2023-12-19T05:20:37.968 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T05:20:37.968 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --verbose --name rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704 -- /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/orig.config.yaml 2023-12-19T05:20:38.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:20:38.094 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704 branch: rishabh-mdscap-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7495704' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPeBqvvW8DTtvuXDBawxojEQ1cjh39iwoN4/skmgEMNEhYsClN7uQ+aEFE12uBDbzeOBF7/A1uPCAr5qmo8E/Q= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ujCLYD6AB0r79A9zyId+NHg2bt9W8ezhnZOxvepu4+42zEsUWq3f7MJNDOyHONjJ4S2nsf3GBamP79sjGqAY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_05:09:22 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T05:20:38.094 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-19T05:20:38.095 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-19T05:20:38.095 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T05:20:38.096 INFO:teuthology.task.internal:Checking packages... 2023-12-19T05:20:38.118 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-19T05:20:38.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T05:20:38.118 INFO:teuthology.packaging:ref: None 2023-12-19T05:20:38.119 INFO:teuthology.packaging:tag: None 2023-12-19T05:20:38.119 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-19T05:20:38.119 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:20:38.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-19T05:20:38.412 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-19T05:20:38.413 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T05:20:38.419 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T05:20:38.419 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T05:20:38.429 INFO:teuthology.task.internal:Saving configuration 2023-12-19T05:20:38.446 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T05:20:38.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:20:38.477 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:55.929794', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPeBqvvW8DTtvuXDBawxojEQ1cjh39iwoN4/skmgEMNEhYsClN7uQ+aEFE12uBDbzeOBF7/A1uPCAr5qmo8E/Q='} 2023-12-19T05:20:38.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:55.928413', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ujCLYD6AB0r79A9zyId+NHg2bt9W8ezhnZOxvepu4+42zEsUWq3f7MJNDOyHONjJ4S2nsf3GBamP79sjGqAY='} 2023-12-19T05:20:38.501 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T05:20:38.507 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-19T05:20:38.507 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-19T05:20:38.508 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T05:20:38.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f83bb4d9dc0>, signals=[15]) 2023-12-19T05:20:38.579 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T05:20:38.585 INFO:teuthology.task.internal:Opening connections... 2023-12-19T05:20:38.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:20:38.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:38.683 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:20:38.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:38.764 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T05:20:38.771 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-12-19T05:20:38.788 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-12-19T05:20:38.788 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2023-12-19T05:20:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T05:20:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-12-19T05:20:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T05:20:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T05:20:38.845 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-12-19T05:20:38.867 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-12-19T05:20:38.884 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-12-19T05:20:38.884 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2023-12-19T05:20:38.941 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T05:20:38.941 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-12-19T05:20:38.941 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:38.941 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T05:20:38.941 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T05:20:38.941 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-12-19T05:20:38.958 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T05:20:38.967 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T05:20:38.972 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T05:20:38.972 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2023-12-19T05:20:38.974 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-12-19T05:20:38.995 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T05:20:39.000 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T05:20:39.000 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2023-12-19T05:20:39.030 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-12-19T05:20:39.140 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T05:20:39.192 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T05:20:39.207 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T05:20:39.207 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-19T05:20:39.207 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-19T05:20:39.207 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T05:20:39.208 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T05:20:39.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:20:39.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T05:20:39.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:20:39.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T05:20:39.408 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:20:39.409 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T05:20:39.409 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-12-19T05:20:39.426 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-361.el9.x86_64 2023-12-19T05:20:39.426 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:20:39.426 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T05:20:39.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum upgrade -y linux-firmware 2023-12-19T05:20:39.548 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:20:39.548 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T05:20:39.548 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-12-19T05:20:39.565 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-361.el9.x86_64 2023-12-19T05:20:39.565 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:20:39.565 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T05:20:39.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum upgrade -y linux-firmware 2023-12-19T05:20:41.668 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-19T05:20:41.948 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.4 MB 00:00 2023-12-19T05:20:43.043 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-12-19T05:20:43.316 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2023-12-19T05:20:45.431 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 7.9 MB 00:01 2023-12-19T05:20:48.742 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 7.9 MB 00:05 2023-12-19T05:20:54.275 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 18 MB 00:07 2023-12-19T05:20:56.875 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 18 MB 00:06 2023-12-19T05:20:59.573 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.8 MB 00:01 2023-12-19T05:21:01.525 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2023-12-19T05:21:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 5.8 MB 00:03 2023-12-19T05:21:05.324 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 20 MB 00:03 2023-12-19T05:21:05.818 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2023-12-19T05:21:07.804 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-19T05:21:10.073 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-19T05:21:12.387 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-12-19T05:21:12.394 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 1 Package 2023-12-19T05:21:12.395 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:21:12.396 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 328 M 2023-12-19T05:21:12.396 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-12-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-19T05:21:15.082 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T05:21:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 1 Package 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 328 M 2023-12-19T05:21:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-19T05:21:25.227 INFO:teuthology.orchestra.run.smithi049.stdout:linux-firmware-20231030-141.el9.noarch.rpm 32 MB/s | 328 MB 00:10 2023-12-19T05:21:25.228 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:21:25.229 INFO:teuthology.orchestra.run.smithi049.stdout:Total 32 MB/s | 328 MB 00:10 2023-12-19T05:21:25.229 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-19T05:21:26.897 INFO:teuthology.orchestra.run.smithi115.stdout:linux-firmware-20231030-141.el9.noarch.rpm 23 MB/s | 328 MB 00:14 2023-12-19T05:21:26.898 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:21:26.899 INFO:teuthology.orchestra.run.smithi115.stdout:Total 23 MB/s | 328 MB 00:14 2023-12-19T05:21:26.899 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-12-19T05:21:26.993 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-12-19T05:21:26.994 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-12-19T05:21:27.539 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-19T05:21:27.539 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-19T05:21:29.146 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-12-19T05:21:29.146 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-12-19T05:21:33.562 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-19T05:21:33.992 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:21:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:34.936 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:34.937 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:21:34.967 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-12-19T05:21:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:21:35.335 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2023-12-19T05:21:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T05:21:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:21:35.335 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-19T05:21:35.345 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:21:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:35.626 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T05:21:35.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:21:35.849 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T05:21:35.850 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T05:21:35.852 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi049.front.sepia.ceph.com to complete... 2023-12-19T05:21:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:21:36.590 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:21:36.590 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:21:36.590 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-12-19T05:21:36.591 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T05:21:36.591 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:21:36.591 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-12-19T05:21:36.892 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T05:21:36.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:21:37.111 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T05:21:37.111 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T05:21:37.113 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi115.front.sepia.ceph.com to complete... 2023-12-19T05:21:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19 05:21:50 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T05:21:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:FINISHED --2023-12-19 05:21:50-- 2023-12-19T05:21:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:Total wall clock time: 15s 2023-12-19T05:21:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:Downloaded: 1 files, 306M in 15s (21.1 MB/s) 2023-12-19T05:21:50.678 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T05:21:50.678 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T05:21:52.627 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying... ######################################## 2023-12-19T05:21:52.686 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing... ######################################## 2023-12-19T05:21:52.772 INFO:teuthology.orchestra.run.smithi049.stdout:Updating / installing... 2023-12-19T05:22:00.172 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T05:22:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T05:22:30.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19 05:22:30 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T05:22:30.648 INFO:teuthology.orchestra.run.smithi115.stderr:FINISHED --2023-12-19 05:22:30-- 2023-12-19T05:22:30.648 INFO:teuthology.orchestra.run.smithi115.stderr:Total wall clock time: 53s 2023-12-19T05:22:30.648 INFO:teuthology.orchestra.run.smithi115.stderr:Downloaded: 1 files, 306M in 53s (5.79 MB/s) 2023-12-19T05:22:30.650 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T05:22:30.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T05:22:32.498 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying... ######################################## 2023-12-19T05:22:32.637 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing... ######################################## 2023-12-19T05:22:32.716 INFO:teuthology.orchestra.run.smithi115.stdout:Updating / installing... 2023-12-19T05:22:37.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T05:22:37.439 DEBUG:teuthology.orchestra.run.smithi049:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T05:22:37.518 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T05:22:37.519 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T05:22:37.520 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T05:22:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T05:22:37.522 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T05:22:37.523 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T05:22:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T05:22:37.525 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T05:22:37.526 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T05:22:37.527 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T05:22:37.528 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T05:22:37.529 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T05:22:37.530 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T05:22:37.531 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T05:22:37.532 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T05:22:37.533 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T05:22:37.534 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T05:22:37.537 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T05:22:37.537 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T05:22:37.538 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T05:22:37.539 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T05:22:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T05:22:37.541 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T05:22:37.542 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T05:22:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T05:22:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T05:22:37.545 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T05:22:37.546 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T05:22:37.547 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T05:22:37.548 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T05:22:37.549 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T05:22:37.550 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T05:22:37.551 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T05:22:37.552 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T05:22:37.553 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T05:22:37.554 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T05:22:37.555 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T05:22:37.556 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T05:22:37.557 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T05:22:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T05:22:37.559 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T05:22:37.560 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T05:22:37.561 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T05:22:37.562 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T05:22:37.563 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T05:22:37.564 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T05:22:37.565 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T05:22:37.566 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T05:22:37.567 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T05:22:37.568 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T05:22:37.569 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T05:22:37.570 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T05:22:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T05:22:37.572 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T05:22:37.573 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T05:22:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T05:22:37.575 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T05:22:37.576 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T05:22:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T05:22:37.578 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T05:22:37.579 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T05:22:37.580 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T05:22:37.581 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T05:22:37.582 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T05:22:37.583 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T05:22:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T05:22:37.585 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T05:22:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T05:22:37.587 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T05:22:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T05:22:37.589 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T05:22:37.590 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T05:22:37.591 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T05:22:37.592 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T05:22:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T05:22:37.594 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T05:22:37.595 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T05:22:37.596 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T05:22:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T05:22:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T05:22:37.599 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T05:22:37.600 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T05:22:37.601 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T05:22:37.602 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T05:22:37.603 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T05:22:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T05:22:37.605 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T05:22:37.606 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T05:22:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T05:22:37.608 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T05:22:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T05:22:37.610 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T05:22:37.611 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T05:22:37.612 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T05:22:37.613 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T05:22:37.614 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T05:22:37.615 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T05:22:37.616 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T05:22:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T05:22:37.618 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T05:22:37.619 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T05:22:37.620 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T05:22:37.621 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T05:22:37.622 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T05:22:37.623 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T05:22:37.624 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T05:22:37.625 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T05:22:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T05:22:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T05:22:37.628 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T05:22:37.629 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T05:22:37.630 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T05:22:37.631 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T05:22:37.632 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T05:22:37.633 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T05:22:37.634 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T05:22:37.635 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T05:22:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T05:22:37.637 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T05:22:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T05:22:37.639 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T05:22:37.640 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T05:22:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T05:22:37.642 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T05:22:37.643 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T05:22:37.644 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T05:22:37.645 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T05:22:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T05:22:37.647 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T05:22:37.648 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T05:22:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T05:22:37.650 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T05:22:37.651 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T05:22:37.652 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T05:22:37.653 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T05:22:37.654 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T05:22:37.655 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.655 DEBUG:teuthology.orchestra.run.smithi049:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:22:37.678 INFO:teuthology.orchestra.run.smithi049.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.679 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2023-12-19T05:22:37.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 68.el9 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8264254 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T05:22:37.760 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:22:37.761 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T05:22:37.762 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T05:22:37.762 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 6.6.0-gcd68252d7b4d 2023-12-19T05:22:37.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T05:22:38.407 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-12-19T05:22:39.756 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T05:22:39.835 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T05:22:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-12-19T05:22:39.857 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-12-19T05:22:39.912 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.N1NfHy4VNE 2023-12-19T05:22:39.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.N1NfHy4VNE 2023-12-19T05:22:39.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.N1NfHy4VNE 2023-12-19T05:22:40.125 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.N1NfHy4VNE is 6KB 2023-12-19T05:22:40.176 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.N1NfHy4VNE 2023-12-19T05:22:40.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T05:22:40.259 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T05:22:40.259 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T05:22:40.259 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T05:22:40.259 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T05:22:40.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T05:22:40.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2023-12-19T05:22:53.832 INFO:teuthology.orchestra.run.smithi115.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T05:23:10.408 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T05:23:10.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:23:10.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:23:15.016 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T05:23:15.016 DEBUG:teuthology.orchestra.run.smithi115:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T05:23:15.089 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T05:23:15.090 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T05:23:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T05:23:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T05:23:15.093 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T05:23:15.094 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T05:23:15.095 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T05:23:15.096 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T05:23:15.097 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T05:23:15.098 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T05:23:15.099 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T05:23:15.100 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T05:23:15.101 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T05:23:15.102 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T05:23:15.103 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T05:23:15.104 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T05:23:15.105 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T05:23:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T05:23:15.107 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T05:23:15.108 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T05:23:15.109 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T05:23:15.110 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T05:23:15.111 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T05:23:15.112 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T05:23:15.113 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T05:23:15.114 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T05:23:15.115 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T05:23:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T05:23:15.117 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T05:23:15.118 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T05:23:15.119 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T05:23:15.120 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T05:23:15.121 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T05:23:15.122 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T05:23:15.123 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T05:23:15.124 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T05:23:15.125 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T05:23:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T05:23:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T05:23:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T05:23:15.129 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T05:23:15.130 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T05:23:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T05:23:15.132 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T05:23:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T05:23:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T05:23:15.135 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T05:23:15.136 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T05:23:15.137 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T05:23:15.138 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T05:23:15.139 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T05:23:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T05:23:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T05:23:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T05:23:15.143 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T05:23:15.144 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T05:23:15.145 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T05:23:15.146 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T05:23:15.147 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T05:23:15.148 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T05:23:15.149 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T05:23:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T05:23:15.151 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T05:23:15.152 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T05:23:15.153 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T05:23:15.154 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T05:23:15.155 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T05:23:15.156 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T05:23:15.157 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T05:23:15.158 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T05:23:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T05:23:15.160 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T05:23:15.161 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T05:23:15.162 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T05:23:15.163 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T05:23:15.164 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T05:23:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T05:23:15.166 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T05:23:15.167 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T05:23:15.170 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T05:23:15.171 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T05:23:15.172 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T05:23:15.173 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T05:23:15.174 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T05:23:15.175 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T05:23:15.176 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T05:23:15.177 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T05:23:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T05:23:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T05:23:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T05:23:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T05:23:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T05:23:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T05:23:15.180 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T05:23:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T05:23:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T05:23:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T05:23:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T05:23:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T05:23:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T05:23:15.187 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T05:23:15.188 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T05:23:15.189 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T05:23:15.190 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T05:23:15.191 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T05:23:15.192 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T05:23:15.193 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T05:23:15.194 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T05:23:15.195 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T05:23:15.196 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T05:23:15.197 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T05:23:15.198 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T05:23:15.199 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T05:23:15.200 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T05:23:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T05:23:15.202 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T05:23:15.203 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T05:23:15.204 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T05:23:15.205 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T05:23:15.206 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T05:23:15.207 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T05:23:15.208 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T05:23:15.209 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T05:23:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T05:23:15.211 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T05:23:15.212 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T05:23:15.213 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T05:23:15.214 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T05:23:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T05:23:15.216 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T05:23:15.217 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T05:23:15.218 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T05:23:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T05:23:15.220 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T05:23:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T05:23:15.222 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T05:23:15.223 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T05:23:15.224 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T05:23:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T05:23:15.226 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T05:23:15.227 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T05:23:15.228 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T05:23:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T05:23:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T05:23:15.231 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T05:23:15.232 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T05:23:15.233 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T05:23:15.234 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T05:23:15.235 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T05:23:15.236 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T05:23:15.237 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T05:23:15.238 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T05:23:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T05:23:15.240 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T05:23:15.241 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T05:23:15.242 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T05:23:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T05:23:15.244 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T05:23:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T05:23:15.246 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T05:23:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T05:23:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T05:23:15.249 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T05:23:15.250 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T05:23:15.251 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T05:23:15.252 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T05:23:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T05:23:15.254 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T05:23:15.255 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T05:23:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T05:23:15.257 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T05:23:15.258 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T05:23:15.259 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T05:23:15.260 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T05:23:15.261 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T05:23:15.262 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T05:23:15.263 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T05:23:15.263 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T05:23:15.263 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T05:23:15.263 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T05:23:15.263 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T05:23:15.263 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.264 DEBUG:teuthology.orchestra.run.smithi115:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T05:23:15.286 INFO:teuthology.orchestra.run.smithi115.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-12-19T05:23:15.287 INFO:teuthology.orchestra.run.smithi115.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T05:23:15.288 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T05:23:15.288 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.288 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-12-19T05:23:15.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2023-12-19T05:23:15.364 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2023-12-19T05:23:15.364 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 68.el9 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8264254 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2023-12-19T05:23:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:23:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T05:23:15.367 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T05:23:15.367 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 6.6.0-gcd68252d7b4d 2023-12-19T05:23:15.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T05:23:15.969 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-12-19T05:23:17.346 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T05:23:17.382 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-12-19T05:23:17.384 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-12-19T05:23:17.399 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.SbrHq3KO6B 2023-12-19T05:23:17.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SbrHq3KO6B 2023-12-19T05:23:17.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.SbrHq3KO6B 2023-12-19T05:23:17.612 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.SbrHq3KO6B is 6KB 2023-12-19T05:23:17.660 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.SbrHq3KO6B 2023-12-19T05:23:17.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T05:23:17.738 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T05:23:17.738 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T05:23:17.738 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T05:23:17.738 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T05:23:17.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T05:23:17.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2023-12-19T05:23:45.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-19T05:23:47.886 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-19T05:23:47.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:23:47.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:23:54.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:23:54.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:23:57.109 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-19T05:24:09.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:24:09.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:24:22.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T05:24:31.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:24:31.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:24:49.809 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T05:25:01.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:25:01.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:04.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T05:25:09.125 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T05:25:19.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:25:19.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:20.244 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-12-19T05:25:20.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:25:20.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-19T05:25:20.884 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-12-19T05:25:20.928 INFO:teuthology.orchestra.run.smithi115.stdout:6.6.0-gcd68252d7b4d 2023-12-19T05:25:20.928 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T05:25:20.928 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T05:25:20.928 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T05:25:21.930 DEBUG:teuthology.parallel:result is None 2023-12-19T05:25:24.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:25:24.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:24.543 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-12-19T05:25:25.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:25:25.269 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T05:25:25.269 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-12-19T05:25:25.328 INFO:teuthology.orchestra.run.smithi049.stdout:6.6.0-gcd68252d7b4d 2023-12-19T05:25:25.328 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T05:25:25.328 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T05:25:25.328 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T05:25:26.329 DEBUG:teuthology.parallel:result is None 2023-12-19T05:25:26.330 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T05:25:26.341 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T05:25:26.341 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T05:25:26.350 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T05:25:26.434 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T05:25:26.441 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T05:25:26.453 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T05:25:26.453 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T05:25:26.461 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T05:25:26.563 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T05:25:26.569 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T05:25:26.570 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T05:25:26.579 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T05:25:26.719 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:26.783 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:26.800 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:26.855 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:26.861 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T05:25:26.869 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T05:25:26.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T05:25:26.878 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T05:25:26.986 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T05:25:26.996 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T05:25:26.996 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T05:25:27.005 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T05:25:27.059 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:27.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:27.306 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:27.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:27.522 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:25:27.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T05:25:27.636 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:27.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:27.798 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:27.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:27.967 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:25:27.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T05:25:28.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2023-12-19T05:25:28.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-12-19T05:25:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:25:28.201 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:25:28.550 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T05:25:28.558 INFO:teuthology.task.internal:Starting timer... 2023-12-19T05:25:28.558 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T05:25:28.580 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T05:25:28.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2023-12-19T05:25:28.736 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2023-12-19T05:25:28.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2023-12-19T05:25:28.975 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2023-12-19T05:25:28.983 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T05:25:28.983 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2023-12-19T05:25:29.067 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2023-12-19T05:25:29.067 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2023-12-19T05:25:29.178 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2023-12-19T05:25:29.179 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2023-12-19T05:25:29.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:25:29.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:29.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:25:29.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:29.367 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T05:25:29.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2023-12-19T05:25:29.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2023-12-19T05:25:29.608 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T05:25:29.618 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-19T05:25:29.623 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-19T05:25:29.763 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T05:25:29.780 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T05:25:29.782 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T05:36:14.264 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2023-12-19T05:36:14.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:36:14.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:36:14.422 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-12-19T05:36:14.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-19T05:36:14.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:36:14.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:36:14.722 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-12-19T05:36:14.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T05:36:14.883 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T05:36:14.893 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T05:36:14.893 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T05:36:14.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:36:14.903 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T05:36:14.904 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:36:15.006 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T05:36:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T05:36:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T05:36:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T05:36:15.144 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2023-12-19T05:36:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2023-12-19T05:36:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2023-12-19T05:36:15.231 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2023-12-19T05:36:15.238 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T05:36:15.291 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T05:36:15.302 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T05:36:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T05:36:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.428 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.506 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.513 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:36:15.514 INFO:teuthology.run_tasks:Running task install... 2023-12-19T05:36:15.523 DEBUG:teuthology.task.install:project ceph 2023-12-19T05:36:15.523 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-19T05:36:15.523 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-19T05:36:15.523 INFO:teuthology.task.install:Using flavor: default 2023-12-19T05:36:15.529 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T05:36:15.529 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T05:36:15.529 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T05:36:15.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:36:15.532 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T05:36:15.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:36:15.675 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T05:36:15.675 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T05:36:15.750 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T05:36:15.751 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T05:36:15.857 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T05:36:15.857 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:36:15.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T05:36:15.859 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T05:36:15.859 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:36:15.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T05:36:15.946 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T05:36:15.947 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T05:36:15.961 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T05:36:15.961 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T05:36:16.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T05:36:16.103 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T05:36:16.217 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T05:36:16.240 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T05:36:16.301 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2023-12-19T05:36:16.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2023-12-19T05:36:16.330 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2023-12-19T05:36:16.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2023-12-19T05:36:16.652 INFO:teuthology.orchestra.run.smithi049.stdout:73 files removed 2023-12-19T05:36:16.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T05:36:16.708 INFO:teuthology.orchestra.run.smithi115.stdout:73 files removed 2023-12-19T05:36:16.749 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T05:36:18.037 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 91 kB/s | 77 kB 00:00 2023-12-19T05:36:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 83 kB/s | 77 kB 00:00 2023-12-19T05:36:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-19T05:36:18.761 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-12-19T05:36:19.255 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2023-12-19T05:36:19.294 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2023-12-19T05:36:20.448 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 5.9 MB/s | 6.4 MB 00:01 2023-12-19T05:36:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - AppStream 5.7 MB/s | 6.4 MB 00:01 2023-12-19T05:36:22.207 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-12-19T05:36:22.217 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-12-19T05:36:23.828 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-12-19T05:36:25.729 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 7.9 MB 00:03 2023-12-19T05:36:33.670 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 18 MB 00:08 2023-12-19T05:36:39.061 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 5.8 MB 00:01 2023-12-19T05:36:40.928 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-12-19T05:36:41.023 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 18 MB 00:14 2023-12-19T05:36:45.530 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 5.8 MB 00:00 2023-12-19T05:36:46.918 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 3.4 MB/s | 20 MB 00:05 2023-12-19T05:36:47.231 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2023-12-19T05:36:48.641 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-19T05:36:52.478 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-12-19T05:36:54.425 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-19T05:36:55.123 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:55.124 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:55.147 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T05:36:55.147 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T05:36:55.147 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:36:55.148 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:55.151 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:55.154 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T05:36:55.155 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:36:55.237 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-12-19T05:36:55.254 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T05:36:55.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T05:36:55.256 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T05:36:55.257 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T05:36:55.258 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T05:36:55.259 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T05:36:55.260 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T05:36:55.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T05:36:55.264 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T05:36:55.265 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T05:36:55.266 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout:Install 139 Packages 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 15 Packages 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:36:55.267 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 200 M 2023-12-19T05:36:55.268 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-12-19T05:36:56.071 INFO:teuthology.orchestra.run.smithi115.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2023-12-19T05:36:56.263 INFO:teuthology.orchestra.run.smithi115.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 4.3 MB/s | 839 kB 00:00 2023-12-19T05:36:56.338 INFO:teuthology.orchestra.run.smithi115.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 1.9 MB/s | 142 kB 00:00 2023-12-19T05:36:56.655 INFO:teuthology.orchestra.run.smithi115.stdout:(4/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 6.7 MB/s | 2.1 MB 00:00 2023-12-19T05:36:56.822 INFO:teuthology.orchestra.run.smithi115.stdout:(5/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 5.1 MB/s | 5.2 MB 00:01 2023-12-19T05:36:56.905 INFO:teuthology.orchestra.run.smithi115.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 5.8 MB/s | 1.4 MB 00:00 2023-12-19T05:36:57.208 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:57.210 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:57.222 INFO:teuthology.orchestra.run.smithi115.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 11 MB/s | 4.4 MB 00:00 2023-12-19T05:36:57.234 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T05:36:57.234 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T05:36:57.235 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:36:57.237 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:57.239 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T05:36:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:36:57.330 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-19T05:36:57.365 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-19T05:36:57.365 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-19T05:36:57.365 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T05:36:57.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T05:36:57.367 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T05:36:57.368 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T05:36:57.369 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T05:36:57.370 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T05:36:57.371 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T05:36:57.372 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T05:36:57.373 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T05:36:57.374 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T05:36:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T05:36:57.376 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T05:36:57.377 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T05:36:57.378 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T05:36:57.378 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T05:36:57.378 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T05:36:57.379 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T05:36:57.380 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout:Install 139 Packages 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 15 Packages 2023-12-19T05:36:57.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:36:57.382 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 200 M 2023-12-19T05:36:57.382 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-19T05:36:57.889 INFO:teuthology.orchestra.run.smithi115.stdout:(8/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 12 MB/s | 7.7 MB 00:00 2023-12-19T05:36:57.956 INFO:teuthology.orchestra.run.smithi115.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 366 kB/s | 24 kB 00:00 2023-12-19T05:36:58.325 INFO:teuthology.orchestra.run.smithi049.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2023-12-19T05:36:58.465 INFO:teuthology.orchestra.run.smithi115.stdout:(10/154): ceph-common-18.2.0-1377.g24e2e32a.el9 6.9 MB/s | 18 MB 00:02 2023-12-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi115.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 2.9 MB/s | 219 kB 00:00 2023-12-19T05:36:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 234 kB/s | 27 kB 00:00 2023-12-19T05:36:58.774 INFO:teuthology.orchestra.run.smithi115.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 268 kB/s | 31 kB 00:00 2023-12-19T05:36:58.859 INFO:teuthology.orchestra.run.smithi049.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.5 MB/s | 839 kB 00:00 2023-12-19T05:36:59.043 INFO:teuthology.orchestra.run.smithi049.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 780 kB/s | 142 kB 00:00 2023-12-19T05:36:59.082 INFO:teuthology.orchestra.run.smithi115.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 2.1 MB/s | 658 kB 00:00 2023-12-19T05:36:59.349 INFO:teuthology.orchestra.run.smithi115.stdout:(15/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 7.2 MB/s | 18 MB 00:02 2023-12-19T05:36:59.383 INFO:teuthology.orchestra.run.smithi115.stdout:(16/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 554 kB/s | 166 kB 00:00 2023-12-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi115.stdout:(17/154): librados-devel-18.2.0-1377.g24e2e32a. 1.7 MB/s | 127 kB 00:00 2023-12-19T05:36:59.526 INFO:teuthology.orchestra.run.smithi049.stdout:(4/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 3.3 MB/s | 5.2 MB 00:01 2023-12-19T05:36:59.533 INFO:teuthology.orchestra.run.smithi115.stdout:(18/154): libradosstriper1-18.2.0-1377.g24e2e32 3.1 MB/s | 474 kB 00:00 2023-12-19T05:36:59.642 INFO:teuthology.orchestra.run.smithi115.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 419 kB/s | 45 kB 00:00 2023-12-19T05:36:59.752 INFO:teuthology.orchestra.run.smithi049.stdout:(5/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 3.0 MB/s | 2.1 MB 00:00 2023-12-19T05:36:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 1.1 MB/s | 124 kB 00:00 2023-12-19T05:36:59.818 INFO:teuthology.orchestra.run.smithi049.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 5.0 MB/s | 1.4 MB 00:00 2023-12-19T05:36:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 1.5 MB/s | 162 kB 00:00 2023-12-19T05:37:00.245 INFO:teuthology.orchestra.run.smithi115.stdout:(22/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 5.4 MB/s | 4.5 MB 00:00 2023-12-19T05:37:00.343 INFO:teuthology.orchestra.run.smithi115.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 2.9 MB/s | 297 kB 00:00 2023-12-19T05:37:00.426 INFO:teuthology.orchestra.run.smithi115.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 99 kB 00:00 2023-12-19T05:37:00.510 INFO:teuthology.orchestra.run.smithi115.stdout:(25/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 87 kB 00:00 2023-12-19T05:37:00.618 INFO:teuthology.orchestra.run.smithi049.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 5.1 MB/s | 4.4 MB 00:00 2023-12-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi115.stdout:(26/154): python3-rados-18.2.0-1377.g24e2e32a.e 391 kB/s | 319 kB 00:00 2023-12-19T05:37:00.802 INFO:teuthology.orchestra.run.smithi115.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.4 MB/s | 171 kB 00:00 2023-12-19T05:37:00.903 INFO:teuthology.orchestra.run.smithi115.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 234 kB/s | 23 kB 00:00 2023-12-19T05:37:01.020 INFO:teuthology.orchestra.run.smithi115.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.1 MB/s | 132 kB 00:00 2023-12-19T05:37:01.262 INFO:teuthology.orchestra.run.smithi115.stdout:(30/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 4.0 MB/s | 3.0 MB 00:00 2023-12-19T05:37:01.736 INFO:teuthology.orchestra.run.smithi049.stdout:(8/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 6.9 MB/s | 7.7 MB 00:01 2023-12-19T05:37:01.786 INFO:teuthology.orchestra.run.smithi049.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 494 kB/s | 24 kB 00:00 2023-12-19T05:37:01.995 INFO:teuthology.orchestra.run.smithi115.stdout:(31/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 9.8 MB/s | 40 MB 00:04 2023-12-19T05:37:02.063 INFO:teuthology.orchestra.run.smithi115.stdout:(32/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 1.7 MB/s | 1.8 MB 00:01 2023-12-19T05:37:02.096 INFO:teuthology.orchestra.run.smithi115.stdout:(33/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.4 MB/s | 242 kB 00:00 2023-12-19T05:37:02.163 INFO:teuthology.orchestra.run.smithi115.stdout:(34/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 505 kB/s | 50 kB 00:00 2023-12-19T05:37:02.188 INFO:teuthology.orchestra.run.smithi115.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 161 kB/s | 15 kB 00:00 2023-12-19T05:37:02.263 INFO:teuthology.orchestra.run.smithi115.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 2.6 MB/s | 262 kB 00:00 2023-12-19T05:37:02.355 INFO:teuthology.orchestra.run.smithi115.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.3 MB/s | 221 kB 00:00 2023-12-19T05:37:02.372 INFO:teuthology.orchestra.run.smithi115.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 168 kB/s | 18 kB 00:00 2023-12-19T05:37:02.624 INFO:teuthology.orchestra.run.smithi115.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2023-12-19T05:37:02.673 INFO:teuthology.orchestra.run.smithi115.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2023-12-19T05:37:02.698 INFO:teuthology.orchestra.run.smithi115.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-19T05:37:02.723 INFO:teuthology.orchestra.run.smithi115.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 444 kB/s | 21 kB 00:00 2023-12-19T05:37:02.757 INFO:teuthology.orchestra.run.smithi115.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-19T05:37:02.769 INFO:teuthology.orchestra.run.smithi049.stdout:(10/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 6.0 MB/s | 18 MB 00:02 2023-12-19T05:37:02.782 INFO:teuthology.orchestra.run.smithi115.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 572 kB/s | 32 kB 00:00 2023-12-19T05:37:02.891 INFO:teuthology.orchestra.run.smithi115.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2023-12-19T05:37:02.894 INFO:teuthology.orchestra.run.smithi049.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.7 MB/s | 219 kB 00:00 2023-12-19T05:37:02.916 INFO:teuthology.orchestra.run.smithi115.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 17 kB 00:00 2023-12-19T05:37:02.953 INFO:teuthology.orchestra.run.smithi049.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 475 kB/s | 27 kB 00:00 2023-12-19T05:37:02.958 INFO:teuthology.orchestra.run.smithi115.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 250 kB/s | 10 kB 00:00 2023-12-19T05:37:02.992 INFO:teuthology.orchestra.run.smithi115.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2023-12-19T05:37:03.012 INFO:teuthology.orchestra.run.smithi049.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 543 kB/s | 31 kB 00:00 2023-12-19T05:37:03.025 INFO:teuthology.orchestra.run.smithi115.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-12-19T05:37:03.051 INFO:teuthology.orchestra.run.smithi115.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 782 kB/s | 44 kB 00:00 2023-12-19T05:37:03.126 INFO:teuthology.orchestra.run.smithi115.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2023-12-19T05:37:03.168 INFO:teuthology.orchestra.run.smithi115.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 5.1 MB/s | 578 kB 00:00 2023-12-19T05:37:03.181 INFO:teuthology.orchestra.run.smithi049.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 3.8 MB/s | 658 kB 00:00 2023-12-19T05:37:03.193 INFO:teuthology.orchestra.run.smithi115.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 403 kB/s | 24 kB 00:00 2023-12-19T05:37:03.245 INFO:teuthology.orchestra.run.smithi049.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 2.6 MB/s | 166 kB 00:00 2023-12-19T05:37:03.312 INFO:teuthology.orchestra.run.smithi049.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 1.9 MB/s | 127 kB 00:00 2023-12-19T05:37:03.318 INFO:teuthology.orchestra.run.smithi115.stdout:(54/154): ceph-mgr-diskprediction-local-18.2.0- 3.6 MB/s | 7.4 MB 00:02 2023-12-19T05:37:03.343 INFO:teuthology.orchestra.run.smithi115.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 266 kB/s | 46 kB 00:00 2023-12-19T05:37:03.377 INFO:teuthology.orchestra.run.smithi115.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 282 kB 00:00 2023-12-19T05:37:03.402 INFO:teuthology.orchestra.run.smithi115.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 624 kB/s | 34 kB 00:00 2023-12-19T05:37:03.421 INFO:teuthology.orchestra.run.smithi049.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 4.3 MB/s | 474 kB 00:00 2023-12-19T05:37:03.452 INFO:teuthology.orchestra.run.smithi115.stdout:(58/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2023-12-19T05:37:03.570 INFO:teuthology.orchestra.run.smithi115.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2023-12-19T05:37:03.636 INFO:teuthology.orchestra.run.smithi115.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2023-12-19T05:37:03.670 INFO:teuthology.orchestra.run.smithi115.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.9 MB/s | 811 kB 00:00 2023-12-19T05:37:03.695 INFO:teuthology.orchestra.run.smithi115.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-12-19T05:37:03.737 INFO:teuthology.orchestra.run.smithi115.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2023-12-19T05:37:03.880 INFO:teuthology.orchestra.run.smithi115.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-12-19T05:37:04.013 INFO:teuthology.orchestra.run.smithi115.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-19T05:37:04.038 INFO:teuthology.orchestra.run.smithi115.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 796 kB/s | 228 kB 00:00 2023-12-19T05:37:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:(18/154): ceph-common-18.2.0-1377.g24e2e32a.el9 3.0 MB/s | 18 MB 00:06 2023-12-19T05:37:04.063 INFO:teuthology.orchestra.run.smithi115.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 144 kB/s | 24 kB 00:00 2023-12-19T05:37:04.122 INFO:teuthology.orchestra.run.smithi115.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 318 kB/s | 18 kB 00:00 2023-12-19T05:37:04.148 INFO:teuthology.orchestra.run.smithi115.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 386 kB/s | 32 kB 00:00 2023-12-19T05:37:04.189 INFO:teuthology.orchestra.run.smithi115.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2023-12-19T05:37:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:(19/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 5.7 MB/s | 4.5 MB 00:00 2023-12-19T05:37:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:(20/154): python3-ceph-argparse-18.2.0-1377.g24 259 kB/s | 45 kB 00:00 2023-12-19T05:37:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:(21/154): python3-ceph-common-18.2.0-1377.g24e2 2.5 MB/s | 124 kB 00:00 2023-12-19T05:37:04.306 INFO:teuthology.orchestra.run.smithi115.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-19T05:37:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 4.2 MB/s | 319 kB 00:00 2023-12-19T05:37:04.331 INFO:teuthology.orchestra.run.smithi115.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2023-12-19T05:37:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:(23/154): python3-cephfs-18.2.0-1377.g24e2e32a. 1.4 MB/s | 162 kB 00:00 2023-12-19T05:37:04.365 INFO:teuthology.orchestra.run.smithi115.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-12-19T05:37:04.390 INFO:teuthology.orchestra.run.smithi115.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-12-19T05:37:04.398 INFO:teuthology.orchestra.run.smithi049.stdout:(24/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 4.4 MB/s | 297 kB 00:00 2023-12-19T05:37:04.407 INFO:teuthology.orchestra.run.smithi115.stdout:(75/154): python3-prettytable-0.7.2-27.el9.noar 566 kB/s | 41 kB 00:00 2023-12-19T05:37:04.441 INFO:teuthology.orchestra.run.smithi115.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-12-19T05:37:04.457 INFO:teuthology.orchestra.run.smithi115.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 738 kB/s | 47 kB 00:00 2023-12-19T05:37:04.483 INFO:teuthology.orchestra.run.smithi115.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-12-19T05:37:04.530 INFO:teuthology.orchestra.run.smithi049.stdout:(25/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 548 kB/s | 99 kB 00:00 2023-12-19T05:37:04.590 INFO:teuthology.orchestra.run.smithi049.stdout:(26/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 454 kB/s | 87 kB 00:00 2023-12-19T05:37:04.633 INFO:teuthology.orchestra.run.smithi115.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 232 kB/s | 39 kB 00:00 2023-12-19T05:37:04.641 INFO:teuthology.orchestra.run.smithi049.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 3.4 MB/s | 171 kB 00:00 2023-12-19T05:37:04.699 INFO:teuthology.orchestra.run.smithi049.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 404 kB/s | 23 kB 00:00 2023-12-19T05:37:04.758 INFO:teuthology.orchestra.run.smithi049.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 2.2 MB/s | 132 kB 00:00 2023-12-19T05:37:04.908 INFO:teuthology.orchestra.run.smithi115.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2023-12-19T05:37:04.925 INFO:teuthology.orchestra.run.smithi115.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 96 kB/s | 41 kB 00:00 2023-12-19T05:37:04.958 INFO:teuthology.orchestra.run.smithi115.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 965 kB/s | 300 kB 00:00 2023-12-19T05:37:04.985 INFO:teuthology.orchestra.run.smithi115.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-12-19T05:37:05.009 INFO:teuthology.orchestra.run.smithi115.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-12-19T05:37:05.034 INFO:teuthology.orchestra.run.smithi115.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 853 kB/s | 63 kB 00:00 2023-12-19T05:37:05.076 INFO:teuthology.orchestra.run.smithi115.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 674 kB/s | 44 kB 00:00 2023-12-19T05:37:05.101 INFO:teuthology.orchestra.run.smithi115.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 871 kB/s | 79 kB 00:00 2023-12-19T05:37:05.152 INFO:teuthology.orchestra.run.smithi115.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-12-19T05:37:05.185 INFO:teuthology.orchestra.run.smithi115.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-12-19T05:37:05.210 INFO:teuthology.orchestra.run.smithi115.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 241 kB 00:00 2023-12-19T05:37:05.225 INFO:teuthology.orchestra.run.smithi049.stdout:(30/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 12 MB/s | 40 MB 00:03 2023-12-19T05:37:05.261 INFO:teuthology.orchestra.run.smithi115.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-19T05:37:05.294 INFO:teuthology.orchestra.run.smithi115.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-19T05:37:05.309 INFO:teuthology.orchestra.run.smithi049.stdout:(31/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 3.2 MB/s | 1.8 MB 00:00 2023-12-19T05:37:05.319 INFO:teuthology.orchestra.run.smithi115.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-19T05:37:05.345 INFO:teuthology.orchestra.run.smithi115.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-12-19T05:37:05.379 INFO:teuthology.orchestra.run.smithi115.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-19T05:37:05.392 INFO:teuthology.orchestra.run.smithi049.stdout:(32/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 3.5 MB/s | 3.0 MB 00:00 2023-12-19T05:37:05.426 INFO:teuthology.orchestra.run.smithi049.stdout:(33/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.0 MB/s | 242 kB 00:00 2023-12-19T05:37:05.459 INFO:teuthology.orchestra.run.smithi049.stdout:(34/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 765 kB/s | 50 kB 00:00 2023-12-19T05:37:05.476 INFO:teuthology.orchestra.run.smithi049.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 297 kB/s | 15 kB 00:00 2023-12-19T05:37:05.560 INFO:teuthology.orchestra.run.smithi049.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 2.6 MB/s | 262 kB 00:00 2023-12-19T05:37:05.594 INFO:teuthology.orchestra.run.smithi049.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.9 MB/s | 221 kB 00:00 2023-12-19T05:37:05.610 INFO:teuthology.orchestra.run.smithi049.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 369 kB/s | 18 kB 00:00 2023-12-19T05:37:05.821 INFO:teuthology.orchestra.run.smithi115.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 251 kB/s | 111 kB 00:00 2023-12-19T05:37:05.886 INFO:teuthology.orchestra.run.smithi049.stdout:(39/154): ceph-mgr-diskprediction-local-18.2.0- 11 MB/s | 7.4 MB 00:00 2023-12-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi115.stdout:(97/154): python3-devel-3.9.17-2.el9.x86_64.rpm 349 kB/s | 245 kB 00:00 2023-12-19T05:37:06.221 INFO:teuthology.orchestra.run.smithi115.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 773 kB/s | 309 kB 00:00 2023-12-19T05:37:06.313 INFO:teuthology.orchestra.run.smithi115.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 285 kB/s | 26 kB 00:00 2023-12-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi049.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 920 kB 00:00 2023-12-19T05:37:06.421 INFO:teuthology.orchestra.run.smithi115.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 452 kB/s | 49 kB 00:00 2023-12-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi049.stdout:(41/154): automake-1.16.2-8.el9.noarch.rpm 721 kB/s | 662 kB 00:00 2023-12-19T05:37:06.545 INFO:teuthology.orchestra.run.smithi049.stdout:(42/154): boost-program-options-1.75.0-8.el9.x8 161 kB/s | 106 kB 00:00 2023-12-19T05:37:06.561 INFO:teuthology.orchestra.run.smithi115.stdout:(101/154): openssl-devel-3.0.7-25.el9.x86_64.rp 3.3 MB/s | 4.1 MB 00:01 2023-12-19T05:37:06.570 INFO:teuthology.orchestra.run.smithi049.stdout:(43/154): elfutils-libelf-devel-0.190-1.el9.x86 86 kB/s | 21 kB 00:00 2023-12-19T05:37:06.589 INFO:teuthology.orchestra.run.smithi115.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 405 kB/s | 67 kB 00:00 2023-12-19T05:37:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:(44/154): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 307 kB 00:00 2023-12-19T05:37:06.762 INFO:teuthology.orchestra.run.smithi049.stdout:(45/154): flexiblas-3.0.4-8.el9.x86_64.rpm 146 kB/s | 32 kB 00:00 2023-12-19T05:37:06.947 INFO:teuthology.orchestra.run.smithi115.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 1.5 MB/s | 548 kB 00:00 2023-12-19T05:37:07.006 INFO:teuthology.orchestra.run.smithi115.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 758 kB/s | 43 kB 00:00 2023-12-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi049.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 63 kB/s | 17 kB 00:00 2023-12-19T05:37:07.081 INFO:teuthology.orchestra.run.smithi115.stdout:(105/154): python3-cachetools-4.2.4-1.el9.noarc 433 kB/s | 32 kB 00:00 2023-12-19T05:37:07.156 INFO:teuthology.orchestra.run.smithi115.stdout:(106/154): python3-certifi-2021.10.8-2.el9.noar 202 kB/s | 15 kB 00:00 2023-12-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi049.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 457 kB/s | 186 kB 00:00 2023-12-19T05:37:07.238 INFO:teuthology.orchestra.run.smithi049.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 45 kB/s | 10 kB 00:00 2023-12-19T05:37:07.240 INFO:teuthology.orchestra.run.smithi115.stdout:(107/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2023-12-19T05:37:07.298 INFO:teuthology.orchestra.run.smithi115.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-12-19T05:37:07.397 INFO:teuthology.orchestra.run.smithi049.stdout:(49/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2023-12-19T05:37:07.430 INFO:teuthology.orchestra.run.smithi049.stdout:(50/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 621 kB/s | 159 kB 00:00 2023-12-19T05:37:07.481 INFO:teuthology.orchestra.run.smithi049.stdout:(51/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 185 kB/s | 44 kB 00:00 2023-12-19T05:37:07.531 INFO:teuthology.orchestra.run.smithi049.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 661 kB 00:00 2023-12-19T05:37:07.573 INFO:teuthology.orchestra.run.smithi049.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 290 kB/s | 24 kB 00:00 2023-12-19T05:37:07.614 INFO:teuthology.orchestra.run.smithi049.stdout:(54/154): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 578 kB 00:00 2023-12-19T05:37:07.648 INFO:teuthology.orchestra.run.smithi049.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 403 kB/s | 46 kB 00:00 2023-12-19T05:37:07.673 INFO:teuthology.orchestra.run.smithi049.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 282 kB 00:00 2023-12-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi115.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 783 kB/s | 358 kB 00:00 2023-12-19T05:37:07.707 INFO:teuthology.orchestra.run.smithi049.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2023-12-19T05:37:07.732 INFO:teuthology.orchestra.run.smithi049.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 618 kB/s | 34 kB 00:00 2023-12-19T05:37:07.733 INFO:teuthology.orchestra.run.smithi115.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 700 kB/s | 303 kB 00:00 2023-12-19T05:37:07.766 INFO:teuthology.orchestra.run.smithi115.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 534 kB/s | 35 kB 00:00 2023-12-19T05:37:07.825 INFO:teuthology.orchestra.run.smithi115.stdout:(112/154): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2023-12-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi115.stdout:(113/154): python3-jaraco-classes-3.2.1-5.el9.n 268 kB/s | 18 kB 00:00 2023-12-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi115.stdout:(114/154): python3-google-auth-2.23.4-1.el9.noa 1.1 MB/s | 197 kB 00:00 2023-12-19T05:37:07.959 INFO:teuthology.orchestra.run.smithi115.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 351 kB/s | 23 kB 00:00 2023-12-19T05:37:07.984 INFO:teuthology.orchestra.run.smithi115.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 293 kB/s | 19 kB 00:00 2023-12-19T05:37:08.033 INFO:teuthology.orchestra.run.smithi049.stdout:(59/154): postgresql-contrib-13.11-1.el9.x86_64 2.7 MB/s | 811 kB 00:00 2023-12-19T05:37:08.043 INFO:teuthology.orchestra.run.smithi115.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2023-12-19T05:37:08.068 INFO:teuthology.orchestra.run.smithi115.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 109 kB/s | 9.0 kB 00:00 2023-12-19T05:37:08.083 INFO:teuthology.orchestra.run.smithi049.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 4.1 MB/s | 1.5 MB 00:00 2023-12-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi115.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 707 kB/s | 41 kB 00:00 2023-12-19T05:37:08.160 INFO:teuthology.orchestra.run.smithi115.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 802 kB/s | 46 kB 00:00 2023-12-19T05:37:08.192 INFO:teuthology.orchestra.run.smithi049.stdout:(61/154): openblas-openmp-0.3.21-2.el9.x86_64.r 9.2 MB/s | 4.7 MB 00:00 2023-12-19T05:37:08.217 INFO:teuthology.orchestra.run.smithi049.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 744 kB/s | 134 kB 00:00 2023-12-19T05:37:08.237 INFO:teuthology.orchestra.run.smithi115.stdout:(121/154): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2023-12-19T05:37:08.335 INFO:teuthology.orchestra.run.smithi115.stdout:(122/154): python3-natsort-7.1.1-5.el9.noarch.r 582 kB/s | 58 kB 00:00 2023-12-19T05:37:08.449 INFO:teuthology.orchestra.run.smithi049.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2023-12-19T05:37:08.476 INFO:teuthology.orchestra.run.smithi049.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 315 kB/s | 78 kB 00:00 2023-12-19T05:37:08.536 INFO:teuthology.orchestra.run.smithi115.stdout:(123/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2023-12-19T05:37:08.603 INFO:teuthology.orchestra.run.smithi115.stdout:(124/154): python3-portend-3.1.0-2.el9.noarch.r 250 kB/s | 16 kB 00:00 2023-12-19T05:37:08.618 INFO:teuthology.orchestra.run.smithi049.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2023-12-19T05:37:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-12-19T05:37:08.660 INFO:teuthology.orchestra.run.smithi049.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 146 kB/s | 24 kB 00:00 2023-12-19T05:37:08.702 INFO:teuthology.orchestra.run.smithi049.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 450 kB/s | 18 kB 00:00 2023-12-19T05:37:08.705 INFO:teuthology.orchestra.run.smithi115.stdout:(125/154): python3-kubernetes-26.1.0-2.el9.noar 1.6 MB/s | 1.0 MB 00:00 2023-12-19T05:37:08.727 INFO:teuthology.orchestra.run.smithi049.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 486 kB/s | 32 kB 00:00 2023-12-19T05:37:08.730 INFO:teuthology.orchestra.run.smithi115.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 710 kB/s | 90 kB 00:00 2023-12-19T05:37:08.773 INFO:teuthology.orchestra.run.smithi115.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 427 kB/s | 28 kB 00:00 2023-12-19T05:37:08.794 INFO:teuthology.orchestra.run.smithi049.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2023-12-19T05:37:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 464 kB/s | 31 kB 00:00 2023-12-19T05:37:08.857 INFO:teuthology.orchestra.run.smithi115.stdout:(129/154): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-19T05:37:08.915 INFO:teuthology.orchestra.run.smithi115.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2023-12-19T05:37:08.919 INFO:teuthology.orchestra.run.smithi049.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2023-12-19T05:37:08.944 INFO:teuthology.orchestra.run.smithi049.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-19T05:37:08.969 INFO:teuthology.orchestra.run.smithi049.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-12-19T05:37:09.003 INFO:teuthology.orchestra.run.smithi049.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 1.3 MB/s | 41 kB 00:00 2023-12-19T05:37:09.037 INFO:teuthology.orchestra.run.smithi049.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-19T05:37:09.041 INFO:teuthology.orchestra.run.smithi115.stdout:(131/154): libarrow-9.0.0-10.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:02 2023-12-19T05:37:09.062 INFO:teuthology.orchestra.run.smithi049.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-12-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi115.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 172 kB/s | 36 kB 00:00 2023-12-19T05:37:09.091 INFO:teuthology.orchestra.run.smithi115.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 292 kB/s | 51 kB 00:00 2023-12-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi049.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 450 kB/s | 47 kB 00:00 2023-12-19T05:37:09.146 INFO:teuthology.orchestra.run.smithi049.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 522 kB/s | 43 kB 00:00 2023-12-19T05:37:09.183 INFO:teuthology.orchestra.run.smithi115.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 772 kB/s | 90 kB 00:00 2023-12-19T05:37:09.258 INFO:teuthology.orchestra.run.smithi115.stdout:(135/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2023-12-19T05:37:09.283 INFO:teuthology.orchestra.run.smithi115.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 201 kB/s | 20 kB 00:00 2023-12-19T05:37:09.434 INFO:teuthology.orchestra.run.smithi115.stdout:(137/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2023-12-19T05:37:09.459 INFO:teuthology.orchestra.run.smithi115.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 959 kB/s | 192 kB 00:00 2023-12-19T05:37:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2023-12-19T05:37:09.554 INFO:teuthology.orchestra.run.smithi049.stdout:(80/154): python3-toml-0.10.2-6.el9.noarch.rpm 91 kB/s | 39 kB 00:00 2023-12-19T05:37:09.579 INFO:teuthology.orchestra.run.smithi049.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 98 kB/s | 41 kB 00:00 2023-12-19T05:37:09.621 INFO:teuthology.orchestra.run.smithi049.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-12-19T05:37:09.647 INFO:teuthology.orchestra.run.smithi049.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-12-19T05:37:09.680 INFO:teuthology.orchestra.run.smithi049.stdout:(84/154): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 300 kB 00:00 2023-12-19T05:37:09.705 INFO:teuthology.orchestra.run.smithi049.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 63 kB 00:00 2023-12-19T05:37:09.756 INFO:teuthology.orchestra.run.smithi049.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 421 kB/s | 44 kB 00:00 2023-12-19T05:37:09.789 INFO:teuthology.orchestra.run.smithi049.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 959 kB/s | 79 kB 00:00 2023-12-19T05:37:09.823 INFO:teuthology.orchestra.run.smithi049.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-12-19T05:37:09.856 INFO:teuthology.orchestra.run.smithi049.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-12-19T05:37:09.877 INFO:teuthology.orchestra.run.smithi115.stdout:(139/154): librados2-18.2.0-1377.g24e2e32a.el9. 7.4 MB/s | 3.3 MB 00:00 2023-12-19T05:37:09.915 INFO:teuthology.orchestra.run.smithi049.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-12-19T05:37:09.948 INFO:teuthology.orchestra.run.smithi049.stdout:(91/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2023-12-19T05:37:09.974 INFO:teuthology.orchestra.run.smithi049.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 882 kB/s | 103 kB 00:00 2023-12-19T05:37:09.991 INFO:teuthology.orchestra.run.smithi115.stdout:(140/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 5.7 MB/s | 3.0 MB 00:00 2023-12-19T05:37:09.999 INFO:teuthology.orchestra.run.smithi049.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-12-19T05:37:10.027 INFO:teuthology.orchestra.run.smithi115.stdout:(141/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 453 kB/s | 68 kB 00:00 2023-12-19T05:37:10.033 INFO:teuthology.orchestra.run.smithi049.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 2.0 MB/s | 113 kB 00:00 2023-12-19T05:37:10.052 INFO:teuthology.orchestra.run.smithi115.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2023-12-19T05:37:10.083 INFO:teuthology.orchestra.run.smithi049.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 1.7 MB/s | 187 kB 00:00 2023-12-19T05:37:10.093 INFO:teuthology.orchestra.run.smithi115.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 558 kB/s | 36 kB 00:00 2023-12-19T05:37:10.136 INFO:teuthology.orchestra.run.smithi115.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2023-12-19T05:37:10.236 INFO:teuthology.orchestra.run.smithi115.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2023-12-19T05:37:10.261 INFO:teuthology.orchestra.run.smithi115.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 176 kB/s | 22 kB 00:00 2023-12-19T05:37:10.312 INFO:teuthology.orchestra.run.smithi115.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-12-19T05:37:10.400 INFO:teuthology.orchestra.run.smithi049.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 351 kB/s | 111 kB 00:00 2023-12-19T05:37:10.420 INFO:teuthology.orchestra.run.smithi115.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2023-12-19T05:37:10.625 INFO:teuthology.orchestra.run.smithi049.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.3 MB/s | 309 kB 00:00 2023-12-19T05:37:10.659 INFO:teuthology.orchestra.run.smithi049.stdout:(98/154): python3-devel-3.9.17-2.el9.x86_64.rpm 393 kB/s | 245 kB 00:00 2023-12-19T05:37:10.793 INFO:teuthology.orchestra.run.smithi049.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 196 kB/s | 26 kB 00:00 2023-12-19T05:37:10.879 INFO:teuthology.orchestra.run.smithi115.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 94 kB/s | 43 kB 00:00 2023-12-19T05:37:10.901 INFO:teuthology.orchestra.run.smithi049.stdout:(100/154): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2023-12-19T05:37:10.926 INFO:teuthology.orchestra.run.smithi049.stdout:(101/154): liboath-2.6.7-2.el9.x86_64.rpm 366 kB/s | 49 kB 00:00 2023-12-19T05:37:10.960 INFO:teuthology.orchestra.run.smithi049.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-12-19T05:37:11.060 INFO:teuthology.orchestra.run.smithi049.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 5.4 MB/s | 548 kB 00:00 2023-12-19T05:37:11.152 INFO:teuthology.orchestra.run.smithi049.stdout:(104/154): openssl-devel-3.0.7-25.el9.x86_64.rp 3.6 MB/s | 4.1 MB 00:01 2023-12-19T05:37:11.178 INFO:teuthology.orchestra.run.smithi049.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 374 kB/s | 43 kB 00:00 2023-12-19T05:37:11.236 INFO:teuthology.orchestra.run.smithi049.stdout:(106/154): python3-certifi-2021.10.8-2.el9.noar 261 kB/s | 15 kB 00:00 2023-12-19T05:37:11.286 INFO:teuthology.orchestra.run.smithi049.stdout:(107/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2023-12-19T05:37:11.313 INFO:teuthology.orchestra.run.smithi049.stdout:(108/154): python3-cachetools-4.2.4-1.el9.noarc 204 kB/s | 32 kB 00:00 2023-12-19T05:37:11.321 INFO:teuthology.orchestra.run.smithi115.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 560 kB/s | 246 kB 00:00 2023-12-19T05:37:11.370 INFO:teuthology.orchestra.run.smithi049.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-12-19T05:37:11.404 INFO:teuthology.orchestra.run.smithi049.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-12-19T05:37:11.438 INFO:teuthology.orchestra.run.smithi049.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 535 kB/s | 35 kB 00:00 2023-12-19T05:37:11.480 INFO:teuthology.orchestra.run.smithi049.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-12-19T05:37:11.513 INFO:teuthology.orchestra.run.smithi049.stdout:(113/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2023-12-19T05:37:11.538 INFO:teuthology.orchestra.run.smithi049.stdout:(114/154): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-12-19T05:37:11.563 INFO:teuthology.orchestra.run.smithi049.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2023-12-19T05:37:11.589 INFO:teuthology.orchestra.run.smithi049.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 472 kB/s | 23 kB 00:00 2023-12-19T05:37:11.606 INFO:teuthology.orchestra.run.smithi049.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 295 kB/s | 19 kB 00:00 2023-12-19T05:37:11.623 INFO:teuthology.orchestra.run.smithi049.stdout:(118/154): python3-jaraco-text-3.2.0-6.el9.noar 338 kB/s | 20 kB 00:00 2023-12-19T05:37:11.678 INFO:teuthology.orchestra.run.smithi049.stdout:(119/154): python3-jwt+crypto-2.4.0-1.el9.noarc 102 kB/s | 9.0 kB 00:00 2023-12-19T05:37:11.706 INFO:teuthology.orchestra.run.smithi049.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 410 kB/s | 41 kB 00:00 2023-12-19T05:37:11.748 INFO:teuthology.orchestra.run.smithi049.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 675 kB/s | 46 kB 00:00 2023-12-19T05:37:11.790 INFO:teuthology.orchestra.run.smithi049.stdout:(122/154): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2023-12-19T05:37:11.796 INFO:teuthology.orchestra.run.smithi115.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 1.5 MB/s | 2.3 MB 00:01 2023-12-19T05:37:11.816 INFO:teuthology.orchestra.run.smithi049.stdout:(123/154): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2023-12-19T05:37:11.841 INFO:teuthology.orchestra.run.smithi049.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 633 kB/s | 58 kB 00:00 2023-12-19T05:37:11.874 INFO:teuthology.orchestra.run.smithi049.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-12-19T05:37:11.902 INFO:teuthology.orchestra.run.smithi049.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 192 kB/s | 16 kB 00:00 2023-12-19T05:37:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2023-12-19T05:37:11.953 INFO:teuthology.orchestra.run.smithi049.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 365 kB/s | 28 kB 00:00 2023-12-19T05:37:11.998 INFO:teuthology.orchestra.run.smithi049.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 323 kB/s | 31 kB 00:00 2023-12-19T05:37:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 714 kB/s | 59 kB 00:00 2023-12-19T05:37:12.070 INFO:teuthology.orchestra.run.smithi049.stdout:(131/154): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2023-12-19T05:37:12.095 INFO:teuthology.orchestra.run.smithi049.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 374 kB/s | 36 kB 00:00 2023-12-19T05:37:12.120 INFO:teuthology.orchestra.run.smithi049.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 614 kB/s | 51 kB 00:00 2023-12-19T05:37:12.154 INFO:teuthology.orchestra.run.smithi049.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-12-19T05:37:12.179 INFO:teuthology.orchestra.run.smithi115.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2023-12-19T05:37:12.188 INFO:teuthology.orchestra.run.smithi049.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 979 kB/s | 90 kB 00:00 2023-12-19T05:37:12.213 INFO:teuthology.orchestra.run.smithi049.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 347 kB/s | 20 kB 00:00 2023-12-19T05:37:12.255 INFO:teuthology.orchestra.run.smithi049.stdout:(137/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2023-12-19T05:37:12.289 INFO:teuthology.orchestra.run.smithi049.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-19T05:37:12.355 INFO:teuthology.orchestra.run.smithi115.stdout:(153/154): NetworkManager-libnm-1.45.7-1.el9.x8 891 kB/s | 1.8 MB 00:02 2023-12-19T05:37:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-19T05:37:12.406 INFO:teuthology.orchestra.run.smithi049.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-19T05:37:12.448 INFO:teuthology.orchestra.run.smithi049.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 69 kB 00:00 2023-12-19T05:37:12.481 INFO:teuthology.orchestra.run.smithi049.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-19T05:37:12.532 INFO:teuthology.orchestra.run.smithi049.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-19T05:37:12.590 INFO:teuthology.orchestra.run.smithi049.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 4.4 MB/s | 255 kB 00:00 2023-12-19T05:37:12.699 INFO:teuthology.orchestra.run.smithi049.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2023-12-19T05:37:12.791 INFO:teuthology.orchestra.run.smithi049.stdout:(146/154): librados2-18.2.0-1377.g24e2e32a.el9. 6.1 MB/s | 3.3 MB 00:00 2023-12-19T05:37:12.825 INFO:teuthology.orchestra.run.smithi049.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2023-12-19T05:37:12.895 INFO:teuthology.orchestra.run.smithi115.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 2.0 MB/s | 2.2 MB 00:01 2023-12-19T05:37:12.913 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:37:12.914 INFO:teuthology.orchestra.run.smithi115.stdout:Total 11 MB/s | 200 MB 00:17 2023-12-19T05:37:12.916 INFO:teuthology.orchestra.run.smithi049.stdout:(148/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 4.8 MB/s | 3.0 MB 00:00 2023-12-19T05:37:13.058 INFO:teuthology.orchestra.run.smithi049.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 306 kB/s | 43 kB 00:00 2023-12-19T05:37:13.167 INFO:teuthology.orchestra.run.smithi049.stdout:(150/154): NetworkManager-libnm-1.45.7-1.el9.x8 5.2 MB/s | 1.8 MB 00:00 2023-12-19T05:37:13.242 INFO:teuthology.orchestra.run.smithi049.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 5.0 MB/s | 2.3 MB 00:00 2023-12-19T05:37:13.301 INFO:teuthology.orchestra.run.smithi049.stdout:(152/154): NetworkManager-tui-1.45.7-1.el9.x86_ 1.0 MB/s | 246 kB 00:00 2023-12-19T05:37:13.334 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-12-19T05:37:13.384 INFO:teuthology.orchestra.run.smithi049.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 5.6 MB/s | 1.2 MB 00:00 2023-12-19T05:37:13.459 INFO:teuthology.orchestra.run.smithi049.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2023-12-19T05:37:13.467 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:37:13.468 INFO:teuthology.orchestra.run.smithi049.stdout:Total 12 MB/s | 200 MB 00:16 2023-12-19T05:37:13.613 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-12-19T05:37:13.614 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-12-19T05:37:13.903 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-19T05:37:14.211 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-19T05:37:14.211 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-19T05:37:15.810 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-12-19T05:37:15.811 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-12-19T05:37:16.496 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-19T05:37:16.496 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-19T05:37:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-12-19T05:37:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T05:37:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T05:37:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T05:37:22.573 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T05:37:22.604 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T05:37:22.720 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T05:37:23.102 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T05:37:23.210 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:23.250 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-19T05:37:23.365 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:23.396 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:23.397 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T05:37:23.434 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T05:37:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:23.509 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T05:37:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:37:23.563 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T05:37:23.593 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T05:37:23.601 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T05:37:23.692 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T05:37:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T05:37:23.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T05:37:23.991 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:24.115 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:24.184 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:37:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:24.371 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:37:24.515 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:24.560 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:37:24.633 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T05:37:24.689 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:37:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:37:24.955 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:24.978 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T05:37:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:25.072 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T05:37:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:37:25.324 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:25.485 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T05:37:25.531 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:37:25.723 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T05:37:25.759 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T05:37:25.817 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T05:37:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:37:25.871 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T05:37:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:37:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T05:37:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T05:37:26.062 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T05:37:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:26.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T05:37:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T05:37:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T05:37:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T05:37:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T05:37:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T05:37:26.654 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:26.853 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T05:37:26.894 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T05:37:27.010 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T05:37:27.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T05:37:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T05:37:27.206 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T05:37:27.265 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T05:37:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T05:37:27.379 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T05:37:27.390 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T05:37:27.450 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T05:37:27.455 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T05:37:27.494 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T05:37:27.532 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T05:37:27.616 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T05:37:27.656 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T05:37:27.664 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T05:37:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T05:37:27.750 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T05:37:27.875 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T05:37:27.965 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T05:37:28.018 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T05:37:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T05:37:28.150 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T05:37:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T05:37:28.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T05:37:28.284 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T05:37:28.375 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T05:37:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T05:37:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T05:37:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T05:37:28.563 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T05:37:28.624 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T05:37:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T05:37:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T05:37:28.885 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T05:37:28.936 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T05:37:28.974 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T05:37:28.977 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T05:37:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T05:37:29.032 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T05:37:29.107 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T05:37:29.149 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T05:37:29.156 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T05:37:29.191 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T05:37:29.248 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T05:37:29.253 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T05:37:29.290 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T05:37:29.329 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T05:37:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T05:37:29.497 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T05:37:29.515 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T05:37:29.554 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T05:37:29.658 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T05:37:29.668 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T05:37:29.719 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T05:37:29.740 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T05:37:29.790 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T05:37:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T05:37:29.919 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T05:37:29.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T05:37:30.012 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T05:37:30.051 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T05:37:30.086 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T05:37:30.101 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T05:37:30.166 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T05:37:30.232 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T05:37:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T05:37:30.318 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T05:37:30.350 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T05:37:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T05:37:30.427 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T05:37:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T05:37:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T05:37:30.490 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T05:37:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T05:37:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T05:37:30.596 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T05:37:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T05:37:30.695 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T05:37:30.739 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T05:37:30.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T05:37:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T05:37:30.787 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T05:37:30.838 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T05:37:30.868 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T05:37:30.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T05:37:30.915 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T05:37:30.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T05:37:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T05:37:31.056 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T05:37:31.091 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T05:37:31.115 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T05:37:31.138 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T05:37:31.183 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T05:37:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T05:37:31.283 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T05:37:31.327 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T05:37:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T05:37:31.548 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T05:37:31.581 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T05:37:31.670 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T05:37:31.870 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T05:37:31.922 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T05:37:31.987 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T05:37:32.034 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T05:37:32.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T05:37:32.126 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T05:37:32.171 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T05:37:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T05:37:32.327 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T05:37:32.398 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T05:37:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T05:37:32.534 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T05:37:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T05:37:32.599 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T05:37:32.636 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T05:37:32.640 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T05:37:32.680 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T05:37:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T05:37:32.748 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T05:37:32.794 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T05:37:32.821 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T05:37:32.866 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T05:37:32.936 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T05:37:32.982 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T05:37:33.104 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T05:37:33.141 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T05:37:33.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T05:37:33.214 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T05:37:33.657 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T05:37:34.267 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T05:37:34.336 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T05:37:34.370 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T05:37:34.430 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T05:37:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T05:37:34.556 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T05:37:34.605 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T05:37:34.700 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T05:37:34.858 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T05:37:34.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T05:37:34.995 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T05:37:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T05:37:36.043 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T05:37:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T05:37:36.342 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T05:37:36.381 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T05:37:36.411 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T05:37:36.484 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T05:37:36.530 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T05:37:36.894 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T05:37:36.925 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:37.045 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:37.072 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T05:37:37.125 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T05:37:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T05:37:37.612 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:37.694 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:37.730 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T05:37:37.758 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T05:37:37.847 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T05:37:37.884 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T05:37:37.915 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T05:37:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T05:37:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T05:37:38.422 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T05:37:38.454 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T05:37:38.656 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T05:37:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T05:37:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T05:37:40.027 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:40.076 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:40.700 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:40.918 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:40.918 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T05:37:40.919 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T05:37:40.919 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:40.964 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:41.884 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:41.955 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:42.624 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:42.675 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:42.866 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:42.866 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T05:37:42.866 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T05:37:42.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:42.926 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:53.577 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:53.577 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2023-12-19T05:37:53.577 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2023-12-19T05:37:53.577 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2023-12-19T05:37:53.578 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2023-12-19T05:37:53.578 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2023-12-19T05:37:53.578 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2023-12-19T05:37:53.578 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2023-12-19T05:37:53.578 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:53.786 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:53.837 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:53.837 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:53.837 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T05:37:53.837 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:55.487 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:55.568 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:55.568 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:55.568 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T05:37:55.568 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:55.569 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:55.569 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2023-12-19T05:37:55.856 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:55.878 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:56.073 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:56.124 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:56.124 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:56.124 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T05:37:56.124 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:56.372 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:56.443 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:56.574 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T05:37:57.175 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:57.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:57.237 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T05:37:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T05:37:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:57.634 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:57.982 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:57.982 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T05:37:57.982 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:57.982 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:58.300 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:58.300 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T05:37:58.300 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:58.300 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:58.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:37:58.959 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:59.061 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T05:37:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T05:37:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:59.247 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:37:59.299 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:59.340 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:59.437 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T05:37:59.745 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:59.780 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:59.861 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T05:38:00.004 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T05:38:00.041 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:38:00.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T05:38:00.251 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:38:00.322 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:38:00.322 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:00.322 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T05:38:00.322 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:38:00.322 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:38:00.323 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:00.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:38:00.388 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:38:00.425 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:38:00.451 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:38:00.451 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:00.451 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T05:38:00.451 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:00.527 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:38:00.609 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:38:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:38:01.079 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:01.079 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T05:38:01.079 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:38:01.079 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:38:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:38:01.642 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:38:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:38:01.986 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T05:38:02.019 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:38:02.100 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:38:02.101 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:02.101 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T05:38:02.101 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:38:02.101 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:38:02.101 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:02.176 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:38:02.217 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:38:02.315 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T05:38:03.182 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T05:38:03.222 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:38:03.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:38:03.458 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:38:03.459 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:03.459 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T05:38:03.459 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:03.540 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:38:03.654 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:38:03.655 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:03.655 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T05:38:03.655 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:38:03.655 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:38:03.655 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:04.033 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:38:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:05.116 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T05:38:05.161 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T05:38:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T05:38:05.282 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T05:38:05.321 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T05:38:05.620 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T05:38:05.747 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T05:38:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T05:38:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T05:38:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T05:38:05.966 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:38:06.006 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T05:38:06.056 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T05:38:06.106 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T05:38:07.143 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:07.273 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:08.400 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T05:38:08.460 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T05:38:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T05:38:08.563 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T05:38:08.634 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T05:38:08.643 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T05:38:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T05:38:08.834 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T05:38:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T05:38:08.974 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T05:38:09.066 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T05:38:09.102 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T05:38:09.105 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T05:38:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T05:38:09.164 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T05:38:09.184 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T05:38:09.198 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T05:38:09.241 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T05:38:09.242 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:38:09.274 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T05:38:09.361 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:38:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:38:09.403 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T05:38:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T05:38:09.457 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T05:38:09.502 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T05:38:09.510 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:38:09.689 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:38:09.720 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:38:09.762 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:09.762 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:10.219 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:10.255 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T05:38:10.324 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T05:38:10.451 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:38:10.534 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:38:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:38:10.716 INFO:teuthology.orchestra.run.smithi115.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T05:38:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:12.096 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T05:38:12.281 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T05:38:12.356 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T05:38:12.527 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T05:38:12.569 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T05:38:12.602 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T05:38:12.637 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T05:38:12.680 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T05:38:12.680 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:38:12.852 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:38:12.905 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T05:38:12.949 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T05:38:12.981 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T05:38:12.982 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:38:13.144 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:38:13.183 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:38:13.226 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:13.227 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:13.591 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:38:13.591 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:13.725 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:13.786 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T05:38:13.819 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T05:38:13.853 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T05:38:13.974 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:38:14.282 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:38:14.282 INFO:teuthology.orchestra.run.smithi049.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T05:38:14.283 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T05:38:15.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T05:38:15.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T05:38:15.340 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T05:38:15.351 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T05:38:15.351 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T05:38:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T05:38:15.353 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T05:38:15.354 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T05:38:15.355 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T05:38:15.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T05:38:15.357 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T05:38:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T05:38:15.359 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T05:38:15.360 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:38:15.361 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T05:38:15.361 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:15.361 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T05:38:15.361 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T05:38:15.361 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T05:38:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T05:38:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T05:38:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-16.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T05:38:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T05:38:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:38:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T05:38:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T05:38:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T05:38:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T05:38:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T05:38:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T05:38:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T05:38:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T05:38:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T05:38:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:17.591 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-12-19T05:38:18.300 DEBUG:teuthology.parallel:result is None 2023-12-19T05:38:19.072 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T05:38:19.072 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T05:38:19.073 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T05:38:19.074 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T05:38:19.075 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T05:38:19.076 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T05:38:19.077 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T05:38:19.078 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T05:38:19.079 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T05:38:19.080 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T05:38:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T05:38:19.082 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T05:38:19.083 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:38:19.084 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T05:38:19.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:38:19.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T05:38:19.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T05:38:19.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.446 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.447 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:38:21.448 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T05:38:21.449 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.6-16.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.450 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T05:38:21.451 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T05:38:21.452 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T05:38:21.453 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T05:38:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T05:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T05:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T05:38:21.457 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.458 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T05:38:21.459 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T05:38:21.460 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T05:38:21.460 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-19T05:38:22.064 DEBUG:teuthology.parallel:result is None 2023-12-19T05:38:22.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:38:22.280 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T05:38:22.340 INFO:teuthology.orchestra.run.smithi049.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T05:38:22.340 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T05:38:22.341 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T05:38:22.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:38:22.557 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T05:38:22.617 INFO:teuthology.orchestra.run.smithi115.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T05:38:22.617 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T05:38:22.617 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T05:38:22.619 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T05:38:22.620 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:22.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T05:38:22.737 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:22.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T05:38:22.826 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T05:38:22.827 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:22.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T05:38:22.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T05:38:23.012 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:23.012 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T05:38:23.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T05:38:23.189 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T05:38:23.190 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:23.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T05:38:23.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T05:38:23.407 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:23.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T05:38:23.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T05:38:23.568 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T05:38:23.568 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:23.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T05:38:23.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T05:38:23.775 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:23.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T05:38:23.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T05:38:23.978 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T05:38:24.064 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T05:38:24.064 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2023-12-19T05:38:24.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-12-19T05:38:24.167 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T05:38:24.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T05:38:24.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T05:38:24.250 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T05:38:24.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T05:38:24.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T05:38:24.342 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T05:38:24.342 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T05:38:24.342 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T05:38:24.342 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:24.343 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T05:38:24.382 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:24.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:24.724 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:24.724 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T05:38:24.777 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:25.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:25.154 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T05:38:25.154 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T05:38:25.155 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7495704', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPeBqvvW8DTtvuXDBawxojEQ1cjh39iwoN4/skmgEMNEhYsClN7uQ+aEFE12uBDbzeOBF7/A1uPCAr5qmo8E/Q=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ujCLYD6AB0r79A9zyId+NHg2bt9W8ezhnZOxvepu4+42zEsUWq3f7MJNDOyHONjJ4S2nsf3GBamP79sjGqAY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_05:09:22', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T05:38:25.155 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T05:38:25.161 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T05:38:25.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T05:38:25.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T05:38:25.319 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:25.319 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T05:38:25.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T05:38:25.362 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2023-12-19T05:38:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T05:38:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:25.443 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-12-19T05:38:25.443 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:25.444 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:25.444 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-19 05:38:14.766901627 +0000 2023-12-19T05:38:25.444 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-19 05:35:22.556074409 +0000 2023-12-19T05:38:25.444 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-19 05:35:22.556074409 +0000 2023-12-19T05:38:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2023-12-19 05:35:22.556074409 +0000 2023-12-19T05:38:25.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T05:38:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-19T05:38:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-19T05:38:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.00025451 s, 2.0 MB/s 2023-12-19T05:38:25.565 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T05:38:25.609 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2023-12-19T05:38:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T05:38:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:25.691 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-12-19T05:38:25.691 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:25.691 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-19 05:38:14.767901600 +0000 2023-12-19T05:38:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-19 05:35:23.651044533 +0000 2023-12-19T05:38:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-19 05:35:23.651044533 +0000 2023-12-19T05:38:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2023-12-19 05:35:23.651044533 +0000 2023-12-19T05:38:25.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T05:38:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-19T05:38:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-19T05:38:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000193401 s, 2.6 MB/s 2023-12-19T05:38:25.807 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T05:38:25.852 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2023-12-19T05:38:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T05:38:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:25.938 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-19T05:38:25.938 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:25.939 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:25.939 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-19 05:38:14.768901572 +0000 2023-12-19T05:38:25.939 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-19 05:35:24.763014193 +0000 2023-12-19T05:38:25.939 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-19 05:35:24.763014193 +0000 2023-12-19T05:38:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2023-12-19 05:35:24.763014193 +0000 2023-12-19T05:38:25.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T05:38:26.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-19T05:38:26.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-19T05:38:26.059 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000202909 s, 2.5 MB/s 2023-12-19T05:38:26.062 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T05:38:26.110 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-19 05:38:14.769901545 +0000 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-19 05:35:25.865984100 +0000 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-19 05:35:25.865984100 +0000 2023-12-19T05:38:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2023-12-19 05:35:25.865984100 +0000 2023-12-19T05:38:26.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T05:38:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-19T05:38:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-19T05:38:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000180009 s, 2.8 MB/s 2023-12-19T05:38:26.279 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T05:38:26.323 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:26.323 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:26.323 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T05:38:26.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T05:38:26.382 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-12-19T05:38:26.433 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T05:38:26.433 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:26.433 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 631 Links: 1 2023-12-19T05:38:26.433 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:26.434 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:26.434 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-12-19 05:38:11.166355004 +0000 2023-12-19T05:38:26.434 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-12-19 05:34:47.689662050 +0000 2023-12-19T05:38:26.434 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-12-19 05:34:47.689662050 +0000 2023-12-19T05:38:26.434 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-12-19 05:34:47.689662050 +0000 2023-12-19T05:38:26.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T05:38:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-12-19T05:38:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-12-19T05:38:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000330346 s, 1.5 MB/s 2023-12-19T05:38:26.519 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T05:38:26.573 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-12-19T05:38:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-12-19 05:38:11.166355004 +0000 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-12-19 05:34:48.725643105 +0000 2023-12-19T05:38:26.623 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-12-19 05:34:48.725643105 +0000 2023-12-19T05:38:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-12-19 05:34:48.725643105 +0000 2023-12-19T05:38:26.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T05:38:26.714 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-12-19T05:38:26.714 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-12-19T05:38:26.714 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000356381 s, 1.4 MB/s 2023-12-19T05:38:26.717 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T05:38:26.771 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-12-19T05:38:26.821 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-12-19 05:38:11.167354985 +0000 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-12-19 05:34:49.803623392 +0000 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-12-19 05:34:49.803623392 +0000 2023-12-19T05:38:26.822 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-12-19 05:34:49.803623392 +0000 2023-12-19T05:38:26.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T05:38:26.905 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-12-19T05:38:26.905 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-12-19T05:38:26.905 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000525113 s, 975 kB/s 2023-12-19T05:38:26.907 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T05:38:26.960 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-12-19 05:38:11.168354967 +0000 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-12-19 05:34:50.855604155 +0000 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-12-19 05:34:50.855604155 +0000 2023-12-19T05:38:27.007 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-12-19 05:34:50.855604155 +0000 2023-12-19T05:38:27.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T05:38:27.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-12-19T05:38:27.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-12-19T05:38:27.142 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000344279 s, 1.5 MB/s 2023-12-19T05:38:27.146 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T05:38:27.204 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:27.204 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T05:38:27.204 INFO:tasks.ceph:Generating config... 2023-12-19T05:38:27.205 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T05:38:27.205 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T05:38:27.205 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T05:38:27.205 INFO:tasks.ceph:[client] pid file = 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.0] debug client = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.1] debug client = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T05:38:27.206 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T05:38:27.207 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T05:38:27.208 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T05:38:27.208 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T05:38:27.208 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-12-19T05:38:27.208 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-12-19T05:38:27.208 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T05:38:27.208 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-12-19T05:38:27.209 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T05:38:27.209 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T05:38:27.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:27.359 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T05:38:27.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T05:38:27.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:27.629 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2023-12-19T05:38:27.630 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T05:38:27.631 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:27.631 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T05:38:27.692 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:27.808 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:27.808 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid e805799f-455a-49b9-9f36-8f2074fd7be4 2023-12-19T05:38:27.808 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = pacific 2023-12-19T05:38:27.808 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2023-12-19T05:38:27.808 INFO:teuthology.orchestra.run.smithi049.stdout:fsid e805799f-455a-49b9-9f36-8f2074fd7be4 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2023-12-19T05:38:27.808138+0000 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-19T05:38:27.808138+0000 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 16 (pacific) 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2023-12-19T05:38:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T05:38:27.811 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T05:38:27.867 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e805799f-455a-49b9-9f36-8f2074fd7be4... 2023-12-19T05:38:27.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T05:38:27.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-12-19T05:38:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = e805799f-455a-49b9-9f36-8f2074fd7be4 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-12-19T05:38:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = bitmap 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2023-12-19T05:38:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: memstore device bytes = 200000000 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 1.0 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: osd mon report interval = 5 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = memstore 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-12-19T05:38:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:38:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2023-12-19T05:38:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull ratio = 0.6 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.7 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.6 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-12-19T05:38:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = "" 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-12-19T05:38:28.064 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug objectcacher = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug objecter = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug objectcacher = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug objecter = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2023-12-19T05:38:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T05:38:28.066 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.067 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T05:38:28.068 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = e805799f-455a-49b9-9f36-8f2074fd7be4 2023-12-19T05:38:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2023-12-19T05:38:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: bdev async discard = True 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: bdev enable discard = True 2023-12-19T05:38:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore allocator = bitmap 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 1/20 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 1/20 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 4/10 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: memstore device bytes = 200000000 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 1.0 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: osd mon report interval = 5 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = memstore 2023-12-19T05:38:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-12-19T05:38:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T05:38:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull ratio = 0.6 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.7 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.6 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T05:38:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-12-19T05:38:28.076 INFO:teuthology.orchestra.run.smithi049.stdout: debug objectcacher = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug objecter = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug objectcacher = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug objecter = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2023-12-19T05:38:28.077 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-12-19T05:38:28.078 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-12-19T05:38:28.078 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-12-19T05:38:28.109 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T05:38:28.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T05:38:28.270 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T05:38:28.270 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:28.270 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T05:38:28.324 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:28.324 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T05:38:28.382 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:38:28.382 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:28.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T05:38:28.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:28.555 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:28.555 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:28.659 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:38:28.659 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:28.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T05:38:28.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:28.823 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:28.823 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:28.921 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T05:38:28.921 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T05:38:28.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T05:38:29.136 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T05:38:29.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T05:38:29.361 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T05:38:29.372 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T05:38:29.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T05:38:29.591 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T05:38:29.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T05:38:29.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T05:38:29.926 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T05:38:29.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T05:38:30.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T05:38:30.236 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T05:38:30.245 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T05:38:30.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T05:38:30.510 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T05:38:30.520 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T05:38:30.613 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T05:38:30.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T05:38:30.762 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T05:38:30.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-19T05:38:30.983 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-19T05:38:31.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T05:38:31.181 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T05:38:31.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-19T05:38:31.356 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-19T05:38:31.407 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T05:38:31.407 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T05:38:31.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:31.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:31.525 INFO:tasks.ceph:role: osd.0 2023-12-19T05:38:31.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:38:31.525 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T05:38:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:31.634 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:31.673 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-12-19T05:38:31.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-12-19T05:38:31.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:31.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:31.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:31.987 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:31.987 INFO:tasks.ceph:role: osd.1 2023-12-19T05:38:31.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:38:31.988 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:32.095 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:32.134 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-12-19T05:38:32.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-12-19T05:38:32.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:32.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:32.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:32.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:32.470 INFO:tasks.ceph:role: osd.2 2023-12-19T05:38:32.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:38:32.471 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:32.576 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:32.577 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:32.577 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:32.613 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-12-19T05:38:32.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-12-19T05:38:32.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:32.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:32.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:32.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:32.913 INFO:tasks.ceph:role: osd.3 2023-12-19T05:38:32.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:38:32.914 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T05:38:33.018 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:33.020 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:33.054 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-12-19T05:38:33.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-12-19T05:38:33.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:33.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:33.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:33.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.416+0000 7fa586269500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T05:38:33.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.417+0000 7fa586269500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T05:38:33.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.420+0000 7fa586269500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:33.442 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:33.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.707+0000 7f038da25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T05:38:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.708+0000 7f038da25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T05:38:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.709+0000 7f038da25500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:33.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:33.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.993+0000 7ff49260c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T05:38:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.994+0000 7ff49260c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T05:38:33.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:33.996+0000 7ff49260c500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:34.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:34.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:34.264+0000 7fbd1af15500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T05:38:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:34.265+0000 7fbd1af15500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T05:38:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:34.267+0000 7fbd1af15500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:34.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:34.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:34.489 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:34.489 INFO:tasks.ceph:role: osd.4 2023-12-19T05:38:34.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:38:34.489 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:34.591 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:34.591 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:34.591 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:35.114 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-12-19T05:38:35.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-12-19T05:38:35.122 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:35.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:35.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:35.490 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:35.490 INFO:tasks.ceph:role: osd.5 2023-12-19T05:38:35.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:38:35.490 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:35.576 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:35.577 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:35.577 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:35.577 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:36.049 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-12-19T05:38:36.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-12-19T05:38:36.056 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:36.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:36.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:36.350 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:36.350 INFO:tasks.ceph:role: osd.6 2023-12-19T05:38:36.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:38:36.350 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T05:38:36.433 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:36.433 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:36.948 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-12-19T05:38:36.953 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-12-19T05:38:36.953 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:37.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:37.246 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:37.342 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:37.342 INFO:tasks.ceph:role: osd.7 2023-12-19T05:38:37.342 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:38:37.343 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:37.444 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:37.899 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-12-19T05:38:37.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-12-19T05:38:37.907 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:38.028 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:38.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.258+0000 7efc46816500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T05:38:38.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.264+0000 7efc46816500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T05:38:38.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.267+0000 7efc46816500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:38.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:38.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:38.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.511+0000 7f5290802500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T05:38:38.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.517+0000 7f5290802500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T05:38:38.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.525+0000 7f5290802500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:38.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:38.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.786+0000 7fa8d5317500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T05:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.787+0000 7fa8d5317500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T05:38:38.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:38.796+0000 7fa8d5317500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:38.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:38.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:39.054+0000 7f13336c7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T05:38:39.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:39.054+0000 7f13336c7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T05:38:39.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:39.056+0000 7f13336c7500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:39.075 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:39.154 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T05:38:39.154 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T05:38:39.273 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T05:38:39.386 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T05:38:39.499 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T05:38:39.610 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T05:38:39.721 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T05:38:39.831 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:39.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T05:38:39.930 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:39.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T05:38:40.034 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T05:38:40.128 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.129 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T05:38:40.225 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T05:38:40.321 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T05:38:40.417 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T05:38:40.512 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T05:38:40.605 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:40.606 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T05:38:40.669 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:40.669 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-19T05:38:40.726 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.726 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T05:38:40.786 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:40.786 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-19T05:38:40.837 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T05:38:40.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T05:38:40.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T05:38:40.937 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-12-19T05:38:40.937 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A== 2023-12-19T05:38:40.937 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-12-19T05:38:40.937 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ== 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw== 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ== 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw== 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-12-19T05:38:40.938 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA== 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2023-12-19T05:38:40.939 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[client.2] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw== 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout:[client.3] 2023-12-19T05:38:40.940 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA== 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A== 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ== 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw== 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2023-12-19T05:38:40.947 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g== 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-12-19T05:38:40.948 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ== 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA== 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA== 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw== 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2023-12-19T05:38:40.949 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg== 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ== 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A== 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw== 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2023-12-19T05:38:40.950 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA== 2023-12-19T05:38:40.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:40.960 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:41.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:41.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:41.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:41.271 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:41.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.588 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.594 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:41.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:42.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:42.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:42.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:42.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:42.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:42.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:42.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:43.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:43.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:43.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:43.844 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T05:38:43.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T05:38:43.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:44.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T05:38:44.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T05:38:44.338 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:44.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T05:38:44.568 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T05:38:44.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:44.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T05:38:44.889 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:44.899 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:44.953 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T05:38:44.954 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T05:38:44.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T05:38:44.960 INFO:tasks.ceph.mon.a:Started 2023-12-19T05:38:44.960 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T05:38:44.960 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T05:38:44.968 INFO:tasks.ceph.mon.b:Started 2023-12-19T05:38:44.968 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T05:38:44.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T05:38:44.976 INFO:tasks.ceph.mon.c:Started 2023-12-19T05:38:44.976 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T05:38:44.977 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T05:38:44.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T05:38:44.982 INFO:tasks.ceph.mgr.y:Started 2023-12-19T05:38:44.982 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T05:38:44.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T05:38:44.987 INFO:tasks.ceph.mgr.x:Started 2023-12-19T05:38:44.987 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T05:38:44.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T05:38:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.176+0000 7fdafeaa1640 1 Processor -- start 2023-12-19T05:38:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.176+0000 7fdafeaa1640 1 -- start start 2023-12-19T05:38:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.177+0000 7fdafeaa1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.177+0000 7fdafeaa1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80cdd80 con 0x7fdaf815d410 2023-12-19T05:38:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.177+0000 7fdafeaa1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80ce8e0 con 0x7fdaf80c81c0 2023-12-19T05:38:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.177+0000 7fdafeaa1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80b2050 con 0x7fdaf815d7f0 2023-12-19T05:38:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdafc83d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdaf815d410 0x7fdaf80b1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42404/0 (socket says 172.21.15.49:42404) 2023-12-19T05:38:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdafc83d640 1 -- 172.21.15.49:0/1163736528 learned_addr learned my addr 172.21.15.49:0/1163736528 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdafd03e640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdaf80c81c0 0x7fdaf8070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59862/0 (socket says 172.21.15.49:59862) 2023-12-19T05:38:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdaf7fff640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdaf80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T05:38:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdaf7fff640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdaf80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T05:38:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T05:38:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.178+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T05:38:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.379+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.380+0000 7fdaf7fff640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdaf80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T05:38:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.380+0000 7fdaf7fff640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdaf80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T05:38:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.380+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T05:38:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.380+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T05:38:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.425+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364964385 0 0) 0x7fdaf80ce8e0 con 0x7fdaf80c81c0 2023-12-19T05:38:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.425+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae8003520 con 0x7fdaf80c81c0 2023-12-19T05:38:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.426+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906470062 0 0) 0x7fdaf80cdd80 con 0x7fdaf815d410 2023-12-19T05:38:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.426+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf80ce8e0 con 0x7fdaf815d410 2023-12-19T05:38:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612535393 0 0) 0x7fdaf80ce8e0 con 0x7fdaf815d410 2023-12-19T05:38:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdaf80d16c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T05:38:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdaf80d16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 >> v1:172.21.15.115:6789/0 conn(0x7fdaf80c81c0 legacy=0x7fdaf8070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80cdfb0 con 0x7fdaf815d410 2023-12-19T05:38:45.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fdaec001670 con 0x7fdaf815d410 2023-12-19T05:38:45.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 >> v1:172.21.15.49:6789/0 conn(0x7fdaf815d410 legacy=0x7fdaf80b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.427+0000 7fdaf77fe640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdae8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdaf77fe640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae8004100 0x7fdae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdaf77fe640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae8004d00 0x7fdae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80b2050 con 0x7fdae8004d00 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae800bbc0 con 0x7fdae8004100 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae800bd80 con 0x7fdaf815d7f0 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.428+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae8004d00 0x7fdae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae8004100 0x7fdae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafc83d640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdae8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafd03e640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 msgr2=0x7fdae8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdaf815d7f0 0x7fdae8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafd03e640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae8004100 msgr2=0x7fdae80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae8004100 0x7fdae80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdafd03e640 1 -- 172.21.15.49:0/1163736528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80ce8e0 con 0x7fdae8004d00 2023-12-19T05:38:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.429+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae8004100 0x7fdae80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.431+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae8004d00 0x7fdae8005180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80c8650 tx=0x7fdae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb09019a2c76816 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.432+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0004d60 con 0x7fdae8004d00 2023-12-19T05:38:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.432+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf002c570 con 0x7fdae8004d00 2023-12-19T05:38:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.432+0000 7fdaf77fe640 1 -- 172.21.15.49:0/1163736528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf002c940 con 0x7fdae8004d00 2023-12-19T05:38:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.433+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1163736528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae8004d00 msgr2=0x7fdae8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.433+0000 7fdafeaa1640 1 --2- 172.21.15.49:0/1163736528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae8004d00 0x7fdae8005180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80c8650 tx=0x7fdae80057f0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.433+0000 7fdafd03e640 1 -- 172.21.15.49:0/1163736528 reap_dead start 2023-12-19T05:38:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.434+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1163736528 shutdown_connections 2023-12-19T05:38:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.434+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1163736528 >> 172.21.15.49:0/1163736528 conn(0x7fdaf80cfd80 msgr2=0x7fdaf80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.434+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1163736528 shutdown_connections 2023-12-19T05:38:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.434+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1163736528 wait complete. 2023-12-19T05:38:45.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.438+0000 7fdafeaa1640 1 Processor -- start 2023-12-19T05:38:45.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.438+0000 7fdafeaa1640 1 -- start start 2023-12-19T05:38:45.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.439+0000 7fdafeaa1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae8004d00 0x7fdaf80ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.439+0000 7fdafeaa1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaf81501c0 0x7fdaf815f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.439+0000 7fdafeaa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafeaa1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8160160 con 0x7fdaf815fce0 2023-12-19T05:38:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafeaa1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80cb1f0 con 0x7fdaf81501c0 2023-12-19T05:38:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafeaa1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80ca950 con 0x7fdae8004d00 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafd03e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafc83d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae8004d00 0x7fdaf80ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafd03e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41338/0 (socket says 172.21.15.49:41338) 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdafd03e640 1 -- 172.21.15.49:0/1312316095 learned_addr learned my addr 172.21.15.49:0/1312316095 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.440+0000 7fdaf7fff640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaf81501c0 0x7fdaf815f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 -- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae8004d00 msgr2=0x7fdaf80ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae8004d00 0x7fdaf80ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 -- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaf81501c0 msgr2=0x7fdaf815f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaf81501c0 0x7fdaf815f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 -- 172.21.15.49:0/1312316095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80cac30 con 0x7fdaf815fce0 2023-12-19T05:38:45.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.441+0000 7fdafd03e640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00020f0 tx=0x7fdaf00016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:45.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.444+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf003c040 con 0x7fdaf815fce0 2023-12-19T05:38:45.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.444+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf80caf10 con 0x7fdaf815fce0 2023-12-19T05:38:45.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.444+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf002cbb0 con 0x7fdaf815fce0 2023-12-19T05:38:45.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.444+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0007070 con 0x7fdaf815fce0 2023-12-19T05:38:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.444+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf8150640 con 0x7fdaf815fce0 2023-12-19T05:38:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.445+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdaf00071d0 con 0x7fdaf815fce0 2023-12-19T05:38:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.445+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdaf0042940 con 0x7fdaf815fce0 2023-12-19T05:38:45.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.446+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf81f6680 con 0x7fdaf815fce0 2023-12-19T05:38:45.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.452+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fdaf81f6680 con 0x7fdaf815fce0 2023-12-19T05:38:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.528+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdaf8061910 con 0x7fdaf815fce0 2023-12-19T05:38:45.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.535+0000 7fdaf57fa640 1 -- 172.21.15.49:0/1312316095 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdaf0051090 con 0x7fdaf815fce0 2023-12-19T05:38:45.536 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2023-12-19T05:38:45.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 msgr2=0x7fdaf81f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:45.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00020f0 tx=0x7fdaf00016c0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 shutdown_connections 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaf815fce0 0x7fdaf81f6960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaf81501c0 0x7fdaf815f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 --2- 172.21.15.49:0/1312316095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae8004d00 0x7fdaf80ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 >> 172.21.15.49:0/1312316095 conn(0x7fdaf80cfd80 msgr2=0x7fdaf815c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 shutdown_connections 2023-12-19T05:38:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:45.536+0000 7fdafeaa1640 1 -- 172.21.15.49:0/1312316095 wait complete. 2023-12-19T05:38:45.556 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T05:38:45.556 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T05:38:45.556 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:45.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T05:38:45.644 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:45.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T05:38:45.782 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:45.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T05:38:45.877 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:38:45.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T05:38:46.000 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:45.998+0000 7f15d3c40040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T05:38:46.014 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:46.014 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T05:38:46.063 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.062+0000 7f338040f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T05:38:46.066 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.065+0000 7f15d3c40040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T05:38:46.104 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:46.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T05:38:46.125 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.124+0000 7f338040f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T05:38:46.182 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:46.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T05:38:46.312 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:38:46.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T05:38:46.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-12-19T05:38:46.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.664+0000 7f760c927640 1 Processor -- start 2023-12-19T05:38:46.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.664+0000 7f760c927640 1 -- start start 2023-12-19T05:38:46.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.665+0000 7f760c927640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f760815e7a0 0x7f76080cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.665+0000 7f760c927640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76080ce1e0 0x7f760815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.665+0000 7f760c927640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080ce9d0 con 0x7f76080d01b0 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.665+0000 7f760c927640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76080ce6f0 con 0x7f76080ce1e0 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.665+0000 7f760c927640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760815dcc0 con 0x7f760815e7a0 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f760659c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f76080d01b0 0x7f76080d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58564/0 (socket says 172.21.15.115:58564) 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f760659c640 1 -- 172.21.15.115:0/4166075363 learned_addr learned my addr 172.21.15.115:0/4166075363 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f75fffff640 1 --2- 172.21.15.115:0/4166075363 >> v2:172.21.15.115:3300/0 conn(0x7f760815e7a0 0x7f76080cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f75fffff640 1 -- 172.21.15.115:0/4166075363 >> v2:172.21.15.49:3300/0 conn(0x7f76080ce1e0 msgr2=0x7f760815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f75fffff640 1 --2- 172.21.15.115:0/4166075363 >> v2:172.21.15.49:3300/0 conn(0x7f76080ce1e0 0x7f760815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f75fffff640 1 -- 172.21.15.115:0/4166075363 >> v1:172.21.15.115:6789/0 conn(0x7f76080d01b0 legacy=0x7f76080d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.666+0000 7f75fffff640 1 -- 172.21.15.115:0/4166075363 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760815dfa0 con 0x7f760815e7a0 2023-12-19T05:38:46.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.667+0000 7f75fffff640 1 --2- 172.21.15.115:0/4166075363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760815e7a0 0x7f76080cdca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76080d0e40 tx=0x7f75f002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c2a19924f41cacd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:46.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f7605d9b640 1 -- 172.21.15.115:0/4166075363 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0031830 con 0x7f760815e7a0 2023-12-19T05:38:46.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f7605d9b640 1 -- 172.21.15.115:0/4166075363 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0031990 con 0x7f760815e7a0 2023-12-19T05:38:46.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f7605d9b640 1 -- 172.21.15.115:0/4166075363 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0031d20 con 0x7f760815e7a0 2023-12-19T05:38:46.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 -- 172.21.15.115:0/4166075363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760815e7a0 msgr2=0x7f76080cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 --2- 172.21.15.115:0/4166075363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760815e7a0 0x7f76080cdca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76080d0e40 tx=0x7f75f002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 -- 172.21.15.115:0/4166075363 shutdown_connections 2023-12-19T05:38:46.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 --2- 172.21.15.115:0/4166075363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760815e7a0 0x7f76080cdca0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 --2- 172.21.15.115:0/4166075363 >> v2:172.21.15.49:3300/0 conn(0x7f76080ce1e0 0x7f760815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.668+0000 7f760c927640 1 -- 172.21.15.115:0/4166075363 >> 172.21.15.115:0/4166075363 conn(0x7f76080b27a0 msgr2=0x7f76080b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:46.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.669+0000 7f760c927640 1 -- 172.21.15.115:0/4166075363 shutdown_connections 2023-12-19T05:38:46.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.669+0000 7f760c927640 1 -- 172.21.15.115:0/4166075363 wait complete. 2023-12-19T05:38:46.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.670+0000 7f760c927640 1 Processor -- start 2023-12-19T05:38:46.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.670+0000 7f760c927640 1 -- start start 2023-12-19T05:38:46.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76080ce1e0 0x7f76081f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f760815e7a0 0x7f7608149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b6b70 con 0x7f760815e7a0 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b6e50 con 0x7f76080ce1e0 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.671+0000 7f760c927640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b7130 con 0x7f76080d01b0 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f760659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76080ce1e0 0x7f76081f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35392/0 (socket says 172.21.15.115:35392) 2023-12-19T05:38:46.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 -- 172.21.15.115:0/1988534897 learned_addr learned my addr 172.21.15.115:0/1988534897 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f7606d9d640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f760815e7a0 0x7f7608149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 -- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76080ce1e0 msgr2=0x7f76081f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76080ce1e0 0x7f76081f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 -- 172.21.15.115:0/1988534897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f760815e7a0 msgr2=0x7f7608149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f760815e7a0 0x7f7608149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 -- 172.21.15.115:0/1988534897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009400 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.672+0000 7f75fffff640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75f0000c00 tx=0x7f75f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f003ba70 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f003bbd0 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76080b7410 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00453f0 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76080b7c10 con 0x7f76080d01b0 2023-12-19T05:38:46.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f75f0045850 con 0x7f76080d01b0 2023-12-19T05:38:46.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.673+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f75f004e850 con 0x7f76080d01b0 2023-12-19T05:38:46.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.674+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080b7930 con 0x7f76080d01b0 2023-12-19T05:38:46.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.677+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f76080b7930 con 0x7f76080d01b0 2023-12-19T05:38:46.714 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.712+0000 7f15d3c40040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T05:38:46.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.755+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f7608061910 con 0x7f76080d01b0 2023-12-19T05:38:46.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.761+0000 7f75feffd640 1 -- 172.21.15.115:0/1988534897 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75f0035020 con 0x7f76080d01b0 2023-12-19T05:38:46.763 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-12-19T05:38:46.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 msgr2=0x7f76080b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75f0000c00 tx=0x7f75f00046c0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 shutdown_connections 2023-12-19T05:38:46.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76080d01b0 0x7f76080b6200 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f760815e7a0 0x7f7608149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 --2- 172.21.15.115:0/1988534897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76080ce1e0 0x7f76081f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 >> 172.21.15.115:0/1988534897 conn(0x7f76080b27a0 msgr2=0x7f76080d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:46.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 shutdown_connections 2023-12-19T05:38:46.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.763+0000 7f760c927640 1 -- 172.21.15.115:0/1988534897 wait complete. 2023-12-19T05:38:46.768 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.767+0000 7f338040f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T05:38:46.779 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.777+0000 7f15d3c40040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T05:38:46.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-12-19T05:38:46.834 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.833+0000 7f338040f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T05:38:46.838 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.836+0000 7f15d3c40040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T05:38:46.888 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.887+0000 7f338040f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T05:38:46.902 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.901+0000 7f15d3c40040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T05:38:46.954 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:46.952+0000 7f15d3c40040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T05:38:46.955 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:46.953+0000 7f338040f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T05:38:46.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.972+0000 7f6b585f6640 1 Processor -- start 2023-12-19T05:38:46.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.972+0000 7f6b585f6640 1 -- start start 2023-12-19T05:38:46.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.973+0000 7f6b585f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.973+0000 7f6b585f6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 0x7f6b500cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.973+0000 7f6b585f6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5015ece0 con 0x7f6b500ce1e0 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.973+0000 7f6b585f6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b500ce9d0 con 0x7f6b500d0590 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.973+0000 7f6b585f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500ce6f0 con 0x7f6b500d01b0 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35398/0 (socket says 172.21.15.115:35398) 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 -- 172.21.15.115:0/2253261123 learned_addr learned my addr 172.21.15.115:0/2253261123 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:46.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b55b91640 1 --2- 172.21.15.115:0/2253261123 >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 0x7f6b500cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 -- 172.21.15.115:0/2253261123 >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 msgr2=0x7f6b500cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 --2- 172.21.15.115:0/2253261123 >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 0x7f6b500cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 -- 172.21.15.115:0/2253261123 >> v1:172.21.15.115:6789/0 conn(0x7f6b500ce1e0 legacy=0x7f6b5015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b56392640 1 -- 172.21.15.115:0/2253261123 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5015dcc0 con 0x7f6b500d01b0 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.974+0000 7f6b55b91640 1 --2- 172.21.15.115:0/2253261123 >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 0x7f6b500cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:46.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.975+0000 7f6b56392640 1 --2- 172.21.15.115:0/2253261123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009870 tx=0x7f6b4c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0bea384050a1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:46.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.976+0000 7f6b55390640 1 -- 172.21.15.115:0/2253261123 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c030840 con 0x7f6b500d01b0 2023-12-19T05:38:46.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.976+0000 7f6b55390640 1 -- 172.21.15.115:0/2253261123 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c0309a0 con 0x7f6b500d01b0 2023-12-19T05:38:46.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.976+0000 7f6b55390640 1 -- 172.21.15.115:0/2253261123 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c030d30 con 0x7f6b500d01b0 2023-12-19T05:38:46.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.976+0000 7f6b585f6640 1 -- 172.21.15.115:0/2253261123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 msgr2=0x7f6b5015e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.976+0000 7f6b585f6640 1 --2- 172.21.15.115:0/2253261123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009870 tx=0x7f6b4c02b980 comp rx=0 tx=0).stop 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 -- 172.21.15.115:0/2253261123 shutdown_connections 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 --2- 172.21.15.115:0/2253261123 >> v2:172.21.15.115:3300/0 conn(0x7f6b500d0590 0x7f6b500cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 --2- 172.21.15.115:0/2253261123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500d01b0 0x7f6b5015e7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 -- 172.21.15.115:0/2253261123 >> 172.21.15.115:0/2253261123 conn(0x7f6b500b27a0 msgr2=0x7f6b500b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 -- 172.21.15.115:0/2253261123 shutdown_connections 2023-12-19T05:38:46.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.977+0000 7f6b585f6640 1 -- 172.21.15.115:0/2253261123 wait complete. 2023-12-19T05:38:46.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.979+0000 7f6b585f6640 1 Processor -- start 2023-12-19T05:38:46.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.979+0000 7f6b585f6640 1 -- start start 2023-12-19T05:38:46.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b500d01b0 0x7f6b500b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:46.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500b7140 con 0x7f6b500d01b0 2023-12-19T05:38:46.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b501474f0 con 0x7f6b500d0590 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b585f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500b8b30 con 0x7f6b500ce1e0 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b56392640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b56b93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b56b93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60372/0 (socket says 172.21.15.115:60372) 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b56392640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35408/0 (socket says 172.21.15.115:35408) 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b56b93640 1 -- 172.21.15.115:0/1702971809 learned_addr learned my addr 172.21.15.115:0/1702971809 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.980+0000 7f6b55b91640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b500d01b0 0x7f6b500b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 -- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 msgr2=0x7f6b50146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 -- 172.21.15.115:0/1702971809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b500d01b0 msgr2=0x7f6b500b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b500d01b0 0x7f6b500b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 -- 172.21.15.115:0/1702971809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40009400 con 0x7f6b500d0590 2023-12-19T05:38:46.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56392640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:46.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b56b93640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c7a0 tx=0x7f6b4800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:46.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48003b70 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48003cf0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48003ea0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.981+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c0094d0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.982+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b500b90f0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.982+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b480050d0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.982+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6b480124c0 con 0x7f6b500d0590 2023-12-19T05:38:46.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.983+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b500b72b0 con 0x7f6b500d0590 2023-12-19T05:38:46.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:46.988+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f6b48005560 con 0x7f6b500d0590 2023-12-19T05:38:47.007 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.006+0000 7f338040f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T05:38:47.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.066+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f6b50061910 con 0x7f6b500d0590 2023-12-19T05:38:47.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.073+0000 7f6b46ffd640 1 -- 172.21.15.115:0/1702971809 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b48005700 con 0x7f6b500d0590 2023-12-19T05:38:47.075 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 msgr2=0x7f6b50152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c7a0 tx=0x7f6b4800cc60 comp rx=0 tx=0).stop 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 shutdown_connections 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b500d0590 0x7f6b50152ee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b500d01b0 0x7f6b500b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 --2- 172.21.15.115:0/1702971809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b500ce1e0 0x7f6b50146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 >> 172.21.15.115:0/1702971809 conn(0x7f6b500b27a0 msgr2=0x7f6b500b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 shutdown_connections 2023-12-19T05:38:47.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.075+0000 7f6b585f6640 1 -- 172.21.15.115:0/1702971809 wait complete. 2023-12-19T05:38:47.083 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.081+0000 7f15d3c40040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T05:38:47.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-12-19T05:38:47.127 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.126+0000 7f338040f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T05:38:47.171 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.169+0000 7f15d3c40040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:47.213 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.211+0000 7f338040f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:47.228 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.226+0000 7f15d3c40040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T05:38:47.269 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.268+0000 7f338040f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T05:38:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.288+0000 7f3a815fd640 1 Processor -- start 2023-12-19T05:38:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.288+0000 7f3a815fd640 1 -- start start 2023-12-19T05:38:47.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f15d3c40040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a7c1578f0 0x7f3a7c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a7c06da80 0x7f3a7c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 0x7f3a7c070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c15eb40 con 0x7f3a7c1578f0 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c070530 con 0x7f3a7c06da80 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.289+0000 7f3a815fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c15e580 con 0x7f3a7c15e070 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a7c06da80 0x7f3a7c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a80dfc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 0x7f3a7c070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a7c06da80 0x7f3a7c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60388/0 (socket says 172.21.15.115:60388) 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/2196400550 learned_addr learned my addr 172.21.15.115:0/2196400550 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7bfff640 1 --2- 172.21.15.115:0/2196400550 >> v2:172.21.15.49:3300/0 conn(0x7f3a7c1578f0 0x7f3a7c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 msgr2=0x7f3a7c070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 0x7f3a7c070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/2196400550 >> v2:172.21.15.49:3300/0 conn(0x7f3a7c1578f0 msgr2=0x7f3a7c06d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/2196400550 >> v2:172.21.15.49:3300/0 conn(0x7f3a7c1578f0 0x7f3a7c06d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/2196400550 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c15e860 con 0x7f3a7c06da80 2023-12-19T05:38:47.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.290+0000 7f3a80dfc640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 0x7f3a7c070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:47.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.291+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c15db30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0d07c0 tx=0x7f3a7002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd2aee56a6623961 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.291+0000 7f3a7affd640 1 -- 172.21.15.115:0/2196400550 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700317e0 con 0x7f3a7c06da80 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.291+0000 7f3a7affd640 1 -- 172.21.15.115:0/2196400550 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70031940 con 0x7f3a7c06da80 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.291+0000 7f3a7affd640 1 -- 172.21.15.115:0/2196400550 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70031cd0 con 0x7f3a7c06da80 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 -- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 msgr2=0x7f3a7c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c15db30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0d07c0 tx=0x7f3a7002b880 comp rx=0 tx=0).stop 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 -- 172.21.15.115:0/2196400550 shutdown_connections 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c15e070 0x7f3a7c070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 --2- 172.21.15.115:0/2196400550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c15db30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 --2- 172.21.15.115:0/2196400550 >> v2:172.21.15.49:3300/0 conn(0x7f3a7c1578f0 0x7f3a7c06d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 -- 172.21.15.115:0/2196400550 >> 172.21.15.115:0/2196400550 conn(0x7f3a7c06f160 msgr2=0x7f3a7c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 -- 172.21.15.115:0/2196400550 shutdown_connections 2023-12-19T05:38:47.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.292+0000 7f3a815fd640 1 -- 172.21.15.115:0/2196400550 wait complete. 2023-12-19T05:38:47.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.294+0000 7f3a815fd640 1 Processor -- start 2023-12-19T05:38:47.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.294+0000 7f3a815fd640 1 -- start start 2023-12-19T05:38:47.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a7c15e070 0x7f3a7c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ca330 con 0x7f3a7c15e070 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ca5d0 con 0x7f3a7c06da80 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a815fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ca8b0 con 0x7f3a7c1578f0 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a7b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a7b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35426/0 (socket says 172.21.15.115:35426) 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/1542894542 learned_addr learned my addr 172.21.15.115:0/1542894542 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.295+0000 7f3a80dfc640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a7c15e070 0x7f3a7c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 msgr2=0x7f3a7c0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c0a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/1542894542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a7c15e070 msgr2=0x7f3a7c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a7c15e070 0x7f3a7c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 -- 172.21.15.115:0/1542894542 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009a70 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a7b7fe640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000c00 tx=0x7f3a700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70032880 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70032a20 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70032dd0 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700094d0 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.296+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c0cae70 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.297+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a7004e750 con 0x7f3a7c1578f0 2023-12-19T05:38:47.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.297+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3a700454e0 con 0x7f3a7c1578f0 2023-12-19T05:38:47.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.297+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c066a60 con 0x7f3a7c1578f0 2023-12-19T05:38:47.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.300+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3a70063b10 con 0x7f3a7c1578f0 2023-12-19T05:38:47.333 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.332+0000 7f338040f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T05:38:47.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.347+0000 7f15d3c40040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T05:38:47.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.378+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f3a7c0cb060 con 0x7f3a7c1578f0 2023-12-19T05:38:47.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.385+0000 7f3a78ff9640 1 -- 172.21.15.115:0/1542894542 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a70052020 con 0x7f3a7c1578f0 2023-12-19T05:38:47.386 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 msgr2=0x7f3a7c15a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000c00 tx=0x7f3a700046c0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 shutdown_connections 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a7c1578f0 0x7f3a7c15a110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a7c15e070 0x7f3a7c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 --2- 172.21.15.115:0/1542894542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a7c06da80 0x7f3a7c0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 >> 172.21.15.115:0/1542894542 conn(0x7f3a7c06f160 msgr2=0x7f3a7c0659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 shutdown_connections 2023-12-19T05:38:47.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.386+0000 7f3a815fd640 1 -- 172.21.15.115:0/1542894542 wait complete. 2023-12-19T05:38:47.392 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.390+0000 7f338040f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T05:38:47.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-12-19T05:38:47.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.589+0000 7f86ce6ec640 1 Processor -- start 2023-12-19T05:38:47.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.589+0000 7f86ce6ec640 1 -- start start 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ce6ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86c80b5cd0 0x7f86c80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ce6ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86c80b4490 0x7f86c80b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ce6ec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80b6670 con 0x7f86c8140360 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ce6ec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8140740 con 0x7f86c80b5cd0 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ce6ec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8143990 con 0x7f86c80b4490 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cd6ea640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f86c8140360 0x7f86c80b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58588/0 (socket says 172.21.15.115:58588) 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cd6ea640 1 -- 172.21.15.115:0/1819366366 learned_addr learned my addr 172.21.15.115:0/1819366366 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cdeeb640 1 --2- 172.21.15.115:0/1819366366 >> v2:172.21.15.115:3300/0 conn(0x7f86c80b4490 0x7f86c80b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86ccee9640 1 --2- 172.21.15.115:0/1819366366 >> v2:172.21.15.49:3300/0 conn(0x7f86c80b5cd0 0x7f86c80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cdeeb640 1 -- 172.21.15.115:0/1819366366 >> v2:172.21.15.49:3300/0 conn(0x7f86c80b5cd0 msgr2=0x7f86c80b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:47.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cdeeb640 1 --2- 172.21.15.115:0/1819366366 >> v2:172.21.15.49:3300/0 conn(0x7f86c80b5cd0 0x7f86c80b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cdeeb640 1 -- 172.21.15.115:0/1819366366 >> v1:172.21.15.115:6789/0 conn(0x7f86c8140360 legacy=0x7f86c80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.591+0000 7f86cdeeb640 1 -- 172.21.15.115:0/1819366366 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8142e10 con 0x7f86c80b4490 2023-12-19T05:38:47.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.593+0000 7f86cdeeb640 1 --2- 172.21.15.115:0/1819366366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b4490 0x7f86c80b4920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009d90 tx=0x7f86c002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24657d7a748c9d8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.593+0000 7f86bffff640 1 -- 172.21.15.115:0/1819366366 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c002cbd0 con 0x7f86c80b4490 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.593+0000 7f86bffff640 1 -- 172.21.15.115:0/1819366366 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c002cd30 con 0x7f86c80b4490 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.593+0000 7f86bffff640 1 -- 172.21.15.115:0/1819366366 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c002cea0 con 0x7f86c80b4490 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1819366366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b4490 msgr2=0x7f86c80b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1819366366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b4490 0x7f86c80b4920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009d90 tx=0x7f86c002be20 comp rx=0 tx=0).stop 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1819366366 shutdown_connections 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1819366366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b4490 0x7f86c80b4920 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1819366366 >> v2:172.21.15.49:3300/0 conn(0x7f86c80b5cd0 0x7f86c80b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1819366366 >> 172.21.15.115:0/1819366366 conn(0x7f86c8065dc0 msgr2=0x7f86c80b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1819366366 shutdown_connections 2023-12-19T05:38:47.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.594+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1819366366 wait complete. 2023-12-19T05:38:47.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.597+0000 7f86ce6ec640 1 Processor -- start 2023-12-19T05:38:47.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.597+0000 7f86ce6ec640 1 -- start start 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 0x7f86c81616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 0x7f86c813b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81f2de0 con 0x7f86c8140360 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8139390 con 0x7f86c80b5cd0 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ce6ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8145d50 con 0x7f86c80b4490 2023-12-19T05:38:47.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35436/0 (socket says 172.21.15.115:35436) 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ccee9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 0x7f86c81616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 -- 172.21.15.115:0/1323244043 learned_addr learned my addr 172.21.15.115:0/1323244043 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cdeeb640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 0x7f86c813b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 -- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 msgr2=0x7f86c81616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 0x7f86c81616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 -- 172.21.15.115:0/1323244043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 msgr2=0x7f86c813b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 0x7f86c813b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cd6ea640 1 -- 172.21.15.115:0/1323244043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0009a70 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86ccee9640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 0x7f86c81616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.599+0000 7f86cdeeb640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 0x7f86c813b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86cd6ea640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c480 tx=0x7f86c400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4005ce0 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4005e40 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40072f0 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c8146030 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c8138ff0 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f86c401c440 con 0x7f86c80b4490 2023-12-19T05:38:47.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.600+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f86c401cb80 con 0x7f86c80b4490 2023-12-19T05:38:47.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.601+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8061910 con 0x7f86c80b4490 2023-12-19T05:38:47.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.605+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f86c4021060 con 0x7f86c80b4490 2023-12-19T05:38:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.683+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f86c8070290 con 0x7f86c80b4490 2023-12-19T05:38:47.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.690+0000 7f86bdffb640 1 -- 172.21.15.115:0/1323244043 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f86c4017070 con 0x7f86c80b4490 2023-12-19T05:38:47.692 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 msgr2=0x7f86c80d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c480 tx=0x7f86c400c940 comp rx=0 tx=0).stop 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 shutdown_connections 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c8140360 0x7f86c813b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c80b5cd0 0x7f86c81616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 --2- 172.21.15.115:0/1323244043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86c80b4490 0x7f86c80d1850 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 >> 172.21.15.115:0/1323244043 conn(0x7f86c8065dc0 msgr2=0x7f86c80704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 shutdown_connections 2023-12-19T05:38:47.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.692+0000 7f86ce6ec640 1 -- 172.21.15.115:0/1323244043 wait complete. 2023-12-19T05:38:47.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-12-19T05:38:47.828 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:47.826+0000 7f15d3c40040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T05:38:47.875 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:47.873+0000 7f338040f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T05:38:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.894+0000 7f13ceb67640 1 Processor -- start 2023-12-19T05:38:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.894+0000 7f13ceb67640 1 -- start start 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13ceb67640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c8159e00 0x7f13c80cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13ceb67640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13c815a1e0 0x7f13c80ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13ceb67640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80cf480 con 0x7f13c80b0120 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13ceb67640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80ce900 con 0x7f13c815a1e0 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13ceb67640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80cebe0 con 0x7f13c8159e00 2023-12-19T05:38:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c8159e00 0x7f13c80cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c8159e00 0x7f13c80cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51586/0 (socket says 172.21.15.115:51586) 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 -- 172.21.15.115:0/1888473464 learned_addr learned my addr 172.21.15.115:0/1888473464 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cd364640 1 --2- 172.21.15.115:0/1888473464 >> v2:172.21.15.49:3300/0 conn(0x7f13c815a1e0 0x7f13c80ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 -- 172.21.15.115:0/1888473464 >> v2:172.21.15.49:3300/0 conn(0x7f13c815a1e0 msgr2=0x7f13c80ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 --2- 172.21.15.115:0/1888473464 >> v2:172.21.15.49:3300/0 conn(0x7f13c815a1e0 0x7f13c80ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 -- 172.21.15.115:0/1888473464 >> v1:172.21.15.49:6789/0 conn(0x7f13c80b0120 legacy=0x7f13c806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.896+0000 7f13cdb65640 1 -- 172.21.15.115:0/1888473464 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80ceec0 con 0x7f13c8159e00 2023-12-19T05:38:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13cdb65640 1 --2- 172.21.15.115:0/1888473464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c80cdd80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f13c806c060 tx=0x7f13c402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc179955724ce7ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13ccb63640 1 -- 172.21.15.115:0/1888473464 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4031870 con 0x7f13c8159e00 2023-12-19T05:38:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13ccb63640 1 -- 172.21.15.115:0/1888473464 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c40319d0 con 0x7f13c8159e00 2023-12-19T05:38:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13ccb63640 1 -- 172.21.15.115:0/1888473464 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4031d60 con 0x7f13c8159e00 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13ceb67640 1 -- 172.21.15.115:0/1888473464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 msgr2=0x7f13c80cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.898+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1888473464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c80cdd80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f13c806c060 tx=0x7f13c402b910 comp rx=0 tx=0).stop 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 -- 172.21.15.115:0/1888473464 shutdown_connections 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1888473464 >> v2:172.21.15.49:3300/0 conn(0x7f13c815a1e0 0x7f13c80ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1888473464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c80cdd80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 -- 172.21.15.115:0/1888473464 >> 172.21.15.115:0/1888473464 conn(0x7f13c80b11a0 msgr2=0x7f13c80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 -- 172.21.15.115:0/1888473464 shutdown_connections 2023-12-19T05:38:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.899+0000 7f13ceb67640 1 -- 172.21.15.115:0/1888473464 wait complete. 2023-12-19T05:38:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.901+0000 7f13ceb67640 1 Processor -- start 2023-12-19T05:38:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.901+0000 7f13ceb67640 1 -- start start 2023-12-19T05:38:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13c80b0120 0x7f13c814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 0x7f13c80b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8154870 con 0x7f13c80b0120 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80700d0 con 0x7f13c8159e00 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ceb67640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c806fdf0 con 0x7f13c815a1e0 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13cd364640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13ce366640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 0x7f13c80b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13cd364640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51592/0 (socket says 172.21.15.115:51592) 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13cd364640 1 -- 172.21.15.115:0/1383013772 learned_addr learned my addr 172.21.15.115:0/1383013772 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.902+0000 7f13cdb65640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13c80b0120 0x7f13c814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 -- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 msgr2=0x7f13c806f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 -- 172.21.15.115:0/1383013772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13c80b0120 msgr2=0x7f13c814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13c80b0120 0x7f13c814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 -- 172.21.15.115:0/1383013772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c40094d0 con 0x7f13c815a1e0 2023-12-19T05:38:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13cd364640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:47.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ce366640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 0x7f13c80b4400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c780 tx=0x7f13c000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000aa50 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000abb0 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000ce30 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c8154b10 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.903+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c814e280 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.904+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f13c0004bf0 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.904+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f13c0005530 con 0x7f13c815a1e0 2023-12-19T05:38:47.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.905+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c81546d0 con 0x7f13c815a1e0 2023-12-19T05:38:47.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:47.907+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f13c0039b10 con 0x7f13c815a1e0 2023-12-19T05:38:48.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.002+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f13c8155030 con 0x7f13c815a1e0 2023-12-19T05:38:48.008 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.007+0000 7f15d3c40040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T05:38:48.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.009+0000 7f13be7fc640 1 -- 172.21.15.115:0/1383013772 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f13c8155030 con 0x7f13c815a1e0 2023-12-19T05:38:48.011 INFO:teuthology.orchestra.run.smithi115.stdout:4 2023-12-19T05:38:48.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.010+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 msgr2=0x7f13c80b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.010+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 0x7f13c80b4400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c780 tx=0x7f13c000cc40 comp rx=0 tx=0).stop 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 shutdown_connections 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13c815a1e0 0x7f13c80b4400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c8159e00 0x7f13c806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 --2- 172.21.15.115:0/1383013772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13c80b0120 0x7f13c814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 >> 172.21.15.115:0/1383013772 conn(0x7f13c80b11a0 msgr2=0x7f13c80cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 shutdown_connections 2023-12-19T05:38:48.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.011+0000 7f13ceb67640 1 -- 172.21.15.115:0/1383013772 wait complete. 2023-12-19T05:38:48.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-12-19T05:38:48.048 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.045+0000 7f338040f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T05:38:48.159 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.157+0000 7f15d3c40040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T05:38:48.188 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.186+0000 7f338040f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T05:38:48.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.212+0000 7f799a634640 1 Processor -- start 2023-12-19T05:38:48.214 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.212+0000 7f15d3c40040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T05:38:48.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.213+0000 7f799a634640 1 -- start start 2023-12-19T05:38:48.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f799a634640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79941578f0 0x7f799415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f799a634640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f799406d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f799a634640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79941614b0 con 0x7f79940cdb40 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f799a634640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799406d540 con 0x7f79941578f0 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f799a634640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799415ea10 con 0x7f79940d1640 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.214+0000 7f7999632640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79941578f0 0x7f799415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79941578f0 0x7f799415e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51600/0 (socket says 172.21.15.115:51600) 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 -- 172.21.15.115:0/1425954478 learned_addr learned my addr 172.21.15.115:0/1425954478 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999e33640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f799406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 -- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 msgr2=0x7f799406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f799406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 -- 172.21.15.115:0/1425954478 >> v1:172.21.15.115:6789/0 conn(0x7f79940cdb40 legacy=0x7f79940d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999632640 1 -- 172.21.15.115:0/1425954478 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994161790 con 0x7f79941578f0 2023-12-19T05:38:48.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.215+0000 7f7999e33640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f799406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:48.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.216+0000 7f7999632640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f799415e4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930f110bb81673dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.216+0000 7f798bfff640 1 -- 172.21.15.115:0/1425954478 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990030840 con 0x7f79941578f0 2023-12-19T05:38:48.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.216+0000 7f798bfff640 1 -- 172.21.15.115:0/1425954478 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900309a0 con 0x7f79941578f0 2023-12-19T05:38:48.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.216+0000 7f798bfff640 1 -- 172.21.15.115:0/1425954478 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990030d30 con 0x7f79941578f0 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 -- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 msgr2=0x7f799415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f799415e4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b980 comp rx=0 tx=0).stop 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 -- 172.21.15.115:0/1425954478 shutdown_connections 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f799406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 --2- 172.21.15.115:0/1425954478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f799415e4d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 -- 172.21.15.115:0/1425954478 >> 172.21.15.115:0/1425954478 conn(0x7f799406f160 msgr2=0x7f799406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 -- 172.21.15.115:0/1425954478 shutdown_connections 2023-12-19T05:38:48.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.217+0000 7f799a634640 1 -- 172.21.15.115:0/1425954478 wait complete. 2023-12-19T05:38:48.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.219+0000 7f799a634640 1 Processor -- start 2023-12-19T05:38:48.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.219+0000 7f799a634640 1 -- start start 2023-12-19T05:38:48.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79940cdb40 0x7f7994151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f79940b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994153ae0 con 0x7f79940cdb40 2023-12-19T05:38:48.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994152ed0 con 0x7f79941578f0 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f799a634640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79941531b0 con 0x7f79940d1640 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f7998e31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f7998e31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47472/0 (socket says 172.21.15.115:47472) 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f7998e31640 1 -- 172.21.15.115:0/2113537351 learned_addr learned my addr 172.21.15.115:0/2113537351 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.220+0000 7f7999e33640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f79940b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7999632640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79940cdb40 0x7f7994151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 -- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 msgr2=0x7f79940b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f79940b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 -- 172.21.15.115:0/2113537351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79940cdb40 msgr2=0x7f7994151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79940cdb40 0x7f7994151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 -- 172.21.15.115:0/2113537351 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900094d0 con 0x7f79940d1640 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7998e31640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f798400c450 tx=0x7f798400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840052d0 con 0x7f79940d1640 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984005430 con 0x7f79940d1640 2023-12-19T05:38:48.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984012870 con 0x7f79940d1640 2023-12-19T05:38:48.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7994153490 con 0x7f79940d1640 2023-12-19T05:38:48.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.221+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7994152290 con 0x7f79940d1640 2023-12-19T05:38:48.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.222+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7984012cd0 con 0x7f79940d1640 2023-12-19T05:38:48.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.222+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f798401b980 con 0x7f79940d1640 2023-12-19T05:38:48.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.223+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994066a60 con 0x7f79940d1640 2023-12-19T05:38:48.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.225+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f798401b400 con 0x7f79940d1640 2023-12-19T05:38:48.245 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.243+0000 7f338040f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T05:38:48.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.302+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f7994153c50 con 0x7f79940d1640 2023-12-19T05:38:48.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.309+0000 7f7989ffb640 1 -- 172.21.15.115:0/2113537351 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f798402a0b0 con 0x7f79940d1640 2023-12-19T05:38:48.311 INFO:teuthology.orchestra.run.smithi115.stdout:5 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 msgr2=0x7f79941525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f798400c450 tx=0x7f798400c910 comp rx=0 tx=0).stop 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 shutdown_connections 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79940d1640 0x7f79941525d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79941578f0 0x7f79940b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 --2- 172.21.15.115:0/2113537351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79940cdb40 0x7f7994151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 >> 172.21.15.115:0/2113537351 conn(0x7f799406f160 msgr2=0x7f799406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 shutdown_connections 2023-12-19T05:38:48.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.310+0000 7f799a634640 1 -- 172.21.15.115:0/2113537351 wait complete. 2023-12-19T05:38:48.329 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-12-19T05:38:48.335 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.330+0000 7f15d3c40040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:48.361 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.359+0000 7f338040f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:48.451 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.449+0000 7f15d3c40040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T05:38:48.480 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.478+0000 7f338040f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T05:38:48.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.506+0000 7fd1d6e31640 1 Processor -- start 2023-12-19T05:38:48.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.506+0000 7fd1d6e31640 1 -- start start 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d6e31640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d6e31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d015f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d6e31640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d015ece0 con 0x7fd1d00d0590 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d6e31640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00ce9d0 con 0x7fd1d00d01b0 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d6e31640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00ce6f0 con 0x7fd1d015efa0 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d4bcd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d53ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d015f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d4bcd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51620/0 (socket says 172.21.15.115:51620) 2023-12-19T05:38:48.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.508+0000 7fd1d4bcd640 1 -- 172.21.15.115:0/2974151726 learned_addr learned my addr 172.21.15.115:0/2974151726 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:48.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.509+0000 7fd1d53ce640 1 -- 172.21.15.115:0/2974151726 >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 msgr2=0x7fd1d015e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:48.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.509+0000 7fd1d53ce640 1 --2- 172.21.15.115:0/2974151726 >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.509+0000 7fd1d53ce640 1 -- 172.21.15.115:0/2974151726 >> v1:172.21.15.115:6789/0 conn(0x7fd1d00d0590 legacy=0x7fd1d00cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.509+0000 7fd1d53ce640 1 -- 172.21.15.115:0/2974151726 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d015dcc0 con 0x7fd1d015efa0 2023-12-19T05:38:48.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.509+0000 7fd1d4bcd640 1 --2- 172.21.15.115:0/2974151726 >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:48.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.510+0000 7fd1d53ce640 1 --2- 172.21.15.115:0/2974151726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d015f410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7a2a55fcfc9d93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.510+0000 7fd1cf7fe640 1 -- 172.21.15.115:0/2974151726 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c802cc60 con 0x7fd1d015efa0 2023-12-19T05:38:48.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.510+0000 7fd1cf7fe640 1 -- 172.21.15.115:0/2974151726 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c802cdc0 con 0x7fd1d015efa0 2023-12-19T05:38:48.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.510+0000 7fd1cf7fe640 1 -- 172.21.15.115:0/2974151726 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8034660 con 0x7fd1d015efa0 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 -- 172.21.15.115:0/2974151726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 msgr2=0x7fd1d015f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/2974151726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d015f410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c802beb0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 -- 172.21.15.115:0/2974151726 shutdown_connections 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/2974151726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d015f410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/2974151726 >> v2:172.21.15.115:3300/0 conn(0x7fd1d00d01b0 0x7fd1d015e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 -- 172.21.15.115:0/2974151726 >> 172.21.15.115:0/2974151726 conn(0x7fd1d00b27a0 msgr2=0x7fd1d00b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 -- 172.21.15.115:0/2974151726 shutdown_connections 2023-12-19T05:38:48.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.511+0000 7fd1d6e31640 1 -- 172.21.15.115:0/2974151726 wait complete. 2023-12-19T05:38:48.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.513+0000 7fd1d6e31640 1 Processor -- start 2023-12-19T05:38:48.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.513+0000 7fd1d6e31640 1 -- start start 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 0x7fd1d014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d014f880 con 0x7fd1d00d0590 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01595a0 con 0x7fd1d00d01b0 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d6e31640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0159880 con 0x7fd1d015efa0 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51626/0 (socket says 172.21.15.115:51626) 2023-12-19T05:38:48.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 -- 172.21.15.115:0/1438671322 learned_addr learned my addr 172.21.15.115:0/1438671322 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d53ce640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1cffff640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 0x7fd1d014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 -- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 msgr2=0x7fd1d014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 -- 172.21.15.115:0/1438671322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 msgr2=0x7fd1d014ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 0x7fd1d014ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1d4bcd640 1 -- 172.21.15.115:0/1438671322 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40094d0 con 0x7fd1d00d01b0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.514+0000 7fd1cffff640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 0x7fd1d014ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1d4bcd640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400e9d0 tx=0x7fd1c400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400ca60 con 0x7fd1d00d01b0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400cbc0 con 0x7fd1d00d01b0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4013470 con 0x7fd1d00d01b0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c8009a70 con 0x7fd1d00d01b0 2023-12-19T05:38:48.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0159e40 con 0x7fd1d00d01b0 2023-12-19T05:38:48.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd1c4005c90 con 0x7fd1d00d01b0 2023-12-19T05:38:48.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.515+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd1c40135d0 con 0x7fd1d00d01b0 2023-12-19T05:38:48.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.516+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d015df50 con 0x7fd1d00d01b0 2023-12-19T05:38:48.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.519+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd1c4021060 con 0x7fd1d00d01b0 2023-12-19T05:38:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.596+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fd1d0061910 con 0x7fd1d00d01b0 2023-12-19T05:38:48.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.606+0000 7fd1cd7fa640 1 -- 172.21.15.115:0/1438671322 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1c4029020 con 0x7fd1d00d01b0 2023-12-19T05:38:48.608 INFO:teuthology.orchestra.run.smithi115.stdout:6 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 msgr2=0x7fd1d015a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400e9d0 tx=0x7fd1c400ee90 comp rx=0 tx=0).stop 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 shutdown_connections 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1d015efa0 0x7fd1d014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1d00d0590 0x7fd1d014ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 --2- 172.21.15.115:0/1438671322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1d00d01b0 0x7fd1d015a640 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 >> 172.21.15.115:0/1438671322 conn(0x7fd1d00b27a0 msgr2=0x7fd1d015c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 shutdown_connections 2023-12-19T05:38:48.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.607+0000 7fd1d6e31640 1 -- 172.21.15.115:0/1438671322 wait complete. 2023-12-19T05:38:48.619 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.617+0000 7f15d3c40040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:48.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-12-19T05:38:48.649 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.647+0000 7f338040f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:48.672 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.670+0000 7f15d3c40040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:48.702 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.700+0000 7f338040f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:48.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.811+0000 7f7a91315640 1 Processor -- start 2023-12-19T05:38:48.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.811+0000 7f7a91315640 1 -- start start 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.812+0000 7f7a91315640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 0x7f7a8c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.812+0000 7f7a91315640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 0x7f7a8c0d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.812+0000 7f7a91315640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0d18c0 con 0x7f7a8c0b43e0 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.812+0000 7f7a91315640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c06e8a0 con 0x7f7a8c15b180 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.812+0000 7f7a91315640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15c7e0 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a8b7fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7a8c0b43e0 0x7f7a8c0ce470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60838/0 (socket says 172.21.15.115:60838) 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a8b7fe640 1 -- 172.21.15.115:0/787174986 learned_addr learned my addr 172.21.15.115:0/787174986 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a90b14640 1 --2- 172.21.15.115:0/787174986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 0x7f7a8c0d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a8bfff640 1 --2- 172.21.15.115:0/787174986 >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 0x7f7a8c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a8affd640 1 -- 172.21.15.115:0/787174986 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144285137 0 0) 0x7f7a80001110 con 0x7f7a8c0b43e0 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a90b14640 1 -- 172.21.15.115:0/787174986 >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 msgr2=0x7f7a8c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a90b14640 1 --2- 172.21.15.115:0/787174986 >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 0x7f7a8c15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a90b14640 1 -- 172.21.15.115:0/787174986 >> v1:172.21.15.115:6789/0 conn(0x7f7a8c0b43e0 legacy=0x7f7a8c0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a90b14640 1 -- 172.21.15.115:0/787174986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0ceb80 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.813+0000 7f7a8bfff640 1 --2- 172.21.15.115:0/787174986 >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 0x7f7a8c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.814+0000 7f7a90b14640 1 --2- 172.21.15.115:0/787174986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 0x7f7a8c0d1380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009d90 tx=0x7f7a8402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d918941a54fea11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.814+0000 7f7a8affd640 1 -- 172.21.15.115:0/787174986 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8402cc50 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a8affd640 1 -- 172.21.15.115:0/787174986 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8402cdb0 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a8affd640 1 -- 172.21.15.115:0/787174986 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84034660 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 -- 172.21.15.115:0/787174986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 msgr2=0x7f7a8c0d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 --2- 172.21.15.115:0/787174986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 0x7f7a8c0d1380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009d90 tx=0x7f7a8402bea0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 -- 172.21.15.115:0/787174986 shutdown_connections 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 --2- 172.21.15.115:0/787174986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0d0f30 0x7f7a8c0d1380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 --2- 172.21.15.115:0/787174986 >> v2:172.21.15.49:3300/0 conn(0x7f7a8c15b180 0x7f7a8c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 -- 172.21.15.115:0/787174986 >> 172.21.15.115:0/787174986 conn(0x7f7a8c06f160 msgr2=0x7f7a8c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 -- 172.21.15.115:0/787174986 shutdown_connections 2023-12-19T05:38:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.815+0000 7f7a91315640 1 -- 172.21.15.115:0/787174986 wait complete. 2023-12-19T05:38:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.817+0000 7f7a91315640 1 Processor -- start 2023-12-19T05:38:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.817+0000 7f7a91315640 1 -- start start 2023-12-19T05:38:48.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a8c0d0f30 0x7f7a8c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 0x7f7a8c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c157810 con 0x7f7a8c0d0f30 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1f2af0 con 0x7f7a8c15b180 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a91315640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1f2dd0 con 0x7f7a8c0b43e0 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47504/0 (socket says 172.21.15.115:47504) 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a8bfff640 1 -- 172.21.15.115:0/3026212765 learned_addr learned my addr 172.21.15.115:0/3026212765 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.818+0000 7f7a90b14640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 0x7f7a8c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a8b7fe640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a8c0d0f30 0x7f7a8c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 -- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 msgr2=0x7f7a8c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 -- 172.21.15.115:0/3026212765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a8c0d0f30 msgr2=0x7f7a8c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a8c0d0f30 0x7f7a8c0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 -- 172.21.15.115:0/3026212765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a84009a70 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a8bfff640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.819+0000 7f7a90b14640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 0x7f7a8c0ad900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a84033000 tx=0x7f7a84004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84040650 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840407b0 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c1f30b0 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84040ba0 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c1f3670 con 0x7f7a8c15b180 2023-12-19T05:38:48.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a84049400 con 0x7f7a8c15b180 2023-12-19T05:38:48.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.820+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7a84049d10 con 0x7f7a8c15b180 2023-12-19T05:38:48.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.821+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c066a60 con 0x7f7a8c15b180 2023-12-19T05:38:48.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.823+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7a84044020 con 0x7f7a8c15b180 2023-12-19T05:38:48.838 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:48.836+0000 7f15d3c40040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T05:38:48.869 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:48.866+0000 7f338040f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T05:38:48.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.900+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f7a8c061910 con 0x7f7a8c15b180 2023-12-19T05:38:48.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.909+0000 7f7a88ff9640 1 -- 172.21.15.115:0/3026212765 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a84039070 con 0x7f7a8c15b180 2023-12-19T05:38:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:7 2023-12-19T05:38:48.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.910+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 msgr2=0x7f7a8c0ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:48.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.910+0000 7f7a91315640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 0x7f7a8c0ad900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a84033000 tx=0x7f7a84004a40 comp rx=0 tx=0).stop 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 shutdown_connections 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a8c15b180 0x7f7a8c0ad900 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a8c0d0f30 0x7f7a8c0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 --2- 172.21.15.115:0/3026212765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a8c0b43e0 0x7f7a8c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 >> 172.21.15.115:0/3026212765 conn(0x7f7a8c06f160 msgr2=0x7f7a8c06d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 shutdown_connections 2023-12-19T05:38:48.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-12-19T05:38:48.911+0000 7f7a91315640 1 -- 172.21.15.115:0/3026212765 wait complete. 2023-12-19T05:38:48.928 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T05:38:48.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T05:38:48.935 INFO:tasks.ceph.osd.0:Started 2023-12-19T05:38:48.936 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T05:38:48.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T05:38:48.942 INFO:tasks.ceph.osd.1:Started 2023-12-19T05:38:48.942 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T05:38:48.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T05:38:48.949 INFO:tasks.ceph.osd.2:Started 2023-12-19T05:38:48.949 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T05:38:48.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T05:38:48.954 INFO:tasks.ceph.osd.3:Started 2023-12-19T05:38:48.954 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T05:38:48.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T05:38:48.973 INFO:tasks.ceph.osd.4:Started 2023-12-19T05:38:48.973 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T05:38:48.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T05:38:48.978 INFO:tasks.ceph.osd.5:Started 2023-12-19T05:38:48.978 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T05:38:48.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T05:38:48.983 INFO:tasks.ceph.osd.6:Started 2023-12-19T05:38:48.983 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T05:38:48.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T05:38:48.988 INFO:tasks.ceph.osd.7:Started 2023-12-19T05:38:48.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:49.139 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-12-19T05:38:49.137+0000 7fd569307500 -1 Falling back to public interface 2023-12-19T05:38:49.140 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-12-19T05:38:49.138+0000 7f0fd7f9b500 -1 Falling back to public interface 2023-12-19T05:38:49.144 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-12-19T05:38:49.142+0000 7fa6b1014500 -1 Falling back to public interface 2023-12-19T05:38:49.157 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-12-19T05:38:49.155+0000 7f696680f500 -1 Falling back to public interface 2023-12-19T05:38:49.163 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-12-19T05:38:49.161+0000 7fc72d4a1500 -1 Falling back to public interface 2023-12-19T05:38:49.163 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-12-19T05:38:49.161+0000 7fd569307500 -1 osd.4 0 log_to_monitors true 2023-12-19T05:38:49.163 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-12-19T05:38:49.161+0000 7efcb300c500 -1 Falling back to public interface 2023-12-19T05:38:49.167 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-12-19T05:38:49.165+0000 7f0fd7f9b500 -1 osd.5 0 log_to_monitors true 2023-12-19T05:38:49.168 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-12-19T05:38:49.166+0000 7fa6b1014500 -1 osd.6 0 log_to_monitors true 2023-12-19T05:38:49.169 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-12-19T05:38:49.168+0000 7f5575a1f500 -1 Falling back to public interface 2023-12-19T05:38:49.177 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-12-19T05:38:49.175+0000 7f696680f500 -1 osd.0 0 log_to_monitors true 2023-12-19T05:38:49.188 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-12-19T05:38:49.186+0000 7f3ec8f15500 -1 Falling back to public interface 2023-12-19T05:38:49.189 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-12-19T05:38:49.187+0000 7efcb300c500 -1 osd.3 0 log_to_monitors true 2023-12-19T05:38:49.196 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-12-19T05:38:49.195+0000 7fc72d4a1500 -1 osd.2 0 log_to_monitors true 2023-12-19T05:38:49.213 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-12-19T05:38:49.211+0000 7f5575a1f500 -1 osd.1 0 log_to_monitors true 2023-12-19T05:38:49.219 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-12-19T05:38:49.218+0000 7f3ec8f15500 -1 osd.7 0 log_to_monitors true 2023-12-19T05:38:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.227+0000 7fad9241a640 1 Processor -- start 2023-12-19T05:38:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.227+0000 7fad9241a640 1 -- start start 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad9241a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad8c143d00 0x7fad8c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad9241a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 0x7fad8c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad9241a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c15bd70 con 0x7fad8c06cbf0 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad9241a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c06d080 con 0x7fad8c15b500 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad9241a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c15e650 con 0x7fad8c143d00 2023-12-19T05:38:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad8bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad8c143d00 0x7fad8c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad909b7640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad8c06cbf0 0x7fad8c070270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42424/0 (socket says 172.21.15.49:42424) 2023-12-19T05:38:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad909b7640 1 -- 172.21.15.49:0/2481685949 learned_addr learned my addr 172.21.15.49:0/2481685949 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad83fff640 1 --2- 172.21.15.49:0/2481685949 >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 0x7fad8c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.229+0000 7fad8b7fe640 1 -- 172.21.15.49:0/2481685949 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037434888 0 0) 0x7fad8c15bd70 con 0x7fad8c06cbf0 2023-12-19T05:38:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.230+0000 7fad8bfff640 1 -- 172.21.15.49:0/2481685949 >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 msgr2=0x7fad8c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.230+0000 7fad8bfff640 1 --2- 172.21.15.49:0/2481685949 >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 0x7fad8c06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.230+0000 7fad8bfff640 1 -- 172.21.15.49:0/2481685949 >> v1:172.21.15.49:6789/0 conn(0x7fad8c06cbf0 legacy=0x7fad8c070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.230+0000 7fad8bfff640 1 -- 172.21.15.49:0/2481685949 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c15e930 con 0x7fad8c143d00 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.230+0000 7fad83fff640 1 --2- 172.21.15.49:0/2481685949 >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 0x7fad8c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.231+0000 7fad8bfff640 1 --2- 172.21.15.49:0/2481685949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c143d00 0x7fad8c15e070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad8c06ea50 tx=0x7fad7c02e010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb4216cf92ccf9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.231+0000 7fad8b7fe640 1 -- 172.21.15.49:0/2481685949 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c02edc0 con 0x7fad8c143d00 2023-12-19T05:38:49.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.231+0000 7fad8b7fe640 1 -- 172.21.15.49:0/2481685949 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c036440 con 0x7fad8c143d00 2023-12-19T05:38:49.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.231+0000 7fad8b7fe640 1 -- 172.21.15.49:0/2481685949 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0367d0 con 0x7fad8c143d00 2023-12-19T05:38:49.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 -- 172.21.15.49:0/2481685949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c143d00 msgr2=0x7fad8c15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:49.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 --2- 172.21.15.49:0/2481685949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c143d00 0x7fad8c15e070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad8c06ea50 tx=0x7fad7c02e010 comp rx=0 tx=0).stop 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 -- 172.21.15.49:0/2481685949 shutdown_connections 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 --2- 172.21.15.49:0/2481685949 >> v2:172.21.15.49:3300/0 conn(0x7fad8c15b500 0x7fad8c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 --2- 172.21.15.49:0/2481685949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c143d00 0x7fad8c15e070 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 -- 172.21.15.49:0/2481685949 >> 172.21.15.49:0/2481685949 conn(0x7fad8c0d01a0 msgr2=0x7fad8c0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 -- 172.21.15.49:0/2481685949 shutdown_connections 2023-12-19T05:38:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.232+0000 7fad9241a640 1 -- 172.21.15.49:0/2481685949 wait complete. 2023-12-19T05:38:49.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.234+0000 7fad9241a640 1 Processor -- start 2023-12-19T05:38:49.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.234+0000 7fad9241a640 1 -- start start 2023-12-19T05:38:49.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 0x7fad8c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 0x7fad8c1f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0cb590 con 0x7fad8c143d00 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c15a0f0 con 0x7fad8c15b500 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad9241a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0ca980 con 0x7fad8c06cbf0 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41440/0 (socket says 172.21.15.49:41440) 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad83fff640 1 -- 172.21.15.49:0/1700365834 learned_addr learned my addr 172.21.15.49:0/1700365834 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad8bfff640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 0x7fad8c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.235+0000 7fad909b7640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 0x7fad8c1f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 -- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 msgr2=0x7fad8c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 0x7fad8c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 -- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 msgr2=0x7fad8c1f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 0x7fad8c1f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 -- 172.21.15.49:0/1700365834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c00b6a0 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad8bfff640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 0x7fad8c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad909b7640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 0x7fad8c1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad83fff640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad7400e7e0 tx=0x7fad7400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74004030 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74004190 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74004520 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c0cac60 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.236+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c0cb220 con 0x7fad8c143d00 2023-12-19T05:38:49.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.237+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad7400c9d0 con 0x7fad8c143d00 2023-12-19T05:38:49.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.237+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fad74013ae0 con 0x7fad8c143d00 2023-12-19T05:38:49.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.238+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c0cb700 con 0x7fad8c143d00 2023-12-19T05:38:49.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.240+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fad74020060 con 0x7fad8c143d00 2023-12-19T05:38:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.304+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad8c061910 con 0x7fad8c143d00 2023-12-19T05:38:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.305+0000 7fad897fa640 1 -- 172.21.15.49:0/1700365834 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fad7400f040 con 0x7fad8c143d00 2023-12-19T05:38:49.307 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:49.307 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:38:48.903493+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:49.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 msgr2=0x7fad8c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:49.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad7400e7e0 tx=0x7fad7400eca0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 shutdown_connections 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad8c15b500 0x7fad8c1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad8c143d00 0x7fad8c0cd1b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 --2- 172.21.15.49:0/1700365834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad8c06cbf0 0x7fad8c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 >> 172.21.15.49:0/1700365834 conn(0x7fad8c0d01a0 msgr2=0x7fad8c15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 shutdown_connections 2023-12-19T05:38:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:49.306+0000 7fad9241a640 1 -- 172.21.15.49:0/1700365834 wait complete. 2023-12-19T05:38:49.323 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T05:38:49.324 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T05:38:49.992 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:49.990+0000 7f15d3c40040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T05:38:50.115 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:50.113+0000 7f338040f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T05:38:50.130 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:50.296 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:50.294+0000 7f15d3c40040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T05:38:50.303 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.301+0000 7fdf16b18640 1 Processor -- start 2023-12-19T05:38:50.303 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.301+0000 7fdf16b18640 1 -- start start 2023-12-19T05:38:50.305 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf16b18640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf10140770 0x7fdf100d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:50.305 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf16b18640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf10141400 con 0x7fdf10142d30 2023-12-19T05:38:50.305 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf16b18640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100d3f20 con 0x7fdf1015e090 2023-12-19T05:38:50.305 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf16b18640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf101432f0 con 0x7fdf10140770 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf0ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdf10142d30 0x7fdf10140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42436/0 (socket says 172.21.15.49:42436) 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf0ffff640 1 -- 172.21.15.49:0/3413576439 learned_addr learned my addr 172.21.15.49:0/3413576439 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.303+0000 7fdf148b4640 1 --2- 172.21.15.49:0/3413576439 >> v2:172.21.15.49:3300/0 conn(0x7fdf10140770 0x7fdf100d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.304+0000 7fdf0f7fe640 1 -- 172.21.15.49:0/3413576439 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411571524 0 0) 0x7fdf10141400 con 0x7fdf10142d30 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.304+0000 7fdf0f7fe640 1 -- 172.21.15.49:0/3413576439 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf00003520 con 0x7fdf10142d30 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.304+0000 7fdf148b4640 1 -- 172.21.15.49:0/3413576439 >> v1:172.21.15.115:6789/0 conn(0x7fdf1015e090 legacy=0x7fdf1015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.304+0000 7fdf148b4640 1 -- 172.21.15.49:0/3413576439 >> v1:172.21.15.49:6789/0 conn(0x7fdf10142d30 legacy=0x7fdf10140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.306 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.304+0000 7fdf148b4640 1 -- 172.21.15.49:0/3413576439 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf101435d0 con 0x7fdf10140770 2023-12-19T05:38:50.307 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.305+0000 7fdf148b4640 1 --2- 172.21.15.49:0/3413576439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10140770 0x7fdf100d39e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf040097a0 tx=0x7fdf0402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc4e699fcec28c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:50.307 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.305+0000 7fdf0f7fe640 1 -- 172.21.15.49:0/3413576439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04030610 con 0x7fdf10140770 2023-12-19T05:38:50.307 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.305+0000 7fdf0f7fe640 1 -- 172.21.15.49:0/3413576439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04030770 con 0x7fdf10140770 2023-12-19T05:38:50.307 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.305+0000 7fdf0f7fe640 1 -- 172.21.15.49:0/3413576439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04030b00 con 0x7fdf10140770 2023-12-19T05:38:50.308 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 -- 172.21.15.49:0/3413576439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10140770 msgr2=0x7fdf100d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.308 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 --2- 172.21.15.49:0/3413576439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10140770 0x7fdf100d39e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf040097a0 tx=0x7fdf0402b960 comp rx=0 tx=0).stop 2023-12-19T05:38:50.308 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 -- 172.21.15.49:0/3413576439 shutdown_connections 2023-12-19T05:38:50.308 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 --2- 172.21.15.49:0/3413576439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10140770 0x7fdf100d39e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.308 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 -- 172.21.15.49:0/3413576439 >> 172.21.15.49:0/3413576439 conn(0x7fdf100b4120 msgr2=0x7fdf100b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:50.309 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 -- 172.21.15.49:0/3413576439 shutdown_connections 2023-12-19T05:38:50.309 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.306+0000 7fdf16b18640 1 -- 172.21.15.49:0/3413576439 wait complete. 2023-12-19T05:38:50.310 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.308+0000 7fdf16b18640 1 Processor -- start 2023-12-19T05:38:50.310 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.308+0000 7fdf16b18640 1 -- start start 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf10140770 0x7fdf100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 0x7fdf1015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100caae0 con 0x7fdf10142d30 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100ca650 con 0x7fdf10140770 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf16b18640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100c9a40 con 0x7fdf1015e090 2023-12-19T05:38:50.314 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf0ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf0ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41454/0 (socket says 172.21.15.49:41454) 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.309+0000 7fdf0ffff640 1 -- 172.21.15.49:0/2063098969 learned_addr learned my addr 172.21.15.49:0/2063098969 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf148b4640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf10140770 0x7fdf100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf150b5640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 0x7fdf1015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 -- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 msgr2=0x7fdf1015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 0x7fdf1015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 -- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf10140770 msgr2=0x7fdf100707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf10140770 0x7fdf100707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 -- 172.21.15.49:0/2063098969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009400 con 0x7fdf10142d30 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf150b5640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 0x7fdf1015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0ffff640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c500 tx=0x7fdefc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc005ce0 con 0x7fdf10142d30 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc005e40 con 0x7fdf10142d30 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf100c9d20 con 0x7fdf10142d30 2023-12-19T05:38:50.315 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc007330 con 0x7fdf10142d30 2023-12-19T05:38:50.316 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.310+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf100ca2e0 con 0x7fdf10142d30 2023-12-19T05:38:50.316 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.311+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdefc01c440 con 0x7fdf10142d30 2023-12-19T05:38:50.316 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.311+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7fdefc012c60 con 0x7fdf10142d30 2023-12-19T05:38:50.316 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.311+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf10061910 con 0x7fdf10142d30 2023-12-19T05:38:50.316 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.314+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fdefc017070 con 0x7fdf10142d30 2023-12-19T05:38:50.357 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:50.354+0000 7f15d3c40040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T05:38:50.381 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.378+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf100ca790 con 0x7fdf10142d30 2023-12-19T05:38:50.381 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.379+0000 7fdf0d7fa640 1 -- 172.21.15.49:0/2063098969 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdefc012570 con 0x7fdf10142d30 2023-12-19T05:38:50.381 INFO:teuthology.misc.health.smithi049.stdout: 2023-12-19T05:38:50.381 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":11,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:38:49.905845+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 msgr2=0x7fdf100c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c500 tx=0x7fdefc00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 shutdown_connections 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf1015e090 0x7fdf1015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf10142d30 0x7fdf100c8ff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 --2- 172.21.15.49:0/2063098969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf10140770 0x7fdf100707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.380+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 >> 172.21.15.49:0/2063098969 conn(0x7fdf100b4120 msgr2=0x7fdf1006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.381+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 shutdown_connections 2023-12-19T05:38:50.383 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:50.381+0000 7fdf16b18640 1 -- 172.21.15.49:0/2063098969 wait complete. 2023-12-19T05:38:50.395 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T05:38:50.447 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:50.445+0000 7f338040f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T05:38:50.468 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:50.466+0000 7f15d3c40040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T05:38:50.511 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:50.509+0000 7f338040f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T05:38:50.631 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-12-19T05:38:50.629+0000 7f338040f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T05:38:50.954 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-12-19T05:38:50.952+0000 7f3ec4ea0640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T05:38:50.954 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-12-19T05:38:50.952+0000 7f0fd3f28640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T05:38:50.956 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-12-19T05:38:50.955+0000 7f3ebe4d3640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.957 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-12-19T05:38:50.956+0000 7f0fcd55b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.967 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-12-19T05:38:50.965+0000 7fd565292640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T05:38:50.967 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-12-19T05:38:50.965+0000 7fa6acf9f640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T05:38:50.969 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-12-19T05:38:50.968+0000 7fd55e8c5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.970 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-12-19T05:38:50.968+0000 7fa6a65d2640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.972 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-12-19T05:38:50.970+0000 7f696226c640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T05:38:50.973 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-12-19T05:38:50.970+0000 7fc72942c640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T05:38:50.973 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-12-19T05:38:50.971+0000 7f557135e640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T05:38:50.974 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-12-19T05:38:50.971+0000 7efcaf11b640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T05:38:50.975 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-12-19T05:38:50.973+0000 7f695b89f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.976 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-12-19T05:38:50.974+0000 7efca7f37640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.977 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-12-19T05:38:50.975+0000 7fc722a5f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:50.977 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-12-19T05:38:50.975+0000 7f556a991640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:51.532 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:51.529+0000 7f1575802640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T05:38:51.534 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:38:51.533+0000 7f1575802640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T05:38:55.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:55.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:57.202 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:57.402 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.400+0000 7f1b069dc640 1 Processor -- start 2023-12-19T05:38:57.402 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.401+0000 7f1b069dc640 1 -- start start 2023-12-19T05:38:57.403 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.402+0000 7f1b069dc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1b000d0c60 0x7f1b00161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.403 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.402+0000 7f1b069dc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b000d25e0 0x7f1b000d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.404 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.402+0000 7f1b069dc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0015e0f0 con 0x7f1b0015d910 2023-12-19T05:38:57.404 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.402+0000 7f1b069dc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b00140840 con 0x7f1b000d25e0 2023-12-19T05:38:57.404 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.402+0000 7f1b069dc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0015e3d0 con 0x7f1b000d0c60 2023-12-19T05:38:57.404 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b000d25e0 0x7f1b000d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b000d25e0 0x7f1b000d2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54530/0 (socket says 172.21.15.49:54530) 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 -- 172.21.15.49:0/4249939633 learned_addr learned my addr 172.21.15.49:0/4249939633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b059da640 1 --2- 172.21.15.49:0/4249939633 >> v2:172.21.15.115:3300/0 conn(0x7f1b000d0c60 0x7f1b00161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 -- 172.21.15.49:0/4249939633 >> v2:172.21.15.115:3300/0 conn(0x7f1b000d0c60 msgr2=0x7f1b00161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 --2- 172.21.15.49:0/4249939633 >> v2:172.21.15.115:3300/0 conn(0x7f1b000d0c60 0x7f1b00161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 -- 172.21.15.49:0/4249939633 >> v1:172.21.15.49:6789/0 conn(0x7f1b0015d910 legacy=0x7f1b000b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.405 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.403+0000 7f1b061db640 1 -- 172.21.15.49:0/4249939633 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0015e6b0 con 0x7f1b000d25e0 2023-12-19T05:38:57.406 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.404+0000 7f1b061db640 1 --2- 172.21.15.49:0/4249939633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b000d2a10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b000746f0 tx=0x7f1af802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2af3043ec808f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.406 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.405+0000 7f1b049d8640 1 -- 172.21.15.49:0/4249939633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802cb20 con 0x7f1b000d25e0 2023-12-19T05:38:57.406 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.405+0000 7f1b049d8640 1 -- 172.21.15.49:0/4249939633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af802cc80 con 0x7f1b000d25e0 2023-12-19T05:38:57.406 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.405+0000 7f1b049d8640 1 -- 172.21.15.49:0/4249939633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80343f0 con 0x7f1b000d25e0 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.405+0000 7f1b069dc640 1 -- 172.21.15.49:0/4249939633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 msgr2=0x7f1b000d2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.405+0000 7f1b069dc640 1 --2- 172.21.15.49:0/4249939633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b000d2a10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b000746f0 tx=0x7f1af802bf80 comp rx=0 tx=0).stop 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 -- 172.21.15.49:0/4249939633 shutdown_connections 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 --2- 172.21.15.49:0/4249939633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b000d2a10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 --2- 172.21.15.49:0/4249939633 >> v2:172.21.15.115:3300/0 conn(0x7f1b000d0c60 0x7f1b00161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 -- 172.21.15.49:0/4249939633 >> 172.21.15.49:0/4249939633 conn(0x7f1b000b2640 msgr2=0x7f1b000b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 -- 172.21.15.49:0/4249939633 shutdown_connections 2023-12-19T05:38:57.407 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.406+0000 7f1b069dc640 1 -- 172.21.15.49:0/4249939633 wait complete. 2023-12-19T05:38:57.408 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.407+0000 7f1b069dc640 1 Processor -- start 2023-12-19T05:38:57.408 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.408+0000 7f1b069dc640 1 -- start start 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b000d0c60 0x7f1b00146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0015d910 0x7f1b0006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0013eae0 con 0x7f1b000d25e0 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00145970 con 0x7f1b0015d910 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b069dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00145c50 con 0x7f1b000d0c60 2023-12-19T05:38:57.410 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.411 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54544/0 (socket says 172.21.15.49:54544) 2023-12-19T05:38:57.411 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 -- 172.21.15.49:0/3559590929 learned_addr learned my addr 172.21.15.49:0/3559590929 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:57.411 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b061db640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0015d910 0x7f1b0006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 -- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b000d0c60 msgr2=0x7f1b00146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b000d0c60 0x7f1b00146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 -- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0015d910 msgr2=0x7f1b0006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0015d910 0x7f1b0006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.409+0000 7f1b051d9640 1 -- 172.21.15.49:0/3559590929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009b30 con 0x7f1b000d25e0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1b051d9640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c400 tx=0x7f1af000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00052d0 con 0x7f1b000d25e0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0005430 con 0x7f1b000d25e0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0003830 con 0x7f1b000d25e0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b00145f30 con 0x7f1b000d25e0 2023-12-19T05:38:57.412 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.410+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b001464f0 con 0x7f1b000d25e0 2023-12-19T05:38:57.413 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.411+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b00061910 con 0x7f1b000d25e0 2023-12-19T05:38:57.413 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.412+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1af0003990 con 0x7f1b000d25e0 2023-12-19T05:38:57.415 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.414+0000 7f1af67fc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 0x7f1ae406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.415 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.414+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1af0087c00 con 0x7f1b000d25e0 2023-12-19T05:38:57.415 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.414+0000 7f1b059da640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 0x7f1ae406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.416 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.415+0000 7f1b059da640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 0x7f1ae406c920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1afc006fd0 tx=0x7f1afc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.420 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.419+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1af00534a0 con 0x7f1b000d25e0 2023-12-19T05:38:57.620 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.619+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b001466b0 con 0x7f1b000d25e0 2023-12-19T05:38:57.622 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.621+0000 7f1af67fc640 1 -- 172.21.15.49:0/3559590929 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f1af0056ac0 con 0x7f1b000d25e0 2023-12-19T05:38:57.623 INFO:teuthology.misc.health.smithi049.stdout: 2023-12-19T05:38:57.623 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":16,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:38:54.984421+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:57.625 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 msgr2=0x7f1ae406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 0x7f1ae406c920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1afc006fd0 tx=0x7f1afc008040 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 msgr2=0x7f1b0013e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c400 tx=0x7f1af000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 shutdown_connections 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ae406a460 0x7f1ae406c920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0015d910 0x7f1b0006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b000d25e0 0x7f1b0013e5a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 --2- 172.21.15.49:0/3559590929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b000d0c60 0x7f1b00146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 >> 172.21.15.49:0/3559590929 conn(0x7f1b000b2640 msgr2=0x7f1b0013fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 shutdown_connections 2023-12-19T05:38:57.626 INFO:teuthology.misc.health.smithi049.stderr:2023-12-19T05:38:57.624+0000 7f1b069dc640 1 -- 172.21.15.49:0/3559590929 wait complete. 2023-12-19T05:38:57.640 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T05:38:57.640 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T05:38:57.641 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:38:57.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:38:57.650 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:38:57.650 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:38:57.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:38:57.658 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:38:57.658 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:38:57.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:38:57.667 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:38:57.667 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:38:57.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:38:57.675 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:38:57.675 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T05:38:57.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:57.816 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:38:57.817 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:38:57.824 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:38:57.831 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:38:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.877+0000 7fa4f4a5f640 1 Processor -- start 2023-12-19T05:38:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.877+0000 7fa4f4a5f640 1 -- start start 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.878+0000 7fa4f4a5f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa4f006cf20 0x7fa4f0140d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.878+0000 7fa4f4a5f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f013e590 con 0x7fa4f00b2ea0 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.878+0000 7fa4f4a5f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f015b810 con 0x7fa4f01408f0 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.878+0000 7fa4f4a5f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f0141390 con 0x7fa4f006cf20 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4ee59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa4f00b2ea0 0x7fa4f015c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38148/0 (socket says 172.21.15.49:38148) 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4ee59c640 1 -- 172.21.15.49:0/2102918534 learned_addr learned my addr 172.21.15.49:0/2102918534 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4eed9d640 1 --2- 172.21.15.49:0/2102918534 >> v2:172.21.15.49:3300/0 conn(0x7fa4f006cf20 0x7fa4f0140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4eed9d640 1 -- 172.21.15.49:0/2102918534 >> v1:172.21.15.115:6789/0 conn(0x7fa4f01408f0 legacy=0x7fa4f006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4edd9b640 1 -- 172.21.15.49:0/2102918534 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684665854 0 0) 0x7fa4f013e590 con 0x7fa4f00b2ea0 2023-12-19T05:38:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4eed9d640 1 -- 172.21.15.49:0/2102918534 >> v1:172.21.15.49:6789/0 conn(0x7fa4f00b2ea0 legacy=0x7fa4f015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.879+0000 7fa4eed9d640 1 -- 172.21.15.49:0/2102918534 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f0141670 con 0x7fa4f006cf20 2023-12-19T05:38:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.880+0000 7fa4eed9d640 1 --2- 172.21.15.49:0/2102918534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f0140d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b23a16d13fea0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4edd9b640 1 -- 172.21.15.49:0/2102918534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e802cae0 con 0x7fa4f006cf20 2023-12-19T05:38:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4edd9b640 1 -- 172.21.15.49:0/2102918534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e802cc40 con 0x7fa4f006cf20 2023-12-19T05:38:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4edd9b640 1 -- 172.21.15.49:0/2102918534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8034440 con 0x7fa4f006cf20 2023-12-19T05:38:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/2102918534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 msgr2=0x7fa4f0140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/2102918534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f0140d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e802bdb0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/2102918534 shutdown_connections 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/2102918534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f0140d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/2102918534 >> 172.21.15.49:0/2102918534 conn(0x7fa4f00659d0 msgr2=0x7fa4f0065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/2102918534 shutdown_connections 2023-12-19T05:38:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.881+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/2102918534 wait complete. 2023-12-19T05:38:57.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.883+0000 7fa4f4a5f640 1 Processor -- start 2023-12-19T05:38:57.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.883+0000 7fa4f4a5f640 1 -- start start 2023-12-19T05:38:57.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4f00b2ea0 0x7fa4f0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4f01408f0 0x7fa4f00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00ccc60 con 0x7fa4f006cf20 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00b1e60 con 0x7fa4f01408f0 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4f4a5f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00b2140 con 0x7fa4f00b2ea0 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.884+0000 7fa4ee59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54578/0 (socket says 172.21.15.49:54578) 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 -- 172.21.15.49:0/212379922 learned_addr learned my addr 172.21.15.49:0/212379922 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4e7fff640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4f00b2ea0 0x7fa4f0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4eed9d640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4f01408f0 0x7fa4f00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 -- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4f00b2ea0 msgr2=0x7fa4f0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4f00b2ea0 0x7fa4f0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 -- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4f01408f0 msgr2=0x7fa4f00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4f01408f0 0x7fa4f00ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 -- 172.21.15.49:0/212379922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009a70 con 0x7fa4f006cf20 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4ee59c640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c500 tx=0x7fa4e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00074e0 con 0x7fa4f006cf20 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0007660 con 0x7fa4f006cf20 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0004a20 con 0x7fa4f006cf20 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.885+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f00cce70 con 0x7fa4f006cf20 2023-12-19T05:38:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.886+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f00b1b10 con 0x7fa4f006cf20 2023-12-19T05:38:57.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.887+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0074770 con 0x7fa4f006cf20 2023-12-19T05:38:57.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.888+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa4e0004b80 con 0x7fa4f006cf20 2023-12-19T05:38:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.889+0000 7fa4e6ffd640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 0x7fa4d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.889+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa4e00877b0 con 0x7fa4f006cf20 2023-12-19T05:38:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.890+0000 7fa4e7fff640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 0x7fa4d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.890+0000 7fa4e7fff640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 0x7fa4d006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8007fd0 tx=0x7fa4d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:57.894+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4e0053180 con 0x7fa4f006cf20 2023-12-19T05:38:58.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.084+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4f00b2a50 con 0x7fa4f006cf20 2023-12-19T05:38:58.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.085+0000 7fa4e6ffd640 1 -- 172.21.15.49:0/212379922 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fa4e0018090 con 0x7fa4f006cf20 2023-12-19T05:38:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:58.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:38:54.984421+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:58.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 msgr2=0x7fa4d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 0x7fa4d006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8007fd0 tx=0x7fa4d8009040 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 msgr2=0x7fa4f01587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c500 tx=0x7fa4e000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 shutdown_connections 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa4d006a430 0x7fa4d006c8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4f00b2ea0 0x7fa4f0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4f01408f0 0x7fa4f00ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 --2- 172.21.15.49:0/212379922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4f006cf20 0x7fa4f01587f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 >> 172.21.15.49:0/212379922 conn(0x7fa4f00659d0 msgr2=0x7fa4f013f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.088+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 shutdown_connections 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.089+0000 7fa4f4a5f640 1 -- 172.21.15.49:0/212379922 wait complete. 2023-12-19T05:38:58.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:38:58.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:38:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.338+0000 7fa3af2d7640 1 Processor -- start 2023-12-19T05:38:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.338+0000 7fa3af2d7640 1 -- start start 2023-12-19T05:38:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3af2d7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3a80b0470 0x7fa3a806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3af2d7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a806e220 con 0x7fa3a8141900 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3af2d7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80cbea0 con 0x7fa3a806da30 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3af2d7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80cc180 con 0x7fa3a80b0470 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3ae2d5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3a8141900 0x7fa3a80afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38160/0 (socket says 172.21.15.49:38160) 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.340+0000 7fa3ae2d5640 1 -- 172.21.15.49:0/3404929427 learned_addr learned my addr 172.21.15.49:0/3404929427 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3404929427 >> v2:172.21.15.115:3300/0 conn(0x7fa3a80b0470 0x7fa3a806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517547704 0 0) 0x7fa3a806e220 con 0x7fa3a8141900 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa394003520 con 0x7fa3a8141900 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908097299 0 0) 0x7fa394003520 con 0x7fa3a8141900 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 >> v2:172.21.15.115:3300/0 conn(0x7fa3a80b0470 msgr2=0x7fa3a806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 --2- 172.21.15.49:0/3404929427 >> v2:172.21.15.115:3300/0 conn(0x7fa3a80b0470 0x7fa3a806d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 >> v1:172.21.15.115:6789/0 conn(0x7fa3a806da30 legacy=0x7fa3a80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80cc460 con 0x7fa3a8141900 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa3a4001670 con 0x7fa3a8141900 2023-12-19T05:38:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 >> v1:172.21.15.49:6789/0 conn(0x7fa3a8141900 legacy=0x7fa3a80afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa394003970 0x7fa394003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.341+0000 7fa3ad2d3640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3ad2d3640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa394005180 0x7fa39400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80cc180 con 0x7fa3940047c0 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39400c020 con 0x7fa394005180 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39400c1e0 con 0x7fa394003970 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3ae2d5640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa394003970 0x7fa394003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 -- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa394003970 msgr2=0x7fa394003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa394003970 0x7fa394003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 -- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa394005180 msgr2=0x7fa39400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3aead6640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa394005180 0x7fa39400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa394005180 0x7fa39400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3aead6640 1 -- 172.21.15.49:0/3404929427 reap_dead start 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.342+0000 7fa3adad4640 1 -- 172.21.15.49:0/3404929427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394003520 con 0x7fa3940047c0 2023-12-19T05:38:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.343+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa394004c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ac0 tx=0x7fa3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75b569d7dbd0f6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.343+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802c6b0 con 0x7fa3940047c0 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.343+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39802c810 con 0x7fa3940047c0 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.343+0000 7fa3ad2d3640 1 -- 172.21.15.49:0/3404929427 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802cba0 con 0x7fa3940047c0 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 msgr2=0x7fa394004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa394004c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ac0 tx=0x7fa3940057f0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3404929427 shutdown_connections 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3404929427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa394004c40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3404929427 >> 172.21.15.49:0/3404929427 conn(0x7fa3a806f630 msgr2=0x7fa3a806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3404929427 shutdown_connections 2023-12-19T05:38:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.344+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3404929427 wait complete. 2023-12-19T05:38:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.346+0000 7fa3af2d7640 1 Processor -- start 2023-12-19T05:38:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.346+0000 7fa3af2d7640 1 -- start start 2023-12-19T05:38:58.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a813ef80 0x7fa3a80b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a80ac8b0 0x7fa3a80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81555e0 con 0x7fa3940047c0 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ad270 con 0x7fa3a813ef80 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3af2d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a813f800 con 0x7fa3a80ac8b0 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3ae2d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3ae2d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54594/0 (socket says 172.21.15.49:54594) 2023-12-19T05:38:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.347+0000 7fa3ae2d5640 1 -- 172.21.15.49:0/3687795466 learned_addr learned my addr 172.21.15.49:0/3687795466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3aead6640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a80ac8b0 0x7fa3a80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a813ef80 0x7fa3a80b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 -- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a80ac8b0 msgr2=0x7fa3a80acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a80ac8b0 0x7fa3a80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 -- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a813ef80 msgr2=0x7fa3a80b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a813ef80 0x7fa3a80b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 -- 172.21.15.49:0/3687795466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8158b90 con 0x7fa3940047c0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3ae2d5640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d8e0 tx=0x7fa3a400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40074e0 con 0x7fa3940047c0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4007640 con 0x7fa3940047c0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a81557f0 con 0x7fa3940047c0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40049e0 con 0x7fa3940047c0 2023-12-19T05:38:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.348+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a8158820 con 0x7fa3940047c0 2023-12-19T05:38:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.350+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8061910 con 0x7fa3940047c0 2023-12-19T05:38:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.350+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3a4004b40 con 0x7fa3940047c0 2023-12-19T05:38:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.351+0000 7fa39effd640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 0x7fa38c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.351+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3a40883d0 con 0x7fa3940047c0 2023-12-19T05:38:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.352+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 0x7fa38c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.353+0000 7fa3adad4640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 0x7fa38c06c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa398036000 tx=0x7fa398030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.355+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3a40577a0 con 0x7fa3940047c0 2023-12-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.548+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3a80cba40 con 0x7fa3940047c0 2023-12-19T05:38:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.549+0000 7fa39effd640 1 -- 172.21.15.49:0/3687795466 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3a40190a0 con 0x7fa3940047c0 2023-12-19T05:38:58.550 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 msgr2=0x7fa38c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 0x7fa38c06c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa398036000 tx=0x7fa398030000 comp rx=0 tx=0).stop 2023-12-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 msgr2=0x7fa3a81550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d8e0 tx=0x7fa3a400dda0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 shutdown_connections 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa38c06a430 0x7fa38c06c8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a80ac8b0 0x7fa3a80acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a813ef80 0x7fa3a80b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 --2- 172.21.15.49:0/3687795466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940047c0 0x7fa3a81550a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.551+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 >> 172.21.15.49:0/3687795466 conn(0x7fa3a806f630 msgr2=0x7fa3a80ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.552+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 shutdown_connections 2023-12-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.552+0000 7fa3af2d7640 1 -- 172.21.15.49:0/3687795466 wait complete. 2023-12-19T05:38:58.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:38:58.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.804+0000 7f17f087a640 1 Processor -- start 2023-12-19T05:38:58.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.804+0000 7f17f087a640 1 -- start start 2023-12-19T05:38:58.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.805+0000 7f17f087a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17ec0ae110 0x7f17ec0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.805+0000 7f17f087a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0b0a60 con 0x7f17ec0b0640 2023-12-19T05:38:58.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.805+0000 7f17f087a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0ae640 con 0x7f17ec157bf0 2023-12-19T05:38:58.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.805+0000 7f17f087a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec06b8c0 con 0x7f17ec0ae110 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17ead9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17ec0b0640 0x7f17ec06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38176/0 (socket says 172.21.15.49:38176) 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17ead9d640 1 -- 172.21.15.49:0/2999803019 learned_addr learned my addr 172.21.15.49:0/2999803019 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17e9d9b640 1 --2- 172.21.15.49:0/2999803019 >> v2:172.21.15.115:3300/0 conn(0x7f17ec0ae110 0x7f17ec0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175797116 0 0) 0x7f17ec0b0a60 con 0x7f17ec0b0640 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d4005730 con 0x7f17ec0b0640 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.806+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265196480 0 0) 0x7f17d4005730 con 0x7f17ec0b0640 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 >> v2:172.21.15.115:3300/0 conn(0x7f17ec0ae110 msgr2=0x7f17ec0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 --2- 172.21.15.49:0/2999803019 >> v2:172.21.15.115:3300/0 conn(0x7f17ec0ae110 0x7f17ec0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 >> v1:172.21.15.115:6789/0 conn(0x7f17ec157bf0 legacy=0x7f17ec15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0ae920 con 0x7f17ec0b0640 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f17e4001670 con 0x7f17ec0b0640 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 >> v1:172.21.15.49:6789/0 conn(0x7f17ec0b0640 legacy=0x7f17ec06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4005bf0 0x7f17d4006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17d40069d0 0x7f17d4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 0x7f17d400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec06b8c0 con 0x7f17d4007390 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d400e2c0 con 0x7f17d4005bf0 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d400e480 con 0x7f17d40069d0 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17ead9d640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 0x7f17d400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17ea59c640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4005bf0 0x7f17d4006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.807+0000 7f17e9d9b640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17d40069d0 0x7f17d4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 -- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17d40069d0 msgr2=0x7f17d4006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17d40069d0 0x7f17d4006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 -- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4005bf0 msgr2=0x7f17d4006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4005bf0 0x7f17d4006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 -- 172.21.15.49:0/2999803019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4005730 con 0x7f17d4007390 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.808+0000 7f17ead9d640 1 -- 172.21.15.49:0/2999803019 reap_dead start 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17ead9d640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 0x7f17d400db90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c240 tx=0x7f17d4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a6515fe9b91290 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4005ad0 con 0x7f17d4007390 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4005c30 con 0x7f17d4007390 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17e959a640 1 -- 172.21.15.49:0/2999803019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e402c8b0 con 0x7f17d4007390 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17f087a640 1 -- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 msgr2=0x7f17d400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.809+0000 7f17f087a640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 0x7f17d400db90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c240 tx=0x7f17d4007a00 comp rx=0 tx=0).stop 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.810+0000 7f17f087a640 1 -- 172.21.15.49:0/2999803019 shutdown_connections 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.810+0000 7f17f087a640 1 --2- 172.21.15.49:0/2999803019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d4007390 0x7f17d400db90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.810+0000 7f17f087a640 1 -- 172.21.15.49:0/2999803019 >> 172.21.15.49:0/2999803019 conn(0x7f17ec0cbb70 msgr2=0x7f17ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.810+0000 7f17f087a640 1 -- 172.21.15.49:0/2999803019 shutdown_connections 2023-12-19T05:38:58.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.810+0000 7f17f087a640 1 -- 172.21.15.49:0/2999803019 wait complete. 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.812+0000 7f17f087a640 1 Processor -- start 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.812+0000 7f17f087a640 1 -- start start 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 0x7f17ec155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17ec1f2ad0 0x7f17ec1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0b18c0 con 0x7f17ec15a7f0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec15b360 con 0x7f17d4007390 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17f087a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec15b640 con 0x7f17ec1f2ad0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17ead9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17ead9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54610/0 (socket says 172.21.15.49:54610) 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17ead9d640 1 -- 172.21.15.49:0/3587816165 learned_addr learned my addr 172.21.15.49:0/3587816165 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17e9d9b640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17ec1f2ad0 0x7f17ec1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.813+0000 7f17ea59c640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 0x7f17ec155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 -- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17ec1f2ad0 msgr2=0x7f17ec1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17ec1f2ad0 0x7f17ec1f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 -- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 msgr2=0x7f17ec155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 0x7f17ec155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 -- 172.21.15.49:0/3587816165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec15b920 con 0x7f17ec15a7f0 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ea59c640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 0x7f17ec155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17ead9d640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c360 tx=0x7f17e4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40049e0 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4004b40 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec15bc00 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4000ed0 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.814+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec155590 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.816+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec061910 con 0x7f17ec15a7f0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.816+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17e4032070 con 0x7f17ec15a7f0 2023-12-19T05:38:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.817+0000 7f17daffd640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 0x7f17cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.817+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f17e403c070 con 0x7f17ec15a7f0 2023-12-19T05:38:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.818+0000 7f17ea59c640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 0x7f17cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.819+0000 7f17ea59c640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 0x7f17cc06c8f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17dc000f80 tx=0x7f17dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:58.821+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17e40751c0 con 0x7f17ec15a7f0 2023-12-19T05:38:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.063+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17ec06e1a0 con 0x7f17ec15a7f0 2023-12-19T05:38:59.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.064+0000 7f17daffd640 1 -- 172.21.15.49:0/3587816165 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f17e4045020 con 0x7f17ec15a7f0 2023-12-19T05:38:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:59.066 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T05:38:59.066 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2023-12-19T05:38:59.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 msgr2=0x7f17cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 0x7f17cc06c8f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17dc000f80 tx=0x7f17dc009040 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 msgr2=0x7f17ec15ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c360 tx=0x7f17e4001a00 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 shutdown_connections 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17cc06a430 0x7f17cc06c8f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17ec1f2ad0 0x7f17ec1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17ec15a7f0 0x7f17ec15ac70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 --2- 172.21.15.49:0/3587816165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d4007390 0x7f17ec155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 >> 172.21.15.49:0/3587816165 conn(0x7f17ec0cbb70 msgr2=0x7f17ec06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.067+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 shutdown_connections 2023-12-19T05:38:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.068+0000 7f17f087a640 1 -- 172.21.15.49:0/3587816165 wait complete. 2023-12-19T05:38:59.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:59.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.306+0000 7f9f48173640 1 Processor -- start 2023-12-19T05:38:59.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.306+0000 7f9f48173640 1 -- start start 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f48173640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f40146e10 0x7f9f400d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f48173640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400d2b00 0x7f9f400b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f48173640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400cd840 con 0x7f9f400ce110 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f48173640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400d2430 con 0x7f9f40146e10 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f48173640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400d2620 con 0x7f9f400d2b00 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f45f0f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f40146e10 0x7f9f400d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f45f0f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f40146e10 0x7f9f400d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54622/0 (socket says 172.21.15.49:54622) 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.308+0000 7f9f45f0f640 1 -- 172.21.15.49:0/2353001790 learned_addr learned my addr 172.21.15.49:0/2353001790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.309+0000 7f9f4570e640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400d2b00 0x7f9f400b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.309+0000 7f9f45f0f640 1 -- 172.21.15.49:0/2353001790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400d2b00 msgr2=0x7f9f400b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.309+0000 7f9f45f0f640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400d2b00 0x7f9f400b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.309+0000 7f9f45f0f640 1 -- 172.21.15.49:0/2353001790 >> v1:172.21.15.115:6789/0 conn(0x7f9f400ce110 legacy=0x7f9f400b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.309+0000 7f9f45f0f640 1 -- 172.21.15.49:0/2353001790 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400b41c0 con 0x7f9f40146e10 2023-12-19T05:38:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.310+0000 7f9f45f0f640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f400d1ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009870 tx=0x7f9f3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8c5444d9b31eb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.310+0000 7f9f44f0d640 1 -- 172.21.15.49:0/2353001790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c031640 con 0x7f9f40146e10 2023-12-19T05:38:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.310+0000 7f9f44f0d640 1 -- 172.21.15.49:0/2353001790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0317a0 con 0x7f9f40146e10 2023-12-19T05:38:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.310+0000 7f9f44f0d640 1 -- 172.21.15.49:0/2353001790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c031b30 con 0x7f9f40146e10 2023-12-19T05:38:59.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 -- 172.21.15.49:0/2353001790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 msgr2=0x7f9f400d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f400d1ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009870 tx=0x7f9f3c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 -- 172.21.15.49:0/2353001790 shutdown_connections 2023-12-19T05:38:59.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400d2b00 0x7f9f400b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 --2- 172.21.15.49:0/2353001790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f400d1ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 -- 172.21.15.49:0/2353001790 >> 172.21.15.49:0/2353001790 conn(0x7f9f400b29c0 msgr2=0x7f9f400b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 -- 172.21.15.49:0/2353001790 shutdown_connections 2023-12-19T05:38:59.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.311+0000 7f9f48173640 1 -- 172.21.15.49:0/2353001790 wait complete. 2023-12-19T05:38:59.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.313+0000 7f9f48173640 1 Processor -- start 2023-12-19T05:38:59.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.313+0000 7f9f48173640 1 -- start start 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400ce110 0x7f9f400b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f400d2b00 0x7f9f401580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40144180 con 0x7f9f40146e10 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40143500 con 0x7f9f400d2b00 2023-12-19T05:38:59.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f48173640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f401437e0 con 0x7f9f400ce110 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f46710640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f46710640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54636/0 (socket says 172.21.15.49:54636) 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.314+0000 7f9f46710640 1 -- 172.21.15.49:0/2463656104 learned_addr learned my addr 172.21.15.49:0/2463656104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f45f0f640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400ce110 0x7f9f400b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f4570e640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f400d2b00 0x7f9f401580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 -- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400ce110 msgr2=0x7f9f400b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400ce110 0x7f9f400b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 -- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f400d2b00 msgr2=0x7f9f401580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f400d2b00 0x7f9f401580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 -- 172.21.15.49:0/2463656104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0094d0 con 0x7f9f40146e10 2023-12-19T05:38:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f46710640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c780 tx=0x7f9f3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38004b60 con 0x7f9f40146e10 2023-12-19T05:38:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3800ce90 con 0x7f9f40146e10 2023-12-19T05:38:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800a850 con 0x7f9f40146e10 2023-12-19T05:38:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.315+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f40143ac0 con 0x7f9f40146e10 2023-12-19T05:38:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.316+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4015d590 con 0x7f9f40146e10 2023-12-19T05:38:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.317+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f401442c0 con 0x7f9f40146e10 2023-12-19T05:38:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.318+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f3800a9b0 con 0x7f9f40146e10 2023-12-19T05:38:59.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.319+0000 7f9f367fc640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 0x7f9f2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.319+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f38088710 con 0x7f9f40146e10 2023-12-19T05:38:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.320+0000 7f9f45f0f640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 0x7f9f2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.321+0000 7f9f45f0f640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 0x7f9f2406c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c036000 tx=0x7f9f3c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.324+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f401442c0 con 0x7f9f40146e10 2023-12-19T05:38:59.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.522+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f401442c0 con 0x7f9f40146e10 2023-12-19T05:38:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.524+0000 7f9f367fc640 1 -- 172.21.15.49:0/2463656104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f9f401442c0 con 0x7f9f40146e10 2023-12-19T05:38:59.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:38:59.525 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:38:54.984421+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.526+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 msgr2=0x7f9f2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.526+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 0x7f9f2406c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c036000 tx=0x7f9f3c03c040 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.526+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 msgr2=0x7f9f4015efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c780 tx=0x7f9f3800cc40 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 shutdown_connections 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f2406a430 0x7f9f2406c8f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f40146e10 0x7f9f4015efd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f400d2b00 0x7f9f401580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 --2- 172.21.15.49:0/2463656104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f400ce110 0x7f9f400b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 >> 172.21.15.49:0/2463656104 conn(0x7f9f400b29c0 msgr2=0x7f9f400d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 shutdown_connections 2023-12-19T05:38:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.527+0000 7f9f48173640 1 -- 172.21.15.49:0/2463656104 wait complete. 2023-12-19T05:38:59.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:38:59.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:38:59.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.773+0000 7fb82bbb9640 1 Processor -- start 2023-12-19T05:38:59.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.773+0000 7fb82bbb9640 1 -- start start 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.775+0000 7fb82bbb9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb82406fc40 0x7fb8240d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.775+0000 7fb82bbb9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 0x7fb82415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.775+0000 7fb82bbb9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb824161e70 con 0x7fb824146ff0 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb82bbb9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb824161080 con 0x7fb82406fc40 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb82bbb9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb824161260 con 0x7fb8240b6430 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb82406fc40 0x7fb8240d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb82406fc40 0x7fb8240d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54638/0 (socket says 172.21.15.49:54638) 2023-12-19T05:38:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 -- 172.21.15.49:0/3439169551 learned_addr learned my addr 172.21.15.49:0/3439169551 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:59.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb82a156640 1 --2- 172.21.15.49:0/3439169551 >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 0x7fb82415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 -- 172.21.15.49:0/3439169551 >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 msgr2=0x7fb82415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:59.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 --2- 172.21.15.49:0/3439169551 >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 0x7fb82415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 -- 172.21.15.49:0/3439169551 >> v1:172.21.15.49:6789/0 conn(0x7fb824146ff0 legacy=0x7fb82406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb829154640 1 -- 172.21.15.49:0/3439169551 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824161540 con 0x7fb82406fc40 2023-12-19T05:38:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.776+0000 7fb82a156640 1 --2- 172.21.15.49:0/3439169551 >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 0x7fb82415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb829154640 1 --2- 172.21.15.49:0/3439169551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb82406fc40 0x7fb8240d10f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8241620f0 tx=0x7fb81402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9e5a1361e178fa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb828953640 1 -- 172.21.15.49:0/3439169551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814030870 con 0x7fb82406fc40 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb828953640 1 -- 172.21.15.49:0/3439169551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8140309d0 con 0x7fb82406fc40 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb828953640 1 -- 172.21.15.49:0/3439169551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814030d60 con 0x7fb82406fc40 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb82bbb9640 1 -- 172.21.15.49:0/3439169551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb82406fc40 msgr2=0x7fb8240d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.778+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/3439169551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb82406fc40 0x7fb8240d10f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8241620f0 tx=0x7fb81402b9b0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 -- 172.21.15.49:0/3439169551 shutdown_connections 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/3439169551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb82406fc40 0x7fb8240d10f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/3439169551 >> v2:172.21.15.115:3300/0 conn(0x7fb8240b6430 0x7fb82415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 -- 172.21.15.49:0/3439169551 >> 172.21.15.49:0/3439169551 conn(0x7fb8240d3520 msgr2=0x7fb8240d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 -- 172.21.15.49:0/3439169551 shutdown_connections 2023-12-19T05:38:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.779+0000 7fb82bbb9640 1 -- 172.21.15.49:0/3439169551 wait complete. 2023-12-19T05:38:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.780+0000 7fb82bbb9640 1 Processor -- start 2023-12-19T05:38:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.781+0000 7fb82bbb9640 1 -- start start 2023-12-19T05:38:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.781+0000 7fb82bbb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb82406fc40 0x7fb824143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82bbb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8240b6430 0x7fb82415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82bbb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82bbb9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240c96f0 con 0x7fb824146ff0 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82bbb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240c8e50 con 0x7fb82406fc40 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82bbb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240c9130 con 0x7fb8240b6430 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54648/0 (socket says 172.21.15.49:54648) 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 -- 172.21.15.49:0/714302303 learned_addr learned my addr 172.21.15.49:0/714302303 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb829955640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb82406fc40 0x7fb824143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb829154640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8240b6430 0x7fb82415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 -- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8240b6430 msgr2=0x7fb82415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8240b6430 0x7fb82415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 -- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb82406fc40 msgr2=0x7fb824143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb82406fc40 0x7fb824143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.782+0000 7fb82a156640 1 -- 172.21.15.49:0/714302303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140094d0 con 0x7fb824146ff0 2023-12-19T05:38:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb82a156640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00cef0 tx=0x7fb81c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00d840 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00d9c0 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00dd70 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240c9410 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.783+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb824143cc0 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.784+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb824141e70 con 0x7fb824146ff0 2023-12-19T05:38:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.785+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb81c01e3b0 con 0x7fb824146ff0 2023-12-19T05:38:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.786+0000 7fb81a7fc640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 0x7fb80806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.786+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb81c089090 con 0x7fb824146ff0 2023-12-19T05:38:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.787+0000 7fb829955640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 0x7fb80806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.788+0000 7fb829955640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 0x7fb80806c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb820000f60 tx=0x7fb820009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.791+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb81c054a90 con 0x7fb824146ff0 2023-12-19T05:38:59.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.989+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8241617f0 con 0x7fb824146ff0 2023-12-19T05:38:59.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.990+0000 7fb81a7fc640 1 -- 172.21.15.49:0/714302303 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb81c01a020 con 0x7fb824146ff0 2023-12-19T05:38:59.991 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:38:59.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 msgr2=0x7fb80806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 0x7fb80806c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb820000f60 tx=0x7fb820009040 comp rx=0 tx=0).stop 2023-12-19T05:38:59.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 msgr2=0x7fb8241f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00cef0 tx=0x7fb81c00a710 comp rx=0 tx=0).stop 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 shutdown_connections 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb80806a430 0x7fb80806c8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8240b6430 0x7fb82415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb824146ff0 0x7fb8241f5f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 --2- 172.21.15.49:0/714302303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb82406fc40 0x7fb824143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 >> 172.21.15.49:0/714302303 conn(0x7fb8240d3520 msgr2=0x7fb82406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 shutdown_connections 2023-12-19T05:38:59.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:38:59.993+0000 7fb82bbb9640 1 -- 172.21.15.49:0/714302303 wait complete. 2023-12-19T05:39:00.013 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:39:00.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.243+0000 7efce02ca640 1 Processor -- start 2023-12-19T05:39:00.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.243+0000 7efce02ca640 1 -- start start 2023-12-19T05:39:00.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efce02ca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcd815d480 0x7efcd80c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efce02ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 0x7efcd80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efce02ca640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80cbac0 con 0x7efcd80b25c0 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efce02ca640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80b2f90 con 0x7efcd815d480 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efce02ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd815e440 con 0x7efcd815df70 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efcde066640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcd815d480 0x7efcd80c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efcde066640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcd815d480 0x7efcd80c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54660/0 (socket says 172.21.15.49:54660) 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.245+0000 7efcde066640 1 -- 172.21.15.49:0/2838601890 learned_addr learned my addr 172.21.15.49:0/2838601890 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:00.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde066640 1 -- 172.21.15.49:0/2838601890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 msgr2=0x7efcd80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde867640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 0x7efcd80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde066640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 0x7efcd80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde066640 1 -- 172.21.15.49:0/2838601890 >> v1:172.21.15.115:6789/0 conn(0x7efcd80b25c0 legacy=0x7efcd815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde066640 1 -- 172.21.15.49:0/2838601890 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd815e720 con 0x7efcd815d480 2023-12-19T05:39:00.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.246+0000 7efcde867640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 0x7efcd80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.247+0000 7efcde066640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd815d480 0x7efcd80c7500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009870 tx=0x7efcd402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffa23f63eb5eb35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.247+0000 7efcdd064640 1 -- 172.21.15.49:0/2838601890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4031640 con 0x7efcd815d480 2023-12-19T05:39:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efcdd064640 1 -- 172.21.15.49:0/2838601890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd40317a0 con 0x7efcd815d480 2023-12-19T05:39:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efcdd064640 1 -- 172.21.15.49:0/2838601890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4031b30 con 0x7efcd815d480 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 -- 172.21.15.49:0/2838601890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd815d480 msgr2=0x7efcd80c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd815d480 0x7efcd80c7500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009870 tx=0x7efcd402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 -- 172.21.15.49:0/2838601890 shutdown_connections 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815df70 0x7efcd80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 --2- 172.21.15.49:0/2838601890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd815d480 0x7efcd80c7500 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 -- 172.21.15.49:0/2838601890 >> 172.21.15.49:0/2838601890 conn(0x7efcd806a2e0 msgr2=0x7efcd806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 -- 172.21.15.49:0/2838601890 shutdown_connections 2023-12-19T05:39:00.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.248+0000 7efce02ca640 1 -- 172.21.15.49:0/2838601890 wait complete. 2023-12-19T05:39:00.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.250+0000 7efce02ca640 1 Processor -- start 2023-12-19T05:39:00.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.250+0000 7efce02ca640 1 -- start start 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815d480 0x7efcd815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd815df70 0x7efcd815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b5970 con 0x7efcd80b25c0 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b6940 con 0x7efcd815df70 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.251+0000 7efce02ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b5b80 con 0x7efcd815d480 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54674/0 (socket says 172.21.15.49:54674) 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 -- 172.21.15.49:0/355772809 learned_addr learned my addr 172.21.15.49:0/355772809 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcdd865640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815d480 0x7efcd815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 -- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815d480 msgr2=0x7efcd815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815d480 0x7efcd815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 -- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd815df70 msgr2=0x7efcd815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd815df70 0x7efcd815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 -- 172.21.15.49:0/355772809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd40094d0 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.252+0000 7efcde066640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009870 tx=0x7efcd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.253+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd403ac60 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.253+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd403ade0 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.253+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4044630 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.253+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80b5e60 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.253+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd80b6420 con 0x7efcd80b25c0 2023-12-19T05:39:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.254+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd80b6610 con 0x7efcd80b25c0 2023-12-19T05:39:00.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.255+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcd402f050 con 0x7efcd80b25c0 2023-12-19T05:39:00.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.256+0000 7efcceffd640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 0x7efcbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.256+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcd40aa830 con 0x7efcd80b25c0 2023-12-19T05:39:00.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.256+0000 7efcdd865640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 0x7efcbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.257+0000 7efcdd865640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 0x7efcbc06c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b5730 tx=0x7efcc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.261+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcd40760d0 con 0x7efcd80b25c0 2023-12-19T05:39:00.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.457+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efcd8061910 con 0x7efcd80b25c0 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.458+0000 7efcceffd640 1 -- 172.21.15.49:0/355772809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7efcd40796f0 con 0x7efcd80b25c0 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:39:00.459 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 msgr2=0x7efcbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 0x7efcbc06c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b5730 tx=0x7efcc8009040 comp rx=0 tx=0).stop 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 msgr2=0x7efcd80d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009870 tx=0x7efcd40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 shutdown_connections 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcbc06a430 0x7efcbc06c8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd815d480 0x7efcd815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd815df70 0x7efcd815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 --2- 172.21.15.49:0/355772809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd80b25c0 0x7efcd80d1760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.460+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 >> 172.21.15.49:0/355772809 conn(0x7efcd806a2e0 msgr2=0x7efcd815d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.461+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 shutdown_connections 2023-12-19T05:39:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.461+0000 7efce02ca640 1 -- 172.21.15.49:0/355772809 wait complete. 2023-12-19T05:39:00.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:39:00.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:39:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.715+0000 7f0a439f0640 1 Processor -- start 2023-12-19T05:39:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.715+0000 7f0a439f0640 1 -- start start 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.716+0000 7f0a439f0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a3c06dc50 0x7f0a3c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a439f0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0cfb90 con 0x7f0a3c15b290 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a439f0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0d0c50 con 0x7f0a3c0cf030 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a439f0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0d00b0 con 0x7f0a3c06dc50 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a4178c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0a3c15b290 0x7f0a3c0ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38184/0 (socket says 172.21.15.49:38184) 2023-12-19T05:39:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a4178c640 1 -- 172.21.15.49:0/1880800803 learned_addr learned my addr 172.21.15.49:0/1880800803 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/1880800803 >> v2:172.21.15.115:3300/0 conn(0x7f0a3c06dc50 0x7f0a3c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27304535 0 0) 0x7f0a2c001490 con 0x7f0a3c15b290 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.717+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a24003520 con 0x7f0a3c15b290 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974360830 0 0) 0x7f0a24003520 con 0x7f0a3c15b290 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 >> v2:172.21.15.115:3300/0 conn(0x7f0a3c06dc50 msgr2=0x7f0a3c06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 --2- 172.21.15.49:0/1880800803 >> v2:172.21.15.115:3300/0 conn(0x7f0a3c06dc50 0x7f0a3c06e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 >> v1:172.21.15.115:6789/0 conn(0x7f0a3c0cf030 legacy=0x7f0a3c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0cfdd0 con 0x7f0a3c15b290 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0a2c001b80 con 0x7f0a3c15b290 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 >> v1:172.21.15.49:6789/0 conn(0x7f0a3c15b290 legacy=0x7f0a3c0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a240039e0 0x7f0a24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a240051f0 0x7f0a2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0d00b0 con 0x7f0a240047c0 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2400c150 con 0x7f0a240051f0 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2400c310 con 0x7f0a240039e0 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.718+0000 7f0a40f8b640 1 -- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a240039e0 msgr2=0x7f0a24003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.719+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a240039e0 0x7f0a24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.719+0000 7f0a40f8b640 1 -- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a240051f0 msgr2=0x7f0a2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.719+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a240051f0 0x7f0a2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.719+0000 7f0a40f8b640 1 -- 172.21.15.49:0/1880800803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24003520 con 0x7f0a240047c0 2023-12-19T05:39:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.719+0000 7f0a41f8d640 1 -- 172.21.15.49:0/1880800803 reap_dead start 2023-12-19T05:39:00.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a24004c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009ac0 tx=0x7f0a240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf865915bc71f84 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3002c6d0 con 0x7f0a240047c0 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3002c830 con 0x7f0a240047c0 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a3bfff640 1 -- 172.21.15.49:0/1880800803 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3002cbc0 con 0x7f0a240047c0 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 -- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 msgr2=0x7f0a24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a24004c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009ac0 tx=0x7f0a240057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 -- 172.21.15.49:0/1880800803 shutdown_connections 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 --2- 172.21.15.49:0/1880800803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a24004c40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 -- 172.21.15.49:0/1880800803 >> 172.21.15.49:0/1880800803 conn(0x7f0a3c071370 msgr2=0x7f0a3c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.720+0000 7f0a439f0640 1 -- 172.21.15.49:0/1880800803 shutdown_connections 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.721+0000 7f0a439f0640 1 -- 172.21.15.49:0/1880800803 wait complete. 2023-12-19T05:39:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.722+0000 7f0a439f0640 1 Processor -- start 2023-12-19T05:39:00.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.722+0000 7f0a439f0640 1 -- start start 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 0x7f0a3c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 0x7f0a3c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c154710 con 0x7f0a240047c0 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15a520 con 0x7f0a3c1539a0 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.723+0000 7f0a439f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15aaa0 con 0x7f0a3c153ef0 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54688/0 (socket says 172.21.15.49:54688) 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 -- 172.21.15.49:0/2629124670 learned_addr learned my addr 172.21.15.49:0/2629124670 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 0x7f0a3c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 -- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 msgr2=0x7f0a3c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 0x7f0a3c0b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a41f8d640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 0x7f0a3c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 -- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 msgr2=0x7f0a3c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 0x7f0a3c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 -- 172.21.15.49:0/2629124670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c1568c0 con 0x7f0a240047c0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 0x7f0a3c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a41f8d640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 0x7f0a3c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a4178c640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c007fd0 tx=0x7f0a2c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.724+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00a760 con 0x7f0a240047c0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.725+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00a900 con 0x7f0a240047c0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.725+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00acb0 con 0x7f0a240047c0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.725+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c15a7c0 con 0x7f0a240047c0 2023-12-19T05:39:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.725+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c156ba0 con 0x7f0a240047c0 2023-12-19T05:39:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.726+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c15b950 con 0x7f0a240047c0 2023-12-19T05:39:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.727+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a2c0070d0 con 0x7f0a240047c0 2023-12-19T05:39:00.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.728+0000 7f0a39ffb640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 0x7f0a2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.728+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a2c087cb0 con 0x7f0a240047c0 2023-12-19T05:39:00.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.728+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 0x7f0a2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.730+0000 7f0a40f8b640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 0x7f0a2806c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a30036000 tx=0x7f0a30030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.732+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a3c15b950 con 0x7f0a240047c0 2023-12-19T05:39:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:00.924+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0a3c0cfb90 con 0x7f0a240047c0 2023-12-19T05:39:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.168+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2629124670 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0a3c0cfb90 con 0x7f0a240047c0 2023-12-19T05:39:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:39:01.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.174+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 msgr2=0x7f0a2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.174+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 0x7f0a2806c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a30036000 tx=0x7f0a30030000 comp rx=0 tx=0).stop 2023-12-19T05:39:01.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.174+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 msgr2=0x7f0a3c153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.174+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c007fd0 tx=0x7f0a2c00cf00 comp rx=0 tx=0).stop 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 shutdown_connections 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a2806a430 0x7f0a2806c8f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a3c153ef0 0x7f0a3c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a3c1539a0 0x7f0a3c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 --2- 172.21.15.49:0/2629124670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a240047c0 0x7f0a3c153180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.175+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 >> 172.21.15.49:0/2629124670 conn(0x7f0a3c071370 msgr2=0x7f0a3c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.177+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 shutdown_connections 2023-12-19T05:39:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.177+0000 7f0a439f0640 1 -- 172.21.15.49:0/2629124670 wait complete. 2023-12-19T05:39:01.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:39:01.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.431+0000 7f895e318640 1 Processor -- start 2023-12-19T05:39:01.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.431+0000 7f895e318640 1 -- start start 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f895e318640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f895815c460 0x7f895806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f895e318640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f895806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f895e318640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8958070130 con 0x7f8958158df0 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f895e318640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895806f6a0 con 0x7f895815c460 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f895e318640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895815c910 con 0x7f895806d850 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f8957fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8958158df0 0x7f89580cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38194/0 (socket says 172.21.15.49:38194) 2023-12-19T05:39:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f8957fff640 1 -- 172.21.15.49:0/913421911 learned_addr learned my addr 172.21.15.49:0/913421911 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:01.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.433+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125565658 0 0) 0x7f8958070130 con 0x7f8958158df0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8944003520 con 0x7f8958158df0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> v2:172.21.15.115:3300/0 conn(0x7f895815c460 0x7f895806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f895c8b5640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f895806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991868341 0 0) 0x7f8944003520 con 0x7f8958158df0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 msgr2=0x7f895806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f895806dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 >> v2:172.21.15.115:3300/0 conn(0x7f895815c460 msgr2=0x7f895806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 --2- 172.21.15.49:0/913421911 >> v2:172.21.15.115:3300/0 conn(0x7f895815c460 0x7f895806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895806e1c0 con 0x7f8958158df0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8948001670 con 0x7f8958158df0 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> v2:172.21.15.115:3300/0 conn(0x7f895815c460 0x7f895806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f895c8b5640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f895806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 >> v1:172.21.15.49:6789/0 conn(0x7f8958158df0 legacy=0x7f89580cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f8944003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8944004d00 0x7f8944005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895815c910 con 0x7f8944003f60 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894400ba60 con 0x7f8944004d00 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bc20 con 0x7f895806d850 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.434+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f8957fff640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f8944003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f895c8b5640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8944004d00 0x7f8944005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f894ffff640 1 -- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 msgr2=0x7f8944003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f895806d850 0x7f8944003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f894ffff640 1 -- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8944004d00 msgr2=0x7f8944005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8944004d00 0x7f8944005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.435+0000 7f894ffff640 1 -- 172.21.15.49:0/913421911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944003520 con 0x7f8944003f60 2023-12-19T05:39:01.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.436+0000 7f894ffff640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89440047c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f89400098a0 tx=0x7f89440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc39ccec7caa9aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.436+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940004230 con 0x7f8944003f60 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.436+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8940004390 con 0x7f8944003f60 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f89577fe640 1 -- 172.21.15.49:0/913421911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940003830 con 0x7f8944003f60 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 -- 172.21.15.49:0/913421911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 msgr2=0x7f89440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 --2- 172.21.15.49:0/913421911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89440047c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f89400098a0 tx=0x7f89440057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895c8b5640 1 -- 172.21.15.49:0/913421911 reap_dead start 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 -- 172.21.15.49:0/913421911 shutdown_connections 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 -- 172.21.15.49:0/913421911 >> 172.21.15.49:0/913421911 conn(0x7f89580cf0b0 msgr2=0x7f89580cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 -- 172.21.15.49:0/913421911 shutdown_connections 2023-12-19T05:39:01.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.437+0000 7f895e318640 1 -- 172.21.15.49:0/913421911 wait complete. 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.439+0000 7f895e318640 1 Processor -- start 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.439+0000 7f895e318640 1 -- start start 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 0x7f895815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89581563c0 0x7f8958156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958156d80 con 0x7f8944003f60 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895806d1e0 con 0x7f89581563c0 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.440+0000 7f895e318640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895806cbd0 con 0x7f89581f6a40 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54712/0 (socket says 172.21.15.49:54712) 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 -- 172.21.15.49:0/154448549 learned_addr learned my addr 172.21.15.49:0/154448549 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f895c8b5640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89581563c0 0x7f8958156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f894ffff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 0x7f895815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 -- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 msgr2=0x7f895815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 0x7f895815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 -- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89581563c0 msgr2=0x7f8958156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89581563c0 0x7f8958156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 -- 172.21.15.49:0/154448549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89581f6ec0 con 0x7f8944003f60 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f894ffff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 0x7f895815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.441+0000 7f8957fff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f894800e870 tx=0x7f894800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.442+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800c8d0 con 0x7f8944003f60 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.442+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800ca50 con 0x7f8944003f60 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.442+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895815b0e0 con 0x7f8944003f60 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.442+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800ce00 con 0x7f8944003f60 2023-12-19T05:39:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.442+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895806ce70 con 0x7f8944003f60 2023-12-19T05:39:01.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.443+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8958074770 con 0x7f8944003f60 2023-12-19T05:39:01.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.444+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f894801d460 con 0x7f8944003f60 2023-12-19T05:39:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.446+0000 7f89557fa640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 0x7f893806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.446+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f89480886c0 con 0x7f8944003f60 2023-12-19T05:39:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.446+0000 7f894ffff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 0x7f893806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.447+0000 7f894ffff640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 0x7f893806c8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8940035000 tx=0x7f8940039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.451+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8948053f20 con 0x7f8944003f60 2023-12-19T05:39:01.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:01.644+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8958061910 con 0x7f8944003f60 2023-12-19T05:39:02.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.182+0000 7f89557fa640 1 -- 172.21.15.49:0/154448549 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8948057540 con 0x7f8944003f60 2023-12-19T05:39:02.188 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:39:02.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.190+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 msgr2=0x7f893806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.190+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 0x7f893806c8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8940035000 tx=0x7f8940039040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.190+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 msgr2=0x7f89581e4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.190+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f894800e870 tx=0x7f894800ed30 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 shutdown_connections 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f893806a430 0x7f893806c8f0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8940035000 tx=0x7f8940039040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89581f6a40 0x7f895815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89581563c0 0x7f8958156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 --2- 172.21.15.49:0/154448549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8944003f60 0x7f89581e4dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.191+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 >> 172.21.15.49:0/154448549 conn(0x7f89580cf0b0 msgr2=0x7f895815b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.194+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 shutdown_connections 2023-12-19T05:39:02.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.194+0000 7f895e318640 1 -- 172.21.15.49:0/154448549 wait complete. 2023-12-19T05:39:02.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:39:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.427+0000 7f3dc472e640 1 Processor -- start 2023-12-19T05:39:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.428+0000 7f3dc472e640 1 -- start start 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.429+0000 7f3dc472e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.429+0000 7f3dc472e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3dbc0ad300 0x7f3dbc0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.429+0000 7f3dc472e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc15da00 con 0x7f3dbc0b0070 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.429+0000 7f3dc472e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc15e940 con 0x7f3dbc0ad300 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.429+0000 7f3dc472e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0adcc0 con 0x7f3dbc157c30 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3dbc0ad300 0x7f3dbc0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3dbc0ad300 0x7f3dbc0ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54726/0 (socket says 172.21.15.49:54726) 2023-12-19T05:39:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2029069466 learned_addr learned my addr 172.21.15.49:0/2029069466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc24ca640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2029069466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 msgr2=0x7f3dbc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2029069466 >> v1:172.21.15.115:6789/0 conn(0x7f3dbc0b0070 legacy=0x7f3dbc0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.430+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2029069466 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc0cf860 con 0x7f3dbc0ad300 2023-12-19T05:39:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.431+0000 7f3dc1cc9640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc0ad780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098a0 tx=0x7f3dac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a566148c0c084b51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.432+0000 7f3dc14c8640 1 -- 172.21.15.49:0/2029069466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031640 con 0x7f3dbc0ad300 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.432+0000 7f3dc14c8640 1 -- 172.21.15.49:0/2029069466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0317a0 con 0x7f3dbc0ad300 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.432+0000 7f3dc14c8640 1 -- 172.21.15.49:0/2029069466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031b30 con 0x7f3dbc0ad300 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.432+0000 7f3dc472e640 1 -- 172.21.15.49:0/2029069466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0ad300 msgr2=0x7f3dbc0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.432+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc0ad780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098a0 tx=0x7f3dac02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 -- 172.21.15.49:0/2029069466 shutdown_connections 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc0ad780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2029069466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 -- 172.21.15.49:0/2029069466 >> 172.21.15.49:0/2029069466 conn(0x7f3dbc073150 msgr2=0x7f3dbc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 -- 172.21.15.49:0/2029069466 shutdown_connections 2023-12-19T05:39:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.433+0000 7f3dc472e640 1 -- 172.21.15.49:0/2029069466 wait complete. 2023-12-19T05:39:02.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.434+0000 7f3dc472e640 1 Processor -- start 2023-12-19T05:39:02.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 -- start start 2023-12-19T05:39:02.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc1f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc06c190 con 0x7f3dbc0b0070 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1f6c90 con 0x7f3dbc0ad300 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.435+0000 7f3dc472e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc15f700 con 0x7f3dbc157c30 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54740/0 (socket says 172.21.15.49:54740) 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2317998340 learned_addr learned my addr 172.21.15.49:0/2317998340 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc24ca640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc1f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 msgr2=0x7f3dbc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dbc0ad300 msgr2=0x7f3dbc1f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc1f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.436+0000 7f3dc1cc9640 1 -- 172.21.15.49:0/2317998340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0094d0 con 0x7f3dbc0b0070 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3dc1cc9640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098a0 tx=0x7f3dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac03ac60 con 0x7f3dbc0b0070 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac03adc0 con 0x7f3dbc0b0070 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac044630 con 0x7f3dbc0b0070 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc15f9e0 con 0x7f3dbc0b0070 2023-12-19T05:39:02.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.437+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc1f6920 con 0x7f3dbc0b0070 2023-12-19T05:39:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.438+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc061910 con 0x7f3dbc0b0070 2023-12-19T05:39:02.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.440+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3dac02f050 con 0x7f3dbc0b0070 2023-12-19T05:39:02.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.441+0000 7f3db2ffd640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 0x7f3da006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.441+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3dac0aa7e0 con 0x7f3dbc0b0070 2023-12-19T05:39:02.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.441+0000 7f3dc24ca640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 0x7f3da006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.442+0000 7f3dc24ca640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 0x7f3da006c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006fd0 tx=0x7f3db8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.446+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3dac075e20 con 0x7f3dbc0b0070 2023-12-19T05:39:02.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.678+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3dbc1f6dd0 con 0x7f3dbc0b0070 2023-12-19T05:39:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.691+0000 7f3db2ffd640 1 -- 172.21.15.49:0/2317998340 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3dac031e60 con 0x7f3dbc0b0070 2023-12-19T05:39:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T05:39:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 msgr2=0x7f3da006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 0x7f3da006c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006fd0 tx=0x7f3db8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 msgr2=0x7f3dbc14ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098a0 tx=0x7f3dac0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 shutdown_connections 2023-12-19T05:39:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.695+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3da006a460 0x7f3da006c920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.696+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3dbc157c30 0x7f3dbc06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.696+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3dbc0b0070 0x7f3dbc14ab80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.696+0000 7f3dc472e640 1 --2- 172.21.15.49:0/2317998340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dbc0ad300 0x7f3dbc1f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.696+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 >> 172.21.15.49:0/2317998340 conn(0x7f3dbc073150 msgr2=0x7f3dbc0af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.701+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 shutdown_connections 2023-12-19T05:39:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.701+0000 7f3dc472e640 1 -- 172.21.15.49:0/2317998340 wait complete. 2023-12-19T05:39:02.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.919+0000 7fef7f95c640 1 Processor -- start 2023-12-19T05:39:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.919+0000 7fef7f95c640 1 -- start start 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7f95c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780b0b50 0x7fef7806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7f95c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef7806b590 0x7fef7806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7f95c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7806bb30 con 0x7fef781449e0 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7f95c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef780b0070 con 0x7fef7806b590 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7f95c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b0350 con 0x7fef780b0b50 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7def9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef7806b590 0x7fef7806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7def9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef7806b590 0x7fef7806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54752/0 (socket says 172.21.15.49:54752) 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.921+0000 7fef7def9640 1 -- 172.21.15.49:0/2362319084 learned_addr learned my addr 172.21.15.49:0/2362319084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.922+0000 7fef7cef7640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780b0b50 0x7fef7806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.922+0000 7fef7def9640 1 -- 172.21.15.49:0/2362319084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780b0b50 msgr2=0x7fef7806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.922+0000 7fef7def9640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780b0b50 0x7fef7806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.922+0000 7fef7def9640 1 -- 172.21.15.49:0/2362319084 >> v1:172.21.15.115:6789/0 conn(0x7fef781449e0 legacy=0x7fef780af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.922+0000 7fef7def9640 1 -- 172.21.15.49:0/2362319084 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780b0630 con 0x7fef7806b590 2023-12-19T05:39:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.923+0000 7fef7def9640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef7806c4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef7002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f22e3e85af27fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.924+0000 7fef6ffff640 1 -- 172.21.15.49:0/2362319084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7002cb00 con 0x7fef7806b590 2023-12-19T05:39:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.924+0000 7fef6ffff640 1 -- 172.21.15.49:0/2362319084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7002cc60 con 0x7fef7806b590 2023-12-19T05:39:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.924+0000 7fef6ffff640 1 -- 172.21.15.49:0/2362319084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700343f0 con 0x7fef7806b590 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.924+0000 7fef7f95c640 1 -- 172.21.15.49:0/2362319084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 msgr2=0x7fef7806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.924+0000 7fef7f95c640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef7806c4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef7002bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 -- 172.21.15.49:0/2362319084 shutdown_connections 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780b0b50 0x7fef7806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 --2- 172.21.15.49:0/2362319084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef7806c4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 -- 172.21.15.49:0/2362319084 >> 172.21.15.49:0/2362319084 conn(0x7fef780cbb70 msgr2=0x7fef780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 -- 172.21.15.49:0/2362319084 shutdown_connections 2023-12-19T05:39:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.925+0000 7fef7f95c640 1 -- 172.21.15.49:0/2362319084 wait complete. 2023-12-19T05:39:02.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.926+0000 7fef7f95c640 1 Processor -- start 2023-12-19T05:39:02.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.927+0000 7fef7f95c640 1 -- start start 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 0x7fef78143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 0x7fef78143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7813e4b0 con 0x7fef7806b590 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780cd750 con 0x7fef780b0b50 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7f95c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7813b800 con 0x7fef781449e0 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54758/0 (socket says 172.21.15.49:54758) 2023-12-19T05:39:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 -- 172.21.15.49:0/79977757 learned_addr learned my addr 172.21.15.49:0/79977757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7cef7640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 0x7fef78143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7def9640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 0x7fef78143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 -- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 msgr2=0x7fef78143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 0x7fef78143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 -- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 msgr2=0x7fef78143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 0x7fef78143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7d6f8640 1 -- 172.21.15.49:0/79977757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009b30 con 0x7fef7806b590 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7def9640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 0x7fef78143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.928+0000 7fef7cef7640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 0x7fef78143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef7d6f8640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c3c0 tx=0x7fef7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740052d0 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74005430 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74003830 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7815b7f0 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.929+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef780cd100 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.930+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef78061910 con 0x7fef7806b590 2023-12-19T05:39:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.931+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef74003990 con 0x7fef7806b590 2023-12-19T05:39:02.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.932+0000 7fef6dffb640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 0x7fef5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.932+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef74087f50 con 0x7fef7806b590 2023-12-19T05:39:02.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.933+0000 7fef7cef7640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 0x7fef5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.934+0000 7fef7cef7640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 0x7fef5c06c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef781443f0 tx=0x7fef68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:02.937+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef74053410 con 0x7fef7806b590 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.130+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef780b16e0 con 0x7fef7806b590 2023-12-19T05:39:03.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.133+0000 7fef6dffb640 1 -- 172.21.15.49:0/79977757 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fef74017020 con 0x7fef7806b590 2023-12-19T05:39:03.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:03.135 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:02.680661+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 msgr2=0x7fef5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 0x7fef5c06c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef781443f0 tx=0x7fef68008040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 msgr2=0x7fef781f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c3c0 tx=0x7fef7400c880 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 shutdown_connections 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5c06a430 0x7fef5c06c8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef781449e0 0x7fef78143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780b0b50 0x7fef78143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 --2- 172.21.15.49:0/79977757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7806b590 0x7fef781f2330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 >> 172.21.15.49:0/79977757 conn(0x7fef780cbb70 msgr2=0x7fef78140be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 shutdown_connections 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.136+0000 7fef7f95c640 1 -- 172.21.15.49:0/79977757 wait complete. 2023-12-19T05:39:03.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.386+0000 7fdc24210640 1 Processor -- start 2023-12-19T05:39:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.386+0000 7fdc24210640 1 -- start start 2023-12-19T05:39:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc24210640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc1c157bf0 0x7fdc1c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc24210640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc24210640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c0b0a90 con 0x7fdc1c0b0640 2023-12-19T05:39:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc24210640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c06b8c0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc24210640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c15b740 con 0x7fdc1c0ae110 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc21fac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc1c157bf0 0x7fdc1c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc21fac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc1c157bf0 0x7fdc1c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54770/0 (socket says 172.21.15.49:54770) 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.388+0000 7fdc21fac640 1 -- 172.21.15.49:0/597285021 learned_addr learned my addr 172.21.15.49:0/597285021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.389+0000 7fdc217ab640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.389+0000 7fdc21fac640 1 -- 172.21.15.49:0/597285021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 msgr2=0x7fdc1c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.389+0000 7fdc21fac640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.389+0000 7fdc21fac640 1 -- 172.21.15.49:0/597285021 >> v1:172.21.15.115:6789/0 conn(0x7fdc1c0b0640 legacy=0x7fdc1c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.389+0000 7fdc21fac640 1 -- 172.21.15.49:0/597285021 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0ae640 con 0x7fdc1c157bf0 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.390+0000 7fdc21fac640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c15b200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9782b997b0c4d4e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.390+0000 7fdc20faa640 1 -- 172.21.15.49:0/597285021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18031640 con 0x7fdc1c157bf0 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.390+0000 7fdc20faa640 1 -- 172.21.15.49:0/597285021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180317a0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.390+0000 7fdc20faa640 1 -- 172.21.15.49:0/597285021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18031b30 con 0x7fdc1c157bf0 2023-12-19T05:39:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 -- 172.21.15.49:0/597285021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 msgr2=0x7fdc1c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c15b200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc1802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 -- 172.21.15.49:0/597285021 shutdown_connections 2023-12-19T05:39:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 --2- 172.21.15.49:0/597285021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c15b200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 -- 172.21.15.49:0/597285021 >> 172.21.15.49:0/597285021 conn(0x7fdc1c0cbb70 msgr2=0x7fdc1c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 -- 172.21.15.49:0/597285021 shutdown_connections 2023-12-19T05:39:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.391+0000 7fdc24210640 1 -- 172.21.15.49:0/597285021 wait complete. 2023-12-19T05:39:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.394+0000 7fdc24210640 1 Processor -- start 2023-12-19T05:39:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.394+0000 7fdc24210640 1 -- start start 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b0640 0x7fdc1c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1506c0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c158d30 con 0x7fdc1c0b0640 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc24210640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1589b0 con 0x7fdc1c0ae110 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc227ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc227ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54782/0 (socket says 172.21.15.49:54782) 2023-12-19T05:39:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.395+0000 7fdc227ad640 1 -- 172.21.15.49:0/3264830141 learned_addr learned my addr 172.21.15.49:0/3264830141 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc217ab640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b0640 0x7fdc1c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc21fac640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 -- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 msgr2=0x7fdc1c14d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c14d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 -- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b0640 msgr2=0x7fdc1c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b0640 0x7fdc1c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 -- 172.21.15.49:0/3264830141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180094d0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc227ad640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c7b0 tx=0x7fdc1400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.396+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004b60 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.397+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14004cc0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.397+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400aa90 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.397+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c154d60 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.397+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c150930 con 0x7fdc1c157bf0 2023-12-19T05:39:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.398+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c158e70 con 0x7fdc1c157bf0 2023-12-19T05:39:03.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.399+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc1400abf0 con 0x7fdc1c157bf0 2023-12-19T05:39:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.400+0000 7fdc127fc640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.400+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc14088a90 con 0x7fdc1c157bf0 2023-12-19T05:39:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.400+0000 7fdc21fac640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.401+0000 7fdc21fac640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc18036000 tx=0x7fdc1803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.404+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc1c158e70 con 0x7fdc1c157bf0 2023-12-19T05:39:03.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.600+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1c158e70 con 0x7fdc1c157bf0 2023-12-19T05:39:03.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.603+0000 7fdc127fc640 1 -- 172.21.15.49:0/3264830141 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fdc1c158e70 con 0x7fdc1c157bf0 2023-12-19T05:39:03.605 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:03.605 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:02.680661+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 msgr2=0x7fdc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc18036000 tx=0x7fdc1803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 msgr2=0x7fdc1c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c7b0 tx=0x7fdc1400cc70 comp rx=0 tx=0).stop 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 shutdown_connections 2023-12-19T05:39:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c157bf0 0x7fdc1c0ac8b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b0640 0x7fdc1c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 --2- 172.21.15.49:0/3264830141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c0ae110 0x7fdc1c14d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 >> 172.21.15.49:0/3264830141 conn(0x7fdc1c0cbb70 msgr2=0x7fdc1c15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 shutdown_connections 2023-12-19T05:39:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.606+0000 7fdc24210640 1 -- 172.21.15.49:0/3264830141 wait complete. 2023-12-19T05:39:03.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:39:03.847 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-12-19T05:39:03.846+0000 7f7078447640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:39:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.848+0000 7f9ef4ac0640 1 Processor -- start 2023-12-19T05:39:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.848+0000 7f9ef4ac0640 1 -- start start 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9ef4ac0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ef00b0a00 0x7f9ef006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9ef4ac0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 0x7f9ef00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9ef4ac0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef015c9c0 con 0x7f9ef0155460 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9ef4ac0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef006d270 con 0x7f9ef00b0a00 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9ef4ac0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef006d550 con 0x7f9ef006ca80 2023-12-19T05:39:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9eeeffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ef00b0a00 0x7f9ef006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9eeeffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ef00b0a00 0x7f9ef006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54788/0 (socket says 172.21.15.49:54788) 2023-12-19T05:39:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.850+0000 7f9eeeffd640 1 -- 172.21.15.49:0/2850446035 learned_addr learned my addr 172.21.15.49:0/2850446035 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeffff640 1 --2- 172.21.15.49:0/2850446035 >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 0x7f9ef00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeeffd640 1 -- 172.21.15.49:0/2850446035 >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 msgr2=0x7f9ef00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeeffd640 1 --2- 172.21.15.49:0/2850446035 >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 0x7f9ef00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeeffd640 1 -- 172.21.15.49:0/2850446035 >> v1:172.21.15.115:6789/0 conn(0x7f9ef0155460 legacy=0x7f9ef00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeeffd640 1 -- 172.21.15.49:0/2850446035 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef006d830 con 0x7f9ef00b0a00 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.851+0000 7f9eeffff640 1 --2- 172.21.15.49:0/2850446035 >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 0x7f9ef00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.852+0000 7f9eeeffd640 1 --2- 172.21.15.49:0/2850446035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef00b0a00 0x7f9ef006c540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00afac0 tx=0x7f9ee402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356b1edd41c3c3a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.852+0000 7f9eee7fc640 1 -- 172.21.15.49:0/2850446035 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4031870 con 0x7f9ef00b0a00 2023-12-19T05:39:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.852+0000 7f9eee7fc640 1 -- 172.21.15.49:0/2850446035 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee40319d0 con 0x7f9ef00b0a00 2023-12-19T05:39:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.852+0000 7f9eee7fc640 1 -- 172.21.15.49:0/2850446035 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4031d60 con 0x7f9ef00b0a00 2023-12-19T05:39:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2850446035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef00b0a00 msgr2=0x7f9ef006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2850446035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef00b0a00 0x7f9ef006c540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00afac0 tx=0x7f9ee402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2850446035 shutdown_connections 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2850446035 >> v2:172.21.15.115:3300/0 conn(0x7f9ef006ca80 0x7f9ef00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2850446035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef00b0a00 0x7f9ef006c540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2850446035 >> 172.21.15.49:0/2850446035 conn(0x7f9ef00659a0 msgr2=0x7f9ef0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2850446035 shutdown_connections 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.853+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2850446035 wait complete. 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.855+0000 7f9ef4ac0640 1 Processor -- start 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.855+0000 7f9ef4ac0640 1 -- start start 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ef006ca80 0x7f9ef01f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ef00b0a00 0x7f9ef0157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01423e0 con 0x7f9ef0155460 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0142680 con 0x7f9ef00b0a00 2023-12-19T05:39:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9ef4ac0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0142960 con 0x7f9ef006ca80 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54798/0 (socket says 172.21.15.49:54798) 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 -- 172.21.15.49:0/2881171713 learned_addr learned my addr 172.21.15.49:0/2881171713 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 -- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ef006ca80 msgr2=0x7f9ef01f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ef006ca80 0x7f9ef01f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 -- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ef00b0a00 msgr2=0x7f9ef0157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ef00b0a00 0x7f9ef0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.857+0000 7f9eeffff640 1 -- 172.21.15.49:0/2881171713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40094d0 con 0x7f9ef0155460 2023-12-19T05:39:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9eeffff640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800cef0 tx=0x7f9ee800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800d840 con 0x7f9ef0155460 2023-12-19T05:39:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800d9c0 con 0x7f9ef0155460 2023-12-19T05:39:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800dd70 con 0x7f9ef0155460 2023-12-19T05:39:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0142c40 con 0x7f9ef0155460 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.858+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0143200 con 0x7f9ef0155460 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.859+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef00ccd20 con 0x7f9ef0155460 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.860+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ee801d360 con 0x7f9ef0155460 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.861+0000 7f9ed7fff640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.861+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee80893e0 con 0x7f9ef0155460 2023-12-19T05:39:03.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.861+0000 7f9eef7fe640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.863+0000 7f9eef7fe640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006fd0 tx=0x7f9ee0006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:03.865+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ef00ccd20 con 0x7f9ef0155460 2023-12-19T05:39:04.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.094+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ef00ccd20 con 0x7f9ef0155460 2023-12-19T05:39:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.701+0000 7f9ed7fff640 1 -- 172.21.15.49:0/2881171713 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ef00ccd20 con 0x7f9ef0155460 2023-12-19T05:39:04.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 msgr2=0x7f9edc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006fd0 tx=0x7f9ee0006bc0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 msgr2=0x7f9ef015dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800cef0 tx=0x7f9ee800a710 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 shutdown_connections 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ef0155460 0x7f9ef015dea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ef00b0a00 0x7f9ef0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 --2- 172.21.15.49:0/2881171713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ef006ca80 0x7f9ef01f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 >> 172.21.15.49:0/2881171713 conn(0x7f9ef00659a0 msgr2=0x7f9ef015a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.706+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 shutdown_connections 2023-12-19T05:39:04.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.707+0000 7f9ef4ac0640 1 -- 172.21.15.49:0/2881171713 wait complete. 2023-12-19T05:39:04.731 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-12-19T05:39:04.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:39:04.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.967+0000 7f0eb6b47640 1 Processor -- start 2023-12-19T05:39:04.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.967+0000 7f0eb6b47640 1 -- start start 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.969+0000 7f0eb6b47640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0eb00b0b50 0x7f0eb006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.969+0000 7f0eb6b47640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb006bb30 con 0x7f0eb01449e0 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.969+0000 7f0eb6b47640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb00b0070 con 0x7f0eb006b590 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.969+0000 7f0eb6b47640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00b0350 con 0x7f0eb00b0b50 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.970+0000 7f0eb48e3640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0eb01449e0 0x7f0eb00af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58442/0 (socket says 172.21.15.49:58442) 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.970+0000 7f0eb48e3640 1 -- 172.21.15.49:0/2655963902 learned_addr learned my addr 172.21.15.49:0/2655963902 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:04.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.970+0000 7f0ea7fff640 1 --2- 172.21.15.49:0/2655963902 >> v2:172.21.15.115:3300/0 conn(0x7f0eb00b0b50 0x7f0eb006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.970+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396820122 0 0) 0x7f0eb006bb30 con 0x7f0eb01449e0 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.970+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e98003520 con 0x7f0eb01449e0 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.971+0000 7f0ea7fff640 1 -- 172.21.15.49:0/2655963902 >> v1:172.21.15.115:6789/0 conn(0x7f0eb006b590 legacy=0x7f0eb00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.971+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297677477 0 0) 0x7f0e98003520 con 0x7f0eb01449e0 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.971+0000 7f0ea7fff640 1 -- 172.21.15.49:0/2655963902 >> v1:172.21.15.49:6789/0 conn(0x7f0eb01449e0 legacy=0x7f0eb00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.971+0000 7f0ea7fff640 1 -- 172.21.15.49:0/2655963902 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00b0630 con 0x7f0eb00b0b50 2023-12-19T05:39:04.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.972+0000 7f0ea7fff640 1 --2- 172.21.15.49:0/2655963902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb006bfa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00097a0 tx=0x7f0ea002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20289e1394a2506c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:04.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.972+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea002f050 con 0x7f0eb00b0b50 2023-12-19T05:39:04.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.972+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0031500 con 0x7f0eb00b0b50 2023-12-19T05:39:04.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.972+0000 7f0ea77fe640 1 -- 172.21.15.49:0/2655963902 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac001670 con 0x7f0eb00b0b50 2023-12-19T05:39:04.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 -- 172.21.15.49:0/2655963902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 msgr2=0x7f0eb006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/2655963902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb006bfa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00097a0 tx=0x7f0ea002b820 comp rx=0 tx=0).stop 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 -- 172.21.15.49:0/2655963902 shutdown_connections 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/2655963902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb006bfa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 -- 172.21.15.49:0/2655963902 >> 172.21.15.49:0/2655963902 conn(0x7f0eb00cbb70 msgr2=0x7f0eb00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 -- 172.21.15.49:0/2655963902 shutdown_connections 2023-12-19T05:39:04.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.973+0000 7f0eb6b47640 1 -- 172.21.15.49:0/2655963902 wait complete. 2023-12-19T05:39:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.975+0000 7f0eb6b47640 1 Processor -- start 2023-12-19T05:39:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.975+0000 7f0eb6b47640 1 -- start start 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eb01449e0 0x7f0eb013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb01548f0 con 0x7f0eb006b590 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb013cc50 con 0x7f0eb00b0b50 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb6b47640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb01f40c0 con 0x7f0eb01449e0 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb48e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb48e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54756/0 (socket says 172.21.15.49:54756) 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.976+0000 7f0eb48e3640 1 -- 172.21.15.49:0/854434375 learned_addr learned my addr 172.21.15.49:0/854434375 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb50e4640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eb01449e0 0x7f0eb013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0ea7fff640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 -- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eb01449e0 msgr2=0x7f0eb013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eb01449e0 0x7f0eb013ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 -- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 msgr2=0x7f0eb013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb013fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 -- 172.21.15.49:0/854434375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009400 con 0x7f0eb006b590 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb48e3640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c7b0 tx=0x7f0eac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac005ad0 con 0x7f0eb006b590 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac005c30 con 0x7f0eb006b590 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb013ff50 con 0x7f0eb006b590 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.977+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac007070 con 0x7f0eb006b590 2023-12-19T05:39:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.978+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb01f1360 con 0x7f0eb006b590 2023-12-19T05:39:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.979+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb01f4290 con 0x7f0eb006b590 2023-12-19T05:39:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.980+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0eac0071d0 con 0x7f0eb006b590 2023-12-19T05:39:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.981+0000 7f0ea57fa640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 0x7f0e9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.981+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0eac0886c0 con 0x7f0eb006b590 2023-12-19T05:39:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.982+0000 7f0ea7fff640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 0x7f0e9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.983+0000 7f0ea7fff640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 0x7f0e9c06c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0035000 tx=0x7f0ea0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:04.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:04.986+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0eb01f4290 con 0x7f0eb006b590 2023-12-19T05:39:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:05.220+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0eb0061910 con 0x7f0eb006b590 2023-12-19T05:39:06.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.214+0000 7f0ea57fa640 1 -- 172.21.15.49:0/854434375 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0eac053c10 con 0x7f0eb006b590 2023-12-19T05:39:06.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 msgr2=0x7f0e9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 0x7f0e9c06c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0035000 tx=0x7f0ea0008030 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 msgr2=0x7f0eb013c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c7b0 tx=0x7f0eac00cc70 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 shutdown_connections 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e9c06a430 0x7f0e9c06c8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eb01449e0 0x7f0eb013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eb00b0b50 0x7f0eb013fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 --2- 172.21.15.49:0/854434375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eb006b590 0x7f0eb013c710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 >> 172.21.15.49:0/854434375 conn(0x7f0eb00cbb70 msgr2=0x7f0eb006fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 shutdown_connections 2023-12-19T05:39:06.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.218+0000 7f0eb6b47640 1 -- 172.21.15.49:0/854434375 wait complete. 2023-12-19T05:39:06.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:39:06.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.464+0000 7f31710da640 1 Processor -- start 2023-12-19T05:39:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.464+0000 7f31710da640 1 -- start start 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.465+0000 7f31710da640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f316c0b2030 0x7f316c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.465+0000 7f31710da640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f316c0cdbf0 0x7f316c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.465+0000 7f31710da640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c15ec30 con 0x7f316c15e5a0 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.465+0000 7f31710da640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c15fbc0 con 0x7f316c0b2030 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.465+0000 7f31710da640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c0ce560 con 0x7f316c0cdbf0 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f316c0b2030 0x7f316c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f316c0b2030 0x7f316c15f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54760/0 (socket says 172.21.15.49:54760) 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 -- 172.21.15.49:0/2444077714 learned_addr learned my addr 172.21.15.49:0/2444077714 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f31708d9640 1 --2- 172.21.15.49:0/2444077714 >> v2:172.21.15.115:3300/0 conn(0x7f316c0cdbf0 0x7f316c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 -- 172.21.15.49:0/2444077714 >> v2:172.21.15.115:3300/0 conn(0x7f316c0cdbf0 msgr2=0x7f316c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 --2- 172.21.15.49:0/2444077714 >> v2:172.21.15.115:3300/0 conn(0x7f316c0cdbf0 0x7f316c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 -- 172.21.15.49:0/2444077714 >> v1:172.21.15.115:6789/0 conn(0x7f316c15e5a0 legacy=0x7f316c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.466+0000 7f3163fff640 1 -- 172.21.15.49:0/2444077714 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c15e980 con 0x7f316c0b2030 2023-12-19T05:39:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.467+0000 7f3163fff640 1 --2- 172.21.15.49:0/2444077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c15f680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d96e7f5468fdac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f316b7fe640 1 -- 172.21.15.49:0/2444077714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031870 con 0x7f316c0b2030 2023-12-19T05:39:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f316b7fe640 1 -- 172.21.15.49:0/2444077714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31540319d0 con 0x7f316c0b2030 2023-12-19T05:39:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f316b7fe640 1 -- 172.21.15.49:0/2444077714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031d60 con 0x7f316c0b2030 2023-12-19T05:39:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 -- 172.21.15.49:0/2444077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 msgr2=0x7f316c15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 --2- 172.21.15.49:0/2444077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c15f680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 -- 172.21.15.49:0/2444077714 shutdown_connections 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 --2- 172.21.15.49:0/2444077714 >> v2:172.21.15.115:3300/0 conn(0x7f316c0cdbf0 0x7f316c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 --2- 172.21.15.49:0/2444077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c15f680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 -- 172.21.15.49:0/2444077714 >> 172.21.15.49:0/2444077714 conn(0x7f316c0b0100 msgr2=0x7f316c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 -- 172.21.15.49:0/2444077714 shutdown_connections 2023-12-19T05:39:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.468+0000 7f31710da640 1 -- 172.21.15.49:0/2444077714 wait complete. 2023-12-19T05:39:06.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.470+0000 7f31710da640 1 Processor -- start 2023-12-19T05:39:06.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.470+0000 7f31710da640 1 -- start start 2023-12-19T05:39:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f316c0cdbf0 0x7f316c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f316c15e5a0 0x7f316c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0af500 con 0x7f316c0b2030 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c9400 con 0x7f316c15e5a0 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.471+0000 7f31710da640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c96e0 con 0x7f316c0cdbf0 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54766/0 (socket says 172.21.15.49:54766) 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 -- 172.21.15.49:0/2625492981 learned_addr learned my addr 172.21.15.49:0/2625492981 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f3163fff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f316c0cdbf0 0x7f316c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f31708d9640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f316c15e5a0 0x7f316c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 -- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f316c0cdbf0 msgr2=0x7f316c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f316c0cdbf0 0x7f316c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 -- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f316c15e5a0 msgr2=0x7f316c0aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f316c15e5a0 0x7f316c0aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 -- 172.21.15.49:0/2625492981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540094d0 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.472+0000 7f316bfff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c430 tx=0x7f315c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.473+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011790 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.473+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0118f0 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.473+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011ce0 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.473+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c0c99c0 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.473+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c0c9f80 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.474+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c061910 con 0x7f316c0b2030 2023-12-19T05:39:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.475+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f315c01c460 con 0x7f316c0b2030 2023-12-19T05:39:06.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.476+0000 7f31697fa640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 0x7f314c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.476+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f315c088820 con 0x7f316c0b2030 2023-12-19T05:39:06.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.477+0000 7f3163fff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 0x7f314c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.479+0000 7f3163fff640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 0x7f314c06c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3154036000 tx=0x7f315403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.481+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f315c053e00 con 0x7f316c0b2030 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.712+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f316c0ce980 con 0x7f316c0b2030 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.713+0000 7f31697fa640 1 -- 172.21.15.49:0/2625492981 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f315c057420 con 0x7f316c0b2030 2023-12-19T05:39:06.715 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:06.715 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:06.715 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 msgr2=0x7f314c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 0x7f314c06c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3154036000 tx=0x7f315403c040 comp rx=0 tx=0).stop 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 msgr2=0x7f316c06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c430 tx=0x7f315c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 shutdown_connections 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f314c06a460 0x7f314c06c920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f316c0cdbf0 0x7f316c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f316c15e5a0 0x7f316c0aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 --2- 172.21.15.49:0/2625492981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f316c0b2030 0x7f316c06d730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 >> 172.21.15.49:0/2625492981 conn(0x7f316c0b0100 msgr2=0x7f316c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 shutdown_connections 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.716+0000 7f31710da640 1 -- 172.21.15.49:0/2625492981 wait complete. 2023-12-19T05:39:06.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.955+0000 7f5ae02a1640 1 Processor -- start 2023-12-19T05:39:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.955+0000 7f5ae02a1640 1 -- start start 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5ae02a1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ad80ce820 0x7f5ad80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5ae02a1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80cd840 con 0x7f5ad80d2b00 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5ae02a1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80b6e90 con 0x7f5ad8146e10 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5ae02a1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80d2430 con 0x7f5ad80ce820 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5add83c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ad80d2b00 0x7f5ad80ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58458/0 (socket says 172.21.15.49:58458) 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5add83c640 1 -- 172.21.15.49:0/2115352990 learned_addr learned my addr 172.21.15.49:0/2115352990 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5ade83e640 1 --2- 172.21.15.49:0/2115352990 >> v2:172.21.15.49:3300/0 conn(0x7f5ad80ce820 0x7f5ad80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5add03b640 1 -- 172.21.15.49:0/2115352990 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979842440 0 0) 0x7f5ad80cd840 con 0x7f5ad80d2b00 2023-12-19T05:39:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.957+0000 7f5add03b640 1 -- 172.21.15.49:0/2115352990 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac4003520 con 0x7f5ad80d2b00 2023-12-19T05:39:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.958+0000 7f5ade83e640 1 -- 172.21.15.49:0/2115352990 >> v1:172.21.15.115:6789/0 conn(0x7f5ad8146e10 legacy=0x7f5ad80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.958+0000 7f5ade83e640 1 -- 172.21.15.49:0/2115352990 >> v1:172.21.15.49:6789/0 conn(0x7f5ad80d2b00 legacy=0x7f5ad80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.958+0000 7f5ade83e640 1 -- 172.21.15.49:0/2115352990 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80d2620 con 0x7f5ad80ce820 2023-12-19T05:39:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.959+0000 7f5ade83e640 1 --2- 172.21.15.49:0/2115352990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad80ce820 0x7f5ad80d1ef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009d90 tx=0x7f5ad002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e921be4fa828fcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.959+0000 7f5add03b640 1 -- 172.21.15.49:0/2115352990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad002cc60 con 0x7f5ad80ce820 2023-12-19T05:39:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.959+0000 7f5add03b640 1 -- 172.21.15.49:0/2115352990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad002cdc0 con 0x7f5ad80ce820 2023-12-19T05:39:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.959+0000 7f5add03b640 1 -- 172.21.15.49:0/2115352990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0034660 con 0x7f5ad80ce820 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2115352990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad80ce820 msgr2=0x7f5ad80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2115352990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad80ce820 0x7f5ad80d1ef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009d90 tx=0x7f5ad002beb0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2115352990 shutdown_connections 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2115352990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad80ce820 0x7f5ad80d1ef0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2115352990 >> 172.21.15.49:0/2115352990 conn(0x7f5ad80b29c0 msgr2=0x7f5ad80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2115352990 shutdown_connections 2023-12-19T05:39:06.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.960+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2115352990 wait complete. 2023-12-19T05:39:06.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.962+0000 7f5ae02a1640 1 Processor -- start 2023-12-19T05:39:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.962+0000 7f5ae02a1640 1 -- start start 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80ce820 0x7f5ad8161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ad80d2b00 0x7f5ad8161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad815fd50 con 0x7f5ad8146e10 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8160030 con 0x7f5ad80ce820 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ae02a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8160310 con 0x7f5ad80d2b00 2023-12-19T05:39:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54778/0 (socket says 172.21.15.49:54778) 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 -- 172.21.15.49:0/2643760831 learned_addr learned my addr 172.21.15.49:0/2643760831 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5add83c640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ad80d2b00 0x7f5ad8161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade03d640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80ce820 0x7f5ad8161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 -- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ad80d2b00 msgr2=0x7f5ad8161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ad80d2b00 0x7f5ad8161860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 -- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80ce820 msgr2=0x7f5ad8161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80ce820 0x7f5ad8161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.963+0000 7f5ade83e640 1 -- 172.21.15.49:0/2643760831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0009a70 con 0x7f5ad8146e10 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5ade83e640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009d90 tx=0x7f5ad0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0040650 con 0x7f5ad8146e10 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00407b0 con 0x7f5ad8146e10 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0040b60 con 0x7f5ad8146e10 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad81605f0 con 0x7f5ad8146e10 2023-12-19T05:39:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.964+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad813d020 con 0x7f5ad8146e10 2023-12-19T05:39:06.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.965+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8160b10 con 0x7f5ad8146e10 2023-12-19T05:39:06.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.966+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ad0040cc0 con 0x7f5ad8146e10 2023-12-19T05:39:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.967+0000 7f5aceffd640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 0x7f5abc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.967+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ad00ab5b0 con 0x7f5ad8146e10 2023-12-19T05:39:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.968+0000 7f5ade03d640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 0x7f5abc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.969+0000 7f5ade03d640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 0x7f5abc06c940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000f60 tx=0x7f5ad4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:06.971+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ad8160b10 con 0x7f5ad8146e10 2023-12-19T05:39:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.157+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ad8160b10 con 0x7f5ad8146e10 2023-12-19T05:39:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.158+0000 7f5aceffd640 1 -- 172.21.15.49:0/2643760831 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5ad8160b10 con 0x7f5ad8146e10 2023-12-19T05:39:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:07.160 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 msgr2=0x7f5abc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 0x7f5abc06c940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000f60 tx=0x7f5ad4009040 comp rx=0 tx=0).stop 2023-12-19T05:39:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 msgr2=0x7f5ad815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009d90 tx=0x7f5ad0004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 shutdown_connections 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5abc06a480 0x7f5abc06c940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ad80d2b00 0x7f5ad8161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ad8146e10 0x7f5ad815f000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 --2- 172.21.15.49:0/2643760831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80ce820 0x7f5ad8161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 >> 172.21.15.49:0/2643760831 conn(0x7f5ad80b29c0 msgr2=0x7f5ad815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 shutdown_connections 2023-12-19T05:39:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.161+0000 7f5ae02a1640 1 -- 172.21.15.49:0/2643760831 wait complete. 2023-12-19T05:39:07.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:39:07.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.401+0000 7f1581370640 1 Processor -- start 2023-12-19T05:39:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.401+0000 7f1581370640 1 -- start start 2023-12-19T05:39:07.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f1581370640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f157c0ac8b0 0x7f157c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f1581370640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c06fa90 0x7f157c06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f1581370640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0b2fa0 con 0x7f157c15e3f0 2023-12-19T05:39:07.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f1581370640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0ad280 con 0x7f157c0ac8b0 2023-12-19T05:39:07.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f1581370640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c06f600 con 0x7f157c06fa90 2023-12-19T05:39:07.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f157bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f157c15e3f0 0x7f157c0b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58474/0 (socket says 172.21.15.49:58474) 2023-12-19T05:39:07.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f157bfff640 1 -- 172.21.15.49:0/762588848 learned_addr learned my addr 172.21.15.49:0/762588848 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:07.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.403+0000 7f15737fe640 1 --2- 172.21.15.49:0/762588848 >> v2:172.21.15.49:3300/0 conn(0x7f157c0ac8b0 0x7f157c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f1580b6f640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c06fa90 0x7f157c06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f157b7fe640 1 -- 172.21.15.49:0/762588848 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933702622 0 0) 0x7f157c0b2fa0 con 0x7f157c15e3f0 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f157b7fe640 1 -- 172.21.15.49:0/762588848 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1568003520 con 0x7f157c15e3f0 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f15737fe640 1 -- 172.21.15.49:0/762588848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c06fa90 msgr2=0x7f157c06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f15737fe640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c06fa90 0x7f157c06ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f15737fe640 1 -- 172.21.15.49:0/762588848 >> v1:172.21.15.49:6789/0 conn(0x7f157c15e3f0 legacy=0x7f157c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.404+0000 7f15737fe640 1 -- 172.21.15.49:0/762588848 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c15e7d0 con 0x7f157c0ac8b0 2023-12-19T05:39:07.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.405+0000 7f15737fe640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c0ac8b0 0x7f157c0acd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15640097a0 tx=0x7f156402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a5c4bf699ba76c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.405+0000 7f157b7fe640 1 -- 172.21.15.49:0/762588848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156402e070 con 0x7f157c0ac8b0 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.405+0000 7f157b7fe640 1 -- 172.21.15.49:0/762588848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15640315a0 con 0x7f157c0ac8b0 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.405+0000 7f157b7fe640 1 -- 172.21.15.49:0/762588848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564031930 con 0x7f157c0ac8b0 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 -- 172.21.15.49:0/762588848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c0ac8b0 msgr2=0x7f157c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c0ac8b0 0x7f157c0acd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15640097a0 tx=0x7f156402b840 comp rx=0 tx=0).stop 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 -- 172.21.15.49:0/762588848 shutdown_connections 2023-12-19T05:39:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c06fa90 0x7f157c06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 --2- 172.21.15.49:0/762588848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c0ac8b0 0x7f157c0acd40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 -- 172.21.15.49:0/762588848 >> 172.21.15.49:0/762588848 conn(0x7f157c0b0100 msgr2=0x7f157c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 -- 172.21.15.49:0/762588848 shutdown_connections 2023-12-19T05:39:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.406+0000 7f1581370640 1 -- 172.21.15.49:0/762588848 wait complete. 2023-12-19T05:39:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.408+0000 7f1581370640 1 Processor -- start 2023-12-19T05:39:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.408+0000 7f1581370640 1 -- start start 2023-12-19T05:39:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c0ac8b0 0x7f157c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 0x7f157c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1588f0 con 0x7f157c06fa90 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c158b00 con 0x7f157c15e3f0 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f1581370640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c158de0 con 0x7f157c0ac8b0 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f157bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f157bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54800/0 (socket says 172.21.15.49:54800) 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.409+0000 7f157bfff640 1 -- 172.21.15.49:0/3616724477 learned_addr learned my addr 172.21.15.49:0/3616724477 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f1580b6f640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 0x7f157c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f15737fe640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c0ac8b0 0x7f157c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 -- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c0ac8b0 msgr2=0x7f157c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c0ac8b0 0x7f157c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 -- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 msgr2=0x7f157c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 0x7f157c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 -- 172.21.15.49:0/3616724477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009400 con 0x7f157c06fa90 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f1580b6f640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 0x7f157c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f157bfff640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c410 tx=0x7f156c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.410+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c005ce0 con 0x7f157c06fa90 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.411+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c005e40 con 0x7f157c06fa90 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.411+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c0072f0 con 0x7f157c06fa90 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.411+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c1590c0 con 0x7f157c06fa90 2023-12-19T05:39:07.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.411+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c159680 con 0x7f157c06fa90 2023-12-19T05:39:07.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.412+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c061910 con 0x7f157c06fa90 2023-12-19T05:39:07.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.413+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f156c007510 con 0x7f157c06fa90 2023-12-19T05:39:07.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.414+0000 7f15797fa640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 0x7f155c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.414+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f156c087ef0 con 0x7f157c06fa90 2023-12-19T05:39:07.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.415+0000 7f15737fe640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 0x7f155c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.416+0000 7f15737fe640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 0x7f155c06c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1564036000 tx=0x7f156403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.418+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f156c053630 con 0x7f157c06fa90 2023-12-19T05:39:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.601+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f157c0b2cc0 con 0x7f155c06a430 2023-12-19T05:39:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.626+0000 7f15797fa640 1 -- 172.21.15.49:0/3616724477 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257164 (secure 0 0 0) 0x7f15640319d0 con 0x7f155c06a430 2023-12-19T05:39:07.631 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:07.632 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.630+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 msgr2=0x7f155c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 0x7f155c06c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1564036000 tx=0x7f156403d040 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 msgr2=0x7f157c14af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c410 tx=0x7f156c00c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 shutdown_connections 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155c06a430 0x7f155c06c8f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f157c0ac8b0 0x7f157c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f157c15e3f0 0x7f157c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 --2- 172.21.15.49:0/3616724477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f157c06fa90 0x7f157c14af20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 >> 172.21.15.49:0/3616724477 conn(0x7f157c0b0100 msgr2=0x7f157c070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 shutdown_connections 2023-12-19T05:39:07.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.631+0000 7f1581370640 1 -- 172.21.15.49:0/3616724477 wait complete. 2023-12-19T05:39:07.650 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-19T05:39:06.499883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1560,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560939,"statfs":{"total":1600000000,"available":1598401885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.333473"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.191317+0000","last_change":"2023-12-19T05:39:02.191317+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.191317+0000","last_undegraded":"2023-12-19T05:39:02.191317+0000","last_fullsized":"2023-12-19T05:39:02.191317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.181777+0000","last_change":"2023-12-19T05:39:02.181777+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.181777+0000","last_undegraded":"2023-12-19T05:39:02.181777+0000","last_fullsized":"2023-12-19T05:39:02.181777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184025+0000","last_change":"2023-12-19T05:39:02.184025+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184025+0000","last_undegraded":"2023-12-19T05:39:02.184025+0000","last_fullsized":"2023-12-19T05:39:02.184025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186039+0000","last_change":"2023-12-19T05:39:02.186039+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186039+0000","last_undegraded":"2023-12-19T05:39:02.186039+0000","last_fullsized":"2023-12-19T05:39:02.186039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187557+0000","last_change":"2023-12-19T05:39:02.187557+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187557+0000","last_undegraded":"2023-12-19T05:39:02.187557+0000","last_fullsized":"2023-12-19T05:39:02.187557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185657+0000","last_change":"2023-12-19T05:39:02.185657+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185657+0000","last_undegraded":"2023-12-19T05:39:02.185657+0000","last_fullsized":"2023-12-19T05:39:02.185657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190210+0000","last_change":"2023-12-19T05:39:02.190210+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190210+0000","last_undegraded":"2023-12-19T05:39:02.190210+0000","last_fullsized":"2023-12-19T05:39:02.190210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182978+0000","last_change":"2023-12-19T05:39:02.182978+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182978+0000","last_undegraded":"2023-12-19T05:39:02.182978+0000","last_fullsized":"2023-12-19T05:39:02.182978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190258+0000","last_change":"2023-12-19T05:39:02.190258+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190258+0000","last_undegraded":"2023-12-19T05:39:02.190258+0000","last_fullsized":"2023-12-19T05:39:02.190258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.188274+0000","last_change":"2023-12-19T05:39:02.188274+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.188274+0000","last_undegraded":"2023-12-19T05:39:02.188274+0000","last_fullsized":"2023-12-19T05:39:02.188274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190717+0000","last_change":"2023-12-19T05:39:02.190717+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190717+0000","last_undegraded":"2023-12-19T05:39:02.190717+0000","last_fullsized":"2023-12-19T05:39:02.190717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.199501+0000","last_change":"2023-12-19T05:39:02.199501+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.199501+0000","last_undegraded":"2023-12-19T05:39:02.199501+0000","last_fullsized":"2023-12-19T05:39:02.199501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192985+0000","last_change":"2023-12-19T05:39:02.192985+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192985+0000","last_undegraded":"2023-12-19T05:39:02.192985+0000","last_fullsized":"2023-12-19T05:39:02.192985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193364+0000","last_change":"2023-12-19T05:39:02.193364+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193364+0000","last_undegraded":"2023-12-19T05:39:02.193364+0000","last_fullsized":"2023-12-19T05:39:02.193364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185079+0000","last_change":"2023-12-19T05:39:02.185079+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185079+0000","last_undegraded":"2023-12-19T05:39:02.185079+0000","last_fullsized":"2023-12-19T05:39:02.185079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194785+0000","last_change":"2023-12-19T05:39:02.194785+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194785+0000","last_undegraded":"2023-12-19T05:39:02.194785+0000","last_fullsized":"2023-12-19T05:39:02.194785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194506+0000","last_change":"2023-12-19T05:39:02.194506+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194506+0000","last_undegraded":"2023-12-19T05:39:02.194506+0000","last_fullsized":"2023-12-19T05:39:02.194506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196837+0000","last_change":"2023-12-19T05:39:02.196837+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196837+0000","last_undegraded":"2023-12-19T05:39:02.196837+0000","last_fullsized":"2023-12-19T05:39:02.196837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195299+0000","last_change":"2023-12-19T05:39:02.195299+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195299+0000","last_undegraded":"2023-12-19T05:39:02.195299+0000","last_fullsized":"2023-12-19T05:39:02.195299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187886+0000","last_change":"2023-12-19T05:39:02.187886+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187886+0000","last_undegraded":"2023-12-19T05:39:02.187886+0000","last_fullsized":"2023-12-19T05:39:02.187886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196002+0000","last_change":"2023-12-19T05:39:02.196002+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196002+0000","last_undegraded":"2023-12-19T05:39:02.196002+0000","last_fullsized":"2023-12-19T05:39:02.196002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192881+0000","last_change":"2023-12-19T05:39:02.192881+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192881+0000","last_undegraded":"2023-12-19T05:39:02.192881+0000","last_fullsized":"2023-12-19T05:39:02.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182147+0000","last_change":"2023-12-19T05:39:02.182147+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182147+0000","last_undegraded":"2023-12-19T05:39:02.182147+0000","last_fullsized":"2023-12-19T05:39:02.182147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194653+0000","last_change":"2023-12-19T05:39:02.194653+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194653+0000","last_undegraded":"2023-12-19T05:39:02.194653+0000","last_fullsized":"2023-12-19T05:39:02.194653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184159+0000","last_change":"2023-12-19T05:39:02.184159+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184159+0000","last_undegraded":"2023-12-19T05:39:02.184159+0000","last_fullsized":"2023-12-19T05:39:02.184159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184322+0000","last_change":"2023-12-19T05:39:02.184322+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184322+0000","last_undegraded":"2023-12-19T05:39:02.184322+0000","last_fullsized":"2023-12-19T05:39:02.184322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193712+0000","last_change":"2023-12-19T05:39:02.193712+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193712+0000","last_undegraded":"2023-12-19T05:39:02.193712+0000","last_fullsized":"2023-12-19T05:39:02.193712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187201+0000","last_change":"2023-12-19T05:39:02.187201+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187201+0000","last_undegraded":"2023-12-19T05:39:02.187201+0000","last_fullsized":"2023-12-19T05:39:02.187201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185922+0000","last_change":"2023-12-19T05:39:02.185922+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185922+0000","last_undegraded":"2023-12-19T05:39:02.185922+0000","last_fullsized":"2023-12-19T05:39:02.185922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195428+0000","last_change":"2023-12-19T05:39:02.195428+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195428+0000","last_undegraded":"2023-12-19T05:39:02.195428+0000","last_fullsized":"2023-12-19T05:39:02.195428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.198388+0000","last_change":"2023-12-19T05:39:02.198388+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.198388+0000","last_undegraded":"2023-12-19T05:39:02.198388+0000","last_fullsized":"2023-12-19T05:39:02.198388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184574+0000","last_change":"2023-12-19T05:39:02.184574+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184574+0000","last_undegraded":"2023-12-19T05:39:02.184574+0000","last_fullsized":"2023-12-19T05:39:02.184574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192329+0000","last_change":"2023-12-19T05:39:02.192329+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192329+0000","last_undegraded":"2023-12-19T05:39:02.192329+0000","last_fullsized":"2023-12-19T05:39:02.192329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200181+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.200181+0000","last_peered":"2023-12-19T05:39:02.200181+0000","last_clean":"2023-12-19T05:39:02.200181+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.200181+0000","last_undegraded":"2023-12-19T05:39:02.200181+0000","last_fullsized":"2023-12-19T05:39:02.200181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196885+0000","last_change":"2023-12-19T05:39:02.196885+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196885+0000","last_undegraded":"2023-12-19T05:39:02.196885+0000","last_fullsized":"2023-12-19T05:39:02.196885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.198051+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.198051+0000","last_peered":"2023-12-19T05:39:02.198051+0000","last_clean":"2023-12-19T05:39:02.198051+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.198051+0000","last_undegraded":"2023-12-19T05:39:02.198051+0000","last_fullsized":"2023-12-19T05:39:02.198051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207940+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.207940+0000","last_peered":"2023-12-19T05:39:02.207940+0000","last_clean":"2023-12-19T05:39:02.207940+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.207940+0000","last_undegraded":"2023-12-19T05:39:02.207940+0000","last_fullsized":"2023-12-19T05:39:02.207940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182532+0000","last_change":"2023-12-19T05:39:02.182532+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182532+0000","last_undegraded":"2023-12-19T05:39:02.182532+0000","last_fullsized":"2023-12-19T05:39:02.182532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.196149+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.196149+0000","last_peered":"2023-12-19T05:39:02.196149+0000","last_clean":"2023-12-19T05:39:02.196149+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.196149+0000","last_undegraded":"2023-12-19T05:39:02.196149+0000","last_fullsized":"2023-12-19T05:39:02.196149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.189923+0000","last_change":"2023-12-19T05:39:02.189923+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.189923+0000","last_undegraded":"2023-12-19T05:39:02.189923+0000","last_fullsized":"2023-12-19T05:39:02.189923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.202359+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.202359+0000","last_peered":"2023-12-19T05:39:02.202359+0000","last_clean":"2023-12-19T05:39:02.202359+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.202359+0000","last_undegraded":"2023-12-19T05:39:02.202359+0000","last_fullsized":"2023-12-19T05:39:02.202359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.183415+0000","last_change":"2023-12-19T05:39:02.183415+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.183415+0000","last_undegraded":"2023-12-19T05:39:02.183415+0000","last_fullsized":"2023-12-19T05:39:02.183415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204882+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.204882+0000","last_peered":"2023-12-19T05:39:02.204882+0000","last_clean":"2023-12-19T05:39:02.204882+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.204882+0000","last_undegraded":"2023-12-19T05:39:02.204882+0000","last_fullsized":"2023-12-19T05:39:02.204882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.180684+0000","last_change":"2023-12-19T05:39:02.180684+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.180684+0000","last_undegraded":"2023-12-19T05:39:02.180684+0000","last_fullsized":"2023-12-19T05:39:02.180684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204748+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.204748+0000","last_peered":"2023-12-19T05:39:02.204748+0000","last_clean":"2023-12-19T05:39:02.204748+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.204748+0000","last_undegraded":"2023-12-19T05:39:02.204748+0000","last_fullsized":"2023-12-19T05:39:02.204748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194181+0000","last_change":"2023-12-19T05:39:02.194181+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194181+0000","last_undegraded":"2023-12-19T05:39:02.194181+0000","last_fullsized":"2023-12-19T05:39:02.194181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204298+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.204298+0000","last_peered":"2023-12-19T05:39:02.204298+0000","last_clean":"2023-12-19T05:39:02.204298+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.204298+0000","last_undegraded":"2023-12-19T05:39:02.204298+0000","last_fullsized":"2023-12-19T05:39:02.204298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186779+0000","last_change":"2023-12-19T05:39:02.186779+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186779+0000","last_undegraded":"2023-12-19T05:39:02.186779+0000","last_fullsized":"2023-12-19T05:39:02.186779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.208403+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.208403+0000","last_peered":"2023-12-19T05:39:02.208403+0000","last_clean":"2023-12-19T05:39:02.208403+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.208403+0000","last_undegraded":"2023-12-19T05:39:02.208403+0000","last_fullsized":"2023-12-19T05:39:02.208403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.189816+0000","last_change":"2023-12-19T05:39:02.189816+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.189816+0000","last_undegraded":"2023-12-19T05:39:02.189816+0000","last_fullsized":"2023-12-19T05:39:02.189816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206024+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.206024+0000","last_peered":"2023-12-19T05:39:02.206024+0000","last_clean":"2023-12-19T05:39:02.206024+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.206024+0000","last_undegraded":"2023-12-19T05:39:02.206024+0000","last_fullsized":"2023-12-19T05:39:02.206024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194131+0000","last_change":"2023-12-19T05:39:02.194131+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194131+0000","last_undegraded":"2023-12-19T05:39:02.194131+0000","last_fullsized":"2023-12-19T05:39:02.194131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206766+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.206766+0000","last_peered":"2023-12-19T05:39:02.206766+0000","last_clean":"2023-12-19T05:39:02.206766+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.206766+0000","last_undegraded":"2023-12-19T05:39:02.206766+0000","last_fullsized":"2023-12-19T05:39:02.206766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.191398+0000","last_change":"2023-12-19T05:39:02.191398+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.191398+0000","last_undegraded":"2023-12-19T05:39:02.191398+0000","last_fullsized":"2023-12-19T05:39:02.191398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206819+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.206819+0000","last_peered":"2023-12-19T05:39:02.206819+0000","last_clean":"2023-12-19T05:39:02.206819+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.206819+0000","last_undegraded":"2023-12-19T05:39:02.206819+0000","last_fullsized":"2023-12-19T05:39:02.206819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193641+0000","last_change":"2023-12-19T05:39:02.193641+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193641+0000","last_undegraded":"2023-12-19T05:39:02.193641+0000","last_fullsized":"2023-12-19T05:39:02.193641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.199758+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.199758+0000","last_peered":"2023-12-19T05:39:02.199758+0000","last_clean":"2023-12-19T05:39:02.199758+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.199758+0000","last_undegraded":"2023-12-19T05:39:02.199758+0000","last_fullsized":"2023-12-19T05:39:02.199758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182654+0000","last_change":"2023-12-19T05:39:02.182654+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182654+0000","last_undegraded":"2023-12-19T05:39:02.182654+0000","last_fullsized":"2023-12-19T05:39:02.182654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200030+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.200030+0000","last_peered":"2023-12-19T05:39:02.200030+0000","last_clean":"2023-12-19T05:39:02.200030+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.200030+0000","last_undegraded":"2023-12-19T05:39:02.200030+0000","last_fullsized":"2023-12-19T05:39:02.200030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193390+0000","last_change":"2023-12-19T05:39:02.193390+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193390+0000","last_undegraded":"2023-12-19T05:39:02.193390+0000","last_fullsized":"2023-12-19T05:39:02.193390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.198612+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.198612+0000","last_peered":"2023-12-19T05:39:02.198612+0000","last_clean":"2023-12-19T05:39:02.198612+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.198612+0000","last_undegraded":"2023-12-19T05:39:02.198612+0000","last_fullsized":"2023-12-19T05:39:02.198612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196219+0000","last_change":"2023-12-19T05:39:02.196219+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196219+0000","last_undegraded":"2023-12-19T05:39:02.196219+0000","last_fullsized":"2023-12-19T05:39:02.196219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205781+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.205781+0000","last_peered":"2023-12-19T05:39:02.205781+0000","last_clean":"2023-12-19T05:39:02.205781+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.205781+0000","last_undegraded":"2023-12-19T05:39:02.205781+0000","last_fullsized":"2023-12-19T05:39:02.205781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194361+0000","last_change":"2023-12-19T05:39:02.194361+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194361+0000","last_undegraded":"2023-12-19T05:39:02.194361+0000","last_fullsized":"2023-12-19T05:39:02.194361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-19T05:39:01.167622+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:01.167622+0000","last_peered":"2023-12-19T05:39:01.167622+0000","last_clean":"2023-12-19T05:39:01.167622+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:01.167622+0000","last_undegraded":"2023-12-19T05:39:01.167622+0000","last_fullsized":"2023-12-19T05:39:01.167622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.182986+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.182986+0000","last_peered":"2023-12-19T05:39:02.182986+0000","last_clean":"2023-12-19T05:39:02.182986+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.182986+0000","last_undegraded":"2023-12-19T05:39:02.182986+0000","last_fullsized":"2023-12-19T05:39:02.182986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195663+0000","last_change":"2023-12-19T05:39:02.195663+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195663+0000","last_undegraded":"2023-12-19T05:39:02.195663+0000","last_fullsized":"2023-12-19T05:39:02.195663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.182901+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.182901+0000","last_peered":"2023-12-19T05:39:02.182901+0000","last_clean":"2023-12-19T05:39:02.182901+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.182901+0000","last_undegraded":"2023-12-19T05:39:02.182901+0000","last_fullsized":"2023-12-19T05:39:02.182901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186179+0000","last_change":"2023-12-19T05:39:02.186179+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186179+0000","last_undegraded":"2023-12-19T05:39:02.186179+0000","last_fullsized":"2023-12-19T05:39:02.186179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205843+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.205843+0000","last_peered":"2023-12-19T05:39:02.205843+0000","last_clean":"2023-12-19T05:39:02.205843+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.205843+0000","last_undegraded":"2023-12-19T05:39:02.205843+0000","last_fullsized":"2023-12-19T05:39:02.205843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182762+0000","last_change":"2023-12-19T05:39:02.182762+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182762+0000","last_undegraded":"2023-12-19T05:39:02.182762+0000","last_fullsized":"2023-12-19T05:39:02.182762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.201713+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.201713+0000","last_peered":"2023-12-19T05:39:02.201713+0000","last_clean":"2023-12-19T05:39:02.201713+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.201713+0000","last_undegraded":"2023-12-19T05:39:02.201713+0000","last_fullsized":"2023-12-19T05:39:02.201713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190234+0000","last_change":"2023-12-19T05:39:02.190234+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190234+0000","last_undegraded":"2023-12-19T05:39:02.190234+0000","last_fullsized":"2023-12-19T05:39:02.190234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200847+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.200847+0000","last_peered":"2023-12-19T05:39:02.200847+0000","last_clean":"2023-12-19T05:39:02.200847+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.200847+0000","last_undegraded":"2023-12-19T05:39:02.200847+0000","last_fullsized":"2023-12-19T05:39:02.200847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182737+0000","last_change":"2023-12-19T05:39:02.182737+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182737+0000","last_undegraded":"2023-12-19T05:39:02.182737+0000","last_fullsized":"2023-12-19T05:39:02.182737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205722+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.205722+0000","last_peered":"2023-12-19T05:39:02.205722+0000","last_clean":"2023-12-19T05:39:02.205722+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.205722+0000","last_undegraded":"2023-12-19T05:39:02.205722+0000","last_fullsized":"2023-12-19T05:39:02.205722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186044+0000","last_change":"2023-12-19T05:39:02.186044+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186044+0000","last_undegraded":"2023-12-19T05:39:02.186044+0000","last_fullsized":"2023-12-19T05:39:02.186044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.208754+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:02.208754+0000","last_peered":"2023-12-19T05:39:02.208754+0000","last_clean":"2023-12-19T05:39:02.208754+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:02.208754+0000","last_undegraded":"2023-12-19T05:39:02.208754+0000","last_fullsized":"2023-12-19T05:39:02.208754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196286+0000","last_change":"2023-12-19T05:39:02.196286+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196286+0000","last_undegraded":"2023-12-19T05:39:02.196286+0000","last_fullsized":"2023-12-19T05:39:02.196286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206544+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.206544+0000","last_peered":"2023-12-19T05:39:02.206544+0000","last_clean":"2023-12-19T05:39:02.206544+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.206544+0000","last_undegraded":"2023-12-19T05:39:02.206544+0000","last_fullsized":"2023-12-19T05:39:02.206544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190579+0000","last_change":"2023-12-19T05:39:02.190579+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190579+0000","last_undegraded":"2023-12-19T05:39:02.190579+0000","last_fullsized":"2023-12-19T05:39:02.190579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.199737+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.199737+0000","last_peered":"2023-12-19T05:39:02.199737+0000","last_clean":"2023-12-19T05:39:02.199737+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.199737+0000","last_undegraded":"2023-12-19T05:39:02.199737+0000","last_fullsized":"2023-12-19T05:39:02.199737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192757+0000","last_change":"2023-12-19T05:39:02.192757+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192757+0000","last_undegraded":"2023-12-19T05:39:02.192757+0000","last_fullsized":"2023-12-19T05:39:02.192757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207261+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.207261+0000","last_peered":"2023-12-19T05:39:02.207261+0000","last_clean":"2023-12-19T05:39:02.207261+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.207261+0000","last_undegraded":"2023-12-19T05:39:02.207261+0000","last_fullsized":"2023-12-19T05:39:02.207261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192315+0000","last_change":"2023-12-19T05:39:02.192315+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192315+0000","last_undegraded":"2023-12-19T05:39:02.192315+0000","last_fullsized":"2023-12-19T05:39:02.192315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.197689+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.197689+0000","last_peered":"2023-12-19T05:39:02.197689+0000","last_clean":"2023-12-19T05:39:02.197689+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.197689+0000","last_undegraded":"2023-12-19T05:39:02.197689+0000","last_fullsized":"2023-12-19T05:39:02.197689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193050+0000","last_change":"2023-12-19T05:39:02.193050+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193050+0000","last_undegraded":"2023-12-19T05:39:02.193050+0000","last_fullsized":"2023-12-19T05:39:02.193050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.181215+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.181215+0000","last_peered":"2023-12-19T05:39:02.181215+0000","last_clean":"2023-12-19T05:39:02.181215+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.181215+0000","last_undegraded":"2023-12-19T05:39:02.181215+0000","last_fullsized":"2023-12-19T05:39:02.181215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193756+0000","last_change":"2023-12-19T05:39:02.193756+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193756+0000","last_undegraded":"2023-12-19T05:39:02.193756+0000","last_fullsized":"2023-12-19T05:39:02.193756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195078+0000","last_change":"2023-12-19T05:39:02.195078+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195078+0000","last_undegraded":"2023-12-19T05:39:02.195078+0000","last_fullsized":"2023-12-19T05:39:02.195078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204913+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.204913+0000","last_peered":"2023-12-19T05:39:02.204913+0000","last_clean":"2023-12-19T05:39:02.204913+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.204913+0000","last_undegraded":"2023-12-19T05:39:02.204913+0000","last_fullsized":"2023-12-19T05:39:02.204913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194496+0000","last_change":"2023-12-19T05:39:02.194496+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194496+0000","last_undegraded":"2023-12-19T05:39:02.194496+0000","last_fullsized":"2023-12-19T05:39:02.194496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207101+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.207101+0000","last_peered":"2023-12-19T05:39:02.207101+0000","last_clean":"2023-12-19T05:39:02.207101+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.207101+0000","last_undegraded":"2023-12-19T05:39:02.207101+0000","last_fullsized":"2023-12-19T05:39:02.207101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.180284+0000","last_change":"2023-12-19T05:39:02.180284+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.180284+0000","last_undegraded":"2023-12-19T05:39:02.180284+0000","last_fullsized":"2023-12-19T05:39:02.180284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.203424+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.203424+0000","last_peered":"2023-12-19T05:39:02.203424+0000","last_clean":"2023-12-19T05:39:02.203424+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.203424+0000","last_undegraded":"2023-12-19T05:39:02.203424+0000","last_fullsized":"2023-12-19T05:39:02.203424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185052+0000","last_change":"2023-12-19T05:39:02.185052+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185052+0000","last_undegraded":"2023-12-19T05:39:02.185052+0000","last_fullsized":"2023-12-19T05:39:02.185052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.202608+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.202608+0000","last_peered":"2023-12-19T05:39:02.202608+0000","last_clean":"2023-12-19T05:39:02.202608+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.202608+0000","last_undegraded":"2023-12-19T05:39:02.202608+0000","last_fullsized":"2023-12-19T05:39:02.202608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199351969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:07.654 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.923+0000 7ff4694d7640 1 Processor -- start 2023-12-19T05:39:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.923+0000 7ff4694d7640 1 -- start start 2023-12-19T05:39:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff46415e5a0 0x7ff4640b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415f680 0x7ff4640b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4640cdbf0 0x7ff4640ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640ce5c0 con 0x7ff46415e5a0 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46415ec30 con 0x7ff4640cdbf0 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff4694d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640b2cc0 con 0x7ff46415f680 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff463fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff46415e5a0 0x7ff4640b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff463fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff46415e5a0 0x7ff4640b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54808/0 (socket says 172.21.15.49:54808) 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff463fff640 1 -- 172.21.15.49:0/60526070 learned_addr learned my addr 172.21.15.49:0/60526070 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.926+0000 7ff463fff640 1 -- 172.21.15.49:0/60526070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415f680 msgr2=0x7ff4640b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.925+0000 7ff468cd6640 1 --2- 172.21.15.49:0/60526070 >> v2:172.21.15.115:3300/0 conn(0x7ff4640cdbf0 0x7ff4640ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.926+0000 7ff463fff640 1 --2- 172.21.15.49:0/60526070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415f680 0x7ff4640b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.926+0000 7ff463fff640 1 -- 172.21.15.49:0/60526070 >> v2:172.21.15.115:3300/0 conn(0x7ff4640cdbf0 msgr2=0x7ff4640ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.926+0000 7ff463fff640 1 --2- 172.21.15.49:0/60526070 >> v2:172.21.15.115:3300/0 conn(0x7ff4640cdbf0 0x7ff4640ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.926+0000 7ff463fff640 1 -- 172.21.15.49:0/60526070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46415e980 con 0x7ff46415e5a0 2023-12-19T05:39:07.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.927+0000 7ff463fff640 1 --2- 172.21.15.49:0/60526070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46415e5a0 0x7ff4640b2030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff46406b310 tx=0x7ff45402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce61e426c00f0ad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.927+0000 7ff4637fe640 1 -- 172.21.15.49:0/60526070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454031870 con 0x7ff46415e5a0 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.927+0000 7ff4637fe640 1 -- 172.21.15.49:0/60526070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540319d0 con 0x7ff46415e5a0 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.927+0000 7ff4637fe640 1 -- 172.21.15.49:0/60526070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454031d60 con 0x7ff46415e5a0 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 -- 172.21.15.49:0/60526070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46415e5a0 msgr2=0x7ff4640b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 --2- 172.21.15.49:0/60526070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46415e5a0 0x7ff4640b2030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff46406b310 tx=0x7ff45402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 -- 172.21.15.49:0/60526070 shutdown_connections 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 --2- 172.21.15.49:0/60526070 >> v2:172.21.15.115:3300/0 conn(0x7ff4640cdbf0 0x7ff4640ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 --2- 172.21.15.49:0/60526070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415f680 0x7ff4640b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 --2- 172.21.15.49:0/60526070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46415e5a0 0x7ff4640b2030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 -- 172.21.15.49:0/60526070 >> 172.21.15.49:0/60526070 conn(0x7ff4640b0100 msgr2=0x7ff4640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 -- 172.21.15.49:0/60526070 shutdown_connections 2023-12-19T05:39:07.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.928+0000 7ff4694d7640 1 -- 172.21.15.49:0/60526070 wait complete. 2023-12-19T05:39:07.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.930+0000 7ff4694d7640 1 Processor -- start 2023-12-19T05:39:07.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.930+0000 7ff4694d7640 1 -- start start 2023-12-19T05:39:07.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415e5a0 0x7ff464153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 0x7ff464158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464149f70 con 0x7ff4640cdbf0 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46415b540 con 0x7ff46415f680 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff4694d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46415b820 con 0x7ff46415e5a0 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54820/0 (socket says 172.21.15.49:54820) 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 -- 172.21.15.49:0/3963229452 learned_addr learned my addr 172.21.15.49:0/3963229452 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff468cd6640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 0x7ff464158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 -- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415e5a0 msgr2=0x7ff464153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415e5a0 0x7ff464153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 -- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 msgr2=0x7ff464158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 0x7ff464158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff463fff640 1 -- 172.21.15.49:0/3963229452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540094d0 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.932+0000 7ff468cd6640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 0x7ff464158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff463fff640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff454000c00 tx=0x7ff4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454031840 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540443f0 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540447a0 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff464152860 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.933+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4641535a0 con 0x7ff4640cdbf0 2023-12-19T05:39:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.934+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464152d80 con 0x7ff4640cdbf0 2023-12-19T05:39:07.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.935+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff45404d450 con 0x7ff4640cdbf0 2023-12-19T05:39:07.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.937+0000 7ff4617fa640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.938+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff45402d040 con 0x7ff4640cdbf0 2023-12-19T05:39:07.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.938+0000 7ff45bfff640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.939+0000 7ff45bfff640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4640700c0 tx=0x7ff44c006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:07.944+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff464152d80 con 0x7ff4640cdbf0 2023-12-19T05:39:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.135+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4640b3270 con 0x7ff44406a430 2023-12-19T05:39:08.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.157+0000 7ff4617fa640 1 -- 172.21.15.49:0/3963229452 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257164 (secure 0 0 0) 0x7ff44c012390 con 0x7ff44406a430 2023-12-19T05:39:08.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 msgr2=0x7ff44406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4640700c0 tx=0x7ff44c006bf0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 msgr2=0x7ff46415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff454000c00 tx=0x7ff4540046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 shutdown_connections 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff46415e5a0 0x7ff464153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46415f680 0x7ff464158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 --2- 172.21.15.49:0/3963229452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640cdbf0 0x7ff46415ae40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 >> 172.21.15.49:0/3963229452 conn(0x7ff4640b0100 msgr2=0x7ff4640acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 shutdown_connections 2023-12-19T05:39:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.163+0000 7ff4694d7640 1 -- 172.21.15.49:0/3963229452 wait complete. 2023-12-19T05:39:08.186 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-19T05:39:06.499883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1560,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560939,"statfs":{"total":1600000000,"available":1598401885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.333473"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.191317+0000","last_change":"2023-12-19T05:39:02.191317+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.191317+0000","last_undegraded":"2023-12-19T05:39:02.191317+0000","last_fullsized":"2023-12-19T05:39:02.191317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.181777+0000","last_change":"2023-12-19T05:39:02.181777+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.181777+0000","last_undegraded":"2023-12-19T05:39:02.181777+0000","last_fullsized":"2023-12-19T05:39:02.181777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184025+0000","last_change":"2023-12-19T05:39:02.184025+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184025+0000","last_undegraded":"2023-12-19T05:39:02.184025+0000","last_fullsized":"2023-12-19T05:39:02.184025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186039+0000","last_change":"2023-12-19T05:39:02.186039+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186039+0000","last_undegraded":"2023-12-19T05:39:02.186039+0000","last_fullsized":"2023-12-19T05:39:02.186039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187557+0000","last_change":"2023-12-19T05:39:02.187557+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187557+0000","last_undegraded":"2023-12-19T05:39:02.187557+0000","last_fullsized":"2023-12-19T05:39:02.187557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185657+0000","last_change":"2023-12-19T05:39:02.185657+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185657+0000","last_undegraded":"2023-12-19T05:39:02.185657+0000","last_fullsized":"2023-12-19T05:39:02.185657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190210+0000","last_change":"2023-12-19T05:39:02.190210+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190210+0000","last_undegraded":"2023-12-19T05:39:02.190210+0000","last_fullsized":"2023-12-19T05:39:02.190210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182978+0000","last_change":"2023-12-19T05:39:02.182978+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182978+0000","last_undegraded":"2023-12-19T05:39:02.182978+0000","last_fullsized":"2023-12-19T05:39:02.182978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190258+0000","last_change":"2023-12-19T05:39:02.190258+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190258+0000","last_undegraded":"2023-12-19T05:39:02.190258+0000","last_fullsized":"2023-12-19T05:39:02.190258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.188274+0000","last_change":"2023-12-19T05:39:02.188274+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.188274+0000","last_undegraded":"2023-12-19T05:39:02.188274+0000","last_fullsized":"2023-12-19T05:39:02.188274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190717+0000","last_change":"2023-12-19T05:39:02.190717+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190717+0000","last_undegraded":"2023-12-19T05:39:02.190717+0000","last_fullsized":"2023-12-19T05:39:02.190717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.199501+0000","last_change":"2023-12-19T05:39:02.199501+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.199501+0000","last_undegraded":"2023-12-19T05:39:02.199501+0000","last_fullsized":"2023-12-19T05:39:02.199501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192985+0000","last_change":"2023-12-19T05:39:02.192985+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192985+0000","last_undegraded":"2023-12-19T05:39:02.192985+0000","last_fullsized":"2023-12-19T05:39:02.192985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193364+0000","last_change":"2023-12-19T05:39:02.193364+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193364+0000","last_undegraded":"2023-12-19T05:39:02.193364+0000","last_fullsized":"2023-12-19T05:39:02.193364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185079+0000","last_change":"2023-12-19T05:39:02.185079+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185079+0000","last_undegraded":"2023-12-19T05:39:02.185079+0000","last_fullsized":"2023-12-19T05:39:02.185079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194785+0000","last_change":"2023-12-19T05:39:02.194785+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194785+0000","last_undegraded":"2023-12-19T05:39:02.194785+0000","last_fullsized":"2023-12-19T05:39:02.194785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194506+0000","last_change":"2023-12-19T05:39:02.194506+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194506+0000","last_undegraded":"2023-12-19T05:39:02.194506+0000","last_fullsized":"2023-12-19T05:39:02.194506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196837+0000","last_change":"2023-12-19T05:39:02.196837+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196837+0000","last_undegraded":"2023-12-19T05:39:02.196837+0000","last_fullsized":"2023-12-19T05:39:02.196837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195299+0000","last_change":"2023-12-19T05:39:02.195299+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195299+0000","last_undegraded":"2023-12-19T05:39:02.195299+0000","last_fullsized":"2023-12-19T05:39:02.195299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187886+0000","last_change":"2023-12-19T05:39:02.187886+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187886+0000","last_undegraded":"2023-12-19T05:39:02.187886+0000","last_fullsized":"2023-12-19T05:39:02.187886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196002+0000","last_change":"2023-12-19T05:39:02.196002+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196002+0000","last_undegraded":"2023-12-19T05:39:02.196002+0000","last_fullsized":"2023-12-19T05:39:02.196002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192881+0000","last_change":"2023-12-19T05:39:02.192881+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192881+0000","last_undegraded":"2023-12-19T05:39:02.192881+0000","last_fullsized":"2023-12-19T05:39:02.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182147+0000","last_change":"2023-12-19T05:39:02.182147+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182147+0000","last_undegraded":"2023-12-19T05:39:02.182147+0000","last_fullsized":"2023-12-19T05:39:02.182147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194653+0000","last_change":"2023-12-19T05:39:02.194653+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194653+0000","last_undegraded":"2023-12-19T05:39:02.194653+0000","last_fullsized":"2023-12-19T05:39:02.194653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184159+0000","last_change":"2023-12-19T05:39:02.184159+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184159+0000","last_undegraded":"2023-12-19T05:39:02.184159+0000","last_fullsized":"2023-12-19T05:39:02.184159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184322+0000","last_change":"2023-12-19T05:39:02.184322+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184322+0000","last_undegraded":"2023-12-19T05:39:02.184322+0000","last_fullsized":"2023-12-19T05:39:02.184322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193712+0000","last_change":"2023-12-19T05:39:02.193712+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193712+0000","last_undegraded":"2023-12-19T05:39:02.193712+0000","last_fullsized":"2023-12-19T05:39:02.193712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.187201+0000","last_change":"2023-12-19T05:39:02.187201+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.187201+0000","last_undegraded":"2023-12-19T05:39:02.187201+0000","last_fullsized":"2023-12-19T05:39:02.187201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185922+0000","last_change":"2023-12-19T05:39:02.185922+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185922+0000","last_undegraded":"2023-12-19T05:39:02.185922+0000","last_fullsized":"2023-12-19T05:39:02.185922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195428+0000","last_change":"2023-12-19T05:39:02.195428+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195428+0000","last_undegraded":"2023-12-19T05:39:02.195428+0000","last_fullsized":"2023-12-19T05:39:02.195428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.198388+0000","last_change":"2023-12-19T05:39:02.198388+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.198388+0000","last_undegraded":"2023-12-19T05:39:02.198388+0000","last_fullsized":"2023-12-19T05:39:02.198388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.184574+0000","last_change":"2023-12-19T05:39:02.184574+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.184574+0000","last_undegraded":"2023-12-19T05:39:02.184574+0000","last_fullsized":"2023-12-19T05:39:02.184574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192329+0000","last_change":"2023-12-19T05:39:02.192329+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192329+0000","last_undegraded":"2023-12-19T05:39:02.192329+0000","last_fullsized":"2023-12-19T05:39:02.192329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200181+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.200181+0000","last_peered":"2023-12-19T05:39:02.200181+0000","last_clean":"2023-12-19T05:39:02.200181+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.200181+0000","last_undegraded":"2023-12-19T05:39:02.200181+0000","last_fullsized":"2023-12-19T05:39:02.200181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196885+0000","last_change":"2023-12-19T05:39:02.196885+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196885+0000","last_undegraded":"2023-12-19T05:39:02.196885+0000","last_fullsized":"2023-12-19T05:39:02.196885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.198051+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.198051+0000","last_peered":"2023-12-19T05:39:02.198051+0000","last_clean":"2023-12-19T05:39:02.198051+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.198051+0000","last_undegraded":"2023-12-19T05:39:02.198051+0000","last_fullsized":"2023-12-19T05:39:02.198051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207940+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.207940+0000","last_peered":"2023-12-19T05:39:02.207940+0000","last_clean":"2023-12-19T05:39:02.207940+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.207940+0000","last_undegraded":"2023-12-19T05:39:02.207940+0000","last_fullsized":"2023-12-19T05:39:02.207940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182532+0000","last_change":"2023-12-19T05:39:02.182532+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182532+0000","last_undegraded":"2023-12-19T05:39:02.182532+0000","last_fullsized":"2023-12-19T05:39:02.182532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.196149+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.196149+0000","last_peered":"2023-12-19T05:39:02.196149+0000","last_clean":"2023-12-19T05:39:02.196149+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.196149+0000","last_undegraded":"2023-12-19T05:39:02.196149+0000","last_fullsized":"2023-12-19T05:39:02.196149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.189923+0000","last_change":"2023-12-19T05:39:02.189923+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.189923+0000","last_undegraded":"2023-12-19T05:39:02.189923+0000","last_fullsized":"2023-12-19T05:39:02.189923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.202359+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.202359+0000","last_peered":"2023-12-19T05:39:02.202359+0000","last_clean":"2023-12-19T05:39:02.202359+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.202359+0000","last_undegraded":"2023-12-19T05:39:02.202359+0000","last_fullsized":"2023-12-19T05:39:02.202359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.183415+0000","last_change":"2023-12-19T05:39:02.183415+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.183415+0000","last_undegraded":"2023-12-19T05:39:02.183415+0000","last_fullsized":"2023-12-19T05:39:02.183415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204882+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.204882+0000","last_peered":"2023-12-19T05:39:02.204882+0000","last_clean":"2023-12-19T05:39:02.204882+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.204882+0000","last_undegraded":"2023-12-19T05:39:02.204882+0000","last_fullsized":"2023-12-19T05:39:02.204882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.180684+0000","last_change":"2023-12-19T05:39:02.180684+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.180684+0000","last_undegraded":"2023-12-19T05:39:02.180684+0000","last_fullsized":"2023-12-19T05:39:02.180684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204748+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.204748+0000","last_peered":"2023-12-19T05:39:02.204748+0000","last_clean":"2023-12-19T05:39:02.204748+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.204748+0000","last_undegraded":"2023-12-19T05:39:02.204748+0000","last_fullsized":"2023-12-19T05:39:02.204748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194181+0000","last_change":"2023-12-19T05:39:02.194181+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194181+0000","last_undegraded":"2023-12-19T05:39:02.194181+0000","last_fullsized":"2023-12-19T05:39:02.194181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204298+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.204298+0000","last_peered":"2023-12-19T05:39:02.204298+0000","last_clean":"2023-12-19T05:39:02.204298+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.204298+0000","last_undegraded":"2023-12-19T05:39:02.204298+0000","last_fullsized":"2023-12-19T05:39:02.204298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186779+0000","last_change":"2023-12-19T05:39:02.186779+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186779+0000","last_undegraded":"2023-12-19T05:39:02.186779+0000","last_fullsized":"2023-12-19T05:39:02.186779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.208403+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.208403+0000","last_peered":"2023-12-19T05:39:02.208403+0000","last_clean":"2023-12-19T05:39:02.208403+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.208403+0000","last_undegraded":"2023-12-19T05:39:02.208403+0000","last_fullsized":"2023-12-19T05:39:02.208403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.189816+0000","last_change":"2023-12-19T05:39:02.189816+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.189816+0000","last_undegraded":"2023-12-19T05:39:02.189816+0000","last_fullsized":"2023-12-19T05:39:02.189816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206024+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.206024+0000","last_peered":"2023-12-19T05:39:02.206024+0000","last_clean":"2023-12-19T05:39:02.206024+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.206024+0000","last_undegraded":"2023-12-19T05:39:02.206024+0000","last_fullsized":"2023-12-19T05:39:02.206024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194131+0000","last_change":"2023-12-19T05:39:02.194131+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194131+0000","last_undegraded":"2023-12-19T05:39:02.194131+0000","last_fullsized":"2023-12-19T05:39:02.194131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206766+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.206766+0000","last_peered":"2023-12-19T05:39:02.206766+0000","last_clean":"2023-12-19T05:39:02.206766+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.206766+0000","last_undegraded":"2023-12-19T05:39:02.206766+0000","last_fullsized":"2023-12-19T05:39:02.206766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.191398+0000","last_change":"2023-12-19T05:39:02.191398+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.191398+0000","last_undegraded":"2023-12-19T05:39:02.191398+0000","last_fullsized":"2023-12-19T05:39:02.191398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206819+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.206819+0000","last_peered":"2023-12-19T05:39:02.206819+0000","last_clean":"2023-12-19T05:39:02.206819+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.206819+0000","last_undegraded":"2023-12-19T05:39:02.206819+0000","last_fullsized":"2023-12-19T05:39:02.206819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193641+0000","last_change":"2023-12-19T05:39:02.193641+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193641+0000","last_undegraded":"2023-12-19T05:39:02.193641+0000","last_fullsized":"2023-12-19T05:39:02.193641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.199758+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.199758+0000","last_peered":"2023-12-19T05:39:02.199758+0000","last_clean":"2023-12-19T05:39:02.199758+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.199758+0000","last_undegraded":"2023-12-19T05:39:02.199758+0000","last_fullsized":"2023-12-19T05:39:02.199758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182654+0000","last_change":"2023-12-19T05:39:02.182654+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182654+0000","last_undegraded":"2023-12-19T05:39:02.182654+0000","last_fullsized":"2023-12-19T05:39:02.182654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200030+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.200030+0000","last_peered":"2023-12-19T05:39:02.200030+0000","last_clean":"2023-12-19T05:39:02.200030+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.200030+0000","last_undegraded":"2023-12-19T05:39:02.200030+0000","last_fullsized":"2023-12-19T05:39:02.200030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193390+0000","last_change":"2023-12-19T05:39:02.193390+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193390+0000","last_undegraded":"2023-12-19T05:39:02.193390+0000","last_fullsized":"2023-12-19T05:39:02.193390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.198612+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.198612+0000","last_peered":"2023-12-19T05:39:02.198612+0000","last_clean":"2023-12-19T05:39:02.198612+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.198612+0000","last_undegraded":"2023-12-19T05:39:02.198612+0000","last_fullsized":"2023-12-19T05:39:02.198612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196219+0000","last_change":"2023-12-19T05:39:02.196219+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196219+0000","last_undegraded":"2023-12-19T05:39:02.196219+0000","last_fullsized":"2023-12-19T05:39:02.196219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205781+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.205781+0000","last_peered":"2023-12-19T05:39:02.205781+0000","last_clean":"2023-12-19T05:39:02.205781+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.205781+0000","last_undegraded":"2023-12-19T05:39:02.205781+0000","last_fullsized":"2023-12-19T05:39:02.205781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194361+0000","last_change":"2023-12-19T05:39:02.194361+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194361+0000","last_undegraded":"2023-12-19T05:39:02.194361+0000","last_fullsized":"2023-12-19T05:39:02.194361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-19T05:39:01.167622+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:01.167622+0000","last_peered":"2023-12-19T05:39:01.167622+0000","last_clean":"2023-12-19T05:39:01.167622+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:01.167622+0000","last_undegraded":"2023-12-19T05:39:01.167622+0000","last_fullsized":"2023-12-19T05:39:01.167622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.182986+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.182986+0000","last_peered":"2023-12-19T05:39:02.182986+0000","last_clean":"2023-12-19T05:39:02.182986+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.182986+0000","last_undegraded":"2023-12-19T05:39:02.182986+0000","last_fullsized":"2023-12-19T05:39:02.182986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195663+0000","last_change":"2023-12-19T05:39:02.195663+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195663+0000","last_undegraded":"2023-12-19T05:39:02.195663+0000","last_fullsized":"2023-12-19T05:39:02.195663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.182901+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.182901+0000","last_peered":"2023-12-19T05:39:02.182901+0000","last_clean":"2023-12-19T05:39:02.182901+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.182901+0000","last_undegraded":"2023-12-19T05:39:02.182901+0000","last_fullsized":"2023-12-19T05:39:02.182901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186179+0000","last_change":"2023-12-19T05:39:02.186179+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186179+0000","last_undegraded":"2023-12-19T05:39:02.186179+0000","last_fullsized":"2023-12-19T05:39:02.186179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205843+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.205843+0000","last_peered":"2023-12-19T05:39:02.205843+0000","last_clean":"2023-12-19T05:39:02.205843+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.205843+0000","last_undegraded":"2023-12-19T05:39:02.205843+0000","last_fullsized":"2023-12-19T05:39:02.205843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182762+0000","last_change":"2023-12-19T05:39:02.182762+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182762+0000","last_undegraded":"2023-12-19T05:39:02.182762+0000","last_fullsized":"2023-12-19T05:39:02.182762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.201713+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.201713+0000","last_peered":"2023-12-19T05:39:02.201713+0000","last_clean":"2023-12-19T05:39:02.201713+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.201713+0000","last_undegraded":"2023-12-19T05:39:02.201713+0000","last_fullsized":"2023-12-19T05:39:02.201713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190234+0000","last_change":"2023-12-19T05:39:02.190234+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190234+0000","last_undegraded":"2023-12-19T05:39:02.190234+0000","last_fullsized":"2023-12-19T05:39:02.190234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.200847+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.200847+0000","last_peered":"2023-12-19T05:39:02.200847+0000","last_clean":"2023-12-19T05:39:02.200847+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.200847+0000","last_undegraded":"2023-12-19T05:39:02.200847+0000","last_fullsized":"2023-12-19T05:39:02.200847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.182737+0000","last_change":"2023-12-19T05:39:02.182737+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.182737+0000","last_undegraded":"2023-12-19T05:39:02.182737+0000","last_fullsized":"2023-12-19T05:39:02.182737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.205722+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.205722+0000","last_peered":"2023-12-19T05:39:02.205722+0000","last_clean":"2023-12-19T05:39:02.205722+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.205722+0000","last_undegraded":"2023-12-19T05:39:02.205722+0000","last_fullsized":"2023-12-19T05:39:02.205722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.186044+0000","last_change":"2023-12-19T05:39:02.186044+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.186044+0000","last_undegraded":"2023-12-19T05:39:02.186044+0000","last_fullsized":"2023-12-19T05:39:02.186044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.208754+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:02.208754+0000","last_peered":"2023-12-19T05:39:02.208754+0000","last_clean":"2023-12-19T05:39:02.208754+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:02.208754+0000","last_undegraded":"2023-12-19T05:39:02.208754+0000","last_fullsized":"2023-12-19T05:39:02.208754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.196286+0000","last_change":"2023-12-19T05:39:02.196286+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.196286+0000","last_undegraded":"2023-12-19T05:39:02.196286+0000","last_fullsized":"2023-12-19T05:39:02.196286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.206544+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.206544+0000","last_peered":"2023-12-19T05:39:02.206544+0000","last_clean":"2023-12-19T05:39:02.206544+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.206544+0000","last_undegraded":"2023-12-19T05:39:02.206544+0000","last_fullsized":"2023-12-19T05:39:02.206544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.190579+0000","last_change":"2023-12-19T05:39:02.190579+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.190579+0000","last_undegraded":"2023-12-19T05:39:02.190579+0000","last_fullsized":"2023-12-19T05:39:02.190579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.199737+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.199737+0000","last_peered":"2023-12-19T05:39:02.199737+0000","last_clean":"2023-12-19T05:39:02.199737+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.199737+0000","last_undegraded":"2023-12-19T05:39:02.199737+0000","last_fullsized":"2023-12-19T05:39:02.199737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192757+0000","last_change":"2023-12-19T05:39:02.192757+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192757+0000","last_undegraded":"2023-12-19T05:39:02.192757+0000","last_fullsized":"2023-12-19T05:39:02.192757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207261+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.207261+0000","last_peered":"2023-12-19T05:39:02.207261+0000","last_clean":"2023-12-19T05:39:02.207261+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.207261+0000","last_undegraded":"2023-12-19T05:39:02.207261+0000","last_fullsized":"2023-12-19T05:39:02.207261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.192315+0000","last_change":"2023-12-19T05:39:02.192315+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.192315+0000","last_undegraded":"2023-12-19T05:39:02.192315+0000","last_fullsized":"2023-12-19T05:39:02.192315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.197689+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.197689+0000","last_peered":"2023-12-19T05:39:02.197689+0000","last_clean":"2023-12-19T05:39:02.197689+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.197689+0000","last_undegraded":"2023-12-19T05:39:02.197689+0000","last_fullsized":"2023-12-19T05:39:02.197689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193050+0000","last_change":"2023-12-19T05:39:02.193050+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193050+0000","last_undegraded":"2023-12-19T05:39:02.193050+0000","last_fullsized":"2023-12-19T05:39:02.193050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.181215+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.181215+0000","last_peered":"2023-12-19T05:39:02.181215+0000","last_clean":"2023-12-19T05:39:02.181215+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.181215+0000","last_undegraded":"2023-12-19T05:39:02.181215+0000","last_fullsized":"2023-12-19T05:39:02.181215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.193756+0000","last_change":"2023-12-19T05:39:02.193756+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.193756+0000","last_undegraded":"2023-12-19T05:39:02.193756+0000","last_fullsized":"2023-12-19T05:39:02.193756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.195078+0000","last_change":"2023-12-19T05:39:02.195078+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.195078+0000","last_undegraded":"2023-12-19T05:39:02.195078+0000","last_fullsized":"2023-12-19T05:39:02.195078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.204913+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.204913+0000","last_peered":"2023-12-19T05:39:02.204913+0000","last_clean":"2023-12-19T05:39:02.204913+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.204913+0000","last_undegraded":"2023-12-19T05:39:02.204913+0000","last_fullsized":"2023-12-19T05:39:02.204913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.194496+0000","last_change":"2023-12-19T05:39:02.194496+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.194496+0000","last_undegraded":"2023-12-19T05:39:02.194496+0000","last_fullsized":"2023-12-19T05:39:02.194496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.207101+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.207101+0000","last_peered":"2023-12-19T05:39:02.207101+0000","last_clean":"2023-12-19T05:39:02.207101+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.207101+0000","last_undegraded":"2023-12-19T05:39:02.207101+0000","last_fullsized":"2023-12-19T05:39:02.207101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.180284+0000","last_change":"2023-12-19T05:39:02.180284+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.180284+0000","last_undegraded":"2023-12-19T05:39:02.180284+0000","last_fullsized":"2023-12-19T05:39:02.180284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.203424+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.203424+0000","last_peered":"2023-12-19T05:39:02.203424+0000","last_clean":"2023-12-19T05:39:02.203424+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.203424+0000","last_undegraded":"2023-12-19T05:39:02.203424+0000","last_fullsized":"2023-12-19T05:39:02.203424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-19T05:39:02.185052+0000","last_change":"2023-12-19T05:39:02.185052+0000","last_active":"2023-12-19T05:39:02.163677+0000","last_peered":"2023-12-19T05:39:02.163677+0000","last_clean":"2023-12-19T05:39:02.163677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:02.185052+0000","last_undegraded":"2023-12-19T05:39:02.185052+0000","last_fullsized":"2023-12-19T05:39:02.185052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.202608+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.202608+0000","last_peered":"2023-12-19T05:39:02.202608+0000","last_clean":"2023-12-19T05:39:02.202608+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.202608+0000","last_undegraded":"2023-12-19T05:39:02.202608+0000","last_fullsized":"2023-12-19T05:39:02.202608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199351969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:08.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:08.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.466+0000 7fd5837b9640 1 Processor -- start 2023-12-19T05:39:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.466+0000 7fd5837b9640 1 -- start start 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd5837b9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd57c0b0b50 0x7fd57c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd5837b9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd57c06b590 0x7fd57c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd5837b9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c06bb30 con 0x7fd57c1449e0 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd5837b9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b0070 con 0x7fd57c06b590 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd5837b9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b0350 con 0x7fd57c0b0b50 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd581d56640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd57c06b590 0x7fd57c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.468+0000 7fd581d56640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd57c06b590 0x7fd57c06c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54834/0 (socket says 172.21.15.49:54834) 2023-12-19T05:39:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd581d56640 1 -- 172.21.15.49:0/2429696395 learned_addr learned my addr 172.21.15.49:0/2429696395 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd580d54640 1 --2- 172.21.15.49:0/2429696395 >> v2:172.21.15.115:3300/0 conn(0x7fd57c0b0b50 0x7fd57c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd581d56640 1 -- 172.21.15.49:0/2429696395 >> v2:172.21.15.115:3300/0 conn(0x7fd57c0b0b50 msgr2=0x7fd57c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd581d56640 1 --2- 172.21.15.49:0/2429696395 >> v2:172.21.15.115:3300/0 conn(0x7fd57c0b0b50 0x7fd57c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd581d56640 1 -- 172.21.15.49:0/2429696395 >> v1:172.21.15.115:6789/0 conn(0x7fd57c1449e0 legacy=0x7fd57c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.469+0000 7fd581d56640 1 -- 172.21.15.49:0/2429696395 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0b0630 con 0x7fd57c06b590 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.470+0000 7fd581d56640 1 --2- 172.21.15.49:0/2429696395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c06b590 0x7fd57c06c4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd57c071c80 tx=0x7fd57402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f393b305fd519db8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.470+0000 7fd573fff640 1 -- 172.21.15.49:0/2429696395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57402ca80 con 0x7fd57c06b590 2023-12-19T05:39:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.470+0000 7fd573fff640 1 -- 172.21.15.49:0/2429696395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57402cbe0 con 0x7fd57c06b590 2023-12-19T05:39:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.470+0000 7fd573fff640 1 -- 172.21.15.49:0/2429696395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740343f0 con 0x7fd57c06b590 2023-12-19T05:39:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 -- 172.21.15.49:0/2429696395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c06b590 msgr2=0x7fd57c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 --2- 172.21.15.49:0/2429696395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c06b590 0x7fd57c06c4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd57c071c80 tx=0x7fd57402bee0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 -- 172.21.15.49:0/2429696395 shutdown_connections 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 --2- 172.21.15.49:0/2429696395 >> v2:172.21.15.115:3300/0 conn(0x7fd57c0b0b50 0x7fd57c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 --2- 172.21.15.49:0/2429696395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c06b590 0x7fd57c06c4e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 -- 172.21.15.49:0/2429696395 >> 172.21.15.49:0/2429696395 conn(0x7fd57c0cbb70 msgr2=0x7fd57c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 -- 172.21.15.49:0/2429696395 shutdown_connections 2023-12-19T05:39:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.471+0000 7fd5837b9640 1 -- 172.21.15.49:0/2429696395 wait complete. 2023-12-19T05:39:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.473+0000 7fd5837b9640 1 Processor -- start 2023-12-19T05:39:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.473+0000 7fd5837b9640 1 -- start start 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd57c06b590 0x7fd57c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd57c1449e0 0x7fd57c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c15e5a0 con 0x7fd57c0b0b50 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c159320 con 0x7fd57c1449e0 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.474+0000 7fd5837b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c159600 con 0x7fd57c06b590 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54848/0 (socket says 172.21.15.49:54848) 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 -- 172.21.15.49:0/3917079962 learned_addr learned my addr 172.21.15.49:0/3917079962 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd581d56640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd57c1449e0 0x7fd57c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd581555640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd57c06b590 0x7fd57c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 -- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd57c06b590 msgr2=0x7fd57c1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd57c06b590 0x7fd57c1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 -- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd57c1449e0 msgr2=0x7fd57c15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd57c1449e0 0x7fd57c15d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 -- 172.21.15.49:0/3917079962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd574009b30 con 0x7fd57c0b0b50 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.475+0000 7fd580d54640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00d800 tx=0x7fd56c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.476+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00b6c0 con 0x7fd57c0b0b50 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.476+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00b820 con 0x7fd57c0b0b50 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.476+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00bbb0 con 0x7fd57c0b0b50 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.476+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c1598e0 con 0x7fd57c0b0b50 2023-12-19T05:39:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.476+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c158fe0 con 0x7fd57c0b0b50 2023-12-19T05:39:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.477+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c061910 con 0x7fd57c0b0b50 2023-12-19T05:39:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.478+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd56c00bd10 con 0x7fd57c0b0b50 2023-12-19T05:39:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.479+0000 7fd571ffb640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 0x7fd56006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.479+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd56c088e60 con 0x7fd57c0b0b50 2023-12-19T05:39:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.480+0000 7fd581555640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 0x7fd56006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.481+0000 7fd581555640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 0x7fd56006c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd578006fd0 tx=0x7fd578008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.483+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd56c054450 con 0x7fd57c0b0b50 2023-12-19T05:39:08.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.674+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd57c0b1710 con 0x7fd56006a430 2023-12-19T05:39:08.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.695+0000 7fd571ffb640 1 -- 172.21.15.49:0/3917079962 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260107 (secure 0 0 0) 0x7fd57800be30 con 0x7fd56006a430 2023-12-19T05:39:08.699 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:08.701 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:08.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 msgr2=0x7fd56006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 0x7fd56006c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd578006fd0 tx=0x7fd578008040 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 msgr2=0x7fd57c15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00d800 tx=0x7fd56c00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 shutdown_connections 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56006a430 0x7fd56006c8f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd57c1449e0 0x7fd57c15d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd57c0b0b50 0x7fd57c15cbd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 --2- 172.21.15.49:0/3917079962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd57c06b590 0x7fd57c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 >> 172.21.15.49:0/3917079962 conn(0x7fd57c0cbb70 msgr2=0x7fd57c0af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 shutdown_connections 2023-12-19T05:39:08.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:08.700+0000 7fd5837b9640 1 -- 172.21.15.49:0/3917079962 wait complete. 2023-12-19T05:39:08.722 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T05:39:08.500514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.325023"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717330+0000","last_change":"2023-12-19T05:39:02.717216+0000","last_active":"2023-12-19T05:39:02.717330+0000","last_peered":"2023-12-19T05:39:02.717330+0000","last_clean":"2023-12-19T05:39:02.717330+0000","last_became_active":"2023-12-19T05:39:02.716805+0000","last_became_peered":"2023-12-19T05:39:02.716805+0000","last_unstale":"2023-12-19T05:39:02.717330+0000","last_undegraded":"2023-12-19T05:39:02.717330+0000","last_fullsized":"2023-12-19T05:39:02.717330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723207+0000","last_change":"2023-12-19T05:39:02.720735+0000","last_active":"2023-12-19T05:39:02.723207+0000","last_peered":"2023-12-19T05:39:02.723207+0000","last_clean":"2023-12-19T05:39:02.723207+0000","last_became_active":"2023-12-19T05:39:02.720479+0000","last_became_peered":"2023-12-19T05:39:02.720479+0000","last_unstale":"2023-12-19T05:39:02.723207+0000","last_undegraded":"2023-12-19T05:39:02.723207+0000","last_fullsized":"2023-12-19T05:39:02.723207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718511+0000","last_change":"2023-12-19T05:39:02.715183+0000","last_active":"2023-12-19T05:39:02.718511+0000","last_peered":"2023-12-19T05:39:02.718511+0000","last_clean":"2023-12-19T05:39:02.718511+0000","last_became_active":"2023-12-19T05:39:02.714240+0000","last_became_peered":"2023-12-19T05:39:02.714240+0000","last_unstale":"2023-12-19T05:39:02.718511+0000","last_undegraded":"2023-12-19T05:39:02.718511+0000","last_fullsized":"2023-12-19T05:39:02.718511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711817+0000","last_change":"2023-12-19T05:39:02.710230+0000","last_active":"2023-12-19T05:39:02.711817+0000","last_peered":"2023-12-19T05:39:02.711817+0000","last_clean":"2023-12-19T05:39:02.711817+0000","last_became_active":"2023-12-19T05:39:02.710001+0000","last_became_peered":"2023-12-19T05:39:02.710001+0000","last_unstale":"2023-12-19T05:39:02.711817+0000","last_undegraded":"2023-12-19T05:39:02.711817+0000","last_fullsized":"2023-12-19T05:39:02.711817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718958+0000","last_change":"2023-12-19T05:39:02.718728+0000","last_active":"2023-12-19T05:39:02.718958+0000","last_peered":"2023-12-19T05:39:02.718958+0000","last_clean":"2023-12-19T05:39:02.718958+0000","last_became_active":"2023-12-19T05:39:02.718457+0000","last_became_peered":"2023-12-19T05:39:02.718457+0000","last_unstale":"2023-12-19T05:39:02.718958+0000","last_undegraded":"2023-12-19T05:39:02.718958+0000","last_fullsized":"2023-12-19T05:39:02.718958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711835+0000","last_change":"2023-12-19T05:39:02.710247+0000","last_active":"2023-12-19T05:39:02.711835+0000","last_peered":"2023-12-19T05:39:02.711835+0000","last_clean":"2023-12-19T05:39:02.711835+0000","last_became_active":"2023-12-19T05:39:02.710039+0000","last_became_peered":"2023-12-19T05:39:02.710039+0000","last_unstale":"2023-12-19T05:39:02.711835+0000","last_undegraded":"2023-12-19T05:39:02.711835+0000","last_fullsized":"2023-12-19T05:39:02.711835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716214+0000","last_change":"2023-12-19T05:39:02.716135+0000","last_active":"2023-12-19T05:39:02.716214+0000","last_peered":"2023-12-19T05:39:02.716214+0000","last_clean":"2023-12-19T05:39:02.716214+0000","last_became_active":"2023-12-19T05:39:02.715148+0000","last_became_peered":"2023-12-19T05:39:02.715148+0000","last_unstale":"2023-12-19T05:39:02.716214+0000","last_undegraded":"2023-12-19T05:39:02.716214+0000","last_fullsized":"2023-12-19T05:39:02.716214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723196+0000","last_change":"2023-12-19T05:39:02.720176+0000","last_active":"2023-12-19T05:39:02.723196+0000","last_peered":"2023-12-19T05:39:02.723196+0000","last_clean":"2023-12-19T05:39:02.723196+0000","last_became_active":"2023-12-19T05:39:02.719954+0000","last_became_peered":"2023-12-19T05:39:02.719954+0000","last_unstale":"2023-12-19T05:39:02.723196+0000","last_undegraded":"2023-12-19T05:39:02.723196+0000","last_fullsized":"2023-12-19T05:39:02.723196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700335+0000","last_change":"2023-12-19T05:39:02.700252+0000","last_active":"2023-12-19T05:39:02.700335+0000","last_peered":"2023-12-19T05:39:02.700335+0000","last_clean":"2023-12-19T05:39:02.700335+0000","last_became_active":"2023-12-19T05:39:02.699871+0000","last_became_peered":"2023-12-19T05:39:02.699871+0000","last_unstale":"2023-12-19T05:39:02.700335+0000","last_undegraded":"2023-12-19T05:39:02.700335+0000","last_fullsized":"2023-12-19T05:39:02.700335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709263+0000","last_change":"2023-12-19T05:39:02.708261+0000","last_active":"2023-12-19T05:39:02.709263+0000","last_peered":"2023-12-19T05:39:02.709263+0000","last_clean":"2023-12-19T05:39:02.709263+0000","last_became_active":"2023-12-19T05:39:02.707762+0000","last_became_peered":"2023-12-19T05:39:02.707762+0000","last_unstale":"2023-12-19T05:39:02.709263+0000","last_undegraded":"2023-12-19T05:39:02.709263+0000","last_fullsized":"2023-12-19T05:39:02.709263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717313+0000","last_change":"2023-12-19T05:39:02.717049+0000","last_active":"2023-12-19T05:39:02.717313+0000","last_peered":"2023-12-19T05:39:02.717313+0000","last_clean":"2023-12-19T05:39:02.717313+0000","last_became_active":"2023-12-19T05:39:02.716371+0000","last_became_peered":"2023-12-19T05:39:02.716371+0000","last_unstale":"2023-12-19T05:39:02.717313+0000","last_undegraded":"2023-12-19T05:39:02.717313+0000","last_fullsized":"2023-12-19T05:39:02.717313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707329+0000","last_change":"2023-12-19T05:39:02.707024+0000","last_active":"2023-12-19T05:39:02.707329+0000","last_peered":"2023-12-19T05:39:02.707329+0000","last_clean":"2023-12-19T05:39:02.707329+0000","last_became_active":"2023-12-19T05:39:02.706779+0000","last_became_peered":"2023-12-19T05:39:02.706779+0000","last_unstale":"2023-12-19T05:39:02.707329+0000","last_undegraded":"2023-12-19T05:39:02.707329+0000","last_fullsized":"2023-12-19T05:39:02.707329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719791+0000","last_change":"2023-12-19T05:39:02.718594+0000","last_active":"2023-12-19T05:39:02.719791+0000","last_peered":"2023-12-19T05:39:02.719791+0000","last_clean":"2023-12-19T05:39:02.719791+0000","last_became_active":"2023-12-19T05:39:02.717977+0000","last_became_peered":"2023-12-19T05:39:02.717977+0000","last_unstale":"2023-12-19T05:39:02.719791+0000","last_undegraded":"2023-12-19T05:39:02.719791+0000","last_fullsized":"2023-12-19T05:39:02.719791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719739+0000","last_change":"2023-12-19T05:39:02.718246+0000","last_active":"2023-12-19T05:39:02.719739+0000","last_peered":"2023-12-19T05:39:02.719739+0000","last_clean":"2023-12-19T05:39:02.719739+0000","last_became_active":"2023-12-19T05:39:02.716071+0000","last_became_peered":"2023-12-19T05:39:02.716071+0000","last_unstale":"2023-12-19T05:39:02.719739+0000","last_undegraded":"2023-12-19T05:39:02.719739+0000","last_fullsized":"2023-12-19T05:39:02.719739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718462+0000","last_change":"2023-12-19T05:39:02.714245+0000","last_active":"2023-12-19T05:39:02.718462+0000","last_peered":"2023-12-19T05:39:02.718462+0000","last_clean":"2023-12-19T05:39:02.718462+0000","last_became_active":"2023-12-19T05:39:02.713242+0000","last_became_peered":"2023-12-19T05:39:02.713242+0000","last_unstale":"2023-12-19T05:39:02.718462+0000","last_undegraded":"2023-12-19T05:39:02.718462+0000","last_fullsized":"2023-12-19T05:39:02.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709046+0000","last_change":"2023-12-19T05:39:02.708950+0000","last_active":"2023-12-19T05:39:02.709046+0000","last_peered":"2023-12-19T05:39:02.709046+0000","last_clean":"2023-12-19T05:39:02.709046+0000","last_became_active":"2023-12-19T05:39:02.708106+0000","last_became_peered":"2023-12-19T05:39:02.708106+0000","last_unstale":"2023-12-19T05:39:02.709046+0000","last_undegraded":"2023-12-19T05:39:02.709046+0000","last_fullsized":"2023-12-19T05:39:02.709046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706992+0000","last_change":"2023-12-19T05:39:02.706691+0000","last_active":"2023-12-19T05:39:02.706992+0000","last_peered":"2023-12-19T05:39:02.706992+0000","last_clean":"2023-12-19T05:39:02.706992+0000","last_became_active":"2023-12-19T05:39:02.706456+0000","last_became_peered":"2023-12-19T05:39:02.706456+0000","last_unstale":"2023-12-19T05:39:02.706992+0000","last_undegraded":"2023-12-19T05:39:02.706992+0000","last_fullsized":"2023-12-19T05:39:02.706992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716359+0000","last_change":"2023-12-19T05:39:02.713393+0000","last_active":"2023-12-19T05:39:02.716359+0000","last_peered":"2023-12-19T05:39:02.716359+0000","last_clean":"2023-12-19T05:39:02.716359+0000","last_became_active":"2023-12-19T05:39:02.713154+0000","last_became_peered":"2023-12-19T05:39:02.713154+0000","last_unstale":"2023-12-19T05:39:02.716359+0000","last_undegraded":"2023-12-19T05:39:02.716359+0000","last_fullsized":"2023-12-19T05:39:02.716359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701477+0000","last_change":"2023-12-19T05:39:02.700926+0000","last_active":"2023-12-19T05:39:02.701477+0000","last_peered":"2023-12-19T05:39:02.701477+0000","last_clean":"2023-12-19T05:39:02.701477+0000","last_became_active":"2023-12-19T05:39:02.697252+0000","last_became_peered":"2023-12-19T05:39:02.697252+0000","last_unstale":"2023-12-19T05:39:02.701477+0000","last_undegraded":"2023-12-19T05:39:02.701477+0000","last_fullsized":"2023-12-19T05:39:02.701477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709283+0000","last_change":"2023-12-19T05:39:02.708393+0000","last_active":"2023-12-19T05:39:02.709283+0000","last_peered":"2023-12-19T05:39:02.709283+0000","last_clean":"2023-12-19T05:39:02.709283+0000","last_became_active":"2023-12-19T05:39:02.708060+0000","last_became_peered":"2023-12-19T05:39:02.708060+0000","last_unstale":"2023-12-19T05:39:02.709283+0000","last_undegraded":"2023-12-19T05:39:02.709283+0000","last_fullsized":"2023-12-19T05:39:02.709283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711238+0000","last_change":"2023-12-19T05:39:02.710664+0000","last_active":"2023-12-19T05:39:02.711238+0000","last_peered":"2023-12-19T05:39:02.711238+0000","last_clean":"2023-12-19T05:39:02.711238+0000","last_became_active":"2023-12-19T05:39:02.710462+0000","last_became_peered":"2023-12-19T05:39:02.710462+0000","last_unstale":"2023-12-19T05:39:02.711238+0000","last_undegraded":"2023-12-19T05:39:02.711238+0000","last_fullsized":"2023-12-19T05:39:02.711238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707454+0000","last_change":"2023-12-19T05:39:02.706412+0000","last_active":"2023-12-19T05:39:02.707454+0000","last_peered":"2023-12-19T05:39:02.707454+0000","last_clean":"2023-12-19T05:39:02.707454+0000","last_became_active":"2023-12-19T05:39:02.706148+0000","last_became_peered":"2023-12-19T05:39:02.706148+0000","last_unstale":"2023-12-19T05:39:02.707454+0000","last_undegraded":"2023-12-19T05:39:02.707454+0000","last_fullsized":"2023-12-19T05:39:02.707454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718533+0000","last_change":"2023-12-19T05:39:02.715320+0000","last_active":"2023-12-19T05:39:02.718533+0000","last_peered":"2023-12-19T05:39:02.718533+0000","last_clean":"2023-12-19T05:39:02.718533+0000","last_became_active":"2023-12-19T05:39:02.714719+0000","last_became_peered":"2023-12-19T05:39:02.714719+0000","last_unstale":"2023-12-19T05:39:02.718533+0000","last_undegraded":"2023-12-19T05:39:02.718533+0000","last_fullsized":"2023-12-19T05:39:02.718533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715762+0000","last_change":"2023-12-19T05:39:02.715586+0000","last_active":"2023-12-19T05:39:02.715762+0000","last_peered":"2023-12-19T05:39:02.715762+0000","last_clean":"2023-12-19T05:39:02.715762+0000","last_became_active":"2023-12-19T05:39:02.715221+0000","last_became_peered":"2023-12-19T05:39:02.715221+0000","last_unstale":"2023-12-19T05:39:02.715762+0000","last_undegraded":"2023-12-19T05:39:02.715762+0000","last_fullsized":"2023-12-19T05:39:02.715762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718480+0000","last_change":"2023-12-19T05:39:02.714373+0000","last_active":"2023-12-19T05:39:02.718480+0000","last_peered":"2023-12-19T05:39:02.718480+0000","last_clean":"2023-12-19T05:39:02.718480+0000","last_became_active":"2023-12-19T05:39:02.713629+0000","last_became_peered":"2023-12-19T05:39:02.713629+0000","last_unstale":"2023-12-19T05:39:02.718480+0000","last_undegraded":"2023-12-19T05:39:02.718480+0000","last_fullsized":"2023-12-19T05:39:02.718480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713382+0000","last_change":"2023-12-19T05:39:02.713317+0000","last_active":"2023-12-19T05:39:02.713382+0000","last_peered":"2023-12-19T05:39:02.713382+0000","last_clean":"2023-12-19T05:39:02.713382+0000","last_became_active":"2023-12-19T05:39:02.712971+0000","last_became_peered":"2023-12-19T05:39:02.712971+0000","last_unstale":"2023-12-19T05:39:02.713382+0000","last_undegraded":"2023-12-19T05:39:02.713382+0000","last_fullsized":"2023-12-19T05:39:02.713382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720145+0000","last_change":"2023-12-19T05:39:02.719977+0000","last_active":"2023-12-19T05:39:02.720145+0000","last_peered":"2023-12-19T05:39:02.720145+0000","last_clean":"2023-12-19T05:39:02.720145+0000","last_became_active":"2023-12-19T05:39:02.719748+0000","last_became_peered":"2023-12-19T05:39:02.719748+0000","last_unstale":"2023-12-19T05:39:02.720145+0000","last_undegraded":"2023-12-19T05:39:02.720145+0000","last_fullsized":"2023-12-19T05:39:02.720145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719772+0000","last_change":"2023-12-19T05:39:02.718445+0000","last_active":"2023-12-19T05:39:02.719772+0000","last_peered":"2023-12-19T05:39:02.719772+0000","last_clean":"2023-12-19T05:39:02.719772+0000","last_became_active":"2023-12-19T05:39:02.717751+0000","last_became_peered":"2023-12-19T05:39:02.717751+0000","last_unstale":"2023-12-19T05:39:02.719772+0000","last_undegraded":"2023-12-19T05:39:02.719772+0000","last_fullsized":"2023-12-19T05:39:02.719772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713710+0000","last_change":"2023-12-19T05:39:02.711952+0000","last_active":"2023-12-19T05:39:02.713710+0000","last_peered":"2023-12-19T05:39:02.713710+0000","last_clean":"2023-12-19T05:39:02.713710+0000","last_became_active":"2023-12-19T05:39:02.711582+0000","last_became_peered":"2023-12-19T05:39:02.711582+0000","last_unstale":"2023-12-19T05:39:02.713710+0000","last_undegraded":"2023-12-19T05:39:02.713710+0000","last_fullsized":"2023-12-19T05:39:02.713710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713984+0000","last_change":"2023-12-19T05:39:02.713881+0000","last_active":"2023-12-19T05:39:02.713984+0000","last_peered":"2023-12-19T05:39:02.713984+0000","last_clean":"2023-12-19T05:39:02.713984+0000","last_became_active":"2023-12-19T05:39:02.708835+0000","last_became_peered":"2023-12-19T05:39:02.708835+0000","last_unstale":"2023-12-19T05:39:02.713984+0000","last_undegraded":"2023-12-19T05:39:02.713984+0000","last_fullsized":"2023-12-19T05:39:02.713984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.708630+0000","last_change":"2023-12-19T05:39:02.708098+0000","last_active":"2023-12-19T05:39:02.708630+0000","last_peered":"2023-12-19T05:39:02.708630+0000","last_clean":"2023-12-19T05:39:02.708630+0000","last_became_active":"2023-12-19T05:39:02.707804+0000","last_became_peered":"2023-12-19T05:39:02.707804+0000","last_unstale":"2023-12-19T05:39:02.708630+0000","last_undegraded":"2023-12-19T05:39:02.708630+0000","last_fullsized":"2023-12-19T05:39:02.708630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721098+0000","last_change":"2023-12-19T05:39:02.720287+0000","last_active":"2023-12-19T05:39:02.721098+0000","last_peered":"2023-12-19T05:39:02.721098+0000","last_clean":"2023-12-19T05:39:02.721098+0000","last_became_active":"2023-12-19T05:39:02.720075+0000","last_became_peered":"2023-12-19T05:39:02.720075+0000","last_unstale":"2023-12-19T05:39:02.721098+0000","last_undegraded":"2023-12-19T05:39:02.721098+0000","last_fullsized":"2023-12-19T05:39:02.721098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719684+0000","last_change":"2023-12-19T05:39:02.719563+0000","last_active":"2023-12-19T05:39:02.719684+0000","last_peered":"2023-12-19T05:39:02.719684+0000","last_clean":"2023-12-19T05:39:02.719684+0000","last_became_active":"2023-12-19T05:39:02.719114+0000","last_became_peered":"2023-12-19T05:39:02.719114+0000","last_unstale":"2023-12-19T05:39:02.719684+0000","last_undegraded":"2023-12-19T05:39:02.719684+0000","last_fullsized":"2023-12-19T05:39:02.719684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727216+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.727216+0000","last_peered":"2023-12-19T05:39:02.727216+0000","last_clean":"2023-12-19T05:39:02.727216+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.727216+0000","last_undegraded":"2023-12-19T05:39:02.727216+0000","last_fullsized":"2023-12-19T05:39:02.727216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711786+0000","last_change":"2023-12-19T05:39:02.711723+0000","last_active":"2023-12-19T05:39:02.711786+0000","last_peered":"2023-12-19T05:39:02.711786+0000","last_clean":"2023-12-19T05:39:02.711786+0000","last_became_active":"2023-12-19T05:39:02.709817+0000","last_became_peered":"2023-12-19T05:39:02.709817+0000","last_unstale":"2023-12-19T05:39:02.711786+0000","last_undegraded":"2023-12-19T05:39:02.711786+0000","last_fullsized":"2023-12-19T05:39:02.711786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722219+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.722219+0000","last_peered":"2023-12-19T05:39:02.722219+0000","last_clean":"2023-12-19T05:39:02.722219+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.722219+0000","last_undegraded":"2023-12-19T05:39:02.722219+0000","last_fullsized":"2023-12-19T05:39:02.722219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713569+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.713569+0000","last_peered":"2023-12-19T05:39:02.713569+0000","last_clean":"2023-12-19T05:39:02.713569+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.713569+0000","last_undegraded":"2023-12-19T05:39:02.713569+0000","last_fullsized":"2023-12-19T05:39:02.713569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723073+0000","last_change":"2023-12-19T05:39:02.719393+0000","last_active":"2023-12-19T05:39:02.723073+0000","last_peered":"2023-12-19T05:39:02.723073+0000","last_clean":"2023-12-19T05:39:02.723073+0000","last_became_active":"2023-12-19T05:39:02.719080+0000","last_became_peered":"2023-12-19T05:39:02.719080+0000","last_unstale":"2023-12-19T05:39:02.723073+0000","last_undegraded":"2023-12-19T05:39:02.723073+0000","last_fullsized":"2023-12-19T05:39:02.723073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691632+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.691632+0000","last_peered":"2023-12-19T05:39:02.691632+0000","last_clean":"2023-12-19T05:39:02.691632+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.691632+0000","last_undegraded":"2023-12-19T05:39:02.691632+0000","last_fullsized":"2023-12-19T05:39:02.691632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706164+0000","last_change":"2023-12-19T05:39:02.697790+0000","last_active":"2023-12-19T05:39:02.706164+0000","last_peered":"2023-12-19T05:39:02.706164+0000","last_clean":"2023-12-19T05:39:02.706164+0000","last_became_active":"2023-12-19T05:39:02.697516+0000","last_became_peered":"2023-12-19T05:39:02.697516+0000","last_unstale":"2023-12-19T05:39:02.706164+0000","last_undegraded":"2023-12-19T05:39:02.706164+0000","last_fullsized":"2023-12-19T05:39:02.706164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695035+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.695035+0000","last_peered":"2023-12-19T05:39:02.695035+0000","last_clean":"2023-12-19T05:39:02.695035+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.695035+0000","last_undegraded":"2023-12-19T05:39:02.695035+0000","last_fullsized":"2023-12-19T05:39:02.695035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711851+0000","last_change":"2023-12-19T05:39:02.711262+0000","last_active":"2023-12-19T05:39:02.711851+0000","last_peered":"2023-12-19T05:39:02.711851+0000","last_clean":"2023-12-19T05:39:02.711851+0000","last_became_active":"2023-12-19T05:39:02.710878+0000","last_became_peered":"2023-12-19T05:39:02.710878+0000","last_unstale":"2023-12-19T05:39:02.711851+0000","last_undegraded":"2023-12-19T05:39:02.711851+0000","last_fullsized":"2023-12-19T05:39:02.711851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.702914+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.702914+0000","last_peered":"2023-12-19T05:39:02.702914+0000","last_clean":"2023-12-19T05:39:02.702914+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.702914+0000","last_undegraded":"2023-12-19T05:39:02.702914+0000","last_fullsized":"2023-12-19T05:39:02.702914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.704026+0000","last_change":"2023-12-19T05:39:02.703882+0000","last_active":"2023-12-19T05:39:02.704026+0000","last_peered":"2023-12-19T05:39:02.704026+0000","last_clean":"2023-12-19T05:39:02.704026+0000","last_became_active":"2023-12-19T05:39:02.703208+0000","last_became_peered":"2023-12-19T05:39:02.703208+0000","last_unstale":"2023-12-19T05:39:02.704026+0000","last_undegraded":"2023-12-19T05:39:02.704026+0000","last_fullsized":"2023-12-19T05:39:02.704026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719259+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.719259+0000","last_peered":"2023-12-19T05:39:02.719259+0000","last_clean":"2023-12-19T05:39:02.719259+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.719259+0000","last_undegraded":"2023-12-19T05:39:02.719259+0000","last_fullsized":"2023-12-19T05:39:02.719259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715569+0000","last_change":"2023-12-19T05:39:02.715445+0000","last_active":"2023-12-19T05:39:02.715569+0000","last_peered":"2023-12-19T05:39:02.715569+0000","last_clean":"2023-12-19T05:39:02.715569+0000","last_became_active":"2023-12-19T05:39:02.714901+0000","last_became_peered":"2023-12-19T05:39:02.714901+0000","last_unstale":"2023-12-19T05:39:02.715569+0000","last_undegraded":"2023-12-19T05:39:02.715569+0000","last_fullsized":"2023-12-19T05:39:02.715569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.728240+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.728240+0000","last_peered":"2023-12-19T05:39:02.728240+0000","last_clean":"2023-12-19T05:39:02.728240+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.728240+0000","last_undegraded":"2023-12-19T05:39:02.728240+0000","last_fullsized":"2023-12-19T05:39:02.728240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720718+0000","last_change":"2023-12-19T05:39:02.720607+0000","last_active":"2023-12-19T05:39:02.720718+0000","last_peered":"2023-12-19T05:39:02.720718+0000","last_clean":"2023-12-19T05:39:02.720718+0000","last_became_active":"2023-12-19T05:39:02.720203+0000","last_became_peered":"2023-12-19T05:39:02.720203+0000","last_unstale":"2023-12-19T05:39:02.720718+0000","last_undegraded":"2023-12-19T05:39:02.720718+0000","last_fullsized":"2023-12-19T05:39:02.720718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716893+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.716893+0000","last_peered":"2023-12-19T05:39:02.716893+0000","last_clean":"2023-12-19T05:39:02.716893+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.716893+0000","last_undegraded":"2023-12-19T05:39:02.716893+0000","last_fullsized":"2023-12-19T05:39:02.716893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719719+0000","last_change":"2023-12-19T05:39:02.717923+0000","last_active":"2023-12-19T05:39:02.719719+0000","last_peered":"2023-12-19T05:39:02.719719+0000","last_clean":"2023-12-19T05:39:02.719719+0000","last_became_active":"2023-12-19T05:39:02.717316+0000","last_became_peered":"2023-12-19T05:39:02.717316+0000","last_unstale":"2023-12-19T05:39:02.719719+0000","last_undegraded":"2023-12-19T05:39:02.719719+0000","last_fullsized":"2023-12-19T05:39:02.719719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689096+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.689096+0000","last_peered":"2023-12-19T05:39:02.689096+0000","last_clean":"2023-12-19T05:39:02.689096+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.689096+0000","last_undegraded":"2023-12-19T05:39:02.689096+0000","last_fullsized":"2023-12-19T05:39:02.689096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713759+0000","last_change":"2023-12-19T05:39:02.713659+0000","last_active":"2023-12-19T05:39:02.713759+0000","last_peered":"2023-12-19T05:39:02.713759+0000","last_clean":"2023-12-19T05:39:02.713759+0000","last_became_active":"2023-12-19T05:39:02.708530+0000","last_became_peered":"2023-12-19T05:39:02.708530+0000","last_unstale":"2023-12-19T05:39:02.713759+0000","last_undegraded":"2023-12-19T05:39:02.713759+0000","last_fullsized":"2023-12-19T05:39:02.713759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703018+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.703018+0000","last_peered":"2023-12-19T05:39:02.703018+0000","last_clean":"2023-12-19T05:39:02.703018+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.703018+0000","last_undegraded":"2023-12-19T05:39:02.703018+0000","last_fullsized":"2023-12-19T05:39:02.703018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719504+0000","last_change":"2023-12-19T05:39:02.719423+0000","last_active":"2023-12-19T05:39:02.719504+0000","last_peered":"2023-12-19T05:39:02.719504+0000","last_clean":"2023-12-19T05:39:02.719504+0000","last_became_active":"2023-12-19T05:39:02.718789+0000","last_became_peered":"2023-12-19T05:39:02.718789+0000","last_unstale":"2023-12-19T05:39:02.719504+0000","last_undegraded":"2023-12-19T05:39:02.719504+0000","last_fullsized":"2023-12-19T05:39:02.719504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727356+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.727356+0000","last_peered":"2023-12-19T05:39:02.727356+0000","last_clean":"2023-12-19T05:39:02.727356+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.727356+0000","last_undegraded":"2023-12-19T05:39:02.727356+0000","last_fullsized":"2023-12-19T05:39:02.727356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.705289+0000","last_change":"2023-12-19T05:39:02.704511+0000","last_active":"2023-12-19T05:39:02.705289+0000","last_peered":"2023-12-19T05:39:02.705289+0000","last_clean":"2023-12-19T05:39:02.705289+0000","last_became_active":"2023-12-19T05:39:02.704290+0000","last_became_peered":"2023-12-19T05:39:02.704290+0000","last_unstale":"2023-12-19T05:39:02.705289+0000","last_undegraded":"2023-12-19T05:39:02.705289+0000","last_fullsized":"2023-12-19T05:39:02.705289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720875+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.720875+0000","last_peered":"2023-12-19T05:39:02.720875+0000","last_clean":"2023-12-19T05:39:02.720875+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.720875+0000","last_undegraded":"2023-12-19T05:39:02.720875+0000","last_fullsized":"2023-12-19T05:39:02.720875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.710295+0000","last_change":"2023-12-19T05:39:02.709021+0000","last_active":"2023-12-19T05:39:02.710295+0000","last_peered":"2023-12-19T05:39:02.710295+0000","last_clean":"2023-12-19T05:39:02.710295+0000","last_became_active":"2023-12-19T05:39:02.708795+0000","last_became_peered":"2023-12-19T05:39:02.708795+0000","last_unstale":"2023-12-19T05:39:02.710295+0000","last_undegraded":"2023-12-19T05:39:02.710295+0000","last_fullsized":"2023-12-19T05:39:02.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723471+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.723471+0000","last_peered":"2023-12-19T05:39:02.723471+0000","last_clean":"2023-12-19T05:39:02.723471+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.723471+0000","last_undegraded":"2023-12-19T05:39:02.723471+0000","last_fullsized":"2023-12-19T05:39:02.723471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711455+0000","last_change":"2023-12-19T05:39:02.710851+0000","last_active":"2023-12-19T05:39:02.711455+0000","last_peered":"2023-12-19T05:39:02.711455+0000","last_clean":"2023-12-19T05:39:02.711455+0000","last_became_active":"2023-12-19T05:39:02.710608+0000","last_became_peered":"2023-12-19T05:39:02.710608+0000","last_unstale":"2023-12-19T05:39:02.711455+0000","last_undegraded":"2023-12-19T05:39:02.711455+0000","last_fullsized":"2023-12-19T05:39:02.711455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726383+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.726383+0000","last_peered":"2023-12-19T05:39:02.726383+0000","last_clean":"2023-12-19T05:39:02.726383+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.726383+0000","last_undegraded":"2023-12-19T05:39:02.726383+0000","last_fullsized":"2023-12-19T05:39:02.726383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707311+0000","last_change":"2023-12-19T05:39:02.705620+0000","last_active":"2023-12-19T05:39:02.707311+0000","last_peered":"2023-12-19T05:39:02.707311+0000","last_clean":"2023-12-19T05:39:02.707311+0000","last_became_active":"2023-12-19T05:39:02.705414+0000","last_became_peered":"2023-12-19T05:39:02.705414+0000","last_unstale":"2023-12-19T05:39:02.707311+0000","last_undegraded":"2023-12-19T05:39:02.707311+0000","last_fullsized":"2023-12-19T05:39:02.707311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715348+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.715348+0000","last_peered":"2023-12-19T05:39:02.715348+0000","last_clean":"2023-12-19T05:39:02.715348+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.715348+0000","last_undegraded":"2023-12-19T05:39:02.715348+0000","last_fullsized":"2023-12-19T05:39:02.715348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.696599+0000","last_change":"2023-12-19T05:39:02.696537+0000","last_active":"2023-12-19T05:39:02.696599+0000","last_peered":"2023-12-19T05:39:02.696599+0000","last_clean":"2023-12-19T05:39:02.696599+0000","last_became_active":"2023-12-19T05:39:02.696310+0000","last_became_peered":"2023-12-19T05:39:02.696310+0000","last_unstale":"2023-12-19T05:39:02.696599+0000","last_undegraded":"2023-12-19T05:39:02.696599+0000","last_fullsized":"2023-12-19T05:39:02.696599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.694722+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:02.694722+0000","last_peered":"2023-12-19T05:39:02.694722+0000","last_clean":"2023-12-19T05:39:02.694722+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:02.694722+0000","last_undegraded":"2023-12-19T05:39:02.694722+0000","last_fullsized":"2023-12-19T05:39:02.694722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689437+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.689437+0000","last_peered":"2023-12-19T05:39:02.689437+0000","last_clean":"2023-12-19T05:39:02.689437+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.689437+0000","last_undegraded":"2023-12-19T05:39:02.689437+0000","last_fullsized":"2023-12-19T05:39:02.689437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711648+0000","last_change":"2023-12-19T05:39:02.711546+0000","last_active":"2023-12-19T05:39:02.711648+0000","last_peered":"2023-12-19T05:39:02.711648+0000","last_clean":"2023-12-19T05:39:02.711648+0000","last_became_active":"2023-12-19T05:39:02.709082+0000","last_became_peered":"2023-12-19T05:39:02.709082+0000","last_unstale":"2023-12-19T05:39:02.711648+0000","last_undegraded":"2023-12-19T05:39:02.711648+0000","last_fullsized":"2023-12-19T05:39:02.711648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691936+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.691936+0000","last_peered":"2023-12-19T05:39:02.691936+0000","last_clean":"2023-12-19T05:39:02.691936+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.691936+0000","last_undegraded":"2023-12-19T05:39:02.691936+0000","last_fullsized":"2023-12-19T05:39:02.691936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719756+0000","last_change":"2023-12-19T05:39:02.718299+0000","last_active":"2023-12-19T05:39:02.719756+0000","last_peered":"2023-12-19T05:39:02.719756+0000","last_clean":"2023-12-19T05:39:02.719756+0000","last_became_active":"2023-12-19T05:39:02.717475+0000","last_became_peered":"2023-12-19T05:39:02.717475+0000","last_unstale":"2023-12-19T05:39:02.719756+0000","last_undegraded":"2023-12-19T05:39:02.719756+0000","last_fullsized":"2023-12-19T05:39:02.719756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701132+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.701132+0000","last_peered":"2023-12-19T05:39:02.701132+0000","last_clean":"2023-12-19T05:39:02.701132+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.701132+0000","last_undegraded":"2023-12-19T05:39:02.701132+0000","last_fullsized":"2023-12-19T05:39:02.701132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711884+0000","last_change":"2023-12-19T05:39:02.711808+0000","last_active":"2023-12-19T05:39:02.711884+0000","last_peered":"2023-12-19T05:39:02.711884+0000","last_clean":"2023-12-19T05:39:02.711884+0000","last_became_active":"2023-12-19T05:39:02.710838+0000","last_became_peered":"2023-12-19T05:39:02.710838+0000","last_unstale":"2023-12-19T05:39:02.711884+0000","last_undegraded":"2023-12-19T05:39:02.711884+0000","last_fullsized":"2023-12-19T05:39:02.711884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.690768+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.690768+0000","last_peered":"2023-12-19T05:39:02.690768+0000","last_clean":"2023-12-19T05:39:02.690768+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.690768+0000","last_undegraded":"2023-12-19T05:39:02.690768+0000","last_fullsized":"2023-12-19T05:39:02.690768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713171+0000","last_change":"2023-12-19T05:39:02.712999+0000","last_active":"2023-12-19T05:39:02.713171+0000","last_peered":"2023-12-19T05:39:02.713171+0000","last_clean":"2023-12-19T05:39:02.713171+0000","last_became_active":"2023-12-19T05:39:02.712612+0000","last_became_peered":"2023-12-19T05:39:02.712612+0000","last_unstale":"2023-12-19T05:39:02.713171+0000","last_undegraded":"2023-12-19T05:39:02.713171+0000","last_fullsized":"2023-12-19T05:39:02.713171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700616+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.700616+0000","last_peered":"2023-12-19T05:39:02.700616+0000","last_clean":"2023-12-19T05:39:02.700616+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.700616+0000","last_undegraded":"2023-12-19T05:39:02.700616+0000","last_fullsized":"2023-12-19T05:39:02.700616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721066+0000","last_change":"2023-12-19T05:39:02.719234+0000","last_active":"2023-12-19T05:39:02.721066+0000","last_peered":"2023-12-19T05:39:02.721066+0000","last_clean":"2023-12-19T05:39:02.721066+0000","last_became_active":"2023-12-19T05:39:02.718998+0000","last_became_peered":"2023-12-19T05:39:02.718998+0000","last_unstale":"2023-12-19T05:39:02.721066+0000","last_undegraded":"2023-12-19T05:39:02.721066+0000","last_fullsized":"2023-12-19T05:39:02.721066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691685+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.691685+0000","last_peered":"2023-12-19T05:39:02.691685+0000","last_clean":"2023-12-19T05:39:02.691685+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.691685+0000","last_undegraded":"2023-12-19T05:39:02.691685+0000","last_fullsized":"2023-12-19T05:39:02.691685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.725731+0000","last_change":"2023-12-19T05:39:02.725655+0000","last_active":"2023-12-19T05:39:02.725731+0000","last_peered":"2023-12-19T05:39:02.725731+0000","last_clean":"2023-12-19T05:39:02.725731+0000","last_became_active":"2023-12-19T05:39:02.725276+0000","last_became_peered":"2023-12-19T05:39:02.725276+0000","last_unstale":"2023-12-19T05:39:02.725731+0000","last_undegraded":"2023-12-19T05:39:02.725731+0000","last_fullsized":"2023-12-19T05:39:02.725731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703423+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:02.703423+0000","last_peered":"2023-12-19T05:39:02.703423+0000","last_clean":"2023-12-19T05:39:02.703423+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:02.703423+0000","last_undegraded":"2023-12-19T05:39:02.703423+0000","last_fullsized":"2023-12-19T05:39:02.703423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720870+0000","last_change":"2023-12-19T05:39:02.719751+0000","last_active":"2023-12-19T05:39:02.720870+0000","last_peered":"2023-12-19T05:39:02.720870+0000","last_clean":"2023-12-19T05:39:02.720870+0000","last_became_active":"2023-12-19T05:39:02.719489+0000","last_became_peered":"2023-12-19T05:39:02.719489+0000","last_unstale":"2023-12-19T05:39:02.720870+0000","last_undegraded":"2023-12-19T05:39:02.720870+0000","last_fullsized":"2023-12-19T05:39:02.720870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721695+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.721695+0000","last_peered":"2023-12-19T05:39:02.721695+0000","last_clean":"2023-12-19T05:39:02.721695+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.721695+0000","last_undegraded":"2023-12-19T05:39:02.721695+0000","last_fullsized":"2023-12-19T05:39:02.721695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719332+0000","last_change":"2023-12-19T05:39:02.719256+0000","last_active":"2023-12-19T05:39:02.719332+0000","last_peered":"2023-12-19T05:39:02.719332+0000","last_clean":"2023-12-19T05:39:02.719332+0000","last_became_active":"2023-12-19T05:39:02.718985+0000","last_became_peered":"2023-12-19T05:39:02.718985+0000","last_unstale":"2023-12-19T05:39:02.719332+0000","last_undegraded":"2023-12-19T05:39:02.719332+0000","last_fullsized":"2023-12-19T05:39:02.719332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700486+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.700486+0000","last_peered":"2023-12-19T05:39:02.700486+0000","last_clean":"2023-12-19T05:39:02.700486+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.700486+0000","last_undegraded":"2023-12-19T05:39:02.700486+0000","last_fullsized":"2023-12-19T05:39:02.700486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.697089+0000","last_change":"2023-12-19T05:39:02.696856+0000","last_active":"2023-12-19T05:39:02.697089+0000","last_peered":"2023-12-19T05:39:02.697089+0000","last_clean":"2023-12-19T05:39:02.697089+0000","last_became_active":"2023-12-19T05:39:02.696670+0000","last_became_peered":"2023-12-19T05:39:02.696670+0000","last_unstale":"2023-12-19T05:39:02.697089+0000","last_undegraded":"2023-12-19T05:39:02.697089+0000","last_fullsized":"2023-12-19T05:39:02.697089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695338+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.695338+0000","last_peered":"2023-12-19T05:39:02.695338+0000","last_clean":"2023-12-19T05:39:02.695338+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.695338+0000","last_undegraded":"2023-12-19T05:39:02.695338+0000","last_fullsized":"2023-12-19T05:39:02.695338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715781+0000","last_change":"2023-12-19T05:39:02.715604+0000","last_active":"2023-12-19T05:39:02.715781+0000","last_peered":"2023-12-19T05:39:02.715781+0000","last_clean":"2023-12-19T05:39:02.715781+0000","last_became_active":"2023-12-19T05:39:02.715340+0000","last_became_peered":"2023-12-19T05:39:02.715340+0000","last_unstale":"2023-12-19T05:39:02.715781+0000","last_undegraded":"2023-12-19T05:39:02.715781+0000","last_fullsized":"2023-12-19T05:39:02.715781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.714039+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.714039+0000","last_peered":"2023-12-19T05:39:02.714039+0000","last_clean":"2023-12-19T05:39:02.714039+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.714039+0000","last_undegraded":"2023-12-19T05:39:02.714039+0000","last_fullsized":"2023-12-19T05:39:02.714039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719903+0000","last_change":"2023-12-19T05:39:02.719822+0000","last_active":"2023-12-19T05:39:02.719903+0000","last_peered":"2023-12-19T05:39:02.719903+0000","last_clean":"2023-12-19T05:39:02.719903+0000","last_became_active":"2023-12-19T05:39:02.719603+0000","last_became_peered":"2023-12-19T05:39:02.719603+0000","last_unstale":"2023-12-19T05:39:02.719903+0000","last_undegraded":"2023-12-19T05:39:02.719903+0000","last_fullsized":"2023-12-19T05:39:02.719903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722064+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.722064+0000","last_peered":"2023-12-19T05:39:02.722064+0000","last_clean":"2023-12-19T05:39:02.722064+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.722064+0000","last_undegraded":"2023-12-19T05:39:02.722064+0000","last_fullsized":"2023-12-19T05:39:02.722064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.698331+0000","last_change":"2023-12-19T05:39:02.698107+0000","last_active":"2023-12-19T05:39:02.698331+0000","last_peered":"2023-12-19T05:39:02.698331+0000","last_clean":"2023-12-19T05:39:02.698331+0000","last_became_active":"2023-12-19T05:39:02.696242+0000","last_became_peered":"2023-12-19T05:39:02.696242+0000","last_unstale":"2023-12-19T05:39:02.698331+0000","last_undegraded":"2023-12-19T05:39:02.698331+0000","last_fullsized":"2023-12-19T05:39:02.698331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709142+0000","last_change":"2023-12-19T05:39:02.709072+0000","last_active":"2023-12-19T05:39:02.709142+0000","last_peered":"2023-12-19T05:39:02.709142+0000","last_clean":"2023-12-19T05:39:02.709142+0000","last_became_active":"2023-12-19T05:39:02.708202+0000","last_became_peered":"2023-12-19T05:39:02.708202+0000","last_unstale":"2023-12-19T05:39:02.709142+0000","last_undegraded":"2023-12-19T05:39:02.709142+0000","last_fullsized":"2023-12-19T05:39:02.709142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713469+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.713469+0000","last_peered":"2023-12-19T05:39:02.713469+0000","last_clean":"2023-12-19T05:39:02.713469+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.713469+0000","last_undegraded":"2023-12-19T05:39:02.713469+0000","last_fullsized":"2023-12-19T05:39:02.713469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707208+0000","last_change":"2023-12-19T05:39:02.706972+0000","last_active":"2023-12-19T05:39:02.707208+0000","last_peered":"2023-12-19T05:39:02.707208+0000","last_clean":"2023-12-19T05:39:02.707208+0000","last_became_active":"2023-12-19T05:39:02.702711+0000","last_became_peered":"2023-12-19T05:39:02.702711+0000","last_unstale":"2023-12-19T05:39:02.707208+0000","last_undegraded":"2023-12-19T05:39:02.707208+0000","last_fullsized":"2023-12-19T05:39:02.707208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713207+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.713207+0000","last_peered":"2023-12-19T05:39:02.713207+0000","last_clean":"2023-12-19T05:39:02.713207+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.713207+0000","last_undegraded":"2023-12-19T05:39:02.713207+0000","last_fullsized":"2023-12-19T05:39:02.713207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718496+0000","last_change":"2023-12-19T05:39:02.714964+0000","last_active":"2023-12-19T05:39:02.718496+0000","last_peered":"2023-12-19T05:39:02.718496+0000","last_clean":"2023-12-19T05:39:02.718496+0000","last_became_active":"2023-12-19T05:39:02.713835+0000","last_became_peered":"2023-12-19T05:39:02.713835+0000","last_unstale":"2023-12-19T05:39:02.718496+0000","last_undegraded":"2023-12-19T05:39:02.718496+0000","last_fullsized":"2023-12-19T05:39:02.718496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726982+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.726982+0000","last_peered":"2023-12-19T05:39:02.726982+0000","last_clean":"2023-12-19T05:39:02.726982+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.726982+0000","last_undegraded":"2023-12-19T05:39:02.726982+0000","last_fullsized":"2023-12-19T05:39:02.726982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718442+0000","last_change":"2023-12-19T05:39:02.714203+0000","last_active":"2023-12-19T05:39:02.718442+0000","last_peered":"2023-12-19T05:39:02.718442+0000","last_clean":"2023-12-19T05:39:02.718442+0000","last_became_active":"2023-12-19T05:39:02.713955+0000","last_became_peered":"2023-12-19T05:39:02.713955+0000","last_unstale":"2023-12-19T05:39:02.718442+0000","last_undegraded":"2023-12-19T05:39:02.718442+0000","last_fullsized":"2023-12-19T05:39:02.718442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727404+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.727404+0000","last_peered":"2023-12-19T05:39:02.727404+0000","last_clean":"2023-12-19T05:39:02.727404+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.727404+0000","last_undegraded":"2023-12-19T05:39:02.727404+0000","last_fullsized":"2023-12-19T05:39:02.727404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:08.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T05:39:09.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.004+0000 7f1530dd0640 1 Processor -- start 2023-12-19T05:39:09.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.004+0000 7f1530dd0640 1 -- start start 2023-12-19T05:39:09.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1530dd0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c157bf0 0x7f152c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1530dd0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f152c0ae110 0x7f152c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1530dd0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0b0a90 con 0x7f152c0b0640 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1530dd0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c06b8c0 con 0x7f152c0ae110 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1530dd0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c15b740 con 0x7f152c157bf0 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.005+0000 7f1523fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f152c0ae110 0x7f152c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f152c0ae110 0x7f152c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54852/0 (socket says 172.21.15.49:54852) 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 -- 172.21.15.49:0/4071078358 learned_addr learned my addr 172.21.15.49:0/4071078358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f152a59c640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c157bf0 0x7f152c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 -- 172.21.15.49:0/4071078358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c157bf0 msgr2=0x7f152c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c157bf0 0x7f152c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 -- 172.21.15.49:0/4071078358 >> v1:172.21.15.115:6789/0 conn(0x7f152c0b0640 legacy=0x7f152c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.006+0000 7f1523fff640 1 -- 172.21.15.49:0/4071078358 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0ae640 con 0x7f152c0ae110 2023-12-19T05:39:09.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.008+0000 7f1523fff640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0ae110 0x7f152c0b0100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1514009870 tx=0x7f151402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d9a7d889d0af3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.008+0000 7f1529d9b640 1 -- 172.21.15.49:0/4071078358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514030840 con 0x7f152c0ae110 2023-12-19T05:39:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.008+0000 7f1529d9b640 1 -- 172.21.15.49:0/4071078358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15140309a0 con 0x7f152c0ae110 2023-12-19T05:39:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.008+0000 7f1529d9b640 1 -- 172.21.15.49:0/4071078358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514030d30 con 0x7f152c0ae110 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 -- 172.21.15.49:0/4071078358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0ae110 msgr2=0x7f152c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0ae110 0x7f152c0b0100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1514009870 tx=0x7f151402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 -- 172.21.15.49:0/4071078358 shutdown_connections 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0ae110 0x7f152c0b0100 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 --2- 172.21.15.49:0/4071078358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c157bf0 0x7f152c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 -- 172.21.15.49:0/4071078358 >> 172.21.15.49:0/4071078358 conn(0x7f152c0cbb70 msgr2=0x7f152c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 -- 172.21.15.49:0/4071078358 shutdown_connections 2023-12-19T05:39:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.009+0000 7f1530dd0640 1 -- 172.21.15.49:0/4071078358 wait complete. 2023-12-19T05:39:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.011+0000 7f1530dd0640 1 Processor -- start 2023-12-19T05:39:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.011+0000 7f1530dd0640 1 -- start start 2023-12-19T05:39:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c0ae110 0x7f152c0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f152c157bf0 0x7f152c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0ccf20 con 0x7f152c0b0640 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0abde0 con 0x7f152c157bf0 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1530dd0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0ac0c0 con 0x7f152c0ae110 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1523fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1523fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54854/0 (socket says 172.21.15.49:54854) 2023-12-19T05:39:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.012+0000 7f1523fff640 1 -- 172.21.15.49:0/763206111 learned_addr learned my addr 172.21.15.49:0/763206111 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f152a59c640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c0ae110 0x7f152c0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f152ad9d640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f152c157bf0 0x7f152c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 -- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c0ae110 msgr2=0x7f152c0ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c0ae110 0x7f152c0ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 -- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f152c157bf0 msgr2=0x7f152c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f152c157bf0 0x7f152c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 -- 172.21.15.49:0/763206111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140094d0 con 0x7f152c0b0640 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.013+0000 7f1523fff640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15140090b0 tx=0x7f1514004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.014+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514047070 con 0x7f152c0b0640 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.014+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514039b50 con 0x7f152c0b0640 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.014+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514043400 con 0x7f152c0b0640 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.014+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0ac3a0 con 0x7f152c0b0640 2023-12-19T05:39:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.014+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0ac960 con 0x7f152c0b0640 2023-12-19T05:39:09.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.015+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c061910 con 0x7f152c0b0640 2023-12-19T05:39:09.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.016+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1514043560 con 0x7f152c0b0640 2023-12-19T05:39:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.017+0000 7f1522ffd640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 0x7f150c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.017+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f151403e070 con 0x7f152c0b0640 2023-12-19T05:39:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.018+0000 7f152a59c640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 0x7f150c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.018+0000 7f152a59c640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 0x7f150c06c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f151c006fd0 tx=0x7f151c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.021+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1514076780 con 0x7f152c0b0640 2023-12-19T05:39:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.291+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f152c15b300 con 0x7f152c0b0640 2023-12-19T05:39:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.292+0000 7f1522ffd640 1 -- 172.21.15.49:0/763206111 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1004 (secure 0 0 0) 0x7f1514079da0 con 0x7f152c0b0640 2023-12-19T05:39:09.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:09.294 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1702964331,"num_in_osds":8,"osd_in_since":1702964328,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":1751364,"bytes_avail":1598248636,"bytes_total":1600000000,"write_bytes_sec":2266,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4291}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-19T05:38:45.395894+0000","services":{}},"progress_events":{}} 2023-12-19T05:39:09.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 msgr2=0x7f150c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 0x7f150c06c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f151c006fd0 tx=0x7f151c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:09.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 msgr2=0x7f152c152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15140090b0 tx=0x7f1514004730 comp rx=0 tx=0).stop 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 shutdown_connections 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f150c06a460 0x7f150c06c920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f152c157bf0 0x7f152c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f152c0b0640 0x7f152c152fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 --2- 172.21.15.49:0/763206111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f152c0ae110 0x7f152c0ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.295+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 >> 172.21.15.49:0/763206111 conn(0x7f152c0cbb70 msgr2=0x7f152c155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.296+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 shutdown_connections 2023-12-19T05:39:09.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.296+0000 7f1530dd0640 1 -- 172.21.15.49:0/763206111 wait complete. 2023-12-19T05:39:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T05:39:09.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:09.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.543+0000 7f250ee25640 1 Processor -- start 2023-12-19T05:39:09.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.543+0000 7f250ee25640 1 -- start start 2023-12-19T05:39:09.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250ee25640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f250815e5a0 0x7f25080b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250ee25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250ee25640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250815ec30 con 0x7f250815f680 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250ee25640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080ce5a0 con 0x7f250815e5a0 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250ee25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250815e980 con 0x7f25080cdbf0 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.545+0000 7f250de23640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f250815e5a0 0x7f25080b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f250815e5a0 0x7f25080b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54862/0 (socket says 172.21.15.49:54862) 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 -- 172.21.15.49:0/3929976141 learned_addr learned my addr 172.21.15.49:0/3929976141 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250e624640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 -- 172.21.15.49:0/3929976141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 msgr2=0x7f25080ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 -- 172.21.15.49:0/3929976141 >> v1:172.21.15.115:6789/0 conn(0x7f250815f680 legacy=0x7f25080b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.546+0000 7f250de23640 1 -- 172.21.15.49:0/3929976141 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080b2f90 con 0x7f250815e5a0 2023-12-19T05:39:09.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.548+0000 7f250de23640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25040098a0 tx=0x7f250402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66df9d982a85448 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.548+0000 7f250ce21640 1 -- 172.21.15.49:0/3929976141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504030840 con 0x7f250815e5a0 2023-12-19T05:39:09.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.548+0000 7f250ce21640 1 -- 172.21.15.49:0/3929976141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25040309a0 con 0x7f250815e5a0 2023-12-19T05:39:09.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.548+0000 7f250ce21640 1 -- 172.21.15.49:0/3929976141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504030d30 con 0x7f250815e5a0 2023-12-19T05:39:09.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 -- 172.21.15.49:0/3929976141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 msgr2=0x7f25080b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25040098a0 tx=0x7f250402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:09.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 -- 172.21.15.49:0/3929976141 shutdown_connections 2023-12-19T05:39:09.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 --2- 172.21.15.49:0/3929976141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 -- 172.21.15.49:0/3929976141 >> 172.21.15.49:0/3929976141 conn(0x7f25080b0100 msgr2=0x7f25080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 -- 172.21.15.49:0/3929976141 shutdown_connections 2023-12-19T05:39:09.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.549+0000 7f250ee25640 1 -- 172.21.15.49:0/3929976141 wait complete. 2023-12-19T05:39:09.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.552+0000 7f250ee25640 1 Processor -- start 2023-12-19T05:39:09.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.552+0000 7f250ee25640 1 -- start start 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250815f680 0x7f250806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080ada30 con 0x7f250815e5a0 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080a94f0 con 0x7f250815f680 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.553+0000 7f250ee25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080b2c70 con 0x7f25080cdbf0 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54876/0 (socket says 172.21.15.49:54876) 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 -- 172.21.15.49:0/2564644709 learned_addr learned my addr 172.21.15.49:0/2564644709 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250de23640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250e624640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250815f680 0x7f250806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 -- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 msgr2=0x7f25080ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 -- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250815f680 msgr2=0x7f250806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250815f680 0x7f250806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.554+0000 7f250d622640 1 -- 172.21.15.49:0/2564644709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040094d0 con 0x7f250815e5a0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f250d622640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c450 tx=0x7f24f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80052d0 con 0x7f250815e5a0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8005430 con 0x7f250815e5a0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8012870 con 0x7f250815e5a0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25080ae8c0 con 0x7f250815e5a0 2023-12-19T05:39:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.555+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25080aee80 con 0x7f250815e5a0 2023-12-19T05:39:09.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.556+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25080a9660 con 0x7f250815e5a0 2023-12-19T05:39:09.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.557+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f24f80129d0 con 0x7f250815e5a0 2023-12-19T05:39:09.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.559+0000 7f24fe7fc640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.559+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24f80883d0 con 0x7f250815e5a0 2023-12-19T05:39:09.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.559+0000 7f250de23640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.561+0000 7f250de23640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 0x7f24ec06c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2504036000 tx=0x7f2504008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.563+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25080a9660 con 0x7f250815e5a0 2023-12-19T05:39:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.757+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f250815ee80 con 0x7f24ec06a430 2023-12-19T05:39:09.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.777+0000 7f24fe7fc640 1 -- 172.21.15.49:0/2564644709 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260107 (secure 0 0 0) 0x7f2504030b90 con 0x7f24ec06a430 2023-12-19T05:39:09.783 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 msgr2=0x7f24ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 0x7f24ec06c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2504036000 tx=0x7f2504008030 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 msgr2=0x7f25080b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c450 tx=0x7f24f800c910 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 shutdown_connections 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250815f680 0x7f250806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f250815e5a0 0x7f25080b2730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 --2- 172.21.15.49:0/2564644709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080cdbf0 0x7f25080ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 >> 172.21.15.49:0/2564644709 conn(0x7f25080b0100 msgr2=0x7f250815af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 shutdown_connections 2023-12-19T05:39:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:09.782+0000 7f250ee25640 1 -- 172.21.15.49:0/2564644709 wait complete. 2023-12-19T05:39:09.801 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T05:39:08.500514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.325023"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717330+0000","last_change":"2023-12-19T05:39:02.717216+0000","last_active":"2023-12-19T05:39:02.717330+0000","last_peered":"2023-12-19T05:39:02.717330+0000","last_clean":"2023-12-19T05:39:02.717330+0000","last_became_active":"2023-12-19T05:39:02.716805+0000","last_became_peered":"2023-12-19T05:39:02.716805+0000","last_unstale":"2023-12-19T05:39:02.717330+0000","last_undegraded":"2023-12-19T05:39:02.717330+0000","last_fullsized":"2023-12-19T05:39:02.717330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723207+0000","last_change":"2023-12-19T05:39:02.720735+0000","last_active":"2023-12-19T05:39:02.723207+0000","last_peered":"2023-12-19T05:39:02.723207+0000","last_clean":"2023-12-19T05:39:02.723207+0000","last_became_active":"2023-12-19T05:39:02.720479+0000","last_became_peered":"2023-12-19T05:39:02.720479+0000","last_unstale":"2023-12-19T05:39:02.723207+0000","last_undegraded":"2023-12-19T05:39:02.723207+0000","last_fullsized":"2023-12-19T05:39:02.723207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718511+0000","last_change":"2023-12-19T05:39:02.715183+0000","last_active":"2023-12-19T05:39:02.718511+0000","last_peered":"2023-12-19T05:39:02.718511+0000","last_clean":"2023-12-19T05:39:02.718511+0000","last_became_active":"2023-12-19T05:39:02.714240+0000","last_became_peered":"2023-12-19T05:39:02.714240+0000","last_unstale":"2023-12-19T05:39:02.718511+0000","last_undegraded":"2023-12-19T05:39:02.718511+0000","last_fullsized":"2023-12-19T05:39:02.718511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711817+0000","last_change":"2023-12-19T05:39:02.710230+0000","last_active":"2023-12-19T05:39:02.711817+0000","last_peered":"2023-12-19T05:39:02.711817+0000","last_clean":"2023-12-19T05:39:02.711817+0000","last_became_active":"2023-12-19T05:39:02.710001+0000","last_became_peered":"2023-12-19T05:39:02.710001+0000","last_unstale":"2023-12-19T05:39:02.711817+0000","last_undegraded":"2023-12-19T05:39:02.711817+0000","last_fullsized":"2023-12-19T05:39:02.711817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718958+0000","last_change":"2023-12-19T05:39:02.718728+0000","last_active":"2023-12-19T05:39:02.718958+0000","last_peered":"2023-12-19T05:39:02.718958+0000","last_clean":"2023-12-19T05:39:02.718958+0000","last_became_active":"2023-12-19T05:39:02.718457+0000","last_became_peered":"2023-12-19T05:39:02.718457+0000","last_unstale":"2023-12-19T05:39:02.718958+0000","last_undegraded":"2023-12-19T05:39:02.718958+0000","last_fullsized":"2023-12-19T05:39:02.718958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711835+0000","last_change":"2023-12-19T05:39:02.710247+0000","last_active":"2023-12-19T05:39:02.711835+0000","last_peered":"2023-12-19T05:39:02.711835+0000","last_clean":"2023-12-19T05:39:02.711835+0000","last_became_active":"2023-12-19T05:39:02.710039+0000","last_became_peered":"2023-12-19T05:39:02.710039+0000","last_unstale":"2023-12-19T05:39:02.711835+0000","last_undegraded":"2023-12-19T05:39:02.711835+0000","last_fullsized":"2023-12-19T05:39:02.711835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716214+0000","last_change":"2023-12-19T05:39:02.716135+0000","last_active":"2023-12-19T05:39:02.716214+0000","last_peered":"2023-12-19T05:39:02.716214+0000","last_clean":"2023-12-19T05:39:02.716214+0000","last_became_active":"2023-12-19T05:39:02.715148+0000","last_became_peered":"2023-12-19T05:39:02.715148+0000","last_unstale":"2023-12-19T05:39:02.716214+0000","last_undegraded":"2023-12-19T05:39:02.716214+0000","last_fullsized":"2023-12-19T05:39:02.716214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723196+0000","last_change":"2023-12-19T05:39:02.720176+0000","last_active":"2023-12-19T05:39:02.723196+0000","last_peered":"2023-12-19T05:39:02.723196+0000","last_clean":"2023-12-19T05:39:02.723196+0000","last_became_active":"2023-12-19T05:39:02.719954+0000","last_became_peered":"2023-12-19T05:39:02.719954+0000","last_unstale":"2023-12-19T05:39:02.723196+0000","last_undegraded":"2023-12-19T05:39:02.723196+0000","last_fullsized":"2023-12-19T05:39:02.723196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700335+0000","last_change":"2023-12-19T05:39:02.700252+0000","last_active":"2023-12-19T05:39:02.700335+0000","last_peered":"2023-12-19T05:39:02.700335+0000","last_clean":"2023-12-19T05:39:02.700335+0000","last_became_active":"2023-12-19T05:39:02.699871+0000","last_became_peered":"2023-12-19T05:39:02.699871+0000","last_unstale":"2023-12-19T05:39:02.700335+0000","last_undegraded":"2023-12-19T05:39:02.700335+0000","last_fullsized":"2023-12-19T05:39:02.700335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709263+0000","last_change":"2023-12-19T05:39:02.708261+0000","last_active":"2023-12-19T05:39:02.709263+0000","last_peered":"2023-12-19T05:39:02.709263+0000","last_clean":"2023-12-19T05:39:02.709263+0000","last_became_active":"2023-12-19T05:39:02.707762+0000","last_became_peered":"2023-12-19T05:39:02.707762+0000","last_unstale":"2023-12-19T05:39:02.709263+0000","last_undegraded":"2023-12-19T05:39:02.709263+0000","last_fullsized":"2023-12-19T05:39:02.709263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717313+0000","last_change":"2023-12-19T05:39:02.717049+0000","last_active":"2023-12-19T05:39:02.717313+0000","last_peered":"2023-12-19T05:39:02.717313+0000","last_clean":"2023-12-19T05:39:02.717313+0000","last_became_active":"2023-12-19T05:39:02.716371+0000","last_became_peered":"2023-12-19T05:39:02.716371+0000","last_unstale":"2023-12-19T05:39:02.717313+0000","last_undegraded":"2023-12-19T05:39:02.717313+0000","last_fullsized":"2023-12-19T05:39:02.717313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707329+0000","last_change":"2023-12-19T05:39:02.707024+0000","last_active":"2023-12-19T05:39:02.707329+0000","last_peered":"2023-12-19T05:39:02.707329+0000","last_clean":"2023-12-19T05:39:02.707329+0000","last_became_active":"2023-12-19T05:39:02.706779+0000","last_became_peered":"2023-12-19T05:39:02.706779+0000","last_unstale":"2023-12-19T05:39:02.707329+0000","last_undegraded":"2023-12-19T05:39:02.707329+0000","last_fullsized":"2023-12-19T05:39:02.707329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719791+0000","last_change":"2023-12-19T05:39:02.718594+0000","last_active":"2023-12-19T05:39:02.719791+0000","last_peered":"2023-12-19T05:39:02.719791+0000","last_clean":"2023-12-19T05:39:02.719791+0000","last_became_active":"2023-12-19T05:39:02.717977+0000","last_became_peered":"2023-12-19T05:39:02.717977+0000","last_unstale":"2023-12-19T05:39:02.719791+0000","last_undegraded":"2023-12-19T05:39:02.719791+0000","last_fullsized":"2023-12-19T05:39:02.719791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719739+0000","last_change":"2023-12-19T05:39:02.718246+0000","last_active":"2023-12-19T05:39:02.719739+0000","last_peered":"2023-12-19T05:39:02.719739+0000","last_clean":"2023-12-19T05:39:02.719739+0000","last_became_active":"2023-12-19T05:39:02.716071+0000","last_became_peered":"2023-12-19T05:39:02.716071+0000","last_unstale":"2023-12-19T05:39:02.719739+0000","last_undegraded":"2023-12-19T05:39:02.719739+0000","last_fullsized":"2023-12-19T05:39:02.719739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718462+0000","last_change":"2023-12-19T05:39:02.714245+0000","last_active":"2023-12-19T05:39:02.718462+0000","last_peered":"2023-12-19T05:39:02.718462+0000","last_clean":"2023-12-19T05:39:02.718462+0000","last_became_active":"2023-12-19T05:39:02.713242+0000","last_became_peered":"2023-12-19T05:39:02.713242+0000","last_unstale":"2023-12-19T05:39:02.718462+0000","last_undegraded":"2023-12-19T05:39:02.718462+0000","last_fullsized":"2023-12-19T05:39:02.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709046+0000","last_change":"2023-12-19T05:39:02.708950+0000","last_active":"2023-12-19T05:39:02.709046+0000","last_peered":"2023-12-19T05:39:02.709046+0000","last_clean":"2023-12-19T05:39:02.709046+0000","last_became_active":"2023-12-19T05:39:02.708106+0000","last_became_peered":"2023-12-19T05:39:02.708106+0000","last_unstale":"2023-12-19T05:39:02.709046+0000","last_undegraded":"2023-12-19T05:39:02.709046+0000","last_fullsized":"2023-12-19T05:39:02.709046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706992+0000","last_change":"2023-12-19T05:39:02.706691+0000","last_active":"2023-12-19T05:39:02.706992+0000","last_peered":"2023-12-19T05:39:02.706992+0000","last_clean":"2023-12-19T05:39:02.706992+0000","last_became_active":"2023-12-19T05:39:02.706456+0000","last_became_peered":"2023-12-19T05:39:02.706456+0000","last_unstale":"2023-12-19T05:39:02.706992+0000","last_undegraded":"2023-12-19T05:39:02.706992+0000","last_fullsized":"2023-12-19T05:39:02.706992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716359+0000","last_change":"2023-12-19T05:39:02.713393+0000","last_active":"2023-12-19T05:39:02.716359+0000","last_peered":"2023-12-19T05:39:02.716359+0000","last_clean":"2023-12-19T05:39:02.716359+0000","last_became_active":"2023-12-19T05:39:02.713154+0000","last_became_peered":"2023-12-19T05:39:02.713154+0000","last_unstale":"2023-12-19T05:39:02.716359+0000","last_undegraded":"2023-12-19T05:39:02.716359+0000","last_fullsized":"2023-12-19T05:39:02.716359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701477+0000","last_change":"2023-12-19T05:39:02.700926+0000","last_active":"2023-12-19T05:39:02.701477+0000","last_peered":"2023-12-19T05:39:02.701477+0000","last_clean":"2023-12-19T05:39:02.701477+0000","last_became_active":"2023-12-19T05:39:02.697252+0000","last_became_peered":"2023-12-19T05:39:02.697252+0000","last_unstale":"2023-12-19T05:39:02.701477+0000","last_undegraded":"2023-12-19T05:39:02.701477+0000","last_fullsized":"2023-12-19T05:39:02.701477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709283+0000","last_change":"2023-12-19T05:39:02.708393+0000","last_active":"2023-12-19T05:39:02.709283+0000","last_peered":"2023-12-19T05:39:02.709283+0000","last_clean":"2023-12-19T05:39:02.709283+0000","last_became_active":"2023-12-19T05:39:02.708060+0000","last_became_peered":"2023-12-19T05:39:02.708060+0000","last_unstale":"2023-12-19T05:39:02.709283+0000","last_undegraded":"2023-12-19T05:39:02.709283+0000","last_fullsized":"2023-12-19T05:39:02.709283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711238+0000","last_change":"2023-12-19T05:39:02.710664+0000","last_active":"2023-12-19T05:39:02.711238+0000","last_peered":"2023-12-19T05:39:02.711238+0000","last_clean":"2023-12-19T05:39:02.711238+0000","last_became_active":"2023-12-19T05:39:02.710462+0000","last_became_peered":"2023-12-19T05:39:02.710462+0000","last_unstale":"2023-12-19T05:39:02.711238+0000","last_undegraded":"2023-12-19T05:39:02.711238+0000","last_fullsized":"2023-12-19T05:39:02.711238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707454+0000","last_change":"2023-12-19T05:39:02.706412+0000","last_active":"2023-12-19T05:39:02.707454+0000","last_peered":"2023-12-19T05:39:02.707454+0000","last_clean":"2023-12-19T05:39:02.707454+0000","last_became_active":"2023-12-19T05:39:02.706148+0000","last_became_peered":"2023-12-19T05:39:02.706148+0000","last_unstale":"2023-12-19T05:39:02.707454+0000","last_undegraded":"2023-12-19T05:39:02.707454+0000","last_fullsized":"2023-12-19T05:39:02.707454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718533+0000","last_change":"2023-12-19T05:39:02.715320+0000","last_active":"2023-12-19T05:39:02.718533+0000","last_peered":"2023-12-19T05:39:02.718533+0000","last_clean":"2023-12-19T05:39:02.718533+0000","last_became_active":"2023-12-19T05:39:02.714719+0000","last_became_peered":"2023-12-19T05:39:02.714719+0000","last_unstale":"2023-12-19T05:39:02.718533+0000","last_undegraded":"2023-12-19T05:39:02.718533+0000","last_fullsized":"2023-12-19T05:39:02.718533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715762+0000","last_change":"2023-12-19T05:39:02.715586+0000","last_active":"2023-12-19T05:39:02.715762+0000","last_peered":"2023-12-19T05:39:02.715762+0000","last_clean":"2023-12-19T05:39:02.715762+0000","last_became_active":"2023-12-19T05:39:02.715221+0000","last_became_peered":"2023-12-19T05:39:02.715221+0000","last_unstale":"2023-12-19T05:39:02.715762+0000","last_undegraded":"2023-12-19T05:39:02.715762+0000","last_fullsized":"2023-12-19T05:39:02.715762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718480+0000","last_change":"2023-12-19T05:39:02.714373+0000","last_active":"2023-12-19T05:39:02.718480+0000","last_peered":"2023-12-19T05:39:02.718480+0000","last_clean":"2023-12-19T05:39:02.718480+0000","last_became_active":"2023-12-19T05:39:02.713629+0000","last_became_peered":"2023-12-19T05:39:02.713629+0000","last_unstale":"2023-12-19T05:39:02.718480+0000","last_undegraded":"2023-12-19T05:39:02.718480+0000","last_fullsized":"2023-12-19T05:39:02.718480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713382+0000","last_change":"2023-12-19T05:39:02.713317+0000","last_active":"2023-12-19T05:39:02.713382+0000","last_peered":"2023-12-19T05:39:02.713382+0000","last_clean":"2023-12-19T05:39:02.713382+0000","last_became_active":"2023-12-19T05:39:02.712971+0000","last_became_peered":"2023-12-19T05:39:02.712971+0000","last_unstale":"2023-12-19T05:39:02.713382+0000","last_undegraded":"2023-12-19T05:39:02.713382+0000","last_fullsized":"2023-12-19T05:39:02.713382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720145+0000","last_change":"2023-12-19T05:39:02.719977+0000","last_active":"2023-12-19T05:39:02.720145+0000","last_peered":"2023-12-19T05:39:02.720145+0000","last_clean":"2023-12-19T05:39:02.720145+0000","last_became_active":"2023-12-19T05:39:02.719748+0000","last_became_peered":"2023-12-19T05:39:02.719748+0000","last_unstale":"2023-12-19T05:39:02.720145+0000","last_undegraded":"2023-12-19T05:39:02.720145+0000","last_fullsized":"2023-12-19T05:39:02.720145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719772+0000","last_change":"2023-12-19T05:39:02.718445+0000","last_active":"2023-12-19T05:39:02.719772+0000","last_peered":"2023-12-19T05:39:02.719772+0000","last_clean":"2023-12-19T05:39:02.719772+0000","last_became_active":"2023-12-19T05:39:02.717751+0000","last_became_peered":"2023-12-19T05:39:02.717751+0000","last_unstale":"2023-12-19T05:39:02.719772+0000","last_undegraded":"2023-12-19T05:39:02.719772+0000","last_fullsized":"2023-12-19T05:39:02.719772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713710+0000","last_change":"2023-12-19T05:39:02.711952+0000","last_active":"2023-12-19T05:39:02.713710+0000","last_peered":"2023-12-19T05:39:02.713710+0000","last_clean":"2023-12-19T05:39:02.713710+0000","last_became_active":"2023-12-19T05:39:02.711582+0000","last_became_peered":"2023-12-19T05:39:02.711582+0000","last_unstale":"2023-12-19T05:39:02.713710+0000","last_undegraded":"2023-12-19T05:39:02.713710+0000","last_fullsized":"2023-12-19T05:39:02.713710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713984+0000","last_change":"2023-12-19T05:39:02.713881+0000","last_active":"2023-12-19T05:39:02.713984+0000","last_peered":"2023-12-19T05:39:02.713984+0000","last_clean":"2023-12-19T05:39:02.713984+0000","last_became_active":"2023-12-19T05:39:02.708835+0000","last_became_peered":"2023-12-19T05:39:02.708835+0000","last_unstale":"2023-12-19T05:39:02.713984+0000","last_undegraded":"2023-12-19T05:39:02.713984+0000","last_fullsized":"2023-12-19T05:39:02.713984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.708630+0000","last_change":"2023-12-19T05:39:02.708098+0000","last_active":"2023-12-19T05:39:02.708630+0000","last_peered":"2023-12-19T05:39:02.708630+0000","last_clean":"2023-12-19T05:39:02.708630+0000","last_became_active":"2023-12-19T05:39:02.707804+0000","last_became_peered":"2023-12-19T05:39:02.707804+0000","last_unstale":"2023-12-19T05:39:02.708630+0000","last_undegraded":"2023-12-19T05:39:02.708630+0000","last_fullsized":"2023-12-19T05:39:02.708630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721098+0000","last_change":"2023-12-19T05:39:02.720287+0000","last_active":"2023-12-19T05:39:02.721098+0000","last_peered":"2023-12-19T05:39:02.721098+0000","last_clean":"2023-12-19T05:39:02.721098+0000","last_became_active":"2023-12-19T05:39:02.720075+0000","last_became_peered":"2023-12-19T05:39:02.720075+0000","last_unstale":"2023-12-19T05:39:02.721098+0000","last_undegraded":"2023-12-19T05:39:02.721098+0000","last_fullsized":"2023-12-19T05:39:02.721098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719684+0000","last_change":"2023-12-19T05:39:02.719563+0000","last_active":"2023-12-19T05:39:02.719684+0000","last_peered":"2023-12-19T05:39:02.719684+0000","last_clean":"2023-12-19T05:39:02.719684+0000","last_became_active":"2023-12-19T05:39:02.719114+0000","last_became_peered":"2023-12-19T05:39:02.719114+0000","last_unstale":"2023-12-19T05:39:02.719684+0000","last_undegraded":"2023-12-19T05:39:02.719684+0000","last_fullsized":"2023-12-19T05:39:02.719684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727216+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.727216+0000","last_peered":"2023-12-19T05:39:02.727216+0000","last_clean":"2023-12-19T05:39:02.727216+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.727216+0000","last_undegraded":"2023-12-19T05:39:02.727216+0000","last_fullsized":"2023-12-19T05:39:02.727216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711786+0000","last_change":"2023-12-19T05:39:02.711723+0000","last_active":"2023-12-19T05:39:02.711786+0000","last_peered":"2023-12-19T05:39:02.711786+0000","last_clean":"2023-12-19T05:39:02.711786+0000","last_became_active":"2023-12-19T05:39:02.709817+0000","last_became_peered":"2023-12-19T05:39:02.709817+0000","last_unstale":"2023-12-19T05:39:02.711786+0000","last_undegraded":"2023-12-19T05:39:02.711786+0000","last_fullsized":"2023-12-19T05:39:02.711786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722219+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.722219+0000","last_peered":"2023-12-19T05:39:02.722219+0000","last_clean":"2023-12-19T05:39:02.722219+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.722219+0000","last_undegraded":"2023-12-19T05:39:02.722219+0000","last_fullsized":"2023-12-19T05:39:02.722219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713569+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.713569+0000","last_peered":"2023-12-19T05:39:02.713569+0000","last_clean":"2023-12-19T05:39:02.713569+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.713569+0000","last_undegraded":"2023-12-19T05:39:02.713569+0000","last_fullsized":"2023-12-19T05:39:02.713569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723073+0000","last_change":"2023-12-19T05:39:02.719393+0000","last_active":"2023-12-19T05:39:02.723073+0000","last_peered":"2023-12-19T05:39:02.723073+0000","last_clean":"2023-12-19T05:39:02.723073+0000","last_became_active":"2023-12-19T05:39:02.719080+0000","last_became_peered":"2023-12-19T05:39:02.719080+0000","last_unstale":"2023-12-19T05:39:02.723073+0000","last_undegraded":"2023-12-19T05:39:02.723073+0000","last_fullsized":"2023-12-19T05:39:02.723073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691632+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.691632+0000","last_peered":"2023-12-19T05:39:02.691632+0000","last_clean":"2023-12-19T05:39:02.691632+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.691632+0000","last_undegraded":"2023-12-19T05:39:02.691632+0000","last_fullsized":"2023-12-19T05:39:02.691632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706164+0000","last_change":"2023-12-19T05:39:02.697790+0000","last_active":"2023-12-19T05:39:02.706164+0000","last_peered":"2023-12-19T05:39:02.706164+0000","last_clean":"2023-12-19T05:39:02.706164+0000","last_became_active":"2023-12-19T05:39:02.697516+0000","last_became_peered":"2023-12-19T05:39:02.697516+0000","last_unstale":"2023-12-19T05:39:02.706164+0000","last_undegraded":"2023-12-19T05:39:02.706164+0000","last_fullsized":"2023-12-19T05:39:02.706164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695035+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.695035+0000","last_peered":"2023-12-19T05:39:02.695035+0000","last_clean":"2023-12-19T05:39:02.695035+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.695035+0000","last_undegraded":"2023-12-19T05:39:02.695035+0000","last_fullsized":"2023-12-19T05:39:02.695035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711851+0000","last_change":"2023-12-19T05:39:02.711262+0000","last_active":"2023-12-19T05:39:02.711851+0000","last_peered":"2023-12-19T05:39:02.711851+0000","last_clean":"2023-12-19T05:39:02.711851+0000","last_became_active":"2023-12-19T05:39:02.710878+0000","last_became_peered":"2023-12-19T05:39:02.710878+0000","last_unstale":"2023-12-19T05:39:02.711851+0000","last_undegraded":"2023-12-19T05:39:02.711851+0000","last_fullsized":"2023-12-19T05:39:02.711851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.702914+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.702914+0000","last_peered":"2023-12-19T05:39:02.702914+0000","last_clean":"2023-12-19T05:39:02.702914+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.702914+0000","last_undegraded":"2023-12-19T05:39:02.702914+0000","last_fullsized":"2023-12-19T05:39:02.702914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.704026+0000","last_change":"2023-12-19T05:39:02.703882+0000","last_active":"2023-12-19T05:39:02.704026+0000","last_peered":"2023-12-19T05:39:02.704026+0000","last_clean":"2023-12-19T05:39:02.704026+0000","last_became_active":"2023-12-19T05:39:02.703208+0000","last_became_peered":"2023-12-19T05:39:02.703208+0000","last_unstale":"2023-12-19T05:39:02.704026+0000","last_undegraded":"2023-12-19T05:39:02.704026+0000","last_fullsized":"2023-12-19T05:39:02.704026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719259+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.719259+0000","last_peered":"2023-12-19T05:39:02.719259+0000","last_clean":"2023-12-19T05:39:02.719259+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.719259+0000","last_undegraded":"2023-12-19T05:39:02.719259+0000","last_fullsized":"2023-12-19T05:39:02.719259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715569+0000","last_change":"2023-12-19T05:39:02.715445+0000","last_active":"2023-12-19T05:39:02.715569+0000","last_peered":"2023-12-19T05:39:02.715569+0000","last_clean":"2023-12-19T05:39:02.715569+0000","last_became_active":"2023-12-19T05:39:02.714901+0000","last_became_peered":"2023-12-19T05:39:02.714901+0000","last_unstale":"2023-12-19T05:39:02.715569+0000","last_undegraded":"2023-12-19T05:39:02.715569+0000","last_fullsized":"2023-12-19T05:39:02.715569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.728240+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.728240+0000","last_peered":"2023-12-19T05:39:02.728240+0000","last_clean":"2023-12-19T05:39:02.728240+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.728240+0000","last_undegraded":"2023-12-19T05:39:02.728240+0000","last_fullsized":"2023-12-19T05:39:02.728240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720718+0000","last_change":"2023-12-19T05:39:02.720607+0000","last_active":"2023-12-19T05:39:02.720718+0000","last_peered":"2023-12-19T05:39:02.720718+0000","last_clean":"2023-12-19T05:39:02.720718+0000","last_became_active":"2023-12-19T05:39:02.720203+0000","last_became_peered":"2023-12-19T05:39:02.720203+0000","last_unstale":"2023-12-19T05:39:02.720718+0000","last_undegraded":"2023-12-19T05:39:02.720718+0000","last_fullsized":"2023-12-19T05:39:02.720718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716893+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.716893+0000","last_peered":"2023-12-19T05:39:02.716893+0000","last_clean":"2023-12-19T05:39:02.716893+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.716893+0000","last_undegraded":"2023-12-19T05:39:02.716893+0000","last_fullsized":"2023-12-19T05:39:02.716893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719719+0000","last_change":"2023-12-19T05:39:02.717923+0000","last_active":"2023-12-19T05:39:02.719719+0000","last_peered":"2023-12-19T05:39:02.719719+0000","last_clean":"2023-12-19T05:39:02.719719+0000","last_became_active":"2023-12-19T05:39:02.717316+0000","last_became_peered":"2023-12-19T05:39:02.717316+0000","last_unstale":"2023-12-19T05:39:02.719719+0000","last_undegraded":"2023-12-19T05:39:02.719719+0000","last_fullsized":"2023-12-19T05:39:02.719719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689096+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.689096+0000","last_peered":"2023-12-19T05:39:02.689096+0000","last_clean":"2023-12-19T05:39:02.689096+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.689096+0000","last_undegraded":"2023-12-19T05:39:02.689096+0000","last_fullsized":"2023-12-19T05:39:02.689096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713759+0000","last_change":"2023-12-19T05:39:02.713659+0000","last_active":"2023-12-19T05:39:02.713759+0000","last_peered":"2023-12-19T05:39:02.713759+0000","last_clean":"2023-12-19T05:39:02.713759+0000","last_became_active":"2023-12-19T05:39:02.708530+0000","last_became_peered":"2023-12-19T05:39:02.708530+0000","last_unstale":"2023-12-19T05:39:02.713759+0000","last_undegraded":"2023-12-19T05:39:02.713759+0000","last_fullsized":"2023-12-19T05:39:02.713759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703018+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.703018+0000","last_peered":"2023-12-19T05:39:02.703018+0000","last_clean":"2023-12-19T05:39:02.703018+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.703018+0000","last_undegraded":"2023-12-19T05:39:02.703018+0000","last_fullsized":"2023-12-19T05:39:02.703018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719504+0000","last_change":"2023-12-19T05:39:02.719423+0000","last_active":"2023-12-19T05:39:02.719504+0000","last_peered":"2023-12-19T05:39:02.719504+0000","last_clean":"2023-12-19T05:39:02.719504+0000","last_became_active":"2023-12-19T05:39:02.718789+0000","last_became_peered":"2023-12-19T05:39:02.718789+0000","last_unstale":"2023-12-19T05:39:02.719504+0000","last_undegraded":"2023-12-19T05:39:02.719504+0000","last_fullsized":"2023-12-19T05:39:02.719504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727356+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.727356+0000","last_peered":"2023-12-19T05:39:02.727356+0000","last_clean":"2023-12-19T05:39:02.727356+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.727356+0000","last_undegraded":"2023-12-19T05:39:02.727356+0000","last_fullsized":"2023-12-19T05:39:02.727356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.705289+0000","last_change":"2023-12-19T05:39:02.704511+0000","last_active":"2023-12-19T05:39:02.705289+0000","last_peered":"2023-12-19T05:39:02.705289+0000","last_clean":"2023-12-19T05:39:02.705289+0000","last_became_active":"2023-12-19T05:39:02.704290+0000","last_became_peered":"2023-12-19T05:39:02.704290+0000","last_unstale":"2023-12-19T05:39:02.705289+0000","last_undegraded":"2023-12-19T05:39:02.705289+0000","last_fullsized":"2023-12-19T05:39:02.705289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720875+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.720875+0000","last_peered":"2023-12-19T05:39:02.720875+0000","last_clean":"2023-12-19T05:39:02.720875+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.720875+0000","last_undegraded":"2023-12-19T05:39:02.720875+0000","last_fullsized":"2023-12-19T05:39:02.720875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.710295+0000","last_change":"2023-12-19T05:39:02.709021+0000","last_active":"2023-12-19T05:39:02.710295+0000","last_peered":"2023-12-19T05:39:02.710295+0000","last_clean":"2023-12-19T05:39:02.710295+0000","last_became_active":"2023-12-19T05:39:02.708795+0000","last_became_peered":"2023-12-19T05:39:02.708795+0000","last_unstale":"2023-12-19T05:39:02.710295+0000","last_undegraded":"2023-12-19T05:39:02.710295+0000","last_fullsized":"2023-12-19T05:39:02.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723471+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.723471+0000","last_peered":"2023-12-19T05:39:02.723471+0000","last_clean":"2023-12-19T05:39:02.723471+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.723471+0000","last_undegraded":"2023-12-19T05:39:02.723471+0000","last_fullsized":"2023-12-19T05:39:02.723471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711455+0000","last_change":"2023-12-19T05:39:02.710851+0000","last_active":"2023-12-19T05:39:02.711455+0000","last_peered":"2023-12-19T05:39:02.711455+0000","last_clean":"2023-12-19T05:39:02.711455+0000","last_became_active":"2023-12-19T05:39:02.710608+0000","last_became_peered":"2023-12-19T05:39:02.710608+0000","last_unstale":"2023-12-19T05:39:02.711455+0000","last_undegraded":"2023-12-19T05:39:02.711455+0000","last_fullsized":"2023-12-19T05:39:02.711455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726383+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.726383+0000","last_peered":"2023-12-19T05:39:02.726383+0000","last_clean":"2023-12-19T05:39:02.726383+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.726383+0000","last_undegraded":"2023-12-19T05:39:02.726383+0000","last_fullsized":"2023-12-19T05:39:02.726383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707311+0000","last_change":"2023-12-19T05:39:02.705620+0000","last_active":"2023-12-19T05:39:02.707311+0000","last_peered":"2023-12-19T05:39:02.707311+0000","last_clean":"2023-12-19T05:39:02.707311+0000","last_became_active":"2023-12-19T05:39:02.705414+0000","last_became_peered":"2023-12-19T05:39:02.705414+0000","last_unstale":"2023-12-19T05:39:02.707311+0000","last_undegraded":"2023-12-19T05:39:02.707311+0000","last_fullsized":"2023-12-19T05:39:02.707311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715348+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.715348+0000","last_peered":"2023-12-19T05:39:02.715348+0000","last_clean":"2023-12-19T05:39:02.715348+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.715348+0000","last_undegraded":"2023-12-19T05:39:02.715348+0000","last_fullsized":"2023-12-19T05:39:02.715348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.696599+0000","last_change":"2023-12-19T05:39:02.696537+0000","last_active":"2023-12-19T05:39:02.696599+0000","last_peered":"2023-12-19T05:39:02.696599+0000","last_clean":"2023-12-19T05:39:02.696599+0000","last_became_active":"2023-12-19T05:39:02.696310+0000","last_became_peered":"2023-12-19T05:39:02.696310+0000","last_unstale":"2023-12-19T05:39:02.696599+0000","last_undegraded":"2023-12-19T05:39:02.696599+0000","last_fullsized":"2023-12-19T05:39:02.696599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.694722+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:02.694722+0000","last_peered":"2023-12-19T05:39:02.694722+0000","last_clean":"2023-12-19T05:39:02.694722+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:02.694722+0000","last_undegraded":"2023-12-19T05:39:02.694722+0000","last_fullsized":"2023-12-19T05:39:02.694722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689437+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.689437+0000","last_peered":"2023-12-19T05:39:02.689437+0000","last_clean":"2023-12-19T05:39:02.689437+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.689437+0000","last_undegraded":"2023-12-19T05:39:02.689437+0000","last_fullsized":"2023-12-19T05:39:02.689437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711648+0000","last_change":"2023-12-19T05:39:02.711546+0000","last_active":"2023-12-19T05:39:02.711648+0000","last_peered":"2023-12-19T05:39:02.711648+0000","last_clean":"2023-12-19T05:39:02.711648+0000","last_became_active":"2023-12-19T05:39:02.709082+0000","last_became_peered":"2023-12-19T05:39:02.709082+0000","last_unstale":"2023-12-19T05:39:02.711648+0000","last_undegraded":"2023-12-19T05:39:02.711648+0000","last_fullsized":"2023-12-19T05:39:02.711648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691936+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.691936+0000","last_peered":"2023-12-19T05:39:02.691936+0000","last_clean":"2023-12-19T05:39:02.691936+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.691936+0000","last_undegraded":"2023-12-19T05:39:02.691936+0000","last_fullsized":"2023-12-19T05:39:02.691936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719756+0000","last_change":"2023-12-19T05:39:02.718299+0000","last_active":"2023-12-19T05:39:02.719756+0000","last_peered":"2023-12-19T05:39:02.719756+0000","last_clean":"2023-12-19T05:39:02.719756+0000","last_became_active":"2023-12-19T05:39:02.717475+0000","last_became_peered":"2023-12-19T05:39:02.717475+0000","last_unstale":"2023-12-19T05:39:02.719756+0000","last_undegraded":"2023-12-19T05:39:02.719756+0000","last_fullsized":"2023-12-19T05:39:02.719756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701132+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.701132+0000","last_peered":"2023-12-19T05:39:02.701132+0000","last_clean":"2023-12-19T05:39:02.701132+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.701132+0000","last_undegraded":"2023-12-19T05:39:02.701132+0000","last_fullsized":"2023-12-19T05:39:02.701132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711884+0000","last_change":"2023-12-19T05:39:02.711808+0000","last_active":"2023-12-19T05:39:02.711884+0000","last_peered":"2023-12-19T05:39:02.711884+0000","last_clean":"2023-12-19T05:39:02.711884+0000","last_became_active":"2023-12-19T05:39:02.710838+0000","last_became_peered":"2023-12-19T05:39:02.710838+0000","last_unstale":"2023-12-19T05:39:02.711884+0000","last_undegraded":"2023-12-19T05:39:02.711884+0000","last_fullsized":"2023-12-19T05:39:02.711884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.690768+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.690768+0000","last_peered":"2023-12-19T05:39:02.690768+0000","last_clean":"2023-12-19T05:39:02.690768+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.690768+0000","last_undegraded":"2023-12-19T05:39:02.690768+0000","last_fullsized":"2023-12-19T05:39:02.690768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713171+0000","last_change":"2023-12-19T05:39:02.712999+0000","last_active":"2023-12-19T05:39:02.713171+0000","last_peered":"2023-12-19T05:39:02.713171+0000","last_clean":"2023-12-19T05:39:02.713171+0000","last_became_active":"2023-12-19T05:39:02.712612+0000","last_became_peered":"2023-12-19T05:39:02.712612+0000","last_unstale":"2023-12-19T05:39:02.713171+0000","last_undegraded":"2023-12-19T05:39:02.713171+0000","last_fullsized":"2023-12-19T05:39:02.713171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700616+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.700616+0000","last_peered":"2023-12-19T05:39:02.700616+0000","last_clean":"2023-12-19T05:39:02.700616+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.700616+0000","last_undegraded":"2023-12-19T05:39:02.700616+0000","last_fullsized":"2023-12-19T05:39:02.700616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721066+0000","last_change":"2023-12-19T05:39:02.719234+0000","last_active":"2023-12-19T05:39:02.721066+0000","last_peered":"2023-12-19T05:39:02.721066+0000","last_clean":"2023-12-19T05:39:02.721066+0000","last_became_active":"2023-12-19T05:39:02.718998+0000","last_became_peered":"2023-12-19T05:39:02.718998+0000","last_unstale":"2023-12-19T05:39:02.721066+0000","last_undegraded":"2023-12-19T05:39:02.721066+0000","last_fullsized":"2023-12-19T05:39:02.721066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691685+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.691685+0000","last_peered":"2023-12-19T05:39:02.691685+0000","last_clean":"2023-12-19T05:39:02.691685+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.691685+0000","last_undegraded":"2023-12-19T05:39:02.691685+0000","last_fullsized":"2023-12-19T05:39:02.691685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.725731+0000","last_change":"2023-12-19T05:39:02.725655+0000","last_active":"2023-12-19T05:39:02.725731+0000","last_peered":"2023-12-19T05:39:02.725731+0000","last_clean":"2023-12-19T05:39:02.725731+0000","last_became_active":"2023-12-19T05:39:02.725276+0000","last_became_peered":"2023-12-19T05:39:02.725276+0000","last_unstale":"2023-12-19T05:39:02.725731+0000","last_undegraded":"2023-12-19T05:39:02.725731+0000","last_fullsized":"2023-12-19T05:39:02.725731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703423+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:02.703423+0000","last_peered":"2023-12-19T05:39:02.703423+0000","last_clean":"2023-12-19T05:39:02.703423+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:02.703423+0000","last_undegraded":"2023-12-19T05:39:02.703423+0000","last_fullsized":"2023-12-19T05:39:02.703423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720870+0000","last_change":"2023-12-19T05:39:02.719751+0000","last_active":"2023-12-19T05:39:02.720870+0000","last_peered":"2023-12-19T05:39:02.720870+0000","last_clean":"2023-12-19T05:39:02.720870+0000","last_became_active":"2023-12-19T05:39:02.719489+0000","last_became_peered":"2023-12-19T05:39:02.719489+0000","last_unstale":"2023-12-19T05:39:02.720870+0000","last_undegraded":"2023-12-19T05:39:02.720870+0000","last_fullsized":"2023-12-19T05:39:02.720870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721695+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.721695+0000","last_peered":"2023-12-19T05:39:02.721695+0000","last_clean":"2023-12-19T05:39:02.721695+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.721695+0000","last_undegraded":"2023-12-19T05:39:02.721695+0000","last_fullsized":"2023-12-19T05:39:02.721695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719332+0000","last_change":"2023-12-19T05:39:02.719256+0000","last_active":"2023-12-19T05:39:02.719332+0000","last_peered":"2023-12-19T05:39:02.719332+0000","last_clean":"2023-12-19T05:39:02.719332+0000","last_became_active":"2023-12-19T05:39:02.718985+0000","last_became_peered":"2023-12-19T05:39:02.718985+0000","last_unstale":"2023-12-19T05:39:02.719332+0000","last_undegraded":"2023-12-19T05:39:02.719332+0000","last_fullsized":"2023-12-19T05:39:02.719332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700486+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.700486+0000","last_peered":"2023-12-19T05:39:02.700486+0000","last_clean":"2023-12-19T05:39:02.700486+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.700486+0000","last_undegraded":"2023-12-19T05:39:02.700486+0000","last_fullsized":"2023-12-19T05:39:02.700486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.697089+0000","last_change":"2023-12-19T05:39:02.696856+0000","last_active":"2023-12-19T05:39:02.697089+0000","last_peered":"2023-12-19T05:39:02.697089+0000","last_clean":"2023-12-19T05:39:02.697089+0000","last_became_active":"2023-12-19T05:39:02.696670+0000","last_became_peered":"2023-12-19T05:39:02.696670+0000","last_unstale":"2023-12-19T05:39:02.697089+0000","last_undegraded":"2023-12-19T05:39:02.697089+0000","last_fullsized":"2023-12-19T05:39:02.697089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695338+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.695338+0000","last_peered":"2023-12-19T05:39:02.695338+0000","last_clean":"2023-12-19T05:39:02.695338+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.695338+0000","last_undegraded":"2023-12-19T05:39:02.695338+0000","last_fullsized":"2023-12-19T05:39:02.695338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715781+0000","last_change":"2023-12-19T05:39:02.715604+0000","last_active":"2023-12-19T05:39:02.715781+0000","last_peered":"2023-12-19T05:39:02.715781+0000","last_clean":"2023-12-19T05:39:02.715781+0000","last_became_active":"2023-12-19T05:39:02.715340+0000","last_became_peered":"2023-12-19T05:39:02.715340+0000","last_unstale":"2023-12-19T05:39:02.715781+0000","last_undegraded":"2023-12-19T05:39:02.715781+0000","last_fullsized":"2023-12-19T05:39:02.715781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.714039+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.714039+0000","last_peered":"2023-12-19T05:39:02.714039+0000","last_clean":"2023-12-19T05:39:02.714039+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.714039+0000","last_undegraded":"2023-12-19T05:39:02.714039+0000","last_fullsized":"2023-12-19T05:39:02.714039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719903+0000","last_change":"2023-12-19T05:39:02.719822+0000","last_active":"2023-12-19T05:39:02.719903+0000","last_peered":"2023-12-19T05:39:02.719903+0000","last_clean":"2023-12-19T05:39:02.719903+0000","last_became_active":"2023-12-19T05:39:02.719603+0000","last_became_peered":"2023-12-19T05:39:02.719603+0000","last_unstale":"2023-12-19T05:39:02.719903+0000","last_undegraded":"2023-12-19T05:39:02.719903+0000","last_fullsized":"2023-12-19T05:39:02.719903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722064+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.722064+0000","last_peered":"2023-12-19T05:39:02.722064+0000","last_clean":"2023-12-19T05:39:02.722064+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.722064+0000","last_undegraded":"2023-12-19T05:39:02.722064+0000","last_fullsized":"2023-12-19T05:39:02.722064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.698331+0000","last_change":"2023-12-19T05:39:02.698107+0000","last_active":"2023-12-19T05:39:02.698331+0000","last_peered":"2023-12-19T05:39:02.698331+0000","last_clean":"2023-12-19T05:39:02.698331+0000","last_became_active":"2023-12-19T05:39:02.696242+0000","last_became_peered":"2023-12-19T05:39:02.696242+0000","last_unstale":"2023-12-19T05:39:02.698331+0000","last_undegraded":"2023-12-19T05:39:02.698331+0000","last_fullsized":"2023-12-19T05:39:02.698331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709142+0000","last_change":"2023-12-19T05:39:02.709072+0000","last_active":"2023-12-19T05:39:02.709142+0000","last_peered":"2023-12-19T05:39:02.709142+0000","last_clean":"2023-12-19T05:39:02.709142+0000","last_became_active":"2023-12-19T05:39:02.708202+0000","last_became_peered":"2023-12-19T05:39:02.708202+0000","last_unstale":"2023-12-19T05:39:02.709142+0000","last_undegraded":"2023-12-19T05:39:02.709142+0000","last_fullsized":"2023-12-19T05:39:02.709142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713469+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.713469+0000","last_peered":"2023-12-19T05:39:02.713469+0000","last_clean":"2023-12-19T05:39:02.713469+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.713469+0000","last_undegraded":"2023-12-19T05:39:02.713469+0000","last_fullsized":"2023-12-19T05:39:02.713469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707208+0000","last_change":"2023-12-19T05:39:02.706972+0000","last_active":"2023-12-19T05:39:02.707208+0000","last_peered":"2023-12-19T05:39:02.707208+0000","last_clean":"2023-12-19T05:39:02.707208+0000","last_became_active":"2023-12-19T05:39:02.702711+0000","last_became_peered":"2023-12-19T05:39:02.702711+0000","last_unstale":"2023-12-19T05:39:02.707208+0000","last_undegraded":"2023-12-19T05:39:02.707208+0000","last_fullsized":"2023-12-19T05:39:02.707208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713207+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.713207+0000","last_peered":"2023-12-19T05:39:02.713207+0000","last_clean":"2023-12-19T05:39:02.713207+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.713207+0000","last_undegraded":"2023-12-19T05:39:02.713207+0000","last_fullsized":"2023-12-19T05:39:02.713207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718496+0000","last_change":"2023-12-19T05:39:02.714964+0000","last_active":"2023-12-19T05:39:02.718496+0000","last_peered":"2023-12-19T05:39:02.718496+0000","last_clean":"2023-12-19T05:39:02.718496+0000","last_became_active":"2023-12-19T05:39:02.713835+0000","last_became_peered":"2023-12-19T05:39:02.713835+0000","last_unstale":"2023-12-19T05:39:02.718496+0000","last_undegraded":"2023-12-19T05:39:02.718496+0000","last_fullsized":"2023-12-19T05:39:02.718496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726982+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.726982+0000","last_peered":"2023-12-19T05:39:02.726982+0000","last_clean":"2023-12-19T05:39:02.726982+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.726982+0000","last_undegraded":"2023-12-19T05:39:02.726982+0000","last_fullsized":"2023-12-19T05:39:02.726982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718442+0000","last_change":"2023-12-19T05:39:02.714203+0000","last_active":"2023-12-19T05:39:02.718442+0000","last_peered":"2023-12-19T05:39:02.718442+0000","last_clean":"2023-12-19T05:39:02.718442+0000","last_became_active":"2023-12-19T05:39:02.713955+0000","last_became_peered":"2023-12-19T05:39:02.713955+0000","last_unstale":"2023-12-19T05:39:02.718442+0000","last_undegraded":"2023-12-19T05:39:02.718442+0000","last_fullsized":"2023-12-19T05:39:02.718442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727404+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.727404+0000","last_peered":"2023-12-19T05:39:02.727404+0000","last_clean":"2023-12-19T05:39:02.727404+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.727404+0000","last_undegraded":"2023-12-19T05:39:02.727404+0000","last_fullsized":"2023-12-19T05:39:02.727404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:12.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:13.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.046+0000 7f6bc46db640 1 Processor -- start 2023-12-19T05:39:13.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.047+0000 7f6bc46db640 1 -- start start 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.048+0000 7f6bc46db640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bbc1444b0 0x7f6bbc144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.048+0000 7f6bc46db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc0d1d20 0x7f6bbc0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.048+0000 7f6bc46db640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0cf280 con 0x7f6bbc144f60 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.048+0000 7f6bc46db640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0d21b0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.048+0000 7f6bc46db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc15f9e0 con 0x7f6bbc0d1d20 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bbc1444b0 0x7f6bbc144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bbc1444b0 0x7f6bbc144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54880/0 (socket says 172.21.15.49:54880) 2023-12-19T05:39:13.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 -- 172.21.15.49:0/3267008385 learned_addr learned my addr 172.21.15.49:0/3267008385 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc1c76640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc0d1d20 0x7f6bbc0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 -- 172.21.15.49:0/3267008385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc0d1d20 msgr2=0x7f6bbc0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc0d1d20 0x7f6bbc0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 -- 172.21.15.49:0/3267008385 >> v1:172.21.15.115:6789/0 conn(0x7f6bbc144f60 legacy=0x7f6bbc0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.049+0000 7f6bc2477640 1 -- 172.21.15.49:0/3267008385 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc06e870 con 0x7f6bbc1444b0 2023-12-19T05:39:13.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.051+0000 7f6bc2477640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc144890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098a0 tx=0x7f6bb802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d914ba51db5940dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.051+0000 7f6bc1475640 1 -- 172.21.15.49:0/3267008385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80317c0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.051+0000 7f6bc1475640 1 -- 172.21.15.49:0/3267008385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8031920 con 0x7f6bbc1444b0 2023-12-19T05:39:13.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.051+0000 7f6bc1475640 1 -- 172.21.15.49:0/3267008385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8031cb0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 -- 172.21.15.49:0/3267008385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 msgr2=0x7f6bbc144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc144890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098a0 tx=0x7f6bb802b860 comp rx=0 tx=0).stop 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 -- 172.21.15.49:0/3267008385 shutdown_connections 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc0d1d20 0x7f6bbc0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 --2- 172.21.15.49:0/3267008385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc144890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 -- 172.21.15.49:0/3267008385 >> 172.21.15.49:0/3267008385 conn(0x7f6bbc06a2e0 msgr2=0x7f6bbc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 -- 172.21.15.49:0/3267008385 shutdown_connections 2023-12-19T05:39:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.052+0000 7f6bc46db640 1 -- 172.21.15.49:0/3267008385 wait complete. 2023-12-19T05:39:13.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.054+0000 7f6bc46db640 1 Processor -- start 2023-12-19T05:39:13.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.054+0000 7f6bc46db640 1 -- start start 2023-12-19T05:39:13.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc144f60 0x7f6bbc0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 0x7f6bbc0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b6190 con 0x7f6bbc1444b0 2023-12-19T05:39:13.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc141b50 con 0x7f6bbc15aff0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc46db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc141da0 con 0x7f6bbc144f60 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54884/0 (socket says 172.21.15.49:54884) 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 -- 172.21.15.49:0/584362523 learned_addr learned my addr 172.21.15.49:0/584362523 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2c78640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 0x7f6bbc0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc1c76640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc144f60 0x7f6bbc0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 -- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc144f60 msgr2=0x7f6bbc0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc144f60 0x7f6bbc0b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 -- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 msgr2=0x7f6bbc0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 0x7f6bbc0b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2477640 1 -- 172.21.15.49:0/584362523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80094d0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.055+0000 7f6bc2c78640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 0x7f6bbc0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6bc2477640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098a0 tx=0x7f6bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8032860 con 0x7f6bbc1444b0 2023-12-19T05:39:13.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80329c0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc142080 con 0x7f6bbc1444b0 2023-12-19T05:39:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8032d70 con 0x7f6bbc1444b0 2023-12-19T05:39:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.056+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc142640 con 0x7f6bbc1444b0 2023-12-19T05:39:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.057+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc061910 con 0x7f6bbc1444b0 2023-12-19T05:39:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.058+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bb804d3f0 con 0x7f6bbc1444b0 2023-12-19T05:39:13.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.059+0000 7f6baeffd640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 0x7f6ba006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.059+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bb80aa790 con 0x7f6bbc1444b0 2023-12-19T05:39:13.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.060+0000 7f6bc1c76640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 0x7f6ba006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.061+0000 7f6bc1c76640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 0x7f6ba006c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc15b480 tx=0x7f6bb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.064+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6bb8075d80 con 0x7f6bbc1444b0 2023-12-19T05:39:13.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.253+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bbc15f0b0 con 0x7f6ba006a460 2023-12-19T05:39:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.275+0000 7f6baeffd640 1 -- 172.21.15.49:0/584362523 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260107 (secure 0 0 0) 0x7f6bb0009d80 con 0x7f6ba006a460 2023-12-19T05:39:13.279 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:13.281 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.281+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 msgr2=0x7f6ba006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.281+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 0x7f6ba006c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc15b480 tx=0x7f6bb0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.281+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 msgr2=0x7f6bbc0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.281+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098a0 tx=0x7f6bb80046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 shutdown_connections 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6ba006a460 0x7f6ba006c920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bbc144f60 0x7f6bbc0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bbc15aff0 0x7f6bbc0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 --2- 172.21.15.49:0/584362523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bbc1444b0 0x7f6bbc0b51d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 >> 172.21.15.49:0/584362523 conn(0x7f6bbc06a2e0 msgr2=0x7f6bbc0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 shutdown_connections 2023-12-19T05:39:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.282+0000 7f6bc46db640 1 -- 172.21.15.49:0/584362523 wait complete. 2023-12-19T05:39:13.302 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-19T05:39:12.502104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.812019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717330+0000","last_change":"2023-12-19T05:39:02.717216+0000","last_active":"2023-12-19T05:39:02.717330+0000","last_peered":"2023-12-19T05:39:02.717330+0000","last_clean":"2023-12-19T05:39:02.717330+0000","last_became_active":"2023-12-19T05:39:02.716805+0000","last_became_peered":"2023-12-19T05:39:02.716805+0000","last_unstale":"2023-12-19T05:39:02.717330+0000","last_undegraded":"2023-12-19T05:39:02.717330+0000","last_fullsized":"2023-12-19T05:39:02.717330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723207+0000","last_change":"2023-12-19T05:39:02.720735+0000","last_active":"2023-12-19T05:39:02.723207+0000","last_peered":"2023-12-19T05:39:02.723207+0000","last_clean":"2023-12-19T05:39:02.723207+0000","last_became_active":"2023-12-19T05:39:02.720479+0000","last_became_peered":"2023-12-19T05:39:02.720479+0000","last_unstale":"2023-12-19T05:39:02.723207+0000","last_undegraded":"2023-12-19T05:39:02.723207+0000","last_fullsized":"2023-12-19T05:39:02.723207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718511+0000","last_change":"2023-12-19T05:39:02.715183+0000","last_active":"2023-12-19T05:39:02.718511+0000","last_peered":"2023-12-19T05:39:02.718511+0000","last_clean":"2023-12-19T05:39:02.718511+0000","last_became_active":"2023-12-19T05:39:02.714240+0000","last_became_peered":"2023-12-19T05:39:02.714240+0000","last_unstale":"2023-12-19T05:39:02.718511+0000","last_undegraded":"2023-12-19T05:39:02.718511+0000","last_fullsized":"2023-12-19T05:39:02.718511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711817+0000","last_change":"2023-12-19T05:39:02.710230+0000","last_active":"2023-12-19T05:39:02.711817+0000","last_peered":"2023-12-19T05:39:02.711817+0000","last_clean":"2023-12-19T05:39:02.711817+0000","last_became_active":"2023-12-19T05:39:02.710001+0000","last_became_peered":"2023-12-19T05:39:02.710001+0000","last_unstale":"2023-12-19T05:39:02.711817+0000","last_undegraded":"2023-12-19T05:39:02.711817+0000","last_fullsized":"2023-12-19T05:39:02.711817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718958+0000","last_change":"2023-12-19T05:39:02.718728+0000","last_active":"2023-12-19T05:39:02.718958+0000","last_peered":"2023-12-19T05:39:02.718958+0000","last_clean":"2023-12-19T05:39:02.718958+0000","last_became_active":"2023-12-19T05:39:02.718457+0000","last_became_peered":"2023-12-19T05:39:02.718457+0000","last_unstale":"2023-12-19T05:39:02.718958+0000","last_undegraded":"2023-12-19T05:39:02.718958+0000","last_fullsized":"2023-12-19T05:39:02.718958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711835+0000","last_change":"2023-12-19T05:39:02.710247+0000","last_active":"2023-12-19T05:39:02.711835+0000","last_peered":"2023-12-19T05:39:02.711835+0000","last_clean":"2023-12-19T05:39:02.711835+0000","last_became_active":"2023-12-19T05:39:02.710039+0000","last_became_peered":"2023-12-19T05:39:02.710039+0000","last_unstale":"2023-12-19T05:39:02.711835+0000","last_undegraded":"2023-12-19T05:39:02.711835+0000","last_fullsized":"2023-12-19T05:39:02.711835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716214+0000","last_change":"2023-12-19T05:39:02.716135+0000","last_active":"2023-12-19T05:39:02.716214+0000","last_peered":"2023-12-19T05:39:02.716214+0000","last_clean":"2023-12-19T05:39:02.716214+0000","last_became_active":"2023-12-19T05:39:02.715148+0000","last_became_peered":"2023-12-19T05:39:02.715148+0000","last_unstale":"2023-12-19T05:39:02.716214+0000","last_undegraded":"2023-12-19T05:39:02.716214+0000","last_fullsized":"2023-12-19T05:39:02.716214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723196+0000","last_change":"2023-12-19T05:39:02.720176+0000","last_active":"2023-12-19T05:39:02.723196+0000","last_peered":"2023-12-19T05:39:02.723196+0000","last_clean":"2023-12-19T05:39:02.723196+0000","last_became_active":"2023-12-19T05:39:02.719954+0000","last_became_peered":"2023-12-19T05:39:02.719954+0000","last_unstale":"2023-12-19T05:39:02.723196+0000","last_undegraded":"2023-12-19T05:39:02.723196+0000","last_fullsized":"2023-12-19T05:39:02.723196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700335+0000","last_change":"2023-12-19T05:39:02.700252+0000","last_active":"2023-12-19T05:39:02.700335+0000","last_peered":"2023-12-19T05:39:02.700335+0000","last_clean":"2023-12-19T05:39:02.700335+0000","last_became_active":"2023-12-19T05:39:02.699871+0000","last_became_peered":"2023-12-19T05:39:02.699871+0000","last_unstale":"2023-12-19T05:39:02.700335+0000","last_undegraded":"2023-12-19T05:39:02.700335+0000","last_fullsized":"2023-12-19T05:39:02.700335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709263+0000","last_change":"2023-12-19T05:39:02.708261+0000","last_active":"2023-12-19T05:39:02.709263+0000","last_peered":"2023-12-19T05:39:02.709263+0000","last_clean":"2023-12-19T05:39:02.709263+0000","last_became_active":"2023-12-19T05:39:02.707762+0000","last_became_peered":"2023-12-19T05:39:02.707762+0000","last_unstale":"2023-12-19T05:39:02.709263+0000","last_undegraded":"2023-12-19T05:39:02.709263+0000","last_fullsized":"2023-12-19T05:39:02.709263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717313+0000","last_change":"2023-12-19T05:39:02.717049+0000","last_active":"2023-12-19T05:39:02.717313+0000","last_peered":"2023-12-19T05:39:02.717313+0000","last_clean":"2023-12-19T05:39:02.717313+0000","last_became_active":"2023-12-19T05:39:02.716371+0000","last_became_peered":"2023-12-19T05:39:02.716371+0000","last_unstale":"2023-12-19T05:39:02.717313+0000","last_undegraded":"2023-12-19T05:39:02.717313+0000","last_fullsized":"2023-12-19T05:39:02.717313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707329+0000","last_change":"2023-12-19T05:39:02.707024+0000","last_active":"2023-12-19T05:39:02.707329+0000","last_peered":"2023-12-19T05:39:02.707329+0000","last_clean":"2023-12-19T05:39:02.707329+0000","last_became_active":"2023-12-19T05:39:02.706779+0000","last_became_peered":"2023-12-19T05:39:02.706779+0000","last_unstale":"2023-12-19T05:39:02.707329+0000","last_undegraded":"2023-12-19T05:39:02.707329+0000","last_fullsized":"2023-12-19T05:39:02.707329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719791+0000","last_change":"2023-12-19T05:39:02.718594+0000","last_active":"2023-12-19T05:39:02.719791+0000","last_peered":"2023-12-19T05:39:02.719791+0000","last_clean":"2023-12-19T05:39:02.719791+0000","last_became_active":"2023-12-19T05:39:02.717977+0000","last_became_peered":"2023-12-19T05:39:02.717977+0000","last_unstale":"2023-12-19T05:39:02.719791+0000","last_undegraded":"2023-12-19T05:39:02.719791+0000","last_fullsized":"2023-12-19T05:39:02.719791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719739+0000","last_change":"2023-12-19T05:39:02.718246+0000","last_active":"2023-12-19T05:39:02.719739+0000","last_peered":"2023-12-19T05:39:02.719739+0000","last_clean":"2023-12-19T05:39:02.719739+0000","last_became_active":"2023-12-19T05:39:02.716071+0000","last_became_peered":"2023-12-19T05:39:02.716071+0000","last_unstale":"2023-12-19T05:39:02.719739+0000","last_undegraded":"2023-12-19T05:39:02.719739+0000","last_fullsized":"2023-12-19T05:39:02.719739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718462+0000","last_change":"2023-12-19T05:39:02.714245+0000","last_active":"2023-12-19T05:39:02.718462+0000","last_peered":"2023-12-19T05:39:02.718462+0000","last_clean":"2023-12-19T05:39:02.718462+0000","last_became_active":"2023-12-19T05:39:02.713242+0000","last_became_peered":"2023-12-19T05:39:02.713242+0000","last_unstale":"2023-12-19T05:39:02.718462+0000","last_undegraded":"2023-12-19T05:39:02.718462+0000","last_fullsized":"2023-12-19T05:39:02.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709046+0000","last_change":"2023-12-19T05:39:02.708950+0000","last_active":"2023-12-19T05:39:02.709046+0000","last_peered":"2023-12-19T05:39:02.709046+0000","last_clean":"2023-12-19T05:39:02.709046+0000","last_became_active":"2023-12-19T05:39:02.708106+0000","last_became_peered":"2023-12-19T05:39:02.708106+0000","last_unstale":"2023-12-19T05:39:02.709046+0000","last_undegraded":"2023-12-19T05:39:02.709046+0000","last_fullsized":"2023-12-19T05:39:02.709046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706992+0000","last_change":"2023-12-19T05:39:02.706691+0000","last_active":"2023-12-19T05:39:02.706992+0000","last_peered":"2023-12-19T05:39:02.706992+0000","last_clean":"2023-12-19T05:39:02.706992+0000","last_became_active":"2023-12-19T05:39:02.706456+0000","last_became_peered":"2023-12-19T05:39:02.706456+0000","last_unstale":"2023-12-19T05:39:02.706992+0000","last_undegraded":"2023-12-19T05:39:02.706992+0000","last_fullsized":"2023-12-19T05:39:02.706992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716359+0000","last_change":"2023-12-19T05:39:02.713393+0000","last_active":"2023-12-19T05:39:02.716359+0000","last_peered":"2023-12-19T05:39:02.716359+0000","last_clean":"2023-12-19T05:39:02.716359+0000","last_became_active":"2023-12-19T05:39:02.713154+0000","last_became_peered":"2023-12-19T05:39:02.713154+0000","last_unstale":"2023-12-19T05:39:02.716359+0000","last_undegraded":"2023-12-19T05:39:02.716359+0000","last_fullsized":"2023-12-19T05:39:02.716359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701477+0000","last_change":"2023-12-19T05:39:02.700926+0000","last_active":"2023-12-19T05:39:02.701477+0000","last_peered":"2023-12-19T05:39:02.701477+0000","last_clean":"2023-12-19T05:39:02.701477+0000","last_became_active":"2023-12-19T05:39:02.697252+0000","last_became_peered":"2023-12-19T05:39:02.697252+0000","last_unstale":"2023-12-19T05:39:02.701477+0000","last_undegraded":"2023-12-19T05:39:02.701477+0000","last_fullsized":"2023-12-19T05:39:02.701477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709283+0000","last_change":"2023-12-19T05:39:02.708393+0000","last_active":"2023-12-19T05:39:02.709283+0000","last_peered":"2023-12-19T05:39:02.709283+0000","last_clean":"2023-12-19T05:39:02.709283+0000","last_became_active":"2023-12-19T05:39:02.708060+0000","last_became_peered":"2023-12-19T05:39:02.708060+0000","last_unstale":"2023-12-19T05:39:02.709283+0000","last_undegraded":"2023-12-19T05:39:02.709283+0000","last_fullsized":"2023-12-19T05:39:02.709283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711238+0000","last_change":"2023-12-19T05:39:02.710664+0000","last_active":"2023-12-19T05:39:02.711238+0000","last_peered":"2023-12-19T05:39:02.711238+0000","last_clean":"2023-12-19T05:39:02.711238+0000","last_became_active":"2023-12-19T05:39:02.710462+0000","last_became_peered":"2023-12-19T05:39:02.710462+0000","last_unstale":"2023-12-19T05:39:02.711238+0000","last_undegraded":"2023-12-19T05:39:02.711238+0000","last_fullsized":"2023-12-19T05:39:02.711238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707454+0000","last_change":"2023-12-19T05:39:02.706412+0000","last_active":"2023-12-19T05:39:02.707454+0000","last_peered":"2023-12-19T05:39:02.707454+0000","last_clean":"2023-12-19T05:39:02.707454+0000","last_became_active":"2023-12-19T05:39:02.706148+0000","last_became_peered":"2023-12-19T05:39:02.706148+0000","last_unstale":"2023-12-19T05:39:02.707454+0000","last_undegraded":"2023-12-19T05:39:02.707454+0000","last_fullsized":"2023-12-19T05:39:02.707454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718533+0000","last_change":"2023-12-19T05:39:02.715320+0000","last_active":"2023-12-19T05:39:02.718533+0000","last_peered":"2023-12-19T05:39:02.718533+0000","last_clean":"2023-12-19T05:39:02.718533+0000","last_became_active":"2023-12-19T05:39:02.714719+0000","last_became_peered":"2023-12-19T05:39:02.714719+0000","last_unstale":"2023-12-19T05:39:02.718533+0000","last_undegraded":"2023-12-19T05:39:02.718533+0000","last_fullsized":"2023-12-19T05:39:02.718533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715762+0000","last_change":"2023-12-19T05:39:02.715586+0000","last_active":"2023-12-19T05:39:02.715762+0000","last_peered":"2023-12-19T05:39:02.715762+0000","last_clean":"2023-12-19T05:39:02.715762+0000","last_became_active":"2023-12-19T05:39:02.715221+0000","last_became_peered":"2023-12-19T05:39:02.715221+0000","last_unstale":"2023-12-19T05:39:02.715762+0000","last_undegraded":"2023-12-19T05:39:02.715762+0000","last_fullsized":"2023-12-19T05:39:02.715762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718480+0000","last_change":"2023-12-19T05:39:02.714373+0000","last_active":"2023-12-19T05:39:02.718480+0000","last_peered":"2023-12-19T05:39:02.718480+0000","last_clean":"2023-12-19T05:39:02.718480+0000","last_became_active":"2023-12-19T05:39:02.713629+0000","last_became_peered":"2023-12-19T05:39:02.713629+0000","last_unstale":"2023-12-19T05:39:02.718480+0000","last_undegraded":"2023-12-19T05:39:02.718480+0000","last_fullsized":"2023-12-19T05:39:02.718480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713382+0000","last_change":"2023-12-19T05:39:02.713317+0000","last_active":"2023-12-19T05:39:02.713382+0000","last_peered":"2023-12-19T05:39:02.713382+0000","last_clean":"2023-12-19T05:39:02.713382+0000","last_became_active":"2023-12-19T05:39:02.712971+0000","last_became_peered":"2023-12-19T05:39:02.712971+0000","last_unstale":"2023-12-19T05:39:02.713382+0000","last_undegraded":"2023-12-19T05:39:02.713382+0000","last_fullsized":"2023-12-19T05:39:02.713382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720145+0000","last_change":"2023-12-19T05:39:02.719977+0000","last_active":"2023-12-19T05:39:02.720145+0000","last_peered":"2023-12-19T05:39:02.720145+0000","last_clean":"2023-12-19T05:39:02.720145+0000","last_became_active":"2023-12-19T05:39:02.719748+0000","last_became_peered":"2023-12-19T05:39:02.719748+0000","last_unstale":"2023-12-19T05:39:02.720145+0000","last_undegraded":"2023-12-19T05:39:02.720145+0000","last_fullsized":"2023-12-19T05:39:02.720145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719772+0000","last_change":"2023-12-19T05:39:02.718445+0000","last_active":"2023-12-19T05:39:02.719772+0000","last_peered":"2023-12-19T05:39:02.719772+0000","last_clean":"2023-12-19T05:39:02.719772+0000","last_became_active":"2023-12-19T05:39:02.717751+0000","last_became_peered":"2023-12-19T05:39:02.717751+0000","last_unstale":"2023-12-19T05:39:02.719772+0000","last_undegraded":"2023-12-19T05:39:02.719772+0000","last_fullsized":"2023-12-19T05:39:02.719772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713710+0000","last_change":"2023-12-19T05:39:02.711952+0000","last_active":"2023-12-19T05:39:02.713710+0000","last_peered":"2023-12-19T05:39:02.713710+0000","last_clean":"2023-12-19T05:39:02.713710+0000","last_became_active":"2023-12-19T05:39:02.711582+0000","last_became_peered":"2023-12-19T05:39:02.711582+0000","last_unstale":"2023-12-19T05:39:02.713710+0000","last_undegraded":"2023-12-19T05:39:02.713710+0000","last_fullsized":"2023-12-19T05:39:02.713710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713984+0000","last_change":"2023-12-19T05:39:02.713881+0000","last_active":"2023-12-19T05:39:02.713984+0000","last_peered":"2023-12-19T05:39:02.713984+0000","last_clean":"2023-12-19T05:39:02.713984+0000","last_became_active":"2023-12-19T05:39:02.708835+0000","last_became_peered":"2023-12-19T05:39:02.708835+0000","last_unstale":"2023-12-19T05:39:02.713984+0000","last_undegraded":"2023-12-19T05:39:02.713984+0000","last_fullsized":"2023-12-19T05:39:02.713984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.708630+0000","last_change":"2023-12-19T05:39:02.708098+0000","last_active":"2023-12-19T05:39:02.708630+0000","last_peered":"2023-12-19T05:39:02.708630+0000","last_clean":"2023-12-19T05:39:02.708630+0000","last_became_active":"2023-12-19T05:39:02.707804+0000","last_became_peered":"2023-12-19T05:39:02.707804+0000","last_unstale":"2023-12-19T05:39:02.708630+0000","last_undegraded":"2023-12-19T05:39:02.708630+0000","last_fullsized":"2023-12-19T05:39:02.708630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721098+0000","last_change":"2023-12-19T05:39:02.720287+0000","last_active":"2023-12-19T05:39:02.721098+0000","last_peered":"2023-12-19T05:39:02.721098+0000","last_clean":"2023-12-19T05:39:02.721098+0000","last_became_active":"2023-12-19T05:39:02.720075+0000","last_became_peered":"2023-12-19T05:39:02.720075+0000","last_unstale":"2023-12-19T05:39:02.721098+0000","last_undegraded":"2023-12-19T05:39:02.721098+0000","last_fullsized":"2023-12-19T05:39:02.721098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719684+0000","last_change":"2023-12-19T05:39:02.719563+0000","last_active":"2023-12-19T05:39:02.719684+0000","last_peered":"2023-12-19T05:39:02.719684+0000","last_clean":"2023-12-19T05:39:02.719684+0000","last_became_active":"2023-12-19T05:39:02.719114+0000","last_became_peered":"2023-12-19T05:39:02.719114+0000","last_unstale":"2023-12-19T05:39:02.719684+0000","last_undegraded":"2023-12-19T05:39:02.719684+0000","last_fullsized":"2023-12-19T05:39:02.719684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727216+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.727216+0000","last_peered":"2023-12-19T05:39:02.727216+0000","last_clean":"2023-12-19T05:39:02.727216+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.727216+0000","last_undegraded":"2023-12-19T05:39:02.727216+0000","last_fullsized":"2023-12-19T05:39:02.727216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711786+0000","last_change":"2023-12-19T05:39:02.711723+0000","last_active":"2023-12-19T05:39:02.711786+0000","last_peered":"2023-12-19T05:39:02.711786+0000","last_clean":"2023-12-19T05:39:02.711786+0000","last_became_active":"2023-12-19T05:39:02.709817+0000","last_became_peered":"2023-12-19T05:39:02.709817+0000","last_unstale":"2023-12-19T05:39:02.711786+0000","last_undegraded":"2023-12-19T05:39:02.711786+0000","last_fullsized":"2023-12-19T05:39:02.711786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722219+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.722219+0000","last_peered":"2023-12-19T05:39:02.722219+0000","last_clean":"2023-12-19T05:39:02.722219+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.722219+0000","last_undegraded":"2023-12-19T05:39:02.722219+0000","last_fullsized":"2023-12-19T05:39:02.722219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713569+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.713569+0000","last_peered":"2023-12-19T05:39:02.713569+0000","last_clean":"2023-12-19T05:39:02.713569+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.713569+0000","last_undegraded":"2023-12-19T05:39:02.713569+0000","last_fullsized":"2023-12-19T05:39:02.713569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723073+0000","last_change":"2023-12-19T05:39:02.719393+0000","last_active":"2023-12-19T05:39:02.723073+0000","last_peered":"2023-12-19T05:39:02.723073+0000","last_clean":"2023-12-19T05:39:02.723073+0000","last_became_active":"2023-12-19T05:39:02.719080+0000","last_became_peered":"2023-12-19T05:39:02.719080+0000","last_unstale":"2023-12-19T05:39:02.723073+0000","last_undegraded":"2023-12-19T05:39:02.723073+0000","last_fullsized":"2023-12-19T05:39:02.723073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691632+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.691632+0000","last_peered":"2023-12-19T05:39:02.691632+0000","last_clean":"2023-12-19T05:39:02.691632+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.691632+0000","last_undegraded":"2023-12-19T05:39:02.691632+0000","last_fullsized":"2023-12-19T05:39:02.691632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706164+0000","last_change":"2023-12-19T05:39:02.697790+0000","last_active":"2023-12-19T05:39:02.706164+0000","last_peered":"2023-12-19T05:39:02.706164+0000","last_clean":"2023-12-19T05:39:02.706164+0000","last_became_active":"2023-12-19T05:39:02.697516+0000","last_became_peered":"2023-12-19T05:39:02.697516+0000","last_unstale":"2023-12-19T05:39:02.706164+0000","last_undegraded":"2023-12-19T05:39:02.706164+0000","last_fullsized":"2023-12-19T05:39:02.706164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695035+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.695035+0000","last_peered":"2023-12-19T05:39:02.695035+0000","last_clean":"2023-12-19T05:39:02.695035+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.695035+0000","last_undegraded":"2023-12-19T05:39:02.695035+0000","last_fullsized":"2023-12-19T05:39:02.695035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711851+0000","last_change":"2023-12-19T05:39:02.711262+0000","last_active":"2023-12-19T05:39:02.711851+0000","last_peered":"2023-12-19T05:39:02.711851+0000","last_clean":"2023-12-19T05:39:02.711851+0000","last_became_active":"2023-12-19T05:39:02.710878+0000","last_became_peered":"2023-12-19T05:39:02.710878+0000","last_unstale":"2023-12-19T05:39:02.711851+0000","last_undegraded":"2023-12-19T05:39:02.711851+0000","last_fullsized":"2023-12-19T05:39:02.711851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.702914+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.702914+0000","last_peered":"2023-12-19T05:39:02.702914+0000","last_clean":"2023-12-19T05:39:02.702914+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.702914+0000","last_undegraded":"2023-12-19T05:39:02.702914+0000","last_fullsized":"2023-12-19T05:39:02.702914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.704026+0000","last_change":"2023-12-19T05:39:02.703882+0000","last_active":"2023-12-19T05:39:02.704026+0000","last_peered":"2023-12-19T05:39:02.704026+0000","last_clean":"2023-12-19T05:39:02.704026+0000","last_became_active":"2023-12-19T05:39:02.703208+0000","last_became_peered":"2023-12-19T05:39:02.703208+0000","last_unstale":"2023-12-19T05:39:02.704026+0000","last_undegraded":"2023-12-19T05:39:02.704026+0000","last_fullsized":"2023-12-19T05:39:02.704026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719259+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.719259+0000","last_peered":"2023-12-19T05:39:02.719259+0000","last_clean":"2023-12-19T05:39:02.719259+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.719259+0000","last_undegraded":"2023-12-19T05:39:02.719259+0000","last_fullsized":"2023-12-19T05:39:02.719259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715569+0000","last_change":"2023-12-19T05:39:02.715445+0000","last_active":"2023-12-19T05:39:02.715569+0000","last_peered":"2023-12-19T05:39:02.715569+0000","last_clean":"2023-12-19T05:39:02.715569+0000","last_became_active":"2023-12-19T05:39:02.714901+0000","last_became_peered":"2023-12-19T05:39:02.714901+0000","last_unstale":"2023-12-19T05:39:02.715569+0000","last_undegraded":"2023-12-19T05:39:02.715569+0000","last_fullsized":"2023-12-19T05:39:02.715569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.728240+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.728240+0000","last_peered":"2023-12-19T05:39:02.728240+0000","last_clean":"2023-12-19T05:39:02.728240+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.728240+0000","last_undegraded":"2023-12-19T05:39:02.728240+0000","last_fullsized":"2023-12-19T05:39:02.728240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720718+0000","last_change":"2023-12-19T05:39:02.720607+0000","last_active":"2023-12-19T05:39:02.720718+0000","last_peered":"2023-12-19T05:39:02.720718+0000","last_clean":"2023-12-19T05:39:02.720718+0000","last_became_active":"2023-12-19T05:39:02.720203+0000","last_became_peered":"2023-12-19T05:39:02.720203+0000","last_unstale":"2023-12-19T05:39:02.720718+0000","last_undegraded":"2023-12-19T05:39:02.720718+0000","last_fullsized":"2023-12-19T05:39:02.720718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716893+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.716893+0000","last_peered":"2023-12-19T05:39:02.716893+0000","last_clean":"2023-12-19T05:39:02.716893+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.716893+0000","last_undegraded":"2023-12-19T05:39:02.716893+0000","last_fullsized":"2023-12-19T05:39:02.716893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719719+0000","last_change":"2023-12-19T05:39:02.717923+0000","last_active":"2023-12-19T05:39:02.719719+0000","last_peered":"2023-12-19T05:39:02.719719+0000","last_clean":"2023-12-19T05:39:02.719719+0000","last_became_active":"2023-12-19T05:39:02.717316+0000","last_became_peered":"2023-12-19T05:39:02.717316+0000","last_unstale":"2023-12-19T05:39:02.719719+0000","last_undegraded":"2023-12-19T05:39:02.719719+0000","last_fullsized":"2023-12-19T05:39:02.719719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689096+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.689096+0000","last_peered":"2023-12-19T05:39:02.689096+0000","last_clean":"2023-12-19T05:39:02.689096+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.689096+0000","last_undegraded":"2023-12-19T05:39:02.689096+0000","last_fullsized":"2023-12-19T05:39:02.689096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713759+0000","last_change":"2023-12-19T05:39:02.713659+0000","last_active":"2023-12-19T05:39:02.713759+0000","last_peered":"2023-12-19T05:39:02.713759+0000","last_clean":"2023-12-19T05:39:02.713759+0000","last_became_active":"2023-12-19T05:39:02.708530+0000","last_became_peered":"2023-12-19T05:39:02.708530+0000","last_unstale":"2023-12-19T05:39:02.713759+0000","last_undegraded":"2023-12-19T05:39:02.713759+0000","last_fullsized":"2023-12-19T05:39:02.713759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703018+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.703018+0000","last_peered":"2023-12-19T05:39:02.703018+0000","last_clean":"2023-12-19T05:39:02.703018+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.703018+0000","last_undegraded":"2023-12-19T05:39:02.703018+0000","last_fullsized":"2023-12-19T05:39:02.703018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719504+0000","last_change":"2023-12-19T05:39:02.719423+0000","last_active":"2023-12-19T05:39:02.719504+0000","last_peered":"2023-12-19T05:39:02.719504+0000","last_clean":"2023-12-19T05:39:02.719504+0000","last_became_active":"2023-12-19T05:39:02.718789+0000","last_became_peered":"2023-12-19T05:39:02.718789+0000","last_unstale":"2023-12-19T05:39:02.719504+0000","last_undegraded":"2023-12-19T05:39:02.719504+0000","last_fullsized":"2023-12-19T05:39:02.719504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727356+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.727356+0000","last_peered":"2023-12-19T05:39:02.727356+0000","last_clean":"2023-12-19T05:39:02.727356+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.727356+0000","last_undegraded":"2023-12-19T05:39:02.727356+0000","last_fullsized":"2023-12-19T05:39:02.727356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.705289+0000","last_change":"2023-12-19T05:39:02.704511+0000","last_active":"2023-12-19T05:39:02.705289+0000","last_peered":"2023-12-19T05:39:02.705289+0000","last_clean":"2023-12-19T05:39:02.705289+0000","last_became_active":"2023-12-19T05:39:02.704290+0000","last_became_peered":"2023-12-19T05:39:02.704290+0000","last_unstale":"2023-12-19T05:39:02.705289+0000","last_undegraded":"2023-12-19T05:39:02.705289+0000","last_fullsized":"2023-12-19T05:39:02.705289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720875+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.720875+0000","last_peered":"2023-12-19T05:39:02.720875+0000","last_clean":"2023-12-19T05:39:02.720875+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.720875+0000","last_undegraded":"2023-12-19T05:39:02.720875+0000","last_fullsized":"2023-12-19T05:39:02.720875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.710295+0000","last_change":"2023-12-19T05:39:02.709021+0000","last_active":"2023-12-19T05:39:02.710295+0000","last_peered":"2023-12-19T05:39:02.710295+0000","last_clean":"2023-12-19T05:39:02.710295+0000","last_became_active":"2023-12-19T05:39:02.708795+0000","last_became_peered":"2023-12-19T05:39:02.708795+0000","last_unstale":"2023-12-19T05:39:02.710295+0000","last_undegraded":"2023-12-19T05:39:02.710295+0000","last_fullsized":"2023-12-19T05:39:02.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723471+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.723471+0000","last_peered":"2023-12-19T05:39:02.723471+0000","last_clean":"2023-12-19T05:39:02.723471+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.723471+0000","last_undegraded":"2023-12-19T05:39:02.723471+0000","last_fullsized":"2023-12-19T05:39:02.723471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711455+0000","last_change":"2023-12-19T05:39:02.710851+0000","last_active":"2023-12-19T05:39:02.711455+0000","last_peered":"2023-12-19T05:39:02.711455+0000","last_clean":"2023-12-19T05:39:02.711455+0000","last_became_active":"2023-12-19T05:39:02.710608+0000","last_became_peered":"2023-12-19T05:39:02.710608+0000","last_unstale":"2023-12-19T05:39:02.711455+0000","last_undegraded":"2023-12-19T05:39:02.711455+0000","last_fullsized":"2023-12-19T05:39:02.711455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726383+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.726383+0000","last_peered":"2023-12-19T05:39:02.726383+0000","last_clean":"2023-12-19T05:39:02.726383+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.726383+0000","last_undegraded":"2023-12-19T05:39:02.726383+0000","last_fullsized":"2023-12-19T05:39:02.726383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707311+0000","last_change":"2023-12-19T05:39:02.705620+0000","last_active":"2023-12-19T05:39:02.707311+0000","last_peered":"2023-12-19T05:39:02.707311+0000","last_clean":"2023-12-19T05:39:02.707311+0000","last_became_active":"2023-12-19T05:39:02.705414+0000","last_became_peered":"2023-12-19T05:39:02.705414+0000","last_unstale":"2023-12-19T05:39:02.707311+0000","last_undegraded":"2023-12-19T05:39:02.707311+0000","last_fullsized":"2023-12-19T05:39:02.707311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715348+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.715348+0000","last_peered":"2023-12-19T05:39:02.715348+0000","last_clean":"2023-12-19T05:39:02.715348+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.715348+0000","last_undegraded":"2023-12-19T05:39:02.715348+0000","last_fullsized":"2023-12-19T05:39:02.715348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.696599+0000","last_change":"2023-12-19T05:39:02.696537+0000","last_active":"2023-12-19T05:39:02.696599+0000","last_peered":"2023-12-19T05:39:02.696599+0000","last_clean":"2023-12-19T05:39:02.696599+0000","last_became_active":"2023-12-19T05:39:02.696310+0000","last_became_peered":"2023-12-19T05:39:02.696310+0000","last_unstale":"2023-12-19T05:39:02.696599+0000","last_undegraded":"2023-12-19T05:39:02.696599+0000","last_fullsized":"2023-12-19T05:39:02.696599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.694722+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:02.694722+0000","last_peered":"2023-12-19T05:39:02.694722+0000","last_clean":"2023-12-19T05:39:02.694722+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:02.694722+0000","last_undegraded":"2023-12-19T05:39:02.694722+0000","last_fullsized":"2023-12-19T05:39:02.694722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689437+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.689437+0000","last_peered":"2023-12-19T05:39:02.689437+0000","last_clean":"2023-12-19T05:39:02.689437+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.689437+0000","last_undegraded":"2023-12-19T05:39:02.689437+0000","last_fullsized":"2023-12-19T05:39:02.689437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711648+0000","last_change":"2023-12-19T05:39:02.711546+0000","last_active":"2023-12-19T05:39:02.711648+0000","last_peered":"2023-12-19T05:39:02.711648+0000","last_clean":"2023-12-19T05:39:02.711648+0000","last_became_active":"2023-12-19T05:39:02.709082+0000","last_became_peered":"2023-12-19T05:39:02.709082+0000","last_unstale":"2023-12-19T05:39:02.711648+0000","last_undegraded":"2023-12-19T05:39:02.711648+0000","last_fullsized":"2023-12-19T05:39:02.711648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691936+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.691936+0000","last_peered":"2023-12-19T05:39:02.691936+0000","last_clean":"2023-12-19T05:39:02.691936+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.691936+0000","last_undegraded":"2023-12-19T05:39:02.691936+0000","last_fullsized":"2023-12-19T05:39:02.691936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719756+0000","last_change":"2023-12-19T05:39:02.718299+0000","last_active":"2023-12-19T05:39:02.719756+0000","last_peered":"2023-12-19T05:39:02.719756+0000","last_clean":"2023-12-19T05:39:02.719756+0000","last_became_active":"2023-12-19T05:39:02.717475+0000","last_became_peered":"2023-12-19T05:39:02.717475+0000","last_unstale":"2023-12-19T05:39:02.719756+0000","last_undegraded":"2023-12-19T05:39:02.719756+0000","last_fullsized":"2023-12-19T05:39:02.719756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701132+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.701132+0000","last_peered":"2023-12-19T05:39:02.701132+0000","last_clean":"2023-12-19T05:39:02.701132+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.701132+0000","last_undegraded":"2023-12-19T05:39:02.701132+0000","last_fullsized":"2023-12-19T05:39:02.701132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711884+0000","last_change":"2023-12-19T05:39:02.711808+0000","last_active":"2023-12-19T05:39:02.711884+0000","last_peered":"2023-12-19T05:39:02.711884+0000","last_clean":"2023-12-19T05:39:02.711884+0000","last_became_active":"2023-12-19T05:39:02.710838+0000","last_became_peered":"2023-12-19T05:39:02.710838+0000","last_unstale":"2023-12-19T05:39:02.711884+0000","last_undegraded":"2023-12-19T05:39:02.711884+0000","last_fullsized":"2023-12-19T05:39:02.711884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.690768+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.690768+0000","last_peered":"2023-12-19T05:39:02.690768+0000","last_clean":"2023-12-19T05:39:02.690768+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.690768+0000","last_undegraded":"2023-12-19T05:39:02.690768+0000","last_fullsized":"2023-12-19T05:39:02.690768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713171+0000","last_change":"2023-12-19T05:39:02.712999+0000","last_active":"2023-12-19T05:39:02.713171+0000","last_peered":"2023-12-19T05:39:02.713171+0000","last_clean":"2023-12-19T05:39:02.713171+0000","last_became_active":"2023-12-19T05:39:02.712612+0000","last_became_peered":"2023-12-19T05:39:02.712612+0000","last_unstale":"2023-12-19T05:39:02.713171+0000","last_undegraded":"2023-12-19T05:39:02.713171+0000","last_fullsized":"2023-12-19T05:39:02.713171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700616+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.700616+0000","last_peered":"2023-12-19T05:39:02.700616+0000","last_clean":"2023-12-19T05:39:02.700616+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.700616+0000","last_undegraded":"2023-12-19T05:39:02.700616+0000","last_fullsized":"2023-12-19T05:39:02.700616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721066+0000","last_change":"2023-12-19T05:39:02.719234+0000","last_active":"2023-12-19T05:39:02.721066+0000","last_peered":"2023-12-19T05:39:02.721066+0000","last_clean":"2023-12-19T05:39:02.721066+0000","last_became_active":"2023-12-19T05:39:02.718998+0000","last_became_peered":"2023-12-19T05:39:02.718998+0000","last_unstale":"2023-12-19T05:39:02.721066+0000","last_undegraded":"2023-12-19T05:39:02.721066+0000","last_fullsized":"2023-12-19T05:39:02.721066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691685+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.691685+0000","last_peered":"2023-12-19T05:39:02.691685+0000","last_clean":"2023-12-19T05:39:02.691685+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.691685+0000","last_undegraded":"2023-12-19T05:39:02.691685+0000","last_fullsized":"2023-12-19T05:39:02.691685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.725731+0000","last_change":"2023-12-19T05:39:02.725655+0000","last_active":"2023-12-19T05:39:02.725731+0000","last_peered":"2023-12-19T05:39:02.725731+0000","last_clean":"2023-12-19T05:39:02.725731+0000","last_became_active":"2023-12-19T05:39:02.725276+0000","last_became_peered":"2023-12-19T05:39:02.725276+0000","last_unstale":"2023-12-19T05:39:02.725731+0000","last_undegraded":"2023-12-19T05:39:02.725731+0000","last_fullsized":"2023-12-19T05:39:02.725731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703423+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:02.703423+0000","last_peered":"2023-12-19T05:39:02.703423+0000","last_clean":"2023-12-19T05:39:02.703423+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:02.703423+0000","last_undegraded":"2023-12-19T05:39:02.703423+0000","last_fullsized":"2023-12-19T05:39:02.703423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720870+0000","last_change":"2023-12-19T05:39:02.719751+0000","last_active":"2023-12-19T05:39:02.720870+0000","last_peered":"2023-12-19T05:39:02.720870+0000","last_clean":"2023-12-19T05:39:02.720870+0000","last_became_active":"2023-12-19T05:39:02.719489+0000","last_became_peered":"2023-12-19T05:39:02.719489+0000","last_unstale":"2023-12-19T05:39:02.720870+0000","last_undegraded":"2023-12-19T05:39:02.720870+0000","last_fullsized":"2023-12-19T05:39:02.720870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721695+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.721695+0000","last_peered":"2023-12-19T05:39:02.721695+0000","last_clean":"2023-12-19T05:39:02.721695+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.721695+0000","last_undegraded":"2023-12-19T05:39:02.721695+0000","last_fullsized":"2023-12-19T05:39:02.721695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719332+0000","last_change":"2023-12-19T05:39:02.719256+0000","last_active":"2023-12-19T05:39:02.719332+0000","last_peered":"2023-12-19T05:39:02.719332+0000","last_clean":"2023-12-19T05:39:02.719332+0000","last_became_active":"2023-12-19T05:39:02.718985+0000","last_became_peered":"2023-12-19T05:39:02.718985+0000","last_unstale":"2023-12-19T05:39:02.719332+0000","last_undegraded":"2023-12-19T05:39:02.719332+0000","last_fullsized":"2023-12-19T05:39:02.719332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700486+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.700486+0000","last_peered":"2023-12-19T05:39:02.700486+0000","last_clean":"2023-12-19T05:39:02.700486+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.700486+0000","last_undegraded":"2023-12-19T05:39:02.700486+0000","last_fullsized":"2023-12-19T05:39:02.700486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.697089+0000","last_change":"2023-12-19T05:39:02.696856+0000","last_active":"2023-12-19T05:39:02.697089+0000","last_peered":"2023-12-19T05:39:02.697089+0000","last_clean":"2023-12-19T05:39:02.697089+0000","last_became_active":"2023-12-19T05:39:02.696670+0000","last_became_peered":"2023-12-19T05:39:02.696670+0000","last_unstale":"2023-12-19T05:39:02.697089+0000","last_undegraded":"2023-12-19T05:39:02.697089+0000","last_fullsized":"2023-12-19T05:39:02.697089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695338+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.695338+0000","last_peered":"2023-12-19T05:39:02.695338+0000","last_clean":"2023-12-19T05:39:02.695338+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.695338+0000","last_undegraded":"2023-12-19T05:39:02.695338+0000","last_fullsized":"2023-12-19T05:39:02.695338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715781+0000","last_change":"2023-12-19T05:39:02.715604+0000","last_active":"2023-12-19T05:39:02.715781+0000","last_peered":"2023-12-19T05:39:02.715781+0000","last_clean":"2023-12-19T05:39:02.715781+0000","last_became_active":"2023-12-19T05:39:02.715340+0000","last_became_peered":"2023-12-19T05:39:02.715340+0000","last_unstale":"2023-12-19T05:39:02.715781+0000","last_undegraded":"2023-12-19T05:39:02.715781+0000","last_fullsized":"2023-12-19T05:39:02.715781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.714039+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.714039+0000","last_peered":"2023-12-19T05:39:02.714039+0000","last_clean":"2023-12-19T05:39:02.714039+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.714039+0000","last_undegraded":"2023-12-19T05:39:02.714039+0000","last_fullsized":"2023-12-19T05:39:02.714039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719903+0000","last_change":"2023-12-19T05:39:02.719822+0000","last_active":"2023-12-19T05:39:02.719903+0000","last_peered":"2023-12-19T05:39:02.719903+0000","last_clean":"2023-12-19T05:39:02.719903+0000","last_became_active":"2023-12-19T05:39:02.719603+0000","last_became_peered":"2023-12-19T05:39:02.719603+0000","last_unstale":"2023-12-19T05:39:02.719903+0000","last_undegraded":"2023-12-19T05:39:02.719903+0000","last_fullsized":"2023-12-19T05:39:02.719903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722064+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.722064+0000","last_peered":"2023-12-19T05:39:02.722064+0000","last_clean":"2023-12-19T05:39:02.722064+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.722064+0000","last_undegraded":"2023-12-19T05:39:02.722064+0000","last_fullsized":"2023-12-19T05:39:02.722064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.698331+0000","last_change":"2023-12-19T05:39:02.698107+0000","last_active":"2023-12-19T05:39:02.698331+0000","last_peered":"2023-12-19T05:39:02.698331+0000","last_clean":"2023-12-19T05:39:02.698331+0000","last_became_active":"2023-12-19T05:39:02.696242+0000","last_became_peered":"2023-12-19T05:39:02.696242+0000","last_unstale":"2023-12-19T05:39:02.698331+0000","last_undegraded":"2023-12-19T05:39:02.698331+0000","last_fullsized":"2023-12-19T05:39:02.698331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709142+0000","last_change":"2023-12-19T05:39:02.709072+0000","last_active":"2023-12-19T05:39:02.709142+0000","last_peered":"2023-12-19T05:39:02.709142+0000","last_clean":"2023-12-19T05:39:02.709142+0000","last_became_active":"2023-12-19T05:39:02.708202+0000","last_became_peered":"2023-12-19T05:39:02.708202+0000","last_unstale":"2023-12-19T05:39:02.709142+0000","last_undegraded":"2023-12-19T05:39:02.709142+0000","last_fullsized":"2023-12-19T05:39:02.709142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713469+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.713469+0000","last_peered":"2023-12-19T05:39:02.713469+0000","last_clean":"2023-12-19T05:39:02.713469+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.713469+0000","last_undegraded":"2023-12-19T05:39:02.713469+0000","last_fullsized":"2023-12-19T05:39:02.713469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707208+0000","last_change":"2023-12-19T05:39:02.706972+0000","last_active":"2023-12-19T05:39:02.707208+0000","last_peered":"2023-12-19T05:39:02.707208+0000","last_clean":"2023-12-19T05:39:02.707208+0000","last_became_active":"2023-12-19T05:39:02.702711+0000","last_became_peered":"2023-12-19T05:39:02.702711+0000","last_unstale":"2023-12-19T05:39:02.707208+0000","last_undegraded":"2023-12-19T05:39:02.707208+0000","last_fullsized":"2023-12-19T05:39:02.707208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713207+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.713207+0000","last_peered":"2023-12-19T05:39:02.713207+0000","last_clean":"2023-12-19T05:39:02.713207+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.713207+0000","last_undegraded":"2023-12-19T05:39:02.713207+0000","last_fullsized":"2023-12-19T05:39:02.713207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718496+0000","last_change":"2023-12-19T05:39:02.714964+0000","last_active":"2023-12-19T05:39:02.718496+0000","last_peered":"2023-12-19T05:39:02.718496+0000","last_clean":"2023-12-19T05:39:02.718496+0000","last_became_active":"2023-12-19T05:39:02.713835+0000","last_became_peered":"2023-12-19T05:39:02.713835+0000","last_unstale":"2023-12-19T05:39:02.718496+0000","last_undegraded":"2023-12-19T05:39:02.718496+0000","last_fullsized":"2023-12-19T05:39:02.718496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726982+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.726982+0000","last_peered":"2023-12-19T05:39:02.726982+0000","last_clean":"2023-12-19T05:39:02.726982+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.726982+0000","last_undegraded":"2023-12-19T05:39:02.726982+0000","last_fullsized":"2023-12-19T05:39:02.726982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718442+0000","last_change":"2023-12-19T05:39:02.714203+0000","last_active":"2023-12-19T05:39:02.718442+0000","last_peered":"2023-12-19T05:39:02.718442+0000","last_clean":"2023-12-19T05:39:02.718442+0000","last_became_active":"2023-12-19T05:39:02.713955+0000","last_became_peered":"2023-12-19T05:39:02.713955+0000","last_unstale":"2023-12-19T05:39:02.718442+0000","last_undegraded":"2023-12-19T05:39:02.718442+0000","last_fullsized":"2023-12-19T05:39:02.718442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727404+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.727404+0000","last_peered":"2023-12-19T05:39:02.727404+0000","last_clean":"2023-12-19T05:39:02.727404+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.727404+0000","last_undegraded":"2023-12-19T05:39:02.727404+0000","last_fullsized":"2023-12-19T05:39:02.727404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:13.308 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:39:13.308 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T05:39:13.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T05:39:13.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T05:39:13.309 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T05:39:13.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.581+0000 7f4ee5173640 1 Processor -- start 2023-12-19T05:39:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.581+0000 7f4ee5173640 1 -- start start 2023-12-19T05:39:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.583+0000 7f4ee5173640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.583+0000 7f4ee5173640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 0x7f4ee006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.583+0000 7f4ee5173640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00afb10 con 0x7f4ee006b590 2023-12-19T05:39:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.583+0000 7f4ee5173640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee006bb30 con 0x7f4ee00b0b50 2023-12-19T05:39:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.583+0000 7f4ee5173640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00b0070 con 0x7f4ee01449e0 2023-12-19T05:39:13.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.584+0000 7f4ed7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 0x7f4ee006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.584+0000 7f4eded9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.584+0000 7f4ed7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 0x7f4ee006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:48644/0 (socket says 172.21.15.49:48644) 2023-12-19T05:39:13.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.584+0000 7f4ed7fff640 1 -- 172.21.15.49:0/1208251608 learned_addr learned my addr 172.21.15.49:0/1208251608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:13.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.585+0000 7f4eded9d640 1 -- 172.21.15.49:0/1208251608 >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 msgr2=0x7f4ee006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:13.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.585+0000 7f4eded9d640 1 --2- 172.21.15.49:0/1208251608 >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 0x7f4ee006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.585+0000 7f4eded9d640 1 -- 172.21.15.49:0/1208251608 >> v1:172.21.15.115:6789/0 conn(0x7f4ee006b590 legacy=0x7f4ee015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.585+0000 7f4ede59c640 1 -- 172.21.15.49:0/1208251608 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323483765 0 0) 0x7f4ee00afb10 con 0x7f4ee006b590 2023-12-19T05:39:13.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.585+0000 7f4eded9d640 1 -- 172.21.15.49:0/1208251608 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00b0350 con 0x7f4ee01449e0 2023-12-19T05:39:13.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.586+0000 7f4eded9d640 1 --2- 172.21.15.49:0/1208251608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee00af5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4777b664eaf1b81a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.586+0000 7f4ede59c640 1 -- 172.21.15.49:0/1208251608 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0031830 con 0x7f4ee01449e0 2023-12-19T05:39:13.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ede59c640 1 -- 172.21.15.49:0/1208251608 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0031990 con 0x7f4ee01449e0 2023-12-19T05:39:13.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ede59c640 1 -- 172.21.15.49:0/1208251608 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0031d20 con 0x7f4ee01449e0 2023-12-19T05:39:13.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 -- 172.21.15.49:0/1208251608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 msgr2=0x7f4ee00af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 --2- 172.21.15.49:0/1208251608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee00af5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 -- 172.21.15.49:0/1208251608 shutdown_connections 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 --2- 172.21.15.49:0/1208251608 >> v2:172.21.15.115:3300/0 conn(0x7f4ee00b0b50 0x7f4ee006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 --2- 172.21.15.49:0/1208251608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee00af5d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 -- 172.21.15.49:0/1208251608 >> 172.21.15.49:0/1208251608 conn(0x7f4ee00cbb70 msgr2=0x7f4ee00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 -- 172.21.15.49:0/1208251608 shutdown_connections 2023-12-19T05:39:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.587+0000 7f4ee5173640 1 -- 172.21.15.49:0/1208251608 wait complete. 2023-12-19T05:39:13.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.589+0000 7f4ee5173640 1 Processor -- start 2023-12-19T05:39:13.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.589+0000 7f4ee5173640 1 -- start start 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ee006b590 0x7f4ee01f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee015d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cdbe0 con 0x7f4ee00b0b50 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee01f38c0 con 0x7f4ee006b590 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.590+0000 7f4ee5173640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cd060 con 0x7f4ee01449e0 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54900/0 (socket says 172.21.15.49:54900) 2023-12-19T05:39:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 -- 172.21.15.49:0/2242609323 learned_addr learned my addr 172.21.15.49:0/2242609323 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4eded9d640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ee006b590 0x7f4ee01f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4edf59e640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 -- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 msgr2=0x7f4ee015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee015d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 -- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ee006b590 msgr2=0x7f4ee01f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ee006b590 0x7f4ee01f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 -- 172.21.15.49:0/2242609323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009400 con 0x7f4ee00b0b50 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.591+0000 7f4ed7fff640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009fd0 tx=0x7f4ec800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.592+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800c940 con 0x7f4ee00b0b50 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.592+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800caa0 con 0x7f4ee00b0b50 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.592+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800ce30 con 0x7f4ee00b0b50 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.592+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00cd340 con 0x7f4ee00b0b50 2023-12-19T05:39:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.592+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee00cd900 con 0x7f4ee00b0b50 2023-12-19T05:39:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.593+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee0061910 con 0x7f4ee00b0b50 2023-12-19T05:39:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.594+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ec8013470 con 0x7f4ee00b0b50 2023-12-19T05:39:13.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.595+0000 7f4ed77fe640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 0x7f4ec006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:13.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.595+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ec8088a70 con 0x7f4ee00b0b50 2023-12-19T05:39:13.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.596+0000 7f4eded9d640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 0x7f4ec006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:13.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.597+0000 7f4eded9d640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 0x7f4ec006c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0036000 tx=0x7f4ed0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:13.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.600+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ec8054050 con 0x7f4ee00b0b50 2023-12-19T05:39:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.845+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4ee00ae560 con 0x7f4ee00b0b50 2023-12-19T05:39:13.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.854+0000 7f4ed77fe640 1 -- 172.21.15.49:0/2242609323 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169969 (secure 0 0 0) 0x7f4ec8017090 con 0x7f4ee00b0b50 2023-12-19T05:39:13.858 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 msgr2=0x7f4ec006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 0x7f4ec006c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0036000 tx=0x7f4ed0008030 comp rx=0 tx=0).stop 2023-12-19T05:39:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 msgr2=0x7f4ee0158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009fd0 tx=0x7f4ec800ed40 comp rx=0 tx=0).stop 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 shutdown_connections 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ec006a430 0x7f4ec006c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ee01449e0 0x7f4ee015d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ee00b0b50 0x7f4ee0158be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 --2- 172.21.15.49:0/2242609323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ee006b590 0x7f4ee01f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 >> 172.21.15.49:0/2242609323 conn(0x7f4ee00cbb70 msgr2=0x7f4ee00cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 shutdown_connections 2023-12-19T05:39:13.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:13.858+0000 7f4ee5173640 1 -- 172.21.15.49:0/2242609323 wait complete. 2023-12-19T05:39:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":83870},{"type":"v1","addr":"172.21.15.115:6833","nonce":83870}]},"active_addr":"172.21.15.115:6833/83870","active_change":"2023-12-19T05:38:50.473252+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":2184031575}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":2180976531}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1602563041}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":801226821}]}]} 2023-12-19T05:39:13.882 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T05:39:13.882 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T05:39:13.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.106+0000 7f0644f8e640 1 Processor -- start 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.106+0000 7f0644f8e640 1 -- start start 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0644f8e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f064015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0644f8e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06400cdbf0 0x7f06400ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0644f8e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064015ec30 con 0x7f064015e5a0 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0644f8e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400ce5c0 con 0x7f06400cdbf0 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0644f8e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064015fbc0 con 0x7f06400b2030 2023-12-19T05:39:14.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f063f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f064015e5a0 0x7f06400b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41154/0 (socket says 172.21.15.49:41154) 2023-12-19T05:39:14.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f063f7fe640 1 -- 172.21.15.49:0/1968974764 learned_addr learned my addr 172.21.15.49:0/1968974764 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178258460 0 0) 0x7f064015ec30 con 0x7f064015e5a0 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f0637fff640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f064015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c003520 con 0x7f064015e5a0 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.108+0000 7f063ffff640 1 --2- 172.21.15.49:0/1968974764 >> v2:172.21.15.115:3300/0 conn(0x7f06400cdbf0 0x7f06400ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791879037 0 0) 0x7f062c003520 con 0x7f064015e5a0 2023-12-19T05:39:14.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 msgr2=0x7f064015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f064015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 >> v2:172.21.15.115:3300/0 conn(0x7f06400cdbf0 msgr2=0x7f06400ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 --2- 172.21.15.49:0/1968974764 >> v2:172.21.15.115:3300/0 conn(0x7f06400cdbf0 0x7f06400ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064015e980 con 0x7f064015e5a0 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0630001670 con 0x7f064015e5a0 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 >> v1:172.21.15.49:6789/0 conn(0x7f064015e5a0 legacy=0x7f06400b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f062c003970 0x7f062c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c0047c0 0x7f062c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f062c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400ce5c0 con 0x7f062c003970 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064015fbc0 con 0x7f062c0047c0 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c00b980 con 0x7f06400b2030 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.109+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f062c003970 0x7f062c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f0637fff640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c0047c0 0x7f062c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063f7fe640 1 -- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 msgr2=0x7f062c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063ffff640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f062c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06400b2030 0x7f062c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063f7fe640 1 -- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c0047c0 msgr2=0x7f062c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c0047c0 0x7f062c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.110+0000 7f063f7fe640 1 -- 172.21.15.49:0/1968974764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c003520 con 0x7f062c003970 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.111+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f062c003970 0x7f062c003d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f063000c110 tx=0x7f062c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b13a1415f5bcee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.111+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630005ad0 con 0x7f062c003970 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.111+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630005c50 con 0x7f062c003970 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.111+0000 7f063effd640 1 -- 172.21.15.49:0/1968974764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063002c830 con 0x7f062c003970 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 -- 172.21.15.49:0/1968974764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f062c003970 msgr2=0x7f062c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1968974764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f062c003970 0x7f062c003d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f063000c110 tx=0x7f062c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f063ffff640 1 -- 172.21.15.49:0/1968974764 reap_dead start 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 -- 172.21.15.49:0/1968974764 shutdown_connections 2023-12-19T05:39:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 -- 172.21.15.49:0/1968974764 >> 172.21.15.49:0/1968974764 conn(0x7f06400b0100 msgr2=0x7f06400b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 -- 172.21.15.49:0/1968974764 shutdown_connections 2023-12-19T05:39:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.112+0000 7f0644f8e640 1 -- 172.21.15.49:0/1968974764 wait complete. 2023-12-19T05:39:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.114+0000 7f0644f8e640 1 Processor -- start 2023-12-19T05:39:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.114+0000 7f0644f8e640 1 -- start start 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 0x7f06401f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f064013ae50 0x7f064013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064013b800 con 0x7f064014c860 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064013ea20 con 0x7f062c003970 2023-12-19T05:39:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0644f8e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06401f5150 con 0x7f064013ae50 2023-12-19T05:39:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0637fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0637fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33576/0 (socket says 172.21.15.49:33576) 2023-12-19T05:39:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.115+0000 7f0637fff640 1 -- 172.21.15.49:0/1041579801 learned_addr learned my addr 172.21.15.49:0/1041579801 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 0x7f06401f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063ffff640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f064013ae50 0x7f064013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 -- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f064013ae50 msgr2=0x7f064013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f064013ae50 0x7f064013b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 -- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 msgr2=0x7f06401f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 0x7f06401f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 -- 172.21.15.49:0/1041579801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064013db30 con 0x7f064014c860 2023-12-19T05:39:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 0x7f06401f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0637fff640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0628010890 tx=0x7f0628010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800eb60 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800ecc0 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062801c400 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064013de10 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.116+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064013e3d0 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.117+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640061910 con 0x7f064014c860 2023-12-19T05:39:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.118+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f062801c560 con 0x7f064014c860 2023-12-19T05:39:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.120+0000 7f063cff9640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 0x7f062006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.120+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0628088f20 con 0x7f064014c860 2023-12-19T05:39:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.120+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 0x7f062006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.121+0000 7f063f7fe640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 0x7f062006c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f0630007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.124+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0628054520 con 0x7f064014c860 2023-12-19T05:39:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.321+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06400ce980 con 0x7f064014c860 2023-12-19T05:39:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.323+0000 7f063cff9640 1 -- 172.21.15.49:0/1041579801 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f0628057b40 con 0x7f064014c860 2023-12-19T05:39:14.324 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:14.324 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 msgr2=0x7f062006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 0x7f062006c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f0630007000 comp rx=0 tx=0).stop 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 msgr2=0x7f0640158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0628010890 tx=0x7f0628010d50 comp rx=0 tx=0).stop 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 shutdown_connections 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f062006a460 0x7f062006c920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f064013ae50 0x7f064013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.325+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064014c860 0x7f0640158a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.326+0000 7f0644f8e640 1 --2- 172.21.15.49:0/1041579801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f062c003970 0x7f06401f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.326+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 >> 172.21.15.49:0/1041579801 conn(0x7f06400b0100 msgr2=0x7f06400ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.326+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 shutdown_connections 2023-12-19T05:39:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.326+0000 7f0644f8e640 1 -- 172.21.15.49:0/1041579801 wait complete. 2023-12-19T05:39:14.345 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T05:39:14.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:14.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.567+0000 7fe1b359e640 1 Processor -- start 2023-12-19T05:39:14.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.567+0000 7fe1b359e640 1 -- start start 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.569+0000 7fe1b359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1b4161810 0x7fe1b40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.569+0000 7fe1b359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1b40ce660 0x7fe1b406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.569+0000 7fe1b359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40b22b0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.569+0000 7fe1b359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b4161bf0 con 0x7fe1b4161810 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.569+0000 7fe1b359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40b2830 con 0x7fe1b40ce660 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1b4161810 0x7fe1b40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1b4161810 0x7fe1b40cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33580/0 (socket says 172.21.15.49:33580) 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 -- 172.21.15.49:0/1324437147 learned_addr learned my addr 172.21.15.49:0/1324437147 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b2d9d640 1 --2- 172.21.15.49:0/1324437147 >> v2:172.21.15.115:3300/0 conn(0x7fe1b40ce660 0x7fe1b406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 -- 172.21.15.49:0/1324437147 >> v2:172.21.15.115:3300/0 conn(0x7fe1b40ce660 msgr2=0x7fe1b406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 --2- 172.21.15.49:0/1324437147 >> v2:172.21.15.115:3300/0 conn(0x7fe1b40ce660 0x7fe1b406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 -- 172.21.15.49:0/1324437147 >> v1:172.21.15.115:6789/0 conn(0x7fe1b40cc8a0 legacy=0x7fe1b40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.570+0000 7fe1b259c640 1 -- 172.21.15.49:0/1324437147 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40b2550 con 0x7fe1b4161810 2023-12-19T05:39:14.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.571+0000 7fe1b259c640 1 --2- 172.21.15.49:0/1324437147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b4161810 0x7fe1b40cc360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406b310 tx=0x7fe1a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74083f30c2ba166e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.572+0000 7fe1b1d9b640 1 -- 172.21.15.49:0/1324437147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40317e0 con 0x7fe1b4161810 2023-12-19T05:39:14.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.572+0000 7fe1b1d9b640 1 -- 172.21.15.49:0/1324437147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4031940 con 0x7fe1b4161810 2023-12-19T05:39:14.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.572+0000 7fe1b1d9b640 1 -- 172.21.15.49:0/1324437147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4031cd0 con 0x7fe1b4161810 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.572+0000 7fe1b359e640 1 -- 172.21.15.49:0/1324437147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b4161810 msgr2=0x7fe1b40cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.572+0000 7fe1b359e640 1 --2- 172.21.15.49:0/1324437147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b4161810 0x7fe1b40cc360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406b310 tx=0x7fe1a402b880 comp rx=0 tx=0).stop 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 -- 172.21.15.49:0/1324437147 shutdown_connections 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 --2- 172.21.15.49:0/1324437147 >> v2:172.21.15.115:3300/0 conn(0x7fe1b40ce660 0x7fe1b406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 --2- 172.21.15.49:0/1324437147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b4161810 0x7fe1b40cc360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 -- 172.21.15.49:0/1324437147 >> 172.21.15.49:0/1324437147 conn(0x7fe1b40b0100 msgr2=0x7fe1b40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 -- 172.21.15.49:0/1324437147 shutdown_connections 2023-12-19T05:39:14.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.573+0000 7fe1b359e640 1 -- 172.21.15.49:0/1324437147 wait complete. 2023-12-19T05:39:14.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.574+0000 7fe1b359e640 1 Processor -- start 2023-12-19T05:39:14.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.575+0000 7fe1b359e640 1 -- start start 2023-12-19T05:39:14.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 0x7fe1b414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1b4161810 0x7fe1b415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415a9f0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415acd0 con 0x7fe1b40ce660 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415afb0 con 0x7fe1b4161810 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33592/0 (socket says 172.21.15.49:33592) 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 -- 172.21.15.49:0/2975462473 learned_addr learned my addr 172.21.15.49:0/2975462473 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1abfff640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 0x7fe1b414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 -- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1b4161810 msgr2=0x7fe1b415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1b4161810 0x7fe1b415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 -- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 msgr2=0x7fe1b414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 0x7fe1b414b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1b259c640 1 -- 172.21.15.49:0/2975462473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40094d0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.576+0000 7fe1abfff640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 0x7fe1b414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:14.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1b259c640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1a402b8c0 tx=0x7fe1a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4032880 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a40329e0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4032d90 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b415b290 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.577+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b4160ef0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.578+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b40cbff0 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.579+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1a404e450 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.580+0000 7fe1aaffd640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 0x7fe19406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.580+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1a40aab00 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.581+0000 7fe1abfff640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 0x7fe19406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.582+0000 7fe1abfff640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 0x7fe19406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40cc870 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.584+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1a40ace60 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.780+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b4061910 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.782+0000 7fe1aaffd640 1 -- 172.21.15.49:0/2975462473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fe1a4076100 con 0x7fe1b40cc8a0 2023-12-19T05:39:14.784 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:14.784 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:14.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.784+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 msgr2=0x7fe19406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 0x7fe19406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40cc870 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 msgr2=0x7fe1b41609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1a402b8c0 tx=0x7fe1a40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 shutdown_connections 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe19406a430 0x7fe19406c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1b4161810 0x7fe1b415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1b40ce660 0x7fe1b414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 --2- 172.21.15.49:0/2975462473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1b40cc8a0 0x7fe1b41609b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 >> 172.21.15.49:0/2975462473 conn(0x7fe1b40b0100 msgr2=0x7fe1b40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 shutdown_connections 2023-12-19T05:39:14.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:14.785+0000 7fe1b359e640 1 -- 172.21.15.49:0/2975462473 wait complete. 2023-12-19T05:39:14.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T05:39:14.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T05:39:14.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T05:39:14.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T05:39:14.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T05:39:14.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T05:39:14.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T05:39:14.810 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T05:39:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.135+0000 7faeed462640 1 Processor -- start 2023-12-19T05:39:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.136+0000 7faeed462640 1 -- start start 2023-12-19T05:39:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.137+0000 7fd70e31b640 1 Processor -- start 2023-12-19T05:39:15.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.137+0000 7fd70e31b640 1 -- start start 2023-12-19T05:39:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.138+0000 7faeed462640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faee80b8070 0x7faee80d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.138+0000 7faeed462640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80d12d0 con 0x7faee80d0a90 2023-12-19T05:39:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.138+0000 7faeed462640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80d15b0 con 0x7faee8146e30 2023-12-19T05:39:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.138+0000 7faeed462640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee8147210 con 0x7faee80b8070 2023-12-19T05:39:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7faee7fff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7faee8146e30 0x7faee80b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58674/0 (socket says 172.21.15.49:58674) 2023-12-19T05:39:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7faee7fff640 1 -- 172.21.15.49:0/2141455809 learned_addr learned my addr 172.21.15.49:0/2141455809 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7faee77fe640 1 --2- 172.21.15.49:0/2141455809 >> v2:172.21.15.49:3300/0 conn(0x7faee80b8070 0x7faee80d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7fd70e31b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd708162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7fd70e31b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7080b6820 0x7fd7080b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7fd70e31b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7080b4660 con 0x7fd708146ef0 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7fd70e31b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080b82c0 con 0x7fd7080b6820 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.139+0000 7fd70e31b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd708162dd0 con 0x7fd7081446e0 2023-12-19T05:39:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7f9d911d0640 1 Processor -- start 2023-12-19T05:39:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7080b6820 0x7fd7080b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7080b6820 0x7fd7080b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33616/0 (socket says 172.21.15.49:33616) 2023-12-19T05:39:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 -- 172.21.15.49:0/1111104619 learned_addr learned my addr 172.21.15.49:0/1111104619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70d319640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd708162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420590297 0 0) 0x7faee80d15b0 con 0x7faee8146e30 2023-12-19T05:39:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed0003520 con 0x7faee8146e30 2023-12-19T05:39:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289240734 0 0) 0x7faee80d12d0 con 0x7faee80d0a90 2023-12-19T05:39:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee80d15b0 con 0x7faee80d0a90 2023-12-19T05:39:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 -- 172.21.15.49:0/1111104619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 msgr2=0x7fd708162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd708162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.140+0000 7fd70db1a640 1 -- 172.21.15.49:0/1111104619 >> v1:172.21.15.115:6789/0 conn(0x7fd708146ef0 legacy=0x7fd7080b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7fd70db1a640 1 -- 172.21.15.49:0/1111104619 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7081474b0 con 0x7fd7080b6820 2023-12-19T05:39:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7fcd14cb6640 1 Processor -- start 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7fcd14cb6640 1 -- start start 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171493699 0 0) 0x7faee80d15b0 con 0x7faee80d0a90 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 >> v2:172.21.15.49:3300/0 conn(0x7faee80b8070 msgr2=0x7faee80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 --2- 172.21.15.49:0/2141455809 >> v2:172.21.15.49:3300/0 conn(0x7faee80b8070 0x7faee80d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 >> v1:172.21.15.115:6789/0 conn(0x7faee8146e30 legacy=0x7faee80b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80d1890 con 0x7faee80d0a90 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7faedc0015f0 con 0x7faee80d0a90 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 >> v1:172.21.15.49:6789/0 conn(0x7faee80d0a90 legacy=0x7faee815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed0004bb0 0x7faed0004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0003760 0x7faed0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faed000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8147210 con 0x7faed0004170 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed000c100 con 0x7faed0004bb0 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed000c2c0 con 0x7faed0003760 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.142+0000 7fd70db1a640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7080b6820 0x7fd7080b4120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd704009870 tx=0x7fd70402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9e35a4a53274ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7fd6fffff640 1 -- 172.21.15.49:0/1111104619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704031870 con 0x7fd7080b6820 2023-12-19T05:39:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7fd6fffff640 1 -- 172.21.15.49:0/1111104619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7040319d0 con 0x7fd7080b6820 2023-12-19T05:39:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7faeecc61640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faed000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7fd6fffff640 1 -- 172.21.15.49:0/1111104619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704031d40 con 0x7fd7080b6820 2023-12-19T05:39:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faee7fff640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed0004bb0 0x7faed0004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.141+0000 7f9d911d0640 1 -- start start 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7f9d911d0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d8c0cb180 0x7f9d8c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7f9d911d0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0cbdd0 con 0x7f9d8c0b04e0 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7f9d911d0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0b32c0 con 0x7f9d8c159320 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.143+0000 7f9d911d0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c070380 con 0x7f9d8c0cb180 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7fd70e31b640 1 -- 172.21.15.49:0/1111104619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7080b6820 msgr2=0x7fd7080b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7fd70e31b640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7080b6820 0x7fd7080b4120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd704009870 tx=0x7fd70402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faee77fe640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0003760 0x7faed0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faeecc61640 1 -- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0003760 msgr2=0x7faed0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faeecc61640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0003760 0x7faed0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faeecc61640 1 -- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed0004bb0 msgr2=0x7faed0004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faeecc61640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed0004bb0 0x7faed0004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.144+0000 7faeecc61640 1 -- 172.21.15.49:0/2141455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80d15b0 con 0x7faed0004170 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7fcd14cb6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7fcd14cb6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd0803a6e0 0x7fcd080386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7fcd14cb6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080e3450 con 0x7fcd08038be0 2023-12-19T05:39:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7fcd14cb6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd08050270 con 0x7fcd0803a6e0 2023-12-19T05:39:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7fcd14cb6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08050550 con 0x7fcd08033e70 2023-12-19T05:39:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.146+0000 7faeecc61640 1 -- 172.21.15.49:0/2141455809 reap_dead start 2023-12-19T05:39:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.146+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.146+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41356/0 (socket says 172.21.15.49:41356) 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7f9d8ad9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9d8c159320 0x7f9d8c0b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58696/0 (socket says 172.21.15.49:58696) 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7f9d8ad9d640 1 -- 172.21.15.49:0/1542451138 learned_addr learned my addr 172.21.15.49:0/1542451138 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7f9d8b59e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d8c0b04e0 0x7f9d8c15d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41170/0 (socket says 172.21.15.49:41170) 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.145+0000 7f9d8a59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d8c0cb180 0x7f9d8c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.146+0000 7fcd0e59c640 1 -- 172.21.15.49:0/3200413497 learned_addr learned my addr 172.21.15.49:0/3200413497 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.146+0000 7faeecc61640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faed000b980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faedc007e10 tx=0x7faed00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41668a0f604adf04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fcd0dd9b640 1 --2- 172.21.15.49:0/3200413497 >> v2:172.21.15.115:3300/0 conn(0x7fcd0803a6e0 0x7fcd080386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7f9d8a59c640 1 -- 172.21.15.49:0/1542451138 >> v1:172.21.15.115:6789/0 conn(0x7f9d8c159320 legacy=0x7f9d8c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fcd0e59c640 1 -- 172.21.15.49:0/3200413497 >> v2:172.21.15.115:3300/0 conn(0x7fcd0803a6e0 msgr2=0x7fcd080386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc02c810 con 0x7faed0004170 2023-12-19T05:39:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fcd0e59c640 1 --2- 172.21.15.49:0/3200413497 >> v2:172.21.15.115:3300/0 conn(0x7fcd0803a6e0 0x7fcd080386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc02c990 con 0x7faed0004170 2023-12-19T05:39:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7faee6ffd640 1 -- 172.21.15.49:0/2141455809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc02cd40 con 0x7faed0004170 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fcd0e59c640 1 -- 172.21.15.49:0/3200413497 >> v1:172.21.15.49:6789/0 conn(0x7fcd08038be0 legacy=0x7fcd080e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 -- 172.21.15.49:0/1111104619 shutdown_connections 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7080b6820 0x7fd7080b4120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 --2- 172.21.15.49:0/1111104619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd708162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 -- 172.21.15.49:0/1111104619 >> 172.21.15.49:0/1111104619 conn(0x7fd7080cfb90 msgr2=0x7fd7080cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 -- 172.21.15.49:0/1111104619 shutdown_connections 2023-12-19T05:39:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.147+0000 7fd70e31b640 1 -- 172.21.15.49:0/1111104619 wait complete. 2023-12-19T05:39:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7f9d8a59c640 1 -- 172.21.15.49:0/1542451138 >> v1:172.21.15.49:6789/0 conn(0x7f9d8c0b04e0 legacy=0x7f9d8c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7f9d8a59c640 1 -- 172.21.15.49:0/1542451138 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c070660 con 0x7f9d8c0cb180 2023-12-19T05:39:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7faeed462640 1 -- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 msgr2=0x7faed000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7faeed462640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faed000b980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faedc007e10 tx=0x7faed00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7fcd0e59c640 1 -- 172.21.15.49:0/3200413497 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08050830 con 0x7fcd08033e70 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.149+0000 7faeed462640 1 -- 172.21.15.49:0/2141455809 shutdown_connections 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.149+0000 7faeed462640 1 --2- 172.21.15.49:0/2141455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faed000b980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.149+0000 7faeed462640 1 -- 172.21.15.49:0/2141455809 >> 172.21.15.49:0/2141455809 conn(0x7faee80b2990 msgr2=0x7faee80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7f8347262640 1 Processor -- start 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.148+0000 7f8347262640 1 -- start start 2023-12-19T05:39:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7fd70e31b640 1 Processor -- start 2023-12-19T05:39:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7faeed462640 1 -- 172.21.15.49:0/2141455809 shutdown_connections 2023-12-19T05:39:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7f583beb2640 1 Processor -- start 2023-12-19T05:39:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7faeed462640 1 -- 172.21.15.49:0/2141455809 wait complete. 2023-12-19T05:39:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7fcd0e59c640 1 --2- 172.21.15.49:0/3200413497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd0002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f198b98bfd1c106c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7f9d8a59c640 1 --2- 172.21.15.49:0/1542451138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c0cb890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9d80010b10 tx=0x7f9d8002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34d76965816c4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7fd70e31b640 1 -- start start 2023-12-19T05:39:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7fcd0d59a640 1 -- 172.21.15.49:0/3200413497 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00031870 con 0x7fcd08033e70 2023-12-19T05:39:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7fcd0d59a640 1 -- 172.21.15.49:0/3200413497 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd000319d0 con 0x7fcd08033e70 2023-12-19T05:39:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7fcd0d59a640 1 -- 172.21.15.49:0/3200413497 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00031da0 con 0x7fcd08033e70 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7fcd14cb6640 1 -- 172.21.15.49:0/3200413497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 msgr2=0x7fcd08054700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f9d89d9b640 1 -- 172.21.15.49:0/1542451138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80030ba0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f9d89d9b640 1 -- 172.21.15.49:0/1542451138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80030d00 con 0x7f9d8c0cb180 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f9d89d9b640 1 -- 172.21.15.49:0/1542451138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80030ba0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7f9d911d0640 1 -- 172.21.15.49:0/1542451138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 msgr2=0x7f9d8c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7f9d911d0640 1 --2- 172.21.15.49:0/1542451138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c0cb890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9d80010b10 tx=0x7f9d8002fdf0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7f8347262640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8338055400 0x7f83380557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7f8347262640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83380543c0 0x7f8338039140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f8347262640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8338055d20 con 0x7f8338049ee0 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f8347262640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83380e8920 con 0x7f8338055400 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f8347262640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83380532c0 con 0x7f83380543c0 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.151+0000 7f8345a5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83380543c0 0x7f8338039140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.150+0000 7f583beb2640 1 -- start start 2023-12-19T05:39:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/3200413497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd0002b910 comp rx=0 tx=0).stop 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7f8346260640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8338055400 0x7f83380557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7f8346260640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8338055400 0x7f83380557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56238/0 (socket says 172.21.15.49:56238) 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.152+0000 7f8346260640 1 -- 172.21.15.49:0/3190535025 learned_addr learned my addr 172.21.15.49:0/3190535025 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f9d911d0640 1 -- 172.21.15.49:0/1542451138 shutdown_connections 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f9d911d0640 1 --2- 172.21.15.49:0/1542451138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c0cb890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7faeed462640 1 Processor -- start 2023-12-19T05:39:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f9d911d0640 1 -- 172.21.15.49:0/1542451138 >> 172.21.15.49:0/1542451138 conn(0x7f9d8c0b4300 msgr2=0x7f9d8c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7faeed462640 1 -- start start 2023-12-19T05:39:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7080b6820 0x7fd7081f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd70806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 0x7fd7080d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081fb330 con 0x7fd708146ef0 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fcd14cb6640 1 -- 172.21.15.49:0/3200413497 shutdown_connections 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/3200413497 >> v2:172.21.15.115:3300/0 conn(0x7fcd0803a6e0 0x7fcd080386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/3200413497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd08054700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fcd14cb6640 1 -- 172.21.15.49:0/3200413497 >> 172.21.15.49:0/3200413497 conn(0x7fcd08054c40 msgr2=0x7fcd08055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708158e80 con 0x7fd7080b6820 2023-12-19T05:39:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7fd70e31b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081f7490 con 0x7fd7081446e0 2023-12-19T05:39:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f8346260640 1 -- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83380543c0 msgr2=0x7f8338039140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f8346260640 1 --2- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83380543c0 0x7f8338039140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f8346260640 1 -- 172.21.15.49:0/3190535025 >> v1:172.21.15.115:6789/0 conn(0x7f8338049ee0 legacy=0x7f8338051930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7f834525e640 1 -- 172.21.15.49:0/3190535025 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930221786 0 0) 0x7f8338055d20 con 0x7f8338049ee0 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7fd70db1a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 0x7fd7080d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7fd70db1a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 0x7fd7080d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33652/0 (socket says 172.21.15.49:33652) 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7fd70db1a640 1 -- 172.21.15.49:0/3178471686 learned_addr learned my addr 172.21.15.49:0/3178471686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7fd70db1a640 1 -- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 msgr2=0x7fd70806dde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7fd70db1a640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7081446e0 0x7fd70806dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7fd70db1a640 1 -- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7080b6820 msgr2=0x7fd7081f6f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7fd70db1a640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7080b6820 0x7fd7081f6f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7fd70db1a640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040094d0 con 0x7fd708146ef0 2023-12-19T05:39:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7faeed462640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faee81f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7faeed462640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faee81dbe70 0x7faee813da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7faeed462640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faee8144be0 0x7faee8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faeed462640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee81455a0 con 0x7faed0004170 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faeed462640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee81dc660 con 0x7faee8144be0 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faeed462640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee81dc940 con 0x7faee81dbe70 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7fcd14cb6640 1 -- 172.21.15.49:0/3200413497 shutdown_connections 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7fcd14cb6640 1 -- 172.21.15.49:0/3200413497 wait complete. 2023-12-19T05:39:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f583beb2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f582c0075f0 0x7f582c0ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f583beb2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0557d0 con 0x7f582c03ae50 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f583beb2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c055aa0 con 0x7f582c0e1100 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.153+0000 7f583beb2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c056b40 con 0x7f582c0075f0 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7f583a44f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f582c0075f0 0x7f582c0ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7f583a44f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f582c0075f0 0x7f582c0ebb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33654/0 (socket says 172.21.15.49:33654) 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7f583a44f640 1 -- 172.21.15.49:0/3135093374 learned_addr learned my addr 172.21.15.49:0/3135093374 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7f583a44f640 1 -- 172.21.15.49:0/3135093374 >> v1:172.21.15.115:6789/0 conn(0x7f582c0e1100 legacy=0x7f582c0550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7f583a44f640 1 -- 172.21.15.49:0/3135093374 >> v1:172.21.15.49:6789/0 conn(0x7f582c03ae50 legacy=0x7f582c005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faee7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faee81f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faee7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faee81f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33670/0 (socket says 172.21.15.49:33670) 2023-12-19T05:39:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7faee7fff640 1 -- 172.21.15.49:0/2655649762 learned_addr learned my addr 172.21.15.49:0/2655649762 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.154+0000 7f8346260640 1 -- 172.21.15.49:0/3190535025 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380e8e10 con 0x7f8338055400 2023-12-19T05:39:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7faeecc61640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faee8144be0 0x7faee8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7f39d17ef640 1 Processor -- start 2023-12-19T05:39:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7faee77fe640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faee81dbe70 0x7faee813da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7f583a44f640 1 -- 172.21.15.49:0/3135093374 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c055d80 con 0x7f582c0075f0 2023-12-19T05:39:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7f39d17ef640 1 -- start start 2023-12-19T05:39:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7f8346260640 1 --2- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8338055400 0x7f83380557e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f833c009870 tx=0x7f833c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72208354a09bf13c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7f9d911d0640 1 -- 172.21.15.49:0/1542451138 shutdown_connections 2023-12-19T05:39:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.155+0000 7f9d911d0640 1 -- 172.21.15.49:0/1542451138 wait complete. 2023-12-19T05:39:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.156+0000 7f583a44f640 1 --2- 172.21.15.49:0/3135093374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c0ebb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5834069210 tx=0x7f58340a6290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a9367ca3cee22a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7fd70db1a640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 0x7fd7080d1ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd704034040 tx=0x7fd7040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7fcd14cb6640 1 Processor -- start 2023-12-19T05:39:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7faee77fe640 1 -- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faee8144be0 msgr2=0x7faee8145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7faee77fe640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faee8144be0 0x7faee8145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7faee77fe640 1 -- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 msgr2=0x7faee81f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7faee77fe640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faed0004170 0x7faee81f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7faee77fe640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee81dcc20 con 0x7faee81dbe70 2023-12-19T05:39:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.157+0000 7fcd14cb6640 1 -- start start 2023-12-19T05:39:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7faee77fe640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faee81dbe70 0x7faee813da70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faee0007db0 tx=0x7faee00115a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f9d911d0640 1 Processor -- start 2023-12-19T05:39:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f9d911d0640 1 -- start start 2023-12-19T05:39:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f39d17ef640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39c400c1f0 0x7f39c4033fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f39d17ef640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39c4053150 0x7f39c40e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f39d17ef640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40543f0 con 0x7f39c4050230 2023-12-19T05:39:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f39d17ef640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c40535d0 con 0x7f39c400c1f0 2023-12-19T05:39:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.158+0000 7f39d17ef640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c40537e0 con 0x7f39c4053150 2023-12-19T05:39:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f5838c4c640 1 -- 172.21.15.49:0/3135093374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340b3120 con 0x7f582c0075f0 2023-12-19T05:39:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f5838c4c640 1 -- 172.21.15.49:0/3135093374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58340aa070 con 0x7f582c0075f0 2023-12-19T05:39:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f5838c4c640 1 -- 172.21.15.49:0/3135093374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340b3500 con 0x7f582c0075f0 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003810 con 0x7fd708146ef0 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70403f070 con 0x7fd708146ef0 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003b90 con 0x7fd708146ef0 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd708159120 con 0x7fd708146ef0 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd0804f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 0x7fcd08049ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd0803a6e0 0x7fcd0804bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08035690 con 0x7fcd0803a6e0 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08034a80 con 0x7fcd08038be0 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fcd14cb6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08034d60 con 0x7fcd08033e70 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7081596e0 con 0x7fd708146ef0 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0b04e0 0x7f9d8c147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c159320 0x7f9d8c1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c147c70 con 0x7f9d8c0cb180 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1faed0 con 0x7f9d8c0b04e0 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f9d911d0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1fb1b0 con 0x7f9d8c159320 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7fcd0dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 0x7fcd08049ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7fcd0dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 0x7fcd08049ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56288/0 (socket says 172.21.15.49:56288) 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7fcd0dd9b640 1 -- 172.21.15.49:0/2772835274 learned_addr learned my addr 172.21.15.49:0/2772835274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 -- 172.21.15.49:0/3135093374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 msgr2=0x7f582c0ebb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 --2- 172.21.15.49:0/3135093374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c0ebb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5834069210 tx=0x7f58340a6290 comp rx=0 tx=0).stop 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f39cbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39c400c1f0 0x7f39c4033fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f39cbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39c400c1f0 0x7f39c4033fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33686/0 (socket says 172.21.15.49:33686) 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f39cbfff640 1 -- 172.21.15.49:0/2364095430 learned_addr learned my addr 172.21.15.49:0/2364095430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.159+0000 7f39cb7fe640 1 --2- 172.21.15.49:0/2364095430 >> v2:172.21.15.115:3300/0 conn(0x7f39c4053150 0x7f39c40e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f39cbfff640 1 -- 172.21.15.49:0/2364095430 >> v2:172.21.15.115:3300/0 conn(0x7f39c4053150 msgr2=0x7f39c40e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f39cbfff640 1 --2- 172.21.15.49:0/2364095430 >> v2:172.21.15.115:3300/0 conn(0x7f39c4053150 0x7f39c40e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f39cbfff640 1 -- 172.21.15.49:0/2364095430 >> v1:172.21.15.115:6789/0 conn(0x7f39c4050230 legacy=0x7f39c4006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f39cbfff640 1 -- 172.21.15.49:0/2364095430 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4053ac0 con 0x7f39c400c1f0 2023-12-19T05:39:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7fcd0e59c640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd0804f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 -- 172.21.15.49:0/3135093374 shutdown_connections 2023-12-19T05:39:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 --2- 172.21.15.49:0/3135093374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c0ebb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 -- 172.21.15.49:0/3135093374 >> 172.21.15.49:0/3135093374 conn(0x7f582c056d10 msgr2=0x7f582c057120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 -- 172.21.15.49:0/3135093374 shutdown_connections 2023-12-19T05:39:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.160+0000 7f583beb2640 1 -- 172.21.15.49:0/3135093374 wait complete. 2023-12-19T05:39:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7f9d8ad9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0b04e0 0x7f9d8c147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7f9d8ad9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0b04e0 0x7f9d8c147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56300/0 (socket says 172.21.15.49:56300) 2023-12-19T05:39:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7f9d8ad9d640 1 -- 172.21.15.49:0/592096621 learned_addr learned my addr 172.21.15.49:0/592096621 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7f9d8a59c640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd708147790 con 0x7fd708146ef0 2023-12-19T05:39:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7f9d8b59e640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c159320 0x7f9d8c1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0ed9d640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd0803a6e0 0x7fcd0804bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0dd9b640 1 -- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 msgr2=0x7fcd0804f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0dd9b640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd08033e70 0x7fcd0804f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0dd9b640 1 -- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd0803a6e0 msgr2=0x7fcd0804bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0dd9b640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd0803a6e0 0x7fcd0804bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.161+0000 7fcd0dd9b640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000094d0 con 0x7fcd08038be0 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7fcd0dd9b640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 0x7fcd08049ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd100697b0 tx=0x7fcd1006cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 -- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c159320 msgr2=0x7f9d8c1f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c159320 0x7f9d8c1f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 -- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0b04e0 msgr2=0x7f9d8c147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0b04e0 0x7f9d8c147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800107f0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f39cbfff640 1 --2- 172.21.15.49:0/2364095430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c400c1f0 0x7f39c4033fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39c4051660 tx=0x7f39b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc7808e7e766f9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f834525e640 1 -- 172.21.15.49:0/3190535025 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c02f840 con 0x7f8338055400 2023-12-19T05:39:15.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f39caffd640 1 -- 172.21.15.49:0/2364095430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8031870 con 0x7f39c400c1f0 2023-12-19T05:39:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1006ef30 con 0x7fcd08038be0 2023-12-19T05:39:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd08035040 con 0x7fcd08038be0 2023-12-19T05:39:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f39caffd640 1 -- 172.21.15.49:0/2364095430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80319d0 con 0x7f39c400c1f0 2023-12-19T05:39:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f39caffd640 1 -- 172.21.15.49:0/2364095430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8031d60 con 0x7f39c400c1f0 2023-12-19T05:39:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.162+0000 7f9d8a59c640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c15b980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d80037000 tx=0x7f9d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd080346a0 con 0x7fcd08038be0 2023-12-19T05:39:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10072960 con 0x7fcd08038be0 2023-12-19T05:39:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80003c40 con 0x7f9d8c0cb180 2023-12-19T05:39:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f583beb2640 1 Processor -- start 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80003da0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80041690 con 0x7f9d8c0cb180 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f39d17ef640 1 -- 172.21.15.49:0/2364095430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c400c1f0 msgr2=0x7f39c4033fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f39d17ef640 1 --2- 172.21.15.49:0/2364095430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c400c1f0 0x7f39c4033fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39c4051660 tx=0x7f39b802b910 comp rx=0 tx=0).stop 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10069ec0 con 0x7fcd08038be0 2023-12-19T05:39:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd704003cf0 con 0x7fd708146ef0 2023-12-19T05:39:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.163+0000 7f583beb2640 1 -- start start 2023-12-19T05:39:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000e070 con 0x7faee81dbe70 2023-12-19T05:39:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee0003990 con 0x7faee81dbe70 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0003b40 con 0x7faee81dbe70 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccf4000fc0 con 0x7fcd08038be0 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 -- 172.21.15.49:0/2364095430 shutdown_connections 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 --2- 172.21.15.49:0/2364095430 >> v2:172.21.15.115:3300/0 conn(0x7f39c4053150 0x7f39c40e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 --2- 172.21.15.49:0/2364095430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c400c1f0 0x7f39c4033fc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 -- 172.21.15.49:0/2364095430 >> 172.21.15.49:0/2364095430 conn(0x7f39c4054c10 msgr2=0x7f39c4054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1fb490 con 0x7f9d8c0cb180 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee81dd3c0 con 0x7faee81dbe70 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee81dc2f0 con 0x7faee81dbe70 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c04d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 0x7f582c0db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582c0e1100 0x7f582c039e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0cf2e0 con 0x7f582c0075f0 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c04c560 con 0x7f582c0e1100 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f583beb2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c047030 con 0x7f582c03ae50 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 -- 172.21.15.49:0/2364095430 shutdown_connections 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f834525e640 1 -- 172.21.15.49:0/3190535025 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c02f9a0 con 0x7f8338055400 2023-12-19T05:39:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f834525e640 1 -- 172.21.15.49:0/3190535025 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c02fd30 con 0x7f8338055400 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c144c90 con 0x7f9d8c0cb180 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f8347262640 1 -- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8338055400 msgr2=0x7f83380557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.165+0000 7f5839c4e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c04d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f583a44f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582c0e1100 0x7f582c039e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f583944d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 0x7f582c0db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f583944d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 0x7f582c0db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41398/0 (socket says 172.21.15.49:41398) 2023-12-19T05:39:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f583944d640 1 -- 172.21.15.49:0/1944589268 learned_addr learned my addr 172.21.15.49:0/1944589268 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.164+0000 7f39d17ef640 1 -- 172.21.15.49:0/2364095430 wait complete. 2023-12-19T05:39:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7fd6fdffb640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd6ec06a500 0x7fd6ec06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7f8347262640 1 --2- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8338055400 0x7f83380557e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f833c009870 tx=0x7f833c02ba20 comp rx=0 tx=0).stop 2023-12-19T05:39:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd100008d0 con 0x7fcd08038be0 2023-12-19T05:39:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d8c070c20 con 0x7f9d8c0cb180 2023-12-19T05:39:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f583944d640 1 -- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582c0e1100 msgr2=0x7f582c039e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f583944d640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582c0e1100 0x7f582c039e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f583944d640 1 -- 172.21.15.49:0/1944589268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 msgr2=0x7f582c04d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7fccfeffd640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf006a430 0x7fccf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd704041070 con 0x7fd708146ef0 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7fd6fdffb640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fd6ec072720 0x7fd6ec074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6ec0751f0 con 0x7fd6ec072720 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7040ad6b0 con 0x7fd708146ef0 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7fd70d319640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd6ec06a500 0x7fd6ec06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd100b6040 con 0x7fcd08038be0 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.166+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faee80d1b70 con 0x7faee81dbe70 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f8347262640 1 -- 172.21.15.49:0/3190535025 shutdown_connections 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f8347262640 1 --2- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83380543c0 0x7f8338039140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f8347262640 1 --2- 172.21.15.49:0/3190535025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8338055400 0x7f83380557e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.167+0000 7f8347262640 1 -- 172.21.15.49:0/3190535025 >> 172.21.15.49:0/3190535025 conn(0x7f83380538a0 msgr2=0x7f8338053cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7fccfeffd640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7fccf00725d0 0x7fccf00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccf00750a0 con 0x7fccf00725d0 2023-12-19T05:39:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd101037f0 con 0x7fcd08038be0 2023-12-19T05:39:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7f583944d640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c04d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7fcd0ed9d640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7fccf00725d0 0x7fccf00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7f8347262640 1 -- 172.21.15.49:0/3190535025 shutdown_connections 2023-12-19T05:39:15.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7f583944d640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583406eaa0 con 0x7f582c03ae50 2023-12-19T05:39:15.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7f39d17ef640 1 Processor -- start 2023-12-19T05:39:15.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7fdd0a0f7640 1 Processor -- start 2023-12-19T05:39:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7fcd0ed9d640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7fccf00725d0 0x7fccf00749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7f39d17ef640 1 -- start start 2023-12-19T05:39:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faee0003ca0 con 0x7faee81dbe70 2023-12-19T05:39:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7fcd0e59c640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf006a430 0x7fccf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== osd.3 v2:172.21.15.49:6809/84034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fccf00750a0 con 0x7fccf00725d0 2023-12-19T05:39:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7f5839c4e640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f582c0075f0 0x7f582c04d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.168+0000 7f8347262640 1 -- 172.21.15.49:0/3190535025 wait complete. 2023-12-19T05:39:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7fd70d319640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd6ec06a500 0x7fd6ec06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7080d1a50 tx=0x7fd700009790 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7f583944d640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 0x7f582c0db420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f582400c400 tx=0x7f582400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7fd70cb18640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fd6ec072720 0x7fd6ec074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011790 con 0x7f582c03ae50 2023-12-19T05:39:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.169+0000 7fdd0a0f7640 1 -- start start 2023-12-19T05:39:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824011930 con 0x7f582c03ae50 2023-12-19T05:39:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011ce0 con 0x7f582c03ae50 2023-12-19T05:39:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c04cde0 con 0x7f582c03ae50 2023-12-19T05:39:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c04c790 con 0x7f582c03ae50 2023-12-19T05:39:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7faee4ff9640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faed406a4b0 0x7faed406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faee0088f30 con 0x7faee81dbe70 2023-12-19T05:39:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7faee4ff9640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7faed40726d0 0x7faed4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faed40751a0 con 0x7faed40726d0 2023-12-19T05:39:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee008b5e0 con 0x7faee81dbe70 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.171+0000 7f39d17ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39c400c1f0 0x7f39c40de240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39d17ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c4050230 0x7f39c40ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39d17ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39c4053150 0x7f39c40dce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39d17ef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40edb40 con 0x7f39c4050230 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39d17ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40ed860 con 0x7f39c400c1f0 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39d17ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40dd760 con 0x7f39c4053150 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f39cbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39c400c1f0 0x7f39c40de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7faeecc61640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7faed40726d0 0x7faed4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f581c000fc0 con 0x7f582c03ae50 2023-12-19T05:39:15.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7fd70cb18640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fd6ec072720 0x7fd6ec074b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7f39cbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39c400c1f0 0x7f39c40de240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56330/0 (socket says 172.21.15.49:56330) 2023-12-19T05:39:15.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7f39d0fee640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39c4053150 0x7f39c40dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.170+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d800417f0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f9d737fe640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7806a480 0x7f9d7806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d800ac370 con 0x7f9d8c0cb180 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f9d737fe640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7f9d780726a0 0x7f9d78074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d78075170 con 0x7f9d780726a0 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.172+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d800ac6e0 con 0x7f9d8c0cb180 2023-12-19T05:39:15.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7f39cb7fe640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c4050230 0x7f39c40ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7fcd0e59c640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf006a430 0x7fccf006c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd00036000 tx=0x7fcd0003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7faee7fff640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faed406a4b0 0x7faed406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.173+0000 7f8347262640 1 Processor -- start 2023-12-19T05:39:15.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7faeecc61640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7faed40726d0 0x7faed4074af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cbfff640 1 -- 172.21.15.49:0/3781918337 learned_addr learned my addr 172.21.15.49:0/3781918337 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f9d8b59e640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7f9d780726a0 0x7f9d78074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f9d8ad9d640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7806a480 0x7f9d7806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7fdd0a0f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 0x7fdd04166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f8347262640 1 -- start start 2023-12-19T05:39:15.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7fdd0a0f7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd04165bc0 con 0x7fdd040afa50 2023-12-19T05:39:15.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7fdd0a0f7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0406e520 con 0x7fdd04161a40 2023-12-19T05:39:15.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7fdd02ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd040afa50 0x7fdd040b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41196/0 (socket says 172.21.15.49:41196) 2023-12-19T05:39:15.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7fdd02ffd640 1 -- 172.21.15.49:0/4066806448 learned_addr learned my addr 172.21.15.49:0/4066806448 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cb7fe640 1 -- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39c4053150 msgr2=0x7f39c40dce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cb7fe640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39c4053150 0x7f39c40dce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cb7fe640 1 -- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39c400c1f0 msgr2=0x7f39c40de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cb7fe640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39c400c1f0 0x7f39c40de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040afef0 con 0x7fdd04161660 2023-12-19T05:39:15.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7f39cb7fe640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80094d0 con 0x7f39c4050230 2023-12-19T05:39:15.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.174+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== osd.1 v2:172.21.15.49:6822/84036 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd6ec0751f0 con 0x7fd6ec072720 2023-12-19T05:39:15.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7f9d8b59e640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7f9d780726a0 0x7f9d78074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7f9d8ad9d640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7806a480 0x7f9d7806c940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007500 tx=0x7f9d7c0047e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7f39cb7fe640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c4050230 0x7f39c40ee060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39cc063d60 tx=0x7f39cc04e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0b6040 con 0x7f39c4050230 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc0008d0 con 0x7f39c4050230 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c40dda40 con 0x7f39c4050230 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f582401c460 con 0x7f582c03ae50 2023-12-19T05:39:15.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== osd.0 v2:172.21.15.49:6800/84033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9d78075170 con 0x7f9d780726a0 2023-12-19T05:39:15.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.175+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== osd.2 v2:172.21.15.49:6808/84037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7faed40751a0 con 0x7faed40726d0 2023-12-19T05:39:15.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.177+0000 7faee7fff640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faed406a4b0 0x7faed406c970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faee8145760 tx=0x7faed8007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f8347262640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8338049ee0 0x7f833804d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f8347262640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83380543c0 0x7f833817d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.177+0000 7f582a7fc640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f581806a460 0x7f581806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58240890e0 con 0x7f582c03ae50 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7f582a7fc640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f5818072600 0x7f5818074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58180750d0 con 0x7f5818072600 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5824089530 con 0x7f582c03ae50 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c40ee5a0 con 0x7f39c4050230 2023-12-19T05:39:15.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0b3890 con 0x7f39c4050230 2023-12-19T05:39:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39ac000fc0 con 0x7f39c4050230 2023-12-19T05:39:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.176+0000 7fdd037fe640 1 --2- 172.21.15.49:0/4066806448 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 0x7fdd04166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.177+0000 7fdd037fe640 1 -- 172.21.15.49:0/4066806448 >> v1:172.21.15.115:6789/0 conn(0x7fdd04161a40 legacy=0x7fdd040ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.177+0000 7fdd037fe640 1 -- 172.21.15.49:0/4066806448 >> v1:172.21.15.49:6789/0 conn(0x7fdd040afa50 legacy=0x7fdd040b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.178+0000 7fdd037fe640 1 -- 172.21.15.49:0/4066806448 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04165570 con 0x7fdd04161660 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.179+0000 7f5839c4e640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f581806a460 0x7f581806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.179+0000 7f583a44f640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f5818072600 0x7f5818074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f5839c4e640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f581806a460 0x7f581806c920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f582c0d8f40 tx=0x7f5830009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7fdd037fe640 1 --2- 172.21.15.49:0/4066806448 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 0x7fdd04166050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009dc0 tx=0x7fdcfc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f524c21eada95e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f8347262640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8338055400 0x7f833804b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f8347262640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338039a40 con 0x7f8338049ee0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f8347262640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833817da40 con 0x7f83380543c0 2023-12-19T05:39:15.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f8347262640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833817dd20 con 0x7f8338055400 2023-12-19T05:39:15.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f583a44f640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f5818072600 0x7f5818074a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39cc0b3de0 con 0x7f39c4050230 2023-12-19T05:39:15.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.180+0000 7fdd027fc640 1 -- 172.21.15.49:0/4066806448 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc02cc50 con 0x7fdd04161660 2023-12-19T05:39:15.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7fdd027fc640 1 -- 172.21.15.49:0/4066806448 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc02cdb0 con 0x7fdd04161660 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7fdd027fc640 1 -- 172.21.15.49:0/4066806448 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc034660 con 0x7fdd04161660 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8338049ee0 0x7f833804d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346a61640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8338055400 0x7f833804b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346a61640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8338055400 0x7f833804b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41414/0 (socket says 172.21.15.49:41414) 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346a61640 1 -- 172.21.15.49:0/4211621068 learned_addr learned my addr 172.21.15.49:0/4211621068 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.182+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== osd.5 v2:172.21.15.115:6805/84439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f58180750d0 con 0x7f5818072600 2023-12-19T05:39:15.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f39c8ff9640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39b006a530 0x7f39b006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39cc1024f0 con 0x7f39c4050230 2023-12-19T05:39:15.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8345a5f640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83380543c0 0x7f833817d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f39c8ff9640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f39b0072750 0x7f39b0074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 -- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8338055400 msgr2=0x7f833804b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8338055400 0x7f833804b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 -- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83380543c0 msgr2=0x7f833817d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83380543c0 0x7f833817d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.181+0000 7f8346260640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0094d0 con 0x7f8338049ee0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.182+0000 7f8346260640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8338049ee0 0x7f833804d340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f833c033000 tx=0x7f833c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c037bc0 con 0x7f8338049ee0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c037d40 con 0x7f8338049ee0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c041640 con 0x7f8338049ee0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833817e000 con 0x7f8338049ee0 2023-12-19T05:39:15.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833817d6c0 con 0x7f8338049ee0 2023-12-19T05:39:15.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.183+0000 7f39cbfff640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39b006a530 0x7f39b006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.184+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8338038940 con 0x7f8338049ee0 2023-12-19T05:39:15.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.184+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 msgr2=0x7fdd04166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.184+0000 7fdd0a0f7640 1 --2- 172.21.15.49:0/4066806448 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 0x7fdd04166050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009dc0 tx=0x7fdcfc02bea0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.185+0000 7f39cbfff640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39b006a530 0x7f39b006c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39b80090b0 tx=0x7f39b803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.185+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 shutdown_connections 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.185+0000 7fdd0a0f7640 1 --2- 172.21.15.49:0/4066806448 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161660 0x7fdd04166050 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009dc0 tx=0x7fdcfc02bea0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.185+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 >> 172.21.15.49:0/4066806448 conn(0x7fdd040cbb70 msgr2=0x7fdd040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.186+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39b0075220 con 0x7f39b0072750 2023-12-19T05:39:15.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.186+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39cc104a50 con 0x7f39c4050230 2023-12-19T05:39:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.186+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f833c0417a0 con 0x7f8338049ee0 2023-12-19T05:39:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.187+0000 7f8336ffd640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f832407b440 0x7f832407d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.187+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f833c03c070 con 0x7f8338049ee0 2023-12-19T05:39:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.187+0000 7f39d0fee640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f39b0072750 0x7f39b0074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.187+0000 7f8336ffd640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f8324083660 0x7f8324085a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.188+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8324086130 con 0x7f8324083660 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.188+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f833c0ac230 con 0x7f8338049ee0 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.188+0000 7f8345a5f640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f832407b440 0x7f832407d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.188+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 shutdown_connections 2023-12-19T05:39:15.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.188+0000 7f8346a61640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f8324083660 0x7f8324085a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.189+0000 7f39d0fee640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f39b0072750 0x7f39b0074b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.189+0000 7f8345a5f640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f832407b440 0x7f832407d900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8338036050 tx=0x7f8330009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.189+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/4066806448 wait complete. 2023-12-19T05:39:15.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.189+0000 7f8346a61640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f8324083660 0x7f8324085a80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.190+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== osd.6 v2:172.21.15.115:6814/84441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f39b0075220 con 0x7f39b0072750 2023-12-19T05:39:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.191+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== osd.4 v2:172.21.15.115:6800/84440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f8324086130 con 0x7f8324083660 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.192+0000 7fdd0a0f7640 1 Processor -- start 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.192+0000 7fdd0a0f7640 1 -- start start 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd040afa50 0x7fdd041528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161a40 0x7fdd04162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd04158f10 0x7fdd041577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04152e20 con 0x7fdd040afa50 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04156700 con 0x7fdd04158f10 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.194+0000 7fdd0a0f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041569e0 con 0x7fdd04161a40 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd040afa50 0x7fdd041528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd04158f10 0x7fdd041577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd040afa50 0x7fdd041528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33740/0 (socket says 172.21.15.49:33740) 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd037fe640 1 -- 172.21.15.49:0/288235470 learned_addr learned my addr 172.21.15.49:0/288235470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd02ffd640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161a40 0x7fdd04162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 -- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161a40 msgr2=0x7fdd04162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd04161a40 0x7fdd04162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 -- 172.21.15.49:0/288235470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd040afa50 msgr2=0x7fdd041528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd040afa50 0x7fdd041528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.195+0000 7fdd03fff640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009a70 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.196+0000 7fdd03fff640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd04158f10 0x7fdd041577a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b3e0 tx=0x7fdcf400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.197+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011830 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.197+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4011990 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.197+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011d40 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.198+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04156cc0 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.198+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04157280 con 0x7fdd04158f10 2023-12-19T05:39:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.199+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd04165850 con 0x7fdd04158f10 2023-12-19T05:39:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.202+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcf401a400 con 0x7fdd04158f10 2023-12-19T05:39:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.202+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 --> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faee80d2370 con 0x7faed40726d0 2023-12-19T05:39:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.203+0000 7faee4ff9640 1 -- 172.21.15.49:0/2655649762 <== osd.2 v2:172.21.15.49:6808/84037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faedc02c610 con 0x7faed40726d0 2023-12-19T05:39:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.203+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 --> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccf4002cb0 con 0x7fccf00725d0 2023-12-19T05:39:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fccfeffd640 1 -- 172.21.15.49:0/2772835274 <== osd.3 v2:172.21.15.49:6809/84034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fccf4002cb0 con 0x7fccf00725d0 2023-12-19T05:39:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fdcebfff640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcf006a4b0 0x7fdcf006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcf4088770 con 0x7fdd04158f10 2023-12-19T05:39:15.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.203+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7faed40726d0 msgr2=0x7faed4074af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.203+0000 7faeed462640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7faed40726d0 0x7faed4074af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fdcebfff640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7fdcf00726d0 0x7fdcf0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7fccf00725d0 msgr2=0x7fccf00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7fccf00725d0 0x7fccf00749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcf00751a0 con 0x7fdcf00726d0 2023-12-19T05:39:15.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf408ae20 con 0x7fdd04158f10 2023-12-19T05:39:15.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faed406a4b0 msgr2=0x7faed406c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7faeed462640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faed406a4b0 0x7faed406c970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faee8145760 tx=0x7faed8007e40 comp rx=0 tx=0).stop 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf006a430 msgr2=0x7fccf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.204+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf006a430 0x7fccf006c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd00036000 tx=0x7fcd0003c040 comp rx=0 tx=0).stop 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 msgr2=0x7fcd08049ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd14cb6640 1 --2- 172.21.15.49:0/2772835274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd08038be0 0x7fcd08049ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd100697b0 tx=0x7fcd1006cea0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faee81dbe70 msgr2=0x7faee813da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 --2- 172.21.15.49:0/2655649762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faee81dbe70 0x7faee813da70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faee0007db0 tx=0x7faee00115a0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeecc61640 1 -- 172.21.15.49:0/2655649762 reap_dead start 2023-12-19T05:39:15.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd0ed9d640 1 -- 172.21.15.49:0/2772835274 reap_dead start 2023-12-19T05:39:15.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 shutdown_connections 2023-12-19T05:39:15.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 >> 172.21.15.49:0/2655649762 conn(0x7faee80b2990 msgr2=0x7faee80ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fdd037fe640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcf006a4b0 0x7fdcf006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 shutdown_connections 2023-12-19T05:39:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 shutdown_connections 2023-12-19T05:39:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 >> 172.21.15.49:0/2772835274 conn(0x7fcd08054c40 msgr2=0x7fcd08039060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7faeed462640 1 -- 172.21.15.49:0/2655649762 wait complete. 2023-12-19T05:39:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fdd02ffd640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7fdcf00726d0 0x7fdcf0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.205+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 shutdown_connections 2023-12-19T05:39:15.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.206+0000 7fcd14cb6640 1 -- 172.21.15.49:0/2772835274 wait complete. 2023-12-19T05:39:15.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.207+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 --> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7080b1c90 con 0x7fd6ec072720 2023-12-19T05:39:15.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.207+0000 7fdd02ffd640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7fdcf00726d0 0x7fdcf0074af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.207+0000 7fdd037fe640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcf006a4b0 0x7fdcf006c970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f80 tx=0x7fdcfc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.207+0000 7fd6fdffb640 1 -- 172.21.15.49:0/3178471686 <== osd.1 v2:172.21.15.49:6822/84036 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6f80011c0 con 0x7fd6ec072720 2023-12-19T05:39:15.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.207+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 --> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d8c070940 con 0x7f9d780726a0 2023-12-19T05:39:15.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7f9d737fe640 1 -- 172.21.15.49:0/592096621 <== osd.0 v2:172.21.15.49:6800/84033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d840020e0 con 0x7f9d780726a0 2023-12-19T05:39:15.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fd6ec072720 msgr2=0x7fd6ec074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fd6ec072720 0x7fd6ec074b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd6ec06a500 msgr2=0x7fd6ec06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd6ec06a500 0x7fd6ec06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7080d1a50 tx=0x7fd700009790 comp rx=0 tx=0).stop 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 msgr2=0x7fd7080d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70e31b640 1 --2- 172.21.15.49:0/3178471686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd708146ef0 0x7fd7080d1ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd704034040 tx=0x7fd7040046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.208+0000 7fd70db1a640 1 -- 172.21.15.49:0/3178471686 reap_dead start 2023-12-19T05:39:15.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.209+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 shutdown_connections 2023-12-19T05:39:15.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.209+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== osd.7 v2:172.21.15.115:6824/84475 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fdcf00751a0 con 0x7fdcf00726d0 2023-12-19T05:39:15.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.209+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 >> 172.21.15.49:0/3178471686 conn(0x7fd7080cfb90 msgr2=0x7fd708163560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.209+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 shutdown_connections 2023-12-19T05:39:15.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.209+0000 7fd70e31b640 1 -- 172.21.15.49:0/3178471686 wait complete. 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7f9d780726a0 msgr2=0x7f9d78074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7f9d780726a0 0x7f9d78074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7806a480 msgr2=0x7f9d7806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7806a480 0x7f9d7806c940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007500 tx=0x7f9d7c0047e0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 msgr2=0x7f9d8c15b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 --2- 172.21.15.49:0/592096621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c0cb180 0x7f9d8c15b980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d80037000 tx=0x7f9d800046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d8b59e640 1 -- 172.21.15.49:0/592096621 reap_dead start 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 shutdown_connections 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 >> 172.21.15.49:0/592096621 conn(0x7f9d8c0b4300 msgr2=0x7f9d8c158650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 shutdown_connections 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.211+0000 7f9d911d0640 1 -- 172.21.15.49:0/592096621 wait complete. 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.221+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 --> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83380e8b30 con 0x7f8324083660 2023-12-19T05:39:15.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.221+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 --> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f581c002cb0 con 0x7f5818072600 2023-12-19T05:39:15.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.222+0000 7f8336ffd640 1 -- 172.21.15.49:0/4211621068 <== osd.4 v2:172.21.15.115:6800/84440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f834004ef70 con 0x7f8324083660 2023-12-19T05:39:15.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f582a7fc640 1 -- 172.21.15.49:0/1944589268 <== osd.5 v2:172.21.15.115:6805/84439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f581c002cb0 con 0x7f5818072600 2023-12-19T05:39:15.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f8324083660 msgr2=0x7f8324085a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f8324083660 0x7f8324085a80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f832407b440 msgr2=0x7f832407d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f832407b440 0x7f832407d900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8338036050 tx=0x7f8330009190 comp rx=0 tx=0).stop 2023-12-19T05:39:15.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8338049ee0 msgr2=0x7f833804d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8347262640 1 --2- 172.21.15.49:0/4211621068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8338049ee0 0x7f833804d340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f833c033000 tx=0x7f833c004730 comp rx=0 tx=0).stop 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f8346a61640 1 -- 172.21.15.49:0/4211621068 reap_dead start 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.223+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 --> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39ac002cb0 con 0x7f39b0072750 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 shutdown_connections 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 >> 172.21.15.49:0/4211621068 conn(0x7f83380538a0 msgr2=0x7f8338039040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f5818072600 msgr2=0x7f5818074a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f5818072600 0x7f5818074a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 shutdown_connections 2023-12-19T05:39:15.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f8347262640 1 -- 172.21.15.49:0/4211621068 wait complete. 2023-12-19T05:39:15.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f581806a460 msgr2=0x7f581806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f581806a460 0x7f581806c920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f582c0d8f40 tx=0x7f5830009040 comp rx=0 tx=0).stop 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 msgr2=0x7f582c0db420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 --2- 172.21.15.49:0/1944589268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582c03ae50 0x7f582c0db420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f582400c400 tx=0x7f582400c8c0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583a44f640 1 -- 172.21.15.49:0/1944589268 reap_dead start 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 shutdown_connections 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.224+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 >> 172.21.15.49:0/1944589268 conn(0x7f582c056d10 msgr2=0x7f582c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.225+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 shutdown_connections 2023-12-19T05:39:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.225+0000 7f583beb2640 1 -- 172.21.15.49:0/1944589268 wait complete. 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.225+0000 7f39c8ff9640 1 -- 172.21.15.49:0/3781918337 <== osd.6 v2:172.21.15.115:6814/84441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f39ac002cb0 con 0x7f39b0072750 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.225+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f39b0072750 msgr2=0x7f39b0074b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.225+0000 7f39d17ef640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f39b0072750 0x7f39b0074b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39b006a530 msgr2=0x7f39b006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39b006a530 0x7f39b006c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39b80090b0 tx=0x7f39b803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c4050230 msgr2=0x7f39c40ee060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 --2- 172.21.15.49:0/3781918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c4050230 0x7f39c40ee060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39cc063d60 tx=0x7f39cc04e750 comp rx=0 tx=0).stop 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d0fee640 1 -- 172.21.15.49:0/3781918337 reap_dead start 2023-12-19T05:39:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 shutdown_connections 2023-12-19T05:39:15.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.226+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 >> 172.21.15.49:0/3781918337 conn(0x7f39c4054c10 msgr2=0x7f39c40e01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.227+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 shutdown_connections 2023-12-19T05:39:15.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.227+0000 7f39d17ef640 1 -- 172.21.15.49:0/3781918337 wait complete. 2023-12-19T05:39:15.248 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T05:39:15.250 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2023-12-19T05:39:15.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T05:39:15.251 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T05:39:15.252 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T05:39:15.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.240+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 --> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd041574a0 con 0x7fdcf00726d0 2023-12-19T05:39:15.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdcebfff640 1 -- 172.21.15.49:0/288235470 <== osd.7 v2:172.21.15.115:6824/84475 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd041574a0 con 0x7fdcf00726d0 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7fdcf00726d0 msgr2=0x7fdcf0074af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7fdcf00726d0 0x7fdcf0074af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcf006a4b0 msgr2=0x7fdcf006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcf006a4b0 0x7fdcf006c970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f80 tx=0x7fdcfc030000 comp rx=0 tx=0).stop 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd04158f10 msgr2=0x7fdd041577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd0a0f7640 1 --2- 172.21.15.49:0/288235470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd04158f10 0x7fdd041577a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b3e0 tx=0x7fdcf400b8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.241+0000 7fdd03fff640 1 -- 172.21.15.49:0/288235470 reap_dead start 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.242+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 shutdown_connections 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.242+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 >> 172.21.15.49:0/288235470 conn(0x7fdd040cbb70 msgr2=0x7fdd04070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.242+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 shutdown_connections 2023-12-19T05:39:15.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.242+0000 7fdd0a0f7640 1 -- 172.21.15.49:0/288235470 wait complete. 2023-12-19T05:39:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T05:39:15.256 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T05:39:15.258 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T05:39:15.259 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:15.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T05:39:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.566+0000 7f2ad881b640 1 Processor -- start 2023-12-19T05:39:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.566+0000 7f2ad881b640 1 -- start start 2023-12-19T05:39:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.567+0000 7f13c2fef640 1 Processor -- start 2023-12-19T05:39:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.567+0000 7f13c2fef640 1 -- start start 2023-12-19T05:39:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.568+0000 7f2ad881b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 0x7f2ad40cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.568+0000 7f2ad881b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ad40cc880 0x7f2ad40ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.568+0000 7f2ad881b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40cea70 con 0x7f2ad41617f0 2023-12-19T05:39:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.568+0000 7f2ad881b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40cc460 con 0x7f2ad40cc880 2023-12-19T05:39:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.568+0000 7f2ad881b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b2d30 con 0x7f2ad406ddb0 2023-12-19T05:39:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.569+0000 7f2ad37fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2ad41617f0 0x7f2ad4165ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58742/0 (socket says 172.21.15.49:58742) 2023-12-19T05:39:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.569+0000 7f2ad37fe640 1 -- 172.21.15.49:0/824927777 learned_addr learned my addr 172.21.15.49:0/824927777 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.570+0000 7f13c2fef640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13b40dffa0 0x7f13b4039970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.570+0000 7f2acbfff640 1 --2- 172.21.15.49:0/824927777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 0x7f2ad40cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.570+0000 7f2ad3fff640 1 --2- 172.21.15.49:0/824927777 >> v2:172.21.15.115:3300/0 conn(0x7f2ad40cc880 0x7f2ad40ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.570+0000 7f13c2fef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4050300 0x7f13b40507f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f13c2fef640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b404fe70 con 0x7f13b4039eb0 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f13c2fef640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40e0380 con 0x7f13b40dffa0 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f13c2fef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b404f260 con 0x7f13b4050300 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.570+0000 7f2acbfff640 1 -- 172.21.15.49:0/824927777 >> v2:172.21.15.115:3300/0 conn(0x7f2ad40cc880 msgr2=0x7f2ad40ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f2acbfff640 1 --2- 172.21.15.49:0/824927777 >> v2:172.21.15.115:3300/0 conn(0x7f2ad40cc880 0x7f2ad40ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f2acbfff640 1 -- 172.21.15.49:0/824927777 >> v1:172.21.15.115:6789/0 conn(0x7f2ad41617f0 legacy=0x7f2ad4165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.571+0000 7f2acbfff640 1 -- 172.21.15.49:0/824927777 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4161bd0 con 0x7f2ad406ddb0 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.572+0000 7f13c17ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4050300 0x7f13b40507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.572+0000 7f13c1fed640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13b40dffa0 0x7f13b4039970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.572+0000 7f2acbfff640 1 --2- 172.21.15.49:0/824927777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 0x7f2ad40cdff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8bc5517a60711a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.572+0000 7f13c1fed640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13b40dffa0 0x7f13b4039970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33750/0 (socket says 172.21.15.49:33750) 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.572+0000 7f13c1fed640 1 -- 172.21.15.49:0/3299235789 learned_addr learned my addr 172.21.15.49:0/3299235789 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.573+0000 7f13c1fed640 1 -- 172.21.15.49:0/3299235789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4050300 msgr2=0x7f13b40507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.573+0000 7f13c1fed640 1 --2- 172.21.15.49:0/3299235789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4050300 0x7f13b40507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.573+0000 7f13c1fed640 1 -- 172.21.15.49:0/3299235789 >> v1:172.21.15.49:6789/0 conn(0x7f13b4039eb0 legacy=0x7f13b40e3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.573+0000 7f13c1fed640 1 -- 172.21.15.49:0/3299235789 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b404f540 con 0x7f13b40dffa0 2023-12-19T05:39:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.574+0000 7f2ad2ffd640 1 -- 172.21.15.49:0/824927777 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc031830 con 0x7f2ad406ddb0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.574+0000 7f2ad2ffd640 1 -- 172.21.15.49:0/824927777 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc031990 con 0x7f2ad406ddb0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.574+0000 7f2ad2ffd640 1 -- 172.21.15.49:0/824927777 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc031830 con 0x7f2ad406ddb0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.574+0000 7f13c1fed640 1 --2- 172.21.15.49:0/3299235789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b40dffa0 0x7f13b4039970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0697b0 tx=0x7f13bc093950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc159410090d168 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.575+0000 7f13c0feb640 1 -- 172.21.15.49:0/3299235789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc09a6b0 con 0x7f13b40dffa0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.575+0000 7f13c0feb640 1 -- 172.21.15.49:0/3299235789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc09a810 con 0x7f13b40dffa0 2023-12-19T05:39:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.575+0000 7f13c0feb640 1 -- 172.21.15.49:0/3299235789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc09ac40 con 0x7f13b40dffa0 2023-12-19T05:39:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.575+0000 7f2ad881b640 1 -- 172.21.15.49:0/824927777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 msgr2=0x7f2ad40cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.575+0000 7f2ad881b640 1 --2- 172.21.15.49:0/824927777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 0x7f2ad40cdff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.576+0000 7f13c2fef640 1 -- 172.21.15.49:0/3299235789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b40dffa0 msgr2=0x7f13b4039970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.576+0000 7f13c2fef640 1 --2- 172.21.15.49:0/3299235789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b40dffa0 0x7f13b4039970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0697b0 tx=0x7f13bc093950 comp rx=0 tx=0).stop 2023-12-19T05:39:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.577+0000 7f13c2fef640 1 -- 172.21.15.49:0/3299235789 shutdown_connections 2023-12-19T05:39:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.577+0000 7f13c2fef640 1 --2- 172.21.15.49:0/3299235789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4050300 0x7f13b40507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.577+0000 7f13c2fef640 1 --2- 172.21.15.49:0/3299235789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b40dffa0 0x7f13b4039970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.577+0000 7f13c2fef640 1 -- 172.21.15.49:0/3299235789 >> 172.21.15.49:0/3299235789 conn(0x7f13b4054c10 msgr2=0x7f13b4054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.577+0000 7f13c2fef640 1 -- 172.21.15.49:0/3299235789 shutdown_connections 2023-12-19T05:39:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 -- 172.21.15.49:0/824927777 shutdown_connections 2023-12-19T05:39:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 --2- 172.21.15.49:0/824927777 >> v2:172.21.15.115:3300/0 conn(0x7f2ad40cc880 0x7f2ad40ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 --2- 172.21.15.49:0/824927777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad406ddb0 0x7f2ad40cdff0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 -- 172.21.15.49:0/824927777 >> 172.21.15.49:0/824927777 conn(0x7f2ad40b0100 msgr2=0x7f2ad40b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 -- 172.21.15.49:0/824927777 shutdown_connections 2023-12-19T05:39:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f2ad881b640 1 -- 172.21.15.49:0/824927777 wait complete. 2023-12-19T05:39:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f13c2fef640 1 -- 172.21.15.49:0/3299235789 wait complete. 2023-12-19T05:39:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.579+0000 7f5253bc9640 1 Processor -- start 2023-12-19T05:39:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f6b8bfff640 1 Processor -- start 2023-12-19T05:39:15.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.578+0000 7f6b8bfff640 1 -- start start 2023-12-19T05:39:15.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.579+0000 7f5253bc9640 1 -- start start 2023-12-19T05:39:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f2ad881b640 1 Processor -- start 2023-12-19T05:39:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f13c2fef640 1 Processor -- start 2023-12-19T05:39:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f13c2fef640 1 -- start start 2023-12-19T05:39:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f2ad881b640 1 -- start start 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f5253bc9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f524c0afa50 0x7f524c166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f5253bc9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 0x7f524c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f5253bc9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524c165bc0 con 0x7f524c161660 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f5253bc9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c06e520 con 0x7f524c0afa50 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f5253bc9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c0afef0 con 0x7f524c161a40 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f6b8bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b8c147cc0 0x7f6b8c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f6b8bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b8c165910 0x7f6b8c0b7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f6b8bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c1485f0 con 0x7f6b8c0b7bd0 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f6b8bfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c165da0 con 0x7f6b8c147cc0 2023-12-19T05:39:15.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.581+0000 7f6b8bfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c0b83c0 con 0x7f6b8c165910 2023-12-19T05:39:15.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f5251164640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f524c0afa50 0x7f524c166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f5252166640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 0x7f524c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f6b8b7fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6b8c0b7bd0 0x7f6b8c0b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58750/0 (socket says 172.21.15.49:58750) 2023-12-19T05:39:15.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f6b8b7fe640 1 -- 172.21.15.49:0/3052344926 learned_addr learned my addr 172.21.15.49:0/3052344926 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f6b8affd640 1 --2- 172.21.15.49:0/3052344926 >> v2:172.21.15.49:3300/0 conn(0x7f6b8c147cc0 0x7f6b8c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f5251164640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f524c0afa50 0x7f524c166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33760/0 (socket says 172.21.15.49:33760) 2023-12-19T05:39:15.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.582+0000 7f5251164640 1 -- 172.21.15.49:0/1328867259 learned_addr learned my addr 172.21.15.49:0/1328867259 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7f6b8a7fc640 1 --2- 172.21.15.49:0/3052344926 >> v2:172.21.15.115:3300/0 conn(0x7f6b8c165910 0x7f6b8c0b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7fbdba62d640 1 Processor -- start 2023-12-19T05:39:15.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7fbdba62d640 1 -- start start 2023-12-19T05:39:15.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7f6b8a7fc640 1 -- 172.21.15.49:0/3052344926 >> v2:172.21.15.49:3300/0 conn(0x7f6b8c147cc0 msgr2=0x7f6b8c1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7f6b8a7fc640 1 --2- 172.21.15.49:0/3052344926 >> v2:172.21.15.49:3300/0 conn(0x7f6b8c147cc0 0x7f6b8c1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad406ddb0 0x7f2ad414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.583+0000 7f13c2fef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4039eb0 0x7f13b40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5250963640 1 -- 172.21.15.49:0/1328867259 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746431922 0 0) 0x7f524c165bc0 con 0x7f524c161660 2023-12-19T05:39:15.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5250963640 1 -- 172.21.15.49:0/1328867259 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5238003520 con 0x7f524c161660 2023-12-19T05:39:15.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f6b8a7fc640 1 -- 172.21.15.49:0/3052344926 >> v1:172.21.15.115:6789/0 conn(0x7f6b8c0b7bd0 legacy=0x7f6b8c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f6b8a7fc640 1 -- 172.21.15.49:0/3052344926 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c0d11f0 con 0x7f6b8c165910 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ad41617f0 0x7f2ad41ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad41629b0 con 0x7f2ad406ddb0 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad414d8d0 con 0x7f2ad41617f0 2023-12-19T05:39:15.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad881b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4164e00 con 0x7f2ad40cc880 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad406ddb0 0x7f2ad414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5251164640 1 -- 172.21.15.49:0/1328867259 >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 msgr2=0x7f524c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5251164640 1 --2- 172.21.15.49:0/1328867259 >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 0x7f524c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5251164640 1 -- 172.21.15.49:0/1328867259 >> v1:172.21.15.115:6789/0 conn(0x7f524c161660 legacy=0x7f524c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f5251164640 1 -- 172.21.15.49:0/1328867259 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c165570 con 0x7f524c0afa50 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f13c2fef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f2acbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.584+0000 7f13c2fef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b40dffa0 0x7f13b404b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c2fef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b404a0a0 con 0x7f13b4050300 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c2fef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b404a380 con 0x7f13b40dffa0 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c2fef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b404a660 con 0x7f13b4039eb0 2023-12-19T05:39:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f5252166640 1 --2- 172.21.15.49:0/1328867259 >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 0x7f524c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c17ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c17ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33780/0 (socket says 172.21.15.49:33780) 2023-12-19T05:39:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c17ec640 1 -- 172.21.15.49:0/2266652688 learned_addr learned my addr 172.21.15.49:0/2266652688 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c1fed640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4039eb0 0x7f13b40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f2acbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41444/0 (socket says 172.21.15.49:41444) 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f2acbfff640 1 -- 172.21.15.49:0/2467980585 learned_addr learned my addr 172.21.15.49:0/2467980585 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f2ad3fff640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ad41617f0 0x7f2ad41ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 0x7fbdac038670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbdac038bb0 0x7fbdac006870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0e3420 con 0x7fbdac033e40 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac050240 con 0x7fbdac038bb0 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7fbdba62d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac050520 con 0x7fbdac03a6b0 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.585+0000 7f13c27ee640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b40dffa0 0x7f13b404b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 -- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ad41617f0 msgr2=0x7f2ad41ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ad41617f0 0x7f2ad41ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 -- 172.21.15.49:0/2467980585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad406ddb0 msgr2=0x7f2ad414d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad406ddb0 0x7f2ad414d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 -- 172.21.15.49:0/2467980585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009400 con 0x7f2ad40cc880 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f13c17ec640 1 -- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4039eb0 msgr2=0x7f13b40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f13c17ec640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4039eb0 0x7f13b40cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f13c17ec640 1 -- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b40dffa0 msgr2=0x7f13b404b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f13c17ec640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b40dffa0 0x7f13b404b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7fbdb962b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7fbdb962b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41460/0 (socket says 172.21.15.49:41460) 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7fbdb962b640 1 -- 172.21.15.49:0/2933173410 learned_addr learned my addr 172.21.15.49:0/2933173410 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f2acbfff640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2abc034040 tx=0x7f2abc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.586+0000 7f13c17ec640 1 -- 172.21.15.49:0/2266652688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc06ed80 con 0x7f13b4050300 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb9e2c640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.115:3300/0 conn(0x7fbdac038bb0 0x7fbdac006870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f5251164640 1 --2- 172.21.15.49:0/1328867259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0afa50 0x7f524c166050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f524c165b30 tx=0x7f523c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42efdc0b16f08770 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb8e2a640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 0x7fbdac038670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb962b640 1 -- 172.21.15.49:0/2933173410 >> v2:172.21.15.115:3300/0 conn(0x7fbdac038bb0 msgr2=0x7fbdac006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc003610 con 0x7f2ad40cc880 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc03f070 con 0x7f2ad40cc880 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0039d0 con 0x7f2ad40cc880 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb962b640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.115:3300/0 conn(0x7fbdac038bb0 0x7fbdac006870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb962b640 1 -- 172.21.15.49:0/2933173410 >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 msgr2=0x7fbdac038670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb962b640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 0x7fbdac038670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb962b640 1 -- 172.21.15.49:0/2933173410 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac050800 con 0x7fbdac03a6b0 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7fbdb8e2a640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 0x7fbdac038670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:15.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f13c17ec640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00bea0 tx=0x7f13ac00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f5250963640 1 -- 172.21.15.49:0/1328867259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c030880 con 0x7f524c0afa50 2023-12-19T05:39:15.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f5250963640 1 -- 172.21.15.49:0/1328867259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0309e0 con 0x7f524c0afa50 2023-12-19T05:39:15.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f5250963640 1 -- 172.21.15.49:0/1328867259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c030d70 con 0x7f524c0afa50 2023-12-19T05:39:15.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00fd20 con 0x7f13b4050300 2023-12-19T05:39:15.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.587+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad41622f0 con 0x7f2ad40cc880 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00fe80 con 0x7f13b4050300 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f6b8a7fc640 1 --2- 172.21.15.49:0/3052344926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c0b7690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0d0a60 tx=0x7f6b8002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8ad96777652b26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.588+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4164a20 con 0x7f2ad40cc880 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 -- 172.21.15.49:0/1328867259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0afa50 msgr2=0x7f524c166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f6b89ffb640 1 -- 172.21.15.49:0/3052344926 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80031830 con 0x7f6b8c165910 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f6b89ffb640 1 -- 172.21.15.49:0/3052344926 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80031990 con 0x7f6b8c165910 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f6b89ffb640 1 -- 172.21.15.49:0/3052344926 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80031d20 con 0x7f6b8c165910 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00fd20 con 0x7f13b4050300 2023-12-19T05:39:15.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f13c2fef640 1 -- 172.21.15.49:0/2266652688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b404a940 con 0x7f13b4050300 2023-12-19T05:39:15.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f13c2fef640 1 -- 172.21.15.49:0/2266652688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b4049db0 con 0x7f13b4050300 2023-12-19T05:39:15.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7fbdb962b640 1 --2- 172.21.15.49:0/2933173410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40697b0 tx=0x7fbdb408d670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c110248b13180e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7f6b8bfff640 1 -- 172.21.15.49:0/3052344926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 msgr2=0x7f6b8c0b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7f6b8bfff640 1 --2- 172.21.15.49:0/3052344926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c0b7690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0d0a60 tx=0x7f6b8002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 --2- 172.21.15.49:0/1328867259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0afa50 0x7f524c166050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f524c165b30 tx=0x7f523c02b9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 -- 172.21.15.49:0/1328867259 shutdown_connections 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 --2- 172.21.15.49:0/1328867259 >> v2:172.21.15.115:3300/0 conn(0x7f524c161a40 0x7f524c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 --2- 172.21.15.49:0/1328867259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0afa50 0x7f524c166050 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f524c165b30 tx=0x7f523c02b9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.589+0000 7f5253bc9640 1 -- 172.21.15.49:0/1328867259 >> 172.21.15.49:0/1328867259 conn(0x7f524c0cbb70 msgr2=0x7f524c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.591+0000 7f5253bc9640 1 -- 172.21.15.49:0/1328867259 shutdown_connections 2023-12-19T05:39:15.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.591+0000 7f13c2fef640 1 -- 172.21.15.49:0/2266652688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b4005490 con 0x7f13b4050300 2023-12-19T05:39:15.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7f81fe404640 1 Processor -- start 2023-12-19T05:39:15.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.591+0000 7f81fe404640 1 -- start start 2023-12-19T05:39:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7fbdabfff640 1 -- 172.21.15.49:0/2933173410 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4096410 con 0x7fbdac03a6b0 2023-12-19T05:39:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7fbdabfff640 1 -- 172.21.15.49:0/2933173410 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4090030 con 0x7fbdac03a6b0 2023-12-19T05:39:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.590+0000 7fbdabfff640 1 -- 172.21.15.49:0/2933173410 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4096830 con 0x7fbdac03a6b0 2023-12-19T05:39:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 -- 172.21.15.49:0/2933173410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 msgr2=0x7fbdac0546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2933173410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40697b0 tx=0x7fbdb408d670 comp rx=0 tx=0).stop 2023-12-19T05:39:15.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f6b8bfff640 1 -- 172.21.15.49:0/3052344926 shutdown_connections 2023-12-19T05:39:15.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f6b8bfff640 1 --2- 172.21.15.49:0/3052344926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c0b7690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f6b8bfff640 1 --2- 172.21.15.49:0/3052344926 >> v2:172.21.15.49:3300/0 conn(0x7f6b8c147cc0 0x7f6b8c1653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f6b8bfff640 1 -- 172.21.15.49:0/3052344926 >> 172.21.15.49:0/3052344926 conn(0x7f6b8c065bb0 msgr2=0x7f6b8c0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4162150 con 0x7f2ad40cc880 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2abc003b30 con 0x7f2ad40cc880 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 -- 172.21.15.49:0/2933173410 shutdown_connections 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.115:3300/0 conn(0x7fbdac038bb0 0x7fbdac006870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2933173410 >> v2:172.21.15.49:3300/0 conn(0x7fbdac033e40 0x7fbdac038670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2933173410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac03a6b0 0x7fbdac0546d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.592+0000 7fbdba62d640 1 -- 172.21.15.49:0/2933173410 >> 172.21.15.49:0/2933173410 conn(0x7fbdac054c10 msgr2=0x7fbdac054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.591+0000 7f5253bc9640 1 -- 172.21.15.49:0/1328867259 wait complete. 2023-12-19T05:39:15.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.594+0000 7f5253bc9640 1 Processor -- start 2023-12-19T05:39:15.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f6b8bfff640 1 -- 172.21.15.49:0/3052344926 shutdown_connections 2023-12-19T05:39:15.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f6b8bfff640 1 -- 172.21.15.49:0/3052344926 wait complete. 2023-12-19T05:39:15.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.594+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13ac014070 con 0x7f13b4050300 2023-12-19T05:39:15.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f81fe404640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81f8146e10 0x7f81f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f81fe404640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f80d2b00 0x7f81f80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f81fe404640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f80cd840 con 0x7f81f80ce110 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f81fe404640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f80d2430 con 0x7f81f8146e10 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7f81fe404640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80d2620 con 0x7f81f80d2b00 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.594+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f80d2b00 0x7f81f80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.594+0000 7f81fc9a1640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f81f80ce110 0x7f81f80b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58758/0 (socket says 172.21.15.49:58758) 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.594+0000 7f81fc9a1640 1 -- 172.21.15.49:0/3203159817 learned_addr learned my addr 172.21.15.49:0/3203159817 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7fbdba62d640 1 -- 172.21.15.49:0/2933173410 shutdown_connections 2023-12-19T05:39:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.593+0000 7fbdba62d640 1 -- 172.21.15.49:0/2933173410 wait complete. 2023-12-19T05:39:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3203159817 >> v2:172.21.15.49:3300/0 conn(0x7f81f8146e10 0x7f81f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7fbb859c4640 1 Processor -- start 2023-12-19T05:39:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f6b8bfff640 1 Processor -- start 2023-12-19T05:39:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7f6b8bfff640 1 -- start start 2023-12-19T05:39:15.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f13b27fc640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 0x7f13a006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7fbb859c4640 1 -- start start 2023-12-19T05:39:15.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7f81f6ffd640 1 -- 172.21.15.49:0/3203159817 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254893570 0 0) 0x7f81f80cd840 con 0x7f81f80ce110 2023-12-19T05:39:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7fbdba62d640 1 Processor -- start 2023-12-19T05:39:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13ac087c30 con 0x7f13b4050300 2023-12-19T05:39:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7f81f6ffd640 1 -- 172.21.15.49:0/3203159817 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003520 con 0x7f81f80ce110 2023-12-19T05:39:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f2ad0ff9640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 0x7f2ab806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2abc041070 con 0x7f2ad40cc880 2023-12-19T05:39:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7f2ad37fe640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 0x7f2ab806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.596+0000 7fbdba62d640 1 -- start start 2023-12-19T05:39:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.595+0000 7f5253bc9640 1 -- start start 2023-12-19T05:39:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f13c1fed640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 0x7f13a006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f2ad37fe640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 0x7f2ab806c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4005880 tx=0x7f2ac4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 0x7f6b8c1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b8c147cc0 0x7f6b8c06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c161730 con 0x7f6b8c0b7bd0 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c06e510 con 0x7f6b8c165910 2023-12-19T05:39:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f6b8bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c06a3d0 con 0x7f6b8c147cc0 2023-12-19T05:39:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 0x7f524c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f81f7fff640 1 -- 172.21.15.49:0/3203159817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f80d2b00 msgr2=0x7f81f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3203159817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f80d2b00 0x7f81f80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f81f7fff640 1 -- 172.21.15.49:0/3203159817 >> v1:172.21.15.115:6789/0 conn(0x7f81f80ce110 legacy=0x7f81f80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.597+0000 7f81f7fff640 1 -- 172.21.15.49:0/3203159817 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80b41c0 con 0x7f81f8146e10 2023-12-19T05:39:15.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c15f0c0 0x7f524c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7fbb859c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb80146e10 0x7fbb800d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f2ca037e640 1 Processor -- start 2023-12-19T05:39:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c15eca0 con 0x7f524c161a40 2023-12-19T05:39:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5251965640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 0x7f524c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7fbb859c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbdba62d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 0x7fbdac04bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c15b140 con 0x7f524c15f0c0 2023-12-19T05:39:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5253bc9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0aa070 con 0x7f524c161660 2023-12-19T05:39:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5251164640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f5251164640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33810/0 (socket says 172.21.15.49:33810) 2023-12-19T05:39:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f5251164640 1 -- 172.21.15.49:0/3005139422 learned_addr learned my addr 172.21.15.49:0/3005139422 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f5251965640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 0x7f524c15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41478/0 (socket says 172.21.15.49:41478) 2023-12-19T05:39:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb859c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb800ce110 0x7fbb800ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f2ca037e640 1 -- start start 2023-12-19T05:39:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbdba62d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdac038bb0 0x7fbdac0db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f6b8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f6b8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56424/0 (socket says 172.21.15.49:56424) 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.598+0000 7f6b8b7fe640 1 -- 172.21.15.49:0/463345970 learned_addr learned my addr 172.21.15.49:0/463345970 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f6b8affd640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 0x7f6b8c1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f6b8a7fc640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b8c147cc0 0x7f6b8c06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbdba62d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 0x7fbdac034670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f5252166640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c15f0c0 0x7f524c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb7effd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb80146e10 0x7fbb800d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb7effd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb80146e10 0x7fbb800d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56436/0 (socket says 172.21.15.49:56436) 2023-12-19T05:39:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3203159817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f8146e10 0x7f81f80d1ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009d90 tx=0x7f81e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986374eaf19674c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbdba62d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0dc820 con 0x7fbdac03a6b0 2023-12-19T05:39:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb7e7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb7e7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41490/0 (socket says 172.21.15.49:41490) 2023-12-19T05:39:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbdb962b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 0x7fbdac04bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.599+0000 7fbb7effd640 1 -- 172.21.15.49:0/1100884737 learned_addr learned my addr 172.21.15.49:0/1100884737 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdb962b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 0x7fbdac04bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41492/0 (socket says 172.21.15.49:41492) 2023-12-19T05:39:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbb7f7fe640 1 --2- 172.21.15.49:0/1100884737 >> v2:172.21.15.49:3300/0 conn(0x7fbb800ce110 0x7fbb800ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdba62d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0dbc10 con 0x7fbdac038bb0 2023-12-19T05:39:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdba62d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0dbef0 con 0x7fbdac033e40 2023-12-19T05:39:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdb962b640 1 -- 172.21.15.49:0/2684651626 learned_addr learned my addr 172.21.15.49:0/2684651626 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800d2430 con 0x7fbb800ce110 2023-12-19T05:39:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800ceae0 con 0x7fbb80146e10 2023-12-19T05:39:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f5251164640 1 -- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 msgr2=0x7f524c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f13c1fed640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 0x7f13a006c950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13b4007980 tx=0x7f13bc0a5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cd840 con 0x7fbb800d2b00 2023-12-19T05:39:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdb8e2a640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdac038bb0 0x7fbdac0db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7fbdb9e2c640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 0x7fbdac034670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f5251164640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 0x7f524c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f5251164640 1 -- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c15f0c0 msgr2=0x7f524c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f5251164640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c15f0c0 0x7f524c0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8b7fe640 1 -- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b8c147cc0 msgr2=0x7f6b8c06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8b7fe640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b8c147cc0 0x7f6b8c06d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f5251164640 1 -- 172.21.15.49:0/3005139422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009a70 con 0x7f524c161a40 2023-12-19T05:39:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 -- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 msgr2=0x7fbdac04bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 0x7fbdac04bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 -- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdac038bb0 msgr2=0x7fbdac0db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdac038bb0 0x7fbdac0db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8b7fe640 1 -- 172.21.15.49:0/463345970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 msgr2=0x7f6b8c1611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8b7fe640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 0x7f6b8c1611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8b7fe640 1 -- 172.21.15.49:0/463345970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80009400 con 0x7f6b8c165910 2023-12-19T05:39:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 -- 172.21.15.49:0/2684651626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb406ed80 con 0x7fbdac03a6b0 2023-12-19T05:39:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.600+0000 7f6b8affd640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 0x7f6b8c1611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7f5251164640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f523c0090b0 tx=0x7f523c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7effd640 1 -- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 msgr2=0x7fbb800b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7effd640 1 -- 172.21.15.49:0/1100884737 >> v2:172.21.15.49:3300/0 conn(0x7fbb800ce110 msgr2=0x7fbb800ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1100884737 >> v2:172.21.15.49:3300/0 conn(0x7fbb800ce110 0x7fbb800ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7effd640 1 -- 172.21.15.49:0/1100884737 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800d2620 con 0x7fbb80146e10 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbb7e7fc640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7f6b8b7fe640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400cb10 tx=0x7f6b8400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7fbdb9e2c640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 0x7fbdac034670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbdac039000 tx=0x7fbdb000d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.601+0000 7f2ca037e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c98150550 0x7f2c980cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400ac70 con 0x7f6b8c165910 2023-12-19T05:39:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f6b8bfff640 1 -- 172.21.15.49:0/463345970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c06a6b0 con 0x7f6b8c165910 2023-12-19T05:39:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2ca037e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2c980b2060 0x7f2c98159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400add0 con 0x7f6b8c165910 2023-12-19T05:39:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84012620 con 0x7f6b8c165910 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2ca037e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9815db80 con 0x7f2c980cb360 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2ca037e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980cb810 con 0x7f2c98150550 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2ca037e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980aef70 con 0x7f2c980b2060 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2c9e11a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c98150550 0x7f2c980cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2c9d919640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2c980cb360 0x7f2c980b1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41204/0 (socket says 172.21.15.49:41204) 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2c9d919640 1 -- 172.21.15.49:0/3132769895 learned_addr learned my addr 172.21.15.49:0/3132769895 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f6b8bfff640 1 -- 172.21.15.49:0/463345970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c06ac70 con 0x7f6b8c165910 2023-12-19T05:39:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.602+0000 7f2c9e91b640 1 --2- 172.21.15.49:0/3132769895 >> v2:172.21.15.115:3300/0 conn(0x7f2c980b2060 0x7f2c98159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb800d1ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbb800d0720 tx=0x7fbb7802b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=558c63d511ac38eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7f2c9e11a640 1 -- 172.21.15.49:0/3132769895 >> v2:172.21.15.115:3300/0 conn(0x7f2c980b2060 msgr2=0x7f2c98159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7f2c9e11a640 1 --2- 172.21.15.49:0/3132769895 >> v2:172.21.15.115:3300/0 conn(0x7f2c980b2060 0x7f2c98159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7f2c9e11a640 1 -- 172.21.15.49:0/3132769895 >> v1:172.21.15.49:6789/0 conn(0x7f2c980cb360 legacy=0x7f2c980b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7f2c9e11a640 1 -- 172.21.15.49:0/3132769895 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980b24d0 con 0x7f2c98150550 2023-12-19T05:39:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7fbb7dffb640 1 -- 172.21.15.49:0/1100884737 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78031880 con 0x7fbb80146e10 2023-12-19T05:39:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.603+0000 7fbb7dffb640 1 -- 172.21.15.49:0/1100884737 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb780319e0 con 0x7fbb80146e10 2023-12-19T05:39:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbb7dffb640 1 -- 172.21.15.49:0/1100884737 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78031d70 con 0x7fbb80146e10 2023-12-19T05:39:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00125f0 con 0x7fbdac03a6b0 2023-12-19T05:39:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c039c90 con 0x7f524c161a40 2023-12-19T05:39:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f81f6ffd640 1 -- 172.21.15.49:0/3203159817 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e802cc80 con 0x7f81f8146e10 2023-12-19T05:39:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f81f6ffd640 1 -- 172.21.15.49:0/3203159817 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e802cde0 con 0x7f81f8146e10 2023-12-19T05:39:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f81f6ffd640 1 -- 172.21.15.49:0/3203159817 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8034660 con 0x7f81f8146e10 2023-12-19T05:39:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f13ac053230 con 0x7f13b4050300 2023-12-19T05:39:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0dc1d0 con 0x7fbdac03a6b0 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0db730 con 0x7fbdac03a6b0 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0012750 con 0x7fbdac03a6b0 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0012ae0 con 0x7fbdac03a6b0 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f6b8bfff640 1 -- 172.21.15.49:0/463345970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c06ae60 con 0x7f6b8c165910 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c0094d0 con 0x7f524c161a40 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c15e5e0 con 0x7f524c161a40 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c039df0 con 0x7f524c161a40 2023-12-19T05:39:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.604+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c004270 con 0x7f524c161a40 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 msgr2=0x7fbb800d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb800d1ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbb800d0720 tx=0x7fbb7802b920 comp rx=0 tx=0).stop 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 -- 172.21.15.49:0/3203159817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f8146e10 msgr2=0x7f81f80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 --2- 172.21.15.49:0/3203159817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f8146e10 0x7f81f80d1ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009d90 tx=0x7f81e802bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 -- 172.21.15.49:0/3203159817 shutdown_connections 2023-12-19T05:39:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 --2- 172.21.15.49:0/3203159817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f80d2b00 0x7f81f80b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 --2- 172.21.15.49:0/3203159817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f8146e10 0x7f81f80d1ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 shutdown_connections 2023-12-19T05:39:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f81fe404640 1 -- 172.21.15.49:0/3203159817 >> 172.21.15.49:0/3203159817 conn(0x7f81f80b29c0 msgr2=0x7f81f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1100884737 >> v2:172.21.15.49:3300/0 conn(0x7fbb800ce110 0x7fbb800ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb800b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.605+0000 7f2c9e11a640 1 --2- 172.21.15.49:0/3132769895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c98150550 0x7f2c980cae20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d90 tx=0x7f2c9402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbb46d7ad66d8d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1100884737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb800d1ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 >> 172.21.15.49:0/1100884737 conn(0x7fbb800b29c0 msgr2=0x7fbb800b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7f2c9d118640 1 -- 172.21.15.49:0/3132769895 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9402cc70 con 0x7f2c98150550 2023-12-19T05:39:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0dc9d0 con 0x7fbdac03a6b0 2023-12-19T05:39:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 shutdown_connections 2023-12-19T05:39:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7f2c9d118640 1 -- 172.21.15.49:0/3132769895 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9402cdd0 con 0x7f2c98150550 2023-12-19T05:39:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.607+0000 7fbb859c4640 1 -- 172.21.15.49:0/1100884737 wait complete. 2023-12-19T05:39:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.607+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b8401b3b0 con 0x7f6b8c165910 2023-12-19T05:39:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.607+0000 7f81fe404640 1 -- 172.21.15.49:0/3203159817 shutdown_connections 2023-12-19T05:39:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5234005250 con 0x7f524c161a40 2023-12-19T05:39:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.606+0000 7f2c9d118640 1 -- 172.21.15.49:0/3132769895 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94034660 con 0x7f2c98150550 2023-12-19T05:39:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.607+0000 7f2ca037e640 1 -- 172.21.15.49:0/3132769895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c98150550 msgr2=0x7f2c980cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.607+0000 7f2ca037e640 1 --2- 172.21.15.49:0/3132769895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c98150550 0x7f2c980cae20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d90 tx=0x7f2c9402bec0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f6b737fe640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 0x7f6b7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b84088720 con 0x7f6b8c165910 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f2ca037e640 1 -- 172.21.15.49:0/3132769895 shutdown_connections 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f2ca037e640 1 --2- 172.21.15.49:0/3132769895 >> v2:172.21.15.115:3300/0 conn(0x7f2c980b2060 0x7f2c98159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f2ca037e640 1 --2- 172.21.15.49:0/3132769895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c98150550 0x7f2c980cae20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f2ca037e640 1 -- 172.21.15.49:0/3132769895 >> 172.21.15.49:0/3132769895 conn(0x7f2c980cbb70 msgr2=0x7f2c980cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdb0012c40 con 0x7fbdac03a6b0 2023-12-19T05:39:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.609+0000 7f2ca037e640 1 -- 172.21.15.49:0/3132769895 shutdown_connections 2023-12-19T05:39:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.608+0000 7f81fe404640 1 -- 172.21.15.49:0/3203159817 wait complete. 2023-12-19T05:39:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.609+0000 7f2ca037e640 1 -- 172.21.15.49:0/3132769895 wait complete. 2023-12-19T05:39:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.609+0000 7f6b8affd640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 0x7f6b7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.609+0000 7fbda9ffb640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 0x7fbd9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.609+0000 7fbb859c4640 1 Processor -- start 2023-12-19T05:39:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.610+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdb0088c90 con 0x7fbdac03a6b0 2023-12-19T05:39:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.610+0000 7fbb859c4640 1 -- start start 2023-12-19T05:39:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.610+0000 7fbdb962b640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 0x7fbd9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.610+0000 7f81fe404640 1 Processor -- start 2023-12-19T05:39:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.610+0000 7f81fe404640 1 -- start start 2023-12-19T05:39:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.611+0000 7f6b8affd640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 0x7f6b7806c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b4a20 tx=0x7f6b7c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f523c0043d0 con 0x7f524c161a40 2023-12-19T05:39:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f2ca037e640 1 Processor -- start 2023-12-19T05:39:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb801541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb80157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb801546e0 con 0x7fbb800ce110 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80157770 con 0x7fbb80146e10 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7fbb859c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb801548d0 con 0x7fbb800d2b00 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f2ca037e640 1 -- start start 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 0x7f81f81f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 0x7f81f815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f813d340 0x7f81f815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81f74f0 con 0x7f81f80ce110 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815b540 con 0x7f81f80d2b00 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.612+0000 7f81fe404640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81f7cf0 con 0x7f81f813d340 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbb7e7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb801541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33852/0 (socket says 172.21.15.49:33852) 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbb7effd640 1 -- 172.21.15.49:0/1813391459 learned_addr learned my addr 172.21.15.49:0/1813391459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 0x7f81f815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f81f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 0x7f81f81f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 0x7f81f815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56454/0 (socket says 172.21.15.49:56454) 2023-12-19T05:39:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f81f77fe640 1 -- 172.21.15.49:0/3171368457 learned_addr learned my addr 172.21.15.49:0/3171368457 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f52427fc640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 0x7f523006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbb7f7fe640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb80157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c980b2060 0x7f2c98158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c98150550 0x7f2c9813c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9815c5e0 con 0x7f2c980cb360 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98141a90 con 0x7f2c980b2060 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f2ca037e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9815b960 con 0x7f2c98150550 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7f81fc9a1640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f813d340 0x7f81f815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.613+0000 7fbdb962b640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 0x7fbd9806c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40638d0 tx=0x7fbdb406c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f2c9d919640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f5251965640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 0x7f523006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7fbb7effd640 1 -- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 msgr2=0x7fbb801541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb801541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7fbb7effd640 1 -- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 msgr2=0x7fbb80157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb80157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7fbb7effd640 1 -- 172.21.15.49:0/1813391459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009400 con 0x7fbb800ce110 2023-12-19T05:39:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f81f7fff640 1 -- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f813d340 msgr2=0x7f81f815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f813d340 0x7f81f815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f81f7fff640 1 -- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 msgr2=0x7f81f815a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 0x7f81f815a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f81f7fff640 1 -- 172.21.15.49:0/3171368457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8009a70 con 0x7f81f80ce110 2023-12-19T05:39:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.614+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ad4162150 con 0x7f2ad40cc880 2023-12-19T05:39:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9e91b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c98150550 0x7f2c9813c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33868/0 (socket says 172.21.15.49:33868) 2023-12-19T05:39:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f81f7fff640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 0x7f81f81f6450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b5ee0 tx=0x7f81e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 -- 172.21.15.49:0/29967264 learned_addr learned my addr 172.21.15.49:0/29967264 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9e11a640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c980b2060 0x7f2c98158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7fbb7effd640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb78000c00 tx=0x7fbb780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f523c03e070 con 0x7f524c161a40 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 -- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c98150550 msgr2=0x7f2c9813c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c98150550 0x7f2c9813c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 -- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c980b2060 msgr2=0x7f2c98158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c980b2060 0x7f2c98158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.616+0000 7f5251965640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 0x7f523006c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52480011e0 tx=0x7f5248009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.615+0000 7f2c9d919640 1 -- 172.21.15.49:0/29967264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94009a70 con 0x7f2c980cb360 2023-12-19T05:39:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.616+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdac0dc9d0 con 0x7fbdac03a6b0 2023-12-19T05:39:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.616+0000 7f2c9d919640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c4d0 tx=0x7f2c8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8040650 con 0x7f81f80ce110 2023-12-19T05:39:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e80407d0 con 0x7f81f80ce110 2023-12-19T05:39:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8040b80 con 0x7f81f80ce110 2023-12-19T05:39:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f81f6990 con 0x7f81f80ce110 2023-12-19T05:39:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7803ac60 con 0x7fbb800ce110 2023-12-19T05:39:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7803adc0 con 0x7fbb800ce110 2023-12-19T05:39:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f523c076ad0 con 0x7f524c161a40 2023-12-19T05:39:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f815b260 con 0x7f81f80ce110 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.624+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88005ce0 con 0x7f2c980cb360 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.625+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88005e40 con 0x7f2c980cb360 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.625+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88007270 con 0x7f2c980cb360 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.625+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78042630 con 0x7fbb800ce110 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.625+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb780094d0 con 0x7fbb800ce110 2023-12-19T05:39:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.625+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb80154e90 con 0x7fbb800ce110 2023-12-19T05:39:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.626+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9815bc40 con 0x7f2c980cb360 2023-12-19T05:39:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.626+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9815c200 con 0x7f2c980cb360 2023-12-19T05:39:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.626+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8061910 con 0x7f81f80ce110 2023-12-19T05:39:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.627+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb801f6d20 con 0x7fbb800ce110 2023-12-19T05:39:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.628+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c80005250 con 0x7f2c980cb360 2023-12-19T05:39:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.630+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81e8040ce0 con 0x7f81f80ce110 2023-12-19T05:39:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.631+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b84053e50 con 0x7f6b8c165910 2023-12-19T05:39:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.632+0000 7f81f4ff9640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 0x7f81e406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.632+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81e80ab260 con 0x7f81f80ce110 2023-12-19T05:39:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.632+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c880073d0 con 0x7f2c980cb360 2023-12-19T05:39:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.633+0000 7f81f77fe640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 0x7f81e406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.634+0000 7f2c8effd640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 0x7f2c7c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.634+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c88087c00 con 0x7f2c980cb360 2023-12-19T05:39:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.634+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb780303d0 con 0x7fbb800ce110 2023-12-19T05:39:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.635+0000 7f81f77fe640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 0x7f81e406c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81f81593b0 tx=0x7f81ec009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.636+0000 7fbb67fff640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 0x7fbb6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.636+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb780aaf10 con 0x7fbb800ce110 2023-12-19T05:39:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.636+0000 7f2c9e11a640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 0x7f2c7c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.637+0000 7fbb7e7fc640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 0x7fbb6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.638+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb78076620 con 0x7fbb800ce110 2023-12-19T05:39:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.638+0000 7f2c9e11a640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 0x7f2c7c06c970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c94036000 tx=0x7f2c94030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.638+0000 7fbb7e7fc640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 0x7fbb6c06c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb80156200 tx=0x7fbb74009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.650+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81e8076850 con 0x7f81f80ce110 2023-12-19T05:39:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:15.655+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c8808d020 con 0x7f2c980cb360 2023-12-19T05:39:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.021+0000 7f13c2fef640 1 -- 172.21.15.49:0/2266652688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f13b40546c0 con 0x7f13b4050300 2023-12-19T05:39:16.027 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.023+0000 7f13b27fc640 1 -- 172.21.15.49:0/2266652688 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13ac01b020 con 0x7f13b4050300 2023-12-19T05:39:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 msgr2=0x7f13a006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 0x7f13a006c950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13b4007980 tx=0x7f13bc0a5040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 msgr2=0x7f13b4049870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00bea0 tx=0x7f13ac00bf90 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 shutdown_connections 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f13a006a490 0x7f13a006c950 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13b4007980 tx=0x7f13bc0a5040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b40dffa0 0x7f13b404b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4050300 0x7f13b4049870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 --2- 172.21.15.49:0/2266652688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b4039eb0 0x7f13b40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.026+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 >> 172.21.15.49:0/2266652688 conn(0x7f13b4054c10 msgr2=0x7f13b4037640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.028+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 shutdown_connections 2023-12-19T05:39:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.028+0000 7f139ffff640 1 -- 172.21.15.49:0/2266652688 wait complete. 2023-12-19T05:39:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.036+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ad4162af0 con 0x7f2ad40cc880 2023-12-19T05:39:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.037+0000 7f2ad0ff9640 1 -- 172.21.15.49:0/2467980585 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ad4162af0 con 0x7f2ad40cc880 2023-12-19T05:39:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.038+0000 7f6b8bfff640 1 -- 172.21.15.49:0/463345970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6b8c061910 con 0x7f6b8c165910 2023-12-19T05:39:16.040 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.039+0000 7f6b737fe640 1 -- 172.21.15.49:0/463345970 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b84017020 con 0x7f6b8c165910 2023-12-19T05:39:16.043 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.040+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 msgr2=0x7f2ab806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 0x7f2ab806c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4005880 tx=0x7f2ac4009040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 msgr2=0x7f2ad41e9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2abc034040 tx=0x7f2abc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 shutdown_connections 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2ab806a500 0x7f2ab806c9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ad40cc880 0x7f2ad41e9f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ad41617f0 0x7f2ad41ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 --2- 172.21.15.49:0/2467980585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ad406ddb0 0x7f2ad414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 >> 172.21.15.49:0/2467980585 conn(0x7f2ad40b0100 msgr2=0x7f2ad406bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 shutdown_connections 2023-12-19T05:39:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.041+0000 7f2ad881b640 1 -- 172.21.15.49:0/2467980585 wait complete. 2023-12-19T05:39:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 msgr2=0x7f6b7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 0x7f6b7806c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b4a20 tx=0x7f6b7c009190 comp rx=0 tx=0).stop 2023-12-19T05:39:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbdac0dc960 con 0x7fbdac03a6b0 2023-12-19T05:39:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 msgr2=0x7f6b8c06deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400cb10 tx=0x7f6b8400a060 comp rx=0 tx=0).stop 2023-12-19T05:39:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 shutdown_connections 2023-12-19T05:39:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b7806a430 0x7f6b7806c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b8c147cc0 0x7f6b8c06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b8c165910 0x7f6b8c06deb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 --2- 172.21.15.49:0/463345970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b8c0b7bd0 0x7f6b8c1611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.045+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 >> 172.21.15.49:0/463345970 conn(0x7f6b8c065bb0 msgr2=0x7f6b8c06f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.046+0000 7fbda9ffb640 1 -- 172.21.15.49:0/2684651626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdb0054290 con 0x7fbdac03a6b0 2023-12-19T05:39:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.046+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 shutdown_connections 2023-12-19T05:39:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.046+0000 7f6b717fa640 1 -- 172.21.15.49:0/463345970 wait complete. 2023-12-19T05:39:16.050 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.052+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 msgr2=0x7fbd9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.052+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 0x7fbd9806c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40638d0 tx=0x7fbdb406c040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.052+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 msgr2=0x7fbdac034670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.052+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 0x7fbdac034670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbdac039000 tx=0x7fbdb000d9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.052+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52340057d0 con 0x7f524c161a40 2023-12-19T05:39:16.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7f52427fc640 1 -- 172.21.15.49:0/3005139422 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f523c034020 con 0x7f524c161a40 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 shutdown_connections 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd9806a430 0x7fbd9806c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdac03a6b0 0x7fbdac034670 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdac038bb0 0x7fbdac0db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 --2- 172.21.15.49:0/2684651626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdac033e40 0x7fbdac04bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.053+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 >> 172.21.15.49:0/2684651626 conn(0x7fbdac054c10 msgr2=0x7fbdac0e1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.054+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 shutdown_connections 2023-12-19T05:39:16.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.054+0000 7fbdba62d640 1 -- 172.21.15.49:0/2684651626 wait complete. 2023-12-19T05:39:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 msgr2=0x7f523006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 0x7f523006c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52480011e0 tx=0x7f5248009040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 msgr2=0x7f524c0a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f523c0090b0 tx=0x7f523c004730 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 shutdown_connections 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f523006a430 0x7f523006c8f0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52480011e0 tx=0x7f5248009040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c15f0c0 0x7f524c0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c161a40 0x7f524c0a9540 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 --2- 172.21.15.49:0/3005139422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c161660 0x7f524c15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.058+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 >> 172.21.15.49:0/3005139422 conn(0x7f524c0cbb70 msgr2=0x7f524c164750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-12-19T05:39:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.059+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 shutdown_connections 2023-12-19T05:39:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.059+0000 7f5253bc9640 1 -- 172.21.15.49:0/3005139422 wait complete. 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.065+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbb80061910 con 0x7fbb800ce110 2023-12-19T05:39:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.066+0000 7fbb67fff640 1 -- 172.21.15.49:0/1813391459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb78047020 con 0x7fbb800ce110 2023-12-19T05:39:16.067 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.067+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f81f81f6990 con 0x7f81f80ce110 2023-12-19T05:39:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.067+0000 7f81f4ff9640 1 -- 172.21.15.49:0/3171368457 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81f81f6990 con 0x7f81f80ce110 2023-12-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.069+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 msgr2=0x7fbb6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.069+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 0x7fbb6c06c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb80156200 tx=0x7fbb74009190 comp rx=0 tx=0).stop 2023-12-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.069+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 msgr2=0x7fbb801f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.069+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb78000c00 tx=0x7fbb780046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 shutdown_connections 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb6c06a430 0x7fbb6c06c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb800d2b00 0x7fbb801541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80146e10 0x7fbb80157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 --2- 172.21.15.49:0/1813391459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb800ce110 0x7fbb801f9b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 >> 172.21.15.49:0/1813391459 conn(0x7fbb800b29c0 msgr2=0x7fbb80146060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 msgr2=0x7f81e406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 0x7f81e406c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81f81593b0 tx=0x7f81ec009190 comp rx=0 tx=0).stop 2023-12-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 msgr2=0x7f81f81f6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 0x7f81f81f6450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b5ee0 tx=0x7f81e8004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:16.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 shutdown_connections 2023-12-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81e406a530 0x7f81e406c9f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.070+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 shutdown_connections 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81f813d340 0x7f81f815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f80d2b00 0x7f81f815a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 --2- 172.21.15.49:0/3171368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81f80ce110 0x7f81f81f6450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 >> 172.21.15.49:0/3171368457 conn(0x7f81f80b29c0 msgr2=0x7f81f80d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7fbb859c4640 1 -- 172.21.15.49:0/1813391459 wait complete. 2023-12-19T05:39:16.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 shutdown_connections 2023-12-19T05:39:16.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.071+0000 7f81fe404640 1 -- 172.21.15.49:0/3171368457 wait complete. 2023-12-19T05:39:16.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-19T05:39:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.076+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2c800057d0 con 0x7f2c980cb360 2023-12-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.077+0000 7f2c8effd640 1 -- 172.21.15.49:0/29967264 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c88053410 con 0x7f2c980cb360 2023-12-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-12-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 msgr2=0x7f2c7c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 0x7f2c7c06c970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c94036000 tx=0x7f2c94030000 comp rx=0 tx=0).stop 2023-12-19T05:39:16.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-19T05:39:16.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 msgr2=0x7f2c98142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c4d0 tx=0x7f2c8800c990 comp rx=0 tx=0).stop 2023-12-19T05:39:16.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 shutdown_connections 2023-12-19T05:39:16.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2c7c06a4b0 0x7f2c7c06c970 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c98150550 0x7f2c9813c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c980cb360 0x7f2c98142cc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 --2- 172.21.15.49:0/29967264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c980b2060 0x7f2c98158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 >> 172.21.15.49:0/29967264 conn(0x7f2c980cbb70 msgr2=0x7f2c980706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 shutdown_connections 2023-12-19T05:39:16.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:16.080+0000 7f2ca037e640 1 -- 172.21.15.49:0/29967264 wait complete. 2023-12-19T05:39:16.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-19T05:39:16.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-19T05:39:16.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-19T05:39:16.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-19T05:39:17.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T05:39:17.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T05:39:17.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T05:39:17.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T05:39:17.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T05:39:17.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T05:39:17.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T05:39:17.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T05:39:17.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.381+0000 7f839520e640 1 Processor -- start 2023-12-19T05:39:17.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.381+0000 7f839520e640 1 -- start start 2023-12-19T05:39:17.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.384+0000 7f839520e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8388054320 0x7f8388057db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.384+0000 7f839520e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f8388006940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f839520e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8388058d50 con 0x7f83880e3270 2023-12-19T05:39:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f838f7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8388054320 0x7f8388057db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f838f7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8388054320 0x7f8388057db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56488/0 (socket says 172.21.15.49:56488) 2023-12-19T05:39:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f838f7fe640 1 -- 172.21.15.49:0/4145923501 learned_addr learned my addr 172.21.15.49:0/4145923501 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838803bfe0 con 0x7f8388054320 2023-12-19T05:39:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.385+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880584b0 con 0x7f838803ea20 2023-12-19T05:39:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.386+0000 7f8394a0d640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f8388006940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.387+0000 7f838f7fe640 1 -- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 msgr2=0x7f8388006940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.387+0000 7f838f7fe640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f8388006940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.387+0000 7f838f7fe640 1 -- 172.21.15.49:0/4145923501 >> v1:172.21.15.49:6789/0 conn(0x7f83880e3270 legacy=0x7f8388053c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.387+0000 7f838f7fe640 1 -- 172.21.15.49:0/4145923501 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388058790 con 0x7f8388054320 2023-12-19T05:39:17.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.389+0000 7f838f7fe640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8388054320 0x7f8388057db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f837c009870 tx=0x7f837c02ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f91bf38d4fc2592 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.390+0000 7f838effd640 1 -- 172.21.15.49:0/4145923501 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c02f870 con 0x7f8388054320 2023-12-19T05:39:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.390+0000 7f838effd640 1 -- 172.21.15.49:0/4145923501 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c02f9d0 con 0x7f8388054320 2023-12-19T05:39:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.390+0000 7f838effd640 1 -- 172.21.15.49:0/4145923501 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c02f870 con 0x7f8388054320 2023-12-19T05:39:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.391+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8388054320 msgr2=0x7f8388057db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.391+0000 7f839520e640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8388054320 0x7f8388057db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f837c009870 tx=0x7f837c02ba50 comp rx=0 tx=0).stop 2023-12-19T05:39:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.392+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 shutdown_connections 2023-12-19T05:39:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.392+0000 7f839520e640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f8388006940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.392+0000 7f839520e640 1 --2- 172.21.15.49:0/4145923501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8388054320 0x7f8388057db0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.393+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 >> 172.21.15.49:0/4145923501 conn(0x7f838803aa70 msgr2=0x7f838803ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.393+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 shutdown_connections 2023-12-19T05:39:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.393+0000 7f839520e640 1 -- 172.21.15.49:0/4145923501 wait complete. 2023-12-19T05:39:17.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.397+0000 7f839520e640 1 Processor -- start 2023-12-19T05:39:17.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.397+0000 7f839520e640 1 -- start start 2023-12-19T05:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.399+0000 7f839520e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.400+0000 7f839520e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.400+0000 7f838ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.400+0000 7f838ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41520/0 (socket says 172.21.15.49:41520) 2023-12-19T05:39:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.401+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.401+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33874/0 (socket says 172.21.15.49:33874) 2023-12-19T05:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.401+0000 7f838ffff640 1 -- 172.21.15.49:0/3081607535 learned_addr learned my addr 172.21.15.49:0/3081607535 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.402+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 0x7f83880dc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.402+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880dd0e0 con 0x7f8388054320 2023-12-19T05:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.402+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880508d0 con 0x7f83880e3270 2023-12-19T05:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.402+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880dcb50 con 0x7f838803ea20 2023-12-19T05:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.402+0000 7f8394a0d640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 0x7f83880dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f838f7fe640 1 -- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 msgr2=0x7f838804eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f838f7fe640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f838f7fe640 1 -- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 msgr2=0x7f83880dc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f838f7fe640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 0x7f83880dc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f838f7fe640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0094d0 con 0x7f8388054320 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.404+0000 7f8394a0d640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 0x7f83880dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.405+0000 7f838f7fe640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f837c033000 tx=0x7f837c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.405+0000 7f838ffff640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.406+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c003810 con 0x7f8388054320 2023-12-19T05:39:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.406+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c003970 con 0x7f8388054320 2023-12-19T05:39:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.406+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880dce00 con 0x7f8388054320 2023-12-19T05:39:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.407+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c003d00 con 0x7f8388054320 2023-12-19T05:39:17.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.409+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8388050560 con 0x7f8388054320 2023-12-19T05:39:17.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.413+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f837c03f070 con 0x7f8388054320 2023-12-19T05:39:17.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.415+0000 7f838cff9640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 0x7f837406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.415+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f837c0aaa80 con 0x7f8388054320 2023-12-19T05:39:17.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.416+0000 7f838ffff640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 0x7f837406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.416+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8388005790 con 0x7f8388054320 2023-12-19T05:39:17.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.419+0000 7f838ffff640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 0x7f837406c9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8390066cb0 tx=0x7f8390073f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.427+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f837c076230 con 0x7f8388054320 2023-12-19T05:39:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.436+0000 7f48f2347640 1 Processor -- start 2023-12-19T05:39:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.437+0000 7f48f2347640 1 -- start start 2023-12-19T05:39:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.438+0000 7f48f2347640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48e40380e0 0x7f48e40eb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.438+0000 7f48f2347640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48e4038570 0x7f48e40eb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.438+0000 7f48f2347640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e4057020 con 0x7f48e40de3d0 2023-12-19T05:39:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.439+0000 7f48f2347640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e4058e90 con 0x7f48e40380e0 2023-12-19T05:39:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.439+0000 7f48f2347640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e4056cf0 con 0x7f48e4038570 2023-12-19T05:39:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.440+0000 7f4762749640 1 Processor -- start 2023-12-19T05:39:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.439+0000 7f48f08e4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48e4038570 0x7f48e40eb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.440+0000 7f48f08e4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48e4038570 0x7f48e40eb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56520/0 (socket says 172.21.15.49:56520) 2023-12-19T05:39:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.440+0000 7f48f08e4640 1 -- 172.21.15.49:0/804566327 learned_addr learned my addr 172.21.15.49:0/804566327 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.440+0000 7f4762749640 1 -- start start 2023-12-19T05:39:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.441+0000 7f48f08e4640 1 -- 172.21.15.49:0/804566327 >> v2:172.21.15.49:3300/0 conn(0x7f48e40380e0 msgr2=0x7f48e40eb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.441+0000 7f48eb7fe640 1 --2- 172.21.15.49:0/804566327 >> v2:172.21.15.49:3300/0 conn(0x7f48e40380e0 0x7f48e40eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.441+0000 7f48f08e4640 1 --2- 172.21.15.49:0/804566327 >> v2:172.21.15.49:3300/0 conn(0x7f48e40380e0 0x7f48e40eb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.441+0000 7f48f08e4640 1 -- 172.21.15.49:0/804566327 >> v1:172.21.15.49:6789/0 conn(0x7f48e40de3d0 legacy=0x7f48e4006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f4762749640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f4762749640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47540545f0 0x7f475404f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f4762749640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754053010 con 0x7f47540e77b0 2023-12-19T05:39:17.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.441+0000 7f48f08e4640 1 -- 172.21.15.49:0/804566327 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e40588d0 con 0x7f48e4038570 2023-12-19T05:39:17.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f48f08e4640 1 --2- 172.21.15.49:0/804566327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e4038570 0x7f48e40eb590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48ec069210 tx=0x7f48ec0a61f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cbc1469ecd2808b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f4762749640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47540e7b90 con 0x7f47540545f0 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.442+0000 7f4762749640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4754054a40 con 0x7f4754034410 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.443+0000 7f4761747640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f47540e77b0 0x7f4754048bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58770/0 (socket says 172.21.15.49:58770) 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.443+0000 7f4761747640 1 -- 172.21.15.49:0/2666973109 learned_addr learned my addr 172.21.15.49:0/2666973109 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.443+0000 7f4760f46640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4761f48640 1 --2- 172.21.15.49:0/2666973109 >> v2:172.21.15.115:3300/0 conn(0x7f47540545f0 0x7f475404f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4753fff640 1 -- 172.21.15.49:0/2666973109 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170888987 0 0) 0x7f4754053010 con 0x7f47540e77b0 2023-12-19T05:39:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4753fff640 1 -- 172.21.15.49:0/2666973109 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4748003520 con 0x7f47540e77b0 2023-12-19T05:39:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f48eaffd640 1 -- 172.21.15.49:0/804566327 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0a6e50 con 0x7f48e4038570 2023-12-19T05:39:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f48eaffd640 1 -- 172.21.15.49:0/804566327 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec0aa070 con 0x7f48e4038570 2023-12-19T05:39:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f48eaffd640 1 -- 172.21.15.49:0/804566327 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0b3320 con 0x7f48e4038570 2023-12-19T05:39:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4761f48640 1 -- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 msgr2=0x7f47540540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.445+0000 7f48f2347640 1 -- 172.21.15.49:0/804566327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e4038570 msgr2=0x7f48e40eb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f48f2347640 1 --2- 172.21.15.49:0/804566327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e4038570 0x7f48e40eb590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48ec069210 tx=0x7f48ec0a61f0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4761f48640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4761f48640 1 -- 172.21.15.49:0/2666973109 >> v1:172.21.15.115:6789/0 conn(0x7f47540e77b0 legacy=0x7f4754048bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.444+0000 7f4761f48640 1 -- 172.21.15.49:0/2666973109 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540532f0 con 0x7f47540545f0 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f48f2347640 1 -- 172.21.15.49:0/804566327 shutdown_connections 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f48f2347640 1 --2- 172.21.15.49:0/804566327 >> v2:172.21.15.49:3300/0 conn(0x7f48e40380e0 0x7f48e40eb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f48f2347640 1 --2- 172.21.15.49:0/804566327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e4038570 0x7f48e40eb590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f48f2347640 1 -- 172.21.15.49:0/804566327 >> 172.21.15.49:0/804566327 conn(0x7f48e4055a90 msgr2=0x7f48e4055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f4761f48640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540545f0 0x7f475404f620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f475c068a50 tx=0x7f475c08b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b2827f2c6315ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f9a2fd0a640 1 Processor -- start 2023-12-19T05:39:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f4753fff640 1 -- 172.21.15.49:0/2666973109 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0cee60 con 0x7f47540545f0 2023-12-19T05:39:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f4753fff640 1 -- 172.21.15.49:0/2666973109 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c08f070 con 0x7f47540545f0 2023-12-19T05:39:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f4753fff640 1 -- 172.21.15.49:0/2666973109 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c095880 con 0x7f47540545f0 2023-12-19T05:39:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.446+0000 7f9a2fd0a640 1 -- start start 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.447+0000 7f48f2347640 1 -- 172.21.15.49:0/804566327 shutdown_connections 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.447+0000 7f48f2347640 1 -- 172.21.15.49:0/804566327 wait complete. 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.447+0000 7f4762749640 1 -- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540545f0 msgr2=0x7f475404f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.447+0000 7f4762749640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540545f0 0x7f475404f620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f475c068a50 tx=0x7f475c08b3a0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 -- 172.21.15.49:0/2666973109 shutdown_connections 2023-12-19T05:39:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540545f0 0x7f475404f620 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 --2- 172.21.15.49:0/2666973109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 -- 172.21.15.49:0/2666973109 >> 172.21.15.49:0/2666973109 conn(0x7f475400a550 msgr2=0x7f475400a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 -- 172.21.15.49:0/2666973109 shutdown_connections 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.448+0000 7f4762749640 1 -- 172.21.15.49:0/2666973109 wait complete. 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.449+0000 7f9a2fd0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 0x7f9a28164460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.449+0000 7f9a2fd0a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a280b24f0 con 0x7f9a280cb530 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.449+0000 7f9a2fd0a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2815db80 con 0x7f9a28150550 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.449+0000 7f9a2fd0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280aef70 con 0x7f9a280b2060 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.450+0000 7f9a2d2a5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a280cb530 0x7f9a280b1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41230/0 (socket says 172.21.15.49:41230) 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.450+0000 7f9a2daa6640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9a28150550 0x7f9a280cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58782/0 (socket says 172.21.15.49:58782) 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.450+0000 7f9a2daa6640 1 -- 172.21.15.49:0/2031094352 learned_addr learned my addr 172.21.15.49:0/2031094352 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.450+0000 7f9a2e2a7640 1 --2- 172.21.15.49:0/2031094352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 0x7f9a28164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586349030 0 0) 0x7f9a280b24f0 con 0x7f9a280cb530 2023-12-19T05:39:17.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a14003520 con 0x7f9a280cb530 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610465333 0 0) 0x7f9a2815db80 con 0x7f9a28150550 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a140048a0 con 0x7f9a28150550 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2e2a7640 1 -- 172.21.15.49:0/2031094352 >> v1:172.21.15.115:6789/0 conn(0x7f9a28150550 legacy=0x7f9a280cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2e2a7640 1 -- 172.21.15.49:0/2031094352 >> v1:172.21.15.49:6789/0 conn(0x7f9a280cb530 legacy=0x7f9a280b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f9a2e2a7640 1 -- 172.21.15.49:0/2031094352 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2815e010 con 0x7f9a280b2060 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f4762749640 1 Processor -- start 2023-12-19T05:39:17.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.451+0000 7f4762749640 1 -- start start 2023-12-19T05:39:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.452+0000 7fb45d7b9640 1 Processor -- start 2023-12-19T05:39:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.452+0000 7fa766947640 1 Processor -- start 2023-12-19T05:39:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f48f2347640 1 Processor -- start 2023-12-19T05:39:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7fa766947640 1 -- start start 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 0x7f4754036680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475404a560 con 0x7f47540545f0 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475404a250 con 0x7f47540e77b0 2023-12-19T05:39:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f4762749640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47540cd9e0 con 0x7f4754034410 2023-12-19T05:39:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7f48f2347640 1 -- start start 2023-12-19T05:39:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.453+0000 7fb45d7b9640 1 -- start start 2023-12-19T05:39:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f9a2e2a7640 1 --2- 172.21.15.49:0/2031094352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 0x7f9a28164460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000d050 tx=0x7f9a200344b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c1b99155f78f27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4761747640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33904/0 (socket says 172.21.15.49:33904) 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 -- 172.21.15.49:0/3721503184 learned_addr learned my addr 172.21.15.49:0/3721503184 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4761f48640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 0x7f4754036680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 -- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 msgr2=0x7f47540cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 -- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 msgr2=0x7f4754036680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 0x7f4754036680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4760f46640 1 -- 172.21.15.49:0/3721503184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c06ed80 con 0x7f47540545f0 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.454+0000 7f4761f48640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 0x7f4754036680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7f4760f46640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f474c00e870 tx=0x7f474c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb456ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb4580d01b0 0x7fb4580d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41250/0 (socket says 172.21.15.49:41250) 2023-12-19T05:39:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb45d7b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 0x7fb4580cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb45d7b9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4580ce1e0 0x7fb45815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb45d7b9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580ce9d0 con 0x7fb4580d01b0 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa766947640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 0x7fa7600d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa766947640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7600cd840 con 0x7fa760146e10 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa766947640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7600b6e90 con 0x7fa7600ce110 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa766947640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7600d2430 con 0x7fa7600d2b00 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa75ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa760146e10 0x7fa7600b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41244/0 (socket says 172.21.15.49:41244) 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa75ffff640 1 -- 172.21.15.49:0/2598324228 learned_addr learned my addr 172.21.15.49:0/2598324228 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fa75f7fe640 1 --2- 172.21.15.49:0/2598324228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 0x7fa7600d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2003a480 con 0x7f9a280b2060 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20037030 con 0x7f9a280b2060 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f9a2caa4640 1 -- 172.21.15.49:0/2031094352 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2003a800 con 0x7f9a280b2060 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0094f0 con 0x7f47540545f0 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00c940 con 0x7f47540545f0 2023-12-19T05:39:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb45d7b9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580ce6f0 con 0x7fb4580ce1e0 2023-12-19T05:39:17.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ccf0 con 0x7f47540545f0 2023-12-19T05:39:17.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47540cdc80 con 0x7f47540545f0 2023-12-19T05:39:17.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fa75f7fe640 1 -- 172.21.15.49:0/2598324228 >> v1:172.21.15.115:6789/0 conn(0x7fa7600ce110 legacy=0x7fa7600b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.455+0000 7fb45d7b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815dcc0 con 0x7fb45815e7a0 2023-12-19T05:39:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fb456ffd640 1 -- 172.21.15.49:0/3061681387 learned_addr learned my addr 172.21.15.49:0/3061681387 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e4038570 0x7f48e40069f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fb4577fe640 1 --2- 172.21.15.49:0/3061681387 >> v2:172.21.15.115:3300/0 conn(0x7fb4580ce1e0 0x7fb45815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 0x7f48e4006f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e417d8b0 con 0x7f48e4038570 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e417cf10 con 0x7f48e40de3d0 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7f48f2347640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e417d1f0 con 0x7f48e40380e0 2023-12-19T05:39:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fb4567fc640 1 --2- 172.21.15.49:0/3061681387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 0x7fb4580cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f48eb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e4038570 0x7f48e40069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/2031094352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 msgr2=0x7f9a28164460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/2031094352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 0x7f9a28164460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000d050 tx=0x7f9a200344b0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f48ebfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fa75f7fe640 1 -- 172.21.15.49:0/2598324228 >> v1:172.21.15.49:6789/0 conn(0x7fa760146e10 legacy=0x7fa7600b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.456+0000 7fa75f7fe640 1 -- 172.21.15.49:0/2598324228 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7600d2620 con 0x7fa7600d2b00 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/2031094352 shutdown_connections 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/2031094352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280b2060 0x7f9a28164460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/2031094352 >> 172.21.15.49:0/2031094352 conn(0x7f9a280cbb70 msgr2=0x7f9a280cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7fcf2411b640 1 Processor -- start 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7fb4567fc640 1 -- 172.21.15.49:0/3061681387 >> v2:172.21.15.115:3300/0 conn(0x7fb4580ce1e0 msgr2=0x7fb45815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7fb4567fc640 1 --2- 172.21.15.49:0/3061681387 >> v2:172.21.15.115:3300/0 conn(0x7fb4580ce1e0 0x7fb45815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7fb4567fc640 1 -- 172.21.15.49:0/3061681387 >> v1:172.21.15.49:6789/0 conn(0x7fb4580d01b0 legacy=0x7fb4580d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f48ebfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41584/0 (socket says 172.21.15.49:41584) 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7f48ebfff640 1 -- 172.21.15.49:0/2066057203 learned_addr learned my addr 172.21.15.49:0/2066057203 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7f48f08e4640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 0x7f48e4006f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7fb4567fc640 1 -- 172.21.15.49:0/3061681387 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45815dfa0 con 0x7fb45815e7a0 2023-12-19T05:39:17.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47540ce240 con 0x7f47540545f0 2023-12-19T05:39:17.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/2031094352 shutdown_connections 2023-12-19T05:39:17.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.457+0000 7fb455ffb640 1 -- 172.21.15.49:0/3061681387 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915780282 0 0) 0x7fb4580ce9d0 con 0x7fb4580d01b0 2023-12-19T05:39:17.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7f48ebfff640 1 -- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 msgr2=0x7f48e4006f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7f48ebfff640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 0x7f48e4006f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.458+0000 7fcf2411b640 1 -- start start 2023-12-19T05:39:17.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f48ebfff640 1 -- 172.21.15.49:0/2066057203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e4038570 msgr2=0x7f48e40069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f48ebfff640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e4038570 0x7f48e40069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f48ebfff640 1 -- 172.21.15.49:0/2066057203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec06eaa0 con 0x7f48e40380e0 2023-12-19T05:39:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f48f08e4640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 0x7f48e4006f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/2031094352 wait complete. 2023-12-19T05:39:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.459+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47540ce430 con 0x7f47540545f0 2023-12-19T05:39:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7f48ebfff640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c410 tx=0x7f48d800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7fb4567fc640 1 --2- 172.21.15.49:0/3061681387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 0x7fb4580cdca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf59b8a1799a594 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7fa75f7fe640 1 --2- 172.21.15.49:0/2598324228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 0x7fa7600d1ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7540097d0 tx=0x7fa75402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46709835fa9d0c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80035f0 con 0x7f48e40380e0 2023-12-19T05:39:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7fb455ffb640 1 -- 172.21.15.49:0/3061681387 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c02d040 con 0x7fb45815e7a0 2023-12-19T05:39:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e417d4d0 con 0x7f48e40380e0 2023-12-19T05:39:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8003750 con 0x7f48e40380e0 2023-12-19T05:39:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e40df5d0 con 0x7f48e40380e0 2023-12-19T05:39:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003b40 con 0x7f48e40380e0 2023-12-19T05:39:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f474c013470 con 0x7f47540545f0 2023-12-19T05:39:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fa75effd640 1 -- 172.21.15.49:0/2598324228 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754030800 con 0x7fa7600d2b00 2023-12-19T05:39:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fa75effd640 1 -- 172.21.15.49:0/2598324228 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754030960 con 0x7fa7600d2b00 2023-12-19T05:39:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fa75effd640 1 -- 172.21.15.49:0/2598324228 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754030cf0 con 0x7fa7600d2b00 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf2411b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf1c0cb530 0x7fcf1c150550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf2411b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0b1950 0x7fcf1c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf2411b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c15db80 con 0x7fcf1c0cc690 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf2411b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0aef70 con 0x7fcf1c0cb530 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf2411b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c150a90 con 0x7fcf1c0b1950 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf216b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf1c0cb530 0x7fcf1c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf216b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf1c0cb530 0x7fcf1c150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56572/0 (socket says 172.21.15.49:56572) 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fcf216b6640 1 -- 172.21.15.49:0/301784896 learned_addr learned my addr 172.21.15.49:0/301784896 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fcf216b6640 1 -- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0b1950 msgr2=0x7fcf1c0b1d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fcf216b6640 1 --2- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0b1950 0x7fcf1c0b1d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fcf216b6640 1 -- 172.21.15.49:0/301784896 >> v1:172.21.15.49:6789/0 conn(0x7fcf1c0cc690 legacy=0x7fcf1c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fcf216b6640 1 -- 172.21.15.49:0/301784896 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c15e010 con 0x7fcf1c0cb530 2023-12-19T05:39:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.460+0000 7fb455ffb640 1 -- 172.21.15.49:0/3061681387 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c031810 con 0x7fb45815e7a0 2023-12-19T05:39:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fb45d7b9640 1 -- 172.21.15.49:0/3061681387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 msgr2=0x7fb4580cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.461+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/3061681387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 0x7fb4580cdca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7f9a2fd0a640 1 Processor -- start 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fa766947640 1 -- 172.21.15.49:0/2598324228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 msgr2=0x7fa7600d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.462+0000 7fa766947640 1 --2- 172.21.15.49:0/2598324228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 0x7fa7600d1ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7540097d0 tx=0x7fa75402b940 comp rx=0 tx=0).stop 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 -- 172.21.15.49:0/3061681387 shutdown_connections 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/3061681387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb45815e7a0 0x7fb4580cdca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/3061681387 >> v2:172.21.15.115:3300/0 conn(0x7fb4580ce1e0 0x7fb45815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 -- 172.21.15.49:0/3061681387 >> 172.21.15.49:0/3061681387 conn(0x7fb4580b27a0 msgr2=0x7fb4580b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fa766947640 1 -- 172.21.15.49:0/2598324228 shutdown_connections 2023-12-19T05:39:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fa766947640 1 --2- 172.21.15.49:0/2598324228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600d2b00 0x7fa7600d1ef0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fa766947640 1 -- 172.21.15.49:0/2598324228 >> 172.21.15.49:0/2598324228 conn(0x7fa7600b29c0 msgr2=0x7fa7600b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fa766947640 1 -- 172.21.15.49:0/2598324228 shutdown_connections 2023-12-19T05:39:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 -- 172.21.15.49:0/3061681387 shutdown_connections 2023-12-19T05:39:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fa766947640 1 -- 172.21.15.49:0/2598324228 wait complete. 2023-12-19T05:39:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.464+0000 7f4751ffb640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 0x7f474006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.464+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f474c057ba0 con 0x7f47540545f0 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.464+0000 7f9a2fd0a640 1 -- start start 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 0x7f9a281f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7fcf216b6640 1 --2- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c150550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009870 tx=0x7fcf1802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb01e732080533 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28150550 0x7f9a2815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2814e6e0 con 0x7f9a280b2060 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281f2bf0 con 0x7f9a28150550 2023-12-19T05:39:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f9a2fd0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2815c9d0 con 0x7f9a280cb530 2023-12-19T05:39:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fcf20eb5640 1 -- 172.21.15.49:0/301784896 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18031870 con 0x7fcf1c0cb530 2023-12-19T05:39:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fcf20eb5640 1 -- 172.21.15.49:0/301784896 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180319d0 con 0x7fcf1c0cb530 2023-12-19T05:39:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fcf20eb5640 1 -- 172.21.15.49:0/301784896 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18031d60 con 0x7fcf1c0cb530 2023-12-19T05:39:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.465+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48d8003ca0 con 0x7f48e40380e0 2023-12-19T05:39:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fa766947640 1 Processor -- start 2023-12-19T05:39:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7f9a2d2a5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7f9a2d2a5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41606/0 (socket says 172.21.15.49:41606) 2023-12-19T05:39:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7f9a2d2a5640 1 -- 172.21.15.49:0/3640884598 learned_addr learned my addr 172.21.15.49:0/3640884598 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e4005790 con 0x7f48e40380e0 2023-12-19T05:39:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.463+0000 7fb45d7b9640 1 -- 172.21.15.49:0/3061681387 wait complete. 2023-12-19T05:39:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.467+0000 7f9a2daa6640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 0x7f9a281f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fb45d7b9640 1 Processor -- start 2023-12-19T05:39:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.467+0000 7fcf2411b640 1 -- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 msgr2=0x7fcf1c150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.467+0000 7fcf2411b640 1 --2- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c150550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009870 tx=0x7fcf1802b910 comp rx=0 tx=0).stop 2023-12-19T05:39:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.467+0000 7fb45d7b9640 1 -- start start 2023-12-19T05:39:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.466+0000 7fa766947640 1 -- start start 2023-12-19T05:39:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f9a2d2a5640 1 -- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28150550 msgr2=0x7f9a2815c490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f9a2d2a5640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28150550 0x7f9a2815c490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f9a2d2a5640 1 -- 172.21.15.49:0/3640884598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 msgr2=0x7f9a281f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fcf2411b640 1 -- 172.21.15.49:0/301784896 shutdown_connections 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fcf2411b640 1 --2- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0b1950 0x7fcf1c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fcf2411b640 1 --2- 172.21.15.49:0/301784896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c150550 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fcf2411b640 1 -- 172.21.15.49:0/301784896 >> 172.21.15.49:0/301784896 conn(0x7fcf1c0cbb70 msgr2=0x7fcf1c0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7600d2b00 0x7fa760157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 0x7fa7601451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76013dd90 con 0x7fa760146e10 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76013e070 con 0x7fa7600d2b00 2023-12-19T05:39:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7fa766947640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76013e350 con 0x7fa7600ce110 2023-12-19T05:39:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f48e8ff9640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48d8087b40 con 0x7f48e40380e0 2023-12-19T05:39:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f4761747640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 0x7f474006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fa764ee4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 0x7fa7601451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f9a2d2a5640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 0x7f9a281f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7f48eb7fe640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fa75ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fa75ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41614/0 (socket says 172.21.15.49:41614) 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fa75ffff640 1 -- 172.21.15.49:0/2573297476 learned_addr learned my addr 172.21.15.49:0/2573297476 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fa75f7fe640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7600d2b00 0x7fa760157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fcf2411b640 1 -- 172.21.15.49:0/301784896 shutdown_connections 2023-12-19T05:39:17.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.468+0000 7f9a2d2a5640 1 -- 172.21.15.49:0/3640884598 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20008480 con 0x7f9a280cb530 2023-12-19T05:39:17.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7f9a2daa6640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 0x7f9a281f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:17.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fcf2411b640 1 -- 172.21.15.49:0/301784896 wait complete. 2023-12-19T05:39:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7f9a2d2a5640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c7f0 tx=0x7f9a2400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7fb45d7b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.469+0000 7f4761747640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 0x7f474006c940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47580011e0 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb45d7b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 0x7fb458151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7f7ec8f55640 1 Processor -- start 2023-12-19T05:39:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa75ffff640 1 -- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7600d2b00 msgr2=0x7fa760157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa75ffff640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7600d2b00 0x7fa760157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa75ffff640 1 -- 172.21.15.49:0/2573297476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 msgr2=0x7fa7601451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb456ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb45d7b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb45815e7a0 0x7fb458152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb456ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33936/0 (socket says 172.21.15.49:33936) 2023-12-19T05:39:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7f7ec8f55640 1 -- start start 2023-12-19T05:39:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa75ffff640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 0x7fa7601451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa75ffff640 1 -- 172.21.15.49:0/2573297476 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009400 con 0x7fa7600ce110 2023-12-19T05:39:17.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fa764ee4640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 0x7fa7601451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:17.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 0x7fb458151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.470+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 0x7fb458151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41626/0 (socket says 172.21.15.49:41626) 2023-12-19T05:39:17.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7f48eb7fe640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 0x7f48d006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fa75ffff640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa750015d60 tx=0x7fa750013560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fb456ffd640 1 -- 172.21.15.49:0/1702924608 learned_addr learned my addr 172.21.15.49:0/1702924608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458150780 con 0x7fb4580ce1e0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b6220 con 0x7fb45815e7a0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb458151b80 con 0x7fb4580d01b0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.471+0000 7fb4577fe640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb45815e7a0 0x7fb458152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 -- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 msgr2=0x7fb458151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 0x7fb458151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 -- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb45815e7a0 msgr2=0x7fb458152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb45815e7a0 0x7fb458152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009400 con 0x7fb4580ce1e0 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fb456ffd640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb44800c480 tx=0x7fb44800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec8f55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec40cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fcf2411b640 1 Processor -- start 2023-12-19T05:39:17.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec8f55640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40ce9d0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec8f55640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40ce6f0 con 0x7f7ec40ce1e0 2023-12-19T05:39:17.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec8f55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec415dcc0 con 0x7f7ec415e7a0 2023-12-19T05:39:17.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7fcf2411b640 1 -- start start 2023-12-19T05:39:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec259c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ec40d01b0 0x7f7ec40d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41268/0 (socket says 172.21.15.49:41268) 2023-12-19T05:39:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.472+0000 7f7ec259c640 1 -- 172.21.15.49:0/1202434626 learned_addr learned my addr 172.21.15.49:0/1202434626 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7f7eb9d9b640 1 --2- 172.21.15.49:0/1202434626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec40cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480074e0 con 0x7fb4580ce1e0 2023-12-19T05:39:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955099404 0 0) 0x7f7ec40ce9d0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb0003520 con 0x7f7ec40d01b0 2023-12-19T05:39:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340133707 0 0) 0x7f7ec40ce6f0 con 0x7f7ec40ce1e0 2023-12-19T05:39:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec40ce9d0 con 0x7f7ec40ce1e0 2023-12-19T05:39:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1202434626 >> v1:172.21.15.115:6789/0 conn(0x7f7ec40ce1e0 legacy=0x7f7ec415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458151e60 con 0x7fb4580ce1e0 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448007640 con 0x7fb4580ce1e0 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.473+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448004a20 con 0x7fb4580ce1e0 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458152420 con 0x7fb4580ce1e0 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1202434626 >> v1:172.21.15.49:6789/0 conn(0x7f7ec40d01b0 legacy=0x7f7ec40d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1202434626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec415dfa0 con 0x7f7ec415e7a0 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0cc690 0x7fcf1c1415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c13e8e0 con 0x7fcf1c0b1950 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c153c10 con 0x7fcf1c0cb530 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7fcf2411b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c151950 con 0x7fcf1c0cc690 2023-12-19T05:39:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.474+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47540ce430 con 0x7f47540545f0 2023-12-19T05:39:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33952/0 (socket says 172.21.15.49:33952) 2023-12-19T05:39:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 -- 172.21.15.49:0/1712936002 learned_addr learned my addr 172.21.15.49:0/1712936002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf216b6640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580b6390 con 0x7fb4580ce1e0 2023-12-19T05:39:17.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf226b8640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0cc690 0x7fcf1c1415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7f7eb9d9b640 1 --2- 172.21.15.49:0/1202434626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec40cdca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097d0 tx=0x7f7eac02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381736b897b6f7aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 -- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0cc690 msgr2=0x7fcf1c1415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0cc690 0x7fcf1c1415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 -- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 msgr2=0x7fcf1c152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.475+0000 7fcf21eb7640 1 -- 172.21.15.49:0/1712936002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180094d0 con 0x7fcf1c0b1950 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.476+0000 7fcf21eb7640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000b3e0 tx=0x7fcf1000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.478+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb448004b80 con 0x7fb4580ce1e0 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.479+0000 7fb43f7fe640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 0x7fb44406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.479+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb448087ce0 con 0x7fb4580ce1e0 2023-12-19T05:39:17.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.480+0000 7fb4567fc640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 0x7fb44406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.481+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011830 con 0x7fcf1c0b1950 2023-12-19T05:39:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.481+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf100119b0 con 0x7fcf1c0b1950 2023-12-19T05:39:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.481+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011d60 con 0x7fcf1c0b1950 2023-12-19T05:39:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.482+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb4480534b0 con 0x7fb4580ce1e0 2023-12-19T05:39:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.482+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c151c30 con 0x7fcf1c0b1950 2023-12-19T05:39:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.482+0000 7fb4567fc640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 0x7fb44406c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036000 tx=0x7fb44c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.482+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c1521f0 con 0x7fcf1c0b1950 2023-12-19T05:39:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.483+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c061910 con 0x7fcf1c0b1950 2023-12-19T05:39:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.484+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf1001a400 con 0x7fcf1c0b1950 2023-12-19T05:39:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.484+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400a640 con 0x7f9a280cb530 2023-12-19T05:39:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a281f2350 con 0x7f9a280cb530 2023-12-19T05:39:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a281f2910 con 0x7f9a280cb530 2023-12-19T05:39:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750019630 con 0x7fa7600ce110 2023-12-19T05:39:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76013e630 con 0x7fa7600ce110 2023-12-19T05:39:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac030800 con 0x7f7ec415e7a0 2023-12-19T05:39:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac030960 con 0x7f7ec415e7a0 2023-12-19T05:39:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f7ec1d9b640 1 -- 172.21.15.49:0/1202434626 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac030cf0 con 0x7f7ec415e7a0 2023-12-19T05:39:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760158630 con 0x7fa7600ce110 2023-12-19T05:39:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400a7a0 con 0x7f9a280cb530 2023-12-19T05:39:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.485+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400ab50 con 0x7f9a280cb530 2023-12-19T05:39:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1202434626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 msgr2=0x7f7ec40cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1202434626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec40cdca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097d0 tx=0x7f7eac02b940 comp rx=0 tx=0).stop 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7fcf0e7fc640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 0x7fcf0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf10088a70 con 0x7fcf1c0b1950 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750019790 con 0x7fa7600ce110 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.486+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750019b60 con 0x7fa7600ce110 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.487+0000 7fcf216b6640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 0x7fcf0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.487+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f48d80531f0 con 0x7f48e40380e0 2023-12-19T05:39:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.488+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10005250 con 0x7f9a280cb530 2023-12-19T05:39:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.488+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa740005250 con 0x7fa7600ce110 2023-12-19T05:39:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.488+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1202434626 shutdown_connections 2023-12-19T05:39:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.488+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1202434626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec40cdca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.488+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1202434626 >> 172.21.15.49:0/1202434626 conn(0x7f7ec40b27a0 msgr2=0x7f7ec40b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.489+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1202434626 shutdown_connections 2023-12-19T05:39:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.489+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a2400acb0 con 0x7f9a280cb530 2023-12-19T05:39:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.489+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1202434626 wait complete. 2023-12-19T05:39:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.490+0000 7fcf216b6640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 0x7fcf0006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.491+0000 7f9a1e7fc640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 0x7f9a0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.491+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa750017040 con 0x7fa7600ce110 2023-12-19T05:39:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.491+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a24057220 con 0x7f9a280cb530 2023-12-19T05:39:17.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.492+0000 7f9a2daa6640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 0x7f9a0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7f7ec8f55640 1 Processor -- start 2023-12-19T05:39:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7f9a2daa6640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 0x7f9a0c06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7f7ec8f55640 1 -- start start 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7fa75cff9640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 0x7fa74c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa750014040 con 0x7fa7600ce110 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.493+0000 7fa75f7fe640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 0x7fa74c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec40ce1e0 0x7f7ec40b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec4147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40b66a0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4159950 con 0x7f7ec40ce1e0 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7ec8f55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec415a1b0 con 0x7f7ec415e7a0 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7eb9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7fa75f7fe640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 0x7fa74c06c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa754008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7eb9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33968/0 (socket says 172.21.15.49:33968) 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1472176788 learned_addr learned my addr 172.21.15.49:0/1472176788 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.495+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf10054050 con 0x7fcf1c0b1950 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7ec259c640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec40ce1e0 0x7f7ec40b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7ec2d9d640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec4147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 msgr2=0x7f7ec4147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7eb9d9b640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec4147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec40ce1e0 msgr2=0x7f7ec40b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7eb9d9b640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec40ce1e0 0x7f7ec40b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7eb9d9b640 1 -- 172.21.15.49:0/1472176788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac009400 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.496+0000 7f7ec2d9d640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec4147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.497+0000 7f7eb9d9b640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0098f0 tx=0x7f7eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.497+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac03e070 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.497+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac039990 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.497+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac039d40 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.497+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec4159bf0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.498+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec40b62c0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.500+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8005250 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.501+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7eac04b400 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.503+0000 7f7ebb7fe640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 0x7f7ea406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.503+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7eac0aabe0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.504+0000 7f7ec259c640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 0x7f7ea406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.504+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9a2408d060 con 0x7f9a280cb530 2023-12-19T05:39:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.509+0000 7f7ec259c640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 0x7f7ea406c940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40012e0 tx=0x7f7eb4001ad0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.512+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7eac0762b0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.519+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa75005c620 con 0x7fa7600ce110 2023-12-19T05:39:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.835+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f838803d9e0 con 0x7f8388054320 2023-12-19T05:39:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.835+0000 7f838cff9640 1 -- 172.21.15.49:0/3081607535 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f837c046030 con 0x7f8388054320 2023-12-19T05:39:17.838 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2023-12-19T05:39:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.839+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 msgr2=0x7f837406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.839+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 0x7f837406c9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8390066cb0 tx=0x7f8390073f50 comp rx=0 tx=0).stop 2023-12-19T05:39:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.839+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 msgr2=0x7f83880dc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.840+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f837c033000 tx=0x7f837c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.840+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 shutdown_connections 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.840+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f837406a530 0x7f837406c9f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.841+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83880e3270 0x7f83880dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.841+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8388054320 0x7f83880dc0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.841+0000 7f839520e640 1 --2- 172.21.15.49:0/3081607535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838803ea20 0x7f838804eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.841+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 >> 172.21.15.49:0/3081607535 conn(0x7f838803aa70 msgr2=0x7f83880538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.842+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 shutdown_connections 2023-12-19T05:39:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.842+0000 7f839520e640 1 -- 172.21.15.49:0/3081607535 wait complete. 2023-12-19T05:39:17.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-12-19T05:39:17.870 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.887+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48e417d660 con 0x7f48e40380e0 2023-12-19T05:39:17.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.888+0000 7f48e8ff9640 1 -- 172.21.15.49:0/2066057203 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48d8017090 con 0x7f48e40380e0 2023-12-19T05:39:17.889 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.890+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 msgr2=0x7f48d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.890+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 0x7f48d006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 msgr2=0x7f48e40df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c410 tx=0x7f48d800c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 shutdown_connections 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48e40de3d0 0x7f48e4006f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e4038570 0x7f48e40069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 --2- 172.21.15.49:0/2066057203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48e40380e0 0x7f48e40df090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 >> 172.21.15.49:0/2066057203 conn(0x7f48e4055a90 msgr2=0x7f48e4038950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 shutdown_connections 2023-12-19T05:39:17.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.891+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f475404a6a0 con 0x7f47540545f0 2023-12-19T05:39:17.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.892+0000 7f48f2347640 1 -- 172.21.15.49:0/2066057203 wait complete. 2023-12-19T05:39:17.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.892+0000 7f4751ffb640 1 -- 172.21.15.49:0/3721503184 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f475404a6a0 con 0x7f47540545f0 2023-12-19T05:39:17.894 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.895+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 msgr2=0x7f474006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.895+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 0x7f474006c940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47580011e0 tx=0x7f4758009040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.895+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 msgr2=0x7f4754036140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.895+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f474c00e870 tx=0x7f474c00ed30 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 shutdown_connections 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f474006a480 0x7f474006c940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47540e77b0 0x7f4754036680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47540545f0 0x7f4754036140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 --2- 172.21.15.49:0/3721503184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4754034410 0x7f47540cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 >> 172.21.15.49:0/3721503184 conn(0x7f475400a550 msgr2=0x7f47540e9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 shutdown_connections 2023-12-19T05:39:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.896+0000 7f4762749640 1 -- 172.21.15.49:0/3721503184 wait complete. 2023-12-19T05:39:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.897+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb4580b6390 con 0x7fb4580ce1e0 2023-12-19T05:39:17.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.898+0000 7fb43f7fe640 1 -- 172.21.15.49:0/1702924608 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4580b6390 con 0x7fb4580ce1e0 2023-12-19T05:39:17.899 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.901+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 msgr2=0x7fb44406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.901+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 0x7fb44406c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036000 tx=0x7fb44c03c040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.901+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 msgr2=0x7fb458150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.901+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb44800c480 tx=0x7fb44800c940 comp rx=0 tx=0).stop 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 shutdown_connections 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb44406a430 0x7fb44406c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4580d01b0 0x7fb458151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb45815e7a0 0x7fb458152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 --2- 172.21.15.49:0/1702924608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4580ce1e0 0x7fb458150240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 >> 172.21.15.49:0/1702924608 conn(0x7fb4580b27a0 msgr2=0x7fb45815f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.902+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 shutdown_connections 2023-12-19T05:39:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.903+0000 7fb45d7b9640 1 -- 172.21.15.49:0/1702924608 wait complete. 2023-12-19T05:39:17.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.916+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcf1c0b1220 con 0x7fcf1c0b1950 2023-12-19T05:39:17.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.917+0000 7fcf0e7fc640 1 -- 172.21.15.49:0/1712936002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf10015020 con 0x7fcf1c0b1950 2023-12-19T05:39:17.918 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-19T05:39:17.920 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 msgr2=0x7fcf0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 0x7fcf0006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 msgr2=0x7fcf1c13e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000b3e0 tx=0x7fcf1000b8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 shutdown_connections 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf0006a430 0x7fcf0006c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf1c0cc690 0x7fcf1c1415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0cb530 0x7fcf1c152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 --2- 172.21.15.49:0/1712936002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf1c0b1950 0x7fcf1c13e3a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.920+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 >> 172.21.15.49:0/1712936002 conn(0x7fcf1c0cbb70 msgr2=0x7fcf1c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.921+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 shutdown_connections 2023-12-19T05:39:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.921+0000 7fcf2411b640 1 -- 172.21.15.49:0/1712936002 wait complete. 2023-12-19T05:39:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.921+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa740005500 con 0x7fa7600ce110 2023-12-19T05:39:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.922+0000 7fa75cff9640 1 -- 172.21.15.49:0/2573297476 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa75001d020 con 0x7fa7600ce110 2023-12-19T05:39:17.923 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-12-19T05:39:17.924 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 msgr2=0x7fa74c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 0x7fa74c06c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa754008030 comp rx=0 tx=0).stop 2023-12-19T05:39:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 msgr2=0x7fa760140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa750015d60 tx=0x7fa750013560 comp rx=0 tx=0).stop 2023-12-19T05:39:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 shutdown_connections 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74c06a430 0x7fa74c06c8f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa760146e10 0x7fa7601451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7600d2b00 0x7fa760157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 --2- 172.21.15.49:0/2573297476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7600ce110 0x7fa760140e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 >> 172.21.15.49:0/2573297476 conn(0x7fa7600b29c0 msgr2=0x7fa76015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 shutdown_connections 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.925+0000 7fa766947640 1 -- 172.21.15.49:0/2573297476 wait complete. 2023-12-19T05:39:17.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-19T05:39:17.928 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-19T05:39:17.939 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-19T05:39:17.942 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.942+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a100057d0 con 0x7f9a280cb530 2023-12-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.943+0000 7f9a1e7fc640 1 -- 172.21.15.49:0/3640884598 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a2408d090 con 0x7f9a280cb530 2023-12-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 msgr2=0x7f9a0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 0x7f9a0c06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18007d60 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 msgr2=0x7f9a2814e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c7f0 tx=0x7f9a2400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 shutdown_connections 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0c06a430 0x7f9a0c06c8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a280cb530 0x7f9a2814e1a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28150550 0x7f9a2815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 --2- 172.21.15.49:0/3640884598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280b2060 0x7f9a281f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 >> 172.21.15.49:0/3640884598 conn(0x7f9a280cbb70 msgr2=0x7f9a280adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 shutdown_connections 2023-12-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.945+0000 7f9a2fd0a640 1 -- 172.21.15.49:0/3640884598 wait complete. 2023-12-19T05:39:17.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.946+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7ea80057d0 con 0x7f7ec40d01b0 2023-12-19T05:39:17.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.946+0000 7f7ebb7fe640 1 -- 172.21.15.49:0/1472176788 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7eac034090 con 0x7f7ec40d01b0 2023-12-19T05:39:17.948 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 msgr2=0x7f7ea406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 0x7f7ea406c940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40012e0 tx=0x7f7eb4001ad0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 msgr2=0x7f7ec4159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0098f0 tx=0x7f7eac0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 shutdown_connections 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea406a480 0x7f7ea406c940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ec415e7a0 0x7f7ec4147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ec40d01b0 0x7f7ec4159410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 --2- 172.21.15.49:0/1472176788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec40ce1e0 0x7f7ec40b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 >> 172.21.15.49:0/1472176788 conn(0x7f7ec40b27a0 msgr2=0x7f7ec415f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.948+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 shutdown_connections 2023-12-19T05:39:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:17.949+0000 7f7ec8f55640 1 -- 172.21.15.49:0/1472176788 wait complete. 2023-12-19T05:39:17.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-19T05:39:17.964 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-19T05:39:17.966 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:17.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T05:39:17.966 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.237+0000 7f9308c5b640 1 Processor -- start 2023-12-19T05:39:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.237+0000 7f9308c5b640 1 -- start start 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9308c5b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f930415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9308c5b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930415ec30 con 0x7f93040cdbf0 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9308c5b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930415fbc0 con 0x7f930415e5a0 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9308c5b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930415e980 con 0x7f93040b2030 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9303fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f93040cdbf0 0x7f930406c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41284/0 (socket says 172.21.15.49:41284) 2023-12-19T05:39:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f9303fff640 1 -- 172.21.15.49:0/2566499353 learned_addr learned my addr 172.21.15.49:0/2566499353 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:18.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.239+0000 7f92fbfff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f930415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333835752 0 0) 0x7f930415ec30 con 0x7f93040cdbf0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f0003520 con 0x7f93040cdbf0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311036797 0 0) 0x7f92f0003520 con 0x7f93040cdbf0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 msgr2=0x7f930415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f930415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 >> v1:172.21.15.115:6789/0 conn(0x7f930415e5a0 legacy=0x7f93040b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040b2f90 con 0x7f93040cdbf0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f92fc0019f0 con 0x7f93040cdbf0 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 >> v1:172.21.15.49:6789/0 conn(0x7f93040cdbf0 legacy=0x7f930406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f92f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f0003f70 0x7f92f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f92f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930415e980 con 0x7f92f0004d00 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000bac0 con 0x7f92f0003f70 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.240+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000bc80 con 0x7f93040b2030 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f92f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f93037fe640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f92f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f92fbfff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f0003f70 0x7f92f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 -- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 msgr2=0x7f92f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93040b2030 0x7f92f00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 -- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f0003f70 msgr2=0x7f92f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f0003f70 0x7f92f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.241+0000 7f9303fff640 1 -- 172.21.15.49:0/2566499353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0003520 con 0x7f92f0004d00 2023-12-19T05:39:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.242+0000 7f9303fff640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f92f0005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00a760 tx=0x7f92f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3202a5a44f87c5a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.242+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc034630 con 0x7f92f0004d00 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.242+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc02f070 con 0x7f92f0004d00 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.242+0000 7f9302ffd640 1 -- 172.21.15.49:0/2566499353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0349f0 con 0x7f92f0004d00 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 -- 172.21.15.49:0/2566499353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 msgr2=0x7f92f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 --2- 172.21.15.49:0/2566499353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f92f0005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00a760 tx=0x7f92f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9303fff640 1 -- 172.21.15.49:0/2566499353 reap_dead start 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 -- 172.21.15.49:0/2566499353 shutdown_connections 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 -- 172.21.15.49:0/2566499353 >> 172.21.15.49:0/2566499353 conn(0x7f93040b0100 msgr2=0x7f93040b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 -- 172.21.15.49:0/2566499353 shutdown_connections 2023-12-19T05:39:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.243+0000 7f9308c5b640 1 -- 172.21.15.49:0/2566499353 wait complete. 2023-12-19T05:39:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.245+0000 7f9308c5b640 1 Processor -- start 2023-12-19T05:39:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.245+0000 7f9308c5b640 1 -- start start 2023-12-19T05:39:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 0x7f930406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 0x7f93041f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304154360 con 0x7f92f0004d00 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930406d570 con 0x7f93041f6970 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f9308c5b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930406d850 con 0x7f930406f9a0 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f93037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f93037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33990/0 (socket says 172.21.15.49:33990) 2023-12-19T05:39:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.246+0000 7f93037fe640 1 -- 172.21.15.49:0/435573003 learned_addr learned my addr 172.21.15.49:0/435573003 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9303fff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 0x7f93041f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f92fbfff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 0x7f930406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 -- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 msgr2=0x7f930406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 0x7f930406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 -- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 msgr2=0x7f93041f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 0x7f93041f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 -- 172.21.15.49:0/435573003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930415ab40 con 0x7f92f0004d00 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f92fbfff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 0x7f930406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9303fff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 0x7f93041f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f93037fe640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92f400e550 tx=0x7f92f400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40052e0 con 0x7f92f0004d00 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4005440 con 0x7f92f0004d00 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4003810 con 0x7f92f0004d00 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.247+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930415ae20 con 0x7f92f0004d00 2023-12-19T05:39:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.248+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930406d260 con 0x7f92f0004d00 2023-12-19T05:39:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.248+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9304061910 con 0x7f92f0004d00 2023-12-19T05:39:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.249+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92f4003970 con 0x7f92f0004d00 2023-12-19T05:39:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.250+0000 7f9300ff9640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 0x7f92e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.250+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92f40886e0 con 0x7f92f0004d00 2023-12-19T05:39:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.251+0000 7f92fbfff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 0x7f92e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.252+0000 7f92fbfff640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 0x7f92e406c920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93040b2c10 tx=0x7f92ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.254+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92f4053c30 con 0x7f92f0004d00 2023-12-19T05:39:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.438+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f930415ee80 con 0x7f92e406a460 2023-12-19T05:39:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.458+0000 7f9300ff9640 1 -- 172.21.15.49:0/435573003 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260005 (secure 0 0 0) 0x7f92ec012950 con 0x7f92e406a460 2023-12-19T05:39:18.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 msgr2=0x7f92e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 0x7f92e406c920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93040b2c10 tx=0x7f92ec008040 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 msgr2=0x7f9304153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92f400e550 tx=0x7f92f400ea10 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 shutdown_connections 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f92e406a460 0x7f92e406c920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f930406f9a0 0x7f930406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93041f6970 0x7f93041f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 --2- 172.21.15.49:0/435573003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0004d00 0x7f9304153e20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.463+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 >> 172.21.15.49:0/435573003 conn(0x7f93040b0100 msgr2=0x7f93040ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.464+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 shutdown_connections 2023-12-19T05:39:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.464+0000 7f9308c5b640 1 -- 172.21.15.49:0/435573003 wait complete. 2023-12-19T05:39:18.484 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-19T05:39:16.503619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004438"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717330+0000","last_change":"2023-12-19T05:39:02.717216+0000","last_active":"2023-12-19T05:39:02.717330+0000","last_peered":"2023-12-19T05:39:02.717330+0000","last_clean":"2023-12-19T05:39:02.717330+0000","last_became_active":"2023-12-19T05:39:02.716805+0000","last_became_peered":"2023-12-19T05:39:02.716805+0000","last_unstale":"2023-12-19T05:39:02.717330+0000","last_undegraded":"2023-12-19T05:39:02.717330+0000","last_fullsized":"2023-12-19T05:39:02.717330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723207+0000","last_change":"2023-12-19T05:39:02.720735+0000","last_active":"2023-12-19T05:39:02.723207+0000","last_peered":"2023-12-19T05:39:02.723207+0000","last_clean":"2023-12-19T05:39:02.723207+0000","last_became_active":"2023-12-19T05:39:02.720479+0000","last_became_peered":"2023-12-19T05:39:02.720479+0000","last_unstale":"2023-12-19T05:39:02.723207+0000","last_undegraded":"2023-12-19T05:39:02.723207+0000","last_fullsized":"2023-12-19T05:39:02.723207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718511+0000","last_change":"2023-12-19T05:39:02.715183+0000","last_active":"2023-12-19T05:39:02.718511+0000","last_peered":"2023-12-19T05:39:02.718511+0000","last_clean":"2023-12-19T05:39:02.718511+0000","last_became_active":"2023-12-19T05:39:02.714240+0000","last_became_peered":"2023-12-19T05:39:02.714240+0000","last_unstale":"2023-12-19T05:39:02.718511+0000","last_undegraded":"2023-12-19T05:39:02.718511+0000","last_fullsized":"2023-12-19T05:39:02.718511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711817+0000","last_change":"2023-12-19T05:39:02.710230+0000","last_active":"2023-12-19T05:39:02.711817+0000","last_peered":"2023-12-19T05:39:02.711817+0000","last_clean":"2023-12-19T05:39:02.711817+0000","last_became_active":"2023-12-19T05:39:02.710001+0000","last_became_peered":"2023-12-19T05:39:02.710001+0000","last_unstale":"2023-12-19T05:39:02.711817+0000","last_undegraded":"2023-12-19T05:39:02.711817+0000","last_fullsized":"2023-12-19T05:39:02.711817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718958+0000","last_change":"2023-12-19T05:39:02.718728+0000","last_active":"2023-12-19T05:39:02.718958+0000","last_peered":"2023-12-19T05:39:02.718958+0000","last_clean":"2023-12-19T05:39:02.718958+0000","last_became_active":"2023-12-19T05:39:02.718457+0000","last_became_peered":"2023-12-19T05:39:02.718457+0000","last_unstale":"2023-12-19T05:39:02.718958+0000","last_undegraded":"2023-12-19T05:39:02.718958+0000","last_fullsized":"2023-12-19T05:39:02.718958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711835+0000","last_change":"2023-12-19T05:39:02.710247+0000","last_active":"2023-12-19T05:39:02.711835+0000","last_peered":"2023-12-19T05:39:02.711835+0000","last_clean":"2023-12-19T05:39:02.711835+0000","last_became_active":"2023-12-19T05:39:02.710039+0000","last_became_peered":"2023-12-19T05:39:02.710039+0000","last_unstale":"2023-12-19T05:39:02.711835+0000","last_undegraded":"2023-12-19T05:39:02.711835+0000","last_fullsized":"2023-12-19T05:39:02.711835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716214+0000","last_change":"2023-12-19T05:39:02.716135+0000","last_active":"2023-12-19T05:39:02.716214+0000","last_peered":"2023-12-19T05:39:02.716214+0000","last_clean":"2023-12-19T05:39:02.716214+0000","last_became_active":"2023-12-19T05:39:02.715148+0000","last_became_peered":"2023-12-19T05:39:02.715148+0000","last_unstale":"2023-12-19T05:39:02.716214+0000","last_undegraded":"2023-12-19T05:39:02.716214+0000","last_fullsized":"2023-12-19T05:39:02.716214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723196+0000","last_change":"2023-12-19T05:39:02.720176+0000","last_active":"2023-12-19T05:39:02.723196+0000","last_peered":"2023-12-19T05:39:02.723196+0000","last_clean":"2023-12-19T05:39:02.723196+0000","last_became_active":"2023-12-19T05:39:02.719954+0000","last_became_peered":"2023-12-19T05:39:02.719954+0000","last_unstale":"2023-12-19T05:39:02.723196+0000","last_undegraded":"2023-12-19T05:39:02.723196+0000","last_fullsized":"2023-12-19T05:39:02.723196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700335+0000","last_change":"2023-12-19T05:39:02.700252+0000","last_active":"2023-12-19T05:39:02.700335+0000","last_peered":"2023-12-19T05:39:02.700335+0000","last_clean":"2023-12-19T05:39:02.700335+0000","last_became_active":"2023-12-19T05:39:02.699871+0000","last_became_peered":"2023-12-19T05:39:02.699871+0000","last_unstale":"2023-12-19T05:39:02.700335+0000","last_undegraded":"2023-12-19T05:39:02.700335+0000","last_fullsized":"2023-12-19T05:39:02.700335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709263+0000","last_change":"2023-12-19T05:39:02.708261+0000","last_active":"2023-12-19T05:39:02.709263+0000","last_peered":"2023-12-19T05:39:02.709263+0000","last_clean":"2023-12-19T05:39:02.709263+0000","last_became_active":"2023-12-19T05:39:02.707762+0000","last_became_peered":"2023-12-19T05:39:02.707762+0000","last_unstale":"2023-12-19T05:39:02.709263+0000","last_undegraded":"2023-12-19T05:39:02.709263+0000","last_fullsized":"2023-12-19T05:39:02.709263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717313+0000","last_change":"2023-12-19T05:39:02.717049+0000","last_active":"2023-12-19T05:39:02.717313+0000","last_peered":"2023-12-19T05:39:02.717313+0000","last_clean":"2023-12-19T05:39:02.717313+0000","last_became_active":"2023-12-19T05:39:02.716371+0000","last_became_peered":"2023-12-19T05:39:02.716371+0000","last_unstale":"2023-12-19T05:39:02.717313+0000","last_undegraded":"2023-12-19T05:39:02.717313+0000","last_fullsized":"2023-12-19T05:39:02.717313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707329+0000","last_change":"2023-12-19T05:39:02.707024+0000","last_active":"2023-12-19T05:39:02.707329+0000","last_peered":"2023-12-19T05:39:02.707329+0000","last_clean":"2023-12-19T05:39:02.707329+0000","last_became_active":"2023-12-19T05:39:02.706779+0000","last_became_peered":"2023-12-19T05:39:02.706779+0000","last_unstale":"2023-12-19T05:39:02.707329+0000","last_undegraded":"2023-12-19T05:39:02.707329+0000","last_fullsized":"2023-12-19T05:39:02.707329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719791+0000","last_change":"2023-12-19T05:39:02.718594+0000","last_active":"2023-12-19T05:39:02.719791+0000","last_peered":"2023-12-19T05:39:02.719791+0000","last_clean":"2023-12-19T05:39:02.719791+0000","last_became_active":"2023-12-19T05:39:02.717977+0000","last_became_peered":"2023-12-19T05:39:02.717977+0000","last_unstale":"2023-12-19T05:39:02.719791+0000","last_undegraded":"2023-12-19T05:39:02.719791+0000","last_fullsized":"2023-12-19T05:39:02.719791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719739+0000","last_change":"2023-12-19T05:39:02.718246+0000","last_active":"2023-12-19T05:39:02.719739+0000","last_peered":"2023-12-19T05:39:02.719739+0000","last_clean":"2023-12-19T05:39:02.719739+0000","last_became_active":"2023-12-19T05:39:02.716071+0000","last_became_peered":"2023-12-19T05:39:02.716071+0000","last_unstale":"2023-12-19T05:39:02.719739+0000","last_undegraded":"2023-12-19T05:39:02.719739+0000","last_fullsized":"2023-12-19T05:39:02.719739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718462+0000","last_change":"2023-12-19T05:39:02.714245+0000","last_active":"2023-12-19T05:39:02.718462+0000","last_peered":"2023-12-19T05:39:02.718462+0000","last_clean":"2023-12-19T05:39:02.718462+0000","last_became_active":"2023-12-19T05:39:02.713242+0000","last_became_peered":"2023-12-19T05:39:02.713242+0000","last_unstale":"2023-12-19T05:39:02.718462+0000","last_undegraded":"2023-12-19T05:39:02.718462+0000","last_fullsized":"2023-12-19T05:39:02.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709046+0000","last_change":"2023-12-19T05:39:02.708950+0000","last_active":"2023-12-19T05:39:02.709046+0000","last_peered":"2023-12-19T05:39:02.709046+0000","last_clean":"2023-12-19T05:39:02.709046+0000","last_became_active":"2023-12-19T05:39:02.708106+0000","last_became_peered":"2023-12-19T05:39:02.708106+0000","last_unstale":"2023-12-19T05:39:02.709046+0000","last_undegraded":"2023-12-19T05:39:02.709046+0000","last_fullsized":"2023-12-19T05:39:02.709046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706992+0000","last_change":"2023-12-19T05:39:02.706691+0000","last_active":"2023-12-19T05:39:02.706992+0000","last_peered":"2023-12-19T05:39:02.706992+0000","last_clean":"2023-12-19T05:39:02.706992+0000","last_became_active":"2023-12-19T05:39:02.706456+0000","last_became_peered":"2023-12-19T05:39:02.706456+0000","last_unstale":"2023-12-19T05:39:02.706992+0000","last_undegraded":"2023-12-19T05:39:02.706992+0000","last_fullsized":"2023-12-19T05:39:02.706992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716359+0000","last_change":"2023-12-19T05:39:02.713393+0000","last_active":"2023-12-19T05:39:02.716359+0000","last_peered":"2023-12-19T05:39:02.716359+0000","last_clean":"2023-12-19T05:39:02.716359+0000","last_became_active":"2023-12-19T05:39:02.713154+0000","last_became_peered":"2023-12-19T05:39:02.713154+0000","last_unstale":"2023-12-19T05:39:02.716359+0000","last_undegraded":"2023-12-19T05:39:02.716359+0000","last_fullsized":"2023-12-19T05:39:02.716359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701477+0000","last_change":"2023-12-19T05:39:02.700926+0000","last_active":"2023-12-19T05:39:02.701477+0000","last_peered":"2023-12-19T05:39:02.701477+0000","last_clean":"2023-12-19T05:39:02.701477+0000","last_became_active":"2023-12-19T05:39:02.697252+0000","last_became_peered":"2023-12-19T05:39:02.697252+0000","last_unstale":"2023-12-19T05:39:02.701477+0000","last_undegraded":"2023-12-19T05:39:02.701477+0000","last_fullsized":"2023-12-19T05:39:02.701477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709283+0000","last_change":"2023-12-19T05:39:02.708393+0000","last_active":"2023-12-19T05:39:02.709283+0000","last_peered":"2023-12-19T05:39:02.709283+0000","last_clean":"2023-12-19T05:39:02.709283+0000","last_became_active":"2023-12-19T05:39:02.708060+0000","last_became_peered":"2023-12-19T05:39:02.708060+0000","last_unstale":"2023-12-19T05:39:02.709283+0000","last_undegraded":"2023-12-19T05:39:02.709283+0000","last_fullsized":"2023-12-19T05:39:02.709283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711238+0000","last_change":"2023-12-19T05:39:02.710664+0000","last_active":"2023-12-19T05:39:02.711238+0000","last_peered":"2023-12-19T05:39:02.711238+0000","last_clean":"2023-12-19T05:39:02.711238+0000","last_became_active":"2023-12-19T05:39:02.710462+0000","last_became_peered":"2023-12-19T05:39:02.710462+0000","last_unstale":"2023-12-19T05:39:02.711238+0000","last_undegraded":"2023-12-19T05:39:02.711238+0000","last_fullsized":"2023-12-19T05:39:02.711238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707454+0000","last_change":"2023-12-19T05:39:02.706412+0000","last_active":"2023-12-19T05:39:02.707454+0000","last_peered":"2023-12-19T05:39:02.707454+0000","last_clean":"2023-12-19T05:39:02.707454+0000","last_became_active":"2023-12-19T05:39:02.706148+0000","last_became_peered":"2023-12-19T05:39:02.706148+0000","last_unstale":"2023-12-19T05:39:02.707454+0000","last_undegraded":"2023-12-19T05:39:02.707454+0000","last_fullsized":"2023-12-19T05:39:02.707454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718533+0000","last_change":"2023-12-19T05:39:02.715320+0000","last_active":"2023-12-19T05:39:02.718533+0000","last_peered":"2023-12-19T05:39:02.718533+0000","last_clean":"2023-12-19T05:39:02.718533+0000","last_became_active":"2023-12-19T05:39:02.714719+0000","last_became_peered":"2023-12-19T05:39:02.714719+0000","last_unstale":"2023-12-19T05:39:02.718533+0000","last_undegraded":"2023-12-19T05:39:02.718533+0000","last_fullsized":"2023-12-19T05:39:02.718533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715762+0000","last_change":"2023-12-19T05:39:02.715586+0000","last_active":"2023-12-19T05:39:02.715762+0000","last_peered":"2023-12-19T05:39:02.715762+0000","last_clean":"2023-12-19T05:39:02.715762+0000","last_became_active":"2023-12-19T05:39:02.715221+0000","last_became_peered":"2023-12-19T05:39:02.715221+0000","last_unstale":"2023-12-19T05:39:02.715762+0000","last_undegraded":"2023-12-19T05:39:02.715762+0000","last_fullsized":"2023-12-19T05:39:02.715762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718480+0000","last_change":"2023-12-19T05:39:02.714373+0000","last_active":"2023-12-19T05:39:02.718480+0000","last_peered":"2023-12-19T05:39:02.718480+0000","last_clean":"2023-12-19T05:39:02.718480+0000","last_became_active":"2023-12-19T05:39:02.713629+0000","last_became_peered":"2023-12-19T05:39:02.713629+0000","last_unstale":"2023-12-19T05:39:02.718480+0000","last_undegraded":"2023-12-19T05:39:02.718480+0000","last_fullsized":"2023-12-19T05:39:02.718480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713382+0000","last_change":"2023-12-19T05:39:02.713317+0000","last_active":"2023-12-19T05:39:02.713382+0000","last_peered":"2023-12-19T05:39:02.713382+0000","last_clean":"2023-12-19T05:39:02.713382+0000","last_became_active":"2023-12-19T05:39:02.712971+0000","last_became_peered":"2023-12-19T05:39:02.712971+0000","last_unstale":"2023-12-19T05:39:02.713382+0000","last_undegraded":"2023-12-19T05:39:02.713382+0000","last_fullsized":"2023-12-19T05:39:02.713382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720145+0000","last_change":"2023-12-19T05:39:02.719977+0000","last_active":"2023-12-19T05:39:02.720145+0000","last_peered":"2023-12-19T05:39:02.720145+0000","last_clean":"2023-12-19T05:39:02.720145+0000","last_became_active":"2023-12-19T05:39:02.719748+0000","last_became_peered":"2023-12-19T05:39:02.719748+0000","last_unstale":"2023-12-19T05:39:02.720145+0000","last_undegraded":"2023-12-19T05:39:02.720145+0000","last_fullsized":"2023-12-19T05:39:02.720145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719772+0000","last_change":"2023-12-19T05:39:02.718445+0000","last_active":"2023-12-19T05:39:02.719772+0000","last_peered":"2023-12-19T05:39:02.719772+0000","last_clean":"2023-12-19T05:39:02.719772+0000","last_became_active":"2023-12-19T05:39:02.717751+0000","last_became_peered":"2023-12-19T05:39:02.717751+0000","last_unstale":"2023-12-19T05:39:02.719772+0000","last_undegraded":"2023-12-19T05:39:02.719772+0000","last_fullsized":"2023-12-19T05:39:02.719772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713710+0000","last_change":"2023-12-19T05:39:02.711952+0000","last_active":"2023-12-19T05:39:02.713710+0000","last_peered":"2023-12-19T05:39:02.713710+0000","last_clean":"2023-12-19T05:39:02.713710+0000","last_became_active":"2023-12-19T05:39:02.711582+0000","last_became_peered":"2023-12-19T05:39:02.711582+0000","last_unstale":"2023-12-19T05:39:02.713710+0000","last_undegraded":"2023-12-19T05:39:02.713710+0000","last_fullsized":"2023-12-19T05:39:02.713710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713984+0000","last_change":"2023-12-19T05:39:02.713881+0000","last_active":"2023-12-19T05:39:02.713984+0000","last_peered":"2023-12-19T05:39:02.713984+0000","last_clean":"2023-12-19T05:39:02.713984+0000","last_became_active":"2023-12-19T05:39:02.708835+0000","last_became_peered":"2023-12-19T05:39:02.708835+0000","last_unstale":"2023-12-19T05:39:02.713984+0000","last_undegraded":"2023-12-19T05:39:02.713984+0000","last_fullsized":"2023-12-19T05:39:02.713984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.708630+0000","last_change":"2023-12-19T05:39:02.708098+0000","last_active":"2023-12-19T05:39:02.708630+0000","last_peered":"2023-12-19T05:39:02.708630+0000","last_clean":"2023-12-19T05:39:02.708630+0000","last_became_active":"2023-12-19T05:39:02.707804+0000","last_became_peered":"2023-12-19T05:39:02.707804+0000","last_unstale":"2023-12-19T05:39:02.708630+0000","last_undegraded":"2023-12-19T05:39:02.708630+0000","last_fullsized":"2023-12-19T05:39:02.708630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721098+0000","last_change":"2023-12-19T05:39:02.720287+0000","last_active":"2023-12-19T05:39:02.721098+0000","last_peered":"2023-12-19T05:39:02.721098+0000","last_clean":"2023-12-19T05:39:02.721098+0000","last_became_active":"2023-12-19T05:39:02.720075+0000","last_became_peered":"2023-12-19T05:39:02.720075+0000","last_unstale":"2023-12-19T05:39:02.721098+0000","last_undegraded":"2023-12-19T05:39:02.721098+0000","last_fullsized":"2023-12-19T05:39:02.721098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719684+0000","last_change":"2023-12-19T05:39:02.719563+0000","last_active":"2023-12-19T05:39:02.719684+0000","last_peered":"2023-12-19T05:39:02.719684+0000","last_clean":"2023-12-19T05:39:02.719684+0000","last_became_active":"2023-12-19T05:39:02.719114+0000","last_became_peered":"2023-12-19T05:39:02.719114+0000","last_unstale":"2023-12-19T05:39:02.719684+0000","last_undegraded":"2023-12-19T05:39:02.719684+0000","last_fullsized":"2023-12-19T05:39:02.719684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727216+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.727216+0000","last_peered":"2023-12-19T05:39:02.727216+0000","last_clean":"2023-12-19T05:39:02.727216+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.727216+0000","last_undegraded":"2023-12-19T05:39:02.727216+0000","last_fullsized":"2023-12-19T05:39:02.727216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711786+0000","last_change":"2023-12-19T05:39:02.711723+0000","last_active":"2023-12-19T05:39:02.711786+0000","last_peered":"2023-12-19T05:39:02.711786+0000","last_clean":"2023-12-19T05:39:02.711786+0000","last_became_active":"2023-12-19T05:39:02.709817+0000","last_became_peered":"2023-12-19T05:39:02.709817+0000","last_unstale":"2023-12-19T05:39:02.711786+0000","last_undegraded":"2023-12-19T05:39:02.711786+0000","last_fullsized":"2023-12-19T05:39:02.711786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722219+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.722219+0000","last_peered":"2023-12-19T05:39:02.722219+0000","last_clean":"2023-12-19T05:39:02.722219+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.722219+0000","last_undegraded":"2023-12-19T05:39:02.722219+0000","last_fullsized":"2023-12-19T05:39:02.722219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713569+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.713569+0000","last_peered":"2023-12-19T05:39:02.713569+0000","last_clean":"2023-12-19T05:39:02.713569+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.713569+0000","last_undegraded":"2023-12-19T05:39:02.713569+0000","last_fullsized":"2023-12-19T05:39:02.713569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723073+0000","last_change":"2023-12-19T05:39:02.719393+0000","last_active":"2023-12-19T05:39:02.723073+0000","last_peered":"2023-12-19T05:39:02.723073+0000","last_clean":"2023-12-19T05:39:02.723073+0000","last_became_active":"2023-12-19T05:39:02.719080+0000","last_became_peered":"2023-12-19T05:39:02.719080+0000","last_unstale":"2023-12-19T05:39:02.723073+0000","last_undegraded":"2023-12-19T05:39:02.723073+0000","last_fullsized":"2023-12-19T05:39:02.723073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691632+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.691632+0000","last_peered":"2023-12-19T05:39:02.691632+0000","last_clean":"2023-12-19T05:39:02.691632+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.691632+0000","last_undegraded":"2023-12-19T05:39:02.691632+0000","last_fullsized":"2023-12-19T05:39:02.691632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706164+0000","last_change":"2023-12-19T05:39:02.697790+0000","last_active":"2023-12-19T05:39:02.706164+0000","last_peered":"2023-12-19T05:39:02.706164+0000","last_clean":"2023-12-19T05:39:02.706164+0000","last_became_active":"2023-12-19T05:39:02.697516+0000","last_became_peered":"2023-12-19T05:39:02.697516+0000","last_unstale":"2023-12-19T05:39:02.706164+0000","last_undegraded":"2023-12-19T05:39:02.706164+0000","last_fullsized":"2023-12-19T05:39:02.706164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695035+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.695035+0000","last_peered":"2023-12-19T05:39:02.695035+0000","last_clean":"2023-12-19T05:39:02.695035+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.695035+0000","last_undegraded":"2023-12-19T05:39:02.695035+0000","last_fullsized":"2023-12-19T05:39:02.695035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711851+0000","last_change":"2023-12-19T05:39:02.711262+0000","last_active":"2023-12-19T05:39:02.711851+0000","last_peered":"2023-12-19T05:39:02.711851+0000","last_clean":"2023-12-19T05:39:02.711851+0000","last_became_active":"2023-12-19T05:39:02.710878+0000","last_became_peered":"2023-12-19T05:39:02.710878+0000","last_unstale":"2023-12-19T05:39:02.711851+0000","last_undegraded":"2023-12-19T05:39:02.711851+0000","last_fullsized":"2023-12-19T05:39:02.711851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.702914+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.702914+0000","last_peered":"2023-12-19T05:39:02.702914+0000","last_clean":"2023-12-19T05:39:02.702914+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.702914+0000","last_undegraded":"2023-12-19T05:39:02.702914+0000","last_fullsized":"2023-12-19T05:39:02.702914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.704026+0000","last_change":"2023-12-19T05:39:02.703882+0000","last_active":"2023-12-19T05:39:02.704026+0000","last_peered":"2023-12-19T05:39:02.704026+0000","last_clean":"2023-12-19T05:39:02.704026+0000","last_became_active":"2023-12-19T05:39:02.703208+0000","last_became_peered":"2023-12-19T05:39:02.703208+0000","last_unstale":"2023-12-19T05:39:02.704026+0000","last_undegraded":"2023-12-19T05:39:02.704026+0000","last_fullsized":"2023-12-19T05:39:02.704026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719259+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.719259+0000","last_peered":"2023-12-19T05:39:02.719259+0000","last_clean":"2023-12-19T05:39:02.719259+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.719259+0000","last_undegraded":"2023-12-19T05:39:02.719259+0000","last_fullsized":"2023-12-19T05:39:02.719259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715569+0000","last_change":"2023-12-19T05:39:02.715445+0000","last_active":"2023-12-19T05:39:02.715569+0000","last_peered":"2023-12-19T05:39:02.715569+0000","last_clean":"2023-12-19T05:39:02.715569+0000","last_became_active":"2023-12-19T05:39:02.714901+0000","last_became_peered":"2023-12-19T05:39:02.714901+0000","last_unstale":"2023-12-19T05:39:02.715569+0000","last_undegraded":"2023-12-19T05:39:02.715569+0000","last_fullsized":"2023-12-19T05:39:02.715569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.728240+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.728240+0000","last_peered":"2023-12-19T05:39:02.728240+0000","last_clean":"2023-12-19T05:39:02.728240+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.728240+0000","last_undegraded":"2023-12-19T05:39:02.728240+0000","last_fullsized":"2023-12-19T05:39:02.728240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720718+0000","last_change":"2023-12-19T05:39:02.720607+0000","last_active":"2023-12-19T05:39:02.720718+0000","last_peered":"2023-12-19T05:39:02.720718+0000","last_clean":"2023-12-19T05:39:02.720718+0000","last_became_active":"2023-12-19T05:39:02.720203+0000","last_became_peered":"2023-12-19T05:39:02.720203+0000","last_unstale":"2023-12-19T05:39:02.720718+0000","last_undegraded":"2023-12-19T05:39:02.720718+0000","last_fullsized":"2023-12-19T05:39:02.720718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716893+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.716893+0000","last_peered":"2023-12-19T05:39:02.716893+0000","last_clean":"2023-12-19T05:39:02.716893+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.716893+0000","last_undegraded":"2023-12-19T05:39:02.716893+0000","last_fullsized":"2023-12-19T05:39:02.716893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719719+0000","last_change":"2023-12-19T05:39:02.717923+0000","last_active":"2023-12-19T05:39:02.719719+0000","last_peered":"2023-12-19T05:39:02.719719+0000","last_clean":"2023-12-19T05:39:02.719719+0000","last_became_active":"2023-12-19T05:39:02.717316+0000","last_became_peered":"2023-12-19T05:39:02.717316+0000","last_unstale":"2023-12-19T05:39:02.719719+0000","last_undegraded":"2023-12-19T05:39:02.719719+0000","last_fullsized":"2023-12-19T05:39:02.719719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689096+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.689096+0000","last_peered":"2023-12-19T05:39:02.689096+0000","last_clean":"2023-12-19T05:39:02.689096+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.689096+0000","last_undegraded":"2023-12-19T05:39:02.689096+0000","last_fullsized":"2023-12-19T05:39:02.689096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713759+0000","last_change":"2023-12-19T05:39:02.713659+0000","last_active":"2023-12-19T05:39:02.713759+0000","last_peered":"2023-12-19T05:39:02.713759+0000","last_clean":"2023-12-19T05:39:02.713759+0000","last_became_active":"2023-12-19T05:39:02.708530+0000","last_became_peered":"2023-12-19T05:39:02.708530+0000","last_unstale":"2023-12-19T05:39:02.713759+0000","last_undegraded":"2023-12-19T05:39:02.713759+0000","last_fullsized":"2023-12-19T05:39:02.713759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703018+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.703018+0000","last_peered":"2023-12-19T05:39:02.703018+0000","last_clean":"2023-12-19T05:39:02.703018+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.703018+0000","last_undegraded":"2023-12-19T05:39:02.703018+0000","last_fullsized":"2023-12-19T05:39:02.703018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719504+0000","last_change":"2023-12-19T05:39:02.719423+0000","last_active":"2023-12-19T05:39:02.719504+0000","last_peered":"2023-12-19T05:39:02.719504+0000","last_clean":"2023-12-19T05:39:02.719504+0000","last_became_active":"2023-12-19T05:39:02.718789+0000","last_became_peered":"2023-12-19T05:39:02.718789+0000","last_unstale":"2023-12-19T05:39:02.719504+0000","last_undegraded":"2023-12-19T05:39:02.719504+0000","last_fullsized":"2023-12-19T05:39:02.719504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727356+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.727356+0000","last_peered":"2023-12-19T05:39:02.727356+0000","last_clean":"2023-12-19T05:39:02.727356+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.727356+0000","last_undegraded":"2023-12-19T05:39:02.727356+0000","last_fullsized":"2023-12-19T05:39:02.727356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.705289+0000","last_change":"2023-12-19T05:39:02.704511+0000","last_active":"2023-12-19T05:39:02.705289+0000","last_peered":"2023-12-19T05:39:02.705289+0000","last_clean":"2023-12-19T05:39:02.705289+0000","last_became_active":"2023-12-19T05:39:02.704290+0000","last_became_peered":"2023-12-19T05:39:02.704290+0000","last_unstale":"2023-12-19T05:39:02.705289+0000","last_undegraded":"2023-12-19T05:39:02.705289+0000","last_fullsized":"2023-12-19T05:39:02.705289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720875+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.720875+0000","last_peered":"2023-12-19T05:39:02.720875+0000","last_clean":"2023-12-19T05:39:02.720875+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.720875+0000","last_undegraded":"2023-12-19T05:39:02.720875+0000","last_fullsized":"2023-12-19T05:39:02.720875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.710295+0000","last_change":"2023-12-19T05:39:02.709021+0000","last_active":"2023-12-19T05:39:02.710295+0000","last_peered":"2023-12-19T05:39:02.710295+0000","last_clean":"2023-12-19T05:39:02.710295+0000","last_became_active":"2023-12-19T05:39:02.708795+0000","last_became_peered":"2023-12-19T05:39:02.708795+0000","last_unstale":"2023-12-19T05:39:02.710295+0000","last_undegraded":"2023-12-19T05:39:02.710295+0000","last_fullsized":"2023-12-19T05:39:02.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723471+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.723471+0000","last_peered":"2023-12-19T05:39:02.723471+0000","last_clean":"2023-12-19T05:39:02.723471+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.723471+0000","last_undegraded":"2023-12-19T05:39:02.723471+0000","last_fullsized":"2023-12-19T05:39:02.723471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711455+0000","last_change":"2023-12-19T05:39:02.710851+0000","last_active":"2023-12-19T05:39:02.711455+0000","last_peered":"2023-12-19T05:39:02.711455+0000","last_clean":"2023-12-19T05:39:02.711455+0000","last_became_active":"2023-12-19T05:39:02.710608+0000","last_became_peered":"2023-12-19T05:39:02.710608+0000","last_unstale":"2023-12-19T05:39:02.711455+0000","last_undegraded":"2023-12-19T05:39:02.711455+0000","last_fullsized":"2023-12-19T05:39:02.711455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726383+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.726383+0000","last_peered":"2023-12-19T05:39:02.726383+0000","last_clean":"2023-12-19T05:39:02.726383+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.726383+0000","last_undegraded":"2023-12-19T05:39:02.726383+0000","last_fullsized":"2023-12-19T05:39:02.726383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707311+0000","last_change":"2023-12-19T05:39:02.705620+0000","last_active":"2023-12-19T05:39:02.707311+0000","last_peered":"2023-12-19T05:39:02.707311+0000","last_clean":"2023-12-19T05:39:02.707311+0000","last_became_active":"2023-12-19T05:39:02.705414+0000","last_became_peered":"2023-12-19T05:39:02.705414+0000","last_unstale":"2023-12-19T05:39:02.707311+0000","last_undegraded":"2023-12-19T05:39:02.707311+0000","last_fullsized":"2023-12-19T05:39:02.707311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715348+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.715348+0000","last_peered":"2023-12-19T05:39:02.715348+0000","last_clean":"2023-12-19T05:39:02.715348+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.715348+0000","last_undegraded":"2023-12-19T05:39:02.715348+0000","last_fullsized":"2023-12-19T05:39:02.715348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.696599+0000","last_change":"2023-12-19T05:39:02.696537+0000","last_active":"2023-12-19T05:39:02.696599+0000","last_peered":"2023-12-19T05:39:02.696599+0000","last_clean":"2023-12-19T05:39:02.696599+0000","last_became_active":"2023-12-19T05:39:02.696310+0000","last_became_peered":"2023-12-19T05:39:02.696310+0000","last_unstale":"2023-12-19T05:39:02.696599+0000","last_undegraded":"2023-12-19T05:39:02.696599+0000","last_fullsized":"2023-12-19T05:39:02.696599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.694722+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:02.694722+0000","last_peered":"2023-12-19T05:39:02.694722+0000","last_clean":"2023-12-19T05:39:02.694722+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:02.694722+0000","last_undegraded":"2023-12-19T05:39:02.694722+0000","last_fullsized":"2023-12-19T05:39:02.694722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689437+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.689437+0000","last_peered":"2023-12-19T05:39:02.689437+0000","last_clean":"2023-12-19T05:39:02.689437+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.689437+0000","last_undegraded":"2023-12-19T05:39:02.689437+0000","last_fullsized":"2023-12-19T05:39:02.689437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711648+0000","last_change":"2023-12-19T05:39:02.711546+0000","last_active":"2023-12-19T05:39:02.711648+0000","last_peered":"2023-12-19T05:39:02.711648+0000","last_clean":"2023-12-19T05:39:02.711648+0000","last_became_active":"2023-12-19T05:39:02.709082+0000","last_became_peered":"2023-12-19T05:39:02.709082+0000","last_unstale":"2023-12-19T05:39:02.711648+0000","last_undegraded":"2023-12-19T05:39:02.711648+0000","last_fullsized":"2023-12-19T05:39:02.711648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691936+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.691936+0000","last_peered":"2023-12-19T05:39:02.691936+0000","last_clean":"2023-12-19T05:39:02.691936+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.691936+0000","last_undegraded":"2023-12-19T05:39:02.691936+0000","last_fullsized":"2023-12-19T05:39:02.691936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719756+0000","last_change":"2023-12-19T05:39:02.718299+0000","last_active":"2023-12-19T05:39:02.719756+0000","last_peered":"2023-12-19T05:39:02.719756+0000","last_clean":"2023-12-19T05:39:02.719756+0000","last_became_active":"2023-12-19T05:39:02.717475+0000","last_became_peered":"2023-12-19T05:39:02.717475+0000","last_unstale":"2023-12-19T05:39:02.719756+0000","last_undegraded":"2023-12-19T05:39:02.719756+0000","last_fullsized":"2023-12-19T05:39:02.719756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701132+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.701132+0000","last_peered":"2023-12-19T05:39:02.701132+0000","last_clean":"2023-12-19T05:39:02.701132+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.701132+0000","last_undegraded":"2023-12-19T05:39:02.701132+0000","last_fullsized":"2023-12-19T05:39:02.701132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711884+0000","last_change":"2023-12-19T05:39:02.711808+0000","last_active":"2023-12-19T05:39:02.711884+0000","last_peered":"2023-12-19T05:39:02.711884+0000","last_clean":"2023-12-19T05:39:02.711884+0000","last_became_active":"2023-12-19T05:39:02.710838+0000","last_became_peered":"2023-12-19T05:39:02.710838+0000","last_unstale":"2023-12-19T05:39:02.711884+0000","last_undegraded":"2023-12-19T05:39:02.711884+0000","last_fullsized":"2023-12-19T05:39:02.711884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.690768+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.690768+0000","last_peered":"2023-12-19T05:39:02.690768+0000","last_clean":"2023-12-19T05:39:02.690768+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.690768+0000","last_undegraded":"2023-12-19T05:39:02.690768+0000","last_fullsized":"2023-12-19T05:39:02.690768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713171+0000","last_change":"2023-12-19T05:39:02.712999+0000","last_active":"2023-12-19T05:39:02.713171+0000","last_peered":"2023-12-19T05:39:02.713171+0000","last_clean":"2023-12-19T05:39:02.713171+0000","last_became_active":"2023-12-19T05:39:02.712612+0000","last_became_peered":"2023-12-19T05:39:02.712612+0000","last_unstale":"2023-12-19T05:39:02.713171+0000","last_undegraded":"2023-12-19T05:39:02.713171+0000","last_fullsized":"2023-12-19T05:39:02.713171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700616+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.700616+0000","last_peered":"2023-12-19T05:39:02.700616+0000","last_clean":"2023-12-19T05:39:02.700616+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.700616+0000","last_undegraded":"2023-12-19T05:39:02.700616+0000","last_fullsized":"2023-12-19T05:39:02.700616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721066+0000","last_change":"2023-12-19T05:39:02.719234+0000","last_active":"2023-12-19T05:39:02.721066+0000","last_peered":"2023-12-19T05:39:02.721066+0000","last_clean":"2023-12-19T05:39:02.721066+0000","last_became_active":"2023-12-19T05:39:02.718998+0000","last_became_peered":"2023-12-19T05:39:02.718998+0000","last_unstale":"2023-12-19T05:39:02.721066+0000","last_undegraded":"2023-12-19T05:39:02.721066+0000","last_fullsized":"2023-12-19T05:39:02.721066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691685+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.691685+0000","last_peered":"2023-12-19T05:39:02.691685+0000","last_clean":"2023-12-19T05:39:02.691685+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.691685+0000","last_undegraded":"2023-12-19T05:39:02.691685+0000","last_fullsized":"2023-12-19T05:39:02.691685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.725731+0000","last_change":"2023-12-19T05:39:02.725655+0000","last_active":"2023-12-19T05:39:02.725731+0000","last_peered":"2023-12-19T05:39:02.725731+0000","last_clean":"2023-12-19T05:39:02.725731+0000","last_became_active":"2023-12-19T05:39:02.725276+0000","last_became_peered":"2023-12-19T05:39:02.725276+0000","last_unstale":"2023-12-19T05:39:02.725731+0000","last_undegraded":"2023-12-19T05:39:02.725731+0000","last_fullsized":"2023-12-19T05:39:02.725731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:39:04.181770+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:04.181770+0000","last_peered":"2023-12-19T05:39:04.181770+0000","last_clean":"2023-12-19T05:39:04.181770+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:04.181770+0000","last_undegraded":"2023-12-19T05:39:04.181770+0000","last_fullsized":"2023-12-19T05:39:04.181770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720870+0000","last_change":"2023-12-19T05:39:02.719751+0000","last_active":"2023-12-19T05:39:02.720870+0000","last_peered":"2023-12-19T05:39:02.720870+0000","last_clean":"2023-12-19T05:39:02.720870+0000","last_became_active":"2023-12-19T05:39:02.719489+0000","last_became_peered":"2023-12-19T05:39:02.719489+0000","last_unstale":"2023-12-19T05:39:02.720870+0000","last_undegraded":"2023-12-19T05:39:02.720870+0000","last_fullsized":"2023-12-19T05:39:02.720870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721695+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.721695+0000","last_peered":"2023-12-19T05:39:02.721695+0000","last_clean":"2023-12-19T05:39:02.721695+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.721695+0000","last_undegraded":"2023-12-19T05:39:02.721695+0000","last_fullsized":"2023-12-19T05:39:02.721695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719332+0000","last_change":"2023-12-19T05:39:02.719256+0000","last_active":"2023-12-19T05:39:02.719332+0000","last_peered":"2023-12-19T05:39:02.719332+0000","last_clean":"2023-12-19T05:39:02.719332+0000","last_became_active":"2023-12-19T05:39:02.718985+0000","last_became_peered":"2023-12-19T05:39:02.718985+0000","last_unstale":"2023-12-19T05:39:02.719332+0000","last_undegraded":"2023-12-19T05:39:02.719332+0000","last_fullsized":"2023-12-19T05:39:02.719332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700486+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.700486+0000","last_peered":"2023-12-19T05:39:02.700486+0000","last_clean":"2023-12-19T05:39:02.700486+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.700486+0000","last_undegraded":"2023-12-19T05:39:02.700486+0000","last_fullsized":"2023-12-19T05:39:02.700486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.697089+0000","last_change":"2023-12-19T05:39:02.696856+0000","last_active":"2023-12-19T05:39:02.697089+0000","last_peered":"2023-12-19T05:39:02.697089+0000","last_clean":"2023-12-19T05:39:02.697089+0000","last_became_active":"2023-12-19T05:39:02.696670+0000","last_became_peered":"2023-12-19T05:39:02.696670+0000","last_unstale":"2023-12-19T05:39:02.697089+0000","last_undegraded":"2023-12-19T05:39:02.697089+0000","last_fullsized":"2023-12-19T05:39:02.697089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695338+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.695338+0000","last_peered":"2023-12-19T05:39:02.695338+0000","last_clean":"2023-12-19T05:39:02.695338+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.695338+0000","last_undegraded":"2023-12-19T05:39:02.695338+0000","last_fullsized":"2023-12-19T05:39:02.695338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715781+0000","last_change":"2023-12-19T05:39:02.715604+0000","last_active":"2023-12-19T05:39:02.715781+0000","last_peered":"2023-12-19T05:39:02.715781+0000","last_clean":"2023-12-19T05:39:02.715781+0000","last_became_active":"2023-12-19T05:39:02.715340+0000","last_became_peered":"2023-12-19T05:39:02.715340+0000","last_unstale":"2023-12-19T05:39:02.715781+0000","last_undegraded":"2023-12-19T05:39:02.715781+0000","last_fullsized":"2023-12-19T05:39:02.715781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.714039+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.714039+0000","last_peered":"2023-12-19T05:39:02.714039+0000","last_clean":"2023-12-19T05:39:02.714039+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.714039+0000","last_undegraded":"2023-12-19T05:39:02.714039+0000","last_fullsized":"2023-12-19T05:39:02.714039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719903+0000","last_change":"2023-12-19T05:39:02.719822+0000","last_active":"2023-12-19T05:39:02.719903+0000","last_peered":"2023-12-19T05:39:02.719903+0000","last_clean":"2023-12-19T05:39:02.719903+0000","last_became_active":"2023-12-19T05:39:02.719603+0000","last_became_peered":"2023-12-19T05:39:02.719603+0000","last_unstale":"2023-12-19T05:39:02.719903+0000","last_undegraded":"2023-12-19T05:39:02.719903+0000","last_fullsized":"2023-12-19T05:39:02.719903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722064+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.722064+0000","last_peered":"2023-12-19T05:39:02.722064+0000","last_clean":"2023-12-19T05:39:02.722064+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.722064+0000","last_undegraded":"2023-12-19T05:39:02.722064+0000","last_fullsized":"2023-12-19T05:39:02.722064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.698331+0000","last_change":"2023-12-19T05:39:02.698107+0000","last_active":"2023-12-19T05:39:02.698331+0000","last_peered":"2023-12-19T05:39:02.698331+0000","last_clean":"2023-12-19T05:39:02.698331+0000","last_became_active":"2023-12-19T05:39:02.696242+0000","last_became_peered":"2023-12-19T05:39:02.696242+0000","last_unstale":"2023-12-19T05:39:02.698331+0000","last_undegraded":"2023-12-19T05:39:02.698331+0000","last_fullsized":"2023-12-19T05:39:02.698331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709142+0000","last_change":"2023-12-19T05:39:02.709072+0000","last_active":"2023-12-19T05:39:02.709142+0000","last_peered":"2023-12-19T05:39:02.709142+0000","last_clean":"2023-12-19T05:39:02.709142+0000","last_became_active":"2023-12-19T05:39:02.708202+0000","last_became_peered":"2023-12-19T05:39:02.708202+0000","last_unstale":"2023-12-19T05:39:02.709142+0000","last_undegraded":"2023-12-19T05:39:02.709142+0000","last_fullsized":"2023-12-19T05:39:02.709142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713469+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.713469+0000","last_peered":"2023-12-19T05:39:02.713469+0000","last_clean":"2023-12-19T05:39:02.713469+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.713469+0000","last_undegraded":"2023-12-19T05:39:02.713469+0000","last_fullsized":"2023-12-19T05:39:02.713469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707208+0000","last_change":"2023-12-19T05:39:02.706972+0000","last_active":"2023-12-19T05:39:02.707208+0000","last_peered":"2023-12-19T05:39:02.707208+0000","last_clean":"2023-12-19T05:39:02.707208+0000","last_became_active":"2023-12-19T05:39:02.702711+0000","last_became_peered":"2023-12-19T05:39:02.702711+0000","last_unstale":"2023-12-19T05:39:02.707208+0000","last_undegraded":"2023-12-19T05:39:02.707208+0000","last_fullsized":"2023-12-19T05:39:02.707208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713207+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.713207+0000","last_peered":"2023-12-19T05:39:02.713207+0000","last_clean":"2023-12-19T05:39:02.713207+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.713207+0000","last_undegraded":"2023-12-19T05:39:02.713207+0000","last_fullsized":"2023-12-19T05:39:02.713207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718496+0000","last_change":"2023-12-19T05:39:02.714964+0000","last_active":"2023-12-19T05:39:02.718496+0000","last_peered":"2023-12-19T05:39:02.718496+0000","last_clean":"2023-12-19T05:39:02.718496+0000","last_became_active":"2023-12-19T05:39:02.713835+0000","last_became_peered":"2023-12-19T05:39:02.713835+0000","last_unstale":"2023-12-19T05:39:02.718496+0000","last_undegraded":"2023-12-19T05:39:02.718496+0000","last_fullsized":"2023-12-19T05:39:02.718496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726982+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.726982+0000","last_peered":"2023-12-19T05:39:02.726982+0000","last_clean":"2023-12-19T05:39:02.726982+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.726982+0000","last_undegraded":"2023-12-19T05:39:02.726982+0000","last_fullsized":"2023-12-19T05:39:02.726982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718442+0000","last_change":"2023-12-19T05:39:02.714203+0000","last_active":"2023-12-19T05:39:02.718442+0000","last_peered":"2023-12-19T05:39:02.718442+0000","last_clean":"2023-12-19T05:39:02.718442+0000","last_became_active":"2023-12-19T05:39:02.713955+0000","last_became_peered":"2023-12-19T05:39:02.713955+0000","last_unstale":"2023-12-19T05:39:02.718442+0000","last_undegraded":"2023-12-19T05:39:02.718442+0000","last_fullsized":"2023-12-19T05:39:02.718442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727404+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.727404+0000","last_peered":"2023-12-19T05:39:02.727404+0000","last_clean":"2023-12-19T05:39:02.727404+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.727404+0000","last_undegraded":"2023-12-19T05:39:02.727404+0000","last_fullsized":"2023-12-19T05:39:02.727404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:18.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:18.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.760+0000 7f6555363640 1 Processor -- start 2023-12-19T05:39:18.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.761+0000 7f6555363640 1 -- start start 2023-12-19T05:39:18.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f6555363640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65500b0b50 0x7f655006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f6555363640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f655006b590 0x7f655006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f6555363640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655006bb30 con 0x7f65501449e0 2023-12-19T05:39:18.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f6555363640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500b0070 con 0x7f655006b590 2023-12-19T05:39:18.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f6555363640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500b0350 con 0x7f65500b0b50 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f654f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f655006b590 0x7f655006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f654f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f655006b590 0x7f655006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33992/0 (socket says 172.21.15.49:33992) 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f654f7fe640 1 -- 172.21.15.49:0/3445554206 learned_addr learned my addr 172.21.15.49:0/3445554206 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.763+0000 7f65467fc640 1 --2- 172.21.15.49:0/3445554206 >> v2:172.21.15.115:3300/0 conn(0x7f65500b0b50 0x7f655006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.764+0000 7f654f7fe640 1 -- 172.21.15.49:0/3445554206 >> v2:172.21.15.115:3300/0 conn(0x7f65500b0b50 msgr2=0x7f655006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.764+0000 7f654f7fe640 1 --2- 172.21.15.49:0/3445554206 >> v2:172.21.15.115:3300/0 conn(0x7f65500b0b50 0x7f655006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.764+0000 7f654f7fe640 1 -- 172.21.15.49:0/3445554206 >> v1:172.21.15.115:6789/0 conn(0x7f65501449e0 legacy=0x7f65500af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.764+0000 7f654f7fe640 1 -- 172.21.15.49:0/3445554206 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500b0630 con 0x7f655006b590 2023-12-19T05:39:18.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.765+0000 7f654f7fe640 1 --2- 172.21.15.49:0/3445554206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655006c4e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6550071c80 tx=0x7f654802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cbdb33861975f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.765+0000 7f654e7fc640 1 -- 172.21.15.49:0/3445554206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654802ca80 con 0x7f655006b590 2023-12-19T05:39:18.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.765+0000 7f654e7fc640 1 -- 172.21.15.49:0/3445554206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654802cbe0 con 0x7f655006b590 2023-12-19T05:39:18.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.765+0000 7f654e7fc640 1 -- 172.21.15.49:0/3445554206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480343f0 con 0x7f655006b590 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 -- 172.21.15.49:0/3445554206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 msgr2=0x7f655006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 --2- 172.21.15.49:0/3445554206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655006c4e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6550071c80 tx=0x7f654802bee0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 -- 172.21.15.49:0/3445554206 shutdown_connections 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 --2- 172.21.15.49:0/3445554206 >> v2:172.21.15.115:3300/0 conn(0x7f65500b0b50 0x7f655006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 --2- 172.21.15.49:0/3445554206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655006c4e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 -- 172.21.15.49:0/3445554206 >> 172.21.15.49:0/3445554206 conn(0x7f65500cbb70 msgr2=0x7f65500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 -- 172.21.15.49:0/3445554206 shutdown_connections 2023-12-19T05:39:18.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.766+0000 7f6555363640 1 -- 172.21.15.49:0/3445554206 wait complete. 2023-12-19T05:39:18.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.768+0000 7f6555363640 1 Processor -- start 2023-12-19T05:39:18.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.768+0000 7f6555363640 1 -- start start 2023-12-19T05:39:18.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65500b0b50 0x7f655013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65501449e0 0x7f655013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655015df70 con 0x7f655006b590 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655013f0e0 con 0x7f65500b0b50 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f6555363640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655013f3c0 con 0x7f65501449e0 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34002/0 (socket says 172.21.15.49:34002) 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 -- 172.21.15.49:0/4075533179 learned_addr learned my addr 172.21.15.49:0/4075533179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 -- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65501449e0 msgr2=0x7f655013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65501449e0 0x7f655013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 -- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65500b0b50 msgr2=0x7f655013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65500b0b50 0x7f655013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.770+0000 7f654effd640 1 -- 172.21.15.49:0/4075533179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009b30 con 0x7f655006b590 2023-12-19T05:39:18.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f654effd640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f654000b3f0 tx=0x7f654000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540011830 con 0x7f655006b590 2023-12-19T05:39:18.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540011990 con 0x7f655006b590 2023-12-19T05:39:18.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655013f6a0 con 0x7f655006b590 2023-12-19T05:39:18.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540011d40 con 0x7f655006b590 2023-12-19T05:39:18.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.771+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655013aee0 con 0x7f655006b590 2023-12-19T05:39:18.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.772+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655013fbc0 con 0x7f655006b590 2023-12-19T05:39:18.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.773+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f654001a400 con 0x7f655006b590 2023-12-19T05:39:18.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.774+0000 7f6547fff640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 0x7f653006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.774+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6540088770 con 0x7f655006b590 2023-12-19T05:39:18.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.774+0000 7f65467fc640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 0x7f653006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.775+0000 7f65467fc640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 0x7f653006c940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65500ae530 tx=0x7f6538008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.778+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f655013fbc0 con 0x7f655006b590 2023-12-19T05:39:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.963+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65500b1710 con 0x7f653006a480 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.984+0000 7f6547fff640 1 -- 172.21.15.49:0/4075533179 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260076 (secure 0 0 0) 0x7f6538009e40 con 0x7f653006a480 2023-12-19T05:39:18.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:18.990 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.988+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 msgr2=0x7f653006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.988+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 0x7f653006c940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65500ae530 tx=0x7f6538008040 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.988+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 msgr2=0x7f655015e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.988+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f654000b3f0 tx=0x7f654000b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 shutdown_connections 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f653006a480 0x7f653006c940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65501449e0 0x7f655013a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65500b0b50 0x7f655013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 --2- 172.21.15.49:0/4075533179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f655006b590 0x7f655015e520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 >> 172.21.15.49:0/4075533179 conn(0x7f65500cbb70 msgr2=0x7f65500cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 shutdown_connections 2023-12-19T05:39:18.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:18.989+0000 7f6555363640 1 -- 172.21.15.49:0/4075533179 wait complete. 2023-12-19T05:39:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T05:39:18.504546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717330+0000","last_change":"2023-12-19T05:39:02.717216+0000","last_active":"2023-12-19T05:39:02.717330+0000","last_peered":"2023-12-19T05:39:02.717330+0000","last_clean":"2023-12-19T05:39:02.717330+0000","last_became_active":"2023-12-19T05:39:02.716805+0000","last_became_peered":"2023-12-19T05:39:02.716805+0000","last_unstale":"2023-12-19T05:39:02.717330+0000","last_undegraded":"2023-12-19T05:39:02.717330+0000","last_fullsized":"2023-12-19T05:39:02.717330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723207+0000","last_change":"2023-12-19T05:39:02.720735+0000","last_active":"2023-12-19T05:39:02.723207+0000","last_peered":"2023-12-19T05:39:02.723207+0000","last_clean":"2023-12-19T05:39:02.723207+0000","last_became_active":"2023-12-19T05:39:02.720479+0000","last_became_peered":"2023-12-19T05:39:02.720479+0000","last_unstale":"2023-12-19T05:39:02.723207+0000","last_undegraded":"2023-12-19T05:39:02.723207+0000","last_fullsized":"2023-12-19T05:39:02.723207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718511+0000","last_change":"2023-12-19T05:39:02.715183+0000","last_active":"2023-12-19T05:39:02.718511+0000","last_peered":"2023-12-19T05:39:02.718511+0000","last_clean":"2023-12-19T05:39:02.718511+0000","last_became_active":"2023-12-19T05:39:02.714240+0000","last_became_peered":"2023-12-19T05:39:02.714240+0000","last_unstale":"2023-12-19T05:39:02.718511+0000","last_undegraded":"2023-12-19T05:39:02.718511+0000","last_fullsized":"2023-12-19T05:39:02.718511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711817+0000","last_change":"2023-12-19T05:39:02.710230+0000","last_active":"2023-12-19T05:39:02.711817+0000","last_peered":"2023-12-19T05:39:02.711817+0000","last_clean":"2023-12-19T05:39:02.711817+0000","last_became_active":"2023-12-19T05:39:02.710001+0000","last_became_peered":"2023-12-19T05:39:02.710001+0000","last_unstale":"2023-12-19T05:39:02.711817+0000","last_undegraded":"2023-12-19T05:39:02.711817+0000","last_fullsized":"2023-12-19T05:39:02.711817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718958+0000","last_change":"2023-12-19T05:39:02.718728+0000","last_active":"2023-12-19T05:39:02.718958+0000","last_peered":"2023-12-19T05:39:02.718958+0000","last_clean":"2023-12-19T05:39:02.718958+0000","last_became_active":"2023-12-19T05:39:02.718457+0000","last_became_peered":"2023-12-19T05:39:02.718457+0000","last_unstale":"2023-12-19T05:39:02.718958+0000","last_undegraded":"2023-12-19T05:39:02.718958+0000","last_fullsized":"2023-12-19T05:39:02.718958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711835+0000","last_change":"2023-12-19T05:39:02.710247+0000","last_active":"2023-12-19T05:39:02.711835+0000","last_peered":"2023-12-19T05:39:02.711835+0000","last_clean":"2023-12-19T05:39:02.711835+0000","last_became_active":"2023-12-19T05:39:02.710039+0000","last_became_peered":"2023-12-19T05:39:02.710039+0000","last_unstale":"2023-12-19T05:39:02.711835+0000","last_undegraded":"2023-12-19T05:39:02.711835+0000","last_fullsized":"2023-12-19T05:39:02.711835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716214+0000","last_change":"2023-12-19T05:39:02.716135+0000","last_active":"2023-12-19T05:39:02.716214+0000","last_peered":"2023-12-19T05:39:02.716214+0000","last_clean":"2023-12-19T05:39:02.716214+0000","last_became_active":"2023-12-19T05:39:02.715148+0000","last_became_peered":"2023-12-19T05:39:02.715148+0000","last_unstale":"2023-12-19T05:39:02.716214+0000","last_undegraded":"2023-12-19T05:39:02.716214+0000","last_fullsized":"2023-12-19T05:39:02.716214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:34.888388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723196+0000","last_change":"2023-12-19T05:39:02.720176+0000","last_active":"2023-12-19T05:39:02.723196+0000","last_peered":"2023-12-19T05:39:02.723196+0000","last_clean":"2023-12-19T05:39:02.723196+0000","last_became_active":"2023-12-19T05:39:02.719954+0000","last_became_peered":"2023-12-19T05:39:02.719954+0000","last_unstale":"2023-12-19T05:39:02.723196+0000","last_undegraded":"2023-12-19T05:39:02.723196+0000","last_fullsized":"2023-12-19T05:39:02.723196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700335+0000","last_change":"2023-12-19T05:39:02.700252+0000","last_active":"2023-12-19T05:39:02.700335+0000","last_peered":"2023-12-19T05:39:02.700335+0000","last_clean":"2023-12-19T05:39:02.700335+0000","last_became_active":"2023-12-19T05:39:02.699871+0000","last_became_peered":"2023-12-19T05:39:02.699871+0000","last_unstale":"2023-12-19T05:39:02.700335+0000","last_undegraded":"2023-12-19T05:39:02.700335+0000","last_fullsized":"2023-12-19T05:39:02.700335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:27.157486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709263+0000","last_change":"2023-12-19T05:39:02.708261+0000","last_active":"2023-12-19T05:39:02.709263+0000","last_peered":"2023-12-19T05:39:02.709263+0000","last_clean":"2023-12-19T05:39:02.709263+0000","last_became_active":"2023-12-19T05:39:02.707762+0000","last_became_peered":"2023-12-19T05:39:02.707762+0000","last_unstale":"2023-12-19T05:39:02.709263+0000","last_undegraded":"2023-12-19T05:39:02.709263+0000","last_fullsized":"2023-12-19T05:39:02.709263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.717313+0000","last_change":"2023-12-19T05:39:02.717049+0000","last_active":"2023-12-19T05:39:02.717313+0000","last_peered":"2023-12-19T05:39:02.717313+0000","last_clean":"2023-12-19T05:39:02.717313+0000","last_became_active":"2023-12-19T05:39:02.716371+0000","last_became_peered":"2023-12-19T05:39:02.716371+0000","last_unstale":"2023-12-19T05:39:02.717313+0000","last_undegraded":"2023-12-19T05:39:02.717313+0000","last_fullsized":"2023-12-19T05:39:02.717313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707329+0000","last_change":"2023-12-19T05:39:02.707024+0000","last_active":"2023-12-19T05:39:02.707329+0000","last_peered":"2023-12-19T05:39:02.707329+0000","last_clean":"2023-12-19T05:39:02.707329+0000","last_became_active":"2023-12-19T05:39:02.706779+0000","last_became_peered":"2023-12-19T05:39:02.706779+0000","last_unstale":"2023-12-19T05:39:02.707329+0000","last_undegraded":"2023-12-19T05:39:02.707329+0000","last_fullsized":"2023-12-19T05:39:02.707329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719791+0000","last_change":"2023-12-19T05:39:02.718594+0000","last_active":"2023-12-19T05:39:02.719791+0000","last_peered":"2023-12-19T05:39:02.719791+0000","last_clean":"2023-12-19T05:39:02.719791+0000","last_became_active":"2023-12-19T05:39:02.717977+0000","last_became_peered":"2023-12-19T05:39:02.717977+0000","last_unstale":"2023-12-19T05:39:02.719791+0000","last_undegraded":"2023-12-19T05:39:02.719791+0000","last_fullsized":"2023-12-19T05:39:02.719791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719739+0000","last_change":"2023-12-19T05:39:02.718246+0000","last_active":"2023-12-19T05:39:02.719739+0000","last_peered":"2023-12-19T05:39:02.719739+0000","last_clean":"2023-12-19T05:39:02.719739+0000","last_became_active":"2023-12-19T05:39:02.716071+0000","last_became_peered":"2023-12-19T05:39:02.716071+0000","last_unstale":"2023-12-19T05:39:02.719739+0000","last_undegraded":"2023-12-19T05:39:02.719739+0000","last_fullsized":"2023-12-19T05:39:02.719739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718462+0000","last_change":"2023-12-19T05:39:02.714245+0000","last_active":"2023-12-19T05:39:02.718462+0000","last_peered":"2023-12-19T05:39:02.718462+0000","last_clean":"2023-12-19T05:39:02.718462+0000","last_became_active":"2023-12-19T05:39:02.713242+0000","last_became_peered":"2023-12-19T05:39:02.713242+0000","last_unstale":"2023-12-19T05:39:02.718462+0000","last_undegraded":"2023-12-19T05:39:02.718462+0000","last_fullsized":"2023-12-19T05:39:02.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:12.962326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709046+0000","last_change":"2023-12-19T05:39:02.708950+0000","last_active":"2023-12-19T05:39:02.709046+0000","last_peered":"2023-12-19T05:39:02.709046+0000","last_clean":"2023-12-19T05:39:02.709046+0000","last_became_active":"2023-12-19T05:39:02.708106+0000","last_became_peered":"2023-12-19T05:39:02.708106+0000","last_unstale":"2023-12-19T05:39:02.709046+0000","last_undegraded":"2023-12-19T05:39:02.709046+0000","last_fullsized":"2023-12-19T05:39:02.709046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:56:28.741214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706992+0000","last_change":"2023-12-19T05:39:02.706691+0000","last_active":"2023-12-19T05:39:02.706992+0000","last_peered":"2023-12-19T05:39:02.706992+0000","last_clean":"2023-12-19T05:39:02.706992+0000","last_became_active":"2023-12-19T05:39:02.706456+0000","last_became_peered":"2023-12-19T05:39:02.706456+0000","last_unstale":"2023-12-19T05:39:02.706992+0000","last_undegraded":"2023-12-19T05:39:02.706992+0000","last_fullsized":"2023-12-19T05:39:02.706992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:54:05.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716359+0000","last_change":"2023-12-19T05:39:02.713393+0000","last_active":"2023-12-19T05:39:02.716359+0000","last_peered":"2023-12-19T05:39:02.716359+0000","last_clean":"2023-12-19T05:39:02.716359+0000","last_became_active":"2023-12-19T05:39:02.713154+0000","last_became_peered":"2023-12-19T05:39:02.713154+0000","last_unstale":"2023-12-19T05:39:02.716359+0000","last_undegraded":"2023-12-19T05:39:02.716359+0000","last_fullsized":"2023-12-19T05:39:02.716359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701477+0000","last_change":"2023-12-19T05:39:02.700926+0000","last_active":"2023-12-19T05:39:02.701477+0000","last_peered":"2023-12-19T05:39:02.701477+0000","last_clean":"2023-12-19T05:39:02.701477+0000","last_became_active":"2023-12-19T05:39:02.697252+0000","last_became_peered":"2023-12-19T05:39:02.697252+0000","last_unstale":"2023-12-19T05:39:02.701477+0000","last_undegraded":"2023-12-19T05:39:02.701477+0000","last_fullsized":"2023-12-19T05:39:02.701477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:37.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709283+0000","last_change":"2023-12-19T05:39:02.708393+0000","last_active":"2023-12-19T05:39:02.709283+0000","last_peered":"2023-12-19T05:39:02.709283+0000","last_clean":"2023-12-19T05:39:02.709283+0000","last_became_active":"2023-12-19T05:39:02.708060+0000","last_became_peered":"2023-12-19T05:39:02.708060+0000","last_unstale":"2023-12-19T05:39:02.709283+0000","last_undegraded":"2023-12-19T05:39:02.709283+0000","last_fullsized":"2023-12-19T05:39:02.709283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711238+0000","last_change":"2023-12-19T05:39:02.710664+0000","last_active":"2023-12-19T05:39:02.711238+0000","last_peered":"2023-12-19T05:39:02.711238+0000","last_clean":"2023-12-19T05:39:02.711238+0000","last_became_active":"2023-12-19T05:39:02.710462+0000","last_became_peered":"2023-12-19T05:39:02.710462+0000","last_unstale":"2023-12-19T05:39:02.711238+0000","last_undegraded":"2023-12-19T05:39:02.711238+0000","last_fullsized":"2023-12-19T05:39:02.711238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707454+0000","last_change":"2023-12-19T05:39:02.706412+0000","last_active":"2023-12-19T05:39:02.707454+0000","last_peered":"2023-12-19T05:39:02.707454+0000","last_clean":"2023-12-19T05:39:02.707454+0000","last_became_active":"2023-12-19T05:39:02.706148+0000","last_became_peered":"2023-12-19T05:39:02.706148+0000","last_unstale":"2023-12-19T05:39:02.707454+0000","last_undegraded":"2023-12-19T05:39:02.707454+0000","last_fullsized":"2023-12-19T05:39:02.707454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718533+0000","last_change":"2023-12-19T05:39:02.715320+0000","last_active":"2023-12-19T05:39:02.718533+0000","last_peered":"2023-12-19T05:39:02.718533+0000","last_clean":"2023-12-19T05:39:02.718533+0000","last_became_active":"2023-12-19T05:39:02.714719+0000","last_became_peered":"2023-12-19T05:39:02.714719+0000","last_unstale":"2023-12-19T05:39:02.718533+0000","last_undegraded":"2023-12-19T05:39:02.718533+0000","last_fullsized":"2023-12-19T05:39:02.718533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715762+0000","last_change":"2023-12-19T05:39:02.715586+0000","last_active":"2023-12-19T05:39:02.715762+0000","last_peered":"2023-12-19T05:39:02.715762+0000","last_clean":"2023-12-19T05:39:02.715762+0000","last_became_active":"2023-12-19T05:39:02.715221+0000","last_became_peered":"2023-12-19T05:39:02.715221+0000","last_unstale":"2023-12-19T05:39:02.715762+0000","last_undegraded":"2023-12-19T05:39:02.715762+0000","last_fullsized":"2023-12-19T05:39:02.715762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:41:41.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718480+0000","last_change":"2023-12-19T05:39:02.714373+0000","last_active":"2023-12-19T05:39:02.718480+0000","last_peered":"2023-12-19T05:39:02.718480+0000","last_clean":"2023-12-19T05:39:02.718480+0000","last_became_active":"2023-12-19T05:39:02.713629+0000","last_became_peered":"2023-12-19T05:39:02.713629+0000","last_unstale":"2023-12-19T05:39:02.718480+0000","last_undegraded":"2023-12-19T05:39:02.718480+0000","last_fullsized":"2023-12-19T05:39:02.718480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:18:00.756147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713382+0000","last_change":"2023-12-19T05:39:02.713317+0000","last_active":"2023-12-19T05:39:02.713382+0000","last_peered":"2023-12-19T05:39:02.713382+0000","last_clean":"2023-12-19T05:39:02.713382+0000","last_became_active":"2023-12-19T05:39:02.712971+0000","last_became_peered":"2023-12-19T05:39:02.712971+0000","last_unstale":"2023-12-19T05:39:02.713382+0000","last_undegraded":"2023-12-19T05:39:02.713382+0000","last_fullsized":"2023-12-19T05:39:02.713382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720145+0000","last_change":"2023-12-19T05:39:02.719977+0000","last_active":"2023-12-19T05:39:02.720145+0000","last_peered":"2023-12-19T05:39:02.720145+0000","last_clean":"2023-12-19T05:39:02.720145+0000","last_became_active":"2023-12-19T05:39:02.719748+0000","last_became_peered":"2023-12-19T05:39:02.719748+0000","last_unstale":"2023-12-19T05:39:02.720145+0000","last_undegraded":"2023-12-19T05:39:02.720145+0000","last_fullsized":"2023-12-19T05:39:02.720145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:04.659501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719772+0000","last_change":"2023-12-19T05:39:02.718445+0000","last_active":"2023-12-19T05:39:02.719772+0000","last_peered":"2023-12-19T05:39:02.719772+0000","last_clean":"2023-12-19T05:39:02.719772+0000","last_became_active":"2023-12-19T05:39:02.717751+0000","last_became_peered":"2023-12-19T05:39:02.717751+0000","last_unstale":"2023-12-19T05:39:02.719772+0000","last_undegraded":"2023-12-19T05:39:02.719772+0000","last_fullsized":"2023-12-19T05:39:02.719772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713710+0000","last_change":"2023-12-19T05:39:02.711952+0000","last_active":"2023-12-19T05:39:02.713710+0000","last_peered":"2023-12-19T05:39:02.713710+0000","last_clean":"2023-12-19T05:39:02.713710+0000","last_became_active":"2023-12-19T05:39:02.711582+0000","last_became_peered":"2023-12-19T05:39:02.711582+0000","last_unstale":"2023-12-19T05:39:02.713710+0000","last_undegraded":"2023-12-19T05:39:02.713710+0000","last_fullsized":"2023-12-19T05:39:02.713710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713984+0000","last_change":"2023-12-19T05:39:02.713881+0000","last_active":"2023-12-19T05:39:02.713984+0000","last_peered":"2023-12-19T05:39:02.713984+0000","last_clean":"2023-12-19T05:39:02.713984+0000","last_became_active":"2023-12-19T05:39:02.708835+0000","last_became_peered":"2023-12-19T05:39:02.708835+0000","last_unstale":"2023-12-19T05:39:02.713984+0000","last_undegraded":"2023-12-19T05:39:02.713984+0000","last_fullsized":"2023-12-19T05:39:02.713984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:42:01.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.708630+0000","last_change":"2023-12-19T05:39:02.708098+0000","last_active":"2023-12-19T05:39:02.708630+0000","last_peered":"2023-12-19T05:39:02.708630+0000","last_clean":"2023-12-19T05:39:02.708630+0000","last_became_active":"2023-12-19T05:39:02.707804+0000","last_became_peered":"2023-12-19T05:39:02.707804+0000","last_unstale":"2023-12-19T05:39:02.708630+0000","last_undegraded":"2023-12-19T05:39:02.708630+0000","last_fullsized":"2023-12-19T05:39:02.708630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721098+0000","last_change":"2023-12-19T05:39:02.720287+0000","last_active":"2023-12-19T05:39:02.721098+0000","last_peered":"2023-12-19T05:39:02.721098+0000","last_clean":"2023-12-19T05:39:02.721098+0000","last_became_active":"2023-12-19T05:39:02.720075+0000","last_became_peered":"2023-12-19T05:39:02.720075+0000","last_unstale":"2023-12-19T05:39:02.721098+0000","last_undegraded":"2023-12-19T05:39:02.721098+0000","last_fullsized":"2023-12-19T05:39:02.721098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.648840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719684+0000","last_change":"2023-12-19T05:39:02.719563+0000","last_active":"2023-12-19T05:39:02.719684+0000","last_peered":"2023-12-19T05:39:02.719684+0000","last_clean":"2023-12-19T05:39:02.719684+0000","last_became_active":"2023-12-19T05:39:02.719114+0000","last_became_peered":"2023-12-19T05:39:02.719114+0000","last_unstale":"2023-12-19T05:39:02.719684+0000","last_undegraded":"2023-12-19T05:39:02.719684+0000","last_fullsized":"2023-12-19T05:39:02.719684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727216+0000","last_change":"2023-12-19T05:39:02.200075+0000","last_active":"2023-12-19T05:39:02.727216+0000","last_peered":"2023-12-19T05:39:02.727216+0000","last_clean":"2023-12-19T05:39:02.727216+0000","last_became_active":"2023-12-19T05:39:02.199793+0000","last_became_peered":"2023-12-19T05:39:02.199793+0000","last_unstale":"2023-12-19T05:39:02.727216+0000","last_undegraded":"2023-12-19T05:39:02.727216+0000","last_fullsized":"2023-12-19T05:39:02.727216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711786+0000","last_change":"2023-12-19T05:39:02.711723+0000","last_active":"2023-12-19T05:39:02.711786+0000","last_peered":"2023-12-19T05:39:02.711786+0000","last_clean":"2023-12-19T05:39:02.711786+0000","last_became_active":"2023-12-19T05:39:02.709817+0000","last_became_peered":"2023-12-19T05:39:02.709817+0000","last_unstale":"2023-12-19T05:39:02.711786+0000","last_undegraded":"2023-12-19T05:39:02.711786+0000","last_fullsized":"2023-12-19T05:39:02.711786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722219+0000","last_change":"2023-12-19T05:39:02.197386+0000","last_active":"2023-12-19T05:39:02.722219+0000","last_peered":"2023-12-19T05:39:02.722219+0000","last_clean":"2023-12-19T05:39:02.722219+0000","last_became_active":"2023-12-19T05:39:02.196765+0000","last_became_peered":"2023-12-19T05:39:02.196765+0000","last_unstale":"2023-12-19T05:39:02.722219+0000","last_undegraded":"2023-12-19T05:39:02.722219+0000","last_fullsized":"2023-12-19T05:39:02.722219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:26.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713569+0000","last_change":"2023-12-19T05:39:02.207858+0000","last_active":"2023-12-19T05:39:02.713569+0000","last_peered":"2023-12-19T05:39:02.713569+0000","last_clean":"2023-12-19T05:39:02.713569+0000","last_became_active":"2023-12-19T05:39:02.207598+0000","last_became_peered":"2023-12-19T05:39:02.207598+0000","last_unstale":"2023-12-19T05:39:02.713569+0000","last_undegraded":"2023-12-19T05:39:02.713569+0000","last_fullsized":"2023-12-19T05:39:02.713569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723073+0000","last_change":"2023-12-19T05:39:02.719393+0000","last_active":"2023-12-19T05:39:02.723073+0000","last_peered":"2023-12-19T05:39:02.723073+0000","last_clean":"2023-12-19T05:39:02.723073+0000","last_became_active":"2023-12-19T05:39:02.719080+0000","last_became_peered":"2023-12-19T05:39:02.719080+0000","last_unstale":"2023-12-19T05:39:02.723073+0000","last_undegraded":"2023-12-19T05:39:02.723073+0000","last_fullsized":"2023-12-19T05:39:02.723073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:48.122816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691632+0000","last_change":"2023-12-19T05:39:02.196004+0000","last_active":"2023-12-19T05:39:02.691632+0000","last_peered":"2023-12-19T05:39:02.691632+0000","last_clean":"2023-12-19T05:39:02.691632+0000","last_became_active":"2023-12-19T05:39:02.195753+0000","last_became_peered":"2023-12-19T05:39:02.195753+0000","last_unstale":"2023-12-19T05:39:02.691632+0000","last_undegraded":"2023-12-19T05:39:02.691632+0000","last_fullsized":"2023-12-19T05:39:02.691632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.706164+0000","last_change":"2023-12-19T05:39:02.697790+0000","last_active":"2023-12-19T05:39:02.706164+0000","last_peered":"2023-12-19T05:39:02.706164+0000","last_clean":"2023-12-19T05:39:02.706164+0000","last_became_active":"2023-12-19T05:39:02.697516+0000","last_became_peered":"2023-12-19T05:39:02.697516+0000","last_unstale":"2023-12-19T05:39:02.706164+0000","last_undegraded":"2023-12-19T05:39:02.706164+0000","last_fullsized":"2023-12-19T05:39:02.706164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:47.784594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695035+0000","last_change":"2023-12-19T05:39:02.202291+0000","last_active":"2023-12-19T05:39:02.695035+0000","last_peered":"2023-12-19T05:39:02.695035+0000","last_clean":"2023-12-19T05:39:02.695035+0000","last_became_active":"2023-12-19T05:39:02.202054+0000","last_became_peered":"2023-12-19T05:39:02.202054+0000","last_unstale":"2023-12-19T05:39:02.695035+0000","last_undegraded":"2023-12-19T05:39:02.695035+0000","last_fullsized":"2023-12-19T05:39:02.695035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711851+0000","last_change":"2023-12-19T05:39:02.711262+0000","last_active":"2023-12-19T05:39:02.711851+0000","last_peered":"2023-12-19T05:39:02.711851+0000","last_clean":"2023-12-19T05:39:02.711851+0000","last_became_active":"2023-12-19T05:39:02.710878+0000","last_became_peered":"2023-12-19T05:39:02.710878+0000","last_unstale":"2023-12-19T05:39:02.711851+0000","last_undegraded":"2023-12-19T05:39:02.711851+0000","last_fullsized":"2023-12-19T05:39:02.711851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:26.221286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.702914+0000","last_change":"2023-12-19T05:39:02.203673+0000","last_active":"2023-12-19T05:39:02.702914+0000","last_peered":"2023-12-19T05:39:02.702914+0000","last_clean":"2023-12-19T05:39:02.702914+0000","last_became_active":"2023-12-19T05:39:02.203237+0000","last_became_peered":"2023-12-19T05:39:02.203237+0000","last_unstale":"2023-12-19T05:39:02.702914+0000","last_undegraded":"2023-12-19T05:39:02.702914+0000","last_fullsized":"2023-12-19T05:39:02.702914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:25.209695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.704026+0000","last_change":"2023-12-19T05:39:02.703882+0000","last_active":"2023-12-19T05:39:02.704026+0000","last_peered":"2023-12-19T05:39:02.704026+0000","last_clean":"2023-12-19T05:39:02.704026+0000","last_became_active":"2023-12-19T05:39:02.703208+0000","last_became_peered":"2023-12-19T05:39:02.703208+0000","last_unstale":"2023-12-19T05:39:02.704026+0000","last_undegraded":"2023-12-19T05:39:02.704026+0000","last_fullsized":"2023-12-19T05:39:02.704026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:59:30.435680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719259+0000","last_change":"2023-12-19T05:39:02.204651+0000","last_active":"2023-12-19T05:39:02.719259+0000","last_peered":"2023-12-19T05:39:02.719259+0000","last_clean":"2023-12-19T05:39:02.719259+0000","last_became_active":"2023-12-19T05:39:02.204228+0000","last_became_peered":"2023-12-19T05:39:02.204228+0000","last_unstale":"2023-12-19T05:39:02.719259+0000","last_undegraded":"2023-12-19T05:39:02.719259+0000","last_fullsized":"2023-12-19T05:39:02.719259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715569+0000","last_change":"2023-12-19T05:39:02.715445+0000","last_active":"2023-12-19T05:39:02.715569+0000","last_peered":"2023-12-19T05:39:02.715569+0000","last_clean":"2023-12-19T05:39:02.715569+0000","last_became_active":"2023-12-19T05:39:02.714901+0000","last_became_peered":"2023-12-19T05:39:02.714901+0000","last_unstale":"2023-12-19T05:39:02.715569+0000","last_undegraded":"2023-12-19T05:39:02.715569+0000","last_fullsized":"2023-12-19T05:39:02.715569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:15.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.728240+0000","last_change":"2023-12-19T05:39:02.204185+0000","last_active":"2023-12-19T05:39:02.728240+0000","last_peered":"2023-12-19T05:39:02.728240+0000","last_clean":"2023-12-19T05:39:02.728240+0000","last_became_active":"2023-12-19T05:39:02.203950+0000","last_became_peered":"2023-12-19T05:39:02.203950+0000","last_unstale":"2023-12-19T05:39:02.728240+0000","last_undegraded":"2023-12-19T05:39:02.728240+0000","last_fullsized":"2023-12-19T05:39:02.728240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:42.250249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720718+0000","last_change":"2023-12-19T05:39:02.720607+0000","last_active":"2023-12-19T05:39:02.720718+0000","last_peered":"2023-12-19T05:39:02.720718+0000","last_clean":"2023-12-19T05:39:02.720718+0000","last_became_active":"2023-12-19T05:39:02.720203+0000","last_became_peered":"2023-12-19T05:39:02.720203+0000","last_unstale":"2023-12-19T05:39:02.720718+0000","last_undegraded":"2023-12-19T05:39:02.720718+0000","last_fullsized":"2023-12-19T05:39:02.720718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:25.958108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.716893+0000","last_change":"2023-12-19T05:39:02.208129+0000","last_active":"2023-12-19T05:39:02.716893+0000","last_peered":"2023-12-19T05:39:02.716893+0000","last_clean":"2023-12-19T05:39:02.716893+0000","last_became_active":"2023-12-19T05:39:02.207867+0000","last_became_peered":"2023-12-19T05:39:02.207867+0000","last_unstale":"2023-12-19T05:39:02.716893+0000","last_undegraded":"2023-12-19T05:39:02.716893+0000","last_fullsized":"2023-12-19T05:39:02.716893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719719+0000","last_change":"2023-12-19T05:39:02.717923+0000","last_active":"2023-12-19T05:39:02.719719+0000","last_peered":"2023-12-19T05:39:02.719719+0000","last_clean":"2023-12-19T05:39:02.719719+0000","last_became_active":"2023-12-19T05:39:02.717316+0000","last_became_peered":"2023-12-19T05:39:02.717316+0000","last_unstale":"2023-12-19T05:39:02.719719+0000","last_undegraded":"2023-12-19T05:39:02.719719+0000","last_fullsized":"2023-12-19T05:39:02.719719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689096+0000","last_change":"2023-12-19T05:39:02.205829+0000","last_active":"2023-12-19T05:39:02.689096+0000","last_peered":"2023-12-19T05:39:02.689096+0000","last_clean":"2023-12-19T05:39:02.689096+0000","last_became_active":"2023-12-19T05:39:02.205500+0000","last_became_peered":"2023-12-19T05:39:02.205500+0000","last_unstale":"2023-12-19T05:39:02.689096+0000","last_undegraded":"2023-12-19T05:39:02.689096+0000","last_fullsized":"2023-12-19T05:39:02.689096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713759+0000","last_change":"2023-12-19T05:39:02.713659+0000","last_active":"2023-12-19T05:39:02.713759+0000","last_peered":"2023-12-19T05:39:02.713759+0000","last_clean":"2023-12-19T05:39:02.713759+0000","last_became_active":"2023-12-19T05:39:02.708530+0000","last_became_peered":"2023-12-19T05:39:02.708530+0000","last_unstale":"2023-12-19T05:39:02.713759+0000","last_undegraded":"2023-12-19T05:39:02.713759+0000","last_fullsized":"2023-12-19T05:39:02.713759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.703018+0000","last_change":"2023-12-19T05:39:02.206625+0000","last_active":"2023-12-19T05:39:02.703018+0000","last_peered":"2023-12-19T05:39:02.703018+0000","last_clean":"2023-12-19T05:39:02.703018+0000","last_became_active":"2023-12-19T05:39:02.205495+0000","last_became_peered":"2023-12-19T05:39:02.205495+0000","last_unstale":"2023-12-19T05:39:02.703018+0000","last_undegraded":"2023-12-19T05:39:02.703018+0000","last_fullsized":"2023-12-19T05:39:02.703018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719504+0000","last_change":"2023-12-19T05:39:02.719423+0000","last_active":"2023-12-19T05:39:02.719504+0000","last_peered":"2023-12-19T05:39:02.719504+0000","last_clean":"2023-12-19T05:39:02.719504+0000","last_became_active":"2023-12-19T05:39:02.718789+0000","last_became_peered":"2023-12-19T05:39:02.718789+0000","last_unstale":"2023-12-19T05:39:02.719504+0000","last_undegraded":"2023-12-19T05:39:02.719504+0000","last_fullsized":"2023-12-19T05:39:02.719504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:53.535617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727356+0000","last_change":"2023-12-19T05:39:02.205010+0000","last_active":"2023-12-19T05:39:02.727356+0000","last_peered":"2023-12-19T05:39:02.727356+0000","last_clean":"2023-12-19T05:39:02.727356+0000","last_became_active":"2023-12-19T05:39:02.204535+0000","last_became_peered":"2023-12-19T05:39:02.204535+0000","last_unstale":"2023-12-19T05:39:02.727356+0000","last_undegraded":"2023-12-19T05:39:02.727356+0000","last_fullsized":"2023-12-19T05:39:02.727356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.705289+0000","last_change":"2023-12-19T05:39:02.704511+0000","last_active":"2023-12-19T05:39:02.705289+0000","last_peered":"2023-12-19T05:39:02.705289+0000","last_clean":"2023-12-19T05:39:02.705289+0000","last_became_active":"2023-12-19T05:39:02.704290+0000","last_became_peered":"2023-12-19T05:39:02.704290+0000","last_unstale":"2023-12-19T05:39:02.705289+0000","last_undegraded":"2023-12-19T05:39:02.705289+0000","last_fullsized":"2023-12-19T05:39:02.705289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720875+0000","last_change":"2023-12-19T05:39:02.199274+0000","last_active":"2023-12-19T05:39:02.720875+0000","last_peered":"2023-12-19T05:39:02.720875+0000","last_clean":"2023-12-19T05:39:02.720875+0000","last_became_active":"2023-12-19T05:39:02.198933+0000","last_became_peered":"2023-12-19T05:39:02.198933+0000","last_unstale":"2023-12-19T05:39:02.720875+0000","last_undegraded":"2023-12-19T05:39:02.720875+0000","last_fullsized":"2023-12-19T05:39:02.720875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.710295+0000","last_change":"2023-12-19T05:39:02.709021+0000","last_active":"2023-12-19T05:39:02.710295+0000","last_peered":"2023-12-19T05:39:02.710295+0000","last_clean":"2023-12-19T05:39:02.710295+0000","last_became_active":"2023-12-19T05:39:02.708795+0000","last_became_peered":"2023-12-19T05:39:02.708795+0000","last_unstale":"2023-12-19T05:39:02.710295+0000","last_undegraded":"2023-12-19T05:39:02.710295+0000","last_fullsized":"2023-12-19T05:39:02.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.723471+0000","last_change":"2023-12-19T05:39:02.199887+0000","last_active":"2023-12-19T05:39:02.723471+0000","last_peered":"2023-12-19T05:39:02.723471+0000","last_clean":"2023-12-19T05:39:02.723471+0000","last_became_active":"2023-12-19T05:39:02.199537+0000","last_became_peered":"2023-12-19T05:39:02.199537+0000","last_unstale":"2023-12-19T05:39:02.723471+0000","last_undegraded":"2023-12-19T05:39:02.723471+0000","last_fullsized":"2023-12-19T05:39:02.723471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:25:52.524026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711455+0000","last_change":"2023-12-19T05:39:02.710851+0000","last_active":"2023-12-19T05:39:02.711455+0000","last_peered":"2023-12-19T05:39:02.711455+0000","last_clean":"2023-12-19T05:39:02.711455+0000","last_became_active":"2023-12-19T05:39:02.710608+0000","last_became_peered":"2023-12-19T05:39:02.710608+0000","last_unstale":"2023-12-19T05:39:02.711455+0000","last_undegraded":"2023-12-19T05:39:02.711455+0000","last_fullsized":"2023-12-19T05:39:02.711455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726383+0000","last_change":"2023-12-19T05:39:02.198452+0000","last_active":"2023-12-19T05:39:02.726383+0000","last_peered":"2023-12-19T05:39:02.726383+0000","last_clean":"2023-12-19T05:39:02.726383+0000","last_became_active":"2023-12-19T05:39:02.198025+0000","last_became_peered":"2023-12-19T05:39:02.198025+0000","last_unstale":"2023-12-19T05:39:02.726383+0000","last_undegraded":"2023-12-19T05:39:02.726383+0000","last_fullsized":"2023-12-19T05:39:02.726383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707311+0000","last_change":"2023-12-19T05:39:02.705620+0000","last_active":"2023-12-19T05:39:02.707311+0000","last_peered":"2023-12-19T05:39:02.707311+0000","last_clean":"2023-12-19T05:39:02.707311+0000","last_became_active":"2023-12-19T05:39:02.705414+0000","last_became_peered":"2023-12-19T05:39:02.705414+0000","last_unstale":"2023-12-19T05:39:02.707311+0000","last_undegraded":"2023-12-19T05:39:02.707311+0000","last_fullsized":"2023-12-19T05:39:02.707311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.998729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715348+0000","last_change":"2023-12-19T05:39:02.204412+0000","last_active":"2023-12-19T05:39:02.715348+0000","last_peered":"2023-12-19T05:39:02.715348+0000","last_clean":"2023-12-19T05:39:02.715348+0000","last_became_active":"2023-12-19T05:39:02.204133+0000","last_became_peered":"2023-12-19T05:39:02.204133+0000","last_unstale":"2023-12-19T05:39:02.715348+0000","last_undegraded":"2023-12-19T05:39:02.715348+0000","last_fullsized":"2023-12-19T05:39:02.715348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:13:13.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.696599+0000","last_change":"2023-12-19T05:39:02.696537+0000","last_active":"2023-12-19T05:39:02.696599+0000","last_peered":"2023-12-19T05:39:02.696599+0000","last_clean":"2023-12-19T05:39:02.696599+0000","last_became_active":"2023-12-19T05:39:02.696310+0000","last_became_peered":"2023-12-19T05:39:02.696310+0000","last_unstale":"2023-12-19T05:39:02.696599+0000","last_undegraded":"2023-12-19T05:39:02.696599+0000","last_fullsized":"2023-12-19T05:39:02.696599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:07.565504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.694722+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:39:02.694722+0000","last_peered":"2023-12-19T05:39:02.694722+0000","last_clean":"2023-12-19T05:39:02.694722+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:39:02.694722+0000","last_undegraded":"2023-12-19T05:39:02.694722+0000","last_fullsized":"2023-12-19T05:39:02.694722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.689437+0000","last_change":"2023-12-19T05:39:02.182575+0000","last_active":"2023-12-19T05:39:02.689437+0000","last_peered":"2023-12-19T05:39:02.689437+0000","last_clean":"2023-12-19T05:39:02.689437+0000","last_became_active":"2023-12-19T05:39:02.181960+0000","last_became_peered":"2023-12-19T05:39:02.181960+0000","last_unstale":"2023-12-19T05:39:02.689437+0000","last_undegraded":"2023-12-19T05:39:02.689437+0000","last_fullsized":"2023-12-19T05:39:02.689437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711648+0000","last_change":"2023-12-19T05:39:02.711546+0000","last_active":"2023-12-19T05:39:02.711648+0000","last_peered":"2023-12-19T05:39:02.711648+0000","last_clean":"2023-12-19T05:39:02.711648+0000","last_became_active":"2023-12-19T05:39:02.709082+0000","last_became_peered":"2023-12-19T05:39:02.709082+0000","last_unstale":"2023-12-19T05:39:02.711648+0000","last_undegraded":"2023-12-19T05:39:02.711648+0000","last_fullsized":"2023-12-19T05:39:02.711648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:11.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691936+0000","last_change":"2023-12-19T05:39:02.181596+0000","last_active":"2023-12-19T05:39:02.691936+0000","last_peered":"2023-12-19T05:39:02.691936+0000","last_clean":"2023-12-19T05:39:02.691936+0000","last_became_active":"2023-12-19T05:39:02.179796+0000","last_became_peered":"2023-12-19T05:39:02.179796+0000","last_unstale":"2023-12-19T05:39:02.691936+0000","last_undegraded":"2023-12-19T05:39:02.691936+0000","last_fullsized":"2023-12-19T05:39:02.691936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:00.647065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719756+0000","last_change":"2023-12-19T05:39:02.718299+0000","last_active":"2023-12-19T05:39:02.719756+0000","last_peered":"2023-12-19T05:39:02.719756+0000","last_clean":"2023-12-19T05:39:02.719756+0000","last_became_active":"2023-12-19T05:39:02.717475+0000","last_became_peered":"2023-12-19T05:39:02.717475+0000","last_unstale":"2023-12-19T05:39:02.719756+0000","last_undegraded":"2023-12-19T05:39:02.719756+0000","last_fullsized":"2023-12-19T05:39:02.719756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:40.509884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.701132+0000","last_change":"2023-12-19T05:39:02.205437+0000","last_active":"2023-12-19T05:39:02.701132+0000","last_peered":"2023-12-19T05:39:02.701132+0000","last_clean":"2023-12-19T05:39:02.701132+0000","last_became_active":"2023-12-19T05:39:02.205216+0000","last_became_peered":"2023-12-19T05:39:02.205216+0000","last_unstale":"2023-12-19T05:39:02.701132+0000","last_undegraded":"2023-12-19T05:39:02.701132+0000","last_fullsized":"2023-12-19T05:39:02.701132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.711884+0000","last_change":"2023-12-19T05:39:02.711808+0000","last_active":"2023-12-19T05:39:02.711884+0000","last_peered":"2023-12-19T05:39:02.711884+0000","last_clean":"2023-12-19T05:39:02.711884+0000","last_became_active":"2023-12-19T05:39:02.710838+0000","last_became_peered":"2023-12-19T05:39:02.710838+0000","last_unstale":"2023-12-19T05:39:02.711884+0000","last_undegraded":"2023-12-19T05:39:02.711884+0000","last_fullsized":"2023-12-19T05:39:02.711884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:26:14.824099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.690768+0000","last_change":"2023-12-19T05:39:02.201624+0000","last_active":"2023-12-19T05:39:02.690768+0000","last_peered":"2023-12-19T05:39:02.690768+0000","last_clean":"2023-12-19T05:39:02.690768+0000","last_became_active":"2023-12-19T05:39:02.200272+0000","last_became_peered":"2023-12-19T05:39:02.200272+0000","last_unstale":"2023-12-19T05:39:02.690768+0000","last_undegraded":"2023-12-19T05:39:02.690768+0000","last_fullsized":"2023-12-19T05:39:02.690768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:39.498293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713171+0000","last_change":"2023-12-19T05:39:02.712999+0000","last_active":"2023-12-19T05:39:02.713171+0000","last_peered":"2023-12-19T05:39:02.713171+0000","last_clean":"2023-12-19T05:39:02.713171+0000","last_became_active":"2023-12-19T05:39:02.712612+0000","last_became_peered":"2023-12-19T05:39:02.712612+0000","last_unstale":"2023-12-19T05:39:02.713171+0000","last_undegraded":"2023-12-19T05:39:02.713171+0000","last_fullsized":"2023-12-19T05:39:02.713171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700616+0000","last_change":"2023-12-19T05:39:02.200762+0000","last_active":"2023-12-19T05:39:02.700616+0000","last_peered":"2023-12-19T05:39:02.700616+0000","last_clean":"2023-12-19T05:39:02.700616+0000","last_became_active":"2023-12-19T05:39:02.200452+0000","last_became_peered":"2023-12-19T05:39:02.200452+0000","last_unstale":"2023-12-19T05:39:02.700616+0000","last_undegraded":"2023-12-19T05:39:02.700616+0000","last_fullsized":"2023-12-19T05:39:02.700616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:50:55.480582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721066+0000","last_change":"2023-12-19T05:39:02.719234+0000","last_active":"2023-12-19T05:39:02.721066+0000","last_peered":"2023-12-19T05:39:02.721066+0000","last_clean":"2023-12-19T05:39:02.721066+0000","last_became_active":"2023-12-19T05:39:02.718998+0000","last_became_peered":"2023-12-19T05:39:02.718998+0000","last_unstale":"2023-12-19T05:39:02.721066+0000","last_undegraded":"2023-12-19T05:39:02.721066+0000","last_fullsized":"2023-12-19T05:39:02.721066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:47.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.691685+0000","last_change":"2023-12-19T05:39:02.205628+0000","last_active":"2023-12-19T05:39:02.691685+0000","last_peered":"2023-12-19T05:39:02.691685+0000","last_clean":"2023-12-19T05:39:02.691685+0000","last_became_active":"2023-12-19T05:39:02.205360+0000","last_became_peered":"2023-12-19T05:39:02.205360+0000","last_unstale":"2023-12-19T05:39:02.691685+0000","last_undegraded":"2023-12-19T05:39:02.691685+0000","last_fullsized":"2023-12-19T05:39:02.691685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:04.398918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.725731+0000","last_change":"2023-12-19T05:39:02.725655+0000","last_active":"2023-12-19T05:39:02.725731+0000","last_peered":"2023-12-19T05:39:02.725731+0000","last_clean":"2023-12-19T05:39:02.725731+0000","last_became_active":"2023-12-19T05:39:02.725276+0000","last_became_peered":"2023-12-19T05:39:02.725276+0000","last_unstale":"2023-12-19T05:39:02.725731+0000","last_undegraded":"2023-12-19T05:39:02.725731+0000","last_fullsized":"2023-12-19T05:39:02.725731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:45.290622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:39:04.181770+0000","last_change":"2023-12-19T05:39:02.208157+0000","last_active":"2023-12-19T05:39:04.181770+0000","last_peered":"2023-12-19T05:39:04.181770+0000","last_clean":"2023-12-19T05:39:04.181770+0000","last_became_active":"2023-12-19T05:39:02.207924+0000","last_became_peered":"2023-12-19T05:39:02.207924+0000","last_unstale":"2023-12-19T05:39:04.181770+0000","last_undegraded":"2023-12-19T05:39:04.181770+0000","last_fullsized":"2023-12-19T05:39:04.181770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.720870+0000","last_change":"2023-12-19T05:39:02.719751+0000","last_active":"2023-12-19T05:39:02.720870+0000","last_peered":"2023-12-19T05:39:02.720870+0000","last_clean":"2023-12-19T05:39:02.720870+0000","last_became_active":"2023-12-19T05:39:02.719489+0000","last_became_peered":"2023-12-19T05:39:02.719489+0000","last_unstale":"2023-12-19T05:39:02.720870+0000","last_undegraded":"2023-12-19T05:39:02.720870+0000","last_fullsized":"2023-12-19T05:39:02.720870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:35.338086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.721695+0000","last_change":"2023-12-19T05:39:02.206451+0000","last_active":"2023-12-19T05:39:02.721695+0000","last_peered":"2023-12-19T05:39:02.721695+0000","last_clean":"2023-12-19T05:39:02.721695+0000","last_became_active":"2023-12-19T05:39:02.206070+0000","last_became_peered":"2023-12-19T05:39:02.206070+0000","last_unstale":"2023-12-19T05:39:02.721695+0000","last_undegraded":"2023-12-19T05:39:02.721695+0000","last_fullsized":"2023-12-19T05:39:02.721695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:44.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719332+0000","last_change":"2023-12-19T05:39:02.719256+0000","last_active":"2023-12-19T05:39:02.719332+0000","last_peered":"2023-12-19T05:39:02.719332+0000","last_clean":"2023-12-19T05:39:02.719332+0000","last_became_active":"2023-12-19T05:39:02.718985+0000","last_became_peered":"2023-12-19T05:39:02.718985+0000","last_unstale":"2023-12-19T05:39:02.719332+0000","last_undegraded":"2023-12-19T05:39:02.719332+0000","last_fullsized":"2023-12-19T05:39:02.719332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:26:24.885697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.700486+0000","last_change":"2023-12-19T05:39:02.197504+0000","last_active":"2023-12-19T05:39:02.700486+0000","last_peered":"2023-12-19T05:39:02.700486+0000","last_clean":"2023-12-19T05:39:02.700486+0000","last_became_active":"2023-12-19T05:39:02.197278+0000","last_became_peered":"2023-12-19T05:39:02.197278+0000","last_unstale":"2023-12-19T05:39:02.700486+0000","last_undegraded":"2023-12-19T05:39:02.700486+0000","last_fullsized":"2023-12-19T05:39:02.700486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:13.541297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.697089+0000","last_change":"2023-12-19T05:39:02.696856+0000","last_active":"2023-12-19T05:39:02.697089+0000","last_peered":"2023-12-19T05:39:02.697089+0000","last_clean":"2023-12-19T05:39:02.697089+0000","last_became_active":"2023-12-19T05:39:02.696670+0000","last_became_peered":"2023-12-19T05:39:02.696670+0000","last_unstale":"2023-12-19T05:39:02.697089+0000","last_undegraded":"2023-12-19T05:39:02.697089+0000","last_fullsized":"2023-12-19T05:39:02.697089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:09.761118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.695338+0000","last_change":"2023-12-19T05:39:02.207179+0000","last_active":"2023-12-19T05:39:02.695338+0000","last_peered":"2023-12-19T05:39:02.695338+0000","last_clean":"2023-12-19T05:39:02.695338+0000","last_became_active":"2023-12-19T05:39:02.206926+0000","last_became_peered":"2023-12-19T05:39:02.206926+0000","last_unstale":"2023-12-19T05:39:02.695338+0000","last_undegraded":"2023-12-19T05:39:02.695338+0000","last_fullsized":"2023-12-19T05:39:02.695338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.715781+0000","last_change":"2023-12-19T05:39:02.715604+0000","last_active":"2023-12-19T05:39:02.715781+0000","last_peered":"2023-12-19T05:39:02.715781+0000","last_clean":"2023-12-19T05:39:02.715781+0000","last_became_active":"2023-12-19T05:39:02.715340+0000","last_became_peered":"2023-12-19T05:39:02.715340+0000","last_unstale":"2023-12-19T05:39:02.715781+0000","last_undegraded":"2023-12-19T05:39:02.715781+0000","last_fullsized":"2023-12-19T05:39:02.715781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.714039+0000","last_change":"2023-12-19T05:39:02.196514+0000","last_active":"2023-12-19T05:39:02.714039+0000","last_peered":"2023-12-19T05:39:02.714039+0000","last_clean":"2023-12-19T05:39:02.714039+0000","last_became_active":"2023-12-19T05:39:02.195884+0000","last_became_peered":"2023-12-19T05:39:02.195884+0000","last_unstale":"2023-12-19T05:39:02.714039+0000","last_undegraded":"2023-12-19T05:39:02.714039+0000","last_fullsized":"2023-12-19T05:39:02.714039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:29.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.719903+0000","last_change":"2023-12-19T05:39:02.719822+0000","last_active":"2023-12-19T05:39:02.719903+0000","last_peered":"2023-12-19T05:39:02.719903+0000","last_clean":"2023-12-19T05:39:02.719903+0000","last_became_active":"2023-12-19T05:39:02.719603+0000","last_became_peered":"2023-12-19T05:39:02.719603+0000","last_unstale":"2023-12-19T05:39:02.719903+0000","last_undegraded":"2023-12-19T05:39:02.719903+0000","last_fullsized":"2023-12-19T05:39:02.719903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:35:05.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.722064+0000","last_change":"2023-12-19T05:39:02.180788+0000","last_active":"2023-12-19T05:39:02.722064+0000","last_peered":"2023-12-19T05:39:02.722064+0000","last_clean":"2023-12-19T05:39:02.722064+0000","last_became_active":"2023-12-19T05:39:02.180068+0000","last_became_peered":"2023-12-19T05:39:02.180068+0000","last_unstale":"2023-12-19T05:39:02.722064+0000","last_undegraded":"2023-12-19T05:39:02.722064+0000","last_fullsized":"2023-12-19T05:39:02.722064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:10:46.441456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.698331+0000","last_change":"2023-12-19T05:39:02.698107+0000","last_active":"2023-12-19T05:39:02.698331+0000","last_peered":"2023-12-19T05:39:02.698331+0000","last_clean":"2023-12-19T05:39:02.698331+0000","last_became_active":"2023-12-19T05:39:02.696242+0000","last_became_peered":"2023-12-19T05:39:02.696242+0000","last_unstale":"2023-12-19T05:39:02.698331+0000","last_undegraded":"2023-12-19T05:39:02.698331+0000","last_fullsized":"2023-12-19T05:39:02.698331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:54:02.321013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.709142+0000","last_change":"2023-12-19T05:39:02.709072+0000","last_active":"2023-12-19T05:39:02.709142+0000","last_peered":"2023-12-19T05:39:02.709142+0000","last_clean":"2023-12-19T05:39:02.709142+0000","last_became_active":"2023-12-19T05:39:02.708202+0000","last_became_peered":"2023-12-19T05:39:02.708202+0000","last_unstale":"2023-12-19T05:39:02.709142+0000","last_undegraded":"2023-12-19T05:39:02.709142+0000","last_fullsized":"2023-12-19T05:39:02.709142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:49:06.421553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713469+0000","last_change":"2023-12-19T05:39:02.204748+0000","last_active":"2023-12-19T05:39:02.713469+0000","last_peered":"2023-12-19T05:39:02.713469+0000","last_clean":"2023-12-19T05:39:02.713469+0000","last_became_active":"2023-12-19T05:39:02.203115+0000","last_became_peered":"2023-12-19T05:39:02.203115+0000","last_unstale":"2023-12-19T05:39:02.713469+0000","last_undegraded":"2023-12-19T05:39:02.713469+0000","last_fullsized":"2023-12-19T05:39:02.713469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.707208+0000","last_change":"2023-12-19T05:39:02.706972+0000","last_active":"2023-12-19T05:39:02.707208+0000","last_peered":"2023-12-19T05:39:02.707208+0000","last_clean":"2023-12-19T05:39:02.707208+0000","last_became_active":"2023-12-19T05:39:02.702711+0000","last_became_peered":"2023-12-19T05:39:02.702711+0000","last_unstale":"2023-12-19T05:39:02.707208+0000","last_undegraded":"2023-12-19T05:39:02.707208+0000","last_fullsized":"2023-12-19T05:39:02.707208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:01.658656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.713207+0000","last_change":"2023-12-19T05:39:02.207008+0000","last_active":"2023-12-19T05:39:02.713207+0000","last_peered":"2023-12-19T05:39:02.713207+0000","last_clean":"2023-12-19T05:39:02.713207+0000","last_became_active":"2023-12-19T05:39:02.204154+0000","last_became_peered":"2023-12-19T05:39:02.204154+0000","last_unstale":"2023-12-19T05:39:02.713207+0000","last_undegraded":"2023-12-19T05:39:02.713207+0000","last_fullsized":"2023-12-19T05:39:02.713207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:03.347721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718496+0000","last_change":"2023-12-19T05:39:02.714964+0000","last_active":"2023-12-19T05:39:02.718496+0000","last_peered":"2023-12-19T05:39:02.718496+0000","last_clean":"2023-12-19T05:39:02.718496+0000","last_became_active":"2023-12-19T05:39:02.713835+0000","last_became_peered":"2023-12-19T05:39:02.713835+0000","last_unstale":"2023-12-19T05:39:02.718496+0000","last_undegraded":"2023-12-19T05:39:02.718496+0000","last_fullsized":"2023-12-19T05:39:02.718496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:02.237341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.726982+0000","last_change":"2023-12-19T05:39:02.203295+0000","last_active":"2023-12-19T05:39:02.726982+0000","last_peered":"2023-12-19T05:39:02.726982+0000","last_clean":"2023-12-19T05:39:02.726982+0000","last_became_active":"2023-12-19T05:39:02.202955+0000","last_became_peered":"2023-12-19T05:39:02.202955+0000","last_unstale":"2023-12-19T05:39:02.726982+0000","last_undegraded":"2023-12-19T05:39:02.726982+0000","last_fullsized":"2023-12-19T05:39:02.726982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:36:02.296037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.718442+0000","last_change":"2023-12-19T05:39:02.714203+0000","last_active":"2023-12-19T05:39:02.718442+0000","last_peered":"2023-12-19T05:39:02.718442+0000","last_clean":"2023-12-19T05:39:02.718442+0000","last_became_active":"2023-12-19T05:39:02.713955+0000","last_became_peered":"2023-12-19T05:39:02.713955+0000","last_unstale":"2023-12-19T05:39:02.718442+0000","last_undegraded":"2023-12-19T05:39:02.718442+0000","last_fullsized":"2023-12-19T05:39:02.718442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:02.163677+0000","last_clean_scrub_stamp":"2023-12-19T05:39:02.163677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:24:58.392102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:39:02.727404+0000","last_change":"2023-12-19T05:39:02.202067+0000","last_active":"2023-12-19T05:39:02.727404+0000","last_peered":"2023-12-19T05:39:02.727404+0000","last_clean":"2023-12-19T05:39:02.727404+0000","last_became_active":"2023-12-19T05:39:02.201662+0000","last_became_peered":"2023-12-19T05:39:02.201662+0000","last_unstale":"2023-12-19T05:39:02.727404+0000","last_undegraded":"2023-12-19T05:39:02.727404+0000","last_fullsized":"2023-12-19T05:39:02.727404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:01.152086+0000","last_clean_scrub_stamp":"2023-12-19T05:39:01.152086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:53:26.145895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.992}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0539999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T05:39:19.013 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T05:39:19.014 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T05:39:19.014 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T05:39:19.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T05:39:19.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.281+0000 7f4959a54640 1 Processor -- start 2023-12-19T05:39:19.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.281+0000 7f4959a54640 1 -- start start 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.282+0000 7f4959a54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4959a54640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49540cdbf0 0x7f49540ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4959a54640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495415ec30 con 0x7f495415e5a0 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4959a54640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49540ce5c0 con 0x7f49540cdbf0 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4959a54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495415fbc0 con 0x7f49540b2030 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4958a52640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f495415e5a0 0x7f49540b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41298/0 (socket says 172.21.15.49:41298) 2023-12-19T05:39:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4958a52640 1 -- 172.21.15.49:0/3905830338 learned_addr learned my addr 172.21.15.49:0/3905830338 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4959253640 1 --2- 172.21.15.49:0/3905830338 >> v2:172.21.15.115:3300/0 conn(0x7f49540cdbf0 0x7f49540ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.283+0000 7f4953fff640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881256418 0 0) 0x7f495415ec30 con 0x7f495415e5a0 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4944003520 con 0x7f495415e5a0 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f4959253640 1 -- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 msgr2=0x7f495415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547126031 0 0) 0x7f4944003520 con 0x7f495415e5a0 2023-12-19T05:39:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f4959253640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f4959253640 1 -- 172.21.15.49:0/3905830338 >> v1:172.21.15.49:6789/0 conn(0x7f495415e5a0 legacy=0x7f49540b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f4959253640 1 -- 172.21.15.49:0/3905830338 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495415e980 con 0x7f49540cdbf0 2023-12-19T05:39:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.284+0000 7f4953fff640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.285+0000 7f4959253640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49540cdbf0 0x7f49540ce080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f494c009d90 tx=0x7f494c02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63e9605d4df89ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.290+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948001670 con 0x7f49540cdbf0 2023-12-19T05:39:19.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.290+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c02c8a0 con 0x7f49540cdbf0 2023-12-19T05:39:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.290+0000 7f49537fe640 1 -- 172.21.15.49:0/3905830338 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c02cc10 con 0x7f49540cdbf0 2023-12-19T05:39:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 -- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49540cdbf0 msgr2=0x7f49540ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49540cdbf0 0x7f49540ce080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f494c009d90 tx=0x7f494c02bd70 comp rx=0 tx=0).stop 2023-12-19T05:39:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 -- 172.21.15.49:0/3905830338 shutdown_connections 2023-12-19T05:39:19.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 --2- 172.21.15.49:0/3905830338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49540cdbf0 0x7f49540ce080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 -- 172.21.15.49:0/3905830338 >> 172.21.15.49:0/3905830338 conn(0x7f49540b0100 msgr2=0x7f49540b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 -- 172.21.15.49:0/3905830338 shutdown_connections 2023-12-19T05:39:19.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.291+0000 7f4959a54640 1 -- 172.21.15.49:0/3905830338 wait complete. 2023-12-19T05:39:19.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.293+0000 7f4959a54640 1 Processor -- start 2023-12-19T05:39:19.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.293+0000 7f4959a54640 1 -- start start 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495414ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 0x7f495406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495414c080 con 0x7f49540cdbf0 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495414c360 con 0x7f495415e5a0 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4959a54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495414c640 con 0x7f49540b2030 2023-12-19T05:39:19.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4953fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4953fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34014/0 (socket says 172.21.15.49:34014) 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.294+0000 7f4953fff640 1 -- 172.21.15.49:0/2064170404 learned_addr learned my addr 172.21.15.49:0/2064170404 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4958a52640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495414ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4959253640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 0x7f495406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 -- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 msgr2=0x7f495414ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495414ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 -- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 msgr2=0x7f495406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 0x7f495406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 -- 172.21.15.49:0/2064170404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940009400 con 0x7f49540cdbf0 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4959253640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 0x7f495406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f4953fff640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f494000e960 tx=0x7f494000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.295+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000ca00 con 0x7f49540cdbf0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.296+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000cb60 con 0x7f49540cdbf0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.296+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940013470 con 0x7f49540cdbf0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.296+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c009a70 con 0x7f49540cdbf0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.296+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495415a2c0 con 0x7f49540cdbf0 2023-12-19T05:39:19.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.297+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4954061910 con 0x7f49540cdbf0 2023-12-19T05:39:19.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.298+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f49400135d0 con 0x7f49540cdbf0 2023-12-19T05:39:19.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.299+0000 7f49517fa640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 0x7f493806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.299+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4940088be0 con 0x7f49540cdbf0 2023-12-19T05:39:19.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.299+0000 7f4958a52640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 0x7f493806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.301+0000 7f4958a52640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 0x7f493806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49480011e0 tx=0x7f4948009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.303+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4940054130 con 0x7f49540cdbf0 2023-12-19T05:39:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.528+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f495414c1c0 con 0x7f49540cdbf0 2023-12-19T05:39:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.528+0000 7f49517fa640 1 -- 172.21.15.49:0/2064170404 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f495414c1c0 con 0x7f49540cdbf0 2023-12-19T05:39:19.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:19.530 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 msgr2=0x7f493806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 0x7f493806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49480011e0 tx=0x7f4948009040 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 msgr2=0x7f4954159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f494000e960 tx=0x7f494000ee20 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 shutdown_connections 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493806a460 0x7f493806c920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f495415e5a0 0x7f495406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.530+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49540cdbf0 0x7f4954159d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.531+0000 7f4959a54640 1 --2- 172.21.15.49:0/2064170404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49540b2030 0x7f495414ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.531+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 >> 172.21.15.49:0/2064170404 conn(0x7f49540b0100 msgr2=0x7f495406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.531+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 shutdown_connections 2023-12-19T05:39:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.531+0000 7f4959a54640 1 -- 172.21.15.49:0/2064170404 wait complete. 2023-12-19T05:39:19.551 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T05:39:19.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.749+0000 7fe90ca25640 1 Processor -- start 2023-12-19T05:39:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.749+0000 7fe90ca25640 1 -- start start 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe90815f680 0x7fe9080b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 0x7fe9080ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080ce5c0 con 0x7fe90815f680 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90815ec30 con 0x7fe9080cdbf0 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe90ca25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b2cc0 con 0x7fe90815e5a0 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe8feffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe90815f680 0x7fe9080b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe8feffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe90815f680 0x7fe9080b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34020/0 (socket says 172.21.15.49:34020) 2023-12-19T05:39:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.751+0000 7fe8feffd640 1 -- 172.21.15.49:0/2700038982 learned_addr learned my addr 172.21.15.49:0/2700038982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe9077fe640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe907fff640 1 --2- 172.21.15.49:0/2700038982 >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 0x7fe9080ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe8feffd640 1 -- 172.21.15.49:0/2700038982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 msgr2=0x7fe9080b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe8feffd640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe8feffd640 1 -- 172.21.15.49:0/2700038982 >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 msgr2=0x7fe9080ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe8feffd640 1 --2- 172.21.15.49:0/2700038982 >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 0x7fe9080ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe8feffd640 1 -- 172.21.15.49:0/2700038982 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90815e980 con 0x7fe90815f680 2023-12-19T05:39:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.752+0000 7fe907fff640 1 --2- 172.21.15.49:0/2700038982 >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 0x7fe9080ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.753+0000 7fe8feffd640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9080b2780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9080711b0 tx=0x7fe8f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63551fb3460d16a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.753+0000 7fe906ffd640 1 -- 172.21.15.49:0/2700038982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002ca70 con 0x7fe90815f680 2023-12-19T05:39:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.753+0000 7fe906ffd640 1 -- 172.21.15.49:0/2700038982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f002cbd0 con 0x7fe90815f680 2023-12-19T05:39:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.753+0000 7fe906ffd640 1 -- 172.21.15.49:0/2700038982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00343f0 con 0x7fe90815f680 2023-12-19T05:39:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 -- 172.21.15.49:0/2700038982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 msgr2=0x7fe9080b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9080b2780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9080711b0 tx=0x7fe8f002bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 -- 172.21.15.49:0/2700038982 shutdown_connections 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 --2- 172.21.15.49:0/2700038982 >> v2:172.21.15.115:3300/0 conn(0x7fe9080cdbf0 0x7fe9080ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9080b2780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 --2- 172.21.15.49:0/2700038982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 -- 172.21.15.49:0/2700038982 >> 172.21.15.49:0/2700038982 conn(0x7fe9080b0100 msgr2=0x7fe9080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 -- 172.21.15.49:0/2700038982 shutdown_connections 2023-12-19T05:39:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.754+0000 7fe90ca25640 1 -- 172.21.15.49:0/2700038982 wait complete. 2023-12-19T05:39:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.756+0000 7fe90ca25640 1 Processor -- start 2023-12-19T05:39:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.756+0000 7fe90ca25640 1 -- start start 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 0x7fe90815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90815d3e0 con 0x7fe90815f680 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908150d50 con 0x7fe9080cdbf0 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe90ca25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe908151bb0 con 0x7fe90815e5a0 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34026/0 (socket says 172.21.15.49:34026) 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 -- 172.21.15.49:0/3434212238 learned_addr learned my addr 172.21.15.49:0/3434212238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe8feffd640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe9077fe640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 0x7fe90815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 -- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 msgr2=0x7fe9080ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 -- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 msgr2=0x7fe90815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 0x7fe90815cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe907fff640 1 -- 172.21.15.49:0/3434212238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009b30 con 0x7fe90815f680 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.757+0000 7fe9077fe640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 0x7fe90815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe907fff640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c820 tx=0x7fe90000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900007a30 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe900007b90 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000ce10 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908150fa0 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.758+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe908151560 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.759+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908061910 con 0x7fe90815f680 2023-12-19T05:39:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.760+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe9000113f0 con 0x7fe90815f680 2023-12-19T05:39:19.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.761+0000 7fe904ff9640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 0x7fe8e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.761+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe900088b00 con 0x7fe90815f680 2023-12-19T05:39:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.762+0000 7fe9077fe640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 0x7fe8e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.763+0000 7fe9077fe640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 0x7fe8e806c920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8006fd0 tx=0x7fe8f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.765+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe900054050 con 0x7fe90815f680 2023-12-19T05:39:19.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.951+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe908151cf0 con 0x7fe90815f680 2023-12-19T05:39:19.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.952+0000 7fe904ff9640 1 -- 172.21.15.49:0/3434212238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fe90001f090 con 0x7fe90815f680 2023-12-19T05:39:19.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:19.954 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 msgr2=0x7fe8e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 0x7fe8e806c920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8006fd0 tx=0x7fe8f8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 msgr2=0x7fe9081f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c820 tx=0x7fe90000cce0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 shutdown_connections 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe8e806a460 0x7fe8e806c920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe90815e5a0 0x7fe9080ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90815f680 0x7fe9081f3bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 --2- 172.21.15.49:0/3434212238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9080cdbf0 0x7fe90815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.955+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 >> 172.21.15.49:0/3434212238 conn(0x7fe9080b0100 msgr2=0x7fe9080b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.956+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 shutdown_connections 2023-12-19T05:39:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:19.956+0000 7fe90ca25640 1 -- 172.21.15.49:0/3434212238 wait complete. 2023-12-19T05:39:19.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:19.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.204+0000 7fb72c648640 1 Processor -- start 2023-12-19T05:39:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.205+0000 7fb72c648640 1 -- start start 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.206+0000 7fb72c648640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb724161700 0x7fb7240cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.206+0000 7fb72c648640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb7240b1830 0x7fb7240b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.206+0000 7fb72c648640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7240cc530 con 0x7fb7240b21e0 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.206+0000 7fb72c648640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb724166300 con 0x7fb724161700 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.206+0000 7fb72c648640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240cb920 con 0x7fb7240b1830 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb724161700 0x7fb7240cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb724161700 0x7fb7240cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34038/0 (socket says 172.21.15.49:34038) 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 -- 172.21.15.49:0/982166993 learned_addr learned my addr 172.21.15.49:0/982166993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72abe5640 1 --1- 172.21.15.49:0/982166993 >> v1:172.21.15.49:6789/0 conn(0x7fb7240b21e0 0x7fb7240b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41304/0 (socket says 172.21.15.49:41304) 2023-12-19T05:39:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb729be3640 1 --2- 172.21.15.49:0/982166993 >> v2:172.21.15.115:3300/0 conn(0x7fb7240b1830 0x7fb7240b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 -- 172.21.15.49:0/982166993 >> v2:172.21.15.115:3300/0 conn(0x7fb7240b1830 msgr2=0x7fb7240b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 --2- 172.21.15.49:0/982166993 >> v2:172.21.15.115:3300/0 conn(0x7fb7240b1830 0x7fb7240b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 -- 172.21.15.49:0/982166993 >> v1:172.21.15.49:6789/0 conn(0x7fb7240b21e0 legacy=0x7fb7240b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb72a3e4640 1 -- 172.21.15.49:0/982166993 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7240cbc00 con 0x7fb724161700 2023-12-19T05:39:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.207+0000 7fb7293e2640 1 -- 172.21.15.49:0/982166993 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170638303 0 0) 0x7fb7240cc530 con 0x7fb7240b21e0 2023-12-19T05:39:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.208+0000 7fb72a3e4640 1 --2- 172.21.15.49:0/982166993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb724161700 0x7fb7240cc9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb7240b1560 tx=0x7fb72002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af15df54cdb2d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb7293e2640 1 -- 172.21.15.49:0/982166993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720030860 con 0x7fb724161700 2023-12-19T05:39:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb7293e2640 1 -- 172.21.15.49:0/982166993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7200309c0 con 0x7fb724161700 2023-12-19T05:39:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb7293e2640 1 -- 172.21.15.49:0/982166993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720030d50 con 0x7fb724161700 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 -- 172.21.15.49:0/982166993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb724161700 msgr2=0x7fb7240cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 --2- 172.21.15.49:0/982166993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb724161700 0x7fb7240cc9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb7240b1560 tx=0x7fb72002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 -- 172.21.15.49:0/982166993 shutdown_connections 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 --2- 172.21.15.49:0/982166993 >> v2:172.21.15.115:3300/0 conn(0x7fb7240b1830 0x7fb7240b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 --2- 172.21.15.49:0/982166993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb724161700 0x7fb7240cc9c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 -- 172.21.15.49:0/982166993 >> 172.21.15.49:0/982166993 conn(0x7fb724073150 msgr2=0x7fb7240659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.209+0000 7fb72c648640 1 -- 172.21.15.49:0/982166993 shutdown_connections 2023-12-19T05:39:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.210+0000 7fb72c648640 1 -- 172.21.15.49:0/982166993 wait complete. 2023-12-19T05:39:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.211+0000 7fb72c648640 1 Processor -- start 2023-12-19T05:39:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.211+0000 7fb72c648640 1 -- start start 2023-12-19T05:39:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7240b1830 0x7fb724152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb724161700 0x7fb724142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72406d050 con 0x7fb7240b21e0 2023-12-19T05:39:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72406c440 con 0x7fb7240b1830 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.212+0000 7fb72c648640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72406c720 con 0x7fb724161700 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34044/0 (socket says 172.21.15.49:34044) 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 -- 172.21.15.49:0/2880685935 learned_addr learned my addr 172.21.15.49:0/2880685935 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb72a3e4640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7240b1830 0x7fb724152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 -- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb724161700 msgr2=0x7fb724142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb724161700 0x7fb724142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 -- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7240b1830 msgr2=0x7fb724152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7240b1830 0x7fb724152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 -- 172.21.15.49:0/2880685935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200094d0 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.213+0000 7fb729be3640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb71400d800 tx=0x7fb71400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.214+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400b6c0 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.214+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400b820 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.214+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400bbb0 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.214+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72406ca00 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.214+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb724142760 con 0x7fb7240b21e0 2023-12-19T05:39:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.215+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb724061910 con 0x7fb7240b21e0 2023-12-19T05:39:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.216+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb71400bd10 con 0x7fb7240b21e0 2023-12-19T05:39:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.217+0000 7fb71affd640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 0x7fb70806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.217+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb714088eb0 con 0x7fb7240b21e0 2023-12-19T05:39:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.218+0000 7fb72a3e4640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 0x7fb70806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.219+0000 7fb72a3e4640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 0x7fb70806c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb720036000 tx=0x7fb72003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.222+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb7140544a0 con 0x7fb7240b21e0 2023-12-19T05:39:20.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.419+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7240b1610 con 0x7fb7240b21e0 2023-12-19T05:39:20.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.420+0000 7fb71affd640 1 -- 172.21.15.49:0/2880685935 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb714057ac0 con 0x7fb7240b21e0 2023-12-19T05:39:20.421 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:20.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 msgr2=0x7fb70806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 0x7fb70806c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb720036000 tx=0x7fb72003b040 comp rx=0 tx=0).stop 2023-12-19T05:39:20.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 msgr2=0x7fb724141ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb71400d800 tx=0x7fb71400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 shutdown_connections 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb70806a430 0x7fb70806c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb724161700 0x7fb724142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7240b21e0 0x7fb724141ce0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 --2- 172.21.15.49:0/2880685935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7240b1830 0x7fb724152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 >> 172.21.15.49:0/2880685935 conn(0x7fb724073150 msgr2=0x7fb724163e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 shutdown_connections 2023-12-19T05:39:20.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.423+0000 7fb72c648640 1 -- 172.21.15.49:0/2880685935 wait complete. 2023-12-19T05:39:20.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.668+0000 7f0583542640 1 Processor -- start 2023-12-19T05:39:20.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.668+0000 7f0583542640 1 -- start start 2023-12-19T05:39:20.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f057c157710 0x7f057c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b2990 0x7f057c0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 0x7f057c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0b0c80 con 0x7f057c157710 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c15d7d0 con 0x7f057c0b0830 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0583542640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0b2ea0 con 0x7f057c0b2990 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0582540640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f057c157710 0x7f057c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0582540640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f057c157710 0x7f057c0b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34060/0 (socket says 172.21.15.49:34060) 2023-12-19T05:39:20.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.670+0000 7f0582540640 1 -- 172.21.15.49:0/3806699342 learned_addr learned my addr 172.21.15.49:0/3806699342 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0581d3f640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b2990 0x7f057c0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582d41640 1 --2- 172.21.15.49:0/3806699342 >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 0x7f057c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582540640 1 -- 172.21.15.49:0/3806699342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b2990 msgr2=0x7f057c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582540640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b2990 0x7f057c0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582540640 1 -- 172.21.15.49:0/3806699342 >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 msgr2=0x7f057c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582540640 1 --2- 172.21.15.49:0/3806699342 >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 0x7f057c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582540640 1 -- 172.21.15.49:0/3806699342 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c15da90 con 0x7f057c157710 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.671+0000 7f0582d41640 1 --2- 172.21.15.49:0/3806699342 >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 0x7f057c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:20.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.672+0000 7f0582540640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c0b2450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0fb0 tx=0x7f057802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2790afea7a0c109 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.672+0000 7f058153e640 1 -- 172.21.15.49:0/3806699342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578031750 con 0x7f057c157710 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.672+0000 7f058153e640 1 -- 172.21.15.49:0/3806699342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05780318b0 con 0x7f057c157710 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.672+0000 7f058153e640 1 -- 172.21.15.49:0/3806699342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578031c40 con 0x7f057c157710 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 -- 172.21.15.49:0/3806699342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 msgr2=0x7f057c0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c0b2450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0fb0 tx=0x7f057802b7f0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 -- 172.21.15.49:0/3806699342 shutdown_connections 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 --2- 172.21.15.49:0/3806699342 >> v2:172.21.15.115:3300/0 conn(0x7f057c0b0830 0x7f057c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b2990 0x7f057c0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 --2- 172.21.15.49:0/3806699342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c0b2450 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 -- 172.21.15.49:0/3806699342 >> 172.21.15.49:0/3806699342 conn(0x7f057c0659a0 msgr2=0x7f057c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 -- 172.21.15.49:0/3806699342 shutdown_connections 2023-12-19T05:39:20.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.673+0000 7f0583542640 1 -- 172.21.15.49:0/3806699342 wait complete. 2023-12-19T05:39:20.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.675+0000 7f0583542640 1 Processor -- start 2023-12-19T05:39:20.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.675+0000 7f0583542640 1 -- start start 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b0830 0x7f057c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 0x7f057c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15a040 con 0x7f057c157710 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c1591b0 con 0x7f057c0b2990 2023-12-19T05:39:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0583542640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c159430 con 0x7f057c0b0830 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.676+0000 7f0582d41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34074/0 (socket says 172.21.15.49:34074) 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 -- 172.21.15.49:0/1169766589 learned_addr learned my addr 172.21.15.49:0/1169766589 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0581d3f640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 0x7f057c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582540640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b0830 0x7f057c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 -- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b0830 msgr2=0x7f057c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b0830 0x7f057c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 -- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 msgr2=0x7f057c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 0x7f057c158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 -- 172.21.15.49:0/1169766589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780094d0 con 0x7f057c157710 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0581d3f640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 0x7f057c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.677+0000 7f0582d41640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f057400cef0 tx=0x7f057400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.678+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400d840 con 0x7f057c157710 2023-12-19T05:39:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.678+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400d9a0 con 0x7f057c157710 2023-12-19T05:39:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.678+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c159710 con 0x7f057c157710 2023-12-19T05:39:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.678+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400dd50 con 0x7f057c157710 2023-12-19T05:39:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.678+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c159cd0 con 0x7f057c157710 2023-12-19T05:39:20.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.679+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c15a1f0 con 0x7f057c157710 2023-12-19T05:39:20.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.680+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f057401e3b0 con 0x7f057c157710 2023-12-19T05:39:20.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.681+0000 7f056effd640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 0x7f056006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.682+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05740893a0 con 0x7f057c157710 2023-12-19T05:39:20.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.682+0000 7f0582540640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 0x7f056006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.683+0000 7f0582540640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 0x7f056006c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0578035000 tx=0x7f0578008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.685+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f057c15a1f0 con 0x7f057c157710 2023-12-19T05:39:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.878+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f057c061910 con 0x7f057c157710 2023-12-19T05:39:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.879+0000 7f056effd640 1 -- 172.21.15.49:0/1169766589 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05740548f0 con 0x7f057c157710 2023-12-19T05:39:20.881 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 msgr2=0x7f056006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 0x7f056006c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0578035000 tx=0x7f0578008030 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 msgr2=0x7f057c14fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f057400cef0 tx=0x7f057400a710 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 shutdown_connections 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056006a460 0x7f056006c920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f057c157710 0x7f057c14fa40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f057c0b2990 0x7f057c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 --2- 172.21.15.49:0/1169766589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f057c0b0830 0x7f057c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 >> 172.21.15.49:0/1169766589 conn(0x7f057c0659a0 msgr2=0x7f057c0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 shutdown_connections 2023-12-19T05:39:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:20.882+0000 7f0583542640 1 -- 172.21.15.49:0/1169766589 wait complete. 2023-12-19T05:39:20.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:21.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.144+0000 7fa95c0f7640 1 Processor -- start 2023-12-19T05:39:21.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.145+0000 7fa95c0f7640 1 -- start start 2023-12-19T05:39:21.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.146+0000 7fa95c0f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa9540d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.146+0000 7fa95c0f7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9540b6430 0x7fa95415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.146+0000 7fa95c0f7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa954161e70 con 0x7fa954146ff0 2023-12-19T05:39:21.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.146+0000 7fa95c0f7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa954161080 con 0x7fa9540b6430 2023-12-19T05:39:21.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.146+0000 7fa95c0f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa954161260 con 0x7fa95406fc40 2023-12-19T05:39:21.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9540b6430 0x7fa95415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9540b6430 0x7fa95415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34086/0 (socket says 172.21.15.49:34086) 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 -- 172.21.15.49:0/4183369454 learned_addr learned my addr 172.21.15.49:0/4183369454 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa959692640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa9540d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 -- 172.21.15.49:0/4183369454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 msgr2=0x7fa9540d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa9540d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 -- 172.21.15.49:0/4183369454 >> v1:172.21.15.115:6789/0 conn(0x7fa954146ff0 legacy=0x7fa95406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.147+0000 7fa95a694640 1 -- 172.21.15.49:0/4183369454 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954161540 con 0x7fa9540b6430 2023-12-19T05:39:21.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.148+0000 7fa95a694640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9540b6430 0x7fa95415dd40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e50 tx=0x7fa94c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78f1bdf8aa4dab4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa958e91640 1 -- 172.21.15.49:0/4183369454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c02ca70 con 0x7fa9540b6430 2023-12-19T05:39:21.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa958e91640 1 -- 172.21.15.49:0/4183369454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c02cbd0 con 0x7fa9540b6430 2023-12-19T05:39:21.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa958e91640 1 -- 172.21.15.49:0/4183369454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0343f0 con 0x7fa9540b6430 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 -- 172.21.15.49:0/4183369454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9540b6430 msgr2=0x7fa95415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9540b6430 0x7fa95415dd40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e50 tx=0x7fa94c02bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 -- 172.21.15.49:0/4183369454 shutdown_connections 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa9540d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/4183369454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9540b6430 0x7fa95415dd40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 -- 172.21.15.49:0/4183369454 >> 172.21.15.49:0/4183369454 conn(0x7fa9540d3520 msgr2=0x7fa9540d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.149+0000 7fa95c0f7640 1 -- 172.21.15.49:0/4183369454 shutdown_connections 2023-12-19T05:39:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.150+0000 7fa95c0f7640 1 -- 172.21.15.49:0/4183369454 wait complete. 2023-12-19T05:39:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.151+0000 7fa95c0f7640 1 Processor -- start 2023-12-19T05:39:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.151+0000 7fa95c0f7640 1 -- start start 2023-12-19T05:39:21.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa95415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9540b6430 0x7fa95413b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954140050 con 0x7fa954146ff0 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95413bfe0 con 0x7fa9540b6430 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.152+0000 7fa95c0f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9541f6030 con 0x7fa95406fc40 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34094/0 (socket says 172.21.15.49:34094) 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 -- 172.21.15.49:0/3948946892 learned_addr learned my addr 172.21.15.49:0/3948946892 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa959692640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9540b6430 0x7fa95413b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa959e93640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa95415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 -- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 msgr2=0x7fa95415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa95415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 -- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9540b6430 msgr2=0x7fa95413b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9540b6430 0x7fa95413b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.153+0000 7fa95a694640 1 -- 172.21.15.49:0/3948946892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009b30 con 0x7fa954146ff0 2023-12-19T05:39:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa95a694640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e50 tx=0x7fa94c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c009510 con 0x7fa954146ff0 2023-12-19T05:39:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c03e450 con 0x7fa954146ff0 2023-12-19T05:39:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c03e800 con 0x7fa954146ff0 2023-12-19T05:39:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9541f6310 con 0x7fa954146ff0 2023-12-19T05:39:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.154+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9541f68d0 con 0x7fa954146ff0 2023-12-19T05:39:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.155+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95413c200 con 0x7fa954146ff0 2023-12-19T05:39:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.156+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa94c03e960 con 0x7fa954146ff0 2023-12-19T05:39:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.158+0000 7fa94a7fc640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 0x7fa93806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.158+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa94c0ab6c0 con 0x7fa954146ff0 2023-12-19T05:39:21.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.158+0000 7fa959e93640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 0x7fa93806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.159+0000 7fa959e93640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 0x7fa93806c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa950000f60 tx=0x7fa950009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.162+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa95413c200 con 0x7fa954146ff0 2023-12-19T05:39:21.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.355+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa95413c200 con 0x7fa954146ff0 2023-12-19T05:39:21.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.356+0000 7fa94a7fc640 1 -- 172.21.15.49:0/3948946892 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa95413c200 con 0x7fa954146ff0 2023-12-19T05:39:21.357 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.358+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 msgr2=0x7fa93806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.358+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 0x7fa93806c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa950000f60 tx=0x7fa950009040 comp rx=0 tx=0).stop 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.358+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 msgr2=0x7fa9540b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.358+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e50 tx=0x7fa94c004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 shutdown_connections 2023-12-19T05:39:21.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa93806a430 0x7fa93806c8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa954146ff0 0x7fa9540b4100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9540b6430 0x7fa95413b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 --2- 172.21.15.49:0/3948946892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa95406fc40 0x7fa95415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 >> 172.21.15.49:0/3948946892 conn(0x7fa9540d3520 msgr2=0x7fa954160200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 shutdown_connections 2023-12-19T05:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.359+0000 7fa95c0f7640 1 -- 172.21.15.49:0/3948946892 wait complete. 2023-12-19T05:39:21.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.609+0000 7f270f2b9640 1 Processor -- start 2023-12-19T05:39:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.609+0000 7f270f2b9640 1 -- start start 2023-12-19T05:39:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270f2b9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2708146e30 0x7f27080b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270f2b9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27080b7ea0 0x7f27080d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270f2b9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080d12d0 con 0x7f27080d0a90 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270f2b9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708147210 con 0x7f27080b7ea0 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270f2b9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080b8330 con 0x7f2708146e30 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270dab6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27080b7ea0 0x7f27080d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270dab6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27080b7ea0 0x7f27080d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34108/0 (socket says 172.21.15.49:34108) 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.611+0000 7f270dab6640 1 -- 172.21.15.49:0/2275733288 learned_addr learned my addr 172.21.15.49:0/2275733288 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.612+0000 7f270e2b7640 1 --2- 172.21.15.49:0/2275733288 >> v2:172.21.15.115:3300/0 conn(0x7f2708146e30 0x7f27080b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.612+0000 7f270dab6640 1 -- 172.21.15.49:0/2275733288 >> v2:172.21.15.115:3300/0 conn(0x7f2708146e30 msgr2=0x7f27080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.612+0000 7f270dab6640 1 --2- 172.21.15.49:0/2275733288 >> v2:172.21.15.115:3300/0 conn(0x7f2708146e30 0x7f27080b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.612+0000 7f270dab6640 1 -- 172.21.15.49:0/2275733288 >> v1:172.21.15.115:6789/0 conn(0x7f27080d0a90 legacy=0x7f270806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:21.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.612+0000 7f270dab6640 1 -- 172.21.15.49:0/2275733288 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080d15b0 con 0x7f27080b7ea0 2023-12-19T05:39:21.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.613+0000 7f270dab6640 1 --2- 172.21.15.49:0/2275733288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27080d0550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27080b85a0 tx=0x7f26f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e112fc81ca0ae0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.613+0000 7f270d2b5640 1 -- 172.21.15.49:0/2275733288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80317e0 con 0x7f27080b7ea0 2023-12-19T05:39:21.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.613+0000 7f270d2b5640 1 -- 172.21.15.49:0/2275733288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8031940 con 0x7f27080b7ea0 2023-12-19T05:39:21.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.613+0000 7f270d2b5640 1 -- 172.21.15.49:0/2275733288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8031cd0 con 0x7f27080b7ea0 2023-12-19T05:39:21.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 -- 172.21.15.49:0/2275733288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 msgr2=0x7f27080d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2275733288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27080d0550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27080b85a0 tx=0x7f26f802b880 comp rx=0 tx=0).stop 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 -- 172.21.15.49:0/2275733288 shutdown_connections 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2275733288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27080d0550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2275733288 >> v2:172.21.15.115:3300/0 conn(0x7f2708146e30 0x7f27080b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 -- 172.21.15.49:0/2275733288 >> 172.21.15.49:0/2275733288 conn(0x7f27080b2990 msgr2=0x7f27080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 -- 172.21.15.49:0/2275733288 shutdown_connections 2023-12-19T05:39:21.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.614+0000 7f270f2b9640 1 -- 172.21.15.49:0/2275733288 wait complete. 2023-12-19T05:39:21.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.616+0000 7f270f2b9640 1 Processor -- start 2023-12-19T05:39:21.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.617+0000 7f270f2b9640 1 -- start start 2023-12-19T05:39:21.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 0x7f270813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2708146e30 0x7f270813c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cb910 con 0x7f27080b7ea0 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cbbf0 con 0x7f27080d0a90 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270f2b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cbed0 con 0x7f2708146e30 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270e2b7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270e2b7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34120/0 (socket says 172.21.15.49:34120) 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270e2b7640 1 -- 172.21.15.49:0/2715191936 learned_addr learned my addr 172.21.15.49:0/2715191936 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270e2b7640 1 -- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2708146e30 msgr2=0x7f270813c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270e2b7640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2708146e30 0x7f270813c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.618+0000 7f270dab6640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 0x7f270813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270e2b7640 1 -- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 msgr2=0x7f270813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270e2b7640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 0x7f270813f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270e2b7640 1 -- 172.21.15.49:0/2715191936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80094d0 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270dab6640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 0x7f270813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270e2b7640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f270400d5f0 tx=0x7f270400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040125f0 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704012750 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704012b00 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080cc1b0 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.619+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27080cc770 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.621+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27080cc900 con 0x7f27080b7ea0 2023-12-19T05:39:21.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.621+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2704012c60 con 0x7f27080b7ea0 2023-12-19T05:39:21.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.622+0000 7f26feffd640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 0x7f26ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.622+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2704088db0 con 0x7f27080b7ea0 2023-12-19T05:39:21.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.623+0000 7f270dab6640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 0x7f26ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.624+0000 7f270dab6640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 0x7f26ec06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26f8036000 tx=0x7f26f803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.627+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f270408d070 con 0x7f27080b7ea0 2023-12-19T05:39:21.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.849+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27080b6210 con 0x7f27080b7ea0 2023-12-19T05:39:21.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.850+0000 7f26feffd640 1 -- 172.21.15.49:0/2715191936 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f2704054390 con 0x7f27080b7ea0 2023-12-19T05:39:21.852 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:21.852 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:21.852 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:39:21.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 msgr2=0x7f26ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 0x7f26ec06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26f8036000 tx=0x7f26f803d040 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 msgr2=0x7f27081dba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f270400d5f0 tx=0x7f270400dab0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 shutdown_connections 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f26ec06a430 0x7f26ec06c8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2708146e30 0x7f270813c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27080d0a90 0x7f270813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 --2- 172.21.15.49:0/2715191936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27080b7ea0 0x7f27081dba40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 >> 172.21.15.49:0/2715191936 conn(0x7f27080b2990 msgr2=0x7f2708141eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 shutdown_connections 2023-12-19T05:39:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:21.853+0000 7f270f2b9640 1 -- 172.21.15.49:0/2715191936 wait complete. 2023-12-19T05:39:21.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.093+0000 7fccfbfff640 1 Processor -- start 2023-12-19T05:39:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.093+0000 7fccfbfff640 1 -- start start 2023-12-19T05:39:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.095+0000 7fccfbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fccfc159f80 0x7fccfc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.095+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfbfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc06b520 con 0x7fccfc15a8a0 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfbfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0b2b20 con 0x7fccfc159f80 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0b2fb0 con 0x7fccfc15b1e0 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfb7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fccfc15a8a0 0x7fccfc15dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41316/0 (socket says 172.21.15.49:41316) 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfb7fe640 1 -- 172.21.15.49:0/1862950720 learned_addr learned my addr 172.21.15.49:0/1862950720 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfaffd640 1 --2- 172.21.15.49:0/1862950720 >> v2:172.21.15.49:3300/0 conn(0x7fccfc159f80 0x7fccfc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfa7fc640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccf9ffb640 1 -- 172.21.15.49:0/1862950720 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371731857 0 0) 0x7fccfc06b520 con 0x7fccfc15a8a0 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfaffd640 1 -- 172.21.15.49:0/1862950720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 msgr2=0x7fccfc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfaffd640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfaffd640 1 -- 172.21.15.49:0/1862950720 >> v1:172.21.15.49:6789/0 conn(0x7fccfc15a8a0 legacy=0x7fccfc15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.096+0000 7fccfaffd640 1 -- 172.21.15.49:0/1862950720 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0b1f10 con 0x7fccfc159f80 2023-12-19T05:39:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.097+0000 7fccfaffd640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc06f160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097a0 tx=0x7fccf402db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58edd69fe9954c11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccf9ffb640 1 -- 172.21.15.49:0/1862950720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf402f910 con 0x7fccfc159f80 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccf9ffb640 1 -- 172.21.15.49:0/1862950720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf402fa70 con 0x7fccfc159f80 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccf9ffb640 1 -- 172.21.15.49:0/1862950720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf402fe00 con 0x7fccfc159f80 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 -- 172.21.15.49:0/1862950720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 msgr2=0x7fccfc06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc06f160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097a0 tx=0x7fccf402db50 comp rx=0 tx=0).stop 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 -- 172.21.15.49:0/1862950720 shutdown_connections 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 --2- 172.21.15.49:0/1862950720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc06f160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 -- 172.21.15.49:0/1862950720 >> 172.21.15.49:0/1862950720 conn(0x7fccfc0b0100 msgr2=0x7fccfc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.098+0000 7fccfbfff640 1 -- 172.21.15.49:0/1862950720 shutdown_connections 2023-12-19T05:39:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.099+0000 7fccfbfff640 1 -- 172.21.15.49:0/1862950720 wait complete. 2023-12-19T05:39:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.100+0000 7fccfbfff640 1 Processor -- start 2023-12-19T05:39:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.100+0000 7fccfbfff640 1 -- start start 2023-12-19T05:39:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 0x7fccfc14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06b890 con 0x7fccfc159f80 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06bb70 con 0x7fccfc15a8a0 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06be50 con 0x7fccfc15b1e0 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34136/0 (socket says 172.21.15.49:34136) 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.101+0000 7fccfaffd640 1 -- 172.21.15.49:0/3238101449 learned_addr learned my addr 172.21.15.49:0/3238101449 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfa7fc640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 0x7fccfc14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfb7fe640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 -- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 msgr2=0x7fccfc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 -- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 msgr2=0x7fccfc14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 0x7fccfc14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 -- 172.21.15.49:0/3238101449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009400 con 0x7fccfc159f80 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfa7fc640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 0x7fccfc14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccfaffd640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccf4039040 tx=0x7fccf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4037a60 con 0x7fccfc159f80 2023-12-19T05:39:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4037bc0 con 0x7fccfc159f80 2023-12-19T05:39:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.102+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4004030 con 0x7fccfc159f80 2023-12-19T05:39:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.103+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc06c130 con 0x7fccfc159f80 2023-12-19T05:39:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.103+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc14b020 con 0x7fccfc159f80 2023-12-19T05:39:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.104+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc06c650 con 0x7fccfc159f80 2023-12-19T05:39:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.105+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fccf4004190 con 0x7fccfc159f80 2023-12-19T05:39:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.106+0000 7fccf37fe640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 0x7fcce006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.106+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccf4033070 con 0x7fccfc159f80 2023-12-19T05:39:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.106+0000 7fccfa7fc640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 0x7fcce006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.107+0000 7fccfa7fc640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 0x7fcce006c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccfc15dab0 tx=0x7fcce400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.110+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fccf4077060 con 0x7fccfc159f80 2023-12-19T05:39:22.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.297+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccfc061910 con 0x7fccfc159f80 2023-12-19T05:39:22.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.299+0000 7fccf37fe640 1 -- 172.21.15.49:0/3238101449 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fccf407a680 con 0x7fccfc159f80 2023-12-19T05:39:22.301 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:22.301 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 msgr2=0x7fcce006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 0x7fcce006c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccfc15dab0 tx=0x7fcce400b040 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 msgr2=0x7fccfc14aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccf4039040 tx=0x7fccf40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 shutdown_connections 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcce006a430 0x7fcce006c8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccfc15b1e0 0x7fccfc15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccfc15a8a0 0x7fccfc14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 --2- 172.21.15.49:0/3238101449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccfc159f80 0x7fccfc14aae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 >> 172.21.15.49:0/3238101449 conn(0x7fccfc0b0100 msgr2=0x7fccfc154850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 shutdown_connections 2023-12-19T05:39:22.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.302+0000 7fccfbfff640 1 -- 172.21.15.49:0/3238101449 wait complete. 2023-12-19T05:39:22.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:22.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:22.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.558+0000 7f498ffff640 1 Processor -- start 2023-12-19T05:39:22.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.558+0000 7f498ffff640 1 -- start start 2023-12-19T05:39:22.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.560+0000 7f498ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f499006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.560+0000 7f498ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.560+0000 7f498ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499006d520 con 0x7f49900b1cd0 2023-12-19T05:39:22.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.560+0000 7f498ffff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900b2690 con 0x7f4990071030 2023-12-19T05:39:22.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.560+0000 7f498ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990140830 con 0x7f4990140450 2023-12-19T05:39:22.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498effd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f499006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498f7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498f7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:56768/0 (socket says 172.21.15.49:56768) 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498f7fe640 1 -- 172.21.15.49:0/372578198 learned_addr learned my addr 172.21.15.49:0/372578198 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498effd640 1 -- 172.21.15.49:0/372578198 >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 msgr2=0x7f49900b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498effd640 1 --2- 172.21.15.49:0/372578198 >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498effd640 1 -- 172.21.15.49:0/372578198 >> v1:172.21.15.115:6789/0 conn(0x7f49900b1cd0 legacy=0x7f4990070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498effd640 1 -- 172.21.15.49:0/372578198 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990161090 con 0x7f4990140450 2023-12-19T05:39:22.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.561+0000 7f498f7fe640 1 --2- 172.21.15.49:0/372578198 >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:22.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.563+0000 7f498effd640 1 --2- 172.21.15.49:0/372578198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f499006cfe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f498002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341673568b8394f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.563+0000 7f498dffb640 1 -- 172.21.15.49:0/372578198 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498002cc50 con 0x7f4990140450 2023-12-19T05:39:22.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.563+0000 7f498dffb640 1 -- 172.21.15.49:0/372578198 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498002cdb0 con 0x7f4990140450 2023-12-19T05:39:22.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.563+0000 7f498dffb640 1 -- 172.21.15.49:0/372578198 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980034660 con 0x7f4990140450 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 -- 172.21.15.49:0/372578198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 msgr2=0x7f499006cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 --2- 172.21.15.49:0/372578198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f499006cfe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f498002bea0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 -- 172.21.15.49:0/372578198 shutdown_connections 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 --2- 172.21.15.49:0/372578198 >> v2:172.21.15.115:3300/0 conn(0x7f4990071030 0x7f49900b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 --2- 172.21.15.49:0/372578198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f499006cfe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 -- 172.21.15.49:0/372578198 >> 172.21.15.49:0/372578198 conn(0x7f49900cf5d0 msgr2=0x7f49900cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 -- 172.21.15.49:0/372578198 shutdown_connections 2023-12-19T05:39:22.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.564+0000 7f498ffff640 1 -- 172.21.15.49:0/372578198 wait complete. 2023-12-19T05:39:22.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.566+0000 7f498ffff640 1 Processor -- start 2023-12-19T05:39:22.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.566+0000 7f498ffff640 1 -- start start 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49900b1cd0 0x7f4990159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f4990159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901f71a0 con 0x7f4990071030 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499013f630 con 0x7f49900b1cd0 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49901f6590 con 0x7f4990140450 2023-12-19T05:39:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34150/0 (socket says 172.21.15.49:34150) 2023-12-19T05:39:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498effd640 1 -- 172.21.15.49:0/1212487039 learned_addr learned my addr 172.21.15.49:0/1212487039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498f7fe640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f4990159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.567+0000 7f498e7fc640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49900b1cd0 0x7f4990159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 -- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 msgr2=0x7f4990159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f4990159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 -- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49900b1cd0 msgr2=0x7f4990159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49900b1cd0 0x7f4990159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 -- 172.21.15.49:0/1212487039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094d0 con 0x7f4990071030 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498effd640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f4980004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980040650 con 0x7f4990071030 2023-12-19T05:39:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800407b0 con 0x7f4990071030 2023-12-19T05:39:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980040b60 con 0x7f4990071030 2023-12-19T05:39:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.568+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4980009a70 con 0x7f4990071030 2023-12-19T05:39:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.569+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49901f6b50 con 0x7f4990071030 2023-12-19T05:39:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.570+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4990061910 con 0x7f4990071030 2023-12-19T05:39:22.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.571+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4980040cc0 con 0x7f4990071030 2023-12-19T05:39:22.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.572+0000 7f4987fff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 0x7f497006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.572+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49800ab710 con 0x7f4990071030 2023-12-19T05:39:22.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.572+0000 7f498e7fc640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 0x7f497006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.573+0000 7f498e7fc640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 0x7f497006c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49900cf300 tx=0x7f4978009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.576+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4980076d90 con 0x7f4990071030 2023-12-19T05:39:22.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.771+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49900b3790 con 0x7f4990071030 2023-12-19T05:39:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.772+0000 7f4987fff640 1 -- 172.21.15.49:0/1212487039 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f498007a3b0 con 0x7f4990071030 2023-12-19T05:39:22.774 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 msgr2=0x7f497006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 0x7f497006c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49900cf300 tx=0x7f4978009040 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 msgr2=0x7f499013f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f4980004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 shutdown_connections 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f497006a430 0x7f497006c8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4990140450 0x7f4990159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49900b1cd0 0x7f4990159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 --2- 172.21.15.49:0/1212487039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4990071030 0x7f499013f0f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.774+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 >> 172.21.15.49:0/1212487039 conn(0x7f49900cf5d0 msgr2=0x7f49901419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.775+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 shutdown_connections 2023-12-19T05:39:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:22.775+0000 7f498ffff640 1 -- 172.21.15.49:0/1212487039 wait complete. 2023-12-19T05:39:22.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:23.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.028+0000 7fdc4c927640 1 Processor -- start 2023-12-19T05:39:23.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.028+0000 7fdc4c927640 1 -- start start 2023-12-19T05:39:23.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4c927640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc48161900 0x7fdc48168580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4c927640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc480d1070 con 0x7fdc48146da0 2023-12-19T05:39:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4c927640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc48162020 con 0x7fdc48147180 2023-12-19T05:39:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4c927640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480aabd0 con 0x7fdc48161900 2023-12-19T05:39:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc48146da0 0x7fdc480aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41330/0 (socket says 172.21.15.49:41330) 2023-12-19T05:39:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.030+0000 7fdc4659c640 1 -- 172.21.15.49:0/745650510 learned_addr learned my addr 172.21.15.49:0/745650510 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> v2:172.21.15.115:3300/0 conn(0x7fdc48161900 0x7fdc48168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949698959 0 0) 0x7fdc480d1070 con 0x7fdc48146da0 2023-12-19T05:39:23.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc34003520 con 0x7fdc48146da0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476978718 0 0) 0x7fdc34003520 con 0x7fdc48146da0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 >> v2:172.21.15.115:3300/0 conn(0x7fdc48161900 msgr2=0x7fdc48168580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 --2- 172.21.15.49:0/745650510 >> v2:172.21.15.115:3300/0 conn(0x7fdc48161900 0x7fdc48168580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 >> v1:172.21.15.115:6789/0 conn(0x7fdc48147180 legacy=0x7fdc481611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480aaeb0 con 0x7fdc48146da0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fdc380019f0 con 0x7fdc48146da0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.031+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 >> v1:172.21.15.49:6789/0 conn(0x7fdc48146da0 legacy=0x7fdc480aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc34003a30 0x7fdc34003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 0x7fdc3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480aabd0 con 0x7fdc340051d0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3400c100 con 0x7fdc340047c0 2023-12-19T05:39:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3400c2c0 con 0x7fdc34003a30 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> v2:172.21.15.115:3300/0 conn(0x7fdc48161900 0x7fdc48168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 0x7fdc3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc45d9b640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc4659c640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc34003a30 0x7fdc34003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 -- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc34003a30 msgr2=0x7fdc34003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc34003a30 0x7fdc34003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 -- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340047c0 msgr2=0x7fdc34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.032+0000 7fdc46d9d640 1 -- 172.21.15.49:0/745650510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc34003520 con 0x7fdc340051d0 2023-12-19T05:39:23.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.033+0000 7fdc46d9d640 1 -- 172.21.15.49:0/745650510 reap_dead start 2023-12-19T05:39:23.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 0x7fdc3400b980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009c70 tx=0x7fdc340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6504bcb0a07570 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004020 con 0x7fdc340051d0 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40004180 con 0x7fdc340051d0 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc4559a640 1 -- 172.21.15.49:0/745650510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4002c8a0 con 0x7fdc340051d0 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc4c927640 1 -- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 msgr2=0x7fdc3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.034+0000 7fdc4c927640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 0x7fdc3400b980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009c70 tx=0x7fdc340057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.035+0000 7fdc4c927640 1 -- 172.21.15.49:0/745650510 shutdown_connections 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.035+0000 7fdc4c927640 1 --2- 172.21.15.49:0/745650510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc340051d0 0x7fdc3400b980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.035+0000 7fdc4c927640 1 -- 172.21.15.49:0/745650510 >> 172.21.15.49:0/745650510 conn(0x7fdc48071a50 msgr2=0x7fdc480d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.035+0000 7fdc4c927640 1 -- 172.21.15.49:0/745650510 shutdown_connections 2023-12-19T05:39:23.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.035+0000 7fdc4c927640 1 -- 172.21.15.49:0/745650510 wait complete. 2023-12-19T05:39:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.037+0000 7fdc4c927640 1 Processor -- start 2023-12-19T05:39:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.037+0000 7fdc4c927640 1 -- start start 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340051d0 0x7fdc4813ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc48145e50 0x7fdc481f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4813b270 con 0x7fdc481f73d0 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48144db0 con 0x7fdc48145e50 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4c927640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48145090 con 0x7fdc340051d0 2023-12-19T05:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34168/0 (socket says 172.21.15.49:34168) 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 -- 172.21.15.49:0/210100196 learned_addr learned my addr 172.21.15.49:0/210100196 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc45d9b640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc48145e50 0x7fdc481f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc4659c640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340051d0 0x7fdc4813ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 -- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340051d0 msgr2=0x7fdc4813ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340051d0 0x7fdc4813ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 -- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc48145e50 msgr2=0x7fdc481f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc48145e50 0x7fdc481f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.038+0000 7fdc46d9d640 1 -- 172.21.15.49:0/210100196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48145370 con 0x7fdc481f73d0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc46d9d640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc4002c510 tx=0x7fdc40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003610 con 0x7fdc481f73d0 2023-12-19T05:39:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40003770 con 0x7fdc481f73d0 2023-12-19T05:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003ae0 con 0x7fdc481f73d0 2023-12-19T05:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48145650 con 0x7fdc481f73d0 2023-12-19T05:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.039+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc481462d0 con 0x7fdc481f73d0 2023-12-19T05:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.041+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc48146460 con 0x7fdc481f73d0 2023-12-19T05:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.041+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc40003c40 con 0x7fdc481f73d0 2023-12-19T05:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.042+0000 7fdc3effd640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 0x7fdc2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.042+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc400aaac0 con 0x7fdc481f73d0 2023-12-19T05:39:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.043+0000 7fdc4659c640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 0x7fdc2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.044+0000 7fdc4659c640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 0x7fdc2806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc38002230 tx=0x7fdc38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.047+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc40076020 con 0x7fdc481f73d0 2023-12-19T05:39:23.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.239+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc48146460 con 0x7fdc481f73d0 2023-12-19T05:39:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.240+0000 7fdc3effd640 1 -- 172.21.15.49:0/210100196 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc40079640 con 0x7fdc481f73d0 2023-12-19T05:39:23.241 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 msgr2=0x7fdc2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 0x7fdc2806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc38002230 tx=0x7fdc38009040 comp rx=0 tx=0).stop 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 msgr2=0x7fdc48142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc4002c510 tx=0x7fdc40004730 comp rx=0 tx=0).stop 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 shutdown_connections 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc2806a430 0x7fdc2806c8f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc481f73d0 0x7fdc48142be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc48145e50 0x7fdc481f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 --2- 172.21.15.49:0/210100196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340051d0 0x7fdc4813ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 >> 172.21.15.49:0/210100196 conn(0x7fdc48071a50 msgr2=0x7fdc4815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 shutdown_connections 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.243+0000 7fdc4c927640 1 -- 172.21.15.49:0/210100196 wait complete. 2023-12-19T05:39:23.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.491+0000 7f731ffff640 1 Processor -- start 2023-12-19T05:39:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.491+0000 7f731ffff640 1 -- start start 2023-12-19T05:39:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.493+0000 7f731ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73200cdc60 0x7f73200adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.493+0000 7f731ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 0x7f73200ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.493+0000 7f731ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200c9bc0 con 0x7f732015a010 2023-12-19T05:39:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.493+0000 7f731ffff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732015e040 con 0x7f73200cdc60 2023-12-19T05:39:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.493+0000 7f731ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73200c9e80 con 0x7f732015dbd0 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.494+0000 7f731effd640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f732015a010 0x7f73200cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:58874/0 (socket says 172.21.15.49:58874) 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.494+0000 7f731effd640 1 -- 172.21.15.49:0/1858491329 learned_addr learned my addr 172.21.15.49:0/1858491329 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.494+0000 7f731f7fe640 1 --2- 172.21.15.49:0/1858491329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 0x7f73200ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.494+0000 7f731e7fc640 1 --2- 172.21.15.49:0/1858491329 >> v2:172.21.15.115:3300/0 conn(0x7f73200cdc60 0x7f73200adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731dffb640 1 -- 172.21.15.49:0/1858491329 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565117335 0 0) 0x7f73200c9bc0 con 0x7f732015a010 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731dffb640 1 -- 172.21.15.49:0/1858491329 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f730c003520 con 0x7f732015a010 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731f7fe640 1 -- 172.21.15.49:0/1858491329 >> v2:172.21.15.115:3300/0 conn(0x7f73200cdc60 msgr2=0x7f73200adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731f7fe640 1 --2- 172.21.15.49:0/1858491329 >> v2:172.21.15.115:3300/0 conn(0x7f73200cdc60 0x7f73200adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731f7fe640 1 -- 172.21.15.49:0/1858491329 >> v1:172.21.15.115:6789/0 conn(0x7f732015a010 legacy=0x7f73200cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.495+0000 7f731f7fe640 1 -- 172.21.15.49:0/1858491329 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732015eb00 con 0x7f732015dbd0 2023-12-19T05:39:23.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.496+0000 7f731f7fe640 1 --2- 172.21.15.49:0/1858491329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 0x7f73200ca310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f73180097a0 tx=0x7f731802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c9f6898f8c5885 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731dffb640 1 -- 172.21.15.49:0/1858491329 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318031830 con 0x7f732015dbd0 2023-12-19T05:39:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731dffb640 1 -- 172.21.15.49:0/1858491329 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318031990 con 0x7f732015dbd0 2023-12-19T05:39:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731dffb640 1 -- 172.21.15.49:0/1858491329 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318031d20 con 0x7f732015dbd0 2023-12-19T05:39:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 -- 172.21.15.49:0/1858491329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 msgr2=0x7f73200ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 --2- 172.21.15.49:0/1858491329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 0x7f73200ca310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f73180097a0 tx=0x7f731802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 -- 172.21.15.49:0/1858491329 shutdown_connections 2023-12-19T05:39:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 --2- 172.21.15.49:0/1858491329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f732015dbd0 0x7f73200ca310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 --2- 172.21.15.49:0/1858491329 >> v2:172.21.15.115:3300/0 conn(0x7f73200cdc60 0x7f73200adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 -- 172.21.15.49:0/1858491329 >> 172.21.15.49:0/1858491329 conn(0x7f73200b30d0 msgr2=0x7f73200659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 -- 172.21.15.49:0/1858491329 shutdown_connections 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.497+0000 7f731ffff640 1 -- 172.21.15.49:0/1858491329 wait complete. 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.499+0000 7f731ffff640 1 Processor -- start 2023-12-19T05:39:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.499+0000 7f731ffff640 1 -- start start 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 0x7f732014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732015dbd0 0x7f73200ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73201f3070 con 0x7f732015a010 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73201f3350 con 0x7f732015dbd0 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73201f3630 con 0x7f73200cdc60 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34178/0 (socket says 172.21.15.49:34178) 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731e7fc640 1 -- 172.21.15.49:0/3237329856 learned_addr learned my addr 172.21.15.49:0/3237329856 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731f7fe640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732015dbd0 0x7f73200ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.501+0000 7f731effd640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 0x7f732014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 -- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 msgr2=0x7f732014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 0x7f732014b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 -- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732015dbd0 msgr2=0x7f73200ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732015dbd0 0x7f73200ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 -- 172.21.15.49:0/3237329856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009400 con 0x7f732015a010 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731effd640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 0x7f732014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731e7fc640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9b0 tx=0x7f730800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308009670 con 0x7f732015a010 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800c9a0 con 0x7f732015a010 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800cd50 con 0x7f732015a010 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73201f3910 con 0x7f732015a010 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.502+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732014beb0 con 0x7f732015a010 2023-12-19T05:39:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.504+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7320061910 con 0x7f732015a010 2023-12-19T05:39:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.505+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7308013470 con 0x7f732015a010 2023-12-19T05:39:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.506+0000 7f7317fff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 0x7f730006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.506+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7308088bd0 con 0x7f732015a010 2023-12-19T05:39:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.506+0000 7f731effd640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 0x7f730006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.507+0000 7f731effd640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 0x7f730006c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7310001560 tx=0x7f7310009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.510+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73080541d0 con 0x7f732015a010 2023-12-19T05:39:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.698+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f732006f700 con 0x7f732015a010 2023-12-19T05:39:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.699+0000 7f7317fff640 1 -- 172.21.15.49:0/3237329856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73080170a0 con 0x7f732015a010 2023-12-19T05:39:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 msgr2=0x7f730006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 0x7f730006c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7310001560 tx=0x7f7310009040 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 msgr2=0x7f73200c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9b0 tx=0x7f730800ee70 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 shutdown_connections 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f730006a430 0x7f730006c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732015dbd0 0x7f73200ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f732015a010 0x7f73200c43e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 --2- 172.21.15.49:0/3237329856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73200cdc60 0x7f732014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 >> 172.21.15.49:0/3237329856 conn(0x7f73200b30d0 msgr2=0x7f732006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 shutdown_connections 2023-12-19T05:39:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.702+0000 7f731ffff640 1 -- 172.21.15.49:0/3237329856 wait complete. 2023-12-19T05:39:23.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.938+0000 7f0ffc96e640 1 Processor -- start 2023-12-19T05:39:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.938+0000 7f0ffc96e640 1 -- start start 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 0x7f0ff80ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ff815d840 0x7f0ff806d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff80d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80d18f0 con 0x7f0ff815d840 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80cebd0 con 0x7f0ff815d460 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ffc96e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff815ddf0 con 0x7f0ff80d0f20 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0feffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ff815d840 0x7f0ff806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0feffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ff815d840 0x7f0ff806d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34180/0 (socket says 172.21.15.49:34180) 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0feffff640 1 -- 172.21.15.49:0/2853580414 learned_addr learned my addr 172.21.15.49:0/2853580414 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ff7fff640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff80d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.940+0000 7f0ff77fe640 1 --2- 172.21.15.49:0/2853580414 >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 0x7f0ff80ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0feffff640 1 -- 172.21.15.49:0/2853580414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 msgr2=0x7f0ff80d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0feffff640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff80d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0feffff640 1 -- 172.21.15.49:0/2853580414 >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 msgr2=0x7f0ff80ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0feffff640 1 --2- 172.21.15.49:0/2853580414 >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 0x7f0ff80ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0feffff640 1 -- 172.21.15.49:0/2853580414 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff815e0d0 con 0x7f0ff815d840 2023-12-19T05:39:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.941+0000 7f0ff77fe640 1 --2- 172.21.15.49:0/2853580414 >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 0x7f0ff80ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.942+0000 7f0feffff640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff806d540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8065e60 tx=0x7f0fe002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96995e408392a62a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.942+0000 7f0ff6ffd640 1 -- 172.21.15.49:0/2853580414 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00317e0 con 0x7f0ff815d840 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.942+0000 7f0ff6ffd640 1 -- 172.21.15.49:0/2853580414 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0031940 con 0x7f0ff815d840 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.942+0000 7f0ff6ffd640 1 -- 172.21.15.49:0/2853580414 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0031cd0 con 0x7f0ff815d840 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 -- 172.21.15.49:0/2853580414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 msgr2=0x7f0ff806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff806d540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8065e60 tx=0x7f0fe002b880 comp rx=0 tx=0).stop 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 -- 172.21.15.49:0/2853580414 shutdown_connections 2023-12-19T05:39:23.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff80d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/2853580414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff806d540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/2853580414 >> v2:172.21.15.115:3300/0 conn(0x7f0ff815d460 0x7f0ff80ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 -- 172.21.15.49:0/2853580414 >> 172.21.15.49:0/2853580414 conn(0x7f0ff806f160 msgr2=0x7f0ff806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 -- 172.21.15.49:0/2853580414 shutdown_connections 2023-12-19T05:39:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.943+0000 7f0ffc96e640 1 -- 172.21.15.49:0/2853580414 wait complete. 2023-12-19T05:39:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.945+0000 7f0ffc96e640 1 Processor -- start 2023-12-19T05:39:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.945+0000 7f0ffc96e640 1 -- start start 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 0x7f0ff815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81f6410 con 0x7f0ff815d840 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b10a0 con 0x7f0ff815d460 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ffc96e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814db50 con 0x7f0ff80d0f20 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34192/0 (socket says 172.21.15.49:34192) 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff7fff640 1 -- 172.21.15.49:0/1184190767 learned_addr learned my addr 172.21.15.49:0/1184190767 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff77fe640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0feffff640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 0x7f0ff815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff7fff640 1 -- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 msgr2=0x7f0ff814d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.946+0000 7f0ff7fff640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff7fff640 1 -- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 msgr2=0x7f0ff815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff7fff640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 0x7f0ff815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff7fff640 1 -- 172.21.15.49:0/1184190767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00094d0 con 0x7f0ff815d840 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0feffff640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 0x7f0ff815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff7fff640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0007d20 tx=0x7f0ff000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0014420 con 0x7f0ff815d840 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00145a0 con 0x7f0ff815d840 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80b0dc0 con 0x7f0ff815d840 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0014950 con 0x7f0ff815d840 2023-12-19T05:39:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.947+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81f68d0 con 0x7f0ff815d840 2023-12-19T05:39:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.948+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8061910 con 0x7f0ff815d840 2023-12-19T05:39:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.949+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ff0014ab0 con 0x7f0ff815d840 2023-12-19T05:39:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.950+0000 7f0ff4ff9640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 0x7f0fd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.950+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ff0089200 con 0x7f0ff815d840 2023-12-19T05:39:23.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.951+0000 7f0ff77fe640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 0x7f0fd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.952+0000 7f0ff77fe640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 0x7f0fd806c920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8008850 tx=0x7f0fe8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:23.954+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ff0054750 con 0x7f0ff815d840 2023-12-19T05:39:24.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.184+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ff80cddb0 con 0x7f0ff815d840 2023-12-19T05:39:24.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.185+0000 7f0ff4ff9640 1 -- 172.21.15.49:0/1184190767 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f0ff0057d70 con 0x7f0ff815d840 2023-12-19T05:39:24.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:24.187 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.187+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 msgr2=0x7f0fd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.187+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 0x7f0fd806c920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8008850 tx=0x7f0fe8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.187+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 msgr2=0x7f0ff81603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.187+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0007d20 tx=0x7f0ff000e4b0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 shutdown_connections 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fd806a460 0x7f0fd806c920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ff815d840 0x7f0ff81603a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ff815d460 0x7f0ff815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 --2- 172.21.15.49:0/1184190767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ff80d0f20 0x7f0ff814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 >> 172.21.15.49:0/1184190767 conn(0x7f0ff806f160 msgr2=0x7f0ff81588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 shutdown_connections 2023-12-19T05:39:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.188+0000 7f0ffc96e640 1 -- 172.21.15.49:0/1184190767 wait complete. 2023-12-19T05:39:24.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.432+0000 7f90624db640 1 Processor -- start 2023-12-19T05:39:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.432+0000 7f90624db640 1 -- start start 2023-12-19T05:39:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.434+0000 7f90624db640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f905c161020 0x7f905c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.434+0000 7f90624db640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c15df70 con 0x7f905c1436c0 2023-12-19T05:39:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.434+0000 7f90624db640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c143af0 con 0x7f905c143230 2023-12-19T05:39:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.434+0000 7f90624db640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c15e1a0 con 0x7f905c161020 2023-12-19T05:39:24.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.435+0000 7f9060a78640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f905c1436c0 0x7f905c0b89a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39438/0 (socket says 172.21.15.49:39438) 2023-12-19T05:39:24.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.435+0000 7f9060a78640 1 -- 172.21.15.49:0/993039912 learned_addr learned my addr 172.21.15.49:0/993039912 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:24.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.435+0000 7f905bfff640 1 --2- 172.21.15.49:0/993039912 >> v2:172.21.15.115:3300/0 conn(0x7f905c161020 0x7f905c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.435+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940214294 0 0) 0x7f905c15df70 con 0x7f905c1436c0 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.435+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9048003520 con 0x7f905c1436c0 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450440769 0 0) 0x7f9048003520 con 0x7f905c1436c0 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 >> v2:172.21.15.115:3300/0 conn(0x7f905c161020 msgr2=0x7f905c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 --2- 172.21.15.49:0/993039912 >> v2:172.21.15.115:3300/0 conn(0x7f905c161020 0x7f905c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 >> v1:172.21.15.115:6789/0 conn(0x7f905c143230 legacy=0x7f905c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c15e480 con 0x7f905c1436c0 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f90540019f0 con 0x7f905c1436c0 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 >> v1:172.21.15.49:6789/0 conn(0x7f905c1436c0 legacy=0x7f905c0b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9048003a30 0x7f9048003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 0x7f9048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480051d0 0x7f904800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c15e1a0 con 0x7f90480047c0 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904800c100 con 0x7f9048003a30 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904800c2c0 con 0x7f90480051d0 2023-12-19T05:39:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.436+0000 7f9053fff640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 0x7f9048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f905bfff640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9048003a30 0x7f9048003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9060a78640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480051d0 0x7f904800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9053fff640 1 -- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480051d0 msgr2=0x7f904800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9053fff640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480051d0 0x7f904800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9053fff640 1 -- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9048003a30 msgr2=0x7f9048003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9053fff640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9048003a30 0x7f9048003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9053fff640 1 -- 172.21.15.49:0/993039912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048003520 con 0x7f90480047c0 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.437+0000 7f9060a78640 1 -- 172.21.15.49:0/993039912 reap_dead start 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.438+0000 7f9053fff640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 0x7f9048004c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9044001750 tx=0x7f90480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf0256f0c95ffbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.438+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440052d0 con 0x7f90480047c0 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.438+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904402e050 con 0x7f90480047c0 2023-12-19T05:39:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.438+0000 7f905b7fe640 1 -- 172.21.15.49:0/993039912 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044003830 con 0x7f90480047c0 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 -- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 msgr2=0x7f9048004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 0x7f9048004c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9044001750 tx=0x7f90480057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 -- 172.21.15.49:0/993039912 shutdown_connections 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 --2- 172.21.15.49:0/993039912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90480047c0 0x7f9048004c40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 -- 172.21.15.49:0/993039912 >> 172.21.15.49:0/993039912 conn(0x7f905c0b26f0 msgr2=0x7f905c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 -- 172.21.15.49:0/993039912 shutdown_connections 2023-12-19T05:39:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.439+0000 7f90624db640 1 -- 172.21.15.49:0/993039912 wait complete. 2023-12-19T05:39:24.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.441+0000 7f90624db640 1 Processor -- start 2023-12-19T05:39:24.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.441+0000 7f90624db640 1 -- start start 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480047c0 0x7f905c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 0x7f905c0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c146e20 con 0x7f905c146460 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c130f50 con 0x7f90480047c0 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f90624db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0d2970 con 0x7f905c133280 2023-12-19T05:39:24.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f9060a78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f9060a78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46914/0 (socket says 172.21.15.49:46914) 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.442+0000 7f9060a78640 1 -- 172.21.15.49:0/2417326810 learned_addr learned my addr 172.21.15.49:0/2417326810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f905bfff640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480047c0 0x7f905c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9053fff640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 0x7f905c0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 -- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 msgr2=0x7f905c0d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 0x7f905c0d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 -- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480047c0 msgr2=0x7f905c15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480047c0 0x7f905c15c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 -- 172.21.15.49:0/2417326810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0d2c50 con 0x7f905c146460 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9053fff640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 0x7f905c0d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:24.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f9060a78640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90540013d0 tx=0x7f905400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400ec10 con 0x7f905c146460 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400edb0 con 0x7f905c146460 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.443+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054013660 con 0x7f905c146460 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.444+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c0d2f30 con 0x7f905c146460 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.444+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c15ce70 con 0x7f905c146460 2023-12-19T05:39:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.445+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c061910 con 0x7f905c146460 2023-12-19T05:39:24.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.446+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90540137c0 con 0x7f905c146460 2023-12-19T05:39:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.447+0000 7f90597fa640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 0x7f903c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.447+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9054088e90 con 0x7f905c146460 2023-12-19T05:39:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.447+0000 7f905bfff640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 0x7f903c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.448+0000 7f905bfff640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 0x7f903c06c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f905c04f980 tx=0x7f904c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.451+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90540543e0 con 0x7f905c146460 2023-12-19T05:39:24.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.644+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f905c1416e0 con 0x7f905c146460 2023-12-19T05:39:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.646+0000 7f90597fa640 1 -- 172.21.15.49:0/2417326810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f905408a090 con 0x7f905c146460 2023-12-19T05:39:24.648 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:24.648 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.648+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 msgr2=0x7f903c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.648+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 0x7f903c06c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f905c04f980 tx=0x7f904c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 msgr2=0x7f905c1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90540013d0 tx=0x7f905400e530 comp rx=0 tx=0).stop 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 shutdown_connections 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f903c06a460 0x7f903c06c920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905c133280 0x7f905c0d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f905c146460 0x7f905c1468e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 --2- 172.21.15.49:0/2417326810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480047c0 0x7f905c15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 >> 172.21.15.49:0/2417326810 conn(0x7f905c0b26f0 msgr2=0x7f905c141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 shutdown_connections 2023-12-19T05:39:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.649+0000 7f90624db640 1 -- 172.21.15.49:0/2417326810 wait complete. 2023-12-19T05:39:24.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.895+0000 7f6edb5dc640 1 Processor -- start 2023-12-19T05:39:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.896+0000 7f6edb5dc640 1 -- start start 2023-12-19T05:39:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6edb5dc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ed40d2b00 0x7f6ed40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6edb5dc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ed40ce110 0x7f6ed40ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6edb5dc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed40cd840 con 0x7f6ed4146e10 2023-12-19T05:39:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6edb5dc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed40d2430 con 0x7f6ed40ce110 2023-12-19T05:39:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6edb5dc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed40ceac0 con 0x7f6ed40d2b00 2023-12-19T05:39:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6ed9b79640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ed40ce110 0x7f6ed40ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6ed9b79640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ed40ce110 0x7f6ed40ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46926/0 (socket says 172.21.15.49:46926) 2023-12-19T05:39:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.897+0000 7f6ed9b79640 1 -- 172.21.15.49:0/2003771459 learned_addr learned my addr 172.21.15.49:0/2003771459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.898+0000 7f6ed8b77640 1 --2- 172.21.15.49:0/2003771459 >> v2:172.21.15.115:3300/0 conn(0x7f6ed40d2b00 0x7f6ed40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.898+0000 7f6ed9b79640 1 -- 172.21.15.49:0/2003771459 >> v2:172.21.15.115:3300/0 conn(0x7f6ed40d2b00 msgr2=0x7f6ed40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.898+0000 7f6ed9b79640 1 --2- 172.21.15.49:0/2003771459 >> v2:172.21.15.115:3300/0 conn(0x7f6ed40d2b00 0x7f6ed40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.898+0000 7f6ed9b79640 1 -- 172.21.15.49:0/2003771459 >> v1:172.21.15.115:6789/0 conn(0x7f6ed4146e10 legacy=0x7f6ed40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.898+0000 7f6ed9b79640 1 -- 172.21.15.49:0/2003771459 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed40b6e90 con 0x7f6ed40ce110 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.899+0000 7f6ed9b79640 1 --2- 172.21.15.49:0/2003771459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed40ce580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40d3360 tx=0x7f6ecc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e58faa2ce1da07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.899+0000 7f6ed3fff640 1 -- 172.21.15.49:0/2003771459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0317e0 con 0x7f6ed40ce110 2023-12-19T05:39:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.899+0000 7f6ed3fff640 1 -- 172.21.15.49:0/2003771459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc031940 con 0x7f6ed40ce110 2023-12-19T05:39:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.899+0000 7f6ed3fff640 1 -- 172.21.15.49:0/2003771459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc031cd0 con 0x7f6ed40ce110 2023-12-19T05:39:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2003771459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 msgr2=0x7f6ed40ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2003771459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed40ce580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40d3360 tx=0x7f6ecc02b880 comp rx=0 tx=0).stop 2023-12-19T05:39:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2003771459 shutdown_connections 2023-12-19T05:39:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2003771459 >> v2:172.21.15.115:3300/0 conn(0x7f6ed40d2b00 0x7f6ed40d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2003771459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed40ce580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2003771459 >> 172.21.15.49:0/2003771459 conn(0x7f6ed40b29c0 msgr2=0x7f6ed40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2003771459 shutdown_connections 2023-12-19T05:39:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.900+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2003771459 wait complete. 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.902+0000 7f6edb5dc640 1 Processor -- start 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.902+0000 7f6edb5dc640 1 -- start start 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ed40d2b00 0x7f6ed406f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ed4146e10 0x7f6ed4070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed413dcc0 con 0x7f6ed40ce110 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed413dfa0 con 0x7f6ed40d2b00 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6edb5dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed413e280 con 0x7f6ed4146e10 2023-12-19T05:39:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6ed9378640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6ed9378640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46930/0 (socket says 172.21.15.49:46930) 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.903+0000 7f6ed9378640 1 -- 172.21.15.49:0/2801247040 learned_addr learned my addr 172.21.15.49:0/2801247040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9b79640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ed4146e10 0x7f6ed4070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 -- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ed4146e10 msgr2=0x7f6ed4070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed8b77640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ed40d2b00 0x7f6ed406f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ed4146e10 0x7f6ed4070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 -- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ed40d2b00 msgr2=0x7f6ed406f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ed40d2b00 0x7f6ed406f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 -- 172.21.15.49:0/2801247040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0094d0 con 0x7f6ed40ce110 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed9378640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c410 tx=0x7f6ec800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80035f0 con 0x7f6ed40ce110 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8003750 con 0x7f6ed40ce110 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8003b40 con 0x7f6ed40ce110 2023-12-19T05:39:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed413e560 con 0x7f6ed40ce110 2023-12-19T05:39:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.904+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed413ed60 con 0x7f6ed40ce110 2023-12-19T05:39:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.906+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed4061910 con 0x7f6ed40ce110 2023-12-19T05:39:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.907+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ec8003ca0 con 0x7f6ed40ce110 2023-12-19T05:39:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.907+0000 7f6ed1ffb640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 0x7f6eb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.908+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ec8087c30 con 0x7f6ed40ce110 2023-12-19T05:39:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.908+0000 7f6ed8b77640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 0x7f6eb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.909+0000 7f6ed8b77640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 0x7f6eb806c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ed415e4e0 tx=0x7f6ec000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:24.912+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ec8053210 con 0x7f6ed40ce110 2023-12-19T05:39:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.146+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ed40d1f20 con 0x7f6ed40ce110 2023-12-19T05:39:25.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.147+0000 7f6ed1ffb640 1 -- 172.21.15.49:0/2801247040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f6ec8017090 con 0x7f6ed40ce110 2023-12-19T05:39:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:25.149 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:25.150 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.149+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 msgr2=0x7f6eb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 0x7f6eb806c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ed415e4e0 tx=0x7f6ec000b040 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 msgr2=0x7f6ed413d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c410 tx=0x7f6ec800c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 shutdown_connections 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6eb806a430 0x7f6eb806c8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ed4146e10 0x7f6ed4070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ed40d2b00 0x7f6ed406f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 --2- 172.21.15.49:0/2801247040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed40ce110 0x7f6ed413d090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 >> 172.21.15.49:0/2801247040 conn(0x7f6ed40b29c0 msgr2=0x7f6ed415cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 shutdown_connections 2023-12-19T05:39:25.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.150+0000 7f6edb5dc640 1 -- 172.21.15.49:0/2801247040 wait complete. 2023-12-19T05:39:25.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:25.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:25.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:39:02.681473+0000', 'modified': '2023-12-19T05:39:06.208482+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/1533170592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1533170592}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1533170592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:39:25.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:39:25.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T05:39:25.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.818+0000 7fbe4f337640 1 Processor -- start 2023-12-19T05:39:25.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.818+0000 7fbe4f337640 1 -- start start 2023-12-19T05:39:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4f337640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe480b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4f337640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4815c9c0 con 0x7fbe4806cc50 2023-12-19T05:39:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4f337640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4806d270 con 0x7fbe480b0830 2023-12-19T05:39:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4f337640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b0cb0 con 0x7fbe48155460 2023-12-19T05:39:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4eb36640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbe4806cc50 0x7fbe480cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39448/0 (socket says 172.21.15.49:39448) 2023-12-19T05:39:25.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.820+0000 7fbe4eb36640 1 -- 172.21.15.49:0/2446556793 learned_addr learned my addr 172.21.15.49:0/2446556793 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4e335640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe480b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020950855 0 0) 0x7fbe4815c9c0 con 0x7fbe4806cc50 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003520 con 0x7fbe4806cc50 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721529332 0 0) 0x7fbe34003520 con 0x7fbe4806cc50 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 msgr2=0x7fbe480b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe480b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 >> v1:172.21.15.115:6789/0 conn(0x7fbe480b0830 legacy=0x7fbe4806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4806d550 con 0x7fbe4806cc50 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fbe400019f0 con 0x7fbe4806cc50 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 >> v1:172.21.15.49:6789/0 conn(0x7fbe4806cc50 legacy=0x7fbe480cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.821+0000 7fbe4d333640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe34003a10 0x7fbe34003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4d333640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4d333640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b0cb0 con 0x7fbe340047c0 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3400bb10 con 0x7fbe34003a10 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3400bca0 con 0x7fbe48155460 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4e335640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe34003a10 0x7fbe34003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 -- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 msgr2=0x7fbe34005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe48155460 0x7fbe34005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 -- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe34003a10 msgr2=0x7fbe34003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe34003a10 0x7fbe34003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.822+0000 7fbe4db34640 1 -- 172.21.15.49:0/2446556793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34003520 con 0x7fbe340047c0 2023-12-19T05:39:25.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.823+0000 7fbe4db34640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe34004c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe38001750 tx=0x7fbe340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828bf6455b7cd065 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380052d0 con 0x7fbe340047c0 2023-12-19T05:39:25.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3802e050 con 0x7fbe340047c0 2023-12-19T05:39:25.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4d333640 1 -- 172.21.15.49:0/2446556793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380035f0 con 0x7fbe340047c0 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 -- 172.21.15.49:0/2446556793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 msgr2=0x7fbe34004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 --2- 172.21.15.49:0/2446556793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe34004c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe38001750 tx=0x7fbe340057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4eb36640 1 -- 172.21.15.49:0/2446556793 reap_dead start 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 -- 172.21.15.49:0/2446556793 shutdown_connections 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 -- 172.21.15.49:0/2446556793 >> 172.21.15.49:0/2446556793 conn(0x7fbe480659a0 msgr2=0x7fbe48065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 -- 172.21.15.49:0/2446556793 shutdown_connections 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.824+0000 7fbe4f337640 1 -- 172.21.15.49:0/2446556793 wait complete. 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.826+0000 7fbe4f337640 1 Processor -- start 2023-12-19T05:39:25.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.826+0000 7fbe4f337640 1 -- start start 2023-12-19T05:39:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 0x7fbe480b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 0x7fbe48153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48153e90 con 0x7fbe340047c0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48149fc0 con 0x7fbe480b1d40 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4f337640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b2790 con 0x7fbe481534d0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46948/0 (socket says 172.21.15.49:46948) 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 -- 172.21.15.49:0/1971705112 learned_addr learned my addr 172.21.15.49:0/1971705112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4db34640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 0x7fbe480b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 0x7fbe48153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 -- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 msgr2=0x7fbe48153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 0x7fbe48153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 -- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 msgr2=0x7fbe480b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 0x7fbe480b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4e335640 1 -- 172.21.15.49:0/1971705112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480b2a70 con 0x7fbe340047c0 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4db34640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 0x7fbe480b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.828+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 0x7fbe48153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe4e335640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe44011600 tx=0x7fbe44011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe3effd640 1 -- 172.21.15.49:0/1971705112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400f920 con 0x7fbe340047c0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe3effd640 1 -- 172.21.15.49:0/1971705112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400fa80 con 0x7fbe340047c0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe3effd640 1 -- 172.21.15.49:0/1971705112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400fdf0 con 0x7fbe340047c0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480b2d50 con 0x7fbe340047c0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.829+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480ad250 con 0x7fbe340047c0 2023-12-19T05:39:25.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.831+0000 7fbe3effd640 1 -- 172.21.15.49:0/1971705112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe44015460 con 0x7fbe340047c0 2023-12-19T05:39:25.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.832+0000 7fbe3effd640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 0x7fbe2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.832+0000 7fbe3effd640 1 -- 172.21.15.49:0/1971705112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe44088ea0 con 0x7fbe340047c0 2023-12-19T05:39:25.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.833+0000 7fbe4db34640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 0x7fbe2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.833+0000 7fbe531e1740 1 Processor -- start 2023-12-19T05:39:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.833+0000 7fbe531e1740 1 -- start start 2023-12-19T05:39:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe4db34640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 0x7fbe2c06c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe38033000 tx=0x7fbe38009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67210e90 0x555f6723e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6723e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f67180f80 con 0x555f67240f10 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f6717e710 con 0x555f67214a90 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f6717a000 con 0x555f67210e90 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46964/0 (socket says 172.21.15.49:46964) 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.834+0000 7fbe4e335640 1 -- 172.21.15.49:0/3490878220 learned_addr learned my addr 172.21.15.49:0/3490878220 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 -- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67210e90 msgr2=0x555f6723e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4db34640 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67210e90 0x555f6723e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6723e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67210e90 0x555f6723e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 -- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 msgr2=0x555f6723e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6723e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 -- 172.21.15.49:0/3490878220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f67141690 con 0x555f67240f10 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe44010010 tx=0x7fbe44058150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f15b29456a96707 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe2bfff640 1 -- 172.21.15.49:0/3490878220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4405e070 con 0x555f67240f10 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe2bfff640 1 -- 172.21.15.49:0/3490878220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440564f0 con 0x555f67240f10 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.835+0000 7fbe2bfff640 1 -- 172.21.15.49:0/3490878220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44057640 con 0x555f67240f10 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 -- 172.21.15.49:0/3490878220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 msgr2=0x555f672412f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe44010010 tx=0x7fbe44058150 comp rx=0 tx=0).stop 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 -- 172.21.15.49:0/3490878220 shutdown_connections 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67210e90 0x555f6723e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6723e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3490878220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67240f10 0x555f672412f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 -- 172.21.15.49:0/3490878220 >> 172.21.15.49:0/3490878220 conn(0x555f672131a0 msgr2=0x555f6725bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 -- 172.21.15.49:0/3490878220 shutdown_connections 2023-12-19T05:39:25.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.836+0000 7fbe531e1740 1 -- 172.21.15.49:0/3490878220 wait complete. 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.837+0000 7fbe531e1740 1 -- start start 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.837+0000 7fbe531e1740 1 Processor -- start 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6726ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6722fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f6711b7d0 con 0x555f672302a0 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f6711b470 con 0x555f67214a90 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f66ee1f20 con 0x555f67240f10 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe531e1740 10 client.0 _ll_register_callbacks cb 0x555f6716a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe4eb36640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.838+0000 7fbe4eb36640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46976/0 (socket says 172.21.15.49:46976) 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 -- 172.21.15.49:0/3935573566 learned_addr learned my addr 172.21.15.49:0/3935573566 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6726ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4db34640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6722fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 -- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 msgr2=0x555f6722fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6722fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 -- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 msgr2=0x555f6726ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6726ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 -- 172.21.15.49:0/3935573566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480ad250 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe480afa90 tx=0x7fbe4000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf92d91a25bb13c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.839+0000 7fbe297fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40018070 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f671a4550 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe4000c070 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe4000fed0 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 10 client.4632 fetch_fsmap learned FSMap version 8 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555f67178680 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40022020 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbe4001b020 con 0x555f672302a0 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T05:39:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 10 client.4632 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 20 client.4632 populate_metadata read hostname 'smithi049' 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f672747f0 0x555f67278860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 4 client.4632 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.840+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 --> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f6716cb50 con 0x555f672747f0 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.841+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f672747f0 0x555f67278860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.842+0000 7fbe4e335640 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f672747f0 0x555f67278860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7759788f48900aa6 server_cookie=d599143313995b54 in_seq=0 out_seq=0 2023-12-19T05:39:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.842+0000 7fbe297fa640 10 client.4632 ms_handle_connect on v2:172.21.15.115:6836/1533170592 2023-12-19T05:39:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.844+0000 7fbe297fa640 1 -- 172.21.15.49:0/3935573566 <== mds.0 v2:172.21.15.115:6836/1533170592 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x555f6716cb50 con 0x555f672747f0 2023-12-19T05:39:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe297fa640 10 client.4632 handle_command_reply: tid=0 2023-12-19T05:39:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 client.4632 shutdown 2023-12-19T05:39:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 msgr2=0x555f67230720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe480afa90 tx=0x7fbe4000fce0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 shutdown_connections 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f672747f0 0x555f67278860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6722fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f672302a0 0x555f67230720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 --2- 172.21.15.49:0/3935573566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67214a90 0x555f6726ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe297fa640 0 client.4632 ms_handle_reset on v2:172.21.15.115:6836/1533170592 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 >> 172.21.15.49:0/3935573566 conn(0x555f67210e90 msgr2=0x555f6725f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 shutdown_connections 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 1 -- 172.21.15.49:0/3935573566 wait complete. 2023-12-19T05:39:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.845+0000 7fbe531e1740 20 client.4632 trim_cache size 0 max 16384 2023-12-19T05:39:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.862+0000 7fbe531e1740 1 Processor -- start 2023-12-19T05:39:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.862+0000 7fbe531e1740 1 -- start start 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f672302a0 0x555f67211a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6725f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f6726dd20 con 0x555f67214a90 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f6725a9e0 con 0x555f672302a0 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f6722fbb0 con 0x555f67240f10 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.863+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46982/0 (socket says 172.21.15.49:46982) 2023-12-19T05:39:25.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 -- 172.21.15.49:0/2871753826 learned_addr learned my addr 172.21.15.49:0/2871753826 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 -- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 msgr2=0x555f6725f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6725f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 -- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f672302a0 msgr2=0x555f67211a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f672302a0 0x555f67211a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 -- 172.21.15.49:0/2871753826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f6711a9e0 con 0x555f67214a90 2023-12-19T05:39:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe4e335640 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe44087420 tx=0x7fbe4405e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4207c99f12a3c98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe3cff9640 1 -- 172.21.15.49:0/2871753826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44073070 con 0x555f67214a90 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe3cff9640 1 -- 172.21.15.49:0/2871753826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44056290 con 0x555f67214a90 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.864+0000 7fbe3cff9640 1 -- 172.21.15.49:0/2871753826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44057640 con 0x555f67214a90 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 -- 172.21.15.49:0/2871753826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 msgr2=0x555f6722e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe44087420 tx=0x7fbe4405e000 comp rx=0 tx=0).stop 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 -- 172.21.15.49:0/2871753826 shutdown_connections 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f67240f10 0x555f6725f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f672302a0 0x555f67211a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 --2- 172.21.15.49:0/2871753826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f6722e8c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 -- 172.21.15.49:0/2871753826 >> 172.21.15.49:0/2871753826 conn(0x555f67210e90 msgr2=0x555f6727ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 -- 172.21.15.49:0/2871753826 shutdown_connections 2023-12-19T05:39:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.865+0000 7fbe531e1740 1 -- 172.21.15.49:0/2871753826 wait complete. 2023-12-19T05:39:25.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.866+0000 7fbe531e1740 1 -- start start 2023-12-19T05:39:25.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.866+0000 7fbe531e1740 1 Processor -- start 2023-12-19T05:39:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 0x555f67270cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67240f10 0x555f67244240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f672466f0 con 0x555f67214a90 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f67271200 con 0x555f67240f10 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f672713c0 con 0x555f672302a0 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe531e1740 10 client.0 _ll_register_callbacks cb 0x7fbe44054510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe4e335640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46984/0 (socket says 172.21.15.49:46984) 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.867+0000 7fbe4e335640 1 -- 172.21.15.49:0/4015502874 learned_addr learned my addr 172.21.15.49:0/4015502874 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4db34640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 0x555f67270cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4eb36640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67240f10 0x555f67244240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 -- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 msgr2=0x555f67270cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 0x555f67270cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 -- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67240f10 msgr2=0x555f67244240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67240f10 0x555f67244240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 -- 172.21.15.49:0/4015502874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f67141690 con 0x555f67214a90 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4db34640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 0x555f67270cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe4e335640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400f4e0 tx=0x7fbe4401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d9fc7013309f6a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe297fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44073070 con 0x555f67214a90 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe44057640 con 0x555f67214a90 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe440564f0 con 0x555f67214a90 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.868+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe44057800 con 0x555f67214a90 2023-12-19T05:39:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 10 client.4638 fetch_fsmap learned FSMap version 8 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555f6713fef0 con 0x555f67214a90 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440564f0 con 0x555f67214a90 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbe4401b020 con 0x555f67214a90 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 10 client.4638 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 20 client.4638 populate_metadata read hostname 'smithi049' 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f67244840 0x555f67245650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 4 client.4638 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 --> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f67173080 con 0x555f67244840 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.869+0000 7fbe4db34640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f67244840 0x555f67245650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.870+0000 7fbe4db34640 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f67244840 0x555f67245650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5294468c3ef7a56b server_cookie=3dc513ec342a8a86 in_seq=0 out_seq=0 2023-12-19T05:39:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.870+0000 7fbe297fa640 10 client.4638 ms_handle_connect on v2:172.21.15.115:6836/1533170592 2023-12-19T05:39:25.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe297fa640 1 -- 172.21.15.49:0/4015502874 <== mds.0 v2:172.21.15.115:6836/1533170592 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555f67173080 con 0x555f67244840 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe297fa640 10 client.4638 handle_command_reply: tid=0 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 client.4638 shutdown 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 msgr2=0x555f672b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400f4e0 tx=0x7fbe4401f070 comp rx=0 tx=0).stop 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 shutdown_connections 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:6836/1533170592,v1:172.21.15.115:6837/1533170592] conn(0x555f67244840 0x555f67245650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555f672302a0 0x555f67270cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555f67240f10 0x555f67244240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe297fa640 0 client.4638 ms_handle_reset on v2:172.21.15.115:6836/1533170592 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 --2- 172.21.15.49:0/4015502874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f67214a90 0x555f672b8870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 >> 172.21.15.49:0/4015502874 conn(0x555f67210e90 msgr2=0x555f6723e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.871+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 shutdown_connections 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe531e1740 1 -- 172.21.15.49:0/4015502874 wait complete. 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe531e1740 20 client.4638 trim_cache size 0 max 16384 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4291, 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:39:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 23.182935921999999, 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 8, 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 20, 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 28.036999276 2023-12-19T05:39:25.879 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 msgr2=0x7fbe2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 0x7fbe2c06c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe38033000 tx=0x7fbe38009030 comp rx=0 tx=0).stop 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 msgr2=0x7fbe48149a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe44011600 tx=0x7fbe44011ac0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 shutdown_connections 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbe2c06a430 0x7fbe2c06c8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe481534d0 0x7fbe48153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe480b1d40 0x7fbe480b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 --2- 172.21.15.49:0/1971705112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe340047c0 0x7fbe48149a80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.872+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 >> 172.21.15.49:0/1971705112 conn(0x7fbe480659a0 msgr2=0x7fbe4815d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.873+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 shutdown_connections 2023-12-19T05:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:25.873+0000 7fbe4f337640 1 -- 172.21.15.49:0/1971705112 wait complete. 2023-12-19T05:39:25.892 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T05:39:25.915 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T05:39:25.915 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-19T05:39:25.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:25.915 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:39:25.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:25.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-19T05:39:26.089 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-12-19T05:39:26.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:39:26.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.095 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:39:26.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-19T05:39:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-12-19T05:39:26.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:39:26.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.274 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:39:26.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-12-19T05:39:26.434 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-12-19T05:39:26.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:39:26.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.439 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:39:26.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:26.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-12-19T05:39:26.587 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-12-19T05:39:26.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:39:26.590 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-19T05:39:26.590 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T05:39:26.591 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:26.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.832+0000 7fdeb2a87640 1 Processor -- start 2023-12-19T05:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.833+0000 7fdeb2a87640 1 -- start start 2023-12-19T05:39:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb2a87640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdeac157bf0 0x7fdeac15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb2a87640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 0x7fdeac06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb2a87640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac15b740 con 0x7fdeac0ae110 2023-12-19T05:39:26.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb2a87640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac06b8c0 con 0x7fdeac157bf0 2023-12-19T05:39:26.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb2a87640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0ae640 con 0x7fdeac0b0810 2023-12-19T05:39:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb0823640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdeac157bf0 0x7fdeac15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb0823640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdeac157bf0 0x7fdeac15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46988/0 (socket says 172.21.15.49:46988) 2023-12-19T05:39:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeabfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdeac0ae110 0x7fdeac0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39454/0 (socket says 172.21.15.49:39454) 2023-12-19T05:39:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.834+0000 7fdeb0823640 1 -- 172.21.15.49:0/3766469160 learned_addr learned my addr 172.21.15.49:0/3766469160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb1024640 1 --2- 172.21.15.49:0/3766469160 >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 0x7fdeac06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb0823640 1 -- 172.21.15.49:0/3766469160 >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 msgr2=0x7fdeac06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:26.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb0823640 1 --2- 172.21.15.49:0/3766469160 >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 0x7fdeac06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb0823640 1 -- 172.21.15.49:0/3766469160 >> v1:172.21.15.49:6789/0 conn(0x7fdeac0ae110 legacy=0x7fdeac0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb0823640 1 -- 172.21.15.49:0/3766469160 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0ae920 con 0x7fdeac157bf0 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.835+0000 7fdeb1024640 1 --2- 172.21.15.49:0/3766469160 >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 0x7fdeac06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.836+0000 7fdeb0823640 1 --2- 172.21.15.49:0/3766469160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac157bf0 0x7fdeac15b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b1210 tx=0x7fdea002e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6610cdfd9a45f4b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.836+0000 7fdeab7fe640 1 -- 172.21.15.49:0/3766469160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0036440 con 0x7fdeac157bf0 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.836+0000 7fdeab7fe640 1 -- 172.21.15.49:0/3766469160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea00365a0 con 0x7fdeac157bf0 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.836+0000 7fdeab7fe640 1 -- 172.21.15.49:0/3766469160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0036930 con 0x7fdeac157bf0 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 -- 172.21.15.49:0/3766469160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac157bf0 msgr2=0x7fdeac15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/3766469160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac157bf0 0x7fdeac15b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b1210 tx=0x7fdea002e180 comp rx=0 tx=0).stop 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 -- 172.21.15.49:0/3766469160 shutdown_connections 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/3766469160 >> v2:172.21.15.115:3300/0 conn(0x7fdeac0b0810 0x7fdeac06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/3766469160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac157bf0 0x7fdeac15b200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 -- 172.21.15.49:0/3766469160 >> 172.21.15.49:0/3766469160 conn(0x7fdeac0cbb70 msgr2=0x7fdeac0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 -- 172.21.15.49:0/3766469160 shutdown_connections 2023-12-19T05:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.837+0000 7fdeb2a87640 1 -- 172.21.15.49:0/3766469160 wait complete. 2023-12-19T05:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.839+0000 7fdeb2a87640 1 Processor -- start 2023-12-19T05:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.839+0000 7fdeb2a87640 1 -- start start 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdeac0b0810 0x7fdeac0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac157bf0 0x7fdeac159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15b920 con 0x7fdeac0ae110 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15bc00 con 0x7fdeac157bf0 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb2a87640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15bee0 con 0x7fdeac0b0810 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb0823640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb0823640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46998/0 (socket says 172.21.15.49:46998) 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.840+0000 7fdeb0823640 1 -- 172.21.15.49:0/1386896962 learned_addr learned my addr 172.21.15.49:0/1386896962 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 -- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdeac0b0810 msgr2=0x7fdeac0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdeac0b0810 0x7fdeac0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 -- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac157bf0 msgr2=0x7fdeac159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac157bf0 0x7fdeac159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 -- 172.21.15.49:0/1386896962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea000b770 con 0x7fdeac0ae110 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb0823640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdea002e1c0 tx=0x7fdea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0034b00 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0034c60 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0041460 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac15c1c0 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.841+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac15c780 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.843+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac061910 con 0x7fdeac0ae110 2023-12-19T05:39:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.844+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdea0049360 con 0x7fdeac0ae110 2023-12-19T05:39:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.844+0000 7fdea97fa640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 0x7fde9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.845+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdea00aad40 con 0x7fdeac0ae110 2023-12-19T05:39:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.845+0000 7fdeabfff640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 0x7fde9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.846+0000 7fdeabfff640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 0x7fde9006c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdeac15a760 tx=0x7fde980079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:26.849+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdea0076320 con 0x7fdeac0ae110 2023-12-19T05:39:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.081+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdeac15ec20 con 0x7fdeac0ae110 2023-12-19T05:39:27.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.082+0000 7fdea97fa640 1 -- 172.21.15.49:0/1386896962 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdea0046070 con 0x7fdeac0ae110 2023-12-19T05:39:27.084 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 msgr2=0x7fde9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 0x7fde9006c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdeac15a760 tx=0x7fde980079c0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 msgr2=0x7fdeac155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdea002e1c0 tx=0x7fdea00046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 shutdown_connections 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fde9006a430 0x7fde9006c8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdeac0b0810 0x7fdeac0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac157bf0 0x7fdeac159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 --2- 172.21.15.49:0/1386896962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeac0ae110 0x7fdeac155160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 >> 172.21.15.49:0/1386896962 conn(0x7fdeac0cbb70 msgr2=0x7fdeac15e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 shutdown_connections 2023-12-19T05:39:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:27.085+0000 7fdeb2a87640 1 -- 172.21.15.49:0/1386896962 wait complete. 2023-12-19T05:39:27.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T05:39:27.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:27.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:39:27.107 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:39:27.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:27.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T05:39:27.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T05:39:27.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:27.108 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:27.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:27.108 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:39:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:39:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:27.165 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:39:27.166 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T05:39:27.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T05:39:27.167 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:27.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:27.680 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:27.769 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:39:27.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:27.773 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:39:27.830 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:39:27.830 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:27.831 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:39:27.831 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:39:27.831 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:27.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:39:27.831 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:28.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:28.623 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:39:28.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:28.674 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-12-19T05:39:28.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:28.723 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:28.723 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:28.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:39:28.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T05:39:28.724 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:28.881 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T05:39:28.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:28.881 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:28.881 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:28.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T05:39:28.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T05:39:28.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T05:39:28.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T05:39:28.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T05:39:28.882 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:29.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:29.185 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:29.185 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:29.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:39:29.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T05:39:29.185 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:29.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:29.360 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:29.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:29.409 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:29.503 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:39:29.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:29.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:29.636 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:29.636 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:30.113 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:30.113 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:30.114 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:30.117 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:30.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:30.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:30.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:30.211 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:30.296 INFO:teuthology.orchestra.run.smithi049.stdout:client4650 2023-12-19T05:39:30.297 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:30.297 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:30.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:30.360 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:30.451 INFO:teuthology.orchestra.run.smithi049.stdout:client4650 2023-12-19T05:39:30.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:30.451 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:30.543 INFO:teuthology.orchestra.run.smithi049.stdout:client4650 2023-12-19T05:39:30.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:30.544 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4650/status') 2023-12-19T05:39:30.673 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.4650 (3)192.168.0.1:0/3846793460 2023-12-19T05:39:30.673 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2023-12-19T05:39:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2023-12-19T05:39:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2023-12-19T05:39:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:69 bytes copied, 0.000103583 s, 666 kB/s 2023-12-19T05:39:30.678 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-19T05:39:30.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T05:39:30.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T05:39:30.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.916+0000 7fcf81f1b640 1 Processor -- start 2023-12-19T05:39:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.916+0000 7fcf81f1b640 1 -- start start 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.917+0000 7fcf81f1b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf7c157bf0 0x7fcf7c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.917+0000 7fcf81f1b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c15b740 con 0x7fcf7c0ae110 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.917+0000 7fcf81f1b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c0ae640 con 0x7fcf7c0b0810 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.917+0000 7fcf81f1b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c06b8c0 con 0x7fcf7c157bf0 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.918+0000 7fcf73fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcf7c0ae110 0x7fcf7c0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39470/0 (socket says 172.21.15.49:39470) 2023-12-19T05:39:30.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.918+0000 7fcf73fff640 1 -- 172.21.15.49:0/510229331 learned_addr learned my addr 172.21.15.49:0/510229331 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.918+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/510229331 >> v2:172.21.15.115:3300/0 conn(0x7fcf7c157bf0 0x7fcf7c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.918+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168988803 0 0) 0x7fcf7c15b740 con 0x7fcf7c0ae110 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.918+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf68003520 con 0x7fcf7c0ae110 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517944818 0 0) 0x7fcf68003520 con 0x7fcf7c0ae110 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 >> v2:172.21.15.115:3300/0 conn(0x7fcf7c157bf0 msgr2=0x7fcf7c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 --2- 172.21.15.49:0/510229331 >> v2:172.21.15.115:3300/0 conn(0x7fcf7c157bf0 0x7fcf7c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 >> v1:172.21.15.115:6789/0 conn(0x7fcf7c0b0810 legacy=0x7fcf7c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0ae920 con 0x7fcf7c0ae110 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fcf64001670 con 0x7fcf7c0ae110 2023-12-19T05:39:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 >> v1:172.21.15.49:6789/0 conn(0x7fcf7c0ae110 legacy=0x7fcf7c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf68005180 0x7fcf6800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06b8c0 con 0x7fcf680039e0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6800e2c0 con 0x7fcf68005180 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6800e480 con 0x7fcf680047c0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7bfff640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf68005180 0x7fcf6800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf73fff640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.919+0000 7fcf7b7fe640 1 -- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680047c0 msgr2=0x7fcf68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7b7fe640 1 -- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf68005180 msgr2=0x7fcf6800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf68005180 0x7fcf6800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7b7fe640 1 -- 172.21.15.49:0/510229331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68003520 con 0x7fcf680039e0 2023-12-19T05:39:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7bfff640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf68005180 0x7fcf6800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf7bfff640 1 -- 172.21.15.49:0/510229331 reap_dead start 2023-12-19T05:39:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.920+0000 7fcf73fff640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.921+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009ac0 tx=0x7fcf680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5a5729c2bb320b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.921+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c02c6b0 con 0x7fcf680039e0 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.921+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c02c810 con 0x7fcf680039e0 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.921+0000 7fcf7affd640 1 -- 172.21.15.49:0/510229331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c02cba0 con 0x7fcf680039e0 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 -- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 msgr2=0x7fcf68003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009ac0 tx=0x7fcf680057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 -- 172.21.15.49:0/510229331 shutdown_connections 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/510229331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 -- 172.21.15.49:0/510229331 >> 172.21.15.49:0/510229331 conn(0x7fcf7c0cbb70 msgr2=0x7fcf7c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 -- 172.21.15.49:0/510229331 shutdown_connections 2023-12-19T05:39:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.922+0000 7fcf81f1b640 1 -- 172.21.15.49:0/510229331 wait complete. 2023-12-19T05:39:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.924+0000 7fcf81f1b640 1 Processor -- start 2023-12-19T05:39:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.924+0000 7fcf81f1b640 1 -- start start 2023-12-19T05:39:30.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680039e0 0x7fcf7c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf7c1f6f80 0x7fcf7c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1f7480 con 0x7fcf7c1f4040 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c157fd0 con 0x7fcf7c1f6f80 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf81f1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c159ee0 con 0x7fcf680039e0 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47016/0 (socket says 172.21.15.49:47016) 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.925+0000 7fcf7bfff640 1 -- 172.21.15.49:0/987183394 learned_addr learned my addr 172.21.15.49:0/987183394 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf73fff640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf7c1f6f80 0x7fcf7c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680039e0 0x7fcf7c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 -- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680039e0 msgr2=0x7fcf7c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680039e0 0x7fcf7c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 -- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf7c1f6f80 msgr2=0x7fcf7c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf7c1f6f80 0x7fcf7c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 -- 172.21.15.49:0/987183394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0c2cc0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf7bfff640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06ea30 tx=0x7fcf7400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74003b70 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74003cd0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740052b0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.926+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c0c2fa0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.927+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c1f44b0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.928+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c0af1a0 con 0x7fcf7c1f4040 2023-12-19T05:39:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.929+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf74005410 con 0x7fcf7c1f4040 2023-12-19T05:39:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.930+0000 7fcf78ff9640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 0x7fcf5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.930+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf74088160 con 0x7fcf7c1f4040 2023-12-19T05:39:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.931+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 0x7fcf5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.932+0000 7fcf7b7fe640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 0x7fcf5c06c920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c036000 tx=0x7fcf6c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:30.935+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf7c0af1a0 con 0x7fcf7c1f4040 2023-12-19T05:39:31.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.168+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf7c158460 con 0x7fcf7c1f4040 2023-12-19T05:39:31.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.169+0000 7fcf78ff9640 1 -- 172.21.15.49:0/987183394 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf74018060 con 0x7fcf7c1f4040 2023-12-19T05:39:31.170 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 msgr2=0x7fcf5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 0x7fcf5c06c920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c036000 tx=0x7fcf6c030000 comp rx=0 tx=0).stop 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 msgr2=0x7fcf7c0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06ea30 tx=0x7fcf7400dc00 comp rx=0 tx=0).stop 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 shutdown_connections 2023-12-19T05:39:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf5c06a460 0x7fcf5c06c920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf7c1f4040 0x7fcf7c0cd940 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf7c1f6f80 0x7fcf7c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 --2- 172.21.15.49:0/987183394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf680039e0 0x7fcf7c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 >> 172.21.15.49:0/987183394 conn(0x7fcf7c0cbb70 msgr2=0x7fcf7c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.171+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 shutdown_connections 2023-12-19T05:39:31.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:31.172+0000 7fcf81f1b640 1 -- 172.21.15.49:0/987183394 wait complete. 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T05:39:31.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:31.194 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-19T05:39:31.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.194 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:39:31.252 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.269 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:39:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:39:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:31.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.273 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:31.378 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:39:31.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.383 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:39:31.434 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:39:31.434 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:31.434 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:39:31.434 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:39:31.434 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:31.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:39:31.435 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:31.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.635 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:39:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:39:31.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.692 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-12-19T05:39:31.744 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-19T05:39:31.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.745 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:31.745 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:31.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:39:31.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-19T05:39:31.745 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:31.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:31.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:45:3a:a8:db:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.015 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a045:3aff:fea8:dbc7/64 scope link 2023-12-19T05:39:32.016 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:32.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:32.128 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:45:3a:a8:db:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T05:39:32.129 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T05:39:32.129 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.129 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a045:3aff:fea8:dbc7/64 scope link 2023-12-19T05:39:32.129 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:32.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-19T05:39:32.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-19T05:39:32.133 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:32.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:32.448 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:39:32.448 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:39:32.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2023-12-19T05:39:32.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T05:39:32.448 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:39:32.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:32.643 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-19T05:39:32.695 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-19T05:39:32.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:32.695 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-19T05:39:32.746 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-19T05:39:32.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:32.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:32.882 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:32.882 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:32.918 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:32.918 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:32.918 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:39:32.918 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 2@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:39:32.918 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:39:32.921 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-19T05:39:32.922 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:32.922 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:32.922 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:32.922 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:32.926 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:32.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:32.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-19T05:39:33.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.032 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:33.094 INFO:teuthology.orchestra.run.smithi049.stdout:client4597 2023-12-19T05:39:33.094 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:33.094 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:33.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.151 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:33.213 INFO:teuthology.orchestra.run.smithi049.stdout:client4597 2023-12-19T05:39:33.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.213 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:33.276 INFO:teuthology.orchestra.run.smithi049.stdout:client4597 2023-12-19T05:39:33.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.276 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4597/status') 2023-12-19T05:39:33.386 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.4597 (3)172.21.15.49:0/1427824576 2023-12-19T05:39:33.386 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2023-12-19T05:39:33.387 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2023-12-19T05:39:33.387 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2023-12-19T05:39:33.387 INFO:teuthology.orchestra.run.smithi049.stderr:70 bytes copied, 0.000103433 s, 677 kB/s 2023-12-19T05:39:33.391 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-19T05:39:33.391 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T05:39:33.392 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:39:33.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.625+0000 7f1009068640 1 Processor -- start 2023-12-19T05:39:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.625+0000 7f1009068640 1 -- start start 2023-12-19T05:39:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.627+0000 7f1009068640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f100415e5a0 0x7f10040b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.627+0000 7f1009068640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f100415f680 0x7f10040b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.627+0000 7f1009068640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100415ec30 con 0x7f10040cdbf0 2023-12-19T05:39:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.627+0000 7f1009068640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10040b2cc0 con 0x7f100415e5a0 2023-12-19T05:39:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.627+0000 7f1009068640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100415e980 con 0x7f100415f680 2023-12-19T05:39:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.628+0000 7f1003fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f100415e5a0 0x7f10040b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.628+0000 7f10037fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f100415f680 0x7f10040b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.628+0000 7f1003fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f100415e5a0 0x7f10040b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:37588/0 (socket says 172.21.15.49:37588) 2023-12-19T05:39:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.628+0000 7f1003fff640 1 -- 172.21.15.49:0/1296531178 learned_addr learned my addr 172.21.15.49:0/1296531178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.629+0000 7f1003fff640 1 -- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f100415f680 msgr2=0x7f10040b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.629+0000 7f1003fff640 1 --2- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f100415f680 0x7f10040b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.629+0000 7f1003fff640 1 -- 172.21.15.49:0/1296531178 >> v1:172.21.15.115:6789/0 conn(0x7f10040cdbf0 legacy=0x7f100406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.629+0000 7f1003fff640 1 -- 172.21.15.49:0/1296531178 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040b2f90 con 0x7f100415e5a0 2023-12-19T05:39:33.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.630+0000 7f1003fff640 1 --2- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10040b2030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009870 tx=0x7f0ff402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718714cbf0b223aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1002ffd640 1 -- 172.21.15.49:0/1296531178 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4030840 con 0x7f100415e5a0 2023-12-19T05:39:33.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1002ffd640 1 -- 172.21.15.49:0/1296531178 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff40309a0 con 0x7f100415e5a0 2023-12-19T05:39:33.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1002ffd640 1 -- 172.21.15.49:0/1296531178 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4030d30 con 0x7f100415e5a0 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 -- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 msgr2=0x7f10040b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 --2- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10040b2030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009870 tx=0x7f0ff402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 -- 172.21.15.49:0/1296531178 shutdown_connections 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 --2- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f100415f680 0x7f10040b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 --2- 172.21.15.49:0/1296531178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10040b2030 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.631+0000 7f1009068640 1 -- 172.21.15.49:0/1296531178 >> 172.21.15.49:0/1296531178 conn(0x7f10040b0100 msgr2=0x7f10040b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.632+0000 7f1009068640 1 -- 172.21.15.49:0/1296531178 shutdown_connections 2023-12-19T05:39:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.632+0000 7f1009068640 1 -- 172.21.15.49:0/1296531178 wait complete. 2023-12-19T05:39:33.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.633+0000 7f1009068640 1 Processor -- start 2023-12-19T05:39:33.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.634+0000 7f1009068640 1 -- start start 2023-12-19T05:39:33.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10040cdbf0 0x7f100414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10041f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040cc830 con 0x7f100415f680 2023-12-19T05:39:33.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10041f3970 con 0x7f100415e5a0 2023-12-19T05:39:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1009068640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10041513b0 con 0x7f10040cdbf0 2023-12-19T05:39:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1008867640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1008867640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47030/0 (socket says 172.21.15.49:47030) 2023-12-19T05:39:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1008867640 1 -- 172.21.15.49:0/331820899 learned_addr learned my addr 172.21.15.49:0/331820899 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f1003fff640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10040cdbf0 0x7f100414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.635+0000 7f10037fe640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10041f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 -- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10040cdbf0 msgr2=0x7f100414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10040cdbf0 0x7f100414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 -- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 msgr2=0x7f10041f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10041f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 -- 172.21.15.49:0/331820899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40094d0 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1008867640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c7a0 tx=0x7f0ffc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc003b70 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc003cf0 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040cbcb0 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.636+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc003ea0 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.637+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10040cc270 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.638+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004061910 con 0x7f100415f680 2023-12-19T05:39:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.639+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ffc00aa90 con 0x7f100415f680 2023-12-19T05:39:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.639+0000 7f1000ff9640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 0x7f0ff006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.640+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ffc088800 con 0x7f100415f680 2023-12-19T05:39:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.640+0000 7f1003fff640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 0x7f0ff006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.641+0000 7f1003fff640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 0x7f0ff006c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4036000 tx=0x7f0ff4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.644+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ffc053d50 con 0x7f100415f680 2023-12-19T05:39:33.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.882+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10040ce980 con 0x7f100415f680 2023-12-19T05:39:33.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.883+0000 7f1000ff9640 1 -- 172.21.15.49:0/331820899 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ffc057370 con 0x7f100415f680 2023-12-19T05:39:33.884 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 msgr2=0x7f0ff006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 0x7f0ff006c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4036000 tx=0x7f0ff4008030 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 msgr2=0x7f100406f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c7a0 tx=0x7f0ffc00cc60 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 shutdown_connections 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ff006a430 0x7f0ff006c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100415f680 0x7f100406f8a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f100415e5a0 0x7f10041f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 --2- 172.21.15.49:0/331820899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10040cdbf0 0x7f100414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.885+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 >> 172.21.15.49:0/331820899 conn(0x7f10040b0100 msgr2=0x7f10040af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.886+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 shutdown_connections 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:33.886+0000 7f1009068640 1 -- 172.21.15.49:0/331820899 wait complete. 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:33.905 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:39:33.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.905 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:39:33.965 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:33.965 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:33.965 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:33.965 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:33.965 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42336sec preferred_lft 42336sec 2023-12-19T05:39:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:39:33.967 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:33.968 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T05:39:33.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T05:39:33.969 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:34.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:34.428 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:34.507 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:39:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:34.511 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:39:34.639 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:39:34.639 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:34.640 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:39:34.640 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:39:34.640 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:39:34.641 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:35.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:35.416 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:39:35.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:35.473 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-12-19T05:39:35.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:35.525 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:35.525 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:35.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:39:35.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T05:39:35.525 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:35.668 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T05:39:35.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T05:39:35.669 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:35.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:35.966 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:35.967 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:35.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:39:35.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T05:39:35.967 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:36.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:36.128 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:39:36.175 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:39:36.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:36.175 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:39:36.224 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:39:36.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:36.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:36.373 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:36.373 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:36.831 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:36.831 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:39:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:39:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:39:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:39:36.834 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:36.834 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:36.834 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:36.834 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:36.838 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:36.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:36.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:39:36.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:36.918 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:36.967 INFO:teuthology.orchestra.run.smithi115.stdout:client4609 2023-12-19T05:39:36.968 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:36.968 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:37.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:37.118 INFO:teuthology.orchestra.run.smithi115.stdout:client4609 2023-12-19T05:39:37.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:37.176 INFO:teuthology.orchestra.run.smithi115.stdout:client4609 2023-12-19T05:39:37.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4609/status') 2023-12-19T05:39:37.268 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4609 (3)192.168.0.1:0/299935382 2023-12-19T05:39:37.268 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-12-19T05:39:37.269 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-12-19T05:39:37.269 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-12-19T05:39:37.269 INFO:teuthology.orchestra.run.smithi115.stderr:68 bytes copied, 8.951e-05 s, 760 kB/s 2023-12-19T05:39:37.272 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-19T05:39:37.272 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T05:39:37.272 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T05:39:37.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:37.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.516+0000 7f11312b6640 1 Processor -- start 2023-12-19T05:39:37.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.517+0000 7f11312b6640 1 -- start start 2023-12-19T05:39:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.518+0000 7f11312b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f112c0d2b00 0x7f112c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.518+0000 7f11312b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.518+0000 7f11312b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c0cd840 con 0x7f112c146e10 2023-12-19T05:39:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.518+0000 7f11312b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0d2430 con 0x7f112c0d2b00 2023-12-19T05:39:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.518+0000 7f11312b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0ceac0 con 0x7f112c0ce110 2023-12-19T05:39:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.519+0000 7f112b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.519+0000 7f112b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50500/0 (socket says 172.21.15.49:50500) 2023-12-19T05:39:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.519+0000 7f112b7fe640 1 -- 172.21.15.49:0/1417287133 learned_addr learned my addr 172.21.15.49:0/1417287133 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.519+0000 7f112a7fc640 1 --2- 172.21.15.49:0/1417287133 >> v2:172.21.15.115:3300/0 conn(0x7f112c0d2b00 0x7f112c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.520+0000 7f112b7fe640 1 -- 172.21.15.49:0/1417287133 >> v2:172.21.15.115:3300/0 conn(0x7f112c0d2b00 msgr2=0x7f112c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.520+0000 7f112b7fe640 1 --2- 172.21.15.49:0/1417287133 >> v2:172.21.15.115:3300/0 conn(0x7f112c0d2b00 0x7f112c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.520+0000 7f112b7fe640 1 -- 172.21.15.49:0/1417287133 >> v1:172.21.15.115:6789/0 conn(0x7f112c146e10 legacy=0x7f112c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.520+0000 7f112b7fe640 1 -- 172.21.15.49:0/1417287133 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0b6e90 con 0x7f112c0ce110 2023-12-19T05:39:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.521+0000 7f112b7fe640 1 --2- 172.21.15.49:0/1417287133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1124009870 tx=0x7f112402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c98bdac4d372ce2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.522+0000 7f1129ffb640 1 -- 172.21.15.49:0/1417287133 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124030840 con 0x7f112c0ce110 2023-12-19T05:39:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.522+0000 7f1129ffb640 1 -- 172.21.15.49:0/1417287133 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11240309a0 con 0x7f112c0ce110 2023-12-19T05:39:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.522+0000 7f1129ffb640 1 -- 172.21.15.49:0/1417287133 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124030d30 con 0x7f112c0ce110 2023-12-19T05:39:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.522+0000 7f11312b6640 1 -- 172.21.15.49:0/1417287133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 msgr2=0x7f112c0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.522+0000 7f11312b6640 1 --2- 172.21.15.49:0/1417287133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1124009870 tx=0x7f112402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 -- 172.21.15.49:0/1417287133 shutdown_connections 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 --2- 172.21.15.49:0/1417287133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c0ce580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 --2- 172.21.15.49:0/1417287133 >> v2:172.21.15.115:3300/0 conn(0x7f112c0d2b00 0x7f112c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 -- 172.21.15.49:0/1417287133 >> 172.21.15.49:0/1417287133 conn(0x7f112c0b29c0 msgr2=0x7f112c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 -- 172.21.15.49:0/1417287133 shutdown_connections 2023-12-19T05:39:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.523+0000 7f11312b6640 1 -- 172.21.15.49:0/1417287133 wait complete. 2023-12-19T05:39:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.525+0000 7f11312b6640 1 Processor -- start 2023-12-19T05:39:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.525+0000 7f11312b6640 1 -- start start 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c13cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c146e10 0x7f112c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c13ef00 con 0x7f112c0d2b00 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c13e2c0 con 0x7f112c146e10 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f11312b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c13e560 con 0x7f112c0ce110 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48036/0 (socket says 172.21.15.49:48036) 2023-12-19T05:39:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 -- 172.21.15.49:0/2185568398 learned_addr learned my addr 172.21.15.49:0/2185568398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112affd640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c13cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112b7fe640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c146e10 0x7f112c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 -- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 msgr2=0x7f112c13cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c13cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 -- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c146e10 msgr2=0x7f112c15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c146e10 0x7f112c15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112a7fc640 1 -- 172.21.15.49:0/2185568398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240094d0 con 0x7f112c0d2b00 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.526+0000 7f112affd640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c13cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f112a7fc640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f111400e9b0 tx=0x7f111400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114009670 con 0x7f112c0d2b00 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400c9a0 con 0x7f112c0d2b00 2023-12-19T05:39:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400cd50 con 0x7f112c0d2b00 2023-12-19T05:39:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c13e840 con 0x7f112c0d2b00 2023-12-19T05:39:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.527+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c13d320 con 0x7f112c0d2b00 2023-12-19T05:39:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.528+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c13f040 con 0x7f112c0d2b00 2023-12-19T05:39:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.529+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1114013470 con 0x7f112c0d2b00 2023-12-19T05:39:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.530+0000 7f11237fe640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 0x7f110c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.530+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1114088c10 con 0x7f112c0d2b00 2023-12-19T05:39:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.531+0000 7f112affd640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 0x7f110c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.532+0000 7f112affd640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 0x7f110c06c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f111c0012e0 tx=0x7f111c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.535+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f112c13f040 con 0x7f112c0d2b00 2023-12-19T05:39:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.770+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f112c13f040 con 0x7f112c0d2b00 2023-12-19T05:39:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.771+0000 7f11237fe640 1 -- 172.21.15.49:0/2185568398 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f112c13f040 con 0x7f112c0d2b00 2023-12-19T05:39:37.773 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 msgr2=0x7f110c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 0x7f110c06c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f111c0012e0 tx=0x7f111c009040 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 msgr2=0x7f112c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f111400e9b0 tx=0x7f111400ee70 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 shutdown_connections 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f110c06a430 0x7f110c06c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c146e10 0x7f112c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c0d2b00 0x7f112c15f230 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 --2- 172.21.15.49:0/2185568398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c0ce110 0x7f112c13cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 >> 172.21.15.49:0/2185568398 conn(0x7f112c0b29c0 msgr2=0x7f112c0d3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.774+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 shutdown_connections 2023-12-19T05:39:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:37.775+0000 7f11312b6640 1 -- 172.21.15.49:0/2185568398 wait complete. 2023-12-19T05:39:37.794 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T05:39:37.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:37.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:37.795 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-19T05:39:37.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.795 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:37.854 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:39:37.855 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:37.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.856 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:37.938 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:39:37.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.943 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:37.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:39:37.993 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:38.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.169 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:39:38.219 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:39:38.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.220 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-12-19T05:39:38.271 INFO:teuthology.orchestra.run.smithi115.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-19T05:39:38.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.273 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:38.273 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:38.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:39:38.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-19T05:39:38.273 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:38.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T05:39:38.510 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:38.510 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:38.510 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:38.510 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 6e:81:78:65:f7:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::6c81:78ff:fe65:f707/64 scope link 2023-12-19T05:39:38.512 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T05:39:38.608 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:38.608 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:38.608 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:38.608 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 6e:81:78:65:f7:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::6c81:78ff:fe65:f707/64 scope link 2023-12-19T05:39:38.609 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:38.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-19T05:39:38.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.613 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:38.613 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-19T05:39:38.614 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:38.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:38.883 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:39:38.883 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:39:38.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.1 up 2023-12-19T05:39:38.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T05:39:38.884 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:39:39.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:39.057 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-19T05:39:39.107 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-19T05:39:39.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:39.107 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-19T05:39:39.161 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-19T05:39:39.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:39.304 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:39.304 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:39.335 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:39:39.335 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:39:39.336 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:39:39.336 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 3@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:39:39.336 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:39:39.337 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-19T05:39:39.337 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:39.337 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:39.337 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:39.337 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:39.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:39.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-19T05:39:39.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.428 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:39.483 INFO:teuthology.orchestra.run.smithi115.stdout:client4466 2023-12-19T05:39:39.483 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:39.483 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:39.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.534 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:39.638 INFO:teuthology.orchestra.run.smithi115.stdout:client4466 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:39.694 INFO:teuthology.orchestra.run.smithi115.stdout:client4466 2023-12-19T05:39:39.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:39.694 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4466/status') 2023-12-19T05:39:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4466 (3)192.168.0.2:0/2127034987 2023-12-19T05:39:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-12-19T05:39:39.783 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-12-19T05:39:39.783 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-12-19T05:39:39.783 INFO:teuthology.orchestra.run.smithi115.stderr:69 bytes copied, 6.491e-05 s, 1.1 MB/s 2023-12-19T05:39:39.787 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T05:39:39.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.047+0000 7fb20140e640 1 Processor -- start 2023-12-19T05:39:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.048+0000 7fb20140e640 1 -- start start 2023-12-19T05:39:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.049+0000 7fb20140e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1fc15aa70 0x7fb1fc164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.049+0000 7fb20140e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc06b520 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.049+0000 7fb20140e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0b2b20 con 0x7fb1fc159f80 2023-12-19T05:39:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.049+0000 7fb20140e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b2fb0 con 0x7fb1fc15aa70 2023-12-19T05:39:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.050+0000 7fb1fb7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb1fc15b1e0 0x7fb1fc15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56426/0 (socket says 172.21.15.49:56426) 2023-12-19T05:39:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.050+0000 7fb1fb7fe640 1 -- 172.21.15.49:0/1610844503 learned_addr learned my addr 172.21.15.49:0/1610844503 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.050+0000 7fb200c0d640 1 --2- 172.21.15.49:0/1610844503 >> v2:172.21.15.115:3300/0 conn(0x7fb1fc15aa70 0x7fb1fc164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.050+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930774493 0 0) 0x7fb1fc06b520 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.050+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e4003520 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223864370 0 0) 0x7fb1e4003520 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 >> v2:172.21.15.115:3300/0 conn(0x7fb1fc15aa70 msgr2=0x7fb1fc164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 --2- 172.21.15.49:0/1610844503 >> v2:172.21.15.115:3300/0 conn(0x7fb1fc15aa70 0x7fb1fc164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 >> v1:172.21.15.115:6789/0 conn(0x7fb1fc159f80 legacy=0x7fb1fc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0b1f10 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb1f0001670 con 0x7fb1fc15b1e0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 >> v1:172.21.15.49:6789/0 conn(0x7fb1fc15b1e0 legacy=0x7fb1fc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1e40047c0 0x7fb1e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e4005180 0x7fb1e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b2fb0 con 0x7fb1e40039c0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400c060 con 0x7fb1e4005180 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400c220 con 0x7fb1e40047c0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.051+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb200c0d640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e4005180 0x7fb1e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1e40047c0 0x7fb1e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fbfff640 1 -- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1e40047c0 msgr2=0x7fb1e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1e40047c0 0x7fb1e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fbfff640 1 -- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e4005180 msgr2=0x7fb1e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e4005180 0x7fb1e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fbfff640 1 -- 172.21.15.49:0/1610844503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4003520 con 0x7fb1e40039c0 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1e40047c0 0x7fb1e4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb200c0d640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e4005180 0x7fb1e400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.052+0000 7fb200c0d640 1 -- 172.21.15.49:0/1610844503 reap_dead start 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.053+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1e4003de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec001e50 tx=0x7fb1e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2205683299e29c4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.053+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec003b70 con 0x7fb1e40039c0 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.053+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec003cd0 con 0x7fb1e40039c0 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.053+0000 7fb1faffd640 1 -- 172.21.15.49:0/1610844503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec005310 con 0x7fb1e40039c0 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 -- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 msgr2=0x7fb1e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1e4003de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec001e50 tx=0x7fb1e40057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 -- 172.21.15.49:0/1610844503 shutdown_connections 2023-12-19T05:39:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 --2- 172.21.15.49:0/1610844503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1e4003de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 -- 172.21.15.49:0/1610844503 >> 172.21.15.49:0/1610844503 conn(0x7fb1fc0b0100 msgr2=0x7fb1fc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 -- 172.21.15.49:0/1610844503 shutdown_connections 2023-12-19T05:39:40.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.054+0000 7fb20140e640 1 -- 172.21.15.49:0/1610844503 wait complete. 2023-12-19T05:39:40.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.056+0000 7fb20140e640 1 Processor -- start 2023-12-19T05:39:40.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.056+0000 7fb20140e640 1 -- start start 2023-12-19T05:39:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 0x7fb1fc0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 0x7fb1fc148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc14d4c0 con 0x7fb1e40039c0 2023-12-19T05:39:40.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1493a0 con 0x7fb1fc1489e0 2023-12-19T05:39:40.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb20140e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc149e10 con 0x7fb1fc149590 2023-12-19T05:39:40.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48046/0 (socket says 172.21.15.49:48046) 2023-12-19T05:39:40.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.057+0000 7fb1fbfff640 1 -- 172.21.15.49:0/2446756863 learned_addr learned my addr 172.21.15.49:0/2446756863 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb200c0d640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 0x7fb1fc148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 -- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 msgr2=0x7fb1fc0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 0x7fb1fc0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 0x7fb1fc0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 -- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 msgr2=0x7fb1fc148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 0x7fb1fc148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 -- 172.21.15.49:0/2446756863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc14c840 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 0x7fb1fc0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb200c0d640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 0x7fb1fc148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.058+0000 7fb1fbfff640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000f80 tx=0x7fb1ec0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.059+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec03e070 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.059+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec02f440 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.059+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc14cb20 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.059+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec02f7b0 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.059+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc14d0e0 con 0x7fb1e40039c0 2023-12-19T05:39:40.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.060+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc061910 con 0x7fb1e40039c0 2023-12-19T05:39:40.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.061+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb1ec02f910 con 0x7fb1e40039c0 2023-12-19T05:39:40.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.062+0000 7fb1f8ff9640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 0x7fb1e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.062+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1ec0aa0f0 con 0x7fb1e40039c0 2023-12-19T05:39:40.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.063+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 0x7fb1e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.064+0000 7fb1fb7fe640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 0x7fb1e806c920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000ff0 tx=0x7fb1f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.067+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1ec0758a0 con 0x7fb1e40039c0 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.262+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1fc0cd890 con 0x7fb1e40039c0 2023-12-19T05:39:40.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.265+0000 7fb1f8ff9640 1 -- 172.21.15.49:0/2446756863 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fb1ec047090 con 0x7fb1e40039c0 2023-12-19T05:39:40.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:40.267 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 msgr2=0x7fb1e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 0x7fb1e806c920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000ff0 tx=0x7fb1f0009040 comp rx=0 tx=0).stop 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 msgr2=0x7fb1fc14a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000f80 tx=0x7fb1ec0014a0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 shutdown_connections 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1e806a460 0x7fb1e806c920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1fc149590 0x7fb1fc0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1fc1489e0 0x7fb1fc148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 --2- 172.21.15.49:0/2446756863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40039c0 0x7fb1fc14a310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.267+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 >> 172.21.15.49:0/2446756863 conn(0x7fb1fc0b0100 msgr2=0x7fb1fc06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.268+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 shutdown_connections 2023-12-19T05:39:40.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.268+0000 7fb20140e640 1 -- 172.21.15.49:0/2446756863 wait complete. 2023-12-19T05:39:40.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:40.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:40.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.514+0000 7f7420438640 1 Processor -- start 2023-12-19T05:39:40.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.515+0000 7f7420438640 1 -- start start 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.516+0000 7f7420438640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74180b2510 0x7f74180b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.516+0000 7f7420438640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180b0350 con 0x7f7418157c10 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f7420438640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180b2e60 con 0x7f74180af720 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f7420438640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741815da50 con 0x7f74180b2510 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f741e1d4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7418157c10 0x7f74180b4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56436/0 (socket says 172.21.15.49:56436) 2023-12-19T05:39:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f741e1d4640 1 -- 172.21.15.49:0/90751795 learned_addr learned my addr 172.21.15.49:0/90751795 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f741e9d5640 1 --2- 172.21.15.49:0/90751795 >> v2:172.21.15.115:3300/0 conn(0x7f74180b2510 0x7f74180b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871163015 0 0) 0x7f7414001110 con 0x7f7418157c10 2023-12-19T05:39:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.517+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7404003520 con 0x7f7418157c10 2023-12-19T05:39:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491559226 0 0) 0x7f7404003520 con 0x7f7418157c10 2023-12-19T05:39:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 >> v2:172.21.15.115:3300/0 conn(0x7f74180b2510 msgr2=0x7f74180b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 --2- 172.21.15.49:0/90751795 >> v2:172.21.15.115:3300/0 conn(0x7f74180b2510 0x7f74180b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 >> v1:172.21.15.115:6789/0 conn(0x7f74180af720 legacy=0x7f741815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180afd90 con 0x7f7418157c10 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f7414001800 con 0x7f7418157c10 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 >> v1:172.21.15.49:6789/0 conn(0x7f7418157c10 legacy=0x7f74180b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 0x7f7404004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7404005180 0x7f740400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741815da50 con 0x7f74040047c0 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740400c0b0 con 0x7f7404005180 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740400c270 con 0x7f74040039e0 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.518+0000 7f741d9d3640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 0x7f7404004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741e1d4640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741d9d3640 1 -- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74040039e0 msgr2=0x7f7404003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741d9d3640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741d9d3640 1 -- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7404005180 msgr2=0x7f740400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741e9d5640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7404005180 0x7f740400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741d9d3640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7404005180 0x7f740400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741d9d3640 1 -- 172.21.15.49:0/90751795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404003520 con 0x7f74040047c0 2023-12-19T05:39:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.519+0000 7f741e9d5640 1 -- 172.21.15.49:0/90751795 reap_dead start 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.520+0000 7f741d9d3640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 0x7f7404004c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7408001750 tx=0x7f74040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead8b23845d9ef37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.520+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080052d0 con 0x7f74040047c0 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.520+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740802e050 con 0x7f74040047c0 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.520+0000 7f741d1d2640 1 -- 172.21.15.49:0/90751795 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408003830 con 0x7f74040047c0 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 -- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 msgr2=0x7f7404004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 0x7f7404004c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7408001750 tx=0x7f74040057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 -- 172.21.15.49:0/90751795 shutdown_connections 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 --2- 172.21.15.49:0/90751795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74040047c0 0x7f7404004c40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 -- 172.21.15.49:0/90751795 >> 172.21.15.49:0/90751795 conn(0x7f741806ba40 msgr2=0x7f741806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 -- 172.21.15.49:0/90751795 shutdown_connections 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.521+0000 7f7420438640 1 -- 172.21.15.49:0/90751795 wait complete. 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.523+0000 7f7420438640 1 Processor -- start 2023-12-19T05:39:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.523+0000 7f7420438640 1 -- start start 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74040047c0 0x7f74180d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7418147ef0 0x7f741815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180cb4b0 con 0x7f7418154180 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180cb940 con 0x7f74040047c0 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f7420438640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ca8a0 con 0x7f7418147ef0 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48052/0 (socket says 172.21.15.49:48052) 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 -- 172.21.15.49:0/1122545535 learned_addr learned my addr 172.21.15.49:0/1122545535 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 -- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7418147ef0 msgr2=0x7f741815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7418147ef0 0x7f741815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 -- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74040047c0 msgr2=0x7f74180d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74040047c0 0x7f74180d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.524+0000 7f741d9d3640 1 -- 172.21.15.49:0/1122545535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180cab80 con 0x7f7418154180 2023-12-19T05:39:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f741d9d3640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f740802bc00 tx=0x7f7408001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408007a30 con 0x7f7418154180 2023-12-19T05:39:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408007640 con 0x7f7418154180 2023-12-19T05:39:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180cae60 con 0x7f7418154180 2023-12-19T05:39:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408006be0 con 0x7f7418154180 2023-12-19T05:39:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.525+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74180d0780 con 0x7f7418154180 2023-12-19T05:39:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.526+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418061910 con 0x7f7418154180 2023-12-19T05:39:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.528+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7408006d40 con 0x7f7418154180 2023-12-19T05:39:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.529+0000 7f740effd640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 0x7f73fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.529+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74080aa930 con 0x7f7418154180 2023-12-19T05:39:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.530+0000 7f741e1d4640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 0x7f73fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.531+0000 7f741e1d4640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 0x7f73fc06c920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7414001270 tx=0x7f74140012e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.532+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7408075f00 con 0x7f7418154180 2023-12-19T05:39:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.729+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74180cb5f0 con 0x7f7418154180 2023-12-19T05:39:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.730+0000 7f740effd640 1 -- 172.21.15.49:0/1122545535 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7408079520 con 0x7f7418154180 2023-12-19T05:39:40.731 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 msgr2=0x7f73fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 0x7f73fc06c920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7414001270 tx=0x7f74140012e0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 msgr2=0x7f741815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f740802bc00 tx=0x7f7408001120 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 shutdown_connections 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f73fc06a460 0x7f73fc06c920 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7418147ef0 0x7f741815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7418154180 0x7f741815b650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 --2- 172.21.15.49:0/1122545535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74040047c0 0x7f74180d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 >> 172.21.15.49:0/1122545535 conn(0x7f741806ba40 msgr2=0x7f74180b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 shutdown_connections 2023-12-19T05:39:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.733+0000 7f7420438640 1 -- 172.21.15.49:0/1122545535 wait complete. 2023-12-19T05:39:40.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:40.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.984+0000 7ff4f7fff640 1 Processor -- start 2023-12-19T05:39:40.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.984+0000 7ff4f7fff640 1 -- start start 2023-12-19T05:39:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.986+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.986+0000 7ff4f7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4f8160dc0 0x7ff4f8161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.986+0000 7ff4f7fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f815d7d0 con 0x7ff4f8157710 2023-12-19T05:39:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.986+0000 7ff4f7fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80b0ce0 con 0x7ff4f8160dc0 2023-12-19T05:39:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.986+0000 7ff4f7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b2ea0 con 0x7ff4f80b02f0 2023-12-19T05:39:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50540/0 (socket says 172.21.15.49:50540) 2023-12-19T05:39:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 -- 172.21.15.49:0/1925883472 learned_addr learned my addr 172.21.15.49:0/1925883472 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f77fe640 1 --2- 172.21.15.49:0/1925883472 >> v2:172.21.15.115:3300/0 conn(0x7ff4f8160dc0 0x7ff4f8161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 -- 172.21.15.49:0/1925883472 >> v2:172.21.15.115:3300/0 conn(0x7ff4f8160dc0 msgr2=0x7ff4f8161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 --2- 172.21.15.49:0/1925883472 >> v2:172.21.15.115:3300/0 conn(0x7ff4f8160dc0 0x7ff4f8161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 -- 172.21.15.49:0/1925883472 >> v1:172.21.15.115:6789/0 conn(0x7ff4f8157710 legacy=0x7ff4f80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.987+0000 7ff4f67fc640 1 -- 172.21.15.49:0/1925883472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f815da90 con 0x7ff4f80b02f0 2023-12-19T05:39:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.989+0000 7ff4f67fc640 1 --2- 172.21.15.49:0/1925883472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009870 tx=0x7ff4ec02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51eae065deba6a1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.989+0000 7ff4f5ffb640 1 -- 172.21.15.49:0/1925883472 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0317c0 con 0x7ff4f80b02f0 2023-12-19T05:39:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.989+0000 7ff4f5ffb640 1 -- 172.21.15.49:0/1925883472 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec031920 con 0x7ff4f80b02f0 2023-12-19T05:39:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.989+0000 7ff4f5ffb640 1 -- 172.21.15.49:0/1925883472 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec031cb0 con 0x7ff4f80b02f0 2023-12-19T05:39:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 -- 172.21.15.49:0/1925883472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 msgr2=0x7ff4f80b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/1925883472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009870 tx=0x7ff4ec02b860 comp rx=0 tx=0).stop 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 -- 172.21.15.49:0/1925883472 shutdown_connections 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/1925883472 >> v2:172.21.15.115:3300/0 conn(0x7ff4f8160dc0 0x7ff4f8161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/1925883472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f80b02f0 0x7ff4f80b07a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.990+0000 7ff4f7fff640 1 -- 172.21.15.49:0/1925883472 >> 172.21.15.49:0/1925883472 conn(0x7ff4f80659a0 msgr2=0x7ff4f8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.991+0000 7ff4f7fff640 1 -- 172.21.15.49:0/1925883472 shutdown_connections 2023-12-19T05:39:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.991+0000 7ff4f7fff640 1 -- 172.21.15.49:0/1925883472 wait complete. 2023-12-19T05:39:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.992+0000 7ff4f7fff640 1 Processor -- start 2023-12-19T05:39:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.993+0000 7ff4f7fff640 1 -- start start 2023-12-19T05:39:40.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.993+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f80b02f0 0x7ff4f8154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.993+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f8160dc0 0x7ff4f8154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f7fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80cd2d0 con 0x7ff4f8157710 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f7fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f806cb70 con 0x7ff4f80b02f0 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8154640 con 0x7ff4f8160dc0 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48066/0 (socket says 172.21.15.49:48066) 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 -- 172.21.15.49:0/3944964669 learned_addr learned my addr 172.21.15.49:0/3944964669 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f6ffd640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f80b02f0 0x7ff4f8154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f77fe640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f8160dc0 0x7ff4f8154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 -- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f8160dc0 msgr2=0x7ff4f8154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f8160dc0 0x7ff4f8154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 -- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f80b02f0 msgr2=0x7ff4f8154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f80b02f0 0x7ff4f8154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.994+0000 7ff4f67fc640 1 -- 172.21.15.49:0/3944964669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0094d0 con 0x7ff4f8157710 2023-12-19T05:39:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4f67fc640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec02b8a0 tx=0x7ff4ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec032860 con 0x7ff4f8157710 2023-12-19T05:39:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec032a00 con 0x7ff4f8157710 2023-12-19T05:39:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80ccd10 con 0x7ff4f8157710 2023-12-19T05:39:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec032db0 con 0x7ff4f8157710 2023-12-19T05:39:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.995+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f806be30 con 0x7ff4f8157710 2023-12-19T05:39:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.997+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f806bc90 con 0x7ff4f8157710 2023-12-19T05:39:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.997+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4ec04e450 con 0x7ff4f8157710 2023-12-19T05:39:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.998+0000 7ff4dffff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 0x7ff4e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.998+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec0aaad0 con 0x7ff4f8157710 2023-12-19T05:39:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:40.999+0000 7ff4f6ffd640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 0x7ff4e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.000+0000 7ff4f6ffd640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 0x7ff4e406c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815af90 tx=0x7ff4e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.003+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4f806bc90 con 0x7ff4f8157710 2023-12-19T05:39:41.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.189+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4f806bc90 con 0x7ff4f8157710 2023-12-19T05:39:41.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.190+0000 7ff4dffff640 1 -- 172.21.15.49:0/3944964669 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4f806bc90 con 0x7ff4f8157710 2023-12-19T05:39:41.191 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:41.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 msgr2=0x7ff4e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 0x7ff4e406c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815af90 tx=0x7ff4e8009040 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 msgr2=0x7ff4f806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec02b8a0 tx=0x7ff4ec0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 shutdown_connections 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a430 0x7ff4e406c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4f8160dc0 0x7ff4f8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f8157710 0x7ff4f806c630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 --2- 172.21.15.49:0/3944964669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f80b02f0 0x7ff4f8154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 >> 172.21.15.49:0/3944964669 conn(0x7ff4f80659a0 msgr2=0x7ff4f80b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 shutdown_connections 2023-12-19T05:39:41.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.192+0000 7ff4f7fff640 1 -- 172.21.15.49:0/3944964669 wait complete. 2023-12-19T05:39:41.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:41.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.430+0000 7ff8aaf1b640 1 Processor -- start 2023-12-19T05:39:41.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.430+0000 7ff8aaf1b640 1 -- start start 2023-12-19T05:39:41.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.432+0000 7ff8aaf1b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8a4154760 0x7ff8a415b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.432+0000 7ff8aaf1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.432+0000 7ff8aaf1b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40ccbd0 con 0x7ff8a40b0070 2023-12-19T05:39:41.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.432+0000 7ff8aaf1b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40ccf20 con 0x7ff8a4154760 2023-12-19T05:39:41.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.432+0000 7ff8aaf1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4154b40 con 0x7ff8a40cb810 2023-12-19T05:39:41.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50556/0 (socket says 172.21.15.49:50556) 2023-12-19T05:39:41.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 -- 172.21.15.49:0/1082283237 learned_addr learned my addr 172.21.15.49:0/1082283237 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:41.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a8cb7640 1 --2- 172.21.15.49:0/1082283237 >> v2:172.21.15.115:3300/0 conn(0x7ff8a4154760 0x7ff8a415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 -- 172.21.15.49:0/1082283237 >> v2:172.21.15.115:3300/0 conn(0x7ff8a4154760 msgr2=0x7ff8a415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1082283237 >> v2:172.21.15.115:3300/0 conn(0x7ff8a4154760 0x7ff8a415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 -- 172.21.15.49:0/1082283237 >> v1:172.21.15.115:6789/0 conn(0x7ff8a40b0070 legacy=0x7ff8a40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.433+0000 7ff8a3fff640 1 -- 172.21.15.49:0/1082283237 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40cc060 con 0x7ff8a40cb810 2023-12-19T05:39:41.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.435+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1082283237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff890009870 tx=0x7ff89002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0e3c20a4e40c09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.435+0000 7ff8a37fe640 1 -- 172.21.15.49:0/1082283237 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890031640 con 0x7ff8a40cb810 2023-12-19T05:39:41.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.435+0000 7ff8a37fe640 1 -- 172.21.15.49:0/1082283237 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8900317a0 con 0x7ff8a40cb810 2023-12-19T05:39:41.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.435+0000 7ff8a37fe640 1 -- 172.21.15.49:0/1082283237 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890031b30 con 0x7ff8a40cb810 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1082283237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 msgr2=0x7ff8a40b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1082283237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff890009870 tx=0x7ff89002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1082283237 shutdown_connections 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1082283237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a40b1440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1082283237 >> v2:172.21.15.115:3300/0 conn(0x7ff8a4154760 0x7ff8a415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1082283237 >> 172.21.15.49:0/1082283237 conn(0x7ff8a4073150 msgr2=0x7ff8a40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1082283237 shutdown_connections 2023-12-19T05:39:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.436+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1082283237 wait complete. 2023-12-19T05:39:41.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.438+0000 7ff8aaf1b640 1 Processor -- start 2023-12-19T05:39:41.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.438+0000 7ff8aaf1b640 1 -- start start 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 0x7ff8a40af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a406da60 con 0x7ff8a40b0070 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4156b00 con 0x7ff8a4154760 2023-12-19T05:39:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8aaf1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4156d80 con 0x7ff8a40cb810 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8a8cb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8a8cb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48068/0 (socket says 172.21.15.49:48068) 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.439+0000 7ff8a8cb7640 1 -- 172.21.15.49:0/1750733223 learned_addr learned my addr 172.21.15.49:0/1750733223 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a94b8640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 0x7ff8a40af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 -- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 msgr2=0x7ff8a4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 -- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 msgr2=0x7ff8a40af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 0x7ff8a40af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 -- 172.21.15.49:0/1750733223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900094d0 con 0x7ff8a40b0070 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a94b8640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 0x7ff8a40af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a8cb7640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff89800e870 tx=0x7ff89800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8980094f0 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800c940 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800ccf0 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.440+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a4157060 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.441+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a4157620 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.442+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4061910 con 0x7ff8a40b0070 2023-12-19T05:39:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.443+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff898013470 con 0x7ff8a40b0070 2023-12-19T05:39:41.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.444+0000 7ff8a17fa640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 0x7ff88806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.444+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8980889f0 con 0x7ff8a40b0070 2023-12-19T05:39:41.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.445+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 0x7ff88806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.446+0000 7ff8a3fff640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 0x7ff88806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff890036000 tx=0x7ff89003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.449+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff898053fe0 con 0x7ff8a40b0070 2023-12-19T05:39:41.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.641+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8a415e820 con 0x7ff8a40b0070 2023-12-19T05:39:41.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.642+0000 7ff8a17fa640 1 -- 172.21.15.49:0/1750733223 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8980210a0 con 0x7ff8a40b0070 2023-12-19T05:39:41.643 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.644+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 msgr2=0x7ff88806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.644+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 0x7ff88806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff890036000 tx=0x7ff89003c040 comp rx=0 tx=0).stop 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 msgr2=0x7ff8a414b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff89800e870 tx=0x7ff89800ed30 comp rx=0 tx=0).stop 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 shutdown_connections 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff88806a430 0x7ff88806c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8a40cb810 0x7ff8a4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8a4154760 0x7ff8a40af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 --2- 172.21.15.49:0/1750733223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8a40b0070 0x7ff8a414b5b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 >> 172.21.15.49:0/1750733223 conn(0x7ff8a4073150 msgr2=0x7ff8a40cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 shutdown_connections 2023-12-19T05:39:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.645+0000 7ff8aaf1b640 1 -- 172.21.15.49:0/1750733223 wait complete. 2023-12-19T05:39:41.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:41.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.891+0000 7f61db347640 1 Processor -- start 2023-12-19T05:39:41.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.892+0000 7f61db347640 1 -- start start 2023-12-19T05:39:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.893+0000 7f61db347640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61d40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.893+0000 7f61db347640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40cd840 con 0x7f61d40ce110 2023-12-19T05:39:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.893+0000 7f61db347640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40b6e90 con 0x7f61d40d2b00 2023-12-19T05:39:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.893+0000 7f61db347640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40d2430 con 0x7f61d4146e10 2023-12-19T05:39:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.894+0000 7f61d98e4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f61d40ce110 0x7f61d40b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56442/0 (socket says 172.21.15.49:56442) 2023-12-19T05:39:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.894+0000 7f61d98e4640 1 -- 172.21.15.49:0/443508 learned_addr learned my addr 172.21.15.49:0/443508 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.894+0000 7f61d90e3640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61d40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.894+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478353315 0 0) 0x7f61d40cd840 con 0x7f61d40ce110 2023-12-19T05:39:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.894+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003520 con 0x7f61d40ce110 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517693798 0 0) 0x7f61c0003520 con 0x7f61d40ce110 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 msgr2=0x7f61d40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61d40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 >> v1:172.21.15.115:6789/0 conn(0x7f61d40d2b00 legacy=0x7f61d40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40d2620 con 0x7f61d40ce110 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f61cc0019f0 con 0x7f61d40ce110 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 >> v1:172.21.15.49:6789/0 conn(0x7f61d40ce110 legacy=0x7f61d40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61c0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0003f90 0x7f61c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0004d00 0x7f61c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000bab0 con 0x7f61c0003f90 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000bc20 con 0x7f61c0004d00 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000bde0 con 0x7f61d4146e10 2023-12-19T05:39:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.895+0000 7f61d88e2640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0003f90 0x7f61c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d90e3640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61c0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d98e4640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0004d00 0x7f61c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d88e2640 1 -- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 msgr2=0x7f61c0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d88e2640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4146e10 0x7f61c0003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d88e2640 1 -- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0004d00 msgr2=0x7f61c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d88e2640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0004d00 0x7f61c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d88e2640 1 -- 172.21.15.49:0/443508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0003520 con 0x7f61c0003f90 2023-12-19T05:39:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.896+0000 7f61d98e4640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0004d00 0x7f61c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.897+0000 7f61d88e2640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0003f90 0x7f61c00047c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61c4001750 tx=0x7f61c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395e4ba6d5f9116b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.897+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40052d0 con 0x7f61c0003f90 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.897+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c402e050 con 0x7f61c0003f90 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.897+0000 7f61cbfff640 1 -- 172.21.15.49:0/443508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4003830 con 0x7f61c0003f90 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 -- 172.21.15.49:0/443508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0003f90 msgr2=0x7f61c00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 --2- 172.21.15.49:0/443508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0003f90 0x7f61c00047c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61c4001750 tx=0x7f61c00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61d98e4640 1 -- 172.21.15.49:0/443508 reap_dead start 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 -- 172.21.15.49:0/443508 shutdown_connections 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 -- 172.21.15.49:0/443508 >> 172.21.15.49:0/443508 conn(0x7f61d40b29c0 msgr2=0x7f61d40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 -- 172.21.15.49:0/443508 shutdown_connections 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.898+0000 7f61db347640 1 -- 172.21.15.49:0/443508 wait complete. 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.900+0000 7f61db347640 1 Processor -- start 2023-12-19T05:39:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.900+0000 7f61db347640 1 -- start start 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 0x7f61d4146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4141630 0x7f61d4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4146690 con 0x7f61d41411b0 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41f2780 con 0x7f61c0003f90 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61db347640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41450b0 con 0x7f61d4141630 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61d88e2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61d88e2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48084/0 (socket says 172.21.15.49:48084) 2023-12-19T05:39:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.901+0000 7f61d88e2640 1 -- 172.21.15.49:0/487928613 learned_addr learned my addr 172.21.15.49:0/487928613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d90e3640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 0x7f61d4146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d98e4640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4141630 0x7f61d4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 -- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4141630 msgr2=0x7f61d4151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4141630 0x7f61d4151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 -- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 msgr2=0x7f61d4146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 0x7f61d4146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 -- 172.21.15.49:0/487928613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4145390 con 0x7f61d41411b0 2023-12-19T05:39:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d90e3640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 0x7f61d4146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.902+0000 7f61d88e2640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61c4008fd0 tx=0x7f61c4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.903+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4007a30 con 0x7f61d41411b0 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.903+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40069e0 con 0x7f61d41411b0 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.903+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4006d50 con 0x7f61d41411b0 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.903+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4145670 con 0x7f61d41411b0 2023-12-19T05:39:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.903+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d4145c30 con 0x7f61d41411b0 2023-12-19T05:39:41.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.904+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d4146690 con 0x7f61d41411b0 2023-12-19T05:39:41.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.905+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61c40035f0 con 0x7f61d41411b0 2023-12-19T05:39:41.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.906+0000 7f61c9ffb640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.906+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61c40aab40 con 0x7f61d41411b0 2023-12-19T05:39:41.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.907+0000 7f61d90e3640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.908+0000 7f61d90e3640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009ad0 tx=0x7f61d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:41.910+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61c4076130 con 0x7f61d41411b0 2023-12-19T05:39:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.110+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d4145dc0 con 0x7f61d41411b0 2023-12-19T05:39:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.112+0000 7f61c9ffb640 1 -- 172.21.15.49:0/487928613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f61c404b090 con 0x7f61d41411b0 2023-12-19T05:39:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:42.114 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 msgr2=0x7f61b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009ad0 tx=0x7f61d0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 msgr2=0x7f61d41425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61c4008fd0 tx=0x7f61c4001120 comp rx=0 tx=0).stop 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 shutdown_connections 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d4141630 0x7f61d4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d41411b0 0x7f61d41425c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 --2- 172.21.15.49:0/487928613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c0003f90 0x7f61d4146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 >> 172.21.15.49:0/487928613 conn(0x7f61d40b29c0 msgr2=0x7f61d406f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 shutdown_connections 2023-12-19T05:39:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.116+0000 7f61db347640 1 -- 172.21.15.49:0/487928613 wait complete. 2023-12-19T05:39:42.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:42.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.372+0000 7f328e367640 1 Processor -- start 2023-12-19T05:39:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.372+0000 7f328e367640 1 -- start start 2023-12-19T05:39:42.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.374+0000 7f328e367640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3288141900 0x7f32880afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.374+0000 7f328e367640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f328806dc00 0x7f32880ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.374+0000 7f328e367640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328806e220 con 0x7f32880b02a0 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.374+0000 7f328e367640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880b0730 con 0x7f328806dc00 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.374+0000 7f328e367640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880cbea0 con 0x7f3288141900 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328cb64640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f32880b02a0 0x7f328806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56444/0 (socket says 172.21.15.49:56444) 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328cb64640 1 -- 172.21.15.49:0/2290101340 learned_addr learned my addr 172.21.15.49:0/2290101340 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328db66640 1 --2- 172.21.15.49:0/2290101340 >> v2:172.21.15.49:3300/0 conn(0x7f328806dc00 0x7f32880ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328d365640 1 --2- 172.21.15.49:0/2290101340 >> v2:172.21.15.115:3300/0 conn(0x7f3288141900 0x7f32880afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f327ffff640 1 -- 172.21.15.49:0/2290101340 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453591319 0 0) 0x7f328806e220 con 0x7f32880b02a0 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328db66640 1 -- 172.21.15.49:0/2290101340 >> v2:172.21.15.115:3300/0 conn(0x7f3288141900 msgr2=0x7f32880afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328db66640 1 --2- 172.21.15.49:0/2290101340 >> v2:172.21.15.115:3300/0 conn(0x7f3288141900 0x7f32880afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328db66640 1 -- 172.21.15.49:0/2290101340 >> v1:172.21.15.49:6789/0 conn(0x7f32880b02a0 legacy=0x7f328806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.375+0000 7f328db66640 1 -- 172.21.15.49:0/2290101340 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880cc180 con 0x7f328806dc00 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.377+0000 7f328db66640 1 --2- 172.21.15.49:0/2290101340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f328806dc00 0x7f32880ccc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3288067480 tx=0x7f328002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5eed45a8db71d97 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.377+0000 7f327ffff640 1 -- 172.21.15.49:0/2290101340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328002cc80 con 0x7f328806dc00 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.377+0000 7f327ffff640 1 -- 172.21.15.49:0/2290101340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328002cde0 con 0x7f328806dc00 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.377+0000 7f327ffff640 1 -- 172.21.15.49:0/2290101340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280034660 con 0x7f328806dc00 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.377+0000 7f328e367640 1 -- 172.21.15.49:0/2290101340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f328806dc00 msgr2=0x7f32880ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 --2- 172.21.15.49:0/2290101340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f328806dc00 0x7f32880ccc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3288067480 tx=0x7f328002bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 -- 172.21.15.49:0/2290101340 shutdown_connections 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 --2- 172.21.15.49:0/2290101340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f328806dc00 0x7f32880ccc60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 --2- 172.21.15.49:0/2290101340 >> v2:172.21.15.115:3300/0 conn(0x7f3288141900 0x7f32880afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 -- 172.21.15.49:0/2290101340 >> 172.21.15.49:0/2290101340 conn(0x7f328806f630 msgr2=0x7f328806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:42.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 -- 172.21.15.49:0/2290101340 shutdown_connections 2023-12-19T05:39:42.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.378+0000 7f328e367640 1 -- 172.21.15.49:0/2290101340 wait complete. 2023-12-19T05:39:42.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.380+0000 7f328e367640 1 Processor -- start 2023-12-19T05:39:42.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.380+0000 7f328e367640 1 -- start start 2023-12-19T05:39:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f328806dc00 0x7f328813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 0x7f3288159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328815ac50 con 0x7f3288141900 2023-12-19T05:39:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328813fd00 con 0x7f32880b02a0 2023-12-19T05:39:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328e367640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328815a040 con 0x7f328806dc00 2023-12-19T05:39:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328db66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328db66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48102/0 (socket says 172.21.15.49:48102) 2023-12-19T05:39:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328db66640 1 -- 172.21.15.49:0/3442762825 learned_addr learned my addr 172.21.15.49:0/3442762825 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328d365640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f328806dc00 0x7f328813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.381+0000 7f328db66640 1 -- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f328806dc00 msgr2=0x7f328813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328cb64640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 0x7f3288159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328db66640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f328806dc00 0x7f328813f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328db66640 1 -- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 msgr2=0x7f3288159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328db66640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 0x7f3288159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328db66640 1 -- 172.21.15.49:0/3442762825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009a70 con 0x7f3288141900 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328cb64640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 0x7f3288159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328db66640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3280009e80 tx=0x7f3280004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280040650 con 0x7f3288141900 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800407b0 con 0x7f3288141900 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280040b60 con 0x7f3288141900 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328815a320 con 0x7f3288141900 2023-12-19T05:39:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.382+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328815a8e0 con 0x7f3288141900 2023-12-19T05:39:42.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.384+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328815adc0 con 0x7f3288141900 2023-12-19T05:39:42.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.385+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3280040cc0 con 0x7f3288141900 2023-12-19T05:39:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.386+0000 7f327dffb640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 0x7f326c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.386+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32800ab7b0 con 0x7f3288141900 2023-12-19T05:39:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.387+0000 7f328d365640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 0x7f326c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.388+0000 7f328d365640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 0x7f326c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.390+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3280076d00 con 0x7f3288141900 2023-12-19T05:39:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.586+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3288061910 con 0x7f3288141900 2023-12-19T05:39:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.587+0000 7f327dffb640 1 -- 172.21.15.49:0/3442762825 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3280009450 con 0x7f3288141900 2023-12-19T05:39:42.588 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 msgr2=0x7f326c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 0x7f326c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 msgr2=0x7f32880b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3280009e80 tx=0x7f3280004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 shutdown_connections 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326c06a430 0x7f326c06c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3288141900 0x7f32880b2440 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32880b02a0 0x7f3288159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 --2- 172.21.15.49:0/3442762825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f328806dc00 0x7f328813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 >> 172.21.15.49:0/3442762825 conn(0x7f328806f630 msgr2=0x7f328815c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 shutdown_connections 2023-12-19T05:39:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.589+0000 7f328e367640 1 -- 172.21.15.49:0/3442762825 wait complete. 2023-12-19T05:39:42.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:42.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.837+0000 7fe789d11640 1 Processor -- start 2023-12-19T05:39:42.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.837+0000 7fe789d11640 1 -- start start 2023-12-19T05:39:42.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe789d11640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 0x7fe7840b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe789d11640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7840b0830 0x7fe78406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe789d11640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78415c9c0 con 0x7fe78406ca80 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe789d11640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840b0ce0 con 0x7fe7840b0830 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe789d11640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78406d270 con 0x7fe784155460 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe783fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7840b0830 0x7fe78406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe783fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7840b0830 0x7fe78406c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48118/0 (socket says 172.21.15.49:48118) 2023-12-19T05:39:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.839+0000 7fe783fff640 1 -- 172.21.15.49:0/2245759421 learned_addr learned my addr 172.21.15.49:0/2245759421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe788d0f640 1 --2- 172.21.15.49:0/2245759421 >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 0x7fe7840b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe783fff640 1 -- 172.21.15.49:0/2245759421 >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 msgr2=0x7fe7840b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe783fff640 1 --2- 172.21.15.49:0/2245759421 >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 0x7fe7840b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe783fff640 1 -- 172.21.15.49:0/2245759421 >> v1:172.21.15.115:6789/0 conn(0x7fe78406ca80 legacy=0x7fe7840cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe783fff640 1 -- 172.21.15.49:0/2245759421 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78406d550 con 0x7fe7840b0830 2023-12-19T05:39:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.840+0000 7fe788d0f640 1 --2- 172.21.15.49:0/2245759421 >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 0x7fe7840b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.841+0000 7fe783fff640 1 --2- 172.21.15.49:0/2245759421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe78406c540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7840717b0 tx=0x7fe77402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0534c797877083 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.841+0000 7fe7837fe640 1 -- 172.21.15.49:0/2245759421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774031870 con 0x7fe7840b0830 2023-12-19T05:39:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe7837fe640 1 -- 172.21.15.49:0/2245759421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7740319d0 con 0x7fe7840b0830 2023-12-19T05:39:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe7837fe640 1 -- 172.21.15.49:0/2245759421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774031d60 con 0x7fe7840b0830 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 -- 172.21.15.49:0/2245759421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 msgr2=0x7fe78406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 --2- 172.21.15.49:0/2245759421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe78406c540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7840717b0 tx=0x7fe77402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 -- 172.21.15.49:0/2245759421 shutdown_connections 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 --2- 172.21.15.49:0/2245759421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe78406c540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 --2- 172.21.15.49:0/2245759421 >> v2:172.21.15.115:3300/0 conn(0x7fe784155460 0x7fe7840b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.842+0000 7fe789d11640 1 -- 172.21.15.49:0/2245759421 >> 172.21.15.49:0/2245759421 conn(0x7fe7840659a0 msgr2=0x7fe784065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.843+0000 7fe789d11640 1 -- 172.21.15.49:0/2245759421 shutdown_connections 2023-12-19T05:39:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.843+0000 7fe789d11640 1 -- 172.21.15.49:0/2245759421 wait complete. 2023-12-19T05:39:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.844+0000 7fe789d11640 1 Processor -- start 2023-12-19T05:39:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.845+0000 7fe789d11640 1 -- start start 2023-12-19T05:39:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.845+0000 7fe789d11640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 0x7fe784147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789d11640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789d11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe784155460 0x7fe784155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789d11640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe784148bd0 con 0x7fe7840b0830 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789d11640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe784156370 con 0x7fe784155460 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789d11640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe784149060 con 0x7fe78406ca80 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48130/0 (socket says 172.21.15.49:48130) 2023-12-19T05:39:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 -- 172.21.15.49:0/3458351269 learned_addr learned my addr 172.21.15.49:0/3458351269 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe788d0f640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 0x7fe784147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe789510640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe784155460 0x7fe784155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 -- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 msgr2=0x7fe784147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 0x7fe784147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 -- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe784155460 msgr2=0x7fe784155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe784155460 0x7fe784155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe783fff640 1 -- 172.21.15.49:0/3458351269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740094d0 con 0x7fe7840b0830 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.846+0000 7fe788d0f640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 0x7fe784147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe783fff640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe7740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774031840 con 0x7fe7840b0830 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7740443f0 con 0x7fe7840b0830 2023-12-19T05:39:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7840cc5d0 con 0x7fe7840b0830 2023-12-19T05:39:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7740447a0 con 0x7fe7840b0830 2023-12-19T05:39:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.847+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe784148580 con 0x7fe7840b0830 2023-12-19T05:39:42.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.848+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784148d40 con 0x7fe7840b0830 2023-12-19T05:39:42.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.849+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe77404d450 con 0x7fe7840b0830 2023-12-19T05:39:42.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.850+0000 7fe7817fa640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 0x7fe77006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:42.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.850+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe77402d040 con 0x7fe7840b0830 2023-12-19T05:39:42.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.851+0000 7fe788d0f640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 0x7fe77006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:42.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.852+0000 7fe788d0f640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 0x7fe77006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe778006fd0 tx=0x7fe778008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:42.854+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe7740766f0 con 0x7fe7840b0830 2023-12-19T05:39:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.054+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe784061910 con 0x7fe7840b0830 2023-12-19T05:39:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.055+0000 7fe7817fa640 1 -- 172.21.15.49:0/3458351269 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe774079d10 con 0x7fe7840b0830 2023-12-19T05:39:43.057 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 msgr2=0x7fe77006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 0x7fe77006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe778006fd0 tx=0x7fe778008040 comp rx=0 tx=0).stop 2023-12-19T05:39:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 msgr2=0x7fe784155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe7740046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 shutdown_connections 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe77006a430 0x7fe77006c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe784155460 0x7fe784155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7840b0830 0x7fe784155840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 --2- 172.21.15.49:0/3458351269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe78406ca80 0x7fe784147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 >> 172.21.15.49:0/3458351269 conn(0x7fe7840659a0 msgr2=0x7fe784070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 shutdown_connections 2023-12-19T05:39:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.058+0000 7fe789d11640 1 -- 172.21.15.49:0/3458351269 wait complete. 2023-12-19T05:39:43.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:43.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.308+0000 7f3f1430a640 1 Processor -- start 2023-12-19T05:39:43.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.309+0000 7f3f1430a640 1 -- start start 2023-12-19T05:39:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.310+0000 7f3f1430a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.310+0000 7f3f1430a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 0x7f3f0c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.310+0000 7f3f1430a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c15fde0 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.310+0000 7f3f1430a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b2400 con 0x7f3f0c0b2760 2023-12-19T05:39:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.310+0000 7f3f1430a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cf870 con 0x7f3f0c0ceea0 2023-12-19T05:39:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48132/0 (socket says 172.21.15.49:48132) 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 -- 172.21.15.49:0/4153057159 learned_addr learned my addr 172.21.15.49:0/4153057159 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f128a7640 1 --2- 172.21.15.49:0/4153057159 >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 0x7f3f0c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 -- 172.21.15.49:0/4153057159 >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 msgr2=0x7f3f0c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 --2- 172.21.15.49:0/4153057159 >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 0x7f3f0c0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.311+0000 7f3f118a5640 1 -- 172.21.15.49:0/4153057159 >> v1:172.21.15.115:6789/0 conn(0x7f3f0c15b1d0 legacy=0x7f3f0c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.312+0000 7f3f118a5640 1 -- 172.21.15.49:0/4153057159 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0b2bc0 con 0x7f3f0c0b2760 2023-12-19T05:39:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.312+0000 7f3f128a7640 1 --2- 172.21.15.49:0/4153057159 >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 0x7f3f0c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.313+0000 7f3f118a5640 1 --2- 172.21.15.49:0/4153057159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0663a0 tx=0x7f3efc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e1ed84e3dd14f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.313+0000 7f3f110a4640 1 -- 172.21.15.49:0/4153057159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc031870 con 0x7f3f0c0b2760 2023-12-19T05:39:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.313+0000 7f3f110a4640 1 -- 172.21.15.49:0/4153057159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0319d0 con 0x7f3f0c0b2760 2023-12-19T05:39:43.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.313+0000 7f3f110a4640 1 -- 172.21.15.49:0/4153057159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc031d60 con 0x7f3f0c0b2760 2023-12-19T05:39:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 -- 172.21.15.49:0/4153057159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c0b2760 msgr2=0x7f3f0c0b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 --2- 172.21.15.49:0/4153057159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0663a0 tx=0x7f3efc02b910 comp rx=0 tx=0).stop 2023-12-19T05:39:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 -- 172.21.15.49:0/4153057159 shutdown_connections 2023-12-19T05:39:43.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 --2- 172.21.15.49:0/4153057159 >> v2:172.21.15.115:3300/0 conn(0x7f3f0c0ceea0 0x7f3f0c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 --2- 172.21.15.49:0/4153057159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c0b1ec0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 -- 172.21.15.49:0/4153057159 >> 172.21.15.49:0/4153057159 conn(0x7f3f0c073150 msgr2=0x7f3f0c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 -- 172.21.15.49:0/4153057159 shutdown_connections 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.314+0000 7f3f1430a640 1 -- 172.21.15.49:0/4153057159 wait complete. 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.316+0000 7f3f1430a640 1 Processor -- start 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.316+0000 7f3f1430a640 1 -- start start 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f0c0ceea0 0x7f3f0c1f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1e62a0 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1e6730 con 0x7f3f0c0b2760 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f1430a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1e56b0 con 0x7f3f0c0ceea0 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48134/0 (socket says 172.21.15.49:48134) 2023-12-19T05:39:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 -- 172.21.15.49:0/3598628032 learned_addr learned my addr 172.21.15.49:0/3598628032 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f118a5640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f0c0ceea0 0x7f3f0c1f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 -- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f0c0ceea0 msgr2=0x7f3f0c1f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f120a6640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f0c0ceea0 0x7f3f0c1f0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 -- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 msgr2=0x7f3f0c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c14e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f128a7640 1 -- 172.21.15.49:0/3598628032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0094d0 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.317+0000 7f3f120a6640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f128a7640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400cef0 tx=0x7f3f0400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400d840 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400d9c0 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400dd70 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c1e5970 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.318+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1e5f30 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.319+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c1e6410 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.320+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f0401e3b0 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.321+0000 7f3f02ffd640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 0x7f3ef006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.321+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f04089400 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.322+0000 7f3f120a6640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 0x7f3ef006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.323+0000 7f3f120a6640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 0x7f3ef006c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800a830 tx=0x7f3f08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.326+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f04054a90 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.516+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f0c061910 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.517+0000 7f3f02ffd640 1 -- 172.21.15.49:0/3598628032 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f0401a020 con 0x7f3f0c15b1d0 2023-12-19T05:39:43.518 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.519+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 msgr2=0x7f3ef006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.519+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 0x7f3ef006c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800a830 tx=0x7f3f08008040 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.519+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 msgr2=0x7f3f0c15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.519+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400cef0 tx=0x7f3f0400a710 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 shutdown_connections 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ef006a430 0x7f3ef006c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f0c0ceea0 0x7f3f0c1f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f0c15b1d0 0x7f3f0c15d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 --2- 172.21.15.49:0/3598628032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f0c0b2760 0x7f3f0c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 >> 172.21.15.49:0/3598628032 conn(0x7f3f0c073150 msgr2=0x7f3f0c157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 shutdown_connections 2023-12-19T05:39:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.520+0000 7f3f1430a640 1 -- 172.21.15.49:0/3598628032 wait complete. 2023-12-19T05:39:43.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:43.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.761+0000 7fd9f3395640 1 Processor -- start 2023-12-19T05:39:43.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.761+0000 7fd9f3395640 1 -- start start 2023-12-19T05:39:43.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.763+0000 7fd9f3395640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9ec0b1710 0x7fd9ec06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.763+0000 7fd9f3395640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9ec15e040 0x7fd9ec15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.763+0000 7fd9f3395640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec15e9f0 con 0x7fd9ec157aa0 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.763+0000 7fd9f3395640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec0b2600 con 0x7fd9ec0b1710 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.763+0000 7fd9f3395640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec0b1d60 con 0x7fd9ec15e040 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9ec0b1710 0x7fd9ec06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9ec0b1710 0x7fd9ec06e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48142/0 (socket says 172.21.15.49:48142) 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 -- 172.21.15.49:0/3933608844 learned_addr learned my addr 172.21.15.49:0/3933608844 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f1932640 1 --2- 172.21.15.49:0/3933608844 >> v2:172.21.15.115:3300/0 conn(0x7fd9ec15e040 0x7fd9ec15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 -- 172.21.15.49:0/3933608844 >> v2:172.21.15.115:3300/0 conn(0x7fd9ec15e040 msgr2=0x7fd9ec15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 --2- 172.21.15.49:0/3933608844 >> v2:172.21.15.115:3300/0 conn(0x7fd9ec15e040 0x7fd9ec15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 -- 172.21.15.49:0/3933608844 >> v1:172.21.15.115:6789/0 conn(0x7fd9ec157aa0 legacy=0x7fd9ec161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:43.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.764+0000 7fd9f0930640 1 -- 172.21.15.49:0/3933608844 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0b2040 con 0x7fd9ec0b1710 2023-12-19T05:39:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.766+0000 7fd9f0930640 1 --2- 172.21.15.49:0/3933608844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec0b1710 0x7fd9ec06e410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec06db00 tx=0x7fd9dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90f1176544dccd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.766+0000 7fd9e3fff640 1 -- 172.21.15.49:0/3933608844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc031640 con 0x7fd9ec0b1710 2023-12-19T05:39:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.766+0000 7fd9e3fff640 1 -- 172.21.15.49:0/3933608844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0317a0 con 0x7fd9ec0b1710 2023-12-19T05:39:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.766+0000 7fd9e3fff640 1 -- 172.21.15.49:0/3933608844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc031b30 con 0x7fd9ec0b1710 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 -- 172.21.15.49:0/3933608844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec0b1710 msgr2=0x7fd9ec06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3933608844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec0b1710 0x7fd9ec06e410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec06db00 tx=0x7fd9dc02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 -- 172.21.15.49:0/3933608844 shutdown_connections 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3933608844 >> v2:172.21.15.115:3300/0 conn(0x7fd9ec15e040 0x7fd9ec15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3933608844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec0b1710 0x7fd9ec06e410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 -- 172.21.15.49:0/3933608844 >> 172.21.15.49:0/3933608844 conn(0x7fd9ec0cbb70 msgr2=0x7fd9ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 -- 172.21.15.49:0/3933608844 shutdown_connections 2023-12-19T05:39:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.767+0000 7fd9f3395640 1 -- 172.21.15.49:0/3933608844 wait complete. 2023-12-19T05:39:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.769+0000 7fd9f3395640 1 Processor -- start 2023-12-19T05:39:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.769+0000 7fd9f3395640 1 -- start start 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 0x7fd9ec146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 0x7fd9ec142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec06c8e0 con 0x7fd9ec15e040 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1433e0 con 0x7fd9ec157aa0 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f3395640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec06cf90 con 0x7fd9ec0b1710 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48148/0 (socket says 172.21.15.49:48148) 2023-12-19T05:39:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 -- 172.21.15.49:0/3635767621 learned_addr learned my addr 172.21.15.49:0/3635767621 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f0930640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 0x7fd9ec142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1131640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 0x7fd9ec146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 -- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 msgr2=0x7fd9ec146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 0x7fd9ec146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 -- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 msgr2=0x7fd9ec142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 0x7fd9ec142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1932640 1 -- 172.21.15.49:0/3635767621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0094d0 con 0x7fd9ec15e040 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f0930640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 0x7fd9ec142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.770+0000 7fd9f1131640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 0x7fd9ec146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9f1932640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4007e60 tx=0x7fd9e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4014420 con 0x7fd9ec15e040 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e40145a0 con 0x7fd9ec15e040 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4014950 con 0x7fd9ec15e040 2023-12-19T05:39:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec06d270 con 0x7fd9ec15e040 2023-12-19T05:39:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.771+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec06d830 con 0x7fd9ec15e040 2023-12-19T05:39:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.772+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec061910 con 0x7fd9ec15e040 2023-12-19T05:39:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.773+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9e4014ab0 con 0x7fd9ec15e040 2023-12-19T05:39:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.774+0000 7fd9e1ffb640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 0x7fd9d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.774+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9e4089270 con 0x7fd9ec15e040 2023-12-19T05:39:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.775+0000 7fd9f1131640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 0x7fd9d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.776+0000 7fd9f1131640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 0x7fd9d006c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8003eb0 tx=0x7fd9e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.779+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9e40547d0 con 0x7fd9ec15e040 2023-12-19T05:39:43.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.973+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9ec0b22f0 con 0x7fd9ec15e040 2023-12-19T05:39:43.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.975+0000 7fd9e1ffb640 1 -- 172.21.15.49:0/3635767621 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fd9e4057df0 con 0x7fd9ec15e040 2023-12-19T05:39:43.976 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:43.977 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 msgr2=0x7fd9d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 0x7fd9d006c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8003eb0 tx=0x7fd9e8009040 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 msgr2=0x7fd9ec15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4007e60 tx=0x7fd9e400e4b0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 shutdown_connections 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9d006a460 0x7fd9d006c920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec15e040 0x7fd9ec15a980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec157aa0 0x7fd9ec142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 --2- 172.21.15.49:0/3635767621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec0b1710 0x7fd9ec146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 >> 172.21.15.49:0/3635767621 conn(0x7fd9ec0cbb70 msgr2=0x7fd9ec15c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 shutdown_connections 2023-12-19T05:39:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:43.978+0000 7fd9f3395640 1 -- 172.21.15.49:0/3635767621 wait complete. 2023-12-19T05:39:44.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:44.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.237+0000 7f2671b29640 1 Processor -- start 2023-12-19T05:39:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.237+0000 7f2671b29640 1 -- start start 2023-12-19T05:39:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2671b29640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f266c06f490 0x7f266c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2671b29640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f266c0d1670 0x7f266c0d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2671b29640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06fe30 con 0x7f266c146cd0 2023-12-19T05:39:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2671b29640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c1470b0 con 0x7f266c06f490 2023-12-19T05:39:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2671b29640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c070260 con 0x7f266c0d1670 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f266bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f266c06f490 0x7f266c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2670b27640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f266c146cd0 0x7f266c0b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58574/0 (socket says 172.21.15.49:58574) 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.239+0000 7f2670b27640 1 -- 172.21.15.49:0/4021964979 learned_addr learned my addr 172.21.15.49:0/4021964979 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f2671328640 1 --2- 172.21.15.49:0/4021964979 >> v2:172.21.15.115:3300/0 conn(0x7f266c0d1670 0x7f266c0d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f266b7fe640 1 -- 172.21.15.49:0/4021964979 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829231895 0 0) 0x7f266c06fe30 con 0x7f266c146cd0 2023-12-19T05:39:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f266bfff640 1 -- 172.21.15.49:0/4021964979 >> v2:172.21.15.115:3300/0 conn(0x7f266c0d1670 msgr2=0x7f266c0d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f266bfff640 1 --2- 172.21.15.49:0/4021964979 >> v2:172.21.15.115:3300/0 conn(0x7f266c0d1670 0x7f266c0d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f266bfff640 1 -- 172.21.15.49:0/4021964979 >> v1:172.21.15.49:6789/0 conn(0x7f266c146cd0 legacy=0x7f266c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.240+0000 7f266bfff640 1 -- 172.21.15.49:0/4021964979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0b6ea0 con 0x7f266c06f490 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.241+0000 7f266bfff640 1 --2- 172.21.15.49:0/4021964979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c06f8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f266c0b3320 tx=0x7f266002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0b3e357016c307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.241+0000 7f266b7fe640 1 -- 172.21.15.49:0/4021964979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266002e070 con 0x7f266c06f490 2023-12-19T05:39:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.241+0000 7f266b7fe640 1 -- 172.21.15.49:0/4021964979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600315a0 con 0x7f266c06f490 2023-12-19T05:39:44.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.241+0000 7f266b7fe640 1 -- 172.21.15.49:0/4021964979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660031930 con 0x7f266c06f490 2023-12-19T05:39:44.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 -- 172.21.15.49:0/4021964979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 msgr2=0x7f266c06f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 --2- 172.21.15.49:0/4021964979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c06f8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f266c0b3320 tx=0x7f266002b840 comp rx=0 tx=0).stop 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 -- 172.21.15.49:0/4021964979 shutdown_connections 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 --2- 172.21.15.49:0/4021964979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c06f8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 --2- 172.21.15.49:0/4021964979 >> v2:172.21.15.115:3300/0 conn(0x7f266c0d1670 0x7f266c0d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 -- 172.21.15.49:0/4021964979 >> 172.21.15.49:0/4021964979 conn(0x7f266c0d3200 msgr2=0x7f266c0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 -- 172.21.15.49:0/4021964979 shutdown_connections 2023-12-19T05:39:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.242+0000 7f2671b29640 1 -- 172.21.15.49:0/4021964979 wait complete. 2023-12-19T05:39:44.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.244+0000 7f2671b29640 1 Processor -- start 2023-12-19T05:39:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.244+0000 7f2671b29640 1 -- start start 2023-12-19T05:39:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 0x7f266c1e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f266c146cd0 0x7f266c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c141120 con 0x7f266c06f490 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c141400 con 0x7f266c0d1670 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2671b29640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c1416e0 con 0x7f266c146cd0 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2670b27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2670b27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50588/0 (socket says 172.21.15.49:50588) 2023-12-19T05:39:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.245+0000 7f2670b27640 1 -- 172.21.15.49:0/1079704325 learned_addr learned my addr 172.21.15.49:0/1079704325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:44.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f266bfff640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 0x7f266c1e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2671328640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f266c146cd0 0x7f266c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 -- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f266c146cd0 msgr2=0x7f266c1424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f266c146cd0 0x7f266c1424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 -- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 msgr2=0x7f266c1e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 0x7f266c1e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 -- 172.21.15.49:0/1079704325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660009400 con 0x7f266c06f490 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f266bfff640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 0x7f266c1e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f2670b27640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c7c0 tx=0x7f265c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.246+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00a640 con 0x7f266c06f490 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.247+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00a7c0 con 0x7f266c06f490 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.247+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00ab70 con 0x7f266c06f490 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.247+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c1419c0 con 0x7f266c06f490 2023-12-19T05:39:44.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.247+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c141f80 con 0x7f266c06f490 2023-12-19T05:39:44.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.248+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c142170 con 0x7f266c06f490 2023-12-19T05:39:44.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.249+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f265c00acd0 con 0x7f266c06f490 2023-12-19T05:39:44.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.250+0000 7f26697fa640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 0x7f265806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.250+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f265c087e20 con 0x7f266c06f490 2023-12-19T05:39:44.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.250+0000 7f266bfff640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 0x7f265806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.251+0000 7f266bfff640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 0x7f265806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f2660008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.254+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f265c0534a0 con 0x7f266c06f490 2023-12-19T05:39:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.449+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f266c061910 con 0x7f266c06f490 2023-12-19T05:39:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.450+0000 7f26697fa640 1 -- 172.21.15.49:0/1079704325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f265c018020 con 0x7f266c06f490 2023-12-19T05:39:44.451 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.452+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 msgr2=0x7f265806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.452+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 0x7f265806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f2660008030 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 msgr2=0x7f266c15c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c7c0 tx=0x7f265c00cc80 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 shutdown_connections 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f265806a430 0x7f265806c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f266c146cd0 0x7f266c1424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0d1670 0x7f266c1e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 --2- 172.21.15.49:0/1079704325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f266c06f490 0x7f266c15c060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 >> 172.21.15.49:0/1079704325 conn(0x7f266c0d3200 msgr2=0x7f266c145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 shutdown_connections 2023-12-19T05:39:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.453+0000 7f2671b29640 1 -- 172.21.15.49:0/1079704325 wait complete. 2023-12-19T05:39:44.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:44.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.703+0000 7f217e4f7640 1 Processor -- start 2023-12-19T05:39:44.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.703+0000 7f217e4f7640 1 -- start start 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217e4f7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21780af7b0 0x7f217806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217e4f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21780d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217e4f7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780afe90 con 0x7f217815b7a0 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217e4f7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780b2cc0 con 0x7f21780af7b0 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217e4f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b00e0 con 0x7f21780cff60 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f2177fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f217815b7a0 0x7f217806d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58584/0 (socket says 172.21.15.49:58584) 2023-12-19T05:39:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f2177fff640 1 -- 172.21.15.49:0/2812510515 learned_addr learned my addr 172.21.15.49:0/2812510515 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f217ca94640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21780d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.705+0000 7f21777fe640 1 --2- 172.21.15.49:0/2812510515 >> v2:172.21.15.115:3300/0 conn(0x7f21780af7b0 0x7f217806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167404079 0 0) 0x7f21780afe90 con 0x7f217815b7a0 2023-12-19T05:39:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2164003520 con 0x7f217815b7a0 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463667777 0 0) 0x7f2164003520 con 0x7f217815b7a0 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 msgr2=0x7f21780d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21780d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 >> v2:172.21.15.115:3300/0 conn(0x7f21780af7b0 msgr2=0x7f217806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 --2- 172.21.15.49:0/2812510515 >> v2:172.21.15.115:3300/0 conn(0x7f21780af7b0 0x7f217806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780cf480 con 0x7f217815b7a0 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f21680019f0 con 0x7f217815b7a0 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 >> v1:172.21.15.49:6789/0 conn(0x7f217815b7a0 legacy=0x7f217806d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2164004d00 0x7f2164005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b2cc0 con 0x7f2164003f60 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b00e0 con 0x7f2164004d00 2023-12-19T05:39:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.706+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216400b9b0 con 0x7f21780cff60 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f2177fff640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f217ca94640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2164004d00 0x7f2164005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 -- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 msgr2=0x7f21640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780cff60 0x7f21640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 -- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2164004d00 msgr2=0x7f2164005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2164004d00 0x7f2164005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f21777fe640 1 -- 172.21.15.49:0/2812510515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164003520 con 0x7f2164003f60 2023-12-19T05:39:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.707+0000 7f217ca94640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2164004d00 0x7f2164005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f21777fe640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21640047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21780b3c50 tx=0x7f21640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1eb463cb31ae3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160005990 con 0x7f2164003f60 2023-12-19T05:39:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160005af0 con 0x7f2164003f60 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f2176ffd640 1 -- 172.21.15.49:0/2812510515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160005ea0 con 0x7f2164003f60 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f217e4f7640 1 -- 172.21.15.49:0/2812510515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 msgr2=0x7f21640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2812510515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21640047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21780b3c50 tx=0x7f21640057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.709+0000 7f217ca94640 1 -- 172.21.15.49:0/2812510515 reap_dead start 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.710+0000 7f217e4f7640 1 -- 172.21.15.49:0/2812510515 shutdown_connections 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.710+0000 7f217e4f7640 1 -- 172.21.15.49:0/2812510515 >> 172.21.15.49:0/2812510515 conn(0x7f21780659d0 msgr2=0x7f2178065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.710+0000 7f217e4f7640 1 -- 172.21.15.49:0/2812510515 shutdown_connections 2023-12-19T05:39:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.710+0000 7f217e4f7640 1 -- 172.21.15.49:0/2812510515 wait complete. 2023-12-19T05:39:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.712+0000 7f217e4f7640 1 Processor -- start 2023-12-19T05:39:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.712+0000 7f217e4f7640 1 -- start start 2023-12-19T05:39:44.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2178159dd0 0x7f217815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780b5c00 0x7f21780b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217815a790 con 0x7f2164003f60 2023-12-19T05:39:44.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b6e80 con 0x7f2178159dd0 2023-12-19T05:39:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f217e4f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178157f90 con 0x7f21780b5c00 2023-12-19T05:39:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f2177fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f2177fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50604/0 (socket says 172.21.15.49:50604) 2023-12-19T05:39:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f2177fff640 1 -- 172.21.15.49:0/2904006046 learned_addr learned my addr 172.21.15.49:0/2904006046 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f2177fff640 1 -- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780b5c00 msgr2=0x7f21780b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.713+0000 7f2177fff640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780b5c00 0x7f21780b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2177fff640 1 -- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2178159dd0 msgr2=0x7f217815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2177fff640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2178159dd0 0x7f217815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2177fff640 1 -- 172.21.15.49:0/2904006046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780b68c0 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2177fff640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2168007a10 tx=0x7f216800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800ed70 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800eed0 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168013660 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21780b6ba0 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.714+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21780b65c0 con 0x7f2164003f60 2023-12-19T05:39:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.716+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2178061910 con 0x7f2164003f60 2023-12-19T05:39:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.717+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21680137c0 con 0x7f2164003f60 2023-12-19T05:39:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.717+0000 7f2174ff9640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.718+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2168088ed0 con 0x7f2164003f60 2023-12-19T05:39:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.718+0000 7f21777fe640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.719+0000 7f21777fe640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2160035000 tx=0x7f216002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.722+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f21680546c0 con 0x7f2164003f60 2023-12-19T05:39:44.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.916+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21780b15e0 con 0x7f2164003f60 2023-12-19T05:39:44.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.917+0000 7f2174ff9640 1 -- 172.21.15.49:0/2904006046 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2168057ce0 con 0x7f2164003f60 2023-12-19T05:39:44.919 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 msgr2=0x7f215806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2160035000 tx=0x7f216002e000 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 msgr2=0x7f21781566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2168007a10 tx=0x7f216800e530 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 shutdown_connections 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21780b5c00 0x7f21780b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2178159dd0 0x7f217815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 --2- 172.21.15.49:0/2904006046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2164003f60 0x7f21781566e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.919+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 >> 172.21.15.49:0/2904006046 conn(0x7f21780659d0 msgr2=0x7f21780b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.920+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 shutdown_connections 2023-12-19T05:39:44.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:44.920+0000 7f217e4f7640 1 -- 172.21.15.49:0/2904006046 wait complete. 2023-12-19T05:39:44.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.180+0000 7f417ffff640 1 Processor -- start 2023-12-19T05:39:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.180+0000 7f417ffff640 1 -- start start 2023-12-19T05:39:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.182+0000 7f417ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f418013e2c0 0x7f41800cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.182+0000 7f417ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.182+0000 7f417ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418015ed70 con 0x7f41800cd230 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.182+0000 7f417ffff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418015c3e0 con 0x7f418013e2c0 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.182+0000 7f417ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800cd6c0 con 0x7f418015bfb0 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.183+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.183+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50282/0 (socket says 172.21.15.49:50282) 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.183+0000 7f417f7fe640 1 -- 172.21.15.49:0/4207089136 learned_addr learned my addr 172.21.15.49:0/4207089136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.183+0000 7f417effd640 1 --2- 172.21.15.49:0/4207089136 >> v2:172.21.15.115:3300/0 conn(0x7f418013e2c0 0x7f41800cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.184+0000 7f417dffb640 1 -- 172.21.15.49:0/4207089136 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285451725 0 0) 0x7f418015ed70 con 0x7f41800cd230 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.184+0000 7f417f7fe640 1 -- 172.21.15.49:0/4207089136 >> v2:172.21.15.115:3300/0 conn(0x7f418013e2c0 msgr2=0x7f41800cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.184+0000 7f417f7fe640 1 --2- 172.21.15.49:0/4207089136 >> v2:172.21.15.115:3300/0 conn(0x7f418013e2c0 0x7f41800cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.184+0000 7f417f7fe640 1 -- 172.21.15.49:0/4207089136 >> v1:172.21.15.115:6789/0 conn(0x7f41800cd230 legacy=0x7f418015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.184+0000 7f417f7fe640 1 -- 172.21.15.49:0/4207089136 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015efe0 con 0x7f418015bfb0 2023-12-19T05:39:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.185+0000 7f417f7fe640 1 --2- 172.21.15.49:0/4207089136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e50 tx=0x7f417802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47fa660a709a2ef7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.186+0000 7f417dffb640 1 -- 172.21.15.49:0/4207089136 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417802ca70 con 0x7f418015bfb0 2023-12-19T05:39:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.186+0000 7f417dffb640 1 -- 172.21.15.49:0/4207089136 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417802cbd0 con 0x7f418015bfb0 2023-12-19T05:39:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.186+0000 7f417dffb640 1 -- 172.21.15.49:0/4207089136 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780343f0 con 0x7f418015bfb0 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 -- 172.21.15.49:0/4207089136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 msgr2=0x7f418006bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 --2- 172.21.15.49:0/4207089136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e50 tx=0x7f417802bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 -- 172.21.15.49:0/4207089136 shutdown_connections 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 --2- 172.21.15.49:0/4207089136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418015bfb0 0x7f418006bbc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 --2- 172.21.15.49:0/4207089136 >> v2:172.21.15.115:3300/0 conn(0x7f418013e2c0 0x7f41800cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 -- 172.21.15.49:0/4207089136 >> 172.21.15.49:0/4207089136 conn(0x7f41800cf5d0 msgr2=0x7f41800cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 -- 172.21.15.49:0/4207089136 shutdown_connections 2023-12-19T05:39:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.187+0000 7f417ffff640 1 -- 172.21.15.49:0/4207089136 wait complete. 2023-12-19T05:39:45.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.189+0000 7f417ffff640 1 Processor -- start 2023-12-19T05:39:45.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.189+0000 7f417ffff640 1 -- start start 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41800cd230 0x7f41801f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 0x7f4180134fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180144810 con 0x7f418013e2c0 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180144fb0 con 0x7f418015bfb0 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180136f40 con 0x7f41800cd230 2023-12-19T05:39:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50608/0 (socket says 172.21.15.49:50608) 2023-12-19T05:39:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.190+0000 7f417e7fc640 1 -- 172.21.15.49:0/1763656838 learned_addr learned my addr 172.21.15.49:0/1763656838 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:45.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417effd640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41800cd230 0x7f41801f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417f7fe640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 0x7f4180134fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 -- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41800cd230 msgr2=0x7f41801f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41800cd230 0x7f41801f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 -- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 msgr2=0x7f4180134fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 0x7f4180134fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 -- 172.21.15.49:0/1763656838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009b30 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417f7fe640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 0x7f4180134fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417e7fc640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f417400c410 tx=0x7f417400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740052d0 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174005430 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174003810 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.191+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180137190 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.192+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180137750 con 0x7f418013e2c0 2023-12-19T05:39:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.193+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800cef60 con 0x7f418013e2c0 2023-12-19T05:39:45.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.194+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4174003970 con 0x7f418013e2c0 2023-12-19T05:39:45.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.195+0000 7f4167fff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 0x7f416c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.195+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4174087fe0 con 0x7f418013e2c0 2023-12-19T05:39:45.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.195+0000 7f417effd640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 0x7f416c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.196+0000 7f417effd640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 0x7f416c06c920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4170009a30 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.200+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4174053530 con 0x7f418013e2c0 2023-12-19T05:39:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.398+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4180061910 con 0x7f418013e2c0 2023-12-19T05:39:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.399+0000 7f4167fff640 1 -- 172.21.15.49:0/1763656838 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4174017020 con 0x7f418013e2c0 2023-12-19T05:39:45.400 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.401+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 msgr2=0x7f416c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.401+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 0x7f416c06c920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4170009a30 tx=0x7f4170008040 comp rx=0 tx=0).stop 2023-12-19T05:39:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 msgr2=0x7f4180136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f417400c410 tx=0x7f417400c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 shutdown_connections 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416c06a460 0x7f416c06c920 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418015bfb0 0x7f4180134fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418013e2c0 0x7f4180136a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 --2- 172.21.15.49:0/1763656838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41800cd230 0x7f41801f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 >> 172.21.15.49:0/1763656838 conn(0x7f41800cf5d0 msgr2=0x7f41800ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 shutdown_connections 2023-12-19T05:39:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.402+0000 7f417ffff640 1 -- 172.21.15.49:0/1763656838 wait complete. 2023-12-19T05:39:45.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.654+0000 7fa2fb515640 1 Processor -- start 2023-12-19T05:39:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.654+0000 7fa2fb515640 1 -- start start 2023-12-19T05:39:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fb515640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40b2030 0x7fa2f415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fb515640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2f40cdbf0 0x7fa2f40ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fb515640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f415ec30 con 0x7fa2f415e5a0 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fb515640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40ce5c0 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fb515640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415fbc0 con 0x7fa2f40b2030 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fad14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2f40cdbf0 0x7fa2f40ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fad14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2f40cdbf0 0x7fa2f40ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50612/0 (socket says 172.21.15.49:50612) 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.656+0000 7fa2fad14640 1 -- 172.21.15.49:0/1850664186 learned_addr learned my addr 172.21.15.49:0/1850664186 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.657+0000 7fa2f9d12640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40b2030 0x7fa2f415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.657+0000 7fa2fad14640 1 -- 172.21.15.49:0/1850664186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40b2030 msgr2=0x7fa2f415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.657+0000 7fa2fad14640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40b2030 0x7fa2f415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.657+0000 7fa2fad14640 1 -- 172.21.15.49:0/1850664186 >> v1:172.21.15.115:6789/0 conn(0x7fa2f415e5a0 legacy=0x7fa2f40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.657+0000 7fa2fad14640 1 -- 172.21.15.49:0/1850664186 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f415e980 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.658+0000 7fa2fad14640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40cdbf0 0x7fa2f40ce080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009870 tx=0x7fa2ec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa9aceeda8daf96 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.658+0000 7fa2f9511640 1 -- 172.21.15.49:0/1850664186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec030840 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2f9511640 1 -- 172.21.15.49:0/1850664186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0309a0 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2f9511640 1 -- 172.21.15.49:0/1850664186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec030d30 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 -- 172.21.15.49:0/1850664186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40cdbf0 msgr2=0x7fa2f40ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40cdbf0 0x7fa2f40ce080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009870 tx=0x7fa2ec02b980 comp rx=0 tx=0).stop 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 -- 172.21.15.49:0/1850664186 shutdown_connections 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40b2030 0x7fa2f415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 --2- 172.21.15.49:0/1850664186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40cdbf0 0x7fa2f40ce080 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 -- 172.21.15.49:0/1850664186 >> 172.21.15.49:0/1850664186 conn(0x7fa2f40b0100 msgr2=0x7fa2f40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 -- 172.21.15.49:0/1850664186 shutdown_connections 2023-12-19T05:39:45.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.659+0000 7fa2fb515640 1 -- 172.21.15.49:0/1850664186 wait complete. 2023-12-19T05:39:45.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.661+0000 7fa2fb515640 1 Processor -- start 2023-12-19T05:39:45.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.661+0000 7fa2fb515640 1 -- start start 2023-12-19T05:39:45.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40cdbf0 0x7fa2f415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f415e5a0 0x7fa2f415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415d260 con 0x7fa2f40b2030 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415b250 con 0x7fa2f415e5a0 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.662+0000 7fa2fb515640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415b4f0 con 0x7fa2f40cdbf0 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.663+0000 7fa2fa513640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.663+0000 7fa2fa513640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50626/0 (socket says 172.21.15.49:50626) 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.663+0000 7fa2fa513640 1 -- 172.21.15.49:0/2059145603 learned_addr learned my addr 172.21.15.49:0/2059145603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.663+0000 7fa2f9d12640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40cdbf0 0x7fa2f415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.663+0000 7fa2fad14640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f415e5a0 0x7fa2f415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 -- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40cdbf0 msgr2=0x7fa2f415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40cdbf0 0x7fa2f415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 -- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f415e5a0 msgr2=0x7fa2f415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f415e5a0 0x7fa2f415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 -- 172.21.15.49:0/2059145603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0094d0 con 0x7fa2f40b2030 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fa513640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c730 tx=0x7fa2e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4003b70 con 0x7fa2f40b2030 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4003cf0 con 0x7fa2f40b2030 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4003ea0 con 0x7fa2f40b2030 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f415b7d0 con 0x7fa2f40b2030 2023-12-19T05:39:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.664+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f415bd90 con 0x7fa2f40b2030 2023-12-19T05:39:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.665+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f415bfb0 con 0x7fa2f40b2030 2023-12-19T05:39:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.666+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2e400aa90 con 0x7fa2f40b2030 2023-12-19T05:39:45.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.668+0000 7fa2f2ffd640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 0x7fa2e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.668+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2e4088680 con 0x7fa2f40b2030 2023-12-19T05:39:45.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.669+0000 7fa2f9d12640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 0x7fa2e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.670+0000 7fa2f9d12640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 0x7fa2e006c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2f415c570 tx=0x7fa2e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.672+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2e4053c80 con 0x7fa2f40b2030 2023-12-19T05:39:45.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.867+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2f4061910 con 0x7fa2f40b2030 2023-12-19T05:39:45.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.869+0000 7fa2f2ffd640 1 -- 172.21.15.49:0/2059145603 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fa2e40572a0 con 0x7fa2f40b2030 2023-12-19T05:39:45.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:45.871 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:45.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.871+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 msgr2=0x7fa2e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.871+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 0x7fa2e006c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2f415c570 tx=0x7fa2e8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:45.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.871+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 msgr2=0x7fa2f4158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.871+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c730 tx=0x7fa2e400cbf0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 shutdown_connections 2023-12-19T05:39:45.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2e006a430 0x7fa2e006c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2f40cdbf0 0x7fa2f415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f415e5a0 0x7fa2f415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 --2- 172.21.15.49:0/2059145603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2f40b2030 0x7fa2f4158b20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 >> 172.21.15.49:0/2059145603 conn(0x7fa2f40b0100 msgr2=0x7fa2f40ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 shutdown_connections 2023-12-19T05:39:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:45.872+0000 7fa2fb515640 1 -- 172.21.15.49:0/2059145603 wait complete. 2023-12-19T05:39:45.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:45.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.123+0000 7f418aefa640 1 Processor -- start 2023-12-19T05:39:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.123+0000 7f418aefa640 1 -- start start 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f418aefa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f418415e460 0x7f41840ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f418aefa640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840cd020 con 0x7f418415ae50 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f418aefa640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840cca30 con 0x7f41840ce750 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f418aefa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418415e8e0 con 0x7f418415e460 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f41896f7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f418415e460 0x7f41840ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f4189ef8640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f418415ae50 0x7f41840b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58598/0 (socket says 172.21.15.49:58598) 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.125+0000 7f4189ef8640 1 -- 172.21.15.49:0/2432883795 learned_addr learned my addr 172.21.15.49:0/2432883795 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.126+0000 7f41896f7640 1 -- 172.21.15.49:0/2432883795 >> v1:172.21.15.115:6789/0 conn(0x7f41840ce750 legacy=0x7f41840cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.126+0000 7f41896f7640 1 -- 172.21.15.49:0/2432883795 >> v1:172.21.15.49:6789/0 conn(0x7f418415ae50 legacy=0x7f41840b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.126+0000 7f41896f7640 1 -- 172.21.15.49:0/2432883795 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840b2f20 con 0x7f418415e460 2023-12-19T05:39:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.126+0000 7f4188ef6640 1 -- 172.21.15.49:0/2432883795 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211389418 0 0) 0x7f41840cd020 con 0x7f418415ae50 2023-12-19T05:39:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.127+0000 7f41896f7640 1 --2- 172.21.15.49:0/2432883795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f41840ce210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f41740097a0 tx=0x7f417402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dfab062f2c820b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.127+0000 7f4188ef6640 1 -- 172.21.15.49:0/2432883795 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174031830 con 0x7f418415e460 2023-12-19T05:39:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f4188ef6640 1 -- 172.21.15.49:0/2432883795 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174031990 con 0x7f418415e460 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f4188ef6640 1 -- 172.21.15.49:0/2432883795 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174031d20 con 0x7f418415e460 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 -- 172.21.15.49:0/2432883795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 msgr2=0x7f41840ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 --2- 172.21.15.49:0/2432883795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f41840ce210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f41740097a0 tx=0x7f417402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 -- 172.21.15.49:0/2432883795 shutdown_connections 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 --2- 172.21.15.49:0/2432883795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f41840ce210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 -- 172.21.15.49:0/2432883795 >> 172.21.15.49:0/2432883795 conn(0x7f418406f630 msgr2=0x7f418406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 -- 172.21.15.49:0/2432883795 shutdown_connections 2023-12-19T05:39:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.128+0000 7f418aefa640 1 -- 172.21.15.49:0/2432883795 wait complete. 2023-12-19T05:39:46.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.130+0000 7f418aefa640 1 Processor -- start 2023-12-19T05:39:46.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.130+0000 7f418aefa640 1 -- start start 2023-12-19T05:39:46.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840ce750 0x7f41840aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418415ae50 0x7f41840af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41841f2d00 con 0x7f418415e460 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418415ccf0 con 0x7f41840ce750 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.131+0000 7f418aefa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418406c810 con 0x7f418415ae50 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50656/0 (socket says 172.21.15.49:50656) 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 -- 172.21.15.49:0/2588954024 learned_addr learned my addr 172.21.15.49:0/2588954024 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f41896f7640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418415ae50 0x7f41840af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f4189ef8640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840ce750 0x7f41840aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 -- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418415ae50 msgr2=0x7f41840af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418415ae50 0x7f41840af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 -- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840ce750 msgr2=0x7f41840aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840ce750 0x7f41840aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.132+0000 7f418a6f9640 1 -- 172.21.15.49:0/2588954024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009400 con 0x7f418415e460 2023-12-19T05:39:46.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f418a6f9640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c700 tx=0x7f417c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00aa50 con 0x7f418415e460 2023-12-19T05:39:46.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00abb0 con 0x7f418415e460 2023-12-19T05:39:46.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00ce10 con 0x7f418415e460 2023-12-19T05:39:46.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418406caf0 con 0x7f418415e460 2023-12-19T05:39:46.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.133+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418406d0b0 con 0x7f418415e460 2023-12-19T05:39:46.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.134+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41841f2e70 con 0x7f418415e460 2023-12-19T05:39:46.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.135+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f417c012420 con 0x7f418415e460 2023-12-19T05:39:46.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.137+0000 7f417a7fc640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 0x7f416806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.137+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f417c088e50 con 0x7f418415e460 2023-12-19T05:39:46.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.137+0000 7f4189ef8640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 0x7f416806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.138+0000 7f4189ef8640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 0x7f416806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4180000f60 tx=0x7f4180007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.141+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f41841f2e70 con 0x7f418415e460 2023-12-19T05:39:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.334+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f418406d2a0 con 0x7f418415e460 2023-12-19T05:39:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.334+0000 7f417a7fc640 1 -- 172.21.15.49:0/2588954024 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f417c0160a0 con 0x7f418415e460 2023-12-19T05:39:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 msgr2=0x7f416806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 0x7f416806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4180000f60 tx=0x7f4180007b50 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 msgr2=0x7f418406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c700 tx=0x7f417c00cbc0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 shutdown_connections 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f416806a430 0x7f416806c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f418415ae50 0x7f41840af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418415e460 0x7f418406bc00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 --2- 172.21.15.49:0/2588954024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840ce750 0x7f41840aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 >> 172.21.15.49:0/2588954024 conn(0x7f418406f630 msgr2=0x7f418415ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 shutdown_connections 2023-12-19T05:39:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.337+0000 7f418aefa640 1 -- 172.21.15.49:0/2588954024 wait complete. 2023-12-19T05:39:46.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.601+0000 7fbbffb39640 1 Processor -- start 2023-12-19T05:39:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.601+0000 7fbbffb39640 1 -- start start 2023-12-19T05:39:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbffb39640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf815b1d0 0x7fbbf80b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbffb39640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbbf80afa70 0x7fbbf815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbffb39640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf815e010 con 0x7fbbf80b67a0 2023-12-19T05:39:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbffb39640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf815b5b0 con 0x7fbbf815b1d0 2023-12-19T05:39:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbffb39640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80b4c20 con 0x7fbbf80afa70 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbfd8d5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf815b1d0 0x7fbbf80b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbfd8d5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf815b1d0 0x7fbbf80b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50664/0 (socket says 172.21.15.49:50664) 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/3254563230 learned_addr learned my addr 172.21.15.49:0/3254563230 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbfe0d6640 1 --1- 172.21.15.49:0/3254563230 >> v1:172.21.15.49:6789/0 conn(0x7fbbf80b67a0 0x7fbbf80b6bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58604/0 (socket says 172.21.15.49:58604) 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.603+0000 7fbbfd0d4640 1 --2- 172.21.15.49:0/3254563230 >> v2:172.21.15.115:3300/0 conn(0x7fbbf80afa70 0x7fbbf815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.604+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/3254563230 >> v2:172.21.15.115:3300/0 conn(0x7fbbf80afa70 msgr2=0x7fbbf815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.604+0000 7fbbfd8d5640 1 --2- 172.21.15.49:0/3254563230 >> v2:172.21.15.115:3300/0 conn(0x7fbbf80afa70 0x7fbbf815e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.604+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/3254563230 >> v1:172.21.15.49:6789/0 conn(0x7fbbf80b67a0 legacy=0x7fbbf80b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.604+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/3254563230 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80b4f00 con 0x7fbbf815b1d0 2023-12-19T05:39:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.604+0000 7fbbfc8d3640 1 -- 172.21.15.49:0/3254563230 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060715384 0 0) 0x7fbbf815e010 con 0x7fbbf80b67a0 2023-12-19T05:39:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.605+0000 7fbbfd8d5640 1 --2- 172.21.15.49:0/3254563230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80b4640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8066810 tx=0x7fbbf402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7be65c10b1df674 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.605+0000 7fbbfc8d3640 1 -- 172.21.15.49:0/3254563230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf402cb20 con 0x7fbbf815b1d0 2023-12-19T05:39:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.605+0000 7fbbfc8d3640 1 -- 172.21.15.49:0/3254563230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf402cc80 con 0x7fbbf815b1d0 2023-12-19T05:39:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.605+0000 7fbbfc8d3640 1 -- 172.21.15.49:0/3254563230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40343f0 con 0x7fbbf815b1d0 2023-12-19T05:39:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 -- 172.21.15.49:0/3254563230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf815b1d0 msgr2=0x7fbbf80b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 --2- 172.21.15.49:0/3254563230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80b4640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8066810 tx=0x7fbbf402bf80 comp rx=0 tx=0).stop 2023-12-19T05:39:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 -- 172.21.15.49:0/3254563230 shutdown_connections 2023-12-19T05:39:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 --2- 172.21.15.49:0/3254563230 >> v2:172.21.15.115:3300/0 conn(0x7fbbf80afa70 0x7fbbf815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 --2- 172.21.15.49:0/3254563230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80b4640 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 -- 172.21.15.49:0/3254563230 >> 172.21.15.49:0/3254563230 conn(0x7fbbf80659a0 msgr2=0x7fbbf8065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 -- 172.21.15.49:0/3254563230 shutdown_connections 2023-12-19T05:39:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.606+0000 7fbbffb39640 1 -- 172.21.15.49:0/3254563230 wait complete. 2023-12-19T05:39:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.608+0000 7fbbffb39640 1 Processor -- start 2023-12-19T05:39:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.608+0000 7fbbffb39640 1 -- start start 2023-12-19T05:39:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbf80b67a0 0x7fbbf814ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf814b280 con 0x7fbbf80afa70 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8157970 con 0x7fbbf815b1d0 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbffb39640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8157c50 con 0x7fbbf80b67a0 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbfd8d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbfd8d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50672/0 (socket says 172.21.15.49:50672) 2023-12-19T05:39:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.609+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/4120103878 learned_addr learned my addr 172.21.15.49:0/4120103878 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfe0d6640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd0d4640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbf80b67a0 0x7fbbf814ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbf80b67a0 msgr2=0x7fbbf814ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbf80b67a0 0x7fbbf814ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 msgr2=0x7fbbf80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 -- 172.21.15.49:0/4120103878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4009b30 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfe0d6640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbfd8d5640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4000f80 tx=0x7fbbf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4009510 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.610+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf403e450 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.611+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf403e5e0 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.611+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf8157f30 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.611+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf81584f0 con 0x7fbbf80afa70 2023-12-19T05:39:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.612+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf8061910 con 0x7fbbf80afa70 2023-12-19T05:39:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.613+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbf403e740 con 0x7fbbf80afa70 2023-12-19T05:39:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.614+0000 7fbbee7fc640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 0x7fbbdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.614+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbf40ab160 con 0x7fbbf80afa70 2023-12-19T05:39:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.615+0000 7fbbfd0d4640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 0x7fbbdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.616+0000 7fbbfd0d4640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 0x7fbbdc06c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006fd0 tx=0x7fbbe8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.619+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbf4076750 con 0x7fbbf80afa70 2023-12-19T05:39:46.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.813+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbf80b3380 con 0x7fbbf80afa70 2023-12-19T05:39:46.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.814+0000 7fbbee7fc640 1 -- 172.21.15.49:0/4120103878 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbf4079d70 con 0x7fbbf80afa70 2023-12-19T05:39:46.816 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.816+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 msgr2=0x7fbbdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.816+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 0x7fbbdc06c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006fd0 tx=0x7fbbe8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.816+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 msgr2=0x7fbbf80ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.816+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4000f80 tx=0x7fbbf4004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 shutdown_connections 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbdc06a430 0x7fbbdc06c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbf80b67a0 0x7fbbf814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf815b1d0 0x7fbbf80cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 --2- 172.21.15.49:0/4120103878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf80afa70 0x7fbbf80ca6b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 >> 172.21.15.49:0/4120103878 conn(0x7fbbf80659a0 msgr2=0x7fbbf8160f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 shutdown_connections 2023-12-19T05:39:46.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:46.817+0000 7fbbffb39640 1 -- 172.21.15.49:0/4120103878 wait complete. 2023-12-19T05:39:46.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.064+0000 7ffa11adc640 1 Processor -- start 2023-12-19T05:39:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.065+0000 7ffa11adc640 1 -- start start 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.066+0000 7ffa11adc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ffa0c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.067+0000 7ffa11adc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c15dae0 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.067+0000 7ffa11adc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c15b000 con 0x7ffa0c15e580 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.067+0000 7ffa11adc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15ea30 con 0x7ffa0c0b0470 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.067+0000 7ffa10ada640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffa0c0cd4e0 0x7ffa0c15a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58608/0 (socket says 172.21.15.49:58608) 2023-12-19T05:39:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.067+0000 7ffa10ada640 1 -- 172.21.15.49:0/4257552043 learned_addr learned my addr 172.21.15.49:0/4257552043 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa112db640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ffa0c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166656638 0 0) 0x7ffa0c15dae0 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9fc005730 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832493337 0 0) 0x7ff9fc005730 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 msgr2=0x7ffa0c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ffa0c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 >> v1:172.21.15.115:6789/0 conn(0x7ffa0c15e580 legacy=0x7ffa0c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c15b2e0 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ffa00001690 con 0x7ffa0c0cd4e0 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 >> v1:172.21.15.49:6789/0 conn(0x7ffa0c0cd4e0 legacy=0x7ffa0c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ff9fc005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc0060f0 0x7ff9fc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc006f10 0x7ff9fc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15ea30 con 0x7ff9fc006f10 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc00dbf0 con 0x7ff9fc0060f0 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.068+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc00ddb0 con 0x7ffa0c0b0470 2023-12-19T05:39:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc006f10 0x7ff9fc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa10ada640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ff9fc005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa0bfff640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc0060f0 0x7ff9fc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 -- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 msgr2=0x7ff9fc005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa0c0b0470 0x7ff9fc005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 -- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc0060f0 msgr2=0x7ff9fc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc0060f0 0x7ff9fc0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.069+0000 7ffa112db640 1 -- 172.21.15.49:0/4257552043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc005730 con 0x7ff9fc006f10 2023-12-19T05:39:47.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.070+0000 7ffa112db640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc006f10 0x7ff9fc007390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009f90 tx=0x7ff9fc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966f59e17730c589 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402cbd0 con 0x7ff9fc006f10 2023-12-19T05:39:47.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0400f040 con 0x7ff9fc006f10 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa0b7fe640 1 -- 172.21.15.49:0/4257552043 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04034440 con 0x7ff9fc006f10 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa11adc640 1 -- 172.21.15.49:0/4257552043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc006f10 msgr2=0x7ff9fc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa11adc640 1 --2- 172.21.15.49:0/4257552043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc006f10 0x7ff9fc007390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009f90 tx=0x7ff9fc007a00 comp rx=0 tx=0).stop 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa112db640 1 -- 172.21.15.49:0/4257552043 reap_dead start 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa11adc640 1 -- 172.21.15.49:0/4257552043 shutdown_connections 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.071+0000 7ffa11adc640 1 -- 172.21.15.49:0/4257552043 >> 172.21.15.49:0/4257552043 conn(0x7ffa0c06f630 msgr2=0x7ffa0c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.072+0000 7ffa11adc640 1 -- 172.21.15.49:0/4257552043 shutdown_connections 2023-12-19T05:39:47.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.072+0000 7ffa11adc640 1 -- 172.21.15.49:0/4257552043 wait complete. 2023-12-19T05:39:47.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.074+0000 7ffa11adc640 1 Processor -- start 2023-12-19T05:39:47.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.074+0000 7ffa11adc640 1 -- start start 2023-12-19T05:39:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 0x7ffa0c0a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 0x7ffa0c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c158d10 con 0x7ffa0c158860 2023-12-19T05:39:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c145950 con 0x7ffa0c1444c0 2023-12-19T05:39:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa11adc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c144940 con 0x7ff9fc006f10 2023-12-19T05:39:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa112db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa112db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50692/0 (socket says 172.21.15.49:50692) 2023-12-19T05:39:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa112db640 1 -- 172.21.15.49:0/1984059511 learned_addr learned my addr 172.21.15.49:0/1984059511 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa10ada640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 0x7ffa0c0a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.075+0000 7ffa0bfff640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 0x7ffa0c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 -- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 msgr2=0x7ffa0c0a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 0x7ffa0c0a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 -- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 msgr2=0x7ffa0c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 0x7ffa0c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 -- 172.21.15.49:0/1984059511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c144d40 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa10ada640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 0x7ffa0c0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa0bfff640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 0x7ffa0c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa112db640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa04037040 tx=0x7ffa04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003b90 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04003cf0 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04034b60 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c145020 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.076+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c1455e0 con 0x7ffa0c158860 2023-12-19T05:39:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.078+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c1457a0 con 0x7ffa0c158860 2023-12-19T05:39:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.079+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa04034cc0 con 0x7ffa0c158860 2023-12-19T05:39:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.080+0000 7ffa097fa640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 0x7ff9f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.080+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa040aa040 con 0x7ffa0c158860 2023-12-19T05:39:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.080+0000 7ffa10ada640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 0x7ff9f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.081+0000 7ffa10ada640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 0x7ff9f006c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c1f1910 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.084+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffa04075770 con 0x7ffa0c158860 2023-12-19T05:39:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.286+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa0c0ad8e0 con 0x7ffa0c158860 2023-12-19T05:39:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.287+0000 7ffa097fa640 1 -- 172.21.15.49:0/1984059511 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa04078d90 con 0x7ffa0c158860 2023-12-19T05:39:47.288 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.289+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 msgr2=0x7ff9f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.289+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 0x7ff9f006c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c1f1910 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.289+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 msgr2=0x7ffa0c0ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.289+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa04037040 tx=0x7ffa04009750 comp rx=0 tx=0).stop 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 shutdown_connections 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9f006a460 0x7ff9f006c920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa0c158860 0x7ffa0c0ab2d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa0c1444c0 0x7ffa0c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 --2- 172.21.15.49:0/1984059511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc006f10 0x7ffa0c0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 >> 172.21.15.49:0/1984059511 conn(0x7ffa0c06f630 msgr2=0x7ffa0c15d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 shutdown_connections 2023-12-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.290+0000 7ffa11adc640 1 -- 172.21.15.49:0/1984059511 wait complete. 2023-12-19T05:39:47.320 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-19T05:39:47.320 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T05:39:47.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.564+0000 7f8a5cd7e640 1 Processor -- start 2023-12-19T05:39:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.564+0000 7f8a5cd7e640 1 -- start start 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a5815e5a0 0x7f8a580b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 0x7f8a580b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 0x7f8a580ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580ce5c0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5815ec30 con 0x7f8a580cdbf0 2023-12-19T05:39:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a5cd7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580b2cc0 con 0x7f8a5815f680 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a577fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a5815e5a0 0x7f8a580b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a577fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a5815e5a0 0x7f8a580b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50708/0 (socket says 172.21.15.49:50708) 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.566+0000 7f8a577fe640 1 -- 172.21.15.49:0/3569330367 learned_addr learned my addr 172.21.15.49:0/3569330367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a57fff640 1 --2- 172.21.15.49:0/3569330367 >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 0x7f8a580ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a4ffff640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 0x7f8a580b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a577fe640 1 -- 172.21.15.49:0/3569330367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 msgr2=0x7f8a580b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 0x7f8a580b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a577fe640 1 -- 172.21.15.49:0/3569330367 >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 msgr2=0x7f8a580ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3569330367 >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 0x7f8a580ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a577fe640 1 -- 172.21.15.49:0/3569330367 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5815e980 con 0x7f8a5815e5a0 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a57fff640 1 --2- 172.21.15.49:0/3569330367 >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 0x7f8a580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:47.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.567+0000 7f8a4ffff640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 0x7f8a580b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:47.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.568+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a580b2030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806b310 tx=0x7f8a4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2f5408dbb1a67d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.568+0000 7f8a56ffd640 1 -- 172.21.15.49:0/3569330367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48031870 con 0x7f8a5815e5a0 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.568+0000 7f8a56ffd640 1 -- 172.21.15.49:0/3569330367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480319d0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.568+0000 7f8a56ffd640 1 -- 172.21.15.49:0/3569330367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48031d60 con 0x7f8a5815e5a0 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3569330367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 msgr2=0x7f8a580b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a580b2030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806b310 tx=0x7f8a4802b910 comp rx=0 tx=0).stop 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3569330367 shutdown_connections 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3569330367 >> v2:172.21.15.115:3300/0 conn(0x7f8a580cdbf0 0x7f8a580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5815f680 0x7f8a580b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3569330367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a580b2030 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3569330367 >> 172.21.15.49:0/3569330367 conn(0x7f8a580b0100 msgr2=0x7f8a580b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3569330367 shutdown_connections 2023-12-19T05:39:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.569+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3569330367 wait complete. 2023-12-19T05:39:47.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.571+0000 7f8a5cd7e640 1 Processor -- start 2023-12-19T05:39:47.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.571+0000 7f8a5cd7e640 1 -- start start 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a580cdbf0 0x7f8a58151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 0x7f8a5815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5815cd40 con 0x7f8a5815e5a0 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58151d40 con 0x7f8a5815f680 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a5cd7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a581f1830 con 0x7f8a580cdbf0 2023-12-19T05:39:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.572+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50722/0 (socket says 172.21.15.49:50722) 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 -- 172.21.15.49:0/3529327885 learned_addr learned my addr 172.21.15.49:0/3529327885 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a580cdbf0 0x7f8a58151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a57fff640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 0x7f8a5815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 -- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a580cdbf0 msgr2=0x7f8a58151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a580cdbf0 0x7f8a58151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 -- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 msgr2=0x7f8a5815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 0x7f8a5815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 -- 172.21.15.49:0/3529327885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480094d0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a57fff640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 0x7f8a5815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.573+0000 7f8a4ffff640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c7f0 tx=0x7f8a4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.574+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007820 con 0x7f8a5815e5a0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.574+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40007980 con 0x7f8a5815e5a0 2023-12-19T05:39:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.574+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007cf0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.574+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5815a720 con 0x7f8a5815e5a0 2023-12-19T05:39:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.574+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5815ace0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.575+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58061910 con 0x7f8a5815e5a0 2023-12-19T05:39:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.576+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a400113f0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.577+0000 7f8a54ff9640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.577+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a40088af0 con 0x7f8a5815e5a0 2023-12-19T05:39:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.578+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:47.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.579+0000 7f8a577fe640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 0x7f8a3806c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a48036000 tx=0x7f8a4803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.581+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a40054170 con 0x7f8a5815e5a0 2023-12-19T05:39:47.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.778+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a5815ee50 con 0x7f8a5815e5a0 2023-12-19T05:39:47.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.781+0000 7f8a54ff9640 1 -- 172.21.15.49:0/3529327885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f8a4001f090 con 0x7f8a5815e5a0 2023-12-19T05:39:47.783 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:47.783 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:03.686879+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:47.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 msgr2=0x7f8a3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 0x7f8a3806c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a48036000 tx=0x7f8a4803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:47.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 msgr2=0x7f8a581f12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c7f0 tx=0x7f8a4000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 shutdown_connections 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a5815f680 0x7f8a5815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a5815e5a0 0x7f8a581f12f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 --2- 172.21.15.49:0/3529327885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a580cdbf0 0x7f8a58151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 >> 172.21.15.49:0/3529327885 conn(0x7f8a580b0100 msgr2=0x7f8a580af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 shutdown_connections 2023-12-19T05:39:47.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:47.784+0000 7f8a5cd7e640 1 -- 172.21.15.49:0/3529327885 wait complete. 2023-12-19T05:39:47.806 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:47.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:48.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.041+0000 7f1c09495640 1 Processor -- start 2023-12-19T05:39:48.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.042+0000 7f1c09495640 1 -- start start 2023-12-19T05:39:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.043+0000 7f1c09495640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c04146cd0 0x7f1c040b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.043+0000 7f1c09495640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c0406fba0 0x7f1c040d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.043+0000 7f1c09495640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c04070260 con 0x7f1c040b6890 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.043+0000 7f1c09495640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c041470b0 con 0x7f1c0406fba0 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.043+0000 7f1c09495640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040b6ea0 con 0x7f1c04146cd0 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c0406fba0 0x7f1c040d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c0406fba0 0x7f1c040d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50736/0 (socket says 172.21.15.49:50736) 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 -- 172.21.15.49:0/2659845464 learned_addr learned my addr 172.21.15.49:0/2659845464 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c03fff640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c04146cd0 0x7f1c040b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 -- 172.21.15.49:0/2659845464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c04146cd0 msgr2=0x7f1c040b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c04146cd0 0x7f1c040b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 -- 172.21.15.49:0/2659845464 >> v1:172.21.15.115:6789/0 conn(0x7f1c040b6890 legacy=0x7f1c0406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.044+0000 7f1c08c94640 1 -- 172.21.15.49:0/2659845464 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040b7180 con 0x7f1c0406fba0 2023-12-19T05:39:48.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.046+0000 7f1c08c94640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c040d1670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009870 tx=0x7f1bfc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9574e8cc071a710 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.046+0000 7f1c02ffd640 1 -- 172.21.15.49:0/2659845464 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0317c0 con 0x7f1c0406fba0 2023-12-19T05:39:48.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.046+0000 7f1c02ffd640 1 -- 172.21.15.49:0/2659845464 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc031920 con 0x7f1c0406fba0 2023-12-19T05:39:48.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.046+0000 7f1c02ffd640 1 -- 172.21.15.49:0/2659845464 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc031cb0 con 0x7f1c0406fba0 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 -- 172.21.15.49:0/2659845464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 msgr2=0x7f1c040d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c040d1670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009870 tx=0x7f1bfc02b860 comp rx=0 tx=0).stop 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 -- 172.21.15.49:0/2659845464 shutdown_connections 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c040d1670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 --2- 172.21.15.49:0/2659845464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c04146cd0 0x7f1c040b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 -- 172.21.15.49:0/2659845464 >> 172.21.15.49:0/2659845464 conn(0x7f1c040d3200 msgr2=0x7f1c040d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 -- 172.21.15.49:0/2659845464 shutdown_connections 2023-12-19T05:39:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.047+0000 7f1c09495640 1 -- 172.21.15.49:0/2659845464 wait complete. 2023-12-19T05:39:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.049+0000 7f1c09495640 1 Processor -- start 2023-12-19T05:39:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.049+0000 7f1c09495640 1 -- start start 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c040b6890 0x7f1c04140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c04146cd0 0x7f1c0415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04142f60 con 0x7f1c0406fba0 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04141800 con 0x7f1c04146cd0 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c09495640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04143200 con 0x7f1c040b6890 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50738/0 (socket says 172.21.15.49:50738) 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.050+0000 7f1c03fff640 1 -- 172.21.15.49:0/2702961297 learned_addr learned my addr 172.21.15.49:0/2702961297 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c037fe640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c040b6890 0x7f1c04140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c08c94640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c04146cd0 0x7f1c0415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 -- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c040b6890 msgr2=0x7f1c04140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c040b6890 0x7f1c04140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 -- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c04146cd0 msgr2=0x7f1c0415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c04146cd0 0x7f1c0415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 -- 172.21.15.49:0/2702961297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0094d0 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c03fff640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400ccd0 tx=0x7f1bf400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.051+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4003990 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.052+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4003af0 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.052+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4004020 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.052+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c041434e0 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.052+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c041f3d10 con 0x7f1c0406fba0 2023-12-19T05:39:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.053+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04143a00 con 0x7f1c0406fba0 2023-12-19T05:39:48.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.054+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1bf4004180 con 0x7f1c0406fba0 2023-12-19T05:39:48.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.055+0000 7f1c00ff9640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 0x7f1be406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.055+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bf4088d20 con 0x7f1c0406fba0 2023-12-19T05:39:48.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.056+0000 7f1c037fe640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 0x7f1be406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.057+0000 7f1c037fe640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 0x7f1be406c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c04153650 tx=0x7f1bec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.060+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c04143a00 con 0x7f1c0406fba0 2023-12-19T05:39:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.253+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c04143a00 con 0x7f1c0406fba0 2023-12-19T05:39:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.254+0000 7f1c00ff9640 1 -- 172.21.15.49:0/2702961297 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c04143a00 con 0x7f1c0406fba0 2023-12-19T05:39:48.255 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 msgr2=0x7f1be406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 0x7f1be406c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c04153650 tx=0x7f1bec009040 comp rx=0 tx=0).stop 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 msgr2=0x7f1c0413a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400ccd0 tx=0x7f1bf400a5c0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 shutdown_connections 2023-12-19T05:39:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1be406a430 0x7f1be406c8f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c040b6890 0x7f1c04140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c04146cd0 0x7f1c0415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 --2- 172.21.15.49:0/2702961297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0406fba0 0x7f1c0413a750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 >> 172.21.15.49:0/2702961297 conn(0x7f1c040d3200 msgr2=0x7f1c040b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 shutdown_connections 2023-12-19T05:39:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.257+0000 7f1c09495640 1 -- 172.21.15.49:0/2702961297 wait complete. 2023-12-19T05:39:48.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:48.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.517+0000 7fb095100640 1 Processor -- start 2023-12-19T05:39:48.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.518+0000 7fb095100640 1 -- start start 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.519+0000 7fb095100640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb090070170 0x7fb0900b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.519+0000 7fb095100640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb090142bf0 con 0x7fb0900d2d00 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.519+0000 7fb095100640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb090142e40 con 0x7fb0900b8f30 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.520+0000 7fb095100640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb090143120 con 0x7fb090070170 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.520+0000 7fb08ed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0900d2d00 0x7fb0900b8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58612/0 (socket says 172.21.15.49:58612) 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.520+0000 7fb08ed9d640 1 -- 172.21.15.49:0/3036957754 learned_addr learned my addr 172.21.15.49:0/3036957754 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.520+0000 7fb08f59e640 1 --2- 172.21.15.49:0/3036957754 >> v2:172.21.15.115:3300/0 conn(0x7fb090070170 0x7fb0900b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308595538 0 0) 0x7fb090142bf0 con 0x7fb0900d2d00 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c003520 con 0x7fb0900d2d00 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08f59e640 1 -- 172.21.15.49:0/3036957754 >> v1:172.21.15.115:6789/0 conn(0x7fb0900b8f30 legacy=0x7fb0900b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08f59e640 1 -- 172.21.15.49:0/3036957754 >> v1:172.21.15.49:6789/0 conn(0x7fb0900d2d00 legacy=0x7fb0900b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3045794181 0 0) 0x7fb07c003520 con 0x7fb0900d2d00 2023-12-19T05:39:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.521+0000 7fb08f59e640 1 -- 172.21.15.49:0/3036957754 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090143400 con 0x7fb090070170 2023-12-19T05:39:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.522+0000 7fb08f59e640 1 --2- 172.21.15.49:0/3036957754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb090070170 0x7fb0900b6e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0880097a0 tx=0x7fb08802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7b768c735aec7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.523+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078001670 con 0x7fb090070170 2023-12-19T05:39:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.523+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08802e050 con 0x7fb090070170 2023-12-19T05:39:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.523+0000 7fb08dd9b640 1 -- 172.21.15.49:0/3036957754 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088030710 con 0x7fb090070170 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.523+0000 7fb095100640 1 -- 172.21.15.49:0/3036957754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb090070170 msgr2=0x7fb0900b6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.523+0000 7fb095100640 1 --2- 172.21.15.49:0/3036957754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb090070170 0x7fb0900b6e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0880097a0 tx=0x7fb08802b790 comp rx=0 tx=0).stop 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.524+0000 7fb095100640 1 -- 172.21.15.49:0/3036957754 shutdown_connections 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.524+0000 7fb095100640 1 --2- 172.21.15.49:0/3036957754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb090070170 0x7fb0900b6e50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.524+0000 7fb095100640 1 -- 172.21.15.49:0/3036957754 >> 172.21.15.49:0/3036957754 conn(0x7fb0900cfe10 msgr2=0x7fb0900d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.524+0000 7fb095100640 1 -- 172.21.15.49:0/3036957754 shutdown_connections 2023-12-19T05:39:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.524+0000 7fb095100640 1 -- 172.21.15.49:0/3036957754 wait complete. 2023-12-19T05:39:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.525+0000 7fb095100640 1 Processor -- start 2023-12-19T05:39:48.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 -- start start 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 0x7fb09013c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900d2d00 0x7fb09013caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090135a80 con 0x7fb090070170 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090146380 con 0x7fb0900b8f30 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.526+0000 7fb095100640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb090145a90 con 0x7fb0900d2d00 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50750/0 (socket says 172.21.15.49:50750) 2023-12-19T05:39:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 -- 172.21.15.49:0/4063502738 learned_addr learned my addr 172.21.15.49:0/4063502738 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08f59e640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900d2d00 0x7fb09013caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08e59c640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 0x7fb09013c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 -- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900d2d00 msgr2=0x7fb09013caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900d2d00 0x7fb09013caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 -- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 msgr2=0x7fb09013c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 0x7fb09013c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08ed9d640 1 -- 172.21.15.49:0/4063502738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088009400 con 0x7fb090070170 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.527+0000 7fb08e59c640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 0x7fb09013c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb08ed9d640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb07800c780 tx=0x7fb07800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078005ad0 con 0x7fb090070170 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078005c50 con 0x7fb090070170 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078007070 con 0x7fb090070170 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0901357a0 con 0x7fb090070170 2023-12-19T05:39:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.528+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb090146010 con 0x7fb090070170 2023-12-19T05:39:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.529+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb090061910 con 0x7fb090070170 2023-12-19T05:39:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.530+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0780071d0 con 0x7fb090070170 2023-12-19T05:39:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.531+0000 7fb0877fe640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 0x7fb07006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.531+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0780885f0 con 0x7fb090070170 2023-12-19T05:39:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.532+0000 7fb08e59c640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 0x7fb07006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.533+0000 7fb08e59c640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 0x7fb07006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0900b6390 tx=0x7fb080009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.536+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb078053bd0 con 0x7fb090070170 2023-12-19T05:39:48.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.724+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0900d3390 con 0x7fb090070170 2023-12-19T05:39:48.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.725+0000 7fb0877fe640 1 -- 172.21.15.49:0/4063502738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0780571f0 con 0x7fb090070170 2023-12-19T05:39:48.726 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.727+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 msgr2=0x7fb07006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.727+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 0x7fb07006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0900b6390 tx=0x7fb080009040 comp rx=0 tx=0).stop 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 msgr2=0x7fb090146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb07800c780 tx=0x7fb07800cc40 comp rx=0 tx=0).stop 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 shutdown_connections 2023-12-19T05:39:48.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb07006a430 0x7fb07006c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900d2d00 0x7fb09013caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900b8f30 0x7fb09013c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 --2- 172.21.15.49:0/4063502738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb090070170 0x7fb090146810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 >> 172.21.15.49:0/4063502738 conn(0x7fb0900cfe10 msgr2=0x7fb0900b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 shutdown_connections 2023-12-19T05:39:48.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.728+0000 7fb095100640 1 -- 172.21.15.49:0/4063502738 wait complete. 2023-12-19T05:39:48.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:48.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.982+0000 7f643ffff640 1 Processor -- start 2023-12-19T05:39:48.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.983+0000 7f643ffff640 1 -- start start 2023-12-19T05:39:48.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.984+0000 7f643ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6440071030 0x7f644015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64400d2a40 0x7f64400d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6440140830 con 0x7f64400b8890 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643ffff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400d26d0 con 0x7f64400d2a40 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643ffff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400b8c70 con 0x7f6440071030 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64400d2a40 0x7f64400d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64400d2a40 0x7f64400d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50754/0 (socket says 172.21.15.49:50754) 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 -- 172.21.15.49:0/854186919 learned_addr learned my addr 172.21.15.49:0/854186919 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643e7fc640 1 --2- 172.21.15.49:0/854186919 >> v2:172.21.15.115:3300/0 conn(0x7f6440071030 0x7f644015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 -- 172.21.15.49:0/854186919 >> v2:172.21.15.115:3300/0 conn(0x7f6440071030 msgr2=0x7f644015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 --2- 172.21.15.49:0/854186919 >> v2:172.21.15.115:3300/0 conn(0x7f6440071030 0x7f644015d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 -- 172.21.15.49:0/854186919 >> v1:172.21.15.115:6789/0 conn(0x7f64400b8890 legacy=0x7f6440070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:48.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.985+0000 7f643f7fe640 1 -- 172.21.15.49:0/854186919 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400d2e90 con 0x7f64400d2a40 2023-12-19T05:39:48.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.987+0000 7f643f7fe640 1 --2- 172.21.15.49:0/854186919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64400d2a40 0x7f64400d0060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64400d4120 tx=0x7f643802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7296da4c5151fd66 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.987+0000 7f643dffb640 1 -- 172.21.15.49:0/854186919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438031870 con 0x7f64400d2a40 2023-12-19T05:39:48.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.987+0000 7f643dffb640 1 -- 172.21.15.49:0/854186919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64380319d0 con 0x7f64400d2a40 2023-12-19T05:39:48.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.987+0000 7f643dffb640 1 -- 172.21.15.49:0/854186919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438031d60 con 0x7f64400d2a40 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 -- 172.21.15.49:0/854186919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64400d2a40 msgr2=0x7f64400d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 --2- 172.21.15.49:0/854186919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64400d2a40 0x7f64400d0060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64400d4120 tx=0x7f643802b910 comp rx=0 tx=0).stop 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 -- 172.21.15.49:0/854186919 shutdown_connections 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 --2- 172.21.15.49:0/854186919 >> v2:172.21.15.115:3300/0 conn(0x7f6440071030 0x7f644015d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 --2- 172.21.15.49:0/854186919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64400d2a40 0x7f64400d0060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 -- 172.21.15.49:0/854186919 >> 172.21.15.49:0/854186919 conn(0x7f64400d30b0 msgr2=0x7f64400d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 -- 172.21.15.49:0/854186919 shutdown_connections 2023-12-19T05:39:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.988+0000 7f643ffff640 1 -- 172.21.15.49:0/854186919 wait complete. 2023-12-19T05:39:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.990+0000 7f643ffff640 1 Processor -- start 2023-12-19T05:39:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.990+0000 7f643ffff640 1 -- start start 2023-12-19T05:39:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64400b8890 0x7f64401f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64400d2a40 0x7f64400b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400b80e0 con 0x7f6440071030 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64401f2340 con 0x7f64400d2a40 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64400b4fe0 con 0x7f64400b8890 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50762/0 (socket says 172.21.15.49:50762) 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.991+0000 7f643effd640 1 -- 172.21.15.49:0/1839406714 learned_addr learned my addr 172.21.15.49:0/1839406714 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 -- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64400b8890 msgr2=0x7f64401f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64400b8890 0x7f64401f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 -- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64400d2a40 msgr2=0x7f64400b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64400d2a40 0x7f64400b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 -- 172.21.15.49:0/1839406714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380094d0 con 0x7f6440071030 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643effd640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f643000c7c0 tx=0x7f643000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000aa50 con 0x7f6440071030 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643000abb0 con 0x7f6440071030 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430012420 con 0x7f6440071030 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64400b7b20 con 0x7f6440071030 2023-12-19T05:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.992+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64400b42a0 con 0x7f6440071030 2023-12-19T05:39:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.994+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64400b4100 con 0x7f6440071030 2023-12-19T05:39:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.995+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6430012580 con 0x7f6440071030 2023-12-19T05:39:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.996+0000 7f6437fff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 0x7f642006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.996+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64300887b0 con 0x7f6440071030 2023-12-19T05:39:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.996+0000 7f643e7fc640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 0x7f642006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:48.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:48.997+0000 7f643e7fc640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 0x7f642006c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6428006fd0 tx=0x7f6428008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.000+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64400b4100 con 0x7f6440071030 2023-12-19T05:39:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.191+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64400b4100 con 0x7f6440071030 2023-12-19T05:39:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.192+0000 7f6437fff640 1 -- 172.21.15.49:0/1839406714 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64400b4100 con 0x7f6440071030 2023-12-19T05:39:49.194 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.194+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 msgr2=0x7f642006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.194+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 0x7f642006c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6428006fd0 tx=0x7f6428008040 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.194+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 msgr2=0x7f64401e8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.194+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f643000c7c0 tx=0x7f643000cc80 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 shutdown_connections 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f642006a460 0x7f642006c920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64400b8890 0x7f64401f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64400d2a40 0x7f64400b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 --2- 172.21.15.49:0/1839406714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6440071030 0x7f64401e8540 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 >> 172.21.15.49:0/1839406714 conn(0x7f64400d30b0 msgr2=0x7f644015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:49.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 shutdown_connections 2023-12-19T05:39:49.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.195+0000 7f643ffff640 1 -- 172.21.15.49:0/1839406714 wait complete. 2023-12-19T05:39:49.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-19T05:39:49.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.444+0000 7f9d515fd640 1 Processor -- start 2023-12-19T05:39:49.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.445+0000 7f9d515fd640 1 -- start start 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.446+0000 7f9d515fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d515fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cdbf0 0x7f9d4c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d515fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c15ec30 con 0x7f9d4c15f680 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d515fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0ce5a0 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d515fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c15e980 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50778/0 (socket says 172.21.15.49:50778) 2023-12-19T05:39:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 -- 172.21.15.49:0/67352647 learned_addr learned my addr 172.21.15.49:0/67352647 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 -- 172.21.15.49:0/67352647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cdbf0 msgr2=0x7f9d4c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d50dfc640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cdbf0 0x7f9d4c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cdbf0 0x7f9d4c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 -- 172.21.15.49:0/67352647 >> v1:172.21.15.115:6789/0 conn(0x7f9d4c15f680 legacy=0x7f9d4c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.447+0000 7f9d4bfff640 1 -- 172.21.15.49:0/67352647 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0b2f90 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.449+0000 7f9d4bfff640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098a0 tx=0x7f9d3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8802713c90e06c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:49.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.449+0000 7f9d4b7fe640 1 -- 172.21.15.49:0/67352647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c031640 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.449+0000 7f9d4b7fe640 1 -- 172.21.15.49:0/67352647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c0317a0 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.449+0000 7f9d4b7fe640 1 -- 172.21.15.49:0/67352647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c031b30 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 -- 172.21.15.49:0/67352647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c15e5a0 msgr2=0x7f9d4c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098a0 tx=0x7f9d3c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 -- 172.21.15.49:0/67352647 shutdown_connections 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cdbf0 0x7f9d4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 --2- 172.21.15.49:0/67352647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c0b2030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 -- 172.21.15.49:0/67352647 >> 172.21.15.49:0/67352647 conn(0x7f9d4c0b0100 msgr2=0x7f9d4c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 -- 172.21.15.49:0/67352647 shutdown_connections 2023-12-19T05:39:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.450+0000 7f9d515fd640 1 -- 172.21.15.49:0/67352647 wait complete. 2023-12-19T05:39:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.452+0000 7f9d515fd640 1 Processor -- start 2023-12-19T05:39:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.452+0000 7f9d515fd640 1 -- start start 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c1f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c15f680 0x7f9d4c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0cb9e0 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c154860 con 0x7f9d4c15e5a0 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d515fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1f6950 con 0x7f9d4c15f680 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.453+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50780/0 (socket says 172.21.15.49:50780) 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 -- 172.21.15.49:0/1581998471 learned_addr learned my addr 172.21.15.49:0/1581998471 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d43fff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c1f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d50dfc640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c15f680 0x7f9d4c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 -- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c15f680 msgr2=0x7f9d4c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:49.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c15f680 0x7f9d4c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 -- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c15e5a0 msgr2=0x7f9d4c1f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:49.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c1f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:49.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.454+0000 7f9d4bfff640 1 -- 172.21.15.49:0/1581998471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0094d0 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.455+0000 7f9d4bfff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098a0 tx=0x7f9d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.456+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c03ac60 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.456+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c1f6c30 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.456+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c03ade0 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.456+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c044630 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.456+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c0cbed0 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.458+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c1f6e40 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.459+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d3c02f050 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.460+0000 7f9d497fa640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 0x7f9d2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.460+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d3c0aab60 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.460+0000 7f9d43fff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 0x7f9d2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.462+0000 7f9d43fff640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 0x7f9d2c06c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0ce110 tx=0x7f9d34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:49.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.464+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d4c1f6e40 con 0x7f9d4c0cdbf0 2023-12-19T05:39:49.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:49.733+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f9d4c1f6e40 con 0x7f9d4c0cdbf0 2023-12-19T05:39:50.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.462+0000 7f9d497fa640 1 -- 172.21.15.49:0/1581998471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v57) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9d4c1f6e40 con 0x7f9d4c0cdbf0 2023-12-19T05:39:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.467+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 msgr2=0x7f9d2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.467+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 0x7f9d2c06c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0ce110 tx=0x7f9d34009040 comp rx=0 tx=0).stop 2023-12-19T05:39:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.467+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 msgr2=0x7f9d4c154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.467+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098a0 tx=0x7f9d3c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 shutdown_connections 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d2c06a430 0x7f9d2c06c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c15f680 0x7f9d4c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c15e5a0 0x7f9d4c1f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 --2- 172.21.15.49:0/1581998471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d4c0cdbf0 0x7f9d4c154320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 >> 172.21.15.49:0/1581998471 conn(0x7f9d4c0b0100 msgr2=0x7f9d4c15b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 shutdown_connections 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.468+0000 7f9d515fd640 1 -- 172.21.15.49:0/1581998471 wait complete. 2023-12-19T05:39:50.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T05:39:50.750 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_objectstore":"memstore"} 2023-12-19T05:39:50.751 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T05:39:50.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:39:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.987+0000 7f020de7d640 1 Processor -- start 2023-12-19T05:39:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.987+0000 7f020de7d640 1 -- start start 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f020de7d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02080b2c20 0x7f020815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f020de7d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020815c260 con 0x7f02080d0c30 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f020de7d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020815b9a0 con 0x7f020815f4e0 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f020de7d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020815bc10 con 0x7f02080b2c20 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f02077fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f02080d0c30 0x7f02080b2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58624/0 (socket says 172.21.15.49:58624) 2023-12-19T05:39:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f02077fe640 1 -- 172.21.15.49:0/3588313709 learned_addr learned my addr 172.21.15.49:0/3588313709 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.989+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236316224 0 0) 0x7f020815c260 con 0x7f02080d0c30 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0003520 con 0x7f02080d0c30 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f0206ffd640 1 --2- 172.21.15.49:0/3588313709 >> v2:172.21.15.115:3300/0 conn(0x7f02080b2c20 0x7f020815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325050921 0 0) 0x7f01f0003520 con 0x7f02080d0c30 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 >> v2:172.21.15.115:3300/0 conn(0x7f02080b2c20 msgr2=0x7f020815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 --2- 172.21.15.49:0/3588313709 >> v2:172.21.15.115:3300/0 conn(0x7f02080b2c20 0x7f020815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 >> v1:172.21.15.115:6789/0 conn(0x7f020815f4e0 legacy=0x7f02080cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020815bef0 con 0x7f02080d0c30 2023-12-19T05:39:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f01f8001670 con 0x7f02080d0c30 2023-12-19T05:39:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 >> v1:172.21.15.49:6789/0 conn(0x7f02080d0c30 legacy=0x7f02080b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:50.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01f00039e0 0x7f01f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01f00047c0 0x7f01f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f01f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020815bc10 con 0x7f01f0005180 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f000c0b0 con 0x7f01f00047c0 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.990+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f000c270 con 0x7f01f00039e0 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f01f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0206ffd640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01f00047c0 0x7f01f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f02077fe640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01f00039e0 0x7f01f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 -- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01f00039e0 msgr2=0x7f01f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01f00039e0 0x7f01f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 -- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01f00047c0 msgr2=0x7f01f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01f00047c0 0x7f01f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.991+0000 7f0207fff640 1 -- 172.21.15.49:0/3588313709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0003520 con 0x7f01f0005180 2023-12-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.992+0000 7f0207fff640 1 -- 172.21.15.49:0/3588313709 reap_dead start 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.992+0000 7f0207fff640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f01f000b980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0200001e50 tx=0x7f01f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df13b2ea10432c99 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200003b70 con 0x7f01f0005180 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200003cf0 con 0x7f01f0005180 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f02067fc640 1 -- 172.21.15.49:0/3588313709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200005310 con 0x7f01f0005180 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f020de7d640 1 -- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 msgr2=0x7f01f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f020de7d640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f01f000b980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0200001e50 tx=0x7f01f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f020de7d640 1 -- 172.21.15.49:0/3588313709 shutdown_connections 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f020de7d640 1 --2- 172.21.15.49:0/3588313709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f01f000b980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.993+0000 7f020de7d640 1 -- 172.21.15.49:0/3588313709 >> 172.21.15.49:0/3588313709 conn(0x7f020806ba40 msgr2=0x7f020806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.994+0000 7f020de7d640 1 -- 172.21.15.49:0/3588313709 shutdown_connections 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.994+0000 7f020de7d640 1 -- 172.21.15.49:0/3588313709 wait complete. 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.995+0000 7f020de7d640 1 Processor -- start 2023-12-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.996+0000 7f020de7d640 1 -- start start 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.996+0000 7f020de7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.996+0000 7f020de7d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0208070050 0x7f02080704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f020de7d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02080b0560 0x7f02080b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f020de7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208070a10 con 0x7f01f0005180 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f020de7d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02081f5c40 con 0x7f0208070050 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f020de7d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02081f5f20 con 0x7f02080b0560 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50798/0 (socket says 172.21.15.49:50798) 2023-12-19T05:39:50.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 -- 172.21.15.49:0/2536086121 learned_addr learned my addr 172.21.15.49:0/2536086121 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 -- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02080b0560 msgr2=0x7f02080b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02080b0560 0x7f02080b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 -- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0208070050 msgr2=0x7f02080704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f0206ffd640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0208070050 0x7f02080704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0208070050 0x7f02080704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.997+0000 7f02077fe640 1 -- 172.21.15.49:0/2536086121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02081f6200 con 0x7f01f0005180 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f02077fe640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01f800e760 tx=0x7f01f800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800ee70 con 0x7f01f0005180 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800c870 con 0x7f01f0005180 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800cc20 con 0x7f01f0005180 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02081f64e0 con 0x7f01f0005180 2023-12-19T05:39:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.998+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02080af2a0 con 0x7f01f0005180 2023-12-19T05:39:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:50.999+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02081f6a00 con 0x7f01f0005180 2023-12-19T05:39:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.000+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f01f801d460 con 0x7f01f0005180 2023-12-19T05:39:51.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.001+0000 7f01effff640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 0x7f01f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.001+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01f8088940 con 0x7f01f0005180 2023-12-19T05:39:51.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.002+0000 7f0206ffd640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 0x7f01f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.003+0000 7f0206ffd640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 0x7f01f406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02080b21a0 tx=0x7f01fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.006+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02081f6a00 con 0x7f01f0005180 2023-12-19T05:39:51.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.204+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f02081f6a00 con 0x7f01f0005180 2023-12-19T05:39:51.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.212+0000 7f01effff640 1 -- 172.21.15.49:0/2536086121 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02081f6a00 con 0x7f01f0005180 2023-12-19T05:39:51.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 msgr2=0x7f01f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 0x7f01f406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02080b21a0 tx=0x7f01fc008040 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 msgr2=0x7f02080aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01f800e760 tx=0x7f01f800ec20 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 shutdown_connections 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01f406a430 0x7f01f406c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02080b0560 0x7f02080b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0208070050 0x7f02080704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 --2- 172.21.15.49:0/2536086121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0005180 0x7f02080aed60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 >> 172.21.15.49:0/2536086121 conn(0x7f020806ba40 msgr2=0x7f02080b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.215+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 shutdown_connections 2023-12-19T05:39:51.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.216+0000 7f020de7d640 1 -- 172.21.15.49:0/2536086121 wait complete. 2023-12-19T05:39:51.237 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:39:51.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:39:51.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:39:51.511 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:39:51.512 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:51.512 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:51.574 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:51.574 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:51.630 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:51.630 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:51.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.920+0000 7f3204f7e640 1 Processor -- start 2023-12-19T05:39:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.920+0000 7f3204f7e640 1 -- start start 2023-12-19T05:39:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f3204f7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f320015e5a0 0x7f32000b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f3204f7e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32000cdbf0 0x7f32000ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f3204f7e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320015ec30 con 0x7f320015f680 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f3204f7e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000ce560 con 0x7f32000cdbf0 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f3204f7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320015e980 con 0x7f320015e5a0 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f31fffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32000cdbf0 0x7f32000ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f31fffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32000cdbf0 0x7f32000ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50806/0 (socket says 172.21.15.49:50806) 2023-12-19T05:39:51.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.922+0000 7f31fffff640 1 -- 172.21.15.49:0/521688124 learned_addr learned my addr 172.21.15.49:0/521688124 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:51.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.923+0000 7f31ff7fe640 1 --2- 172.21.15.49:0/521688124 >> v2:172.21.15.115:3300/0 conn(0x7f320015e5a0 0x7f32000b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.923+0000 7f31fffff640 1 -- 172.21.15.49:0/521688124 >> v2:172.21.15.115:3300/0 conn(0x7f320015e5a0 msgr2=0x7f32000b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:51.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.923+0000 7f31fffff640 1 --2- 172.21.15.49:0/521688124 >> v2:172.21.15.115:3300/0 conn(0x7f320015e5a0 0x7f32000b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.923+0000 7f31fffff640 1 -- 172.21.15.49:0/521688124 >> v1:172.21.15.115:6789/0 conn(0x7f320015f680 legacy=0x7f32000b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.923+0000 7f31fffff640 1 -- 172.21.15.49:0/521688124 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000b2f90 con 0x7f32000cdbf0 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.924+0000 7f31fffff640 1 --2- 172.21.15.49:0/521688124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32000cdbf0 0x7f32000ce020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009e50 tx=0x7f31f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55e202917ae14ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f31fe7fc640 1 -- 172.21.15.49:0/521688124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f802ca80 con 0x7f32000cdbf0 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f31fe7fc640 1 -- 172.21.15.49:0/521688124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f802cbe0 con 0x7f32000cdbf0 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f31fe7fc640 1 -- 172.21.15.49:0/521688124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80343f0 con 0x7f32000cdbf0 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 -- 172.21.15.49:0/521688124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32000cdbf0 msgr2=0x7f32000ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 --2- 172.21.15.49:0/521688124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32000cdbf0 0x7f32000ce020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009e50 tx=0x7f31f802bee0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 -- 172.21.15.49:0/521688124 shutdown_connections 2023-12-19T05:39:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 --2- 172.21.15.49:0/521688124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32000cdbf0 0x7f32000ce020 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 --2- 172.21.15.49:0/521688124 >> v2:172.21.15.115:3300/0 conn(0x7f320015e5a0 0x7f32000b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 -- 172.21.15.49:0/521688124 >> 172.21.15.49:0/521688124 conn(0x7f32000b0100 msgr2=0x7f32000b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.925+0000 7f3204f7e640 1 -- 172.21.15.49:0/521688124 shutdown_connections 2023-12-19T05:39:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.926+0000 7f3204f7e640 1 -- 172.21.15.49:0/521688124 wait complete. 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.927+0000 7f3204f7e640 1 Processor -- start 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.927+0000 7f3204f7e640 1 -- start start 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32000cdbf0 0x7f3200147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f320015f680 0x7f3200155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32001f6c10 con 0x7f320015e5a0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32001f5fd0 con 0x7f32000cdbf0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.928+0000 7f3204f7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32001f6270 con 0x7f320015f680 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50812/0 (socket says 172.21.15.49:50812) 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 -- 172.21.15.49:0/997053532 learned_addr learned my addr 172.21.15.49:0/997053532 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31ff7fe640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32000cdbf0 0x7f3200147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 -- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f320015f680 msgr2=0x7f3200155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f320015f680 0x7f3200155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 -- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32000cdbf0 msgr2=0x7f3200147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32000cdbf0 0x7f3200147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 -- 172.21.15.49:0/997053532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8009b30 con 0x7f320015e5a0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.929+0000 7f31feffd640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c430 tx=0x7f31f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.930+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011790 con 0x7f320015e5a0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.930+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f40118f0 con 0x7f320015e5a0 2023-12-19T05:39:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.930+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011ca0 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.930+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32001f6550 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.930+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32001f2930 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.931+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32001f2af0 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.932+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31f401c460 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.933+0000 7f31e7fff640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 0x7f31ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.933+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f31f40888d0 con 0x7f320015e5a0 2023-12-19T05:39:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.934+0000 7f31ff7fe640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 0x7f31ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:51.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.935+0000 7f31ff7fe640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 0x7f31ec06c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31f0006fd0 tx=0x7f31f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:51.937+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f32001f2af0 con 0x7f320015e5a0 2023-12-19T05:39:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.130+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32001f6d50 con 0x7f320015e5a0 2023-12-19T05:39:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.134+0000 7f31e7fff640 1 -- 172.21.15.49:0/997053532 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f32001f6d50 con 0x7f320015e5a0 2023-12-19T05:39:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:52.135 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:51.459263+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 msgr2=0x7f31ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 0x7f31ec06c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31f0006fd0 tx=0x7f31f0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 msgr2=0x7f32001551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c430 tx=0x7f31f400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 shutdown_connections 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31ec06a430 0x7f31ec06c8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f320015f680 0x7f3200155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f320015e5a0 0x7f32001551c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 --2- 172.21.15.49:0/997053532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32000cdbf0 0x7f3200147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.136+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 >> 172.21.15.49:0/997053532 conn(0x7f32000b0100 msgr2=0x7f320006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.137+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 shutdown_connections 2023-12-19T05:39:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.137+0000 7f3204f7e640 1 -- 172.21.15.49:0/997053532 wait complete. 2023-12-19T05:39:52.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:52.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.391+0000 7fd224a42640 1 Processor -- start 2023-12-19T05:39:52.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.391+0000 7fd224a42640 1 -- start start 2023-12-19T05:39:52.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd224a42640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2200d0c30 0x7fd2200b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd224a42640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2200cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd224a42640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22015c260 con 0x7fd2200b2a50 2023-12-19T05:39:52.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd224a42640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22015fb20 con 0x7fd2200d0c30 2023-12-19T05:39:52.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd224a42640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b2ee0 con 0x7fd22015f6b0 2023-12-19T05:39:52.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd21dd9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2200b2a50 0x7fd22015efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58632/0 (socket says 172.21.15.49:58632) 2023-12-19T05:39:52.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd21dd9b640 1 -- 172.21.15.49:0/2058027559 learned_addr learned my addr 172.21.15.49:0/2058027559 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:52.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.393+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2058027559 >> v2:172.21.15.49:3300/0 conn(0x7fd2200d0c30 0x7fd2200b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178374084 0 0) 0x7fd22015c260 con 0x7fd2200b2a50 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21ed9d640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2200cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd208003520 con 0x7fd2200b2a50 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448340796 0 0) 0x7fd208003520 con 0x7fd2200b2a50 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21e59c640 1 -- 172.21.15.49:0/2058027559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 msgr2=0x7fd2200cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2200cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21e59c640 1 -- 172.21.15.49:0/2058027559 >> v1:172.21.15.49:6789/0 conn(0x7fd2200b2a50 legacy=0x7fd22015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.394+0000 7fd21e59c640 1 -- 172.21.15.49:0/2058027559 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22015b9a0 con 0x7fd2200d0c30 2023-12-19T05:39:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.395+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd2200b2510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd210009d90 tx=0x7fd21002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568de71622466dbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.395+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214001670 con 0x7fd2200d0c30 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21002c8a0 con 0x7fd2200d0c30 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd21d59a640 1 -- 172.21.15.49:0/2058027559 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21002cc30 con 0x7fd2200d0c30 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 -- 172.21.15.49:0/2058027559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 msgr2=0x7fd2200b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd2200b2510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd210009d90 tx=0x7fd21002bd70 comp rx=0 tx=0).stop 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 -- 172.21.15.49:0/2058027559 shutdown_connections 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2200cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 --2- 172.21.15.49:0/2058027559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd2200b2510 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 -- 172.21.15.49:0/2058027559 >> 172.21.15.49:0/2058027559 conn(0x7fd22006ba40 msgr2=0x7fd22006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 -- 172.21.15.49:0/2058027559 shutdown_connections 2023-12-19T05:39:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.396+0000 7fd224a42640 1 -- 172.21.15.49:0/2058027559 wait complete. 2023-12-19T05:39:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.398+0000 7fd224a42640 1 Processor -- start 2023-12-19T05:39:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.398+0000 7fd224a42640 1 -- start start 2023-12-19T05:39:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200b2a50 0x7fd2200ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2201f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2201f5ea0 con 0x7fd2200d0c30 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200acdf0 con 0x7fd2200b2a50 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.399+0000 7fd224a42640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200ad240 con 0x7fd22015f6b0 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50818/0 (socket says 172.21.15.49:50818) 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 -- 172.21.15.49:0/2278492240 learned_addr learned my addr 172.21.15.49:0/2278492240 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200b2a50 0x7fd2200ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21ed9d640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2201f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 -- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 msgr2=0x7fd2201f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2201f6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 -- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200b2a50 msgr2=0x7fd2200ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200b2a50 0x7fd2200ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.400+0000 7fd21dd9b640 1 -- 172.21.15.49:0/2278492240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009a70 con 0x7fd2200d0c30 2023-12-19T05:39:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd21dd9b640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c710 tx=0x7fd21400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214005ad0 con 0x7fd2200d0c30 2023-12-19T05:39:52.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214005c30 con 0x7fd2200d0c30 2023-12-19T05:39:52.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214007070 con 0x7fd2200d0c30 2023-12-19T05:39:52.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200ad520 con 0x7fd2200d0c30 2023-12-19T05:39:52.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.401+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2201f60f0 con 0x7fd2200d0c30 2023-12-19T05:39:52.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.402+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2201f6310 con 0x7fd2200d0c30 2023-12-19T05:39:52.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.403+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2140071f0 con 0x7fd2200d0c30 2023-12-19T05:39:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.404+0000 7fd20effd640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 0x7fd20006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.404+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd2140886f0 con 0x7fd2200d0c30 2023-12-19T05:39:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.405+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 0x7fd20006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.406+0000 7fd21e59c640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 0x7fd20006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd210036000 tx=0x7fd210030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.411+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd214053e00 con 0x7fd2200d0c30 2023-12-19T05:39:52.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.619+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd220061910 con 0x7fd2200d0c30 2023-12-19T05:39:52.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.620+0000 7fd20effd640 1 -- 172.21.15.49:0/2278492240 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd214057420 con 0x7fd2200d0c30 2023-12-19T05:39:52.621 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 msgr2=0x7fd20006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 0x7fd20006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd210036000 tx=0x7fd210030000 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 msgr2=0x7fd22015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c710 tx=0x7fd21400cbd0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 shutdown_connections 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd20006a430 0x7fd20006c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22015f6b0 0x7fd2201f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200d0c30 0x7fd22015a230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 --2- 172.21.15.49:0/2278492240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200b2a50 0x7fd2200ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 >> 172.21.15.49:0/2278492240 conn(0x7fd22006ba40 msgr2=0x7fd2200b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.623+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 shutdown_connections 2023-12-19T05:39:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.624+0000 7fd224a42640 1 -- 172.21.15.49:0/2278492240 wait complete. 2023-12-19T05:39:52.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:52.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.870+0000 7fd6330b6640 1 Processor -- start 2023-12-19T05:39:52.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.870+0000 7fd6330b6640 1 -- start start 2023-12-19T05:39:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd6330b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd62c146e10 0x7fd62c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd6330b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0ce110 0x7fd62c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd6330b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0cd840 con 0x7fd62c0d2b00 2023-12-19T05:39:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd6330b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0d2430 con 0x7fd62c146e10 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd6330b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0ceac0 con 0x7fd62c0ce110 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd630e52640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd62c146e10 0x7fd62c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd630e52640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd62c146e10 0x7fd62c0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50832/0 (socket says 172.21.15.49:50832) 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.872+0000 7fd630e52640 1 -- 172.21.15.49:0/3254166872 learned_addr learned my addr 172.21.15.49:0/3254166872 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.873+0000 7fd631653640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0ce110 0x7fd62c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.873+0000 7fd630e52640 1 -- 172.21.15.49:0/3254166872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0ce110 msgr2=0x7fd62c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.873+0000 7fd630e52640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0ce110 0x7fd62c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.873+0000 7fd630e52640 1 -- 172.21.15.49:0/3254166872 >> v1:172.21.15.115:6789/0 conn(0x7fd62c0d2b00 legacy=0x7fd62c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.873+0000 7fd630e52640 1 -- 172.21.15.49:0/3254166872 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0b6e90 con 0x7fd62c146e10 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.874+0000 7fd630e52640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c146e10 0x7fd62c0d1ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009e80 tx=0x7fd61c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b5fa5899b966e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.874+0000 7fd62b7fe640 1 -- 172.21.15.49:0/3254166872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c02ca50 con 0x7fd62c146e10 2023-12-19T05:39:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.874+0000 7fd62b7fe640 1 -- 172.21.15.49:0/3254166872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c02cbb0 con 0x7fd62c146e10 2023-12-19T05:39:52.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.874+0000 7fd62b7fe640 1 -- 172.21.15.49:0/3254166872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0343f0 con 0x7fd62c146e10 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 -- 172.21.15.49:0/3254166872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c146e10 msgr2=0x7fd62c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c146e10 0x7fd62c0d1ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009e80 tx=0x7fd61c02beb0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 -- 172.21.15.49:0/3254166872 shutdown_connections 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0ce110 0x7fd62c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 --2- 172.21.15.49:0/3254166872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c146e10 0x7fd62c0d1ef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 -- 172.21.15.49:0/3254166872 >> 172.21.15.49:0/3254166872 conn(0x7fd62c0b29c0 msgr2=0x7fd62c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.875+0000 7fd6330b6640 1 -- 172.21.15.49:0/3254166872 shutdown_connections 2023-12-19T05:39:52.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.876+0000 7fd6330b6640 1 -- 172.21.15.49:0/3254166872 wait complete. 2023-12-19T05:39:52.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.877+0000 7fd6330b6640 1 Processor -- start 2023-12-19T05:39:52.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.877+0000 7fd6330b6640 1 -- start start 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0d2b00 0x7fd62c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c146e10 0x7fd62c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0cc990 con 0x7fd62c0ce110 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0cbd80 con 0x7fd62c146e10 2023-12-19T05:39:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.878+0000 7fd6330b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0cc060 con 0x7fd62c0d2b00 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50848/0 (socket says 172.21.15.49:50848) 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 -- 172.21.15.49:0/1879774852 learned_addr learned my addr 172.21.15.49:0/1879774852 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 -- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0d2b00 msgr2=0x7fd62c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0d2b00 0x7fd62c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 -- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c146e10 msgr2=0x7fd62c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c146e10 0x7fd62c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 -- 172.21.15.49:0/1879774852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c009b30 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.879+0000 7fd630e52640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd61c036040 tx=0x7fd61c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.880+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c009510 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.880+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c03e450 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.880+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c03e800 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.880+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0cc340 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.880+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0cba20 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.881+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c061910 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.882+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd61c03e960 con 0x7fd62c0ce110 2023-12-19T05:39:52.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.884+0000 7fd6297fa640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 0x7fd61806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:52.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.884+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd61c0ab640 con 0x7fd62c0ce110 2023-12-19T05:39:52.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.884+0000 7fd62bfff640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 0x7fd61806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:52.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.885+0000 7fd62bfff640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 0x7fd61806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd62c071150 tx=0x7fd6200079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:52.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:52.888+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd61c076ca0 con 0x7fd62c0ce110 2023-12-19T05:39:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.079+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd62c0b4a50 con 0x7fd62c0ce110 2023-12-19T05:39:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.081+0000 7fd6297fa640 1 -- 172.21.15.49:0/1879774852 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd61c07a2c0 con 0x7fd62c0ce110 2023-12-19T05:39:53.082 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 msgr2=0x7fd61806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 0x7fd61806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd62c071150 tx=0x7fd6200079d0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 msgr2=0x7fd62c15c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd61c036040 tx=0x7fd61c004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 shutdown_connections 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd61806a430 0x7fd61806c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c0d2b00 0x7fd62c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c146e10 0x7fd62c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 --2- 172.21.15.49:0/1879774852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c0ce110 0x7fd62c15c190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.083+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 >> 172.21.15.49:0/1879774852 conn(0x7fd62c0b29c0 msgr2=0x7fd62c161010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.084+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 shutdown_connections 2023-12-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.084+0000 7fd6330b6640 1 -- 172.21.15.49:0/1879774852 wait complete. 2023-12-19T05:39:53.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:53.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.339+0000 7fea8e9a2640 1 Processor -- start 2023-12-19T05:39:53.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.339+0000 7fea8e9a2640 1 -- start start 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 0x7fea880b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea880b6890 0x7fea8806f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 0x7fea88160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea881470b0 con 0x7fea880b6890 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8806fe60 con 0x7fea88146cd0 2023-12-19T05:39:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8e9a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88070260 con 0x7fea8806f9d0 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8d19f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea880b6890 0x7fea8806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8d19f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea880b6890 0x7fea8806f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50854/0 (socket says 172.21.15.49:50854) 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.341+0000 7fea8d19f640 1 -- 172.21.15.49:0/750517871 learned_addr learned my addr 172.21.15.49:0/750517871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8e1a1640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 0x7fea88160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d19f640 1 -- 172.21.15.49:0/750517871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 msgr2=0x7fea88160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d9a0640 1 --2- 172.21.15.49:0/750517871 >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 0x7fea880b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d19f640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 0x7fea88160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d19f640 1 -- 172.21.15.49:0/750517871 >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 msgr2=0x7fea880b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d19f640 1 --2- 172.21.15.49:0/750517871 >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 0x7fea880b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d19f640 1 -- 172.21.15.49:0/750517871 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880b6ea0 con 0x7fea880b6890 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8e1a1640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 0x7fea88160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.342+0000 7fea8d9a0640 1 --2- 172.21.15.49:0/750517871 >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 0x7fea880b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:53.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.343+0000 7fea8d19f640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea880b6890 0x7fea8806f490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea8806f0b0 tx=0x7fea7c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8b1085dfa8191c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.343+0000 7fea8c99e640 1 -- 172.21.15.49:0/750517871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0317d0 con 0x7fea880b6890 2023-12-19T05:39:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.343+0000 7fea8c99e640 1 -- 172.21.15.49:0/750517871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c031930 con 0x7fea880b6890 2023-12-19T05:39:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.343+0000 7fea8c99e640 1 -- 172.21.15.49:0/750517871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c031cc0 con 0x7fea880b6890 2023-12-19T05:39:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 -- 172.21.15.49:0/750517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea880b6890 msgr2=0x7fea8806f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea880b6890 0x7fea8806f490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea8806f0b0 tx=0x7fea7c02b870 comp rx=0 tx=0).stop 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 -- 172.21.15.49:0/750517871 shutdown_connections 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea8806f9d0 0x7fea88160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/750517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea880b6890 0x7fea8806f490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/750517871 >> v2:172.21.15.115:3300/0 conn(0x7fea88146cd0 0x7fea880b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 -- 172.21.15.49:0/750517871 >> 172.21.15.49:0/750517871 conn(0x7fea880d3200 msgr2=0x7fea880d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 -- 172.21.15.49:0/750517871 shutdown_connections 2023-12-19T05:39:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.344+0000 7fea8e9a2640 1 -- 172.21.15.49:0/750517871 wait complete. 2023-12-19T05:39:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.346+0000 7fea8e9a2640 1 Processor -- start 2023-12-19T05:39:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.346+0000 7fea8e9a2640 1 -- start start 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 0x7fea8814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea88146cd0 0x7fea881e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea881e4ed0 con 0x7fea8806f9d0 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8813d3e0 con 0x7fea880b6890 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8e9a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8813c760 con 0x7fea88146cd0 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8d9a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8d9a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50864/0 (socket says 172.21.15.49:50864) 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.347+0000 7fea8d9a0640 1 -- 172.21.15.49:0/4143864959 learned_addr learned my addr 172.21.15.49:0/4143864959 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d19f640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 0x7fea8814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 -- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea88146cd0 msgr2=0x7fea881e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8e1a1640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea88146cd0 0x7fea881e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea88146cd0 0x7fea881e43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 -- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 msgr2=0x7fea8814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 0x7fea8814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 -- 172.21.15.49:0/4143864959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0094d0 con 0x7fea8806f9d0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d19f640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 0x7fea8814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.348+0000 7fea8d9a0640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c7f0 tx=0x7fea8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.349+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84007820 con 0x7fea8806f9d0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.349+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea84007980 con 0x7fea8806f9d0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.349+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84007cf0 con 0x7fea8806f9d0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.349+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8813ca40 con 0x7fea8806f9d0 2023-12-19T05:39:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.349+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8813d000 con 0x7fea8806f9d0 2023-12-19T05:39:53.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.350+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88061910 con 0x7fea8806f9d0 2023-12-19T05:39:53.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.351+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea840113f0 con 0x7fea8806f9d0 2023-12-19T05:39:53.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.352+0000 7fea7a7fc640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.352+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fea84088d00 con 0x7fea8806f9d0 2023-12-19T05:39:53.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.353+0000 7fea8d19f640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.354+0000 7fea8d19f640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea7c036000 tx=0x7fea7c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.356+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea84054230 con 0x7fea8806f9d0 2023-12-19T05:39:53.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.556+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea880d2500 con 0x7fea8806f9d0 2023-12-19T05:39:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.556+0000 7fea7a7fc640 1 -- 172.21.15.49:0/4143864959 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea8401f0a0 con 0x7fea8806f9d0 2023-12-19T05:39:53.558 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 msgr2=0x7fea6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea7c036000 tx=0x7fea7c03d040 comp rx=0 tx=0).stop 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 msgr2=0x7fea8815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c7f0 tx=0x7fea8400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 shutdown_connections 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea88146cd0 0x7fea881e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea880b6890 0x7fea8814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 --2- 172.21.15.49:0/4143864959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806f9d0 0x7fea8815c7f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 >> 172.21.15.49:0/4143864959 conn(0x7fea880d3200 msgr2=0x7fea880d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 shutdown_connections 2023-12-19T05:39:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.560+0000 7fea8e9a2640 1 -- 172.21.15.49:0/4143864959 wait complete. 2023-12-19T05:39:53.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:39:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.806+0000 7f5b42a73640 1 Processor -- start 2023-12-19T05:39:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.807+0000 7f5b42a73640 1 -- start start 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.808+0000 7f5b42a73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.808+0000 7f5b42a73640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b3c0b6130 0x7f5b3c161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.808+0000 7f5b42a73640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c140740 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.808+0000 7f5b42a73640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c143990 con 0x7f5b3c0b6130 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.808+0000 7f5b42a73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0b8610 con 0x7f5b3c140360 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b3c0b6130 0x7f5b3c161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b3c0b6130 0x7f5b3c161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50878/0 (socket says 172.21.15.49:50878) 2023-12-19T05:39:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 -- 172.21.15.49:0/4240790443 learned_addr learned my addr 172.21.15.49:0/4240790443 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b41270640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5b3c0b5cd0 0x7f5b3c160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58648/0 (socket says 172.21.15.49:58648) 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b41a71640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 -- 172.21.15.49:0/4240790443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 msgr2=0x7f5b3c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 -- 172.21.15.49:0/4240790443 >> v1:172.21.15.49:6789/0 conn(0x7f5b3c0b5cd0 legacy=0x7f5b3c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b42272640 1 -- 172.21.15.49:0/4240790443 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c142e10 con 0x7f5b3c0b6130 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b41a71640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.809+0000 7f5b40a6f640 1 -- 172.21.15.49:0/4240790443 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156442964 0 0) 0x7f5b3c140740 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.811+0000 7f5b42272640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c161640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d6ca2df78d4c9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.811+0000 7f5b40a6f640 1 -- 172.21.15.49:0/4240790443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34031640 con 0x7f5b3c0b6130 2023-12-19T05:39:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.811+0000 7f5b40a6f640 1 -- 172.21.15.49:0/4240790443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b340317a0 con 0x7f5b3c0b6130 2023-12-19T05:39:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.811+0000 7f5b40a6f640 1 -- 172.21.15.49:0/4240790443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34031b30 con 0x7f5b3c0b6130 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 -- 172.21.15.49:0/4240790443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b6130 msgr2=0x7f5b3c161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c161640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 -- 172.21.15.49:0/4240790443 shutdown_connections 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c161640 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 --2- 172.21.15.49:0/4240790443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 -- 172.21.15.49:0/4240790443 >> 172.21.15.49:0/4240790443 conn(0x7f5b3c065dc0 msgr2=0x7f5b3c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 -- 172.21.15.49:0/4240790443 shutdown_connections 2023-12-19T05:39:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.812+0000 7f5b42a73640 1 -- 172.21.15.49:0/4240790443 wait complete. 2023-12-19T05:39:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.814+0000 7f5b42a73640 1 Processor -- start 2023-12-19T05:39:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.814+0000 7f5b42a73640 1 -- start start 2023-12-19T05:39:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c161370 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c153af0 con 0x7f5b3c0b6130 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b42a73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1606f0 con 0x7f5b3c140360 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50894/0 (socket says 172.21.15.49:50894) 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 -- 172.21.15.49:0/47698626 learned_addr learned my addr 172.21.15.49:0/47698626 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 -- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 msgr2=0x7f5b3c0d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 -- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b3c0b6130 msgr2=0x7f5b3c0d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.816+0000 7f5b41a71640 1 -- 172.21.15.49:0/47698626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340094d0 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b41a71640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009fc0 tx=0x7f5b3000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30003b90 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000f040 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30004030 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c1609d0 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.817+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c160f90 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.818+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c061910 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.819+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b30004190 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.820+0000 7f5b3a7fc640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 0x7f5b2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.820+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5b30088bd0 con 0x7f5b3c0b5cd0 2023-12-19T05:39:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.821+0000 7f5b41270640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 0x7f5b2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:53.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.822+0000 7f5b41270640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 0x7f5b2006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b28007fd0 tx=0x7f5b28007960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:53.824+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b300542e0 con 0x7f5b3c0b5cd0 2023-12-19T05:39:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.031+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b3c0b3bd0 con 0x7f5b3c0b5cd0 2023-12-19T05:39:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.032+0000 7f5b3a7fc640 1 -- 172.21.15.49:0/47698626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b3001a080 con 0x7f5b3c0b5cd0 2023-12-19T05:39:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:39:54.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 msgr2=0x7f5b2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 0x7f5b2006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b28007fd0 tx=0x7f5b28007960 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 msgr2=0x7f5b3c1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009fc0 tx=0x7f5b3000d560 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 shutdown_connections 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5b2006a430 0x7f5b2006c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b3c140360 0x7f5b3c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b3c0b6130 0x7f5b3c0d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 --2- 172.21.15.49:0/47698626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0b5cd0 0x7f5b3c1535b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 >> 172.21.15.49:0/47698626 conn(0x7f5b3c065dc0 msgr2=0x7f5b3c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 shutdown_connections 2023-12-19T05:39:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.035+0000 7f5b42a73640 1 -- 172.21.15.49:0/47698626 wait complete. 2023-12-19T05:39:54.056 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:39:54.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:54.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T05:39:54.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:39:54.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:54.156 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:39:54.217 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:54.217 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:54.275 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:54.275 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:54.325 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:54.325 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:54.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.666+0000 7f43ae567640 1 Processor -- start 2023-12-19T05:39:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.666+0000 7f43ae567640 1 -- start start 2023-12-19T05:39:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43ae567640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43a80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43ae567640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a815ec30 con 0x7f43a815f680 2023-12-19T05:39:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43ae567640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a815e980 con 0x7f43a80cdbf0 2023-12-19T05:39:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43ae567640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b2f90 con 0x7f43a815e5a0 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43acd64640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f43a815f680 0x7f43a80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55162/0 (socket says 172.21.15.49:55162) 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.668+0000 7f43acd64640 1 -- 172.21.15.49:0/3621946363 learned_addr learned my addr 172.21.15.49:0/3621946363 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f43ad565640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43a80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243275408 0 0) 0x7f43a815ec30 con 0x7f43a815f680 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4394003520 con 0x7f43a815f680 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1902387938 0 0) 0x7f4394003520 con 0x7f43a815f680 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 msgr2=0x7f43a80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43a80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 >> v1:172.21.15.115:6789/0 conn(0x7f43a80cdbf0 legacy=0x7f43a806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80b3270 con 0x7f43a815f680 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f4398001670 con 0x7f43a815f680 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 >> v1:172.21.15.49:6789/0 conn(0x7f43a815f680 legacy=0x7f43a80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394003f20 0x7f43940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4394004d00 0x7f4394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b2f90 con 0x7f4394004d00 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439400ba60 con 0x7f4394003f20 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.669+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439400bc20 con 0x7f43a815e5a0 2023-12-19T05:39:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4394004d00 0x7f4394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43acd64640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394003f20 0x7f43940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43ad565640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 -- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 msgr2=0x7f43940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a815e5a0 0x7f43940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 -- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394003f20 msgr2=0x7f43940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394003f20 0x7f43940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.670+0000 7f43add66640 1 -- 172.21.15.49:0/3621946363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394003520 con 0x7f4394004d00 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.671+0000 7f43add66640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4394004d00 0x7f4394005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43a0001e50 tx=0x7f43940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f9725977a14c0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0003b70 con 0x7f4394004d00 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0003cd0 con 0x7f4394004d00 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f439ffff640 1 -- 172.21.15.49:0/3621946363 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0005310 con 0x7f4394004d00 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 -- 172.21.15.49:0/3621946363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4394004d00 msgr2=0x7f4394005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 --2- 172.21.15.49:0/3621946363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4394004d00 0x7f4394005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43a0001e50 tx=0x7f43940057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43add66640 1 -- 172.21.15.49:0/3621946363 reap_dead start 2023-12-19T05:39:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 -- 172.21.15.49:0/3621946363 shutdown_connections 2023-12-19T05:39:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 -- 172.21.15.49:0/3621946363 >> 172.21.15.49:0/3621946363 conn(0x7f43a80b0100 msgr2=0x7f43a80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 -- 172.21.15.49:0/3621946363 shutdown_connections 2023-12-19T05:39:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.672+0000 7f43ae567640 1 -- 172.21.15.49:0/3621946363 wait complete. 2023-12-19T05:39:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.674+0000 7f43ae567640 1 Processor -- start 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.674+0000 7f43ae567640 1 -- start start 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394004d00 0x7f43a81f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a80cd130 0x7f43a80cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8145240 con 0x7f43a8144dc0 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8147e40 con 0x7f4394004d00 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.675+0000 7f43ae567640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8148120 con 0x7f43a80cd130 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36856/0 (socket says 172.21.15.49:36856) 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 -- 172.21.15.49:0/164353657 learned_addr learned my addr 172.21.15.49:0/164353657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43ad565640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394004d00 0x7f43a81f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43add66640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a80cd130 0x7f43a80cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 -- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a80cd130 msgr2=0x7f43a80cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a80cd130 0x7f43a80cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 -- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394004d00 msgr2=0x7f43a81f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394004d00 0x7f43a81f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 -- 172.21.15.49:0/164353657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8148400 con 0x7f43a8144dc0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.676+0000 7f43acd64640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f439800e7f0 tx=0x7f439800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.677+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800c8d0 con 0x7f43a8144dc0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.677+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439800ca30 con 0x7f43a8144dc0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.677+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800cdc0 con 0x7f43a8144dc0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.677+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a80ccc10 con 0x7f43a8144dc0 2023-12-19T05:39:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.677+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a80cc870 con 0x7f43a8144dc0 2023-12-19T05:39:54.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.678+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a8061910 con 0x7f43a8144dc0 2023-12-19T05:39:54.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.679+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f439801d460 con 0x7f43a8144dc0 2023-12-19T05:39:54.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.680+0000 7f439dffb640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 0x7f438c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:54.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.680+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f43980889f0 con 0x7f43a8144dc0 2023-12-19T05:39:54.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.681+0000 7f43ad565640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 0x7f438c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:54.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.682+0000 7f43ad565640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 0x7f438c06c920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43a81e7920 tx=0x7f43a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:54.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.684+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4398053f20 con 0x7f43a8144dc0 2023-12-19T05:39:54.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.880+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a80b2980 con 0x7f43a8144dc0 2023-12-19T05:39:54.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.881+0000 7f439dffb640 1 -- 172.21.15.49:0/164353657 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f4398057540 con 0x7f43a8144dc0 2023-12-19T05:39:54.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:54.884 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.884+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 msgr2=0x7f438c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.884+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 0x7f438c06c920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43a81e7920 tx=0x7f43a4008040 comp rx=0 tx=0).stop 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.884+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 msgr2=0x7f43a81475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.884+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f439800e7f0 tx=0x7f439800ecb0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 shutdown_connections 2023-12-19T05:39:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f438c06a460 0x7f438c06c920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43a80cd130 0x7f43a80cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43a8144dc0 0x7f43a81475a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 --2- 172.21.15.49:0/164353657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4394004d00 0x7f43a81f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 >> 172.21.15.49:0/164353657 conn(0x7f43a80b0100 msgr2=0x7f43a80b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 shutdown_connections 2023-12-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:54.885+0000 7f43ae567640 1 -- 172.21.15.49:0/164353657 wait complete. 2023-12-19T05:39:54.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:54.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.137+0000 7f8bf359e640 1 Processor -- start 2023-12-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.137+0000 7f8bf359e640 1 -- start start 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bf40cd4e0 0x7f8bf415e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf415a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf359e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf415dae0 con 0x7f8bf40afd60 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf415b000 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf415b2e0 con 0x7f8bf415a4f0 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bf40cd4e0 0x7f8bf415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf2d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8bf40afd60 0x7f8bf40b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55174/0 (socket says 172.21.15.49:55174) 2023-12-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bf2d9d640 1 -- 172.21.15.49:0/458649821 learned_addr learned my addr 172.21.15.49:0/458649821 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.139+0000 7f8bebfff640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.140+0000 7f8bf259c640 1 -- 172.21.15.49:0/458649821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 msgr2=0x7f8bf415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.140+0000 7f8bf259c640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.140+0000 7f8bf259c640 1 -- 172.21.15.49:0/458649821 >> v1:172.21.15.49:6789/0 conn(0x7f8bf40afd60 legacy=0x7f8bf40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.140+0000 7f8bf259c640 1 -- 172.21.15.49:0/458649821 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf415dd80 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.140+0000 7f8bf1d9b640 1 -- 172.21.15.49:0/458649821 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292156756 0 0) 0x7f8bf415dae0 con 0x7f8bf40afd60 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.141+0000 7f8bf259c640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf415e580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8be40097a0 tx=0x7f8be402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef0d9d6311a2a15 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.141+0000 7f8bf1d9b640 1 -- 172.21.15.49:0/458649821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be402d040 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.141+0000 7f8bf1d9b640 1 -- 172.21.15.49:0/458649821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4031810 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.141+0000 7f8bf1d9b640 1 -- 172.21.15.49:0/458649821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4031ba0 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 -- 172.21.15.49:0/458649821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40cd4e0 msgr2=0x7f8bf415e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf415e580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8be40097a0 tx=0x7f8be402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 -- 172.21.15.49:0/458649821 shutdown_connections 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 --2- 172.21.15.49:0/458649821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf415e580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 -- 172.21.15.49:0/458649821 >> 172.21.15.49:0/458649821 conn(0x7f8bf406f630 msgr2=0x7f8bf406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 -- 172.21.15.49:0/458649821 shutdown_connections 2023-12-19T05:39:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.142+0000 7f8bf359e640 1 -- 172.21.15.49:0/458649821 wait complete. 2023-12-19T05:39:55.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.144+0000 7f8bf359e640 1 Processor -- start 2023-12-19T05:39:55.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.144+0000 7f8bf359e640 1 -- start start 2023-12-19T05:39:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf41f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf41f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41f3b50 con 0x7f8bf40afd60 2023-12-19T05:39:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf40abd10 con 0x7f8bf40cd4e0 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41f5f50 con 0x7f8bf415a4f0 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36866/0 (socket says 172.21.15.49:36866) 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.145+0000 7f8bf259c640 1 -- 172.21.15.49:0/33917350 learned_addr learned my addr 172.21.15.49:0/33917350 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf2d9d640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf41f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bebfff640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf41f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 -- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 msgr2=0x7f8bf41f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf41f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 -- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bf40cd4e0 msgr2=0x7f8bf41f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf41f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 -- 172.21.15.49:0/33917350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009400 con 0x7f8bf40afd60 2023-12-19T05:39:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.146+0000 7f8bf259c640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8be402bec0 tx=0x7f8be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.147+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be403ad60 con 0x7f8bf40afd60 2023-12-19T05:39:55.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.147+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be40423f0 con 0x7f8bf40afd60 2023-12-19T05:39:55.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.147+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40427a0 con 0x7f8bf40afd60 2023-12-19T05:39:55.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.147+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf41f3590 con 0x7f8bf40afd60 2023-12-19T05:39:55.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.147+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf40abf90 con 0x7f8bf40afd60 2023-12-19T05:39:55.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.148+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf4061910 con 0x7f8bf40afd60 2023-12-19T05:39:55.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.149+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8be4042900 con 0x7f8bf40afd60 2023-12-19T05:39:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.150+0000 7f8beaffd640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.150+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8be40aa8e0 con 0x7f8bf40afd60 2023-12-19T05:39:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.151+0000 7f8bebfff640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.152+0000 7f8bebfff640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 0x7f8bd406c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.154+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8be4075eb0 con 0x7f8bf40afd60 2023-12-19T05:39:55.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.356+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bf406e330 con 0x7f8bf40afd60 2023-12-19T05:39:55.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.357+0000 7f8beaffd640 1 -- 172.21.15.49:0/33917350 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8be40350a0 con 0x7f8bf40afd60 2023-12-19T05:39:55.359 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:55.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 msgr2=0x7f8bd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 0x7f8bd406c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc008040 comp rx=0 tx=0).stop 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 msgr2=0x7f8bf41f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8be402bec0 tx=0x7f8be40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 shutdown_connections 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8bf415a4f0 0x7f8bf41f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bf40cd4e0 0x7f8bf41f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 --2- 172.21.15.49:0/33917350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf40afd60 0x7f8bf41f5a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 >> 172.21.15.49:0/33917350 conn(0x7f8bf406f630 msgr2=0x7f8bf4154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 shutdown_connections 2023-12-19T05:39:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.360+0000 7f8bf359e640 1 -- 172.21.15.49:0/33917350 wait complete. 2023-12-19T05:39:55.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:55.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:55.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:55.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.588+0000 7f24fe7ce640 1 Processor -- start 2023-12-19T05:39:55.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.588+0000 7f24fe7ce640 1 -- start start 2023-12-19T05:39:55.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fe7ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fe7ce640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f80cd840 con 0x7f24f80ce110 2023-12-19T05:39:55.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fe7ce640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f80b6e90 con 0x7f24f80d2b00 2023-12-19T05:39:55.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fe7ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80d2430 con 0x7f24f8146e10 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fcd6b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24f80ce110 0x7f24f80b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55184/0 (socket says 172.21.15.49:55184) 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24fcd6b640 1 -- 172.21.15.49:0/171723092 learned_addr learned my addr 172.21.15.49:0/171723092 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.590+0000 7f24f7fff640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510981873 0 0) 0x7f24f80cd840 con 0x7f24f80ce110 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e4003520 con 0x7f24f80ce110 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294429481 0 0) 0x7f24f80b6e90 con 0x7f24f80d2b00 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f80cd840 con 0x7f24f80d2b00 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2917244450 0 0) 0x7f24e4003520 con 0x7f24f80ce110 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 msgr2=0x7f24f80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24f80d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 >> v1:172.21.15.115:6789/0 conn(0x7f24f80d2b00 legacy=0x7f24f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f80d2620 con 0x7f24f80ce110 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f24f00019f0 con 0x7f24f80ce110 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 >> v1:172.21.15.49:6789/0 conn(0x7f24f80ce110 legacy=0x7f24f80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24e4003ba0 0x7f24e4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24e4004d00 0x7f24e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e400ba80 con 0x7f24e4004d00 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e400bbf0 con 0x7f24e4003ba0 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.591+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e400bdb0 con 0x7f24f8146e10 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24e4004d00 0x7f24e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24f7fff640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24e4003ba0 0x7f24e4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24effff640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 -- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 msgr2=0x7f24e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f8146e10 0x7f24e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 -- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24e4003ba0 msgr2=0x7f24e4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24e4003ba0 0x7f24e4003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.592+0000 7f24fcd6b640 1 -- 172.21.15.49:0/171723092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4003520 con 0x7f24e4004d00 2023-12-19T05:39:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.594+0000 7f24fcd6b640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24e4004d00 0x7f24e4005180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24f000a710 tx=0x7f24e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e888cc7b3836ac9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.594+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0034630 con 0x7f24e4004d00 2023-12-19T05:39:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.594+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f002f070 con 0x7f24e4004d00 2023-12-19T05:39:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.594+0000 7f24f77fe640 1 -- 172.21.15.49:0/171723092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0034a10 con 0x7f24e4004d00 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 -- 172.21.15.49:0/171723092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24e4004d00 msgr2=0x7f24e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/171723092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24e4004d00 0x7f24e4005180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24f000a710 tx=0x7f24e40057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fcd6b640 1 -- 172.21.15.49:0/171723092 reap_dead start 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 -- 172.21.15.49:0/171723092 shutdown_connections 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 -- 172.21.15.49:0/171723092 >> 172.21.15.49:0/171723092 conn(0x7f24f80b29c0 msgr2=0x7f24f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 -- 172.21.15.49:0/171723092 shutdown_connections 2023-12-19T05:39:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.595+0000 7f24fe7ce640 1 -- 172.21.15.49:0/171723092 wait complete. 2023-12-19T05:39:55.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.597+0000 7f24fe7ce640 1 Processor -- start 2023-12-19T05:39:55.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.597+0000 7f24fe7ce640 1 -- start start 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.598+0000 7f24fe7ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24e4004d00 0x7f24f81f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.598+0000 7f24fe7ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.598+0000 7f24fe7ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f813c4e0 0x7f24f813cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.598+0000 7f24fe7ce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f81f2da0 con 0x7f24f815baf0 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.598+0000 7f24fe7ce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f813c960 con 0x7f24f813c4e0 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24fe7ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f815dc30 con 0x7f24e4004d00 2023-12-19T05:39:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36880/0 (socket says 172.21.15.49:36880) 2023-12-19T05:39:55.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 -- 172.21.15.49:0/1461390163 learned_addr learned my addr 172.21.15.49:0/1461390163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:55.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24f7fff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24e4004d00 0x7f24f81f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24fcd6b640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f813c4e0 0x7f24f813cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 -- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24e4004d00 msgr2=0x7f24f81f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24e4004d00 0x7f24f81f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 -- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f813c4e0 msgr2=0x7f24f813cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f813c4e0 0x7f24f813cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.599+0000 7f24effff640 1 -- 172.21.15.49:0/1461390163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f815df10 con 0x7f24f815baf0 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24effff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f24e000f7a0 tx=0x7f24e000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0005110 con 0x7f24f815baf0 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e0005290 con 0x7f24f815baf0 2023-12-19T05:39:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0007050 con 0x7f24f815baf0 2023-12-19T05:39:55.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f815e1f0 con 0x7f24f815baf0 2023-12-19T05:39:55.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.600+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f815bf70 con 0x7f24f815baf0 2023-12-19T05:39:55.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.602+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f815e710 con 0x7f24f815baf0 2023-12-19T05:39:55.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.603+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f24e00071b0 con 0x7f24f815baf0 2023-12-19T05:39:55.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.604+0000 7f24f57fa640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 0x7f24d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:55.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.604+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f24e0087e50 con 0x7f24f815baf0 2023-12-19T05:39:55.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.605+0000 7f24f7fff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 0x7f24d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.606+0000 7f24f7fff640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 0x7f24d806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009bc0 tx=0x7f24e8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.609+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f24f815e710 con 0x7f24f815baf0 2023-12-19T05:39:55.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.803+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24f815e710 con 0x7f24f815baf0 2023-12-19T05:39:55.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.803+0000 7f24f57fa640 1 -- 172.21.15.49:0/1461390163 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24f815e710 con 0x7f24f815baf0 2023-12-19T05:39:55.805 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:55.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 msgr2=0x7f24d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 0x7f24d806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009bc0 tx=0x7f24e8009190 comp rx=0 tx=0).stop 2023-12-19T05:39:55.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 msgr2=0x7f24f813bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:55.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f24e000f7a0 tx=0x7f24e000fba0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 shutdown_connections 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f24d806a430 0x7f24d806c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f813c4e0 0x7f24f813cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f815baf0 0x7f24f813bfa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 --2- 172.21.15.49:0/1461390163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24e4004d00 0x7f24f81f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 >> 172.21.15.49:0/1461390163 conn(0x7f24f80b29c0 msgr2=0x7f24f8070370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 shutdown_connections 2023-12-19T05:39:55.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:55.806+0000 7f24fe7ce640 1 -- 172.21.15.49:0/1461390163 wait complete. 2023-12-19T05:39:55.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:56.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.046+0000 7fbe111dc640 1 Processor -- start 2023-12-19T05:39:56.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.046+0000 7fbe111dc640 1 -- start start 2023-12-19T05:39:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.048+0000 7fbe111dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.048+0000 7fbe111dc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 0x7fbe0c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.048+0000 7fbe111dc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c06e220 con 0x7fbe0c0b02a0 2023-12-19T05:39:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.048+0000 7fbe111dc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cbea0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.048+0000 7fbe111dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cc180 con 0x7fbe0c141900 2023-12-19T05:39:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:54168/0 (socket says 172.21.15.49:54168) 2023-12-19T05:39:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 -- 172.21.15.49:0/1537930775 learned_addr learned my addr 172.21.15.49:0/1537930775 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe109db640 1 --2- 172.21.15.49:0/1537930775 >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 0x7fbe0c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 -- 172.21.15.49:0/1537930775 >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 msgr2=0x7fbe0c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 --2- 172.21.15.49:0/1537930775 >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 0x7fbe0c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 -- 172.21.15.49:0/1537930775 >> v1:172.21.15.115:6789/0 conn(0x7fbe0c0b02a0 legacy=0x7fbe0c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe0bfff640 1 -- 172.21.15.49:0/1537930775 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0b0700 con 0x7fbe0c141900 2023-12-19T05:39:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.049+0000 7fbe109db640 1 --2- 172.21.15.49:0/1537930775 >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 0x7fbe0c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.051+0000 7fbe0bfff640 1 --2- 172.21.15.49:0/1537930775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009870 tx=0x7fbdfc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d73ac4434983fc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.051+0000 7fbe0affd640 1 -- 172.21.15.49:0/1537930775 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc030840 con 0x7fbe0c141900 2023-12-19T05:39:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe0affd640 1 -- 172.21.15.49:0/1537930775 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0309a0 con 0x7fbe0c141900 2023-12-19T05:39:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe0affd640 1 -- 172.21.15.49:0/1537930775 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc030d30 con 0x7fbe0c141900 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 -- 172.21.15.49:0/1537930775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 msgr2=0x7fbe0c0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 --2- 172.21.15.49:0/1537930775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009870 tx=0x7fbdfc02b980 comp rx=0 tx=0).stop 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 -- 172.21.15.49:0/1537930775 shutdown_connections 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 --2- 172.21.15.49:0/1537930775 >> v2:172.21.15.115:3300/0 conn(0x7fbe0c06dc00 0x7fbe0c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 --2- 172.21.15.49:0/1537930775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0afd60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 -- 172.21.15.49:0/1537930775 >> 172.21.15.49:0/1537930775 conn(0x7fbe0c06f630 msgr2=0x7fbe0c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 -- 172.21.15.49:0/1537930775 shutdown_connections 2023-12-19T05:39:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.052+0000 7fbe111dc640 1 -- 172.21.15.49:0/1537930775 wait complete. 2023-12-19T05:39:56.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.054+0000 7fbe111dc640 1 Processor -- start 2023-12-19T05:39:56.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.055+0000 7fbe111dc640 1 -- start start 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 0x7fbe0c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c91c0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c94a0 con 0x7fbe0c0b02a0 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe111dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c9780 con 0x7fbe0c141900 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36882/0 (socket says 172.21.15.49:36882) 2023-12-19T05:39:56.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe0bfff640 1 -- 172.21.15.49:0/3714297794 learned_addr learned my addr 172.21.15.49:0/3714297794 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.056+0000 7fbe109db640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0b7fe640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 0x7fbe0c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 -- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 msgr2=0x7fbe0c0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 -- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 msgr2=0x7fbe0c0af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 0x7fbe0c0af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 -- 172.21.15.49:0/3714297794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04009a70 con 0x7fbe0c06dc00 2023-12-19T05:39:56.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0b7fe640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 0x7fbe0c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe0bfff640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc02b9c0 tx=0x7fbdfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc03e070 con 0x7fbe0c06dc00 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc039a10 con 0x7fbe0c06dc00 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc0094d0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.057+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc039de0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.058+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c0c9d40 con 0x7fbe0c06dc00 2023-12-19T05:39:56.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.059+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c0c9f30 con 0x7fbe0c06dc00 2023-12-19T05:39:56.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.060+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdfc04b400 con 0x7fbe0c06dc00 2023-12-19T05:39:56.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.061+0000 7fbe08ff9640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 0x7fbdf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.061+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbdfc0aaf90 con 0x7fbe0c06dc00 2023-12-19T05:39:56.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.061+0000 7fbe0b7fe640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 0x7fbdf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.063+0000 7fbe0b7fe640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 0x7fbdf806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cce30 tx=0x7fbe00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.065+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdfc0764c0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.272+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe0c061910 con 0x7fbe0c06dc00 2023-12-19T05:39:56.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.273+0000 7fbe08ff9640 1 -- 172.21.15.49:0/3714297794 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdfc079ae0 con 0x7fbe0c06dc00 2023-12-19T05:39:56.274 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.275+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 msgr2=0x7fbdf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.275+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 0x7fbdf806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cce30 tx=0x7fbe00009040 comp rx=0 tx=0).stop 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.275+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 msgr2=0x7fbe0c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.275+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc02b9c0 tx=0x7fbdfc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 shutdown_connections 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbdf806a430 0x7fbdf806c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe0c141900 0x7fbe0c0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0b02a0 0x7fbe0c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 --2- 172.21.15.49:0/3714297794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe0c06dc00 0x7fbe0c159af0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 >> 172.21.15.49:0/3714297794 conn(0x7fbe0c06f630 msgr2=0x7fbe0c15dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 shutdown_connections 2023-12-19T05:39:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.276+0000 7fbe111dc640 1 -- 172.21.15.49:0/3714297794 wait complete. 2023-12-19T05:39:56.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:39:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.515+0000 7fe337101640 1 Processor -- start 2023-12-19T05:39:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.515+0000 7fe337101640 1 -- start start 2023-12-19T05:39:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe337101640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3301606f0 0x7fe33015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe337101640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33006c2d0 con 0x7fe33006bb30 2023-12-19T05:39:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe337101640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300ad0a0 con 0x7fe330160d50 2023-12-19T05:39:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe337101640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe330143870 con 0x7fe3301606f0 2023-12-19T05:39:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe3358fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe33006bb30 0x7fe33006e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55186/0 (socket says 172.21.15.49:55186) 2023-12-19T05:39:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.517+0000 7fe3358fe640 1 -- 172.21.15.49:0/3081809804 learned_addr learned my addr 172.21.15.49:0/3081809804 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656587906 0 0) 0x7fe320001110 con 0x7fe33006bb30 2023-12-19T05:39:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe31c003520 con 0x7fe33006bb30 2023-12-19T05:39:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3360ff640 1 --2- 172.21.15.49:0/3081809804 >> v2:172.21.15.115:3300/0 conn(0x7fe3301606f0 0x7fe33015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509047109 0 0) 0x7fe31c003520 con 0x7fe33006bb30 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 >> v2:172.21.15.115:3300/0 conn(0x7fe3301606f0 msgr2=0x7fe33015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 --2- 172.21.15.49:0/3081809804 >> v2:172.21.15.115:3300/0 conn(0x7fe3301606f0 0x7fe33015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 >> v1:172.21.15.115:6789/0 conn(0x7fe330160d50 legacy=0x7fe3300ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330160ad0 con 0x7fe33006bb30 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe320001800 con 0x7fe33006bb30 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 >> v1:172.21.15.49:6789/0 conn(0x7fe33006bb30 legacy=0x7fe33006e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c003a30 0x7fe31c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 0x7fe31c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c005380 0x7fe31c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.518+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330143870 con 0x7fe31c0047c0 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c00c210 con 0x7fe31c003a30 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c00c3d0 con 0x7fe31c005380 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 0x7fe31c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3360ff640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c003a30 0x7fe31c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 -- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c005380 msgr2=0x7fe31c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c005380 0x7fe31c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 -- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c003a30 msgr2=0x7fe31c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c003a30 0x7fe31c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe3358fe640 1 -- 172.21.15.49:0/3081809804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c003520 con 0x7fe31c0047c0 2023-12-19T05:39:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.519+0000 7fe336900640 1 -- 172.21.15.49:0/3081809804 reap_dead start 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.520+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 0x7fe31c004c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c110 tx=0x7fe31c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b51346d93864a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320005ad0 con 0x7fe31c0047c0 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320005c30 con 0x7fe31c0047c0 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe3350fd640 1 -- 172.21.15.49:0/3081809804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32002c7e0 con 0x7fe31c0047c0 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 -- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 msgr2=0x7fe31c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 0x7fe31c004c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c110 tx=0x7fe31c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 -- 172.21.15.49:0/3081809804 shutdown_connections 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 --2- 172.21.15.49:0/3081809804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe31c0047c0 0x7fe31c004c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 -- 172.21.15.49:0/3081809804 >> 172.21.15.49:0/3081809804 conn(0x7fe3300cfca0 msgr2=0x7fe3300b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 -- 172.21.15.49:0/3081809804 shutdown_connections 2023-12-19T05:39:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.521+0000 7fe337101640 1 -- 172.21.15.49:0/3081809804 wait complete. 2023-12-19T05:39:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.523+0000 7fe337101640 1 Processor -- start 2023-12-19T05:39:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.523+0000 7fe337101640 1 -- start start 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c0047c0 0x7fe330153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3300b1c60 0x7fe3300b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330153e70 con 0x7fe3301f2840 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33013ff90 con 0x7fe3300b1c60 2023-12-19T05:39:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.524+0000 7fe337101640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300b2620 con 0x7fe31c0047c0 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36908/0 (socket says 172.21.15.49:36908) 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 -- 172.21.15.49:0/3448847890 learned_addr learned my addr 172.21.15.49:0/3448847890 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3360ff640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c0047c0 0x7fe330153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe336900640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3300b1c60 0x7fe3300b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 -- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c0047c0 msgr2=0x7fe330153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c0047c0 0x7fe330153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 -- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3300b1c60 msgr2=0x7fe3300b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3300b1c60 0x7fe3300b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.525+0000 7fe3358fe640 1 -- 172.21.15.49:0/3448847890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330130ad0 con 0x7fe3301f2840 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe3358fe640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe32002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32003c040 con 0x7fe3301f2840 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32002cbf0 con 0x7fe3301f2840 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320007070 con 0x7fe3301f2840 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3301f2da0 con 0x7fe3301f2840 2023-12-19T05:39:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.526+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3301f3360 con 0x7fe3301f2840 2023-12-19T05:39:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.527+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe330145510 con 0x7fe3301f2840 2023-12-19T05:39:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.528+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe320032070 con 0x7fe3301f2840 2023-12-19T05:39:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.529+0000 7fe326ffd640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 0x7fe31406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.529+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe3200a9d70 con 0x7fe3301f2840 2023-12-19T05:39:56.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.530+0000 7fe3360ff640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 0x7fe31406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:56.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.531+0000 7fe3360ff640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 0x7fe31406c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe330067660 tx=0x7fe32c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:56.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.534+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe330145510 con 0x7fe3301f2840 2023-12-19T05:39:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.734+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe33006c2d0 con 0x7fe3301f2840 2023-12-19T05:39:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.734+0000 7fe326ffd640 1 -- 172.21.15.49:0/3448847890 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe33006c2d0 con 0x7fe3301f2840 2023-12-19T05:39:56.736 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:39:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 msgr2=0x7fe31406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 0x7fe31406c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe330067660 tx=0x7fe32c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 msgr2=0x7fe330130590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe32002e070 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 shutdown_connections 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe31406a460 0x7fe31406c920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3300b1c60 0x7fe3300b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3301f2840 0x7fe330130590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 --2- 172.21.15.49:0/3448847890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31c0047c0 0x7fe330153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 >> 172.21.15.49:0/3448847890 conn(0x7fe3300cfca0 msgr2=0x7fe33006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 shutdown_connections 2023-12-19T05:39:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:56.737+0000 7fe337101640 1 -- 172.21.15.49:0/3448847890 wait complete. 2023-12-19T05:39:56.754 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:39:56.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:56.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-19T05:39:56.862 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:39:56.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:56.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:39:56.928 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:56.928 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:56.988 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:56.988 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:57.043 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:39:57.044 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:57.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.335+0000 7f234f9c4640 1 Processor -- start 2023-12-19T05:39:57.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.335+0000 7f234f9c4640 1 -- start start 2023-12-19T05:39:57.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.336+0000 7f234f9c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23481449e0 0x7f23480af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234f9c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f234806c6b0 0x7f23480b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234f9c4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480afb10 con 0x7f23480b0b50 2023-12-19T05:39:57.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234f9c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234806bb30 con 0x7f234806c6b0 2023-12-19T05:39:57.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234f9c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480b0070 con 0x7f23481449e0 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f234806c6b0 0x7f23480b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f234806c6b0 0x7f23480b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36912/0 (socket says 172.21.15.49:36912) 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 -- 172.21.15.49:0/3244113717 learned_addr learned my addr 172.21.15.49:0/3244113717 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234d760640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23481449e0 0x7f23480af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 -- 172.21.15.49:0/3244113717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23481449e0 msgr2=0x7f23480af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23481449e0 0x7f23480af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 -- 172.21.15.49:0/3244113717 >> v1:172.21.15.115:6789/0 conn(0x7f23480b0b50 legacy=0x7f234806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.337+0000 7f234df61640 1 -- 172.21.15.49:0/3244113717 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480b0350 con 0x7f234806c6b0 2023-12-19T05:39:57.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.338+0000 7f234df61640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234806c6b0 0x7f23480b1710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2340009e50 tx=0x7f234002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6560187f7a520396 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f233ffff640 1 -- 172.21.15.49:0/3244113717 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234002ca70 con 0x7f234806c6b0 2023-12-19T05:39:57.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f233ffff640 1 -- 172.21.15.49:0/3244113717 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234002cbd0 con 0x7f234806c6b0 2023-12-19T05:39:57.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f233ffff640 1 -- 172.21.15.49:0/3244113717 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400343f0 con 0x7f234806c6b0 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 -- 172.21.15.49:0/3244113717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234806c6b0 msgr2=0x7f23480b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234806c6b0 0x7f23480b1710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2340009e50 tx=0x7f234002bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 -- 172.21.15.49:0/3244113717 shutdown_connections 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234806c6b0 0x7f23480b1710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3244113717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23481449e0 0x7f23480af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.339+0000 7f234f9c4640 1 -- 172.21.15.49:0/3244113717 >> 172.21.15.49:0/3244113717 conn(0x7f23480cbb70 msgr2=0x7f23480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.340+0000 7f234f9c4640 1 -- 172.21.15.49:0/3244113717 shutdown_connections 2023-12-19T05:39:57.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.340+0000 7f234f9c4640 1 -- 172.21.15.49:0/3244113717 wait complete. 2023-12-19T05:39:57.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.341+0000 7f234f9c4640 1 Processor -- start 2023-12-19T05:39:57.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.341+0000 7f234f9c4640 1 -- start start 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 0x7f234815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23480b0b50 0x7f234815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23481f64b0 con 0x7f23481449e0 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234815d5a0 con 0x7f234806c6b0 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.342+0000 7f234f9c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23481f5b80 con 0x7f23480b0b50 2023-12-19T05:39:57.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36916/0 (socket says 172.21.15.49:36916) 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 -- 172.21.15.49:0/3424969815 learned_addr learned my addr 172.21.15.49:0/3424969815 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234d760640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 0x7f234815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234cf5f640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23480b0b50 0x7f234815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 -- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23480b0b50 msgr2=0x7f234815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23480b0b50 0x7f234815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 -- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 msgr2=0x7f234815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 0x7f234815a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 -- 172.21.15.49:0/3424969815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340009b30 con 0x7f23481449e0 2023-12-19T05:39:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234d760640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 0x7f234815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.343+0000 7f234df61640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2340036040 tx=0x7f2340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.344+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234003e450 con 0x7f23481449e0 2023-12-19T05:39:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.344+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234003e5d0 con 0x7f23481449e0 2023-12-19T05:39:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.344+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23481f5e60 con 0x7f23481449e0 2023-12-19T05:39:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.344+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234003e980 con 0x7f23481449e0 2023-12-19T05:39:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.344+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23481f6940 con 0x7f23481449e0 2023-12-19T05:39:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.345+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23481f6660 con 0x7f23481449e0 2023-12-19T05:39:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.346+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f234003eae0 con 0x7f23481449e0 2023-12-19T05:39:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.347+0000 7f233dffb640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 0x7f232c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.347+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f23400ab5d0 con 0x7f23481449e0 2023-12-19T05:39:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.347+0000 7f234d760640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 0x7f232c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.348+0000 7f234d760640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 0x7f232c06c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f234400a9d0 tx=0x7f2344008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.351+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23481f6660 con 0x7f23481449e0 2023-12-19T05:39:57.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.549+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2348061910 con 0x7f23481449e0 2023-12-19T05:39:57.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.551+0000 7f233dffb640 1 -- 172.21.15.49:0/3424969815 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f2340076bb0 con 0x7f23481449e0 2023-12-19T05:39:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:39:57.552 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.553+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 msgr2=0x7f232c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.553+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 0x7f232c06c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f234400a9d0 tx=0x7f2344008040 comp rx=0 tx=0).stop 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.553+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 msgr2=0x7f2348070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.553+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2340036040 tx=0x7f2340004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 shutdown_connections 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f232c06a460 0x7f232c06c920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23480b0b50 0x7f234815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23481449e0 0x7f2348070450 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 --2- 172.21.15.49:0/3424969815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f234806c6b0 0x7f234815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 >> 172.21.15.49:0/3424969815 conn(0x7f23480cbb70 msgr2=0x7f234806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:57.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 shutdown_connections 2023-12-19T05:39:57.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.554+0000 7f234f9c4640 1 -- 172.21.15.49:0/3424969815 wait complete. 2023-12-19T05:39:57.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:57.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:57.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.807+0000 7f1e0339f640 1 Processor -- start 2023-12-19T05:39:57.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.807+0000 7f1e0339f640 1 -- start start 2023-12-19T05:39:57.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.808+0000 7f1e0339f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1dfc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.808+0000 7f1e0339f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc161e70 con 0x7f1dfc146ff0 2023-12-19T05:39:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.808+0000 7f1e0339f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc161260 con 0x7f1dfc06fc40 2023-12-19T05:39:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.808+0000 7f1e0339f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc161080 con 0x7f1dfc0b6430 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.809+0000 7f1e0113b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1dfc146ff0 0x7f1dfc06f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55188/0 (socket says 172.21.15.49:55188) 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.809+0000 7f1e0113b640 1 -- 172.21.15.49:0/1413971533 learned_addr learned my addr 172.21.15.49:0/1413971533 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.809+0000 7f1e0193c640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1dfc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.809+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389847731 0 0) 0x7f1dfc161e70 con 0x7f1dfc146ff0 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.809+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de8003520 con 0x7f1dfc146ff0 2023-12-19T05:39:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352336763 0 0) 0x7f1de8003520 con 0x7f1dfc146ff0 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 msgr2=0x7f1dfc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1dfc0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 >> v1:172.21.15.115:6789/0 conn(0x7f1dfc06fc40 legacy=0x7f1dfc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc161540 con 0x7f1dfc146ff0 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1df8001670 con 0x7f1dfc146ff0 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 >> v1:172.21.15.49:6789/0 conn(0x7f1dfc146ff0 legacy=0x7f1dfc06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1de8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8003fe0 0x7f1de80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de8004d00 0x7f1de8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc161080 con 0x7f1de8004d00 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de800bb40 con 0x7f1de8003fe0 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de800bd00 con 0x7f1dfc0b6430 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1e0193c640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de8004d00 0x7f1de8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1e0113b640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1de8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.810+0000 7f1e0093a640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8003fe0 0x7f1de80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0193c640 1 -- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 msgr2=0x7f1de8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0193c640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc0b6430 0x7f1de8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0193c640 1 -- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8003fe0 msgr2=0x7f1de80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0193c640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8003fe0 0x7f1de80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0193c640 1 -- 172.21.15.49:0/1413971533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8003520 con 0x7f1de8004d00 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.811+0000 7f1e0093a640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8003fe0 0x7f1de80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1e0193c640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de8004d00 0x7f1de8005180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009fc0 tx=0x7f1de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897d9eae86858284 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df402cc20 con 0x7f1de8004d00 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400f040 con 0x7f1de8004d00 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1df3fff640 1 -- 172.21.15.49:0/1413971533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4034440 con 0x7f1de8004d00 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1e0339f640 1 -- 172.21.15.49:0/1413971533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de8004d00 msgr2=0x7f1de8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1e0339f640 1 --2- 172.21.15.49:0/1413971533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de8004d00 0x7f1de8005180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009fc0 tx=0x7f1de80057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.812+0000 7f1e0193c640 1 -- 172.21.15.49:0/1413971533 reap_dead start 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.813+0000 7f1e0339f640 1 -- 172.21.15.49:0/1413971533 shutdown_connections 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.813+0000 7f1e0339f640 1 -- 172.21.15.49:0/1413971533 >> 172.21.15.49:0/1413971533 conn(0x7f1dfc0d3520 msgr2=0x7f1dfc0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.813+0000 7f1e0339f640 1 -- 172.21.15.49:0/1413971533 shutdown_connections 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.813+0000 7f1e0339f640 1 -- 172.21.15.49:0/1413971533 wait complete. 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.814+0000 7f1e0339f640 1 Processor -- start 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.815+0000 7f1e0339f640 1 -- start start 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.815+0000 7f1e0339f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8004d00 0x7f1dfc143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0339f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc15a030 0x7f1dfc13d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0339f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0339f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc13edd0 con 0x7f1dfc13d690 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0339f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc13df90 con 0x7f1de8004d00 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0339f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc13e5c0 con 0x7f1dfc15a030 2023-12-19T05:39:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36938/0 (socket says 172.21.15.49:36938) 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 -- 172.21.15.49:0/3221771132 learned_addr learned my addr 172.21.15.49:0/3221771132 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0093a640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc15a030 0x7f1dfc13d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 -- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc15a030 msgr2=0x7f1dfc13d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0113b640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8004d00 0x7f1dfc143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc15a030 0x7f1dfc13d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 -- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8004d00 msgr2=0x7f1dfc143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8004d00 0x7f1dfc143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.816+0000 7f1e0193c640 1 -- 172.21.15.49:0/3221771132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc13e810 con 0x7f1dfc13d690 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1e0193c640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1df4037040 tx=0x7f1df4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4034d50 con 0x7f1dfc13d690 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4003990 con 0x7f1dfc13d690 2023-12-19T05:39:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4003d40 con 0x7f1dfc13d690 2023-12-19T05:39:57.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc13eaf0 con 0x7f1dfc13d690 2023-12-19T05:39:57.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.817+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc143b60 con 0x7f1dfc13d690 2023-12-19T05:39:57.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.818+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc061910 con 0x7f1dfc13d690 2023-12-19T05:39:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.819+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1df4004030 con 0x7f1dfc13d690 2023-12-19T05:39:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.820+0000 7f1df1ffb640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 0x7f1de006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.820+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1df40aa3c0 con 0x7f1dfc13d690 2023-12-19T05:39:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.821+0000 7f1e0113b640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 0x7f1de006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.822+0000 7f1e0113b640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 0x7f1de006c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1df8001eb0 tx=0x7f1df8000f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:57.824+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1df4075a30 con 0x7f1dfc13d690 2023-12-19T05:39:58.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.022+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1dfc0d43e0 con 0x7f1dfc13d690 2023-12-19T05:39:58.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.023+0000 7f1df1ffb640 1 -- 172.21.15.49:0/3221771132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1df4079050 con 0x7f1dfc13d690 2023-12-19T05:39:58.025 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 msgr2=0x7f1de006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 0x7f1de006c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1df8001eb0 tx=0x7f1df8000f50 comp rx=0 tx=0).stop 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 msgr2=0x7f1dfc15c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1df4037040 tx=0x7f1df4009750 comp rx=0 tx=0).stop 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 shutdown_connections 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1de006a430 0x7f1de006c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1dfc15a030 0x7f1dfc13d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dfc13d690 0x7f1dfc15c180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 --2- 172.21.15.49:0/3221771132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1de8004d00 0x7f1dfc143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 >> 172.21.15.49:0/3221771132 conn(0x7f1dfc0d3520 msgr2=0x7f1dfc145040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:58.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 shutdown_connections 2023-12-19T05:39:58.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.026+0000 7f1e0339f640 1 -- 172.21.15.49:0/3221771132 wait complete. 2023-12-19T05:39:58.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:58.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.281+0000 7fc4415c4640 1 Processor -- start 2023-12-19T05:39:58.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.282+0000 7fc4415c4640 1 -- start start 2023-12-19T05:39:58.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.283+0000 7fc4415c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc43c146c40 0x7fc43c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.283+0000 7fc4415c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc43c0d08f0 0x7fc43c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.283+0000 7fc4415c4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b7d00 con 0x7fc43c0b7360 2023-12-19T05:39:58.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc4415c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0700c0 con 0x7fc43c146c40 2023-12-19T05:39:58.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc4415c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c06f160 con 0x7fc43c0d08f0 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc43c146c40 0x7fc43c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc43c146c40 0x7fc43c070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36946/0 (socket says 172.21.15.49:36946) 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 -- 172.21.15.49:0/295637064 learned_addr learned my addr 172.21.15.49:0/295637064 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc440dc3640 1 --2- 172.21.15.49:0/295637064 >> v2:172.21.15.115:3300/0 conn(0x7fc43c0d08f0 0x7fc43c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 -- 172.21.15.49:0/295637064 >> v2:172.21.15.115:3300/0 conn(0x7fc43c0d08f0 msgr2=0x7fc43c0b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:58.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 --2- 172.21.15.49:0/295637064 >> v2:172.21.15.115:3300/0 conn(0x7fc43c0d08f0 0x7fc43c0b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 -- 172.21.15.49:0/295637064 >> v1:172.21.15.115:6789/0 conn(0x7fc43c0b7360 legacy=0x7fc43c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:58.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.284+0000 7fc43bfff640 1 -- 172.21.15.49:0/295637064 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c06f440 con 0x7fc43c146c40 2023-12-19T05:39:58.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc43bfff640 1 --2- 172.21.15.49:0/295637064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c146c40 0x7fc43c070e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0cf490 tx=0x7fc42c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be53948bc98175 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc43affd640 1 -- 172.21.15.49:0/295637064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c02ca80 con 0x7fc43c146c40 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc43affd640 1 -- 172.21.15.49:0/295637064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c02cbe0 con 0x7fc43c146c40 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc43affd640 1 -- 172.21.15.49:0/295637064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0343f0 con 0x7fc43c146c40 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc4415c4640 1 -- 172.21.15.49:0/295637064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c146c40 msgr2=0x7fc43c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.286+0000 7fc4415c4640 1 --2- 172.21.15.49:0/295637064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c146c40 0x7fc43c070e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0cf490 tx=0x7fc42c02bee0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 -- 172.21.15.49:0/295637064 shutdown_connections 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 --2- 172.21.15.49:0/295637064 >> v2:172.21.15.115:3300/0 conn(0x7fc43c0d08f0 0x7fc43c0b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 --2- 172.21.15.49:0/295637064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c146c40 0x7fc43c070e70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 -- 172.21.15.49:0/295637064 >> 172.21.15.49:0/295637064 conn(0x7fc43c0d31b0 msgr2=0x7fc43c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 -- 172.21.15.49:0/295637064 shutdown_connections 2023-12-19T05:39:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.287+0000 7fc4415c4640 1 -- 172.21.15.49:0/295637064 wait complete. 2023-12-19T05:39:58.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.288+0000 7fc4415c4640 1 Processor -- start 2023-12-19T05:39:58.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.289+0000 7fc4415c4640 1 -- start start 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc43c0b7360 0x7fc43c13d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc43c146c40 0x7fc43c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15d010 con 0x7fc43c0d08f0 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c13b8e0 con 0x7fc43c0b7360 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc4415c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c13d500 con 0x7fc43c146c40 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36948/0 (socket says 172.21.15.49:36948) 2023-12-19T05:39:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 -- 172.21.15.49:0/3189663937 learned_addr learned my addr 172.21.15.49:0/3189663937 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43bfff640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc43c0b7360 0x7fc43c13d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc440dc3640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc43c146c40 0x7fc43c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 -- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc43c146c40 msgr2=0x7fc43c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc43c146c40 0x7fc43c15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 -- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc43c0b7360 msgr2=0x7fc43c13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.290+0000 7fc43b7fe640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc43c0b7360 0x7fc43c13d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc43b7fe640 1 -- 172.21.15.49:0/3189663937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009b30 con 0x7fc43c0d08f0 2023-12-19T05:39:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc43b7fe640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc42400b3f0 tx=0x7fc42400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011830 con 0x7fc43c0d08f0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424011990 con 0x7fc43c0d08f0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c13bb60 con 0x7fc43c0d08f0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011d40 con 0x7fc43c0d08f0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.291+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c13c120 con 0x7fc43c0d08f0 2023-12-19T05:39:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.293+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c061910 con 0x7fc43c0d08f0 2023-12-19T05:39:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.294+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc42401a400 con 0x7fc43c0d08f0 2023-12-19T05:39:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.294+0000 7fc438ff9640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 0x7fc41c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.295+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc424088720 con 0x7fc43c0d08f0 2023-12-19T05:39:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.295+0000 7fc43bfff640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 0x7fc41c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.296+0000 7fc43bfff640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 0x7fc41c06c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc42c035000 tx=0x7fc42c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.300+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc424053d80 con 0x7fc43c0d08f0 2023-12-19T05:39:58.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.493+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc43c0b8a50 con 0x7fc43c0d08f0 2023-12-19T05:39:58.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.494+0000 7fc438ff9640 1 -- 172.21.15.49:0/3189663937 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4240573a0 con 0x7fc43c0d08f0 2023-12-19T05:39:58.495 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:39:58.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 msgr2=0x7fc41c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 0x7fc41c06c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc42c035000 tx=0x7fc42c030000 comp rx=0 tx=0).stop 2023-12-19T05:39:58.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 msgr2=0x7fc43c15cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc42400b3f0 tx=0x7fc42400b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 shutdown_connections 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc41c06a430 0x7fc41c06c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc43c146c40 0x7fc43c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc43c0d08f0 0x7fc43c15cad0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 --2- 172.21.15.49:0/3189663937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc43c0b7360 0x7fc43c13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 >> 172.21.15.49:0/3189663937 conn(0x7fc43c0d31b0 msgr2=0x7fc43c160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 shutdown_connections 2023-12-19T05:39:58.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.497+0000 7fc4415c4640 1 -- 172.21.15.49:0/3189663937 wait complete. 2023-12-19T05:39:58.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.756+0000 7ff9facdb640 1 Processor -- start 2023-12-19T05:39:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.757+0000 7ff9facdb640 1 -- start start 2023-12-19T05:39:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.758+0000 7ff9facdb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 0x7ff9f40b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.758+0000 7ff9facdb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9f40ceea0 0x7ff9f40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.758+0000 7ff9facdb640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f415fde0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.758+0000 7ff9facdb640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40cf870 con 0x7ff9f40ceea0 2023-12-19T05:39:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.758+0000 7ff9facdb640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f415ef10 con 0x7ff9f415b1d0 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff9f40b1ec0 0x7ff9f415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55204/0 (socket says 172.21.15.49:55204) 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f3fff640 1 -- 172.21.15.49:0/347594118 learned_addr learned my addr 172.21.15.49:0/347594118 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f9278640 1 --2- 172.21.15.49:0/347594118 >> v2:172.21.15.49:3300/0 conn(0x7ff9f40ceea0 0x7ff9f40cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f8a77640 1 --2- 172.21.15.49:0/347594118 >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 0x7ff9f40b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f37fe640 1 -- 172.21.15.49:0/347594118 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752466966 0 0) 0x7ff9f415fde0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f37fe640 1 -- 172.21.15.49:0/347594118 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e4003520 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f9278640 1 -- 172.21.15.49:0/347594118 >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 msgr2=0x7ff9f40b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f9278640 1 --2- 172.21.15.49:0/347594118 >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 0x7ff9f40b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f9278640 1 -- 172.21.15.49:0/347594118 >> v1:172.21.15.49:6789/0 conn(0x7ff9f40b1ec0 legacy=0x7ff9f415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f9278640 1 -- 172.21.15.49:0/347594118 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40b2320 con 0x7ff9f40ceea0 2023-12-19T05:39:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.759+0000 7ff9f8a77640 1 --2- 172.21.15.49:0/347594118 >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 0x7ff9f40b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.761+0000 7ff9f9278640 1 --2- 172.21.15.49:0/347594118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40ceea0 0x7ff9f40cf330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40ae020 tx=0x7ff9ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761557588ddf4a73 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.761+0000 7ff9f37fe640 1 -- 172.21.15.49:0/347594118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec02cc80 con 0x7ff9f40ceea0 2023-12-19T05:39:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.761+0000 7ff9f37fe640 1 -- 172.21.15.49:0/347594118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec02cde0 con 0x7ff9f40ceea0 2023-12-19T05:39:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.761+0000 7ff9f37fe640 1 -- 172.21.15.49:0/347594118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec034640 con 0x7ff9f40ceea0 2023-12-19T05:39:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.761+0000 7ff9facdb640 1 -- 172.21.15.49:0/347594118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40ceea0 msgr2=0x7ff9f40cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 --2- 172.21.15.49:0/347594118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40ceea0 0x7ff9f40cf330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40ae020 tx=0x7ff9ec02bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 -- 172.21.15.49:0/347594118 shutdown_connections 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 --2- 172.21.15.49:0/347594118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40ceea0 0x7ff9f40cf330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 --2- 172.21.15.49:0/347594118 >> v2:172.21.15.115:3300/0 conn(0x7ff9f415b1d0 0x7ff9f40b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 -- 172.21.15.49:0/347594118 >> 172.21.15.49:0/347594118 conn(0x7ff9f4073150 msgr2=0x7ff9f40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 -- 172.21.15.49:0/347594118 shutdown_connections 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.762+0000 7ff9facdb640 1 -- 172.21.15.49:0/347594118 wait complete. 2023-12-19T05:39:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.764+0000 7ff9facdb640 1 Processor -- start 2023-12-19T05:39:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.764+0000 7ff9facdb640 1 -- start start 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 0x7ff9f414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f415b1d0 0x7ff9f4157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40c82a0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40c8820 con 0x7ff9f415b1d0 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9facdb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f4155500 con 0x7ff9f40ceea0 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9f8a77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9f8a77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36974/0 (socket says 172.21.15.49:36974) 2023-12-19T05:39:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9f8a77640 1 -- 172.21.15.49:0/1135671483 learned_addr learned my addr 172.21.15.49:0/1135671483 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9f9278640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f415b1d0 0x7ff9f4157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.765+0000 7ff9f3fff640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 0x7ff9f414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 -- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 msgr2=0x7ff9f414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 0x7ff9f414ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 -- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f415b1d0 msgr2=0x7ff9f4157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f415b1d0 0x7ff9f4157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 -- 172.21.15.49:0/1135671483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009a70 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f3fff640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 0x7ff9f414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f8a77640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800d7d0 tx=0x7ff9e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8004030 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8004190 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8004520 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f4156800 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.766+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f40c84b0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.768+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4061910 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.768+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9e80096a0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.769+0000 7ff9f17fa640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 0x7ff9d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.770+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff9e8088ad0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.770+0000 7ff9f3fff640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 0x7ff9d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.771+0000 7ff9f3fff640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 0x7ff9d806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40ca550 tx=0x7ff9e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.773+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9e80540a0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.971+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9f40cdc90 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.972+0000 7ff9f17fa640 1 -- 172.21.15.49:0/1135671483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9e80576c0 con 0x7ff9f40b1ec0 2023-12-19T05:39:58.975 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.974+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 msgr2=0x7ff9d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.974+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 0x7ff9d806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40ca550 tx=0x7ff9e0009040 comp rx=0 tx=0).stop 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.974+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 msgr2=0x7ff9f4156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.974+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800d7d0 tx=0x7ff9e800dc90 comp rx=0 tx=0).stop 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 shutdown_connections 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9d806a430 0x7ff9d806c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f40ceea0 0x7ff9f414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f415b1d0 0x7ff9f4157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 --2- 172.21.15.49:0/1135671483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9f40b1ec0 0x7ff9f4156120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 >> 172.21.15.49:0/1135671483 conn(0x7ff9f4073150 msgr2=0x7ff9f40cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 shutdown_connections 2023-12-19T05:39:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:58.975+0000 7ff9facdb640 1 -- 172.21.15.49:0/1135671483 wait complete. 2023-12-19T05:39:58.993 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:39:59.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.225+0000 7fb9df0b4640 1 Processor -- start 2023-12-19T05:39:59.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.226+0000 7fb9df0b4640 1 -- start start 2023-12-19T05:39:59.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d8157710 0x7fb9d80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d80b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9d80b0830 0x7fb9d80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d80b0c80 con 0x7fb9d8157710 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d815d7d0 con 0x7fb9d80b0830 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.227+0000 7fb9df0b4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80b2ea0 con 0x7fb9d80b2990 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d8157710 0x7fb9d80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d8157710 0x7fb9d80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36984/0 (socket says 172.21.15.49:36984) 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 -- 172.21.15.49:0/809764568 learned_addr learned my addr 172.21.15.49:0/809764568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9dd8b1640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d80b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de8b3640 1 --2- 172.21.15.49:0/809764568 >> v2:172.21.15.115:3300/0 conn(0x7fb9d80b0830 0x7fb9d80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 -- 172.21.15.49:0/809764568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 msgr2=0x7fb9d80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d80b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 -- 172.21.15.49:0/809764568 >> v2:172.21.15.115:3300/0 conn(0x7fb9d80b0830 msgr2=0x7fb9d80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/809764568 >> v2:172.21.15.115:3300/0 conn(0x7fb9d80b0830 0x7fb9d80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.228+0000 7fb9de0b2640 1 -- 172.21.15.49:0/809764568 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d815da90 con 0x7fb9d8157710 2023-12-19T05:39:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.230+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d80b2450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80b0fb0 tx=0x7fb9d402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cea49a33f6959ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.230+0000 7fb9dd0b0640 1 -- 172.21.15.49:0/809764568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4031750 con 0x7fb9d8157710 2023-12-19T05:39:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.230+0000 7fb9dd0b0640 1 -- 172.21.15.49:0/809764568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40318b0 con 0x7fb9d8157710 2023-12-19T05:39:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.230+0000 7fb9dd0b0640 1 -- 172.21.15.49:0/809764568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4031c40 con 0x7fb9d8157710 2023-12-19T05:39:59.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 -- 172.21.15.49:0/809764568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 msgr2=0x7fb9d80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:59.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d80b2450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80b0fb0 tx=0x7fb9d402b7f0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 -- 172.21.15.49:0/809764568 shutdown_connections 2023-12-19T05:39:59.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/809764568 >> v2:172.21.15.115:3300/0 conn(0x7fb9d80b0830 0x7fb9d80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/809764568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d80b2450 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 -- 172.21.15.49:0/809764568 >> 172.21.15.49:0/809764568 conn(0x7fb9d80659a0 msgr2=0x7fb9d8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:59.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 -- 172.21.15.49:0/809764568 shutdown_connections 2023-12-19T05:39:59.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.231+0000 7fb9df0b4640 1 -- 172.21.15.49:0/809764568 wait complete. 2023-12-19T05:39:59.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.233+0000 7fb9df0b4640 1 Processor -- start 2023-12-19T05:39:59.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.233+0000 7fb9df0b4640 1 -- start start 2023-12-19T05:39:59.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d80b0830 0x7fb9d806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d8151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d806b490 con 0x7fb9d8157710 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8152a70 con 0x7fb9d80b0830 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9df0b4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81521d0 con 0x7fb9d80b2990 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9de8b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9de8b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37000/0 (socket says 172.21.15.49:37000) 2023-12-19T05:39:59.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.234+0000 7fb9de8b3640 1 -- 172.21.15.49:0/2134820691 learned_addr learned my addr 172.21.15.49:0/2134820691 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9dd8b1640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d8151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d80b0830 0x7fb9d806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 -- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 msgr2=0x7fb9d8151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d8151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 -- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d80b0830 msgr2=0x7fb9d806d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d80b0830 0x7fb9d806d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 -- 172.21.15.49:0/2134820691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40094d0 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9de8b3640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0007d20 tx=0x7fb9d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0014420 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d00145a0 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0014950 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.235+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d81524b0 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.236+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d8070cb0 con 0x7fb9d8157710 2023-12-19T05:39:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.237+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d806b5d0 con 0x7fb9d8157710 2023-12-19T05:39:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.238+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9d0014ab0 con 0x7fb9d8157710 2023-12-19T05:39:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.239+0000 7fb9ceffd640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 0x7fb9bc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.239+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb9d0089050 con 0x7fb9d8157710 2023-12-19T05:39:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.239+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 0x7fb9bc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.240+0000 7fb9de0b2640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 0x7fb9bc06c940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4035000 tx=0x7fb9d4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.243+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9d806b5d0 con 0x7fb9d8157710 2023-12-19T05:39:59.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.453+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9d806b5d0 con 0x7fb9d8157710 2023-12-19T05:39:59.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.454+0000 7fb9ceffd640 1 -- 172.21.15.49:0/2134820691 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb9d806b5d0 con 0x7fb9d8157710 2023-12-19T05:39:59.455 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 msgr2=0x7fb9bc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 0x7fb9bc06c940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4035000 tx=0x7fb9d4008030 comp rx=0 tx=0).stop 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 msgr2=0x7fb9d8151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0007d20 tx=0x7fb9d000e4b0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 shutdown_connections 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9bc06a480 0x7fb9bc06c940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d80b2990 0x7fb9d8151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d8157710 0x7fb9d8151b50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 --2- 172.21.15.49:0/2134820691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d80b0830 0x7fb9d806d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:59.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 >> 172.21.15.49:0/2134820691 conn(0x7fb9d80659a0 msgr2=0x7fb9d80cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:59.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 shutdown_connections 2023-12-19T05:39:59.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:39:59.457+0000 7fb9df0b4640 1 -- 172.21.15.49:0/2134820691 wait complete. 2023-12-19T05:39:59.479 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-19T05:39:59.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:59.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-19T05:39:59.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:39:59.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:59.593 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T05:39:59.651 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:59.651 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:59.712 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:59.712 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:59.767 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:39:59.767 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:59.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.064+0000 7f0de3d0a640 1 Processor -- start 2023-12-19T05:40:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.064+0000 7f0de3d0a640 1 -- start start 2023-12-19T05:40:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.066+0000 7f0de3d0a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ddc06c6b0 0x7f0ddc166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.066+0000 7f0de3d0a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc06bb30 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.066+0000 7f0de3d0a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0b0070 con 0x7f0ddc1449e0 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.066+0000 7f0de3d0a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b0350 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.066+0000 7f0de22a7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ddc06c6b0 0x7f0ddc166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de22a7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ddc06c6b0 0x7f0ddc166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37012/0 (socket says 172.21.15.49:37012) 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de12a5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ddc0b0b50 0x7f0ddc06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55210/0 (socket says 172.21.15.49:55210) 2023-12-19T05:40:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de22a7640 1 -- 172.21.15.49:0/3371782441 learned_addr learned my addr 172.21.15.49:0/3371782441 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:00.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de22a7640 1 -- 172.21.15.49:0/3371782441 >> v1:172.21.15.115:6789/0 conn(0x7f0ddc1449e0 legacy=0x7f0ddc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:00.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de22a7640 1 -- 172.21.15.49:0/3371782441 >> v1:172.21.15.49:6789/0 conn(0x7f0ddc0b0b50 legacy=0x7f0ddc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de22a7640 1 -- 172.21.15.49:0/3371782441 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0b0630 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.067+0000 7f0de0aa4640 1 -- 172.21.15.49:0/3371782441 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674518242 0 0) 0x7f0ddc06bb30 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.068+0000 7f0de22a7640 1 --2- 172.21.15.49:0/3371782441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc06c6b0 0x7f0ddc166200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009870 tx=0x7f0dd402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23a7d9af3326a68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de0aa4640 1 -- 172.21.15.49:0/3371782441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd402f840 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de0aa4640 1 -- 172.21.15.49:0/3371782441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd402f9a0 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de0aa4640 1 -- 172.21.15.49:0/3371782441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd402fd30 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 -- 172.21.15.49:0/3371782441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc06c6b0 msgr2=0x7f0ddc166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/3371782441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc06c6b0 0x7f0ddc166200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009870 tx=0x7f0dd402ba20 comp rx=0 tx=0).stop 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 -- 172.21.15.49:0/3371782441 shutdown_connections 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/3371782441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc06c6b0 0x7f0ddc166200 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 -- 172.21.15.49:0/3371782441 >> 172.21.15.49:0/3371782441 conn(0x7f0ddc0cbb70 msgr2=0x7f0ddc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 -- 172.21.15.49:0/3371782441 shutdown_connections 2023-12-19T05:40:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.069+0000 7f0de3d0a640 1 -- 172.21.15.49:0/3371782441 wait complete. 2023-12-19T05:40:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.071+0000 7f0de3d0a640 1 Processor -- start 2023-12-19T05:40:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.071+0000 7f0de3d0a640 1 -- start start 2023-12-19T05:40:00.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 0x7f0ddc1f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ddc1449e0 0x7f0ddc1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1f28b0 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cdd80 con 0x7f0ddc1449e0 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.072+0000 7f0de3d0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ce060 con 0x7f0ddc06c6b0 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37028/0 (socket says 172.21.15.49:37028) 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 -- 172.21.15.49:0/4294811820 learned_addr learned my addr 172.21.15.49:0/4294811820 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de1aa6640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 0x7f0ddc1f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 -- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 msgr2=0x7f0ddc1f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 0x7f0ddc1f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 -- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ddc1449e0 msgr2=0x7f0ddc1f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de22a7640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ddc1449e0 0x7f0ddc1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ddc1449e0 0x7f0ddc1f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 -- 172.21.15.49:0/4294811820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40094d0 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de1aa6640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 0x7f0ddc1f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.073+0000 7f0de12a5640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c4a0 tx=0x7f0dcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.074+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0074e0 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.074+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc007640 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.074+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004a00 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.074+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0ce340 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.074+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc0ce900 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.075+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc0ac8b0 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.076+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0dcc004b60 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.077+0000 7f0dd27fc640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.077+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0dcc087bc0 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.078+0000 7f0de1aa6640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.079+0000 7f0de1aa6640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 0x7f0dc006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80012e0 tx=0x7f0dd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.082+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0dcc053130 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.280+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ddc061910 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.282+0000 7f0dd27fc640 1 -- 172.21.15.49:0/4294811820 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f0dcc018020 con 0x7f0ddc0b0b50 2023-12-19T05:40:00.283 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:00.283 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.284+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 msgr2=0x7f0dc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.284+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 0x7f0dc006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80012e0 tx=0x7f0dd8009040 comp rx=0 tx=0).stop 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.284+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 msgr2=0x7f0ddc1f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c4a0 tx=0x7f0dcc00c960 comp rx=0 tx=0).stop 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 shutdown_connections 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dc006a430 0x7f0dc006c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ddc1449e0 0x7f0ddc1f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ddc0b0b50 0x7f0ddc1f2370 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 --2- 172.21.15.49:0/4294811820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ddc06c6b0 0x7f0ddc1f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 >> 172.21.15.49:0/4294811820 conn(0x7f0ddc0cbb70 msgr2=0x7f0ddc06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:00.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 shutdown_connections 2023-12-19T05:40:00.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.285+0000 7f0de3d0a640 1 -- 172.21.15.49:0/4294811820 wait complete. 2023-12-19T05:40:00.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:00.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:00.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.544+0000 7f87e7f2e640 1 Processor -- start 2023-12-19T05:40:00.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.544+0000 7f87e7f2e640 1 -- start start 2023-12-19T05:40:00.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e7f2e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87e00b2760 0x7f87e00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e7f2e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 0x7f87e00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e7f2e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e015fde0 con 0x7f87e015b1d0 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e7f2e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00b2400 con 0x7f87e00b2760 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e7f2e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00cf870 con 0x7f87e00ceea0 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87e00b2760 0x7f87e00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87e00b2760 0x7f87e00b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37032/0 (socket says 172.21.15.49:37032) 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 -- 172.21.15.49:0/1429796079 learned_addr learned my addr 172.21.15.49:0/1429796079 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e64cb640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 0x7f87e00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 -- 172.21.15.49:0/1429796079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 msgr2=0x7f87e00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 0x7f87e00cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.546+0000 7f87e54c9640 1 -- 172.21.15.49:0/1429796079 >> v1:172.21.15.115:6789/0 conn(0x7f87e015b1d0 legacy=0x7f87e015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.547+0000 7f87e54c9640 1 -- 172.21.15.49:0/1429796079 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00b2bc0 con 0x7f87e00b2760 2023-12-19T05:40:00.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.547+0000 7f87e64cb640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 0x7f87e00cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:00.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.548+0000 7f87e54c9640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00b2760 0x7f87e00b1ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009870 tx=0x7f87d002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4a41bbc31c4d1e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.548+0000 7f87e4cc8640 1 -- 172.21.15.49:0/1429796079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0031640 con 0x7f87e00b2760 2023-12-19T05:40:00.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.548+0000 7f87e4cc8640 1 -- 172.21.15.49:0/1429796079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00317a0 con 0x7f87e00b2760 2023-12-19T05:40:00.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.548+0000 7f87e4cc8640 1 -- 172.21.15.49:0/1429796079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0031b30 con 0x7f87e00b2760 2023-12-19T05:40:00.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 -- 172.21.15.49:0/1429796079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00b2760 msgr2=0x7f87e00b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00b2760 0x7f87e00b1ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009870 tx=0x7f87d002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 -- 172.21.15.49:0/1429796079 shutdown_connections 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00ceea0 0x7f87e00cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/1429796079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00b2760 0x7f87e00b1ec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 -- 172.21.15.49:0/1429796079 >> 172.21.15.49:0/1429796079 conn(0x7f87e0073150 msgr2=0x7f87e00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 -- 172.21.15.49:0/1429796079 shutdown_connections 2023-12-19T05:40:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.549+0000 7f87e7f2e640 1 -- 172.21.15.49:0/1429796079 wait complete. 2023-12-19T05:40:00.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.551+0000 7f87e7f2e640 1 Processor -- start 2023-12-19T05:40:00.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.551+0000 7f87e7f2e640 1 -- start start 2023-12-19T05:40:00.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00b2760 0x7f87e00acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 0x7f87e015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00ad310 con 0x7f87e00ceea0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0144230 con 0x7f87e015b1d0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e7f2e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0145640 con 0x7f87e00b2760 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e54c9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e54c9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37042/0 (socket says 172.21.15.49:37042) 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.552+0000 7f87e54c9640 1 -- 172.21.15.49:0/4026485108 learned_addr learned my addr 172.21.15.49:0/4026485108 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e5cca640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00b2760 0x7f87e00acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e64cb640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 0x7f87e015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 -- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00b2760 msgr2=0x7f87e00acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00b2760 0x7f87e00acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 -- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 msgr2=0x7f87e015c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 0x7f87e015c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 -- 172.21.15.49:0/4026485108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00094d0 con 0x7f87e00ceea0 2023-12-19T05:40:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e64cb640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 0x7f87e015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87e54c9640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87d0000c00 tx=0x7f87d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.553+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d003ac60 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.554+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d003ade0 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.554+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0044630 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.554+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e01f4d50 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.554+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e0144d10 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.555+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0061910 con 0x7f87e00ceea0 2023-12-19T05:40:00.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.556+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87d002f050 con 0x7f87e00ceea0 2023-12-19T05:40:00.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.557+0000 7f87d67fc640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 0x7f87c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:00.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.557+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f87d00aaac0 con 0x7f87e00ceea0 2023-12-19T05:40:00.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.558+0000 7f87e5cca640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 0x7f87c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:00.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.559+0000 7f87e5cca640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 0x7f87c406c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006fd0 tx=0x7f87dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:00.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.563+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87d0076150 con 0x7f87e00ceea0 2023-12-19T05:40:00.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.752+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87e00ade00 con 0x7f87e00ceea0 2023-12-19T05:40:00.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.753+0000 7f87d67fc640 1 -- 172.21.15.49:0/4026485108 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87d0035020 con 0x7f87e00ceea0 2023-12-19T05:40:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 msgr2=0x7f87c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 0x7f87c406c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006fd0 tx=0x7f87dc008040 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 msgr2=0x7f87e01f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87d0000c00 tx=0x7f87d00046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 shutdown_connections 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87c406a430 0x7f87c406c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87e015b1d0 0x7f87e015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e00ceea0 0x7f87e01f4810 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 --2- 172.21.15.49:0/4026485108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87e00b2760 0x7f87e00acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.755+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 >> 172.21.15.49:0/4026485108 conn(0x7f87e0073150 msgr2=0x7f87e00b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.756+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 shutdown_connections 2023-12-19T05:40:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:00.756+0000 7f87e7f2e640 1 -- 172.21.15.49:0/4026485108 wait complete. 2023-12-19T05:40:00.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:40:01.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.010+0000 7f3ecf2fa640 1 Processor -- start 2023-12-19T05:40:01.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.010+0000 7f3ecf2fa640 1 -- start start 2023-12-19T05:40:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ec8159e40 0x7f3ec80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec80b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 0x7f3ec815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80b23e0 con 0x7f3ec8159e40 2023-12-19T05:40:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80b0ca0 con 0x7f3ec80b0830 2023-12-19T05:40:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ecf2fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec806b3a0 con 0x7f3ec80cd430 2023-12-19T05:40:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ece2f8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ec8159e40 0x7f3ec80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ece2f8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ec8159e40 0x7f3ec80b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37052/0 (socket says 172.21.15.49:37052) 2023-12-19T05:40:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ece2f8640 1 -- 172.21.15.49:0/3479267110 learned_addr learned my addr 172.21.15.49:0/3479267110 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.012+0000 7f3ece2f8640 1 -- 172.21.15.49:0/3479267110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 msgr2=0x7f3ec80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3eceaf9640 1 --2- 172.21.15.49:0/3479267110 >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 0x7f3ec815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ecdaf7640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec80b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec80b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ece2f8640 1 -- 172.21.15.49:0/3479267110 >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 msgr2=0x7f3ec815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/3479267110 >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 0x7f3ec815da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ece2f8640 1 -- 172.21.15.49:0/3479267110 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80cd8a0 con 0x7f3ec8159e40 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3eceaf9640 1 --2- 172.21.15.49:0/3479267110 >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 0x7f3ec815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.013+0000 7f3ecdaf7640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.014+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec80b1230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80af070 tx=0x7f3ec402e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd3e6528e208106 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.014+0000 7f3ecd2f6640 1 -- 172.21.15.49:0/3479267110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4036440 con 0x7f3ec8159e40 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.014+0000 7f3ecd2f6640 1 -- 172.21.15.49:0/3479267110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40365a0 con 0x7f3ec8159e40 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.014+0000 7f3ecd2f6640 1 -- 172.21.15.49:0/3479267110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4036930 con 0x7f3ec8159e40 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/3479267110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 msgr2=0x7f3ec80b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec80b1230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80af070 tx=0x7f3ec402e150 comp rx=0 tx=0).stop 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/3479267110 shutdown_connections 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/3479267110 >> v2:172.21.15.115:3300/0 conn(0x7f3ec80b0830 0x7f3ec815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/3479267110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec80b1230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/3479267110 >> 172.21.15.49:0/3479267110 conn(0x7f3ec80659a0 msgr2=0x7f3ec8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/3479267110 shutdown_connections 2023-12-19T05:40:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.015+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/3479267110 wait complete. 2023-12-19T05:40:01.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.017+0000 7f3ecf2fa640 1 Processor -- start 2023-12-19T05:40:01.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.017+0000 7f3ecf2fa640 1 -- start start 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ec80b0830 0x7f3ec814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81f5910 con 0x7f3ec8159e40 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec814b060 con 0x7f3ec80b0830 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.018+0000 7f3ecf2fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81f5b60 con 0x7f3ec80cd430 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37068/0 (socket says 172.21.15.49:37068) 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 -- 172.21.15.49:0/1356588667 learned_addr learned my addr 172.21.15.49:0/1356588667 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ec80b0830 0x7f3ec814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3ecdaf7640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 -- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 msgr2=0x7f3ec814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 -- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ec80b0830 msgr2=0x7f3ec814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ec80b0830 0x7f3ec814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 -- 172.21.15.49:0/1356588667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec400b770 con 0x7f3ec8159e40 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.019+0000 7f3eceaf9640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cd50 tx=0x7f3ec000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.020+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000f680 con 0x7f3ec8159e40 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.020+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000f800 con 0x7f3ec8159e40 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.020+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000fbb0 con 0x7f3ec8159e40 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.020+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec81f5e40 con 0x7f3ec8159e40 2023-12-19T05:40:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.020+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81f6400 con 0x7f3ec8159e40 2023-12-19T05:40:01.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.021+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec81f6620 con 0x7f3ec8159e40 2023-12-19T05:40:01.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.022+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ec000b040 con 0x7f3ec8159e40 2023-12-19T05:40:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.023+0000 7f3ebeffd640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 0x7f3eac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.023+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3ec0089290 con 0x7f3ec8159e40 2023-12-19T05:40:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.024+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 0x7f3eac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.025+0000 7f3ece2f8640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 0x7f3eac06c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4038000 tx=0x7f3ec4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.027+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ec00548d0 con 0x7f3ec8159e40 2023-12-19T05:40:01.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.221+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ec8061910 con 0x7f3ec8159e40 2023-12-19T05:40:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.222+0000 7f3ebeffd640 1 -- 172.21.15.49:0/1356588667 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ec0057ef0 con 0x7f3ec8159e40 2023-12-19T05:40:01.224 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:40:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 msgr2=0x7f3eac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 0x7f3eac06c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4038000 tx=0x7f3ec4008040 comp rx=0 tx=0).stop 2023-12-19T05:40:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 msgr2=0x7f3ec806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cd50 tx=0x7f3ec000a650 comp rx=0 tx=0).stop 2023-12-19T05:40:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 shutdown_connections 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3eac06a430 0x7f3eac06c8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ec80cd430 0x7f3ec814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec8159e40 0x7f3ec806d7d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 --2- 172.21.15.49:0/1356588667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ec80b0830 0x7f3ec814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 >> 172.21.15.49:0/1356588667 conn(0x7f3ec80659a0 msgr2=0x7f3ec8158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 shutdown_connections 2023-12-19T05:40:01.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.225+0000 7f3ecf2fa640 1 -- 172.21.15.49:0/1356588667 wait complete. 2023-12-19T05:40:01.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:40:01.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.463+0000 7fac032e5640 1 Processor -- start 2023-12-19T05:40:01.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.464+0000 7fac032e5640 1 -- start start 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.465+0000 7fac032e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabfc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.465+0000 7fac032e5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc161e70 con 0x7fabfc146ff0 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.465+0000 7fac032e5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc161260 con 0x7fabfc06fc40 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.465+0000 7fac032e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc161080 con 0x7fabfc0b6430 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.466+0000 7fac01081640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fabfc146ff0 0x7fabfc06f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55226/0 (socket says 172.21.15.49:55226) 2023-12-19T05:40:01.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.466+0000 7fac01081640 1 -- 172.21.15.49:0/227007601 learned_addr learned my addr 172.21.15.49:0/227007601 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.466+0000 7fac01882640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabfc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.466+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856845820 0 0) 0x7fabfc161e70 con 0x7fabfc146ff0 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.466+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe8003520 con 0x7fabfc146ff0 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369509580 0 0) 0x7fabe8003520 con 0x7fabfc146ff0 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 msgr2=0x7fabfc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabfc0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 >> v1:172.21.15.115:6789/0 conn(0x7fabfc06fc40 legacy=0x7fabfc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc161540 con 0x7fabfc146ff0 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fabf8001670 con 0x7fabfc146ff0 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 >> v1:172.21.15.49:6789/0 conn(0x7fabfc146ff0 legacy=0x7fabfc06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabe8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabe80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabe8004d00 0x7fabe8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc161080 con 0x7fabe8003fe0 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe800bb40 con 0x7fabe8004d00 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe800bd00 con 0x7fabfc0b6430 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fac00880640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabe80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fac01081640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabe8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.467+0000 7fac00880640 1 -- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 msgr2=0x7fabe8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac01882640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabe8004d00 0x7fabe8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac00880640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabe8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac00880640 1 -- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabe8004d00 msgr2=0x7fabe8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac00880640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabe8004d00 0x7fabe8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac00880640 1 -- 172.21.15.49:0/227007601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8003520 con 0x7fabe8003fe0 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac01081640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b6430 0x7fabe8003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.468+0000 7fac01882640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabe8004d00 0x7fabe8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.469+0000 7fac00880640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabe80047c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fabec001720 tx=0x7fabe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a0a8359e849d8d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.469+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0052d0 con 0x7fabe8003fe0 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.469+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec02e050 con 0x7fabe8003fe0 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.469+0000 7fabf3fff640 1 -- 172.21.15.49:0/227007601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec003830 con 0x7fabe8003fe0 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 -- 172.21.15.49:0/227007601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 msgr2=0x7fabe80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 --2- 172.21.15.49:0/227007601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabe80047c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fabec001720 tx=0x7fabe80057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac01882640 1 -- 172.21.15.49:0/227007601 reap_dead start 2023-12-19T05:40:01.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 -- 172.21.15.49:0/227007601 shutdown_connections 2023-12-19T05:40:01.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 -- 172.21.15.49:0/227007601 >> 172.21.15.49:0/227007601 conn(0x7fabfc0d3520 msgr2=0x7fabfc0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:01.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 -- 172.21.15.49:0/227007601 shutdown_connections 2023-12-19T05:40:01.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.470+0000 7fac032e5640 1 -- 172.21.15.49:0/227007601 wait complete. 2023-12-19T05:40:01.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.472+0000 7fac032e5640 1 Processor -- start 2023-12-19T05:40:01.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.472+0000 7fac032e5640 1 -- start start 2023-12-19T05:40:01.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc140690 0x7fabfc140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc143990 0x7fabfc143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14f9c0 con 0x7fabe8003fe0 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc1423f0 con 0x7fabfc140690 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac032e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc141370 con 0x7fabfc143990 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37080/0 (socket says 172.21.15.49:37080) 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 -- 172.21.15.49:0/2986719207 learned_addr learned my addr 172.21.15.49:0/2986719207 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 -- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc143990 msgr2=0x7fabfc143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc143990 0x7fabfc143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 -- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc140690 msgr2=0x7fabfc140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc140690 0x7fabfc140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.473+0000 7fac01081640 1 -- 172.21.15.49:0/2986719207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc141650 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fac01081640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fabf800d750 tx=0x7fabf800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80074e0 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8007640 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80049e0 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc141930 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.474+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc141ef0 con 0x7fabe8003fe0 2023-12-19T05:40:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.475+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc061910 con 0x7fabe8003fe0 2023-12-19T05:40:01.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.476+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabf8004b40 con 0x7fabe8003fe0 2023-12-19T05:40:01.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.477+0000 7fabf1ffb640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 0x7fabe006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.477+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fabf8088280 con 0x7fabe8003fe0 2023-12-19T05:40:01.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.478+0000 7fac00880640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 0x7fabe006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.479+0000 7fac00880640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 0x7fabe006c920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabec033000 tx=0x7fabec02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.481+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fabf80537b0 con 0x7fabe8003fe0 2023-12-19T05:40:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.672+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabfc0717b0 con 0x7fabe8003fe0 2023-12-19T05:40:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.673+0000 7fabf1ffb640 1 -- 172.21.15.49:0/2986719207 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabf800de60 con 0x7fabe8003fe0 2023-12-19T05:40:01.675 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.675+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 msgr2=0x7fabe006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.675+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 0x7fabe006c920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabec033000 tx=0x7fabec02f000 comp rx=0 tx=0).stop 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.675+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 msgr2=0x7fabfc14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.675+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fabf800d750 tx=0x7fabf800dc10 comp rx=0 tx=0).stop 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 shutdown_connections 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fabe006a460 0x7fabe006c920 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc143990 0x7fabfc143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc140690 0x7fabfc140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 --2- 172.21.15.49:0/2986719207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe8003fe0 0x7fabfc14edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 >> 172.21.15.49:0/2986719207 conn(0x7fabfc0d3520 msgr2=0x7fabfc145320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 shutdown_connections 2023-12-19T05:40:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.676+0000 7fac032e5640 1 -- 172.21.15.49:0/2986719207 wait complete. 2023-12-19T05:40:01.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:40:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.917+0000 7f360138e640 1 Processor -- start 2023-12-19T05:40:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.917+0000 7f360138e640 1 -- start start 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.918+0000 7f360138e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 0x7f35fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f360138e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f35fc0b4490 0x7f35fc0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f360138e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0b6670 con 0x7f35fc140360 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f360138e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc140740 con 0x7f35fc0b4490 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f360138e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc143990 con 0x7f35fc0b5cd0 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f35fbfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35fc140360 0x7f35fc0b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55238/0 (socket says 172.21.15.49:55238) 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f35fbfff640 1 -- 172.21.15.49:0/2777407529 learned_addr learned my addr 172.21.15.49:0/2777407529 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f3600b8d640 1 --2- 172.21.15.49:0/2777407529 >> v2:172.21.15.49:3300/0 conn(0x7f35fc0b4490 0x7f35fc0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f35f3fff640 1 --2- 172.21.15.49:0/2777407529 >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 0x7f35fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f3600b8d640 1 -- 172.21.15.49:0/2777407529 >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 msgr2=0x7f35fc0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f3600b8d640 1 --2- 172.21.15.49:0/2777407529 >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 0x7f35fc0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f3600b8d640 1 -- 172.21.15.49:0/2777407529 >> v1:172.21.15.49:6789/0 conn(0x7f35fc140360 legacy=0x7f35fc0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f3600b8d640 1 -- 172.21.15.49:0/2777407529 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc142e10 con 0x7f35fc0b4490 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f35fb7fe640 1 -- 172.21.15.49:0/2777407529 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316755219 0 0) 0x7f35fc0b6670 con 0x7f35fc140360 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.919+0000 7f35f3fff640 1 --2- 172.21.15.49:0/2777407529 >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 0x7f35fc0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f3600b8d640 1 --2- 172.21.15.49:0/2777407529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc0b4490 0x7f35fc0b4920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb2db52a5f1afcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f35fb7fe640 1 -- 172.21.15.49:0/2777407529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402cbd0 con 0x7f35fc0b4490 2023-12-19T05:40:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f35fb7fe640 1 -- 172.21.15.49:0/2777407529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f402cd30 con 0x7f35fc0b4490 2023-12-19T05:40:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f35fb7fe640 1 -- 172.21.15.49:0/2777407529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402cea0 con 0x7f35fc0b4490 2023-12-19T05:40:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f360138e640 1 -- 172.21.15.49:0/2777407529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc0b4490 msgr2=0x7f35fc0b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.921+0000 7f360138e640 1 --2- 172.21.15.49:0/2777407529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc0b4490 0x7f35fc0b4920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402be20 comp rx=0 tx=0).stop 2023-12-19T05:40:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 -- 172.21.15.49:0/2777407529 shutdown_connections 2023-12-19T05:40:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 --2- 172.21.15.49:0/2777407529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc0b4490 0x7f35fc0b4920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 --2- 172.21.15.49:0/2777407529 >> v2:172.21.15.115:3300/0 conn(0x7f35fc0b5cd0 0x7f35fc0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 -- 172.21.15.49:0/2777407529 >> 172.21.15.49:0/2777407529 conn(0x7f35fc065dc0 msgr2=0x7f35fc0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 -- 172.21.15.49:0/2777407529 shutdown_connections 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.922+0000 7f360138e640 1 -- 172.21.15.49:0/2777407529 wait complete. 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.923+0000 7f360138e640 1 Processor -- start 2023-12-19T05:40:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.924+0000 7f360138e640 1 -- start start 2023-12-19T05:40:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 0x7f35fc1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 0x7f35fc13e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc13a2e0 con 0x7f35fc140360 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc138940 con 0x7f35fc0b4490 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f360138e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc138c20 con 0x7f35fc0b5cd0 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37092/0 (socket says 172.21.15.49:37092) 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 -- 172.21.15.49:0/1085118223 learned_addr learned my addr 172.21.15.49:0/1085118223 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f35fbfff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 0x7f35fc1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f35f3fff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 0x7f35fc13e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 -- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 msgr2=0x7f35fc13e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 0x7f35fc13e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 -- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 msgr2=0x7f35fc1382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 0x7f35fc1382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.925+0000 7f3600b8d640 1 -- 172.21.15.49:0/1085118223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009a70 con 0x7f35fc140360 2023-12-19T05:40:01.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f35f3fff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 0x7f35fc13e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f35fbfff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 0x7f35fc1382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:01.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f3600b8d640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402cea0 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4003b90 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4004030 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc138f00 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.926+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc1394c0 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.928+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc061910 con 0x7f35fc140360 2023-12-19T05:40:01.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.928+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35f403b050 con 0x7f35fc140360 2023-12-19T05:40:01.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.929+0000 7f35f97fa640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 0x7f35dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:01.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.929+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f35f40ab150 con 0x7f35fc140360 2023-12-19T05:40:01.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.930+0000 7f35fbfff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 0x7f35dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:01.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.931+0000 7f35fbfff640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 0x7f35dc06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f60 tx=0x7f35ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:01.934+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35f40767b0 con 0x7f35fc140360 2023-12-19T05:40:02.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.137+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35fc06fdb0 con 0x7f35fc140360 2023-12-19T05:40:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.138+0000 7f35f97fa640 1 -- 172.21.15.49:0/1085118223 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f35f4079dd0 con 0x7f35fc140360 2023-12-19T05:40:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:40:02.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 msgr2=0x7f35dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 0x7f35dc06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f60 tx=0x7f35ec009040 comp rx=0 tx=0).stop 2023-12-19T05:40:02.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 msgr2=0x7f35fc070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f4004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 shutdown_connections 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f35dc06a430 0x7f35dc06c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35fc0b5cd0 0x7f35fc13e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35fc140360 0x7f35fc070540 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 --2- 172.21.15.49:0/1085118223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc0b4490 0x7f35fc1382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.140+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 >> 172.21.15.49:0/1085118223 conn(0x7f35fc065dc0 msgr2=0x7f35fc153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:02.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.141+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 shutdown_connections 2023-12-19T05:40:02.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.141+0000 7f360138e640 1 -- 172.21.15.49:0/1085118223 wait complete. 2023-12-19T05:40:02.161 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-19T05:40:02.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:02.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-19T05:40:02.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:40:02.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:02.274 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T05:40:02.324 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:40:02.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:02.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.559+0000 7f582688b640 1 Processor -- start 2023-12-19T05:40:02.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.559+0000 7f582688b640 1 -- start start 2023-12-19T05:40:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f582688b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f58201449e0 0x7f58200af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f582688b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f58200b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f582688b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58200afb10 con 0x7f58200b0b50 2023-12-19T05:40:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f582688b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582006bb30 con 0x7f58201449e0 2023-12-19T05:40:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f582688b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200b0070 con 0x7f582006c6b0 2023-12-19T05:40:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f5817fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58200b0b50 0x7f582006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55244/0 (socket says 172.21.15.49:55244) 2023-12-19T05:40:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.561+0000 7f5817fff640 1 -- 172.21.15.49:0/4239667959 learned_addr learned my addr 172.21.15.49:0/4239667959 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581ffff640 1 --2- 172.21.15.49:0/4239667959 >> v2:172.21.15.115:3300/0 conn(0x7f58201449e0 0x7f58200af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f5824e28640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f58200b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343992714 0 0) 0x7f58200afb10 con 0x7f58200b0b50 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f580c003520 con 0x7f58200b0b50 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47370353 0 0) 0x7f580c003520 con 0x7f58200b0b50 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 msgr2=0x7f58200b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f58200b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 >> v2:172.21.15.115:3300/0 conn(0x7f58201449e0 msgr2=0x7f58200af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 --2- 172.21.15.49:0/4239667959 >> v2:172.21.15.115:3300/0 conn(0x7f58201449e0 0x7f58200af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200b0350 con 0x7f58200b0b50 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5808001670 con 0x7f58200b0b50 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 >> v1:172.21.15.49:6789/0 conn(0x7f58200b0b50 legacy=0x7f582006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f580c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f580c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f580c004d00 0x7f580c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582006bb30 con 0x7f580c0039e0 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200b0070 con 0x7f580c004d00 2023-12-19T05:40:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.562+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c00b980 con 0x7f582006c6b0 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f580c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f5817fff640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f580c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 -- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 msgr2=0x7f580c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f582006c6b0 0x7f580c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 -- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f580c004d00 msgr2=0x7f580c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f580c004d00 0x7f580c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.563+0000 7f581ffff640 1 -- 172.21.15.49:0/4239667959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c003520 con 0x7f580c0039e0 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.564+0000 7f581ffff640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f580c003e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5810009ac0 tx=0x7f580c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b1ccd53939ee36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.564+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581002c710 con 0x7f580c0039e0 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581002c870 con 0x7f580c0039e0 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f581f7fe640 1 -- 172.21.15.49:0/4239667959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581002cc00 con 0x7f580c0039e0 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 -- 172.21.15.49:0/4239667959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 msgr2=0x7f580c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 --2- 172.21.15.49:0/4239667959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f580c003e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5810009ac0 tx=0x7f580c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f5824e28640 1 -- 172.21.15.49:0/4239667959 reap_dead start 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 -- 172.21.15.49:0/4239667959 shutdown_connections 2023-12-19T05:40:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 -- 172.21.15.49:0/4239667959 >> 172.21.15.49:0/4239667959 conn(0x7f58200cbb70 msgr2=0x7f58200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 -- 172.21.15.49:0/4239667959 shutdown_connections 2023-12-19T05:40:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.565+0000 7f582688b640 1 -- 172.21.15.49:0/4239667959 wait complete. 2023-12-19T05:40:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.567+0000 7f582688b640 1 Processor -- start 2023-12-19T05:40:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.567+0000 7f582688b640 1 -- start start 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582015b980 0x7f58200a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58200ce2c0 0x7f58200a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200ccd20 con 0x7f580c0039e0 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200ccfc0 con 0x7f582015b980 2023-12-19T05:40:02.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f582688b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200cd2a0 con 0x7f58200ce2c0 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.568+0000 7f581ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37104/0 (socket says 172.21.15.49:37104) 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 -- 172.21.15.49:0/3921464247 learned_addr learned my addr 172.21.15.49:0/3921464247 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f5817fff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582015b980 0x7f58200a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 -- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58200ce2c0 msgr2=0x7f58200a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58200ce2c0 0x7f58200a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 -- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582015b980 msgr2=0x7f58200a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582015b980 0x7f58200a9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 -- 172.21.15.49:0/3921464247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200cd580 con 0x7f580c0039e0 2023-12-19T05:40:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.569+0000 7f581ffff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f581002c2b0 tx=0x7f5810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.570+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810003810 con 0x7f580c0039e0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.570+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581002de90 con 0x7f580c0039e0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.570+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810003b70 con 0x7f580c0039e0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.570+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58200cd860 con 0x7f580c0039e0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.570+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200ae330 con 0x7f580c0039e0 2023-12-19T05:40:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.571+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820061910 con 0x7f580c0039e0 2023-12-19T05:40:02.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.572+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5810003cd0 con 0x7f580c0039e0 2023-12-19T05:40:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.573+0000 7f581d7fa640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 0x7f580006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.573+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f58100aa5d0 con 0x7f580c0039e0 2023-12-19T05:40:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.574+0000 7f5817fff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 0x7f580006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.575+0000 7f5817fff640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 0x7f580006c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.577+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5810075c30 con 0x7f580c0039e0 2023-12-19T05:40:02.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.811+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58200ae560 con 0x7f580c0039e0 2023-12-19T05:40:02.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.812+0000 7f581d7fa640 1 -- 172.21.15.49:0/3921464247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f5810079250 con 0x7f580c0039e0 2023-12-19T05:40:02.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:02.814 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:40:02.815 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:40:02.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 msgr2=0x7f580006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 0x7f580006c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808009040 comp rx=0 tx=0).stop 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 msgr2=0x7f58200cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f581002c2b0 tx=0x7f5810004730 comp rx=0 tx=0).stop 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 shutdown_connections 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f580006a460 0x7f580006c920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58200ce2c0 0x7f58200a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f582015b980 0x7f58200a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 --2- 172.21.15.49:0/3921464247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f580c0039e0 0x7f58200cdd80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:02.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.814+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 >> 172.21.15.49:0/3921464247 conn(0x7f58200cbb70 msgr2=0x7f582013eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:02.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.815+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 shutdown_connections 2023-12-19T05:40:02.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:02.815+0000 7f582688b640 1 -- 172.21.15.49:0/3921464247 wait complete. 2023-12-19T05:40:02.839 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:03.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.074+0000 7f7e15aa1640 1 Processor -- start 2023-12-19T05:40:03.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.074+0000 7f7e15aa1640 1 -- start start 2023-12-19T05:40:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.076+0000 7f7e15aa1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7e101449e0 0x7f7e100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.076+0000 7f7e15aa1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100afb10 con 0x7f7e100b0b50 2023-12-19T05:40:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.076+0000 7f7e15aa1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1006bb30 con 0x7f7e1006c6b0 2023-12-19T05:40:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.076+0000 7f7e15aa1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100b0070 con 0x7f7e101449e0 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.076+0000 7f7e07fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7e100b0b50 0x7f7e1006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55254/0 (socket says 172.21.15.49:55254) 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e07fff640 1 -- 172.21.15.49:0/2872033337 learned_addr learned my addr 172.21.15.49:0/2872033337 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/2872033337 >> v2:172.21.15.115:3300/0 conn(0x7f7e101449e0 0x7f7e100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390579711 0 0) 0x7f7e100afb10 con 0x7f7e100b0b50 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dfc003520 con 0x7f7e100b0b50 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424665983 0 0) 0x7f7dfc003520 con 0x7f7e100b0b50 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 >> v2:172.21.15.115:3300/0 conn(0x7f7e101449e0 msgr2=0x7f7e100af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 --2- 172.21.15.49:0/2872033337 >> v2:172.21.15.115:3300/0 conn(0x7f7e101449e0 0x7f7e100af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 >> v1:172.21.15.115:6789/0 conn(0x7f7e1006c6b0 legacy=0x7f7e100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100b0350 con 0x7f7e100b0b50 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.077+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f7df8001670 con 0x7f7e100b0b50 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 >> v1:172.21.15.49:6789/0 conn(0x7f7e100b0b50 legacy=0x7f7e1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 0x7f7dfc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dfc0047c0 0x7f7dfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc005180 0x7f7dfc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100b0070 con 0x7f7dfc0039e0 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc00c0b0 con 0x7f7dfc005180 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc00c270 con 0x7f7dfc0047c0 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 0x7f7dfc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e07fff640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dfc0047c0 0x7f7dfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 -- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dfc0047c0 msgr2=0x7f7dfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0ffff640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc005180 0x7f7dfc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dfc0047c0 0x7f7dfc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 -- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc005180 msgr2=0x7f7dfc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc005180 0x7f7dfc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0f7fe640 1 -- 172.21.15.49:0/2872033337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc003520 con 0x7f7dfc0039e0 2023-12-19T05:40:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0ffff640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc005180 0x7f7dfc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.078+0000 7f7e0ffff640 1 -- 172.21.15.49:0/2872033337 reap_dead start 2023-12-19T05:40:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 0x7f7dfc003e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009ac0 tx=0x7f7dfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94be2a58cea62cd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0002c6b0 con 0x7f7dfc0039e0 2023-12-19T05:40:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0002c810 con 0x7f7dfc0039e0 2023-12-19T05:40:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e0effd640 1 -- 172.21.15.49:0/2872033337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0002cba0 con 0x7f7dfc0039e0 2023-12-19T05:40:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e15aa1640 1 -- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 msgr2=0x7f7dfc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.080+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 0x7f7dfc003e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009ac0 tx=0x7f7dfc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.081+0000 7f7e15aa1640 1 -- 172.21.15.49:0/2872033337 shutdown_connections 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.081+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/2872033337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dfc0039e0 0x7f7dfc003e00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.081+0000 7f7e15aa1640 1 -- 172.21.15.49:0/2872033337 >> 172.21.15.49:0/2872033337 conn(0x7f7e100cbb70 msgr2=0x7f7e100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.081+0000 7f7e15aa1640 1 -- 172.21.15.49:0/2872033337 shutdown_connections 2023-12-19T05:40:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.081+0000 7f7e15aa1640 1 -- 172.21.15.49:0/2872033337 wait complete. 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.083+0000 7f7e15aa1640 1 Processor -- start 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.083+0000 7f7e15aa1640 1 -- start start 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc0039e0 0x7f7e1015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1015ca20 0x7f7e1015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10131c70 con 0x7f7e100ad140 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1015d3e0 con 0x7f7dfc0039e0 2023-12-19T05:40:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e15aa1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10131640 con 0x7f7e1015ca20 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37130/0 (socket says 172.21.15.49:37130) 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0ffff640 1 -- 172.21.15.49:0/4110109472 learned_addr learned my addr 172.21.15.49:0/4110109472 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e07fff640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1015ca20 0x7f7e1015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc0039e0 0x7f7e1015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0ffff640 1 -- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1015ca20 msgr2=0x7f7e1015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.084+0000 7f7e0ffff640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1015ca20 0x7f7e1015cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0ffff640 1 -- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc0039e0 msgr2=0x7f7e1015ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0ffff640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc0039e0 0x7f7e1015ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0ffff640 1 -- 172.21.15.49:0/4110109472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100adf10 con 0x7f7e100ad140 2023-12-19T05:40:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0ffff640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7e100cef20 tx=0x7f7e0800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08003d80 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08005070 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08005420 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100ae1f0 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.085+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1015b140 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.086+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e10061910 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.087+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e08005580 con 0x7f7e100ad140 2023-12-19T05:40:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.088+0000 7f7e0cff9640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 0x7f7df006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.089+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7e080881a0 con 0x7f7e100ad140 2023-12-19T05:40:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.089+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 0x7f7df006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.090+0000 7f7e0f7fe640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 0x7f7df006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e00036000 tx=0x7f7e00030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.092+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e08053760 con 0x7f7e100ad140 2023-12-19T05:40:03.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.292+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e100ae560 con 0x7f7e100ad140 2023-12-19T05:40:03.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.296+0000 7f7e0cff9640 1 -- 172.21.15.49:0/4110109472 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7e08005830 con 0x7f7e100ad140 2023-12-19T05:40:03.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:03.298 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 msgr2=0x7f7df006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 0x7f7df006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e00036000 tx=0x7f7e00030000 comp rx=0 tx=0).stop 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 msgr2=0x7f7e100ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7e100cef20 tx=0x7f7e0800d9d0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 shutdown_connections 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7df006a430 0x7f7df006c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1015ca20 0x7f7e1015cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e100ad140 0x7f7e100ad5c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 --2- 172.21.15.49:0/4110109472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dfc0039e0 0x7f7e1015ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 >> 172.21.15.49:0/4110109472 conn(0x7f7e100cbb70 msgr2=0x7f7e100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 shutdown_connections 2023-12-19T05:40:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.299+0000 7f7e15aa1640 1 -- 172.21.15.49:0/4110109472 wait complete. 2023-12-19T05:40:03.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:00.989973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:01.711482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:03.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:03.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.563+0000 7f20ff7d9640 1 Processor -- start 2023-12-19T05:40:03.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.563+0000 7f20ff7d9640 1 -- start start 2023-12-19T05:40:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20ff7d9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20f80ad780 0x7f20f80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20ff7d9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f815da00 con 0x7f20f80ad300 2023-12-19T05:40:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20ff7d9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f815dcc0 con 0x7f20f8157c30 2023-12-19T05:40:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20ff7d9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f815e940 con 0x7f20f80ad780 2023-12-19T05:40:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20fcd74640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20f80ad300 0x7f20f80cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55256/0 (socket says 172.21.15.49:55256) 2023-12-19T05:40:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20fcd74640 1 -- 172.21.15.49:0/380444311 learned_addr learned my addr 172.21.15.49:0/380444311 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20fdd76640 1 --2- 172.21.15.49:0/380444311 >> v2:172.21.15.115:3300/0 conn(0x7f20f80ad780 0x7f20f80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.565+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552314545 0 0) 0x7f20f815da00 con 0x7f20f80ad300 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e0003520 con 0x7f20f80ad300 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824056983 0 0) 0x7f20e0003520 con 0x7f20f80ad300 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 >> v2:172.21.15.115:3300/0 conn(0x7f20f80ad780 msgr2=0x7f20f80cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 --2- 172.21.15.49:0/380444311 >> v2:172.21.15.115:3300/0 conn(0x7f20f80ad780 0x7f20f80cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 >> v1:172.21.15.115:6789/0 conn(0x7f20f8157c30 legacy=0x7f20f80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f815dfa0 con 0x7f20f80ad300 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f20ec001670 con 0x7f20f80ad300 2023-12-19T05:40:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 >> v1:172.21.15.49:6789/0 conn(0x7f20f80ad300 legacy=0x7f20f80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 0x7f20e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00047c0 0x7f20e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e0005180 0x7f20e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f815e940 con 0x7f20e00039e0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e000c0b0 con 0x7f20e0005180 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e000c270 con 0x7f20e00047c0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.566+0000 7f20fd575640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 0x7f20e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fcd74640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00047c0 0x7f20e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fdd76640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e0005180 0x7f20e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fd575640 1 -- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00047c0 msgr2=0x7f20e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fd575640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00047c0 0x7f20e0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fd575640 1 -- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e0005180 msgr2=0x7f20e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fd575640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e0005180 0x7f20e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fd575640 1 -- 172.21.15.49:0/380444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0003520 con 0x7f20e00039e0 2023-12-19T05:40:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fdd76640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e0005180 0x7f20e000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:03.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.567+0000 7f20fdd76640 1 -- 172.21.15.49:0/380444311 reap_dead start 2023-12-19T05:40:03.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.568+0000 7f20fd575640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 0x7f20e0003e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001e20 tx=0x7f20e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3855021bc8da73a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.568+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8003b70 con 0x7f20e00039e0 2023-12-19T05:40:03.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.568+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8003cd0 con 0x7f20e00039e0 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.568+0000 7f20f7fff640 1 -- 172.21.15.49:0/380444311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8005310 con 0x7f20e00039e0 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 -- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 msgr2=0x7f20e0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 0x7f20e0003e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001e20 tx=0x7f20e00057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 -- 172.21.15.49:0/380444311 shutdown_connections 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/380444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e00039e0 0x7f20e0003e20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 -- 172.21.15.49:0/380444311 >> 172.21.15.49:0/380444311 conn(0x7f20f8073150 msgr2=0x7f20f80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 -- 172.21.15.49:0/380444311 shutdown_connections 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.569+0000 7f20ff7d9640 1 -- 172.21.15.49:0/380444311 wait complete. 2023-12-19T05:40:03.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.571+0000 7f20ff7d9640 1 Processor -- start 2023-12-19T05:40:03.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.571+0000 7f20ff7d9640 1 -- start start 2023-12-19T05:40:03.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00039e0 0x7f20f8141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 0x7f20f8161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81456c0 con 0x7f20f81f2a00 2023-12-19T05:40:03.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8145f60 con 0x7f20f8160b90 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20ff7d9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8161920 con 0x7f20e00039e0 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.572+0000 7f20fcd74640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37158/0 (socket says 172.21.15.49:37158) 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 -- 172.21.15.49:0/3606079848 learned_addr learned my addr 172.21.15.49:0/3606079848 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fdd76640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 0x7f20f8161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fd575640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00039e0 0x7f20f8141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 -- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00039e0 msgr2=0x7f20f8141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00039e0 0x7f20f8141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 -- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 msgr2=0x7f20f8161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 0x7f20f8161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 -- 172.21.15.49:0/3606079848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f81458a0 con 0x7f20f81f2a00 2023-12-19T05:40:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fdd76640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 0x7f20f8161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.573+0000 7f20fcd74640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d7a0 tx=0x7f20ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.574+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0074e0 con 0x7f20f81f2a00 2023-12-19T05:40:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.574+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec007640 con 0x7f20f81f2a00 2023-12-19T05:40:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.574+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004a00 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.574+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f8145b80 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.574+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f8161550 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.575+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f81460a0 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.576+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20ec004b60 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.577+0000 7f20f5ffb640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 0x7f20e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.577+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f20ec088440 con 0x7f20f81f2a00 2023-12-19T05:40:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.579+0000 7f20fd575640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 0x7f20e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:03.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.580+0000 7f20fd575640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 0x7f20e406c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20e8034000 tx=0x7f20e8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:03.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.582+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f20f81460a0 con 0x7f20f81f2a00 2023-12-19T05:40:03.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.777+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20f81460a0 con 0x7f20f81f2a00 2023-12-19T05:40:03.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.778+0000 7f20f5ffb640 1 -- 172.21.15.49:0/3606079848 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20f81460a0 con 0x7f20f81f2a00 2023-12-19T05:40:03.780 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.780+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 msgr2=0x7f20e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.780+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 0x7f20e406c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20e8034000 tx=0x7f20e8009030 comp rx=0 tx=0).stop 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.780+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 msgr2=0x7f20f81f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.780+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d7a0 tx=0x7f20ec00dc60 comp rx=0 tx=0).stop 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 shutdown_connections 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20e406a430 0x7f20e406c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f8160b90 0x7f20f8161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f81f2a00 0x7f20f81f2e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 --2- 172.21.15.49:0/3606079848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20e00039e0 0x7f20f8141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:03.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 >> 172.21.15.49:0/3606079848 conn(0x7f20f8073150 msgr2=0x7f20f80ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:03.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 shutdown_connections 2023-12-19T05:40:03.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:03.781+0000 7f20ff7d9640 1 -- 172.21.15.49:0/3606079848 wait complete. 2023-12-19T05:40:03.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:40:04.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.035+0000 7ff66bfff640 1 Processor -- start 2023-12-19T05:40:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.035+0000 7ff66bfff640 1 -- start start 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff66c157710 0x7ff66c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66bfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c15d7d0 con 0x7ff66c0b2990 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0b2ea0 con 0x7ff66c0b0a00 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66bfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c15da90 con 0x7ff66c157710 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66a7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff66c0b2990 0x7ff66c0b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46396/0 (socket says 172.21.15.49:46396) 2023-12-19T05:40:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66a7fc640 1 -- 172.21.15.49:0/52044662 learned_addr learned my addr 172.21.15.49:0/52044662 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66affd640 1 --2- 172.21.15.49:0/52044662 >> v2:172.21.15.115:3300/0 conn(0x7ff66c157710 0x7ff66c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272854942 0 0) 0x7ff66c15d7d0 con 0x7ff66c0b2990 2023-12-19T05:40:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff654003520 con 0x7ff66c0b2990 2023-12-19T05:40:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795646555 0 0) 0x7ff654003520 con 0x7ff66c0b2990 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 >> v2:172.21.15.115:3300/0 conn(0x7ff66c157710 msgr2=0x7ff66c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 --2- 172.21.15.49:0/52044662 >> v2:172.21.15.115:3300/0 conn(0x7ff66c157710 0x7ff66c0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 >> v1:172.21.15.115:6789/0 conn(0x7ff66c0b0a00 legacy=0x7ff66c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c15dd70 con 0x7ff66c0b2990 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff660001670 con 0x7ff66c0b2990 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 >> v1:172.21.15.49:6789/0 conn(0x7ff66c0b2990 legacy=0x7ff66c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff654003a30 0x7ff654003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff654004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6540052d0 0x7ff65400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15da90 con 0x7ff6540047c0 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400c210 con 0x7ff654003a30 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400c3d0 con 0x7ff6540052d0 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.038+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff654004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66affd640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff654003a30 0x7ff654003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66b7fe640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6540052d0 0x7ff65400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66a7fc640 1 -- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6540052d0 msgr2=0x7ff65400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6540052d0 0x7ff65400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66a7fc640 1 -- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff654003a30 msgr2=0x7ff654003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff654003a30 0x7ff654003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66a7fc640 1 -- 172.21.15.49:0/52044662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654003520 con 0x7ff6540047c0 2023-12-19T05:40:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.039+0000 7ff66b7fe640 1 -- 172.21.15.49:0/52044662 reap_dead start 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.040+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff654004c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff66000c0e0 tx=0x7ff6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2c1a160a1ce4dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.040+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660005ad0 con 0x7ff6540047c0 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.040+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff660005c50 con 0x7ff6540047c0 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.040+0000 7ff669ffb640 1 -- 172.21.15.49:0/52044662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66002c810 con 0x7ff6540047c0 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 -- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 msgr2=0x7ff654004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff654004c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff66000c0e0 tx=0x7ff6540057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 -- 172.21.15.49:0/52044662 shutdown_connections 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 --2- 172.21.15.49:0/52044662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff654004c40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 -- 172.21.15.49:0/52044662 >> 172.21.15.49:0/52044662 conn(0x7ff66c0659a0 msgr2=0x7ff66c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 -- 172.21.15.49:0/52044662 shutdown_connections 2023-12-19T05:40:04.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.041+0000 7ff66bfff640 1 -- 172.21.15.49:0/52044662 wait complete. 2023-12-19T05:40:04.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.043+0000 7ff66bfff640 1 Processor -- start 2023-12-19T05:40:04.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.043+0000 7ff66bfff640 1 -- start start 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 0x7ff66c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff66c159c40 0x7ff66c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a600 con 0x7ff6540047c0 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c06cf40 con 0x7ff66c150d90 2023-12-19T05:40:04.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c06df80 con 0x7ff66c159c40 2023-12-19T05:40:04.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51236/0 (socket says 172.21.15.49:51236) 2023-12-19T05:40:04.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.044+0000 7ff66affd640 1 -- 172.21.15.49:0/220671202 learned_addr learned my addr 172.21.15.49:0/220671202 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 0x7ff66c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66b7fe640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff66c159c40 0x7ff66c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 -- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff66c159c40 msgr2=0x7ff66c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff66c159c40 0x7ff66c15a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 -- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 msgr2=0x7ff66c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 0x7ff66c151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 -- 172.21.15.49:0/220671202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c06e260 con 0x7ff6540047c0 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 0x7ff66c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66affd640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff65c011700 tx=0x7ff65c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00f9c0 con 0x7ff6540047c0 2023-12-19T05:40:04.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00fb20 con 0x7ff6540047c0 2023-12-19T05:40:04.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00fed0 con 0x7ff6540047c0 2023-12-19T05:40:04.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.045+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c06e540 con 0x7ff6540047c0 2023-12-19T05:40:04.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.046+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c06db70 con 0x7ff6540047c0 2023-12-19T05:40:04.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.047+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c061910 con 0x7ff6540047c0 2023-12-19T05:40:04.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.048+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff65c015460 con 0x7ff6540047c0 2023-12-19T05:40:04.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.051+0000 7ff653fff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 0x7ff65806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.051+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff65c089160 con 0x7ff6540047c0 2023-12-19T05:40:04.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.051+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 0x7ff65806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.052+0000 7ff66a7fc640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 0x7ff65806c920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff660009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.054+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff65c0547c0 con 0x7ff6540047c0 2023-12-19T05:40:04.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.240+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff66c0ae7b0 con 0x7ff6540047c0 2023-12-19T05:40:04.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.241+0000 7ff653fff640 1 -- 172.21.15.49:0/220671202 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff65c057de0 con 0x7ff6540047c0 2023-12-19T05:40:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 msgr2=0x7ff65806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 0x7ff65806c920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff660009030 comp rx=0 tx=0).stop 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 msgr2=0x7ff66c14e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff65c011700 tx=0x7ff65c011bc0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 shutdown_connections 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff65806a460 0x7ff65806c920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff66c159c40 0x7ff66c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff66c150d90 0x7ff66c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 --2- 172.21.15.49:0/220671202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6540047c0 0x7ff66c14e710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 >> 172.21.15.49:0/220671202 conn(0x7ff66c0659a0 msgr2=0x7ff66c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 shutdown_connections 2023-12-19T05:40:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.243+0000 7ff66bfff640 1 -- 172.21.15.49:0/220671202 wait complete. 2023-12-19T05:40:04.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:40:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.475+0000 7fad23fff640 1 Processor -- start 2023-12-19T05:40:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.475+0000 7fad23fff640 1 -- start start 2023-12-19T05:40:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad240afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad23fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad240b02a0 0x7fad240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad23fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2415ea00 con 0x7fad240cd4e0 2023-12-19T05:40:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad23fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad240b06f0 con 0x7fad240b02a0 2023-12-19T05:40:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2415dae0 con 0x7fad2415e580 2023-12-19T05:40:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad22ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad240cd4e0 0x7fad2415a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46406/0 (socket says 172.21.15.49:46406) 2023-12-19T05:40:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad22ffd640 1 -- 172.21.15.49:0/2216798051 learned_addr learned my addr 172.21.15.49:0/2216798051 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.477+0000 7fad237fe640 1 --2- 172.21.15.49:0/2216798051 >> v2:172.21.15.49:3300/0 conn(0x7fad240b02a0 0x7fad240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad227fc640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad240afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad21ffb640 1 -- 172.21.15.49:0/2216798051 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439866990 0 0) 0x7fad14001110 con 0x7fad240cd4e0 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad21ffb640 1 -- 172.21.15.49:0/2216798051 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0c005730 con 0x7fad240cd4e0 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad237fe640 1 -- 172.21.15.49:0/2216798051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 msgr2=0x7fad240afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad237fe640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad240afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad237fe640 1 -- 172.21.15.49:0/2216798051 >> v1:172.21.15.49:6789/0 conn(0x7fad240cd4e0 legacy=0x7fad2415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad237fe640 1 -- 172.21.15.49:0/2216798051 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2415b000 con 0x7fad240b02a0 2023-12-19T05:40:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.478+0000 7fad227fc640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad240afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.479+0000 7fad237fe640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad240b1130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009d90 tx=0x7fad1c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76dd8f07bc7347c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad21ffb640 1 -- 172.21.15.49:0/2216798051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c02cc50 con 0x7fad240b02a0 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad21ffb640 1 -- 172.21.15.49:0/2216798051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c02cdb0 con 0x7fad240b02a0 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad21ffb640 1 -- 172.21.15.49:0/2216798051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c034660 con 0x7fad240b02a0 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad23fff640 1 -- 172.21.15.49:0/2216798051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 msgr2=0x7fad240b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad23fff640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad240b1130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009d90 tx=0x7fad1c02bea0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad23fff640 1 -- 172.21.15.49:0/2216798051 shutdown_connections 2023-12-19T05:40:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad23fff640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad240b1130 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.480+0000 7fad23fff640 1 --2- 172.21.15.49:0/2216798051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad240afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.481+0000 7fad23fff640 1 -- 172.21.15.49:0/2216798051 >> 172.21.15.49:0/2216798051 conn(0x7fad2406f630 msgr2=0x7fad2406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.481+0000 7fad23fff640 1 -- 172.21.15.49:0/2216798051 shutdown_connections 2023-12-19T05:40:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.481+0000 7fad23fff640 1 -- 172.21.15.49:0/2216798051 wait complete. 2023-12-19T05:40:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.482+0000 7fad23fff640 1 Processor -- start 2023-12-19T05:40:04.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.483+0000 7fad23fff640 1 -- start start 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad240cd4e0 0x7fad2414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad241382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2414cba0 con 0x7fad240b02a0 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2414e670 con 0x7fad240cd4e0 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2414e090 con 0x7fad2415e580 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51262/0 (socket says 172.21.15.49:51262) 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 -- 172.21.15.49:0/1169853348 learned_addr learned my addr 172.21.15.49:0/1169853348 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 -- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 msgr2=0x7fad241382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad237fe640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad241382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad227fc640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad240cd4e0 0x7fad2414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad241382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 -- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad240cd4e0 msgr2=0x7fad2414b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad240cd4e0 0x7fad2414b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.484+0000 7fad22ffd640 1 -- 172.21.15.49:0/1169853348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009a70 con 0x7fad240b02a0 2023-12-19T05:40:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad22ffd640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c450 tx=0x7fad1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14005ce0 con 0x7fad240b02a0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14005e40 con 0x7fad240b02a0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14007290 con 0x7fad240b02a0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2413b2b0 con 0x7fad240b02a0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.485+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2414c5e0 con 0x7fad240b02a0 2023-12-19T05:40:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.487+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24061910 con 0x7fad240b02a0 2023-12-19T05:40:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.487+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad140073f0 con 0x7fad240b02a0 2023-12-19T05:40:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.488+0000 7fad0b7fe640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 0x7fad1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.489+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad14087d10 con 0x7fad240b02a0 2023-12-19T05:40:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.489+0000 7fad227fc640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 0x7fad1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.490+0000 7fad227fc640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 0x7fad1006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad240b0130 tx=0x7fad18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.493+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad1408d020 con 0x7fad240b02a0 2023-12-19T05:40:04.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.682+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad2415ea00 con 0x7fad240b02a0 2023-12-19T05:40:04.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.683+0000 7fad0b7fe640 1 -- 172.21.15.49:0/1169853348 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad2415ea00 con 0x7fad240b02a0 2023-12-19T05:40:04.684 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 msgr2=0x7fad1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 0x7fad1006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad240b0130 tx=0x7fad18008040 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 msgr2=0x7fad2413ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c450 tx=0x7fad1400c910 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 shutdown_connections 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fad1006a430 0x7fad1006c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad2415e580 0x7fad241382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad240cd4e0 0x7fad2414b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 --2- 172.21.15.49:0/1169853348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad240b02a0 0x7fad2413ad70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.685+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 >> 172.21.15.49:0/1169853348 conn(0x7fad2406f630 msgr2=0x7fad240cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.686+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 shutdown_connections 2023-12-19T05:40:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.686+0000 7fad23fff640 1 -- 172.21.15.49:0/1169853348 wait complete. 2023-12-19T05:40:04.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.933+0000 7f541e404640 1 Processor -- start 2023-12-19T05:40:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.933+0000 7f541e404640 1 -- start start 2023-12-19T05:40:04.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.935+0000 7f541e404640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54180d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.935+0000 7f541e404640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180d12d0 con 0x7f5418146e30 2023-12-19T05:40:04.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.935+0000 7f541e404640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180d15b0 con 0x7f54180b8070 2023-12-19T05:40:04.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.935+0000 7f541e404640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5418147210 con 0x7f541815e880 2023-12-19T05:40:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.936+0000 7f541d402640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5418146e30 0x7f54180b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46418/0 (socket says 172.21.15.49:46418) 2023-12-19T05:40:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.936+0000 7f541d402640 1 -- 172.21.15.49:0/2875235439 learned_addr learned my addr 172.21.15.49:0/2875235439 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.936+0000 7f541dc03640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54180d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.936+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327509343 0 0) 0x7f54180d12d0 con 0x7f5418146e30 2023-12-19T05:40:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.936+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5404003520 con 0x7f5418146e30 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356808875 0 0) 0x7f5404003520 con 0x7f5418146e30 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 msgr2=0x7f54180d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54180d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 >> v1:172.21.15.115:6789/0 conn(0x7f54180b8070 legacy=0x7f54180d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180d1890 con 0x7f5418146e30 2023-12-19T05:40:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5414001670 con 0x7f5418146e30 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 >> v1:172.21.15.49:6789/0 conn(0x7f5418146e30 legacy=0x7f54180b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040039a0 0x7f5404003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404004d00 0x7f5404005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418147210 con 0x7f54040039a0 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540400bb90 con 0x7f5404004d00 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540400bd50 con 0x7f541815e880 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f541d402640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040039a0 0x7f5404003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.937+0000 7f541cc01640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541dc03640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404004d00 0x7f5404005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541d402640 1 -- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 msgr2=0x7f54040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541d402640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f541815e880 0x7f54040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541d402640 1 -- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404004d00 msgr2=0x7f5404005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541d402640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404004d00 0x7f5404005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541d402640 1 -- 172.21.15.49:0/2875235439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404003520 con 0x7f54040039a0 2023-12-19T05:40:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.938+0000 7f541dc03640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404004d00 0x7f5404005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:04.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.939+0000 7f541d402640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040039a0 0x7f5404003dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f541400c0e0 tx=0x7f54040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a52bd2fb2e5d25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.939+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414005ad0 con 0x7f54040039a0 2023-12-19T05:40:04.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.939+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414005c30 con 0x7f54040039a0 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.939+0000 7f540ffff640 1 -- 172.21.15.49:0/2875235439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541402c810 con 0x7f54040039a0 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 -- 172.21.15.49:0/2875235439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040039a0 msgr2=0x7f5404003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 --2- 172.21.15.49:0/2875235439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040039a0 0x7f5404003dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f541400c0e0 tx=0x7f54040057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541dc03640 1 -- 172.21.15.49:0/2875235439 reap_dead start 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 -- 172.21.15.49:0/2875235439 shutdown_connections 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 -- 172.21.15.49:0/2875235439 >> 172.21.15.49:0/2875235439 conn(0x7f54180b2990 msgr2=0x7f54180b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 -- 172.21.15.49:0/2875235439 shutdown_connections 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.940+0000 7f541e404640 1 -- 172.21.15.49:0/2875235439 wait complete. 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.942+0000 7f541e404640 1 Processor -- start 2023-12-19T05:40:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.942+0000 7f541e404640 1 -- start start 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 0x7f541813da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5418143210 0x7f54181436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418144ba0 con 0x7f541815dc90 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541815e650 con 0x7f54040039a0 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541e404640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5418143f20 con 0x7f5418143210 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541cc01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541cc01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51280/0 (socket says 172.21.15.49:51280) 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.943+0000 7f541cc01640 1 -- 172.21.15.49:0/2158987372 learned_addr learned my addr 172.21.15.49:0/2158987372 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541d402640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 0x7f541813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 -- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5418143210 msgr2=0x7f54181436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5418143210 0x7f54181436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 -- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 msgr2=0x7f541813da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 0x7f541813da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 -- 172.21.15.49:0/2158987372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418144200 con 0x7f541815dc90 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541d402640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 0x7f541813da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.944+0000 7f541cc01640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f540800e450 tx=0x7f540800e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.945+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080053a0 con 0x7f541815dc90 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.945+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080035f0 con 0x7f541815dc90 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.945+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408003980 con 0x7f541815dc90 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.945+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54181444e0 con 0x7f541815dc90 2023-12-19T05:40:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.945+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5418143c00 con 0x7f541815dc90 2023-12-19T05:40:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.946+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5418061910 con 0x7f541815dc90 2023-12-19T05:40:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.947+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5408003ae0 con 0x7f541815dc90 2023-12-19T05:40:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.948+0000 7f540dffb640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 0x7f53fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.948+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5408088670 con 0x7f541815dc90 2023-12-19T05:40:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.949+0000 7f541d402640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 0x7f53fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.950+0000 7f541d402640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 0x7f53fc06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5414034000 tx=0x7f5414009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:04.952+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5408053c30 con 0x7f541815dc90 2023-12-19T05:40:05.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.183+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54181e54d0 con 0x7f541815dc90 2023-12-19T05:40:05.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.184+0000 7f540dffb640 1 -- 172.21.15.49:0/2158987372 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7f5408057250 con 0x7f541815dc90 2023-12-19T05:40:05.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:05.186 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:40:05.186 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.187+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 msgr2=0x7f53fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.187+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 0x7f53fc06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5414034000 tx=0x7f5414009030 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.187+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 msgr2=0x7f541815e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.187+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f540800e450 tx=0x7f540800e910 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 shutdown_connections 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53fc06a430 0x7f53fc06c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5418143210 0x7f54181436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f541815dc90 0x7f541815e110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 --2- 172.21.15.49:0/2158987372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54040039a0 0x7f541813da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 >> 172.21.15.49:0/2158987372 conn(0x7f54180b2990 msgr2=0x7f541813e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:05.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 shutdown_connections 2023-12-19T05:40:05.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.188+0000 7f541e404640 1 -- 172.21.15.49:0/2158987372 wait complete. 2023-12-19T05:40:05.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.432+0000 7f217b641640 1 Processor -- start 2023-12-19T05:40:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.432+0000 7f217b641640 1 -- start start 2023-12-19T05:40:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f217b641640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21741449e0 0x7f21740af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f217b641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f21740b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f217b641640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740afb10 con 0x7f21740b0b50 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f217b641640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217406bb30 con 0x7f21741449e0 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f217b641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b0070 con 0x7f217406c6b0 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f21793dd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21741449e0 0x7f21740af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f21793dd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21741449e0 0x7f21740af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51290/0 (socket says 172.21.15.49:51290) 2023-12-19T05:40:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.434+0000 7f21793dd640 1 -- 172.21.15.49:0/1782931033 learned_addr learned my addr 172.21.15.49:0/1782931033 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.435+0000 7f2179bde640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f21740b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.435+0000 7f21793dd640 1 -- 172.21.15.49:0/1782931033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 msgr2=0x7f21740b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.435+0000 7f21793dd640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f21740b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.435+0000 7f21793dd640 1 -- 172.21.15.49:0/1782931033 >> v1:172.21.15.115:6789/0 conn(0x7f21740b0b50 legacy=0x7f217406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.435+0000 7f21793dd640 1 -- 172.21.15.49:0/1782931033 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740b0350 con 0x7f21741449e0 2023-12-19T05:40:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.436+0000 7f21793dd640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21741449e0 0x7f21740af5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2170009e50 tx=0x7f217002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8a5c12411e936d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.436+0000 7f216bfff640 1 -- 172.21.15.49:0/1782931033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217002ca70 con 0x7f21741449e0 2023-12-19T05:40:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.436+0000 7f216bfff640 1 -- 172.21.15.49:0/1782931033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217002cbd0 con 0x7f21741449e0 2023-12-19T05:40:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.436+0000 7f216bfff640 1 -- 172.21.15.49:0/1782931033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700343f0 con 0x7f21741449e0 2023-12-19T05:40:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 -- 172.21.15.49:0/1782931033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21741449e0 msgr2=0x7f21740af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21741449e0 0x7f21740af5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2170009e50 tx=0x7f217002bed0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 -- 172.21.15.49:0/1782931033 shutdown_connections 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f21740b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 --2- 172.21.15.49:0/1782931033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21741449e0 0x7f21740af5d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 -- 172.21.15.49:0/1782931033 >> 172.21.15.49:0/1782931033 conn(0x7f21740cbb70 msgr2=0x7f21740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 -- 172.21.15.49:0/1782931033 shutdown_connections 2023-12-19T05:40:05.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.437+0000 7f217b641640 1 -- 172.21.15.49:0/1782931033 wait complete. 2023-12-19T05:40:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.439+0000 7f217b641640 1 Processor -- start 2023-12-19T05:40:05.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.439+0000 7f217b641640 1 -- start start 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f217414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21741449e0 0x7f217413c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217414c5a0 con 0x7f21740b0b50 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174149960 con 0x7f21741449e0 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f217b641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2174149c40 con 0x7f217406c6b0 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f2178bdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.440+0000 7f2178bdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51302/0 (socket says 172.21.15.49:51302) 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 -- 172.21.15.49:0/2903937267 learned_addr learned my addr 172.21.15.49:0/2903937267 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f21793dd640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f217414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2179bde640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21741449e0 0x7f217413c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 -- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 msgr2=0x7f217414c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f217414c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 -- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21741449e0 msgr2=0x7f217413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21741449e0 0x7f217413c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 -- 172.21.15.49:0/2903937267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009b30 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.441+0000 7f2178bdc640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f216400c430 tx=0x7f216400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.442+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164011790 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.442+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21640118f0 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.442+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164011ce0 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.442+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2174149f20 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.442+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217414a4e0 con 0x7f21740b0b50 2023-12-19T05:40:05.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.443+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217414a700 con 0x7f21740b0b50 2023-12-19T05:40:05.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.444+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f216401c460 con 0x7f21740b0b50 2023-12-19T05:40:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.445+0000 7f2169ffb640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.445+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f21640888b0 con 0x7f21740b0b50 2023-12-19T05:40:05.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.446+0000 7f21793dd640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.447+0000 7f21793dd640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2170035000 tx=0x7f2170030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.449+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2164053e70 con 0x7f21740b0b50 2023-12-19T05:40:05.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.646+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2174061910 con 0x7f21740b0b50 2023-12-19T05:40:05.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.649+0000 7f2169ffb640 1 -- 172.21.15.49:0/2903937267 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f2164057490 con 0x7f21740b0b50 2023-12-19T05:40:05.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:05.650 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.651+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 msgr2=0x7f215806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.651+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2170035000 tx=0x7f2170030000 comp rx=0 tx=0).stop 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.651+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 msgr2=0x7f21740add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.651+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f216400c430 tx=0x7f216400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 shutdown_connections 2023-12-19T05:40:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f215806a430 0x7f215806c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21741449e0 0x7f217413c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21740b0b50 0x7f21740add00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 --2- 172.21.15.49:0/2903937267 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f217406c6b0 0x7f217414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 >> 172.21.15.49:0/2903937267 conn(0x7f21740cbb70 msgr2=0x7f21740b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 shutdown_connections 2023-12-19T05:40:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.652+0000 7f217b641640 1 -- 172.21.15.49:0/2903937267 wait complete. 2023-12-19T05:40:05.673 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:40:05.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.900+0000 7fed12cb9640 1 Processor -- start 2023-12-19T05:40:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.900+0000 7fed12cb9640 1 -- start start 2023-12-19T05:40:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.901+0000 7fed12cb9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed0c1449e0 0x7fed0c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.901+0000 7fed12cb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fed0c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.901+0000 7fed12cb9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c0afb10 con 0x7fed0c06b590 2023-12-19T05:40:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed12cb9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c06bb30 con 0x7fed0c1449e0 2023-12-19T05:40:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed12cb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b0070 con 0x7fed0c0b0b50 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed11256640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fed0c06b590 0x7fed0c15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46428/0 (socket says 172.21.15.49:46428) 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed11256640 1 -- 172.21.15.49:0/2827357284 learned_addr learned my addr 172.21.15.49:0/2827357284 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980624559 0 0) 0x7fed0c0afb10 con 0x7fed0c06b590 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed0bfff640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fed0c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed10a55640 1 --2- 172.21.15.49:0/2827357284 >> v2:172.21.15.115:3300/0 conn(0x7fed0c1449e0 0x7fed0c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.902+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf4003520 con 0x7fed0c06b590 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373927138 0 0) 0x7fecf4003520 con 0x7fed0c06b590 2023-12-19T05:40:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 msgr2=0x7fed0c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fed0c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 >> v2:172.21.15.115:3300/0 conn(0x7fed0c1449e0 msgr2=0x7fed0c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 --2- 172.21.15.49:0/2827357284 >> v2:172.21.15.115:3300/0 conn(0x7fed0c1449e0 0x7fed0c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0b0350 con 0x7fed0c06b590 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fed04001670 con 0x7fed0c06b590 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed10a55640 1 --2- 172.21.15.49:0/2827357284 >> v2:172.21.15.115:3300/0 conn(0x7fed0c1449e0 0x7fed0c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 >> v1:172.21.15.49:6789/0 conn(0x7fed0c06b590 legacy=0x7fed0c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fecf40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fecf40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4004d00 0x7fecf4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c06bb30 con 0x7fecf4003f60 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b0070 con 0x7fecf4004d00 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf400ba60 con 0x7fed0c0b0b50 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.903+0000 7fed0bfff640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fecf40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed10a55640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fecf40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed0bfff640 1 -- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 msgr2=0x7fecf40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed0bfff640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0b0b50 0x7fecf40039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed0bfff640 1 -- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4004d00 msgr2=0x7fecf4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed11256640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4004d00 0x7fecf4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed0bfff640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4004d00 0x7fecf4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.904+0000 7fed0bfff640 1 -- 172.21.15.49:0/2827357284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4003520 con 0x7fecf4003f60 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.905+0000 7fed0bfff640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fecf40047c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed00009ac0 tx=0x7fecf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e73c5bc2ba815e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.905+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0002c6b0 con 0x7fecf4003f60 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.905+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0002c810 con 0x7fecf4003f60 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.905+0000 7fed0b7fe640 1 -- 172.21.15.49:0/2827357284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0002cba0 con 0x7fecf4003f60 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 -- 172.21.15.49:0/2827357284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 msgr2=0x7fecf40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 --2- 172.21.15.49:0/2827357284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fecf40047c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed00009ac0 tx=0x7fecf40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed11256640 1 -- 172.21.15.49:0/2827357284 reap_dead start 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 -- 172.21.15.49:0/2827357284 shutdown_connections 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 -- 172.21.15.49:0/2827357284 >> 172.21.15.49:0/2827357284 conn(0x7fed0c0cbb70 msgr2=0x7fed0c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 -- 172.21.15.49:0/2827357284 shutdown_connections 2023-12-19T05:40:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.906+0000 7fed12cb9640 1 -- 172.21.15.49:0/2827357284 wait complete. 2023-12-19T05:40:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.908+0000 7fed12cb9640 1 Processor -- start 2023-12-19T05:40:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.908+0000 7fed12cb9640 1 -- start start 2023-12-19T05:40:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed0c15ac80 0x7fed0c1f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0cdcb0 0x7fed0c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c13ccd0 con 0x7fecf4003f60 2023-12-19T05:40:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0ce680 con 0x7fed0c15ac80 2023-12-19T05:40:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed12cb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c157520 con 0x7fed0c0cdcb0 2023-12-19T05:40:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed10a55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed10a55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51306/0 (socket says 172.21.15.49:51306) 2023-12-19T05:40:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.909+0000 7fed10a55640 1 -- 172.21.15.49:0/436399242 learned_addr learned my addr 172.21.15.49:0/436399242 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 -- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0cdcb0 msgr2=0x7fed0c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0cdcb0 0x7fed0c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 -- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed0c15ac80 msgr2=0x7fed0c1f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed0c15ac80 0x7fed0c1f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 -- 172.21.15.49:0/436399242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c13c960 con 0x7fecf4003f60 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed10a55640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007fa0 tx=0x7fecfc00e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc015610 con 0x7fecf4003f60 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc00f040 con 0x7fecf4003f60 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0159b0 con 0x7fecf4003f60 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.910+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c13b350 con 0x7fecf4003f60 2023-12-19T05:40:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.911+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c1f2810 con 0x7fecf4003f60 2023-12-19T05:40:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.912+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c061910 con 0x7fecf4003f60 2023-12-19T05:40:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.913+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecfc015b10 con 0x7fecf4003f60 2023-12-19T05:40:05.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.914+0000 7fed097fa640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 0x7fecf806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.914+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fecfc0896f0 con 0x7fecf4003f60 2023-12-19T05:40:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.914+0000 7fed0bfff640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 0x7fecf806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:05.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.915+0000 7fed0bfff640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 0x7fecf806c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed00036000 tx=0x7fed0002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:05.918+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecfc054d50 con 0x7fecf4003f60 2023-12-19T05:40:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.153+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed0c0ae560 con 0x7fecf4003f60 2023-12-19T05:40:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.154+0000 7fed097fa640 1 -- 172.21.15.49:0/436399242 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7fecfc058370 con 0x7fecf4003f60 2023-12-19T05:40:06.156 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:06.156 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:40:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:40:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 msgr2=0x7fecf806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 0x7fecf806c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed00036000 tx=0x7fed0002e000 comp rx=0 tx=0).stop 2023-12-19T05:40:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 msgr2=0x7fed0c1f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007fa0 tx=0x7fecfc00e5d0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 shutdown_connections 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecf806a460 0x7fecf806c920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0c0cdcb0 0x7fed0c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed0c15ac80 0x7fed0c1f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 --2- 172.21.15.49:0/436399242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4003f60 0x7fed0c1f6990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 >> 172.21.15.49:0/436399242 conn(0x7fed0c0cbb70 msgr2=0x7fed0c06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.157+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 shutdown_connections 2023-12-19T05:40:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.158+0000 7fed12cb9640 1 -- 172.21.15.49:0/436399242 wait complete. 2023-12-19T05:40:06.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:06.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.403+0000 7fd27598b640 1 Processor -- start 2023-12-19T05:40:06.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.403+0000 7fd27598b640 1 -- start start 2023-12-19T05:40:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd27598b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd27598b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2700ae110 0x7fd2700b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd27598b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700b0a90 con 0x7fd2700b0640 2023-12-19T05:40:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd27598b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27006b8c0 con 0x7fd2700ae110 2023-12-19T05:40:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd27598b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27015b740 con 0x7fd270157bf0 2023-12-19T05:40:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd267fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2700ae110 0x7fd2700b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd26f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2700b0640 0x7fd27015dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46432/0 (socket says 172.21.15.49:46432) 2023-12-19T05:40:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.405+0000 7fd26f7fe640 1 -- 172.21.15.49:0/2094796543 learned_addr learned my addr 172.21.15.49:0/2094796543 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd26effd640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd267fff640 1 -- 172.21.15.49:0/2094796543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 msgr2=0x7fd27015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd267fff640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd267fff640 1 -- 172.21.15.49:0/2094796543 >> v1:172.21.15.49:6789/0 conn(0x7fd2700b0640 legacy=0x7fd27015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd267fff640 1 -- 172.21.15.49:0/2094796543 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700ae640 con 0x7fd2700ae110 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.406+0000 7fd26e7fc640 1 -- 172.21.15.49:0/2094796543 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186362613 0 0) 0x7fd268001490 con 0x7fd2700b0640 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.407+0000 7fd267fff640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700ae110 0x7fd2700b0100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097a0 tx=0x7fd25802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f256d3e07baac4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd26e7fc640 1 -- 172.21.15.49:0/2094796543 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25802d040 con 0x7fd2700ae110 2023-12-19T05:40:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd26e7fc640 1 -- 172.21.15.49:0/2094796543 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258031810 con 0x7fd2700ae110 2023-12-19T05:40:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd26e7fc640 1 -- 172.21.15.49:0/2094796543 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258031ba0 con 0x7fd2700ae110 2023-12-19T05:40:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 -- 172.21.15.49:0/2094796543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700ae110 msgr2=0x7fd2700b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700ae110 0x7fd2700b0100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097a0 tx=0x7fd25802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 -- 172.21.15.49:0/2094796543 shutdown_connections 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700ae110 0x7fd2700b0100 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 --2- 172.21.15.49:0/2094796543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.408+0000 7fd27598b640 1 -- 172.21.15.49:0/2094796543 >> 172.21.15.49:0/2094796543 conn(0x7fd2700cbb70 msgr2=0x7fd2700cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.409+0000 7fd27598b640 1 -- 172.21.15.49:0/2094796543 shutdown_connections 2023-12-19T05:40:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.409+0000 7fd27598b640 1 -- 172.21.15.49:0/2094796543 wait complete. 2023-12-19T05:40:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.410+0000 7fd27598b640 1 Processor -- start 2023-12-19T05:40:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.411+0000 7fd27598b640 1 -- start start 2023-12-19T05:40:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2700ae110 0x7fd270145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270146380 con 0x7fd2700b0640 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270159080 con 0x7fd2700ae110 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd27598b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700ce110 con 0x7fd270157bf0 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd26effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2700ae110 0x7fd270145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51330/0 (socket says 172.21.15.49:51330) 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.412+0000 7fd267fff640 1 -- 172.21.15.49:0/2338905781 learned_addr learned my addr 172.21.15.49:0/2338905781 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd26f7fe640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 -- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 msgr2=0x7fd27006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27006f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 -- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2700ae110 msgr2=0x7fd270145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2700ae110 0x7fd270145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 -- 172.21.15.49:0/2338905781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009400 con 0x7fd2700b0640 2023-12-19T05:40:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd26f7fe640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.413+0000 7fd267fff640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd2580098c0 tx=0x7fd2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.414+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25803ad60 con 0x7fd2700b0640 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.414+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258044400 con 0x7fd2700b0640 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.414+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580447b0 con 0x7fd2700b0640 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.414+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd270159320 con 0x7fd2700b0640 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.414+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2700ce3f0 con 0x7fd2700b0640 2023-12-19T05:40:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.415+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270159840 con 0x7fd2700b0640 2023-12-19T05:40:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.416+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd25804d440 con 0x7fd2700b0640 2023-12-19T05:40:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.417+0000 7fd26cff9640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 0x7fd25006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.417+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd2580aae00 con 0x7fd2700b0640 2023-12-19T05:40:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.418+0000 7fd26effd640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 0x7fd25006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.419+0000 7fd26effd640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 0x7fd25006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2600079a0 tx=0x7fd260008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.422+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd270159840 con 0x7fd2700b0640 2023-12-19T05:40:06.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.656+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd270159840 con 0x7fd2700b0640 2023-12-19T05:40:06.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.656+0000 7fd26cff9640 1 -- 172.21.15.49:0/2338905781 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4645 (secure 0 0 0) 0x7fd270159840 con 0x7fd2700b0640 2023-12-19T05:40:06.658 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:06.658 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1156516535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1156516535},{"type":"v1","addr":"172.21.15.49:6834","nonce":1156516535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2613269979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2613269979},{"type":"v1","addr":"172.21.15.49:6835","nonce":2613269979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/733276165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":733276165},{"type":"v1","addr":"172.21.15.115:6835","nonce":733276165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:02.681473+0000","modified":"2023-12-19T05:39:06.208482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1533170592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1533170592},{"type":"v1","addr":"172.21.15.115:6837","nonce":1533170592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:40:06.658 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 msgr2=0x7fd25006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 0x7fd25006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2600079a0 tx=0x7fd260008040 comp rx=0 tx=0).stop 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 msgr2=0x7fd27006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd2580098c0 tx=0x7fd2580046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 shutdown_connections 2023-12-19T05:40:06.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd25006a430 0x7fd25006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd270157bf0 0x7fd27006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2700b0640 0x7fd27006f120 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 --2- 172.21.15.49:0/2338905781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2700ae110 0x7fd270145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 >> 172.21.15.49:0/2338905781 conn(0x7fd2700cbb70 msgr2=0x7fd2700ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 shutdown_connections 2023-12-19T05:40:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.659+0000 7fd27598b640 1 -- 172.21.15.49:0/2338905781 wait complete. 2023-12-19T05:40:06.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.884+0000 7fee65426640 1 Processor -- start 2023-12-19T05:40:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.884+0000 7fee65426640 1 -- start start 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 0x7fee600af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 0x7fee6006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee6006b590 0x7fee6006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600afb10 con 0x7fee6006b590 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6006bb30 con 0x7fee600b0b50 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee65426640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b0070 con 0x7fee601449e0 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee5f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee6006b590 0x7fee6006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee5f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee6006b590 0x7fee6006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51334/0 (socket says 172.21.15.49:51334) 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.886+0000 7fee5f7fe640 1 -- 172.21.15.49:0/2719018049 learned_addr learned my addr 172.21.15.49:0/2719018049 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5e7fc640 1 --2- 172.21.15.49:0/2719018049 >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 0x7fee6006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5effd640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 0x7fee600af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5f7fe640 1 -- 172.21.15.49:0/2719018049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 msgr2=0x7fee600af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5f7fe640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 0x7fee600af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5f7fe640 1 -- 172.21.15.49:0/2719018049 >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 msgr2=0x7fee6006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5f7fe640 1 --2- 172.21.15.49:0/2719018049 >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 0x7fee6006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5f7fe640 1 -- 172.21.15.49:0/2719018049 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600b0350 con 0x7fee6006b590 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5e7fc640 1 --2- 172.21.15.49:0/2719018049 >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 0x7fee6006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.887+0000 7fee5effd640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 0x7fee600af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.888+0000 7fee5f7fe640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee6006b590 0x7fee6006c4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee600b14b0 tx=0x7fee5802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c519ef9b3f2a370 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.888+0000 7fee5dffb640 1 -- 172.21.15.49:0/2719018049 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5802ca80 con 0x7fee6006b590 2023-12-19T05:40:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.888+0000 7fee5dffb640 1 -- 172.21.15.49:0/2719018049 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5802cbe0 con 0x7fee6006b590 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.888+0000 7fee5dffb640 1 -- 172.21.15.49:0/2719018049 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580343f0 con 0x7fee6006b590 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 -- 172.21.15.49:0/2719018049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee6006b590 msgr2=0x7fee6006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee6006b590 0x7fee6006c4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee600b14b0 tx=0x7fee5802bee0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 -- 172.21.15.49:0/2719018049 shutdown_connections 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee6006b590 0x7fee6006c4e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 --2- 172.21.15.49:0/2719018049 >> v2:172.21.15.115:3300/0 conn(0x7fee600b0b50 0x7fee6006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 --2- 172.21.15.49:0/2719018049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee601449e0 0x7fee600af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 -- 172.21.15.49:0/2719018049 >> 172.21.15.49:0/2719018049 conn(0x7fee600cbb70 msgr2=0x7fee600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 -- 172.21.15.49:0/2719018049 shutdown_connections 2023-12-19T05:40:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.889+0000 7fee65426640 1 -- 172.21.15.49:0/2719018049 wait complete. 2023-12-19T05:40:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.891+0000 7fee65426640 1 Processor -- start 2023-12-19T05:40:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.891+0000 7fee65426640 1 -- start start 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee6006b590 0x7fee601f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee601449e0 0x7fee6013d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6015be20 con 0x7fee600b0b50 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6013c550 con 0x7fee601449e0 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee65426640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6013bf90 con 0x7fee6006b590 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.892+0000 7fee5e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51348/0 (socket says 172.21.15.49:51348) 2023-12-19T05:40:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 -- 172.21.15.49:0/3558588928 learned_addr learned my addr 172.21.15.49:0/3558588928 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5effd640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee6006b590 0x7fee601f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 -- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee6006b590 msgr2=0x7fee601f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee6006b590 0x7fee601f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 -- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee601449e0 msgr2=0x7fee6013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee601449e0 0x7fee6013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 -- 172.21.15.49:0/3558588928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009b30 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.893+0000 7fee5e7fc640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c7c0 tx=0x7fee5400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.894+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54007a30 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.894+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54007b90 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.894+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400ce70 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.894+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6013c270 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.894+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee601f2770 con 0x7fee600b0b50 2023-12-19T05:40:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.895+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6015bfd0 con 0x7fee600b0b50 2023-12-19T05:40:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.896+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee540113f0 con 0x7fee600b0b50 2023-12-19T05:40:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.898+0000 7fee477fe640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 0x7fee4c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.898+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fee54088a10 con 0x7fee600b0b50 2023-12-19T05:40:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.898+0000 7fee5effd640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 0x7fee4c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:06.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.900+0000 7fee5effd640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 0x7fee4c06c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee6015ebd0 tx=0x7fee50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:06.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:06.901+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee6015bfd0 con 0x7fee600b0b50 2023-12-19T05:40:07.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.111+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee60061910 con 0x7fee600b0b50 2023-12-19T05:40:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.114+0000 7fee477fe640 1 -- 172.21.15.49:0/3558588928 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fee54054070 con 0x7fee600b0b50 2023-12-19T05:40:07.116 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:07.116 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:39:52.468347+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:00.989973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:01.711482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 msgr2=0x7fee4c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 0x7fee4c06c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee6015ebd0 tx=0x7fee50008040 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 msgr2=0x7fee6013b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c7c0 tx=0x7fee5400cc80 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 shutdown_connections 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee4c06a460 0x7fee4c06c920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee601449e0 0x7fee6013d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee600b0b50 0x7fee6013b4d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 --2- 172.21.15.49:0/3558588928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee6006b590 0x7fee601f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 >> 172.21.15.49:0/3558588928 conn(0x7fee600cbb70 msgr2=0x7fee600ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.117+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 shutdown_connections 2023-12-19T05:40:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.118+0000 7fee65426640 1 -- 172.21.15.49:0/3558588928 wait complete. 2023-12-19T05:40:07.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:40:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.358+0000 7f806136e640 1 Processor -- start 2023-12-19T05:40:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.358+0000 7f806136e640 1 -- start start 2023-12-19T05:40:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f806136e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f805c0ce820 0x7f805c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f806136e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0cd840 con 0x7f805c0d2b00 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f806136e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0b6e90 con 0x7f805c146e10 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f806136e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805c0d2430 con 0x7f805c0ce820 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f805b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f805c0ce820 0x7f805c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f805a7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f805c0d2b00 0x7f805c0ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46436/0 (socket says 172.21.15.49:46436) 2023-12-19T05:40:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.360+0000 7f805a7fc640 1 -- 172.21.15.49:0/2267181350 learned_addr learned my addr 172.21.15.49:0/2267181350 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.361+0000 7f8059ffb640 1 -- 172.21.15.49:0/2267181350 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970328180 0 0) 0x7f805c0cd840 con 0x7f805c0d2b00 2023-12-19T05:40:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.361+0000 7f8059ffb640 1 -- 172.21.15.49:0/2267181350 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8048003520 con 0x7f805c0d2b00 2023-12-19T05:40:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.361+0000 7f805b7fe640 1 -- 172.21.15.49:0/2267181350 >> v1:172.21.15.115:6789/0 conn(0x7f805c146e10 legacy=0x7f805c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.361+0000 7f805b7fe640 1 -- 172.21.15.49:0/2267181350 >> v1:172.21.15.49:6789/0 conn(0x7f805c0d2b00 legacy=0x7f805c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.361+0000 7f805b7fe640 1 -- 172.21.15.49:0/2267181350 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c0d2620 con 0x7f805c0ce820 2023-12-19T05:40:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.362+0000 7f805b7fe640 1 --2- 172.21.15.49:0/2267181350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c0d1ef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80540097a0 tx=0x7f805402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fb7c053f2a1b59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f8059ffb640 1 -- 172.21.15.49:0/2267181350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054031830 con 0x7f805c0ce820 2023-12-19T05:40:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f8059ffb640 1 -- 172.21.15.49:0/2267181350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8054031990 con 0x7f805c0ce820 2023-12-19T05:40:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f8059ffb640 1 -- 172.21.15.49:0/2267181350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054031d20 con 0x7f805c0ce820 2023-12-19T05:40:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 -- 172.21.15.49:0/2267181350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 msgr2=0x7f805c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 --2- 172.21.15.49:0/2267181350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c0d1ef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80540097a0 tx=0x7f805402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 -- 172.21.15.49:0/2267181350 shutdown_connections 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 --2- 172.21.15.49:0/2267181350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c0d1ef0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 -- 172.21.15.49:0/2267181350 >> 172.21.15.49:0/2267181350 conn(0x7f805c0b29c0 msgr2=0x7f805c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 -- 172.21.15.49:0/2267181350 shutdown_connections 2023-12-19T05:40:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.363+0000 7f806136e640 1 -- 172.21.15.49:0/2267181350 wait complete. 2023-12-19T05:40:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.365+0000 7f806136e640 1 Processor -- start 2023-12-19T05:40:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.365+0000 7f806136e640 1 -- start start 2023-12-19T05:40:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 0x7f805c13e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 0x7f805c13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b7050 con 0x7f805c0ce820 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b7bd0 con 0x7f805c146e10 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f806136e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b72a0 con 0x7f805c0d2b00 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.366+0000 7f805affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51368/0 (socket says 172.21.15.49:51368) 2023-12-19T05:40:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 -- 172.21.15.49:0/2347523895 learned_addr learned my addr 172.21.15.49:0/2347523895 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805b7fe640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 0x7f805c13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805a7fc640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 0x7f805c13e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 -- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 msgr2=0x7f805c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 0x7f805c13e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 -- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 msgr2=0x7f805c13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 0x7f805c13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 -- 172.21.15.49:0/2347523895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054009400 con 0x7f805c0ce820 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805b7fe640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 0x7f805c13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805a7fc640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 0x7f805c13e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f805affd640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c760 tx=0x7f804c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.367+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c003b70 con 0x7f805c0ce820 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.368+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c003cf0 con 0x7f805c0ce820 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.368+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c00aa90 con 0x7f805c0ce820 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.368+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c0b7580 con 0x7f805c0ce820 2023-12-19T05:40:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.368+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c13dac0 con 0x7f805c0ce820 2023-12-19T05:40:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.369+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c140bf0 con 0x7f805c0ce820 2023-12-19T05:40:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.370+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f804c00abf0 con 0x7f805c0ce820 2023-12-19T05:40:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.371+0000 7f80537fe640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.371+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f804c088810 con 0x7f805c0ce820 2023-12-19T05:40:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.372+0000 7f805a7fc640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.373+0000 7f805a7fc640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 0x7f803c06c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f805c0d3d90 tx=0x7f8044009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.375+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f804c053d40 con 0x7f805c0ce820 2023-12-19T05:40:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.607+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f805c061910 con 0x7f805c0ce820 2023-12-19T05:40:07.610 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:40:07.608+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:40:07.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.623+0000 7f80537fe640 1 -- 172.21.15.49:0/2347523895 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f804c003e60 con 0x7f805c0ce820 2023-12-19T05:40:07.624 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 msgr2=0x7f803c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 0x7f803c06c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f805c0d3d90 tx=0x7f8044009040 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 msgr2=0x7f805c13f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c760 tx=0x7f804c00cc20 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 shutdown_connections 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f803c06a430 0x7f803c06c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f805c0d2b00 0x7f805c13e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f805c146e10 0x7f805c13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 --2- 172.21.15.49:0/2347523895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f805c0ce820 0x7f805c13f6d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.625+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 >> 172.21.15.49:0/2347523895 conn(0x7f805c0b29c0 msgr2=0x7f805c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:07.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.626+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 shutdown_connections 2023-12-19T05:40:07.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.626+0000 7f806136e640 1 -- 172.21.15.49:0/2347523895 wait complete. 2023-12-19T05:40:07.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:40:07.658 INFO:tasks.ceph.mds.d.smithi115.stderr: -7730> 2023-12-19T05:39:03.846+0000 7f7078447640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:40:07.753 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:40:07.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.873+0000 7ffadffff640 1 Processor -- start 2023-12-19T05:40:07.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.873+0000 7ffadffff640 1 -- start start 2023-12-19T05:40:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffae0157250 0x7ffae015a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffae00b2f70 0x7ffae00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae00ceb50 con 0x7ffae00cc1a0 2023-12-19T05:40:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadffff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae0157630 con 0x7ffae0157250 2023-12-19T05:40:07.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadffff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae015ab90 con 0x7ffae00b2f70 2023-12-19T05:40:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.875+0000 7ffadeffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffae0157250 0x7ffae015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffae0157250 0x7ffae015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51384/0 (socket says 172.21.15.49:51384) 2023-12-19T05:40:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 -- 172.21.15.49:0/4058829312 learned_addr learned my addr 172.21.15.49:0/4058829312 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffad67fc640 1 --2- 172.21.15.49:0/4058829312 >> v2:172.21.15.115:3300/0 conn(0x7ffae00b2f70 0x7ffae00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 -- 172.21.15.49:0/4058829312 >> v2:172.21.15.115:3300/0 conn(0x7ffae00b2f70 msgr2=0x7ffae00b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 --2- 172.21.15.49:0/4058829312 >> v2:172.21.15.115:3300/0 conn(0x7ffae00b2f70 0x7ffae00b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 -- 172.21.15.49:0/4058829312 >> v1:172.21.15.115:6789/0 conn(0x7ffae00cc1a0 legacy=0x7ffae00cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.876+0000 7ffadeffd640 1 -- 172.21.15.49:0/4058829312 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00ce590 con 0x7ffae0157250 2023-12-19T05:40:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.877+0000 7ffadeffd640 1 --2- 172.21.15.49:0/4058829312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae0157250 0x7ffae015a650 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ce1c0 tx=0x7ffad002cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb8996c57e253cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffade7fc640 1 -- 172.21.15.49:0/4058829312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad002db00 con 0x7ffae0157250 2023-12-19T05:40:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffade7fc640 1 -- 172.21.15.49:0/4058829312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad002dc60 con 0x7ffae0157250 2023-12-19T05:40:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffade7fc640 1 -- 172.21.15.49:0/4058829312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0035440 con 0x7ffae0157250 2023-12-19T05:40:07.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 -- 172.21.15.49:0/4058829312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae0157250 msgr2=0x7ffae015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 --2- 172.21.15.49:0/4058829312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae0157250 0x7ffae015a650 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ce1c0 tx=0x7ffad002cd50 comp rx=0 tx=0).stop 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 -- 172.21.15.49:0/4058829312 shutdown_connections 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 --2- 172.21.15.49:0/4058829312 >> v2:172.21.15.115:3300/0 conn(0x7ffae00b2f70 0x7ffae00b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 --2- 172.21.15.49:0/4058829312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae0157250 0x7ffae015a650 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.878+0000 7ffadffff640 1 -- 172.21.15.49:0/4058829312 >> 172.21.15.49:0/4058829312 conn(0x7ffae00659a0 msgr2=0x7ffae0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.879+0000 7ffadffff640 1 -- 172.21.15.49:0/4058829312 shutdown_connections 2023-12-19T05:40:07.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.879+0000 7ffadffff640 1 -- 172.21.15.49:0/4058829312 wait complete. 2023-12-19T05:40:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.880+0000 7ffadffff640 1 Processor -- start 2023-12-19T05:40:07.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.880+0000 7ffadffff640 1 -- start start 2023-12-19T05:40:07.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae00b2f70 0x7ffae0150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffae0157250 0x7ffae01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae006d460 con 0x7ffae00cc1a0 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae006b2f0 con 0x7ffae00b2f70 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.881+0000 7ffadffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae006be70 con 0x7ffae0157250 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51388/0 (socket says 172.21.15.49:51388) 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 -- 172.21.15.49:0/3734834392 learned_addr learned my addr 172.21.15.49:0/3734834392 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffadeffd640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae00b2f70 0x7ffae0150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffadf7fe640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffae0157250 0x7ffae01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 -- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffae0157250 msgr2=0x7ffae01582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffae0157250 0x7ffae01582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 -- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae00b2f70 msgr2=0x7ffae0150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae00b2f70 0x7ffae0150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 -- 172.21.15.49:0/3734834392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad000a670 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.882+0000 7ffad67fc640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d830 tx=0x7ffac800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.883+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800b6c0 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.883+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800b820 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.883+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800bbb0 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.883+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae015dd70 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.883+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae006b820 con 0x7ffae00cc1a0 2023-12-19T05:40:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.884+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0061910 con 0x7ffae00cc1a0 2023-12-19T05:40:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.885+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffac801e460 con 0x7ffae00cc1a0 2023-12-19T05:40:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.886+0000 7ffadcff9640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 0x7ffac006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.886+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5824+0+0 (secure 0 0 0) 0x7ffac80891a0 con 0x7ffae00cc1a0 2023-12-19T05:40:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.887+0000 7ffadeffd640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 0x7ffac006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.888+0000 7ffadeffd640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 0x7ffac006c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffad0037000 tx=0x7ffad0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:07.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:07.890+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffac80546a0 con 0x7ffae00cc1a0 2023-12-19T05:40:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.115+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffae00b1980 con 0x7ffae00cc1a0 2023-12-19T05:40:08.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.626+0000 7ffadcff9640 1 -- 172.21.15.49:0/3734834392 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffac8057cc0 con 0x7ffae00cc1a0 2023-12-19T05:40:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 msgr2=0x7ffac006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 0x7ffac006c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffad0037000 tx=0x7ffad0008040 comp rx=0 tx=0).stop 2023-12-19T05:40:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 msgr2=0x7ffae0157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d830 tx=0x7ffac800dcf0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 shutdown_connections 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffac006a430 0x7ffac006c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffae0157250 0x7ffae01582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00cc1a0 0x7ffae0157da0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 --2- 172.21.15.49:0/3734834392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae00b2f70 0x7ffae0150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.630+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 >> 172.21.15.49:0/3734834392 conn(0x7ffae00659a0 msgr2=0x7ffae00b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:08.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.631+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 shutdown_connections 2023-12-19T05:40:08.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.631+0000 7ffadffff640 1 -- 172.21.15.49:0/3734834392 wait complete. 2023-12-19T05:40:08.657 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:40:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.898+0000 7fa53d311640 1 Processor -- start 2023-12-19T05:40:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.898+0000 7fa53d311640 1 -- start start 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5380ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa53806d070 0x7fa5380afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 0x7fa5380ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380adc40 con 0x7fa53806d070 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380b0780 con 0x7fa5380b02f0 2023-12-19T05:40:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53d311640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53815f920 con 0x7fa53815afd0 2023-12-19T05:40:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa52ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa53806d070 0x7fa5380afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa52ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa53806d070 0x7fa5380afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51398/0 (socket says 172.21.15.49:51398) 2023-12-19T05:40:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa52ffff640 1 -- 172.21.15.49:0/826453707 learned_addr learned my addr 172.21.15.49:0/826453707 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa53cb10640 1 --2- 172.21.15.49:0/826453707 >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 0x7fa5380ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.900+0000 7fa537fff640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5380ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa52ffff640 1 -- 172.21.15.49:0/826453707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 msgr2=0x7fa5380ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa52ffff640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5380ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa52ffff640 1 -- 172.21.15.49:0/826453707 >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 msgr2=0x7fa5380ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa52ffff640 1 --2- 172.21.15.49:0/826453707 >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 0x7fa5380ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa52ffff640 1 -- 172.21.15.49:0/826453707 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53815ed10 con 0x7fa53806d070 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa53cb10640 1 --2- 172.21.15.49:0/826453707 >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 0x7fa5380ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.901+0000 7fa537fff640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5380ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:08.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.902+0000 7fa52ffff640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380afdb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5380719c0 tx=0x7fa52002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e24f427ffa06251 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:08.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.902+0000 7fa5377fe640 1 -- 172.21.15.49:0/826453707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520031880 con 0x7fa53806d070 2023-12-19T05:40:08.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.902+0000 7fa5377fe640 1 -- 172.21.15.49:0/826453707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5200319e0 con 0x7fa53806d070 2023-12-19T05:40:08.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.902+0000 7fa5377fe640 1 -- 172.21.15.49:0/826453707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520031d70 con 0x7fa53806d070 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 -- 172.21.15.49:0/826453707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 msgr2=0x7fa5380afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380afdb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5380719c0 tx=0x7fa52002b920 comp rx=0 tx=0).stop 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 -- 172.21.15.49:0/826453707 shutdown_connections 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 --2- 172.21.15.49:0/826453707 >> v2:172.21.15.115:3300/0 conn(0x7fa5380b02f0 0x7fa5380ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380afdb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 --2- 172.21.15.49:0/826453707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5380ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 -- 172.21.15.49:0/826453707 >> 172.21.15.49:0/826453707 conn(0x7fa5380b4750 msgr2=0x7fa5380659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 -- 172.21.15.49:0/826453707 shutdown_connections 2023-12-19T05:40:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.903+0000 7fa53d311640 1 -- 172.21.15.49:0/826453707 wait complete. 2023-12-19T05:40:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.905+0000 7fa53d311640 1 Processor -- start 2023-12-19T05:40:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.905+0000 7fa53d311640 1 -- start start 2023-12-19T05:40:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 0x7fa53814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5381f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53814be40 con 0x7fa53806d070 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53814c400 con 0x7fa5380b02f0 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa53d311640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53814c6e0 con 0x7fa53815afd0 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa537fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa537fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51412/0 (socket says 172.21.15.49:51412) 2023-12-19T05:40:08.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.906+0000 7fa537fff640 1 -- 172.21.15.49:0/2149548179 learned_addr learned my addr 172.21.15.49:0/2149548179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:08.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa53cb10640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5381f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa52ffff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 0x7fa53814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 -- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 msgr2=0x7fa5381f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5381f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 -- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 msgr2=0x7fa53814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 0x7fa53814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 -- 172.21.15.49:0/2149548179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5200094d0 con 0x7fa53806d070 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa53cb10640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5381f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa52ffff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 0x7fa53814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.907+0000 7fa537fff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c7f0 tx=0x7fa52800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.908+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528007820 con 0x7fa53806d070 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.908+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528007980 con 0x7fa53806d070 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.908+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528007cf0 con 0x7fa53806d070 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.908+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53814c9c0 con 0x7fa53806d070 2023-12-19T05:40:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.908+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53814cf80 con 0x7fa53806d070 2023-12-19T05:40:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.909+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa538061910 con 0x7fa53806d070 2023-12-19T05:40:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.910+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5280113f0 con 0x7fa53806d070 2023-12-19T05:40:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.911+0000 7fa5357fa640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 0x7fa51806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.911+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fa528088d30 con 0x7fa53806d070 2023-12-19T05:40:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.912+0000 7fa52ffff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 0x7fa51806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.913+0000 7fa52ffff640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 0x7fa51806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa520036000 tx=0x7fa52003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:08.916+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa528054230 con 0x7fa53806d070 2023-12-19T05:40:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.110+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa538066710 con 0x7fa53806d070 2023-12-19T05:40:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.640+0000 7fa5357fa640 1 -- 172.21.15.49:0/2149548179 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa52801f0d0 con 0x7fa53806d070 2023-12-19T05:40:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:40:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 msgr2=0x7fa51806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 0x7fa51806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa520036000 tx=0x7fa52003c040 comp rx=0 tx=0).stop 2023-12-19T05:40:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 msgr2=0x7fa5380b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c7f0 tx=0x7fa52800ccb0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 shutdown_connections 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa51806a430 0x7fa51806c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa53815afd0 0x7fa5381f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5380b02f0 0x7fa53814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 --2- 172.21.15.49:0/2149548179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53806d070 0x7fa5380b2170 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.645+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 >> 172.21.15.49:0/2149548179 conn(0x7fa5380b4750 msgr2=0x7fa5380ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.646+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 shutdown_connections 2023-12-19T05:40:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.646+0000 7fa53d311640 1 -- 172.21.15.49:0/2149548179 wait complete. 2023-12-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:40:09.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.905+0000 7f58d7fff640 1 Processor -- start 2023-12-19T05:40:09.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.906+0000 7f58d7fff640 1 -- start start 2023-12-19T05:40:09.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.908+0000 7f58d7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f58d80b0a70 0x7f58d80cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:09.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.908+0000 7f58d7fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d815b460 con 0x7f58d815b000 2023-12-19T05:40:09.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.908+0000 7f58d7fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d80cc700 con 0x7f58d8157970 2023-12-19T05:40:09.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.908+0000 7f58d7fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d80cdab0 con 0x7f58d80b0a70 2023-12-19T05:40:09.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d67fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58d815b000 0x7f58d80b0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46442/0 (socket says 172.21.15.49:46442) 2023-12-19T05:40:09.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d67fc640 1 -- 172.21.15.49:0/3343155311 learned_addr learned my addr 172.21.15.49:0/3343155311 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:09.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d77fe640 1 --2- 172.21.15.49:0/3343155311 >> v2:172.21.15.115:3300/0 conn(0x7f58d80b0a70 0x7f58d80cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:09.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143453478 0 0) 0x7f58c8001290 con 0x7f58d815b000 2023-12-19T05:40:09.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c4003520 con 0x7f58d815b000 2023-12-19T05:40:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931874016 0 0) 0x7f58c4003520 con 0x7f58d815b000 2023-12-19T05:40:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d77fe640 1 -- 172.21.15.49:0/3343155311 >> v1:172.21.15.115:6789/0 conn(0x7f58d8157970 legacy=0x7f58d80ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.909+0000 7f58d77fe640 1 -- 172.21.15.49:0/3343155311 >> v1:172.21.15.49:6789/0 conn(0x7f58d815b000 legacy=0x7f58d80b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.910+0000 7f58d77fe640 1 -- 172.21.15.49:0/3343155311 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80cbd30 con 0x7f58d80b0a70 2023-12-19T05:40:09.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.911+0000 7f58d77fe640 1 --2- 172.21.15.49:0/3343155311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d80b0a70 0x7f58d80cc1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009d90 tx=0x7f58d002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9628276c73ca506e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:09.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.911+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8001980 con 0x7f58d80b0a70 2023-12-19T05:40:09.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.911+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d002c940 con 0x7f58d80b0a70 2023-12-19T05:40:09.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.911+0000 7f58d5ffb640 1 -- 172.21.15.49:0/3343155311 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d002ccd0 con 0x7f58d80b0a70 2023-12-19T05:40:09.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 -- 172.21.15.49:0/3343155311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d80b0a70 msgr2=0x7f58d80cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 --2- 172.21.15.49:0/3343155311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d80b0a70 0x7f58d80cc1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009d90 tx=0x7f58d002be10 comp rx=0 tx=0).stop 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 -- 172.21.15.49:0/3343155311 shutdown_connections 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 --2- 172.21.15.49:0/3343155311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d80b0a70 0x7f58d80cc1c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 -- 172.21.15.49:0/3343155311 >> 172.21.15.49:0/3343155311 conn(0x7f58d80659a0 msgr2=0x7f58d8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 -- 172.21.15.49:0/3343155311 shutdown_connections 2023-12-19T05:40:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.912+0000 7f58d7fff640 1 -- 172.21.15.49:0/3343155311 wait complete. 2023-12-19T05:40:09.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.914+0000 7f58d7fff640 1 Processor -- start 2023-12-19T05:40:09.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.914+0000 7f58d7fff640 1 -- start start 2023-12-19T05:40:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d8157970 0x7f58d81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58d815b000 0x7f58d81e8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d815bfa0 con 0x7f58d80b0a70 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81551d0 con 0x7f58d8157970 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.915+0000 7f58d7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d815b600 con 0x7f58d815b000 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51428/0 (socket says 172.21.15.49:51428) 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 -- 172.21.15.49:0/2872725385 learned_addr learned my addr 172.21.15.49:0/2872725385 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d77fe640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58d815b000 0x7f58d81e8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 -- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58d815b000 msgr2=0x7f58d81e8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58d815b000 0x7f58d81e8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 -- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d8157970 msgr2=0x7f58d81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:09.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d8157970 0x7f58d81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 -- 172.21.15.49:0/2872725385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0009a70 con 0x7f58d80b0a70 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.916+0000 7f58d6ffd640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c450 tx=0x7f58c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.917+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00052d0 con 0x7f58d80b0a70 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.917+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0005430 con 0x7f58d80b0a70 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.917+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0012870 con 0x7f58d80b0a70 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.917+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d815b8e0 con 0x7f58d80b0a70 2023-12-19T05:40:09.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.917+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d814f4d0 con 0x7f58d80b0a70 2023-12-19T05:40:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.918+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d8061910 con 0x7f58d80b0a70 2023-12-19T05:40:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.919+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58c00129d0 con 0x7f58d80b0a70 2023-12-19T05:40:09.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.920+0000 7f58cf7fe640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 0x7f58b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.920+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f58c0088250 con 0x7f58d80b0a70 2023-12-19T05:40:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.921+0000 7f58d67fc640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 0x7f58b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.922+0000 7f58d67fc640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 0x7f58b806c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58d8070030 tx=0x7f58c8001c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:09.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:09.924+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f58c00538e0 con 0x7f58d80b0a70 2023-12-19T05:40:10.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.126+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58d80ccec0 con 0x7f58d80b0a70 2023-12-19T05:40:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.646+0000 7f58cf7fe640 1 -- 172.21.15.49:0/2872725385 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f58d80ccec0 con 0x7f58d80b0a70 2023-12-19T05:40:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:40:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.651+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 msgr2=0x7f58b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.651+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 0x7f58b806c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58d8070030 tx=0x7f58c8001c00 comp rx=0 tx=0).stop 2023-12-19T05:40:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.651+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 msgr2=0x7f58d814ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.651+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c450 tx=0x7f58c000c910 comp rx=0 tx=0).stop 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 shutdown_connections 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f58b806a430 0x7f58b806c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58d815b000 0x7f58d81e8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58d8157970 0x7f58d81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 --2- 172.21.15.49:0/2872725385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d80b0a70 0x7f58d814ef90 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c450 tx=0x7f58c000c910 comp rx=0 tx=0).stop 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 >> 172.21.15.49:0/2872725385 conn(0x7f58d80659a0 msgr2=0x7f58d8156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.652+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 shutdown_connections 2023-12-19T05:40:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.653+0000 7f58d7fff640 1 -- 172.21.15.49:0/2872725385 wait complete. 2023-12-19T05:40:10.677 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:40:10.677 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:40:10.678 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:40:10.678 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:10.678 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:40:10.678 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:40:10.678 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:40:10.678 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:10.678 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:40:10.678 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:40:10.679 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:40:10.679 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:10.679 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:40:10.679 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:40:10.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:40:10.679 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:10.696 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:40:10.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:40:10.698 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:40:10.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:40:10.699 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:40:10.699 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:40:10.701 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:40:10.702 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:40:10.750 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:40:10.751 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:10.751 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:40:10.752 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:10.757 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:40:10.757 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:10.758 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:40:10.758 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:10.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:40:10.911 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:40:10.913 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:40:10.928 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:40:10.928 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:40:10.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.971+0000 7f17657ab640 1 Processor -- start 2023-12-19T05:40:10.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.971+0000 7f17657ab640 1 -- start start 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f17657ab640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17601449e0 0x7f17600af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f17657ab640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f176006c6b0 0x7f17600b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f17657ab640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600afb10 con 0x7f17600b0b50 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f17657ab640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176006bb30 con 0x7f17601449e0 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f17657ab640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600b0070 con 0x7f176006c6b0 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f175effd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17601449e0 0x7f17600af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f175effd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17601449e0 0x7f17600af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51468/0 (socket says 172.21.15.49:51468) 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f175effd640 1 -- 172.21.15.49:0/3065530239 learned_addr learned my addr 172.21.15.49:0/3065530239 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.973+0000 7f175f7fe640 1 --2- 172.21.15.49:0/3065530239 >> v2:172.21.15.115:3300/0 conn(0x7f176006c6b0 0x7f17600b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.974+0000 7f175effd640 1 -- 172.21.15.49:0/3065530239 >> v2:172.21.15.115:3300/0 conn(0x7f176006c6b0 msgr2=0x7f17600b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.974+0000 7f175effd640 1 --2- 172.21.15.49:0/3065530239 >> v2:172.21.15.115:3300/0 conn(0x7f176006c6b0 0x7f17600b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.974+0000 7f175effd640 1 -- 172.21.15.49:0/3065530239 >> v1:172.21.15.115:6789/0 conn(0x7f17600b0b50 legacy=0x7f176006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.974+0000 7f175effd640 1 -- 172.21.15.49:0/3065530239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600b0350 con 0x7f17601449e0 2023-12-19T05:40:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.975+0000 7f175effd640 1 --2- 172.21.15.49:0/3065530239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17600af5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f17600b1270 tx=0x7f175002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461741db296d68cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.975+0000 7f175e7fc640 1 -- 172.21.15.49:0/3065530239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750030860 con 0x7f17601449e0 2023-12-19T05:40:10.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.975+0000 7f175e7fc640 1 -- 172.21.15.49:0/3065530239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17500309c0 con 0x7f17601449e0 2023-12-19T05:40:10.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.975+0000 7f175e7fc640 1 -- 172.21.15.49:0/3065530239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750030d50 con 0x7f17601449e0 2023-12-19T05:40:10.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 -- 172.21.15.49:0/3065530239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 msgr2=0x7f17600af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 --2- 172.21.15.49:0/3065530239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17600af5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f17600b1270 tx=0x7f175002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 -- 172.21.15.49:0/3065530239 shutdown_connections 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 --2- 172.21.15.49:0/3065530239 >> v2:172.21.15.115:3300/0 conn(0x7f176006c6b0 0x7f17600b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 --2- 172.21.15.49:0/3065530239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17600af5d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 -- 172.21.15.49:0/3065530239 >> 172.21.15.49:0/3065530239 conn(0x7f17600cbb70 msgr2=0x7f17600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 -- 172.21.15.49:0/3065530239 shutdown_connections 2023-12-19T05:40:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.976+0000 7f17657ab640 1 -- 172.21.15.49:0/3065530239 wait complete. 2023-12-19T05:40:10.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.978+0000 7f17657ab640 1 Processor -- start 2023-12-19T05:40:10.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.978+0000 7f17657ab640 1 -- start start 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f176006c6b0 0x7f176012b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 0x7f176012dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176012e1b0 con 0x7f17601449e0 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176012b870 con 0x7f176006c6b0 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f17657ab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176012bb50 con 0x7f17600b0b50 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f175f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f175f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51482/0 (socket says 172.21.15.49:51482) 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.979+0000 7f175f7fe640 1 -- 172.21.15.49:0/3541146768 learned_addr learned my addr 172.21.15.49:0/3541146768 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175effd640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f176006c6b0 0x7f176012b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f1757fff640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 0x7f176012dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 -- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 msgr2=0x7f176012dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 0x7f176012dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 -- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f176006c6b0 msgr2=0x7f176012b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f176006c6b0 0x7f176012b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 -- 172.21.15.49:0/3541146768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500094d0 con 0x7f17601449e0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f1757fff640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 0x7f176012dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.980+0000 7f175f7fe640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1758007e40 tx=0x7f175800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.981+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758014620 con 0x7f17601449e0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.981+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800ee90 con 0x7f17601449e0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.981+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580149e0 con 0x7f17601449e0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.981+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176012be30 con 0x7f17601449e0 2023-12-19T05:40:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.981+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176012c3f0 con 0x7f17601449e0 2023-12-19T05:40:10.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.982+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760061910 con 0x7f17601449e0 2023-12-19T05:40:10.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.983+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1758014b40 con 0x7f17601449e0 2023-12-19T05:40:10.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.984+0000 7f17577fe640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:10.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.984+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1758088fd0 con 0x7f17601449e0 2023-12-19T05:40:10.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.984+0000 7f175effd640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:10.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.985+0000 7f175effd640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 0x7f174006c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1750036000 tx=0x7f1750008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:10.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:10.989+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1758054820 con 0x7f17601449e0 2023-12-19T05:40:11.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:11.197+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f17600b2790 con 0x7f17601449e0 2023-12-19T05:40:12.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.186+0000 7f17577fe640 1 -- 172.21.15.49:0/3541146768 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1758057e40 con 0x7f17601449e0 2023-12-19T05:40:12.188 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:40:12.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 msgr2=0x7f174006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 0x7f174006c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1750036000 tx=0x7f1750008030 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 msgr2=0x7f17601f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1758007e40 tx=0x7f175800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 shutdown_connections 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17600b0b50 0x7f176012dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17601449e0 0x7f17601f02a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 --2- 172.21.15.49:0/3541146768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f176006c6b0 0x7f176012b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 >> 172.21.15.49:0/3541146768 conn(0x7f17600cbb70 msgr2=0x7f17600af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 shutdown_connections 2023-12-19T05:40:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.190+0000 7f17657ab640 1 -- 172.21.15.49:0/3541146768 wait complete. 2023-12-19T05:40:12.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:40:12.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.452+0000 7ff306eb2640 1 Processor -- start 2023-12-19T05:40:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.452+0000 7ff306eb2640 1 -- start start 2023-12-19T05:40:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.454+0000 7ff306eb2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.454+0000 7ff306eb2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3000d2b00 0x7ff3000b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.454+0000 7ff306eb2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3000cd840 con 0x7ff3000ce110 2023-12-19T05:40:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.454+0000 7ff306eb2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3000d2430 con 0x7ff3000d2b00 2023-12-19T05:40:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.454+0000 7ff306eb2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000d2620 con 0x7ff300146e10 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3000d2b00 0x7ff3000b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3000d2b00 0x7ff3000b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51494/0 (socket says 172.21.15.49:51494) 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 -- 172.21.15.49:0/1549038740 learned_addr learned my addr 172.21.15.49:0/1549038740 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff304c4e640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 -- 172.21.15.49:0/1549038740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 msgr2=0x7ff3000d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 -- 172.21.15.49:0/1549038740 >> v1:172.21.15.115:6789/0 conn(0x7ff3000ce110 legacy=0x7ff3000b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.455+0000 7ff2fffff640 1 -- 172.21.15.49:0/1549038740 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000b41c0 con 0x7ff3000d2b00 2023-12-19T05:40:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.457+0000 7ff2fffff640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000d2b00 0x7ff3000b6780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64942ff6e762b02a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.457+0000 7ff2ff7fe640 1 -- 172.21.15.49:0/1549038740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec031640 con 0x7ff3000d2b00 2023-12-19T05:40:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.457+0000 7ff2ff7fe640 1 -- 172.21.15.49:0/1549038740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0317a0 con 0x7ff3000d2b00 2023-12-19T05:40:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.457+0000 7ff2ff7fe640 1 -- 172.21.15.49:0/1549038740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec031b30 con 0x7ff3000d2b00 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 -- 172.21.15.49:0/1549038740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000d2b00 msgr2=0x7ff3000b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000d2b00 0x7ff3000b6780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 -- 172.21.15.49:0/1549038740 shutdown_connections 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000d2b00 0x7ff3000b6780 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 --2- 172.21.15.49:0/1549038740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 -- 172.21.15.49:0/1549038740 >> 172.21.15.49:0/1549038740 conn(0x7ff3000b29c0 msgr2=0x7ff3000b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 -- 172.21.15.49:0/1549038740 shutdown_connections 2023-12-19T05:40:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.458+0000 7ff306eb2640 1 -- 172.21.15.49:0/1549038740 wait complete. 2023-12-19T05:40:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.460+0000 7ff306eb2640 1 Processor -- start 2023-12-19T05:40:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.460+0000 7ff306eb2640 1 -- start start 2023-12-19T05:40:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3000d2b00 0x7ff300140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300134190 con 0x7ff3000ce110 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300134670 con 0x7ff3000d2b00 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff306eb2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3001f62a0 con 0x7ff300146e10 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff304c4e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff304c4e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51498/0 (socket says 172.21.15.49:51498) 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff304c4e640 1 -- 172.21.15.49:0/2056481981 learned_addr learned my addr 172.21.15.49:0/2056481981 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.461+0000 7ff2fffff640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3000d2b00 0x7ff300140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff30544f640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 -- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 msgr2=0x7ff3000d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 -- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3000d2b00 msgr2=0x7ff300140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3000d2b00 0x7ff300140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 -- 172.21.15.49:0/2056481981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0094d0 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff30544f640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff304c4e640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d5f0 tx=0x7ff2f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40125f0 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4012750 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4012b00 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.462+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3001f6580 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.463+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3001f6b40 con 0x7ff3000ce110 2023-12-19T05:40:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.464+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff300061910 con 0x7ff3000ce110 2023-12-19T05:40:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.465+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2f4012c60 con 0x7ff3000ce110 2023-12-19T05:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.466+0000 7ff2fd7fa640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 0x7ff2e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.466+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2f4088a20 con 0x7ff3000ce110 2023-12-19T05:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.467+0000 7ff2fffff640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 0x7ff2e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.468+0000 7ff2fffff640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 0x7ff2e406c920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec036000 tx=0x7ff2ec03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.471+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2f4054350 con 0x7ff3000ce110 2023-12-19T05:40:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.735+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff3000b6360 con 0x7ff3000ce110 2023-12-19T05:40:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.737+0000 7ff2fd7fa640 1 -- 172.21.15.49:0/2056481981 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff2f4057970 con 0x7ff3000ce110 2023-12-19T05:40:12.738 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:12.738 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:40:12.739 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:40:12.741 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:40:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:12.746 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.747 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2023-12-19T05:40:12.749 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFllMpvFxAAQTOQgKboK52etKdjlwDipQ==", 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFl1QBwFxAA91ya7u2iL/A+/3utjD1IZg==", 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFlJTJwFxAAff7zriaoA5u3DNrCeXiokw==", 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.750 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFlqV9wFxAAzMWr7e36lYikXv3OqKgjRQ==", 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFlDo5wFxAAhqJT4VT1LhN2wpqWfB7wFg==", 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.751 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBlLIFlO75wFxAA6kKODRuFHnPVipfGkCSAWg==", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:12.752 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:40:12.753 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 msgr2=0x7ff2e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 0x7ff2e406c920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec036000 tx=0x7ff2ec03c040 comp rx=0 tx=0).stop 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 msgr2=0x7ff300133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d5f0 tx=0x7ff2f400dab0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 shutdown_connections 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff2e406a460 0x7ff2e406c920 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff300146e10 0x7ff3000d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3000d2b00 0x7ff300140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 --2- 172.21.15.49:0/2056481981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3000ce110 0x7ff300133c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 >> 172.21.15.49:0/2056481981 conn(0x7ff3000b29c0 msgr2=0x7ff30013fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:12.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 shutdown_connections 2023-12-19T05:40:12.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.740+0000 7ff306eb2640 1 -- 172.21.15.49:0/2056481981 wait complete. 2023-12-19T05:40:12.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T05:40:12.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.979+0000 7f2385316640 1 Processor -- start 2023-12-19T05:40:12.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.979+0000 7f2385316640 1 -- start start 2023-12-19T05:40:12.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2385316640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f238006c6b0 0x7f2380166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2385316640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238006bb30 con 0x7f23800b0b50 2023-12-19T05:40:12.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2385316640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23800b0070 con 0x7f23801449e0 2023-12-19T05:40:12.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2385316640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23800b0350 con 0x7f238006c6b0 2023-12-19T05:40:12.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2377fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f23800b0b50 0x7f238006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46454/0 (socket says 172.21.15.49:46454) 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f2377fff640 1 -- 172.21.15.49:0/2690288294 learned_addr learned my addr 172.21.15.49:0/2690288294 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.981+0000 7f237f7fe640 1 --2- 172.21.15.49:0/2690288294 >> v2:172.21.15.49:3300/0 conn(0x7f238006c6b0 0x7f2380166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.982+0000 7f237e7fc640 1 -- 172.21.15.49:0/2690288294 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887151074 0 0) 0x7f238006bb30 con 0x7f23800b0b50 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.982+0000 7f237e7fc640 1 -- 172.21.15.49:0/2690288294 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f236c003520 con 0x7f23800b0b50 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.982+0000 7f237f7fe640 1 -- 172.21.15.49:0/2690288294 >> v1:172.21.15.115:6789/0 conn(0x7f23801449e0 legacy=0x7f23800af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.982+0000 7f237f7fe640 1 -- 172.21.15.49:0/2690288294 >> v1:172.21.15.49:6789/0 conn(0x7f23800b0b50 legacy=0x7f238006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.982+0000 7f237f7fe640 1 -- 172.21.15.49:0/2690288294 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800b0630 con 0x7f238006c6b0 2023-12-19T05:40:12.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.983+0000 7f237f7fe640 1 --2- 172.21.15.49:0/2690288294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f2380166200 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2378009d90 tx=0x7f237802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757e317589cb2d3a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.983+0000 7f237e7fc640 1 -- 172.21.15.49:0/2690288294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237802cd00 con 0x7f238006c6b0 2023-12-19T05:40:12.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.983+0000 7f237e7fc640 1 -- 172.21.15.49:0/2690288294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237802ce60 con 0x7f238006c6b0 2023-12-19T05:40:12.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.983+0000 7f237e7fc640 1 -- 172.21.15.49:0/2690288294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378034660 con 0x7f238006c6b0 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 -- 172.21.15.49:0/2690288294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 msgr2=0x7f2380166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 --2- 172.21.15.49:0/2690288294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f2380166200 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2378009d90 tx=0x7f237802bf50 comp rx=0 tx=0).stop 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 -- 172.21.15.49:0/2690288294 shutdown_connections 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 --2- 172.21.15.49:0/2690288294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f2380166200 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 -- 172.21.15.49:0/2690288294 >> 172.21.15.49:0/2690288294 conn(0x7f23800cbb70 msgr2=0x7f23800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 -- 172.21.15.49:0/2690288294 shutdown_connections 2023-12-19T05:40:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.984+0000 7f2385316640 1 -- 172.21.15.49:0/2690288294 wait complete. 2023-12-19T05:40:12.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.986+0000 7f2385316640 1 Processor -- start 2023-12-19T05:40:12.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.986+0000 7f2385316640 1 -- start start 2023-12-19T05:40:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 0x7f238013ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 0x7f23801f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238013ebf0 con 0x7f238006c6b0 2023-12-19T05:40:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238013d550 con 0x7f23801449e0 2023-12-19T05:40:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2385316640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238015a560 con 0x7f23800b0b50 2023-12-19T05:40:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51514/0 (socket says 172.21.15.49:51514) 2023-12-19T05:40:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237effd640 1 -- 172.21.15.49:0/1924486852 learned_addr learned my addr 172.21.15.49:0/1924486852 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f2377fff640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 0x7f238013ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237f7fe640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 0x7f23801f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237effd640 1 -- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 msgr2=0x7f238013ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.987+0000 7f237effd640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 0x7f238013ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f237effd640 1 -- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 msgr2=0x7f23801f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f237effd640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 0x7f23801f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f237effd640 1 -- 172.21.15.49:0/1924486852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378009a70 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f2377fff640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 0x7f238013ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f237f7fe640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 0x7f23801f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f237effd640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f237000c400 tx=0x7f237000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700052d0 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370005430 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370003830 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238013d270 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.988+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238015bc00 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.989+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2380061910 con 0x7f238006c6b0 2023-12-19T05:40:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.991+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2370003990 con 0x7f238006c6b0 2023-12-19T05:40:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.991+0000 7f23777fe640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 0x7f236006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.992+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2370087c10 con 0x7f238006c6b0 2023-12-19T05:40:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.992+0000 7f2377fff640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 0x7f236006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.993+0000 7f2377fff640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 0x7f236006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23800afc70 tx=0x7f2368009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:12.996+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23700534b0 con 0x7f238006c6b0 2023-12-19T05:40:13.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.263+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f23800ae560 con 0x7f238006c6b0 2023-12-19T05:40:13.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.272+0000 7f23777fe640 1 -- 172.21.15.49:0/1924486852 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2370056ad0 con 0x7f238006c6b0 2023-12-19T05:40:13.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 msgr2=0x7f236006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 0x7f236006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23800afc70 tx=0x7f2368009040 comp rx=0 tx=0).stop 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 msgr2=0x7f238013c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f237000c400 tx=0x7f237000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 shutdown_connections 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f236006a430 0x7f236006c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23800b0b50 0x7f238013ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23801449e0 0x7f23801f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 --2- 172.21.15.49:0/1924486852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f238006c6b0 0x7f238013c4f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 >> 172.21.15.49:0/1924486852 conn(0x7f23800cbb70 msgr2=0x7f23800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 shutdown_connections 2023-12-19T05:40:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.275+0000 7f2385316640 1 -- 172.21.15.49:0/1924486852 wait complete. 2023-12-19T05:40:13.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T05:40:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.532+0000 7f8420bc1640 1 Processor -- start 2023-12-19T05:40:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.532+0000 7f8420bc1640 1 -- start start 2023-12-19T05:40:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f8420bc1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f841c0b2030 0x7f841c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f8420bc1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f841c0cdbf0 0x7f841c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f8420bc1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c15ec30 con 0x7f841c15e5a0 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f8420bc1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c15fbc0 con 0x7f841c0cdbf0 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f8420bc1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0ce560 con 0x7f841c0b2030 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f841bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f841c0cdbf0 0x7f841c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f841b7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f841c15e5a0 0x7f841c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46462/0 (socket says 172.21.15.49:46462) 2023-12-19T05:40:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.533+0000 7f841b7fe640 1 -- 172.21.15.49:0/2946034661 learned_addr learned my addr 172.21.15.49:0/2946034661 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841affd640 1 --2- 172.21.15.49:0/2946034661 >> v2:172.21.15.115:3300/0 conn(0x7f841c0b2030 0x7f841c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841bfff640 1 -- 172.21.15.49:0/2946034661 >> v2:172.21.15.115:3300/0 conn(0x7f841c0b2030 msgr2=0x7f841c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841bfff640 1 --2- 172.21.15.49:0/2946034661 >> v2:172.21.15.115:3300/0 conn(0x7f841c0b2030 0x7f841c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841bfff640 1 -- 172.21.15.49:0/2946034661 >> v1:172.21.15.49:6789/0 conn(0x7f841c15e5a0 legacy=0x7f841c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841bfff640 1 -- 172.21.15.49:0/2946034661 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c15e980 con 0x7f841c0cdbf0 2023-12-19T05:40:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.534+0000 7f841a7fc640 1 -- 172.21.15.49:0/2946034661 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440242731 0 0) 0x7f841c15ec30 con 0x7f841c15e5a0 2023-12-19T05:40:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.535+0000 7f841bfff640 1 --2- 172.21.15.49:0/2946034661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cdbf0 0x7f841c0ce020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f84140097a0 tx=0x7f841402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3031dc897244d0fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.535+0000 7f841a7fc640 1 -- 172.21.15.49:0/2946034661 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414031830 con 0x7f841c0cdbf0 2023-12-19T05:40:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f841a7fc640 1 -- 172.21.15.49:0/2946034661 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414031990 con 0x7f841c0cdbf0 2023-12-19T05:40:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f841a7fc640 1 -- 172.21.15.49:0/2946034661 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414031d20 con 0x7f841c0cdbf0 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 -- 172.21.15.49:0/2946034661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cdbf0 msgr2=0x7f841c0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 --2- 172.21.15.49:0/2946034661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cdbf0 0x7f841c0ce020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f84140097a0 tx=0x7f841402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 -- 172.21.15.49:0/2946034661 shutdown_connections 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 --2- 172.21.15.49:0/2946034661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cdbf0 0x7f841c0ce020 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 --2- 172.21.15.49:0/2946034661 >> v2:172.21.15.115:3300/0 conn(0x7f841c0b2030 0x7f841c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 -- 172.21.15.49:0/2946034661 >> 172.21.15.49:0/2946034661 conn(0x7f841c0b0100 msgr2=0x7f841c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 -- 172.21.15.49:0/2946034661 shutdown_connections 2023-12-19T05:40:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.536+0000 7f8420bc1640 1 -- 172.21.15.49:0/2946034661 wait complete. 2023-12-19T05:40:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.538+0000 7f8420bc1640 1 Processor -- start 2023-12-19T05:40:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.538+0000 7f8420bc1640 1 -- start start 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 0x7f841c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c0cdbf0 0x7f841c0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0c9d70 con 0x7f841c15e5a0 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0ca050 con 0x7f841c0b2030 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.539+0000 7f8420bc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0ca330 con 0x7f841c0cdbf0 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51532/0 (socket says 172.21.15.49:51532) 2023-12-19T05:40:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 -- 172.21.15.49:0/4055653129 learned_addr learned my addr 172.21.15.49:0/4055653129 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841b7fe640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 0x7f841c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841affd640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c0cdbf0 0x7f841c0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 -- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c0cdbf0 msgr2=0x7f841c0a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c0cdbf0 0x7f841c0a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 -- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 msgr2=0x7f841c0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 0x7f841c0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841bfff640 1 -- 172.21.15.49:0/4055653129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009400 con 0x7f841c15e5a0 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.540+0000 7f841b7fe640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 0x7f841c0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f841bfff640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84140098c0 tx=0x7f84140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84140317d0 con 0x7f841c15e5a0 2023-12-19T05:40:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841403b9f0 con 0x7f841c15e5a0 2023-12-19T05:40:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841403bda0 con 0x7f841c15e5a0 2023-12-19T05:40:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c0ca610 con 0x7f841c15e5a0 2023-12-19T05:40:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.541+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c0cce00 con 0x7f841c15e5a0 2023-12-19T05:40:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.543+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c061910 con 0x7f841c15e5a0 2023-12-19T05:40:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.544+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84140453f0 con 0x7f841c15e5a0 2023-12-19T05:40:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.544+0000 7f8403fff640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.545+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84140aa8d0 con 0x7f841c15e5a0 2023-12-19T05:40:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.545+0000 7f841b7fe640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.546+0000 7f841b7fe640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 0x7f840806c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f840c007fd0 tx=0x7f840c005b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.549+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8414076320 con 0x7f841c15e5a0 2023-12-19T05:40:13.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.815+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f841c0c9eb0 con 0x7f841c15e5a0 2023-12-19T05:40:13.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.825+0000 7f8403fff640 1 -- 172.21.15.49:0/4055653129 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f841c0c9eb0 con 0x7f841c15e5a0 2023-12-19T05:40:13.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 msgr2=0x7f840806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 0x7f840806c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f840c007fd0 tx=0x7f840c005b70 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 msgr2=0x7f841c155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84140098c0 tx=0x7f84140046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 shutdown_connections 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c0cdbf0 0x7f841c0a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c15e5a0 0x7f841c155d90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 --2- 172.21.15.49:0/4055653129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c0b2030 0x7f841c0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 >> 172.21.15.49:0/4055653129 conn(0x7f841c0b0100 msgr2=0x7f841c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 shutdown_connections 2023-12-19T05:40:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:13.828+0000 7f8420bc1640 1 -- 172.21.15.49:0/4055653129 wait complete. 2023-12-19T05:40:13.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T05:40:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.071+0000 7feb14a07640 1 Processor -- start 2023-12-19T05:40:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.072+0000 7feb14a07640 1 -- start start 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.073+0000 7feb14a07640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb1015aa70 0x7feb10164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb14a07640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1006b520 con 0x7feb10159f80 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb14a07640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb100b2b20 con 0x7feb1015b1e0 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb14a07640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100b2fb0 con 0x7feb1015aa70 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb10159f80 0x7feb1006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39110/0 (socket says 172.21.15.49:39110) 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0f7fe640 1 -- 172.21.15.49:0/4284842421 learned_addr learned my addr 172.21.15.49:0/4284842421 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0ffff640 1 --2- 172.21.15.49:0/4284842421 >> v2:172.21.15.49:3300/0 conn(0x7feb1015aa70 0x7feb10164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0ffff640 1 -- 172.21.15.49:0/4284842421 >> v1:172.21.15.115:6789/0 conn(0x7feb1015b1e0 legacy=0x7feb1015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0ffff640 1 -- 172.21.15.49:0/4284842421 >> v1:172.21.15.49:6789/0 conn(0x7feb10159f80 legacy=0x7feb1006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0effd640 1 -- 172.21.15.49:0/4284842421 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744856284 0 0) 0x7feb1006b520 con 0x7feb10159f80 2023-12-19T05:40:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.074+0000 7feb0ffff640 1 -- 172.21.15.49:0/4284842421 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100b1f10 con 0x7feb1015aa70 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb0ffff640 1 --2- 172.21.15.49:0/4284842421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb1015aa70 0x7feb10164f30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb08009d90 tx=0x7feb0802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d07e42b6e0ca3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb0effd640 1 -- 172.21.15.49:0/4284842421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08036440 con 0x7feb1015aa70 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb0effd640 1 -- 172.21.15.49:0/4284842421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080365a0 con 0x7feb1015aa70 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb0effd640 1 -- 172.21.15.49:0/4284842421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08036930 con 0x7feb1015aa70 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb14a07640 1 -- 172.21.15.49:0/4284842421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb1015aa70 msgr2=0x7feb10164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.076+0000 7feb14a07640 1 --2- 172.21.15.49:0/4284842421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb1015aa70 0x7feb10164f30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb08009d90 tx=0x7feb0802e160 comp rx=0 tx=0).stop 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.077+0000 7feb14a07640 1 -- 172.21.15.49:0/4284842421 shutdown_connections 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.077+0000 7feb14a07640 1 --2- 172.21.15.49:0/4284842421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb1015aa70 0x7feb10164f30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.077+0000 7feb14a07640 1 -- 172.21.15.49:0/4284842421 >> 172.21.15.49:0/4284842421 conn(0x7feb100b0100 msgr2=0x7feb100b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.077+0000 7feb14a07640 1 -- 172.21.15.49:0/4284842421 shutdown_connections 2023-12-19T05:40:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.077+0000 7feb14a07640 1 -- 172.21.15.49:0/4284842421 wait complete. 2023-12-19T05:40:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.078+0000 7feb14a07640 1 Processor -- start 2023-12-19T05:40:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.079+0000 7feb14a07640 1 -- start start 2023-12-19T05:40:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.079+0000 7feb14a07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb14a07640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 0x7feb101517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb14a07640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb1015b1e0 0x7feb1014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb14a07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb101f3e50 con 0x7feb10159f80 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb14a07640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb101f41e0 con 0x7feb1015aa70 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb14a07640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb101f3360 con 0x7feb1015b1e0 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60338/0 (socket says 172.21.15.49:60338) 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 -- 172.21.15.49:0/1734812971 learned_addr learned my addr 172.21.15.49:0/1734812971 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb07fff640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 0x7feb101517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 -- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb1015b1e0 msgr2=0x7feb1014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0ffff640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb1015b1e0 0x7feb1014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb1015b1e0 0x7feb1014ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 -- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 msgr2=0x7feb101517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 0x7feb101517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb0f7fe640 1 -- 172.21.15.49:0/1734812971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009a70 con 0x7feb10159f80 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.080+0000 7feb07fff640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 0x7feb101517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb0f7fe640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c500 tx=0x7feb0000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00007560 con 0x7feb10159f80 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb000047e0 con 0x7feb10159f80 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00004b90 con 0x7feb10159f80 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb10151d30 con 0x7feb10159f80 2023-12-19T05:40:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.081+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb101f3890 con 0x7feb10159f80 2023-12-19T05:40:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.082+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb10061910 con 0x7feb10159f80 2023-12-19T05:40:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.083+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb00004cf0 con 0x7feb10159f80 2023-12-19T05:40:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.084+0000 7feb0cff9640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 0x7feaf006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.085+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb00087780 con 0x7feb10159f80 2023-12-19T05:40:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.085+0000 7feb07fff640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 0x7feaf006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.086+0000 7feb07fff640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 0x7feaf006c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb10154e80 tx=0x7feaf8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.089+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb000530b0 con 0x7feb10159f80 2023-12-19T05:40:14.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.355+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7feb100cb530 con 0x7feb10159f80 2023-12-19T05:40:14.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.363+0000 7feb0cff9640 1 -- 172.21.15.49:0/1734812971 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7feb000180a0 con 0x7feb10159f80 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 msgr2=0x7feaf006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 0x7feaf006c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb10154e80 tx=0x7feaf8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 msgr2=0x7feb101f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c500 tx=0x7feb0000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 shutdown_connections 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaf006a460 0x7feaf006c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb1015b1e0 0x7feb1014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb1015aa70 0x7feb101517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 --2- 172.21.15.49:0/1734812971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb10159f80 0x7feb101f2e20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.365+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 >> 172.21.15.49:0/1734812971 conn(0x7feb100b0100 msgr2=0x7feb100b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:14.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.366+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 shutdown_connections 2023-12-19T05:40:14.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.366+0000 7feb14a07640 1 -- 172.21.15.49:0/1734812971 wait complete. 2023-12-19T05:40:14.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T05:40:14.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.618+0000 7fa398fa2640 1 Processor -- start 2023-12-19T05:40:14.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.619+0000 7fa398fa2640 1 -- start start 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.620+0000 7fa398fa2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa3940b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.620+0000 7fa398fa2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3940cdbf0 0x7fa3940ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.620+0000 7fa398fa2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39415ec30 con 0x7fa39415f680 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.620+0000 7fa398fa2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940ce5c0 con 0x7fa3940cdbf0 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.620+0000 7fa398fa2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39415e980 con 0x7fa39415e5a0 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3940cdbf0 0x7fa3940ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3940cdbf0 0x7fa3940ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60342/0 (socket says 172.21.15.49:60342) 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 -- 172.21.15.49:0/63880659 learned_addr learned my addr 172.21.15.49:0/63880659 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa3937fe640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa3940b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 -- 172.21.15.49:0/63880659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 msgr2=0x7fa3940b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa3940b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 -- 172.21.15.49:0/63880659 >> v1:172.21.15.49:6789/0 conn(0x7fa39415f680 legacy=0x7fa3940b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.621+0000 7fa393fff640 1 -- 172.21.15.49:0/63880659 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940b2f90 con 0x7fa3940cdbf0 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.622+0000 7fa393fff640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa3940ce080 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e50 tx=0x7fa38c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a25e6ddf418b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.623+0000 7fa392ffd640 1 -- 172.21.15.49:0/63880659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c02cb00 con 0x7fa3940cdbf0 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.623+0000 7fa392ffd640 1 -- 172.21.15.49:0/63880659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c02cc60 con 0x7fa3940cdbf0 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.623+0000 7fa392ffd640 1 -- 172.21.15.49:0/63880659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0343f0 con 0x7fa3940cdbf0 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.623+0000 7fa398fa2640 1 -- 172.21.15.49:0/63880659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 msgr2=0x7fa3940ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.623+0000 7fa398fa2640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa3940ce080 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e50 tx=0x7fa38c02bf60 comp rx=0 tx=0).stop 2023-12-19T05:40:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 -- 172.21.15.49:0/63880659 shutdown_connections 2023-12-19T05:40:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa3940ce080 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 --2- 172.21.15.49:0/63880659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa3940b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 -- 172.21.15.49:0/63880659 >> 172.21.15.49:0/63880659 conn(0x7fa3940b0100 msgr2=0x7fa3940b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 -- 172.21.15.49:0/63880659 shutdown_connections 2023-12-19T05:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.624+0000 7fa398fa2640 1 -- 172.21.15.49:0/63880659 wait complete. 2023-12-19T05:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.626+0000 7fa398fa2640 1 Processor -- start 2023-12-19T05:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.626+0000 7fa398fa2640 1 -- start start 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa394159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa39415f680 0x7fa39415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39415b5c0 con 0x7fa3940cdbf0 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39415a9b0 con 0x7fa39415f680 2023-12-19T05:40:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa398fa2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39415ac90 con 0x7fa39415e5a0 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa3937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa3937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60346/0 (socket says 172.21.15.49:60346) 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.627+0000 7fa3937fe640 1 -- 172.21.15.49:0/365331488 learned_addr learned my addr 172.21.15.49:0/365331488 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa38bfff640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa394159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa393fff640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa39415f680 0x7fa39415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 -- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 msgr2=0x7fa394159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa394159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 -- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa39415f680 msgr2=0x7fa39415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa39415f680 0x7fa39415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 -- 172.21.15.49:0/365331488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c009b30 con 0x7fa3940cdbf0 2023-12-19T05:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa3937fe640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa38400d800 tx=0x7fa38400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.628+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400b6c0 con 0x7fa3940cdbf0 2023-12-19T05:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.629+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38400b820 con 0x7fa3940cdbf0 2023-12-19T05:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.629+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400bbb0 con 0x7fa3940cdbf0 2023-12-19T05:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.629+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39415af70 con 0x7fa3940cdbf0 2023-12-19T05:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.629+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3940ad780 con 0x7fa3940cdbf0 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.630+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa394061910 con 0x7fa3940cdbf0 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.631+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa38400bd10 con 0x7fa3940cdbf0 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.632+0000 7fa390ff9640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 0x7fa37406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.632+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa384088b60 con 0x7fa3940cdbf0 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.632+0000 7fa38bfff640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 0x7fa37406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.634+0000 7fa38bfff640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 0x7fa37406c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b0e40 tx=0x7fa37c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.636+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa384054410 con 0x7fa3940cdbf0 2023-12-19T05:40:14.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.901+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa3940afa90 con 0x7fa3940cdbf0 2023-12-19T05:40:14.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.910+0000 7fa390ff9640 1 -- 172.21.15.49:0/365331488 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa384057a30 con 0x7fa3940cdbf0 2023-12-19T05:40:14.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 msgr2=0x7fa37406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 0x7fa37406c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b0e40 tx=0x7fa37c009040 comp rx=0 tx=0).stop 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 msgr2=0x7fa394148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa38400d800 tx=0x7fa38400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 shutdown_connections 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa37406a430 0x7fa37406c8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa39415e5a0 0x7fa394159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa39415f680 0x7fa39415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 --2- 172.21.15.49:0/365331488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3940cdbf0 0x7fa394148f70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:14.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 >> 172.21.15.49:0/365331488 conn(0x7fa3940b0100 msgr2=0x7fa3940ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:14.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 shutdown_connections 2023-12-19T05:40:14.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:14.913+0000 7fa398fa2640 1 -- 172.21.15.49:0/365331488 wait complete. 2023-12-19T05:40:14.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T05:40:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.157+0000 7f9dee0ee640 1 Processor -- start 2023-12-19T05:40:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.158+0000 7f9dee0ee640 1 -- start start 2023-12-19T05:40:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.159+0000 7f9dee0ee640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9de8146da0 0x7f9de80aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.159+0000 7f9dee0ee640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9de80aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.159+0000 7f9dee0ee640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de80d1070 con 0x7f9de8147180 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.159+0000 7f9dee0ee640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de8162020 con 0x7f9de8146da0 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.159+0000 7f9dee0ee640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80aabd0 con 0x7f9de8161900 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de6ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9de8147180 0x7f9de81611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39124/0 (socket says 172.21.15.49:39124) 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de6ffd640 1 -- 172.21.15.49:0/2722335894 learned_addr learned my addr 172.21.15.49:0/2722335894 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2722335894 >> v2:172.21.15.115:3300/0 conn(0x7f9de8146da0 0x7f9de80aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9de80aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786963189 0 0) 0x7f9de80d1070 con 0x7f9de8147180 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.160+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd4003520 con 0x7f9de8147180 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208838806 0 0) 0x7f9dd4003520 con 0x7f9de8147180 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 msgr2=0x7f9de80aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9de80aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 >> v2:172.21.15.115:3300/0 conn(0x7f9de8146da0 msgr2=0x7f9de80aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 --2- 172.21.15.49:0/2722335894 >> v2:172.21.15.115:3300/0 conn(0x7f9de8146da0 0x7f9de80aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80aaeb0 con 0x7f9de8147180 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9dd0001670 con 0x7f9de8147180 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 >> v1:172.21.15.49:6789/0 conn(0x7f9de8147180 legacy=0x7f9de81611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9dd40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4003fb0 0x7f9dd40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4004d00 0x7f9dd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8162020 con 0x7f9dd4003fb0 2023-12-19T05:40:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80aabd0 con 0x7f9dd4004d00 2023-12-19T05:40:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd400ba00 con 0x7f9de8161900 2023-12-19T05:40:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de6ffd640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4003fb0 0x7f9dd40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4004d00 0x7f9dd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.161+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9dd40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de6ffd640 1 -- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 msgr2=0x7f9dd40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de6ffd640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9dd40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de6ffd640 1 -- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4004d00 msgr2=0x7f9dd4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de6ffd640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4004d00 0x7f9dd4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de6ffd640 1 -- 172.21.15.49:0/2722335894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4003520 con 0x7f9dd4003fb0 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4004d00 0x7f9dd4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.162+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8161900 0x7f9dd40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9de6ffd640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4003fb0 0x7f9dd40047c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c110 tx=0x7f9dd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cc456b5e94dc45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0005ad0 con 0x7f9dd4003fb0 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0005c50 con 0x7f9dd4003fb0 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9de67fc640 1 -- 172.21.15.49:0/2722335894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd002c830 con 0x7f9dd4003fb0 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2722335894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4003fb0 msgr2=0x7f9dd40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.163+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2722335894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4003fb0 0x7f9dd40047c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c110 tx=0x7f9dd40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.164+0000 7f9de7fff640 1 -- 172.21.15.49:0/2722335894 reap_dead start 2023-12-19T05:40:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.164+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2722335894 shutdown_connections 2023-12-19T05:40:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.164+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2722335894 >> 172.21.15.49:0/2722335894 conn(0x7f9de8071a50 msgr2=0x7f9de80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.164+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2722335894 shutdown_connections 2023-12-19T05:40:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.164+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2722335894 wait complete. 2023-12-19T05:40:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.166+0000 7f9dee0ee640 1 Processor -- start 2023-12-19T05:40:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.166+0000 7f9dee0ee640 1 -- start start 2023-12-19T05:40:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4003fb0 0x7f9de81f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8139e80 0x7f9de81f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80aee20 con 0x7f9de81f3e70 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de81f3c40 con 0x7f9dd4003fb0 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9dee0ee640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80ae210 con 0x7f9de8139e80 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60368/0 (socket says 172.21.15.49:60368) 2023-12-19T05:40:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9de7fff640 1 -- 172.21.15.49:0/2762850534 learned_addr learned my addr 172.21.15.49:0/2762850534 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4003fb0 0x7f9de81f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.167+0000 7f9de6ffd640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8139e80 0x7f9de81f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 -- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8139e80 msgr2=0x7f9de81f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8139e80 0x7f9de81f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 -- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4003fb0 msgr2=0x7f9de81f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4003fb0 0x7f9de81f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 -- 172.21.15.49:0/2762850534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80ae4f0 con 0x7f9de81f3e70 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9de7fff640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9de80d3390 tx=0x7f9de0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000e8a0 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000ea20 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000edd0 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.168+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de80ae7d0 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.169+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de81f42f0 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.170+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de8073ec0 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.171+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9de0020410 con 0x7f9de81f3e70 2023-12-19T05:40:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.171+0000 7f9ddffff640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 0x7f9dc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.172+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9de0087d60 con 0x7f9de81f3e70 2023-12-19T05:40:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.172+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 0x7f9dc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.173+0000 7f9de77fe640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 0x7f9dc806c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8003be0 tx=0x7f9dd800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.176+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9de0053740 con 0x7f9de81f3e70 2023-12-19T05:40:15.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.439+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9de80b0db0 con 0x7f9de81f3e70 2023-12-19T05:40:15.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.447+0000 7f9ddffff640 1 -- 172.21.15.49:0/2762850534 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9de0056d60 con 0x7f9de81f3e70 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.449+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 msgr2=0x7f9dc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 0x7f9dc806c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8003be0 tx=0x7f9dd800b040 comp rx=0 tx=0).stop 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 msgr2=0x7f9de813a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9de80d3390 tx=0x7f9de0010c20 comp rx=0 tx=0).stop 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 shutdown_connections 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9dc806a460 0x7f9dc806c920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9de8139e80 0x7f9de81f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9de81f3e70 0x7f9de813a510 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 --2- 172.21.15.49:0/2762850534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd4003fb0 0x7f9de81f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 >> 172.21.15.49:0/2762850534 conn(0x7f9de8071a50 msgr2=0x7f9de80d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:15.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 shutdown_connections 2023-12-19T05:40:15.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.450+0000 7f9dee0ee640 1 -- 172.21.15.49:0/2762850534 wait complete. 2023-12-19T05:40:15.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T05:40:15.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.703+0000 7fc6cec21640 1 Processor -- start 2023-12-19T05:40:15.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.703+0000 7fc6cec21640 1 -- start start 2023-12-19T05:40:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.704+0000 7fc6cec21640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6c80d2b00 0x7fc6c80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.704+0000 7fc6cec21640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c80ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.704+0000 7fc6cec21640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80cd840 con 0x7fc6c8146e10 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.704+0000 7fc6cec21640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80d2430 con 0x7fc6c80d2b00 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.704+0000 7fc6cec21640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80ceac0 con 0x7fc6c80ce110 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6c80d2b00 0x7fc6c80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6cc9bd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6c8146e10 0x7fc6c80b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39136/0 (socket says 172.21.15.49:39136) 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6cc9bd640 1 -- 172.21.15.49:0/591054486 learned_addr learned my addr 172.21.15.49:0/591054486 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c7fff640 1 -- 172.21.15.49:0/591054486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 msgr2=0x7fc6c80ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c7fff640 1 --2- 172.21.15.49:0/591054486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c80ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c7fff640 1 -- 172.21.15.49:0/591054486 >> v1:172.21.15.49:6789/0 conn(0x7fc6c8146e10 legacy=0x7fc6c80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c7fff640 1 -- 172.21.15.49:0/591054486 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80b6e90 con 0x7fc6c80d2b00 2023-12-19T05:40:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.705+0000 7fc6c77fe640 1 -- 172.21.15.49:0/591054486 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357652862 0 0) 0x7fc6c80cd840 con 0x7fc6c8146e10 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.706+0000 7fc6c7fff640 1 --2- 172.21.15.49:0/591054486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80d1ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00097d0 tx=0x7fc6b002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c544c53d374993 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6c77fe640 1 -- 172.21.15.49:0/591054486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0031800 con 0x7fc6c80d2b00 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6c77fe640 1 -- 172.21.15.49:0/591054486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0031960 con 0x7fc6c80d2b00 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6c77fe640 1 -- 172.21.15.49:0/591054486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0031cf0 con 0x7fc6c80d2b00 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 -- 172.21.15.49:0/591054486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c80d2b00 msgr2=0x7fc6c80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 --2- 172.21.15.49:0/591054486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80d1ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00097d0 tx=0x7fc6b002b8a0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 -- 172.21.15.49:0/591054486 shutdown_connections 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 --2- 172.21.15.49:0/591054486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c80ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 --2- 172.21.15.49:0/591054486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80d1ef0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.707+0000 7fc6cec21640 1 -- 172.21.15.49:0/591054486 >> 172.21.15.49:0/591054486 conn(0x7fc6c80b29c0 msgr2=0x7fc6c80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.708+0000 7fc6cec21640 1 -- 172.21.15.49:0/591054486 shutdown_connections 2023-12-19T05:40:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.708+0000 7fc6cec21640 1 -- 172.21.15.49:0/591054486 wait complete. 2023-12-19T05:40:15.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.709+0000 7fc6cec21640 1 Processor -- start 2023-12-19T05:40:15.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.709+0000 7fc6cec21640 1 -- start start 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80b7930 con 0x7fc6c8146e10 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8140c40 con 0x7fc6c80d2b00 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.710+0000 7fc6cec21640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c815e480 con 0x7fc6c80ce110 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60378/0 (socket says 172.21.15.49:60378) 2023-12-19T05:40:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 -- 172.21.15.49:0/1182883698 learned_addr learned my addr 172.21.15.49:0/1182883698 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6c7fff640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cc9bd640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 -- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 msgr2=0x7fc6c815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 -- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 msgr2=0x7fc6c80b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 -- 172.21.15.49:0/1182883698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009400 con 0x7fc6c8146e10 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6c7fff640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.711+0000 7fc6cd1be640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b440 tx=0x7fc6c000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.712+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011830 con 0x7fc6c8146e10 2023-12-19T05:40:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.712+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0011990 con 0x7fc6c8146e10 2023-12-19T05:40:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.712+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011d40 con 0x7fc6c8146e10 2023-12-19T05:40:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.712+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c815e760 con 0x7fc6c8146e10 2023-12-19T05:40:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.712+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81408d0 con 0x7fc6c8146e10 2023-12-19T05:40:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.713+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c8061910 con 0x7fc6c8146e10 2023-12-19T05:40:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.714+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6c001a400 con 0x7fc6c8146e10 2023-12-19T05:40:15.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.715+0000 7fc6c57fa640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 0x7fc6a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:15.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.716+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6c0088740 con 0x7fc6c8146e10 2023-12-19T05:40:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.716+0000 7fc6cc9bd640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 0x7fc6a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.717+0000 7fc6cc9bd640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 0x7fc6a806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80012e0 tx=0x7fc6b8007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.720+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6c0054070 con 0x7fc6c8146e10 2023-12-19T05:40:15.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:15.994+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc6c80b85e0 con 0x7fc6c8146e10 2023-12-19T05:40:16.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.003+0000 7fc6c57fa640 1 -- 172.21.15.49:0/1182883698 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc6c00150a0 con 0x7fc6c8146e10 2023-12-19T05:40:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.006+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 msgr2=0x7fc6a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.006+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 0x7fc6a806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80012e0 tx=0x7fc6b8007ef0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.006+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 msgr2=0x7fc6c81599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.006+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b440 tx=0x7fc6c000b900 comp rx=0 tx=0).stop 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 shutdown_connections 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc6a806a430 0x7fc6a806c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c8146e10 0x7fc6c81599d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6c80d2b00 0x7fc6c80b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 --2- 172.21.15.49:0/1182883698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6c80ce110 0x7fc6c815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 >> 172.21.15.49:0/1182883698 conn(0x7fc6c80b29c0 msgr2=0x7fc6c80b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 shutdown_connections 2023-12-19T05:40:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.007+0000 7fc6cec21640 1 -- 172.21.15.49:0/1182883698 wait complete. 2023-12-19T05:40:16.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:16.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.261+0000 7f1c63fff640 1 Processor -- start 2023-12-19T05:40:16.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.262+0000 7f1c63fff640 1 -- start start 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 0x7f1c640b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c6415f680 0x7f1c640b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c640cdbf0 0x7f1c640ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c640ce5a0 con 0x7f1c6415f680 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6415ec30 con 0x7f1c6415e5a0 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c63fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640b2cc0 con 0x7f1c640cdbf0 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c5a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c6415f680 0x7f1c640b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c5a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c6415f680 0x7f1c640b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60388/0 (socket says 172.21.15.49:60388) 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.264+0000 7f1c5a7fc640 1 -- 172.21.15.49:0/424713855 learned_addr learned my addr 172.21.15.49:0/424713855 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/424713855 >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 0x7f1c640b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c637fe640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c640cdbf0 0x7f1c640ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c5a7fc640 1 -- 172.21.15.49:0/424713855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c640cdbf0 msgr2=0x7f1c640ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c640cdbf0 0x7f1c640ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c5a7fc640 1 -- 172.21.15.49:0/424713855 >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 msgr2=0x7f1c640b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/424713855 >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 0x7f1c640b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c5a7fc640 1 -- 172.21.15.49:0/424713855 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6415e980 con 0x7f1c6415f680 2023-12-19T05:40:16.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.265+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/424713855 >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 0x7f1c640b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:16.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.266+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6415f680 0x7f1c640b2780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009870 tx=0x7f1c4c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf0270e376b8a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.266+0000 7f1c627fc640 1 -- 172.21.15.49:0/424713855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c031640 con 0x7f1c6415f680 2023-12-19T05:40:16.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c627fc640 1 -- 172.21.15.49:0/424713855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c0317a0 con 0x7f1c6415f680 2023-12-19T05:40:16.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c627fc640 1 -- 172.21.15.49:0/424713855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c031b30 con 0x7f1c6415f680 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 -- 172.21.15.49:0/424713855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6415f680 msgr2=0x7f1c640b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6415f680 0x7f1c640b2780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009870 tx=0x7f1c4c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 -- 172.21.15.49:0/424713855 shutdown_connections 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c640cdbf0 0x7f1c640ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 --2- 172.21.15.49:0/424713855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6415f680 0x7f1c640b2780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 --2- 172.21.15.49:0/424713855 >> v2:172.21.15.115:3300/0 conn(0x7f1c6415e5a0 0x7f1c640b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 -- 172.21.15.49:0/424713855 >> 172.21.15.49:0/424713855 conn(0x7f1c640b0100 msgr2=0x7f1c640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.267+0000 7f1c63fff640 1 -- 172.21.15.49:0/424713855 shutdown_connections 2023-12-19T05:40:16.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.268+0000 7f1c63fff640 1 -- 172.21.15.49:0/424713855 wait complete. 2023-12-19T05:40:16.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.269+0000 7f1c63fff640 1 Processor -- start 2023-12-19T05:40:16.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.269+0000 7f1c63fff640 1 -- start start 2023-12-19T05:40:16.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 0x7f1c64147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6415f680 0x7f1c64157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64148d50 con 0x7f1c640cdbf0 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641480d0 con 0x7f1c6415e5a0 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.270+0000 7f1c63fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641483b0 con 0x7f1c6415f680 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60390/0 (socket says 172.21.15.49:60390) 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 -- 172.21.15.49:0/1437729822 learned_addr learned my addr 172.21.15.49:0/1437729822 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 0x7f1c64147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 -- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6415f680 msgr2=0x7f1c64157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c637fe640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6415f680 0x7f1c64157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6415f680 0x7f1c64157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 -- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 msgr2=0x7f1c64147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 0x7f1c64147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c62ffd640 1 -- 172.21.15.49:0/1437729822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0094d0 con 0x7f1c640cdbf0 2023-12-19T05:40:16.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.271+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 0x7f1c64147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:16.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fc0 tx=0x7f1c5400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54003b90 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400f040 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54004030 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64148690 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.272+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640adb20 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.273+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c64148fc0 con 0x7f1c640cdbf0 2023-12-19T05:40:16.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.274+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c54004190 con 0x7f1c640cdbf0 2023-12-19T05:40:16.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.275+0000 7f1c5bfff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.275+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c54088a00 con 0x7f1c640cdbf0 2023-12-19T05:40:16.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.276+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.277+0000 7f1c5a7fc640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 0x7f1c4406c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c036000 tx=0x7f1c4c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.279+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c54054350 con 0x7f1c640cdbf0 2023-12-19T05:40:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.476+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c64061910 con 0x7f1c640cdbf0 2023-12-19T05:40:16.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.478+0000 7f1c5bfff640 1 -- 172.21.15.49:0/1437729822 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f1c5401a020 con 0x7f1c640cdbf0 2023-12-19T05:40:16.480 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:16.480 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:12.179666+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 msgr2=0x7f1c4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 0x7f1c4406c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c036000 tx=0x7f1c4c03c040 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 msgr2=0x7f1c641f2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fc0 tx=0x7f1c5400d560 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 shutdown_connections 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c4406a430 0x7f1c4406c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6415f680 0x7f1c64157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6415e5a0 0x7f1c64147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 --2- 172.21.15.49:0/1437729822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c640cdbf0 0x7f1c641f2260 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.481+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 >> 172.21.15.49:0/1437729822 conn(0x7f1c640b0100 msgr2=0x7f1c6406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:16.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.482+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 shutdown_connections 2023-12-19T05:40:16.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.482+0000 7f1c63fff640 1 -- 172.21.15.49:0/1437729822 wait complete. 2023-12-19T05:40:16.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:16.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.741+0000 7f0d0d6db640 1 Processor -- start 2023-12-19T05:40:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.741+0000 7f0d0d6db640 1 -- start start 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.743+0000 7f0d0d6db640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0d080cc9c0 0x7f0d080b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.743+0000 7f0d0d6db640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080cc530 con 0x7f0d08161700 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.743+0000 7f0d0d6db640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080cb920 con 0x7f0d080ce230 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.743+0000 7f0d0d6db640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d08166300 con 0x7f0d080cc9c0 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d067fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0d080cc9c0 0x7f0d080b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d06ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0d08161700 0x7f0d080b1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39144/0 (socket says 172.21.15.49:39144) 2023-12-19T05:40:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d06ffd640 1 -- 172.21.15.49:0/2768221763 learned_addr learned my addr 172.21.15.49:0/2768221763 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:16.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d05ffb640 1 -- 172.21.15.49:0/2768221763 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587075643 0 0) 0x7f0d080cc530 con 0x7f0d08161700 2023-12-19T05:40:16.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d05ffb640 1 -- 172.21.15.49:0/2768221763 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf0003520 con 0x7f0d08161700 2023-12-19T05:40:16.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d067fc640 1 -- 172.21.15.49:0/2768221763 >> v1:172.21.15.115:6789/0 conn(0x7f0d080ce230 legacy=0x7f0d080ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:16.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d067fc640 1 -- 172.21.15.49:0/2768221763 >> v1:172.21.15.49:6789/0 conn(0x7f0d08161700 legacy=0x7f0d080b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.744+0000 7f0d067fc640 1 -- 172.21.15.49:0/2768221763 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080cbc00 con 0x7f0d080cc9c0 2023-12-19T05:40:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d067fc640 1 --2- 172.21.15.49:0/2768221763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d080cc9c0 0x7f0d080b1f40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0097a0 tx=0x7f0cfc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c6deea6590e3d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d05ffb640 1 -- 172.21.15.49:0/2768221763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc030610 con 0x7f0d080cc9c0 2023-12-19T05:40:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d05ffb640 1 -- 172.21.15.49:0/2768221763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc030770 con 0x7f0d080cc9c0 2023-12-19T05:40:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d05ffb640 1 -- 172.21.15.49:0/2768221763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc030b00 con 0x7f0d080cc9c0 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d0d6db640 1 -- 172.21.15.49:0/2768221763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d080cc9c0 msgr2=0x7f0d080b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.746+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/2768221763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d080cc9c0 0x7f0d080b1f40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0097a0 tx=0x7f0cfc02b960 comp rx=0 tx=0).stop 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.747+0000 7f0d0d6db640 1 -- 172.21.15.49:0/2768221763 shutdown_connections 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.747+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/2768221763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d080cc9c0 0x7f0d080b1f40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.747+0000 7f0d0d6db640 1 -- 172.21.15.49:0/2768221763 >> 172.21.15.49:0/2768221763 conn(0x7f0d08073150 msgr2=0x7f0d080659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.747+0000 7f0d0d6db640 1 -- 172.21.15.49:0/2768221763 shutdown_connections 2023-12-19T05:40:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.747+0000 7f0d0d6db640 1 -- 172.21.15.49:0/2768221763 wait complete. 2023-12-19T05:40:16.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.748+0000 7f0d0d6db640 1 Processor -- start 2023-12-19T05:40:16.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.749+0000 7f0d0d6db640 1 -- start start 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 0x7f0d0814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 0x7f0d0815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0814d750 con 0x7f0d08161700 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0806ce90 con 0x7f0d080ce230 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d0d6db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0806c280 con 0x7f0d080cc9c0 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60404/0 (socket says 172.21.15.49:60404) 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d077fe640 1 -- 172.21.15.49:0/3972158962 learned_addr learned my addr 172.21.15.49:0/3972158962 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.750+0000 7f0d067fc640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 0x7f0d0815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d06ffd640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 0x7f0d0814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 -- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 msgr2=0x7f0d0814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 0x7f0d0814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 -- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 msgr2=0x7f0d0815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 0x7f0d0815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 -- 172.21.15.49:0/3972158962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009400 con 0x7f0d08161700 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d067fc640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 0x7f0d0815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d06ffd640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 0x7f0d0814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d077fe640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c7d0 tx=0x7f0d0000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003b70 con 0x7f0d08161700 2023-12-19T05:40:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00003cf0 con 0x7f0d08161700 2023-12-19T05:40:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000aa90 con 0x7f0d08161700 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.751+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0806c560 con 0x7f0d08161700 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.752+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0806cb20 con 0x7f0d08161700 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.753+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0815d1b0 con 0x7f0d08161700 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.753+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d0000abf0 con 0x7f0d08161700 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.754+0000 7f0cef7fe640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 0x7f0cf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.755+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d00088460 con 0x7f0d08161700 2023-12-19T05:40:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.755+0000 7f0d06ffd640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 0x7f0cf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.756+0000 7f0d06ffd640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 0x7f0cf406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80011e0 tx=0x7f0cf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.759+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d0815d1b0 con 0x7f0d08161700 2023-12-19T05:40:16.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.950+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d0815d1b0 con 0x7f0d08161700 2023-12-19T05:40:16.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.951+0000 7f0cef7fe640 1 -- 172.21.15.49:0/3972158962 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d0815d1b0 con 0x7f0d08161700 2023-12-19T05:40:16.952 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:16.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.953+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 msgr2=0x7f0cf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.953+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 0x7f0cf406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80011e0 tx=0x7f0cf8009040 comp rx=0 tx=0).stop 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.953+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 msgr2=0x7f0d0815fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.953+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c7d0 tx=0x7f0d0000cc90 comp rx=0 tx=0).stop 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 shutdown_connections 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0cf406a430 0x7f0cf406c8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d08161700 0x7f0d0815fd30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d080ce230 0x7f0d0815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 --2- 172.21.15.49:0/3972158962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d080cc9c0 0x7f0d0814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:16.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 >> 172.21.15.49:0/3972158962 conn(0x7f0d08073150 msgr2=0x7f0d080b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:16.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 shutdown_connections 2023-12-19T05:40:16.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:16.954+0000 7f0d0d6db640 1 -- 172.21.15.49:0/3972158962 wait complete. 2023-12-19T05:40:16.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.193+0000 7fe304fce640 1 Processor -- start 2023-12-19T05:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.193+0000 7fe304fce640 1 -- start start 2023-12-19T05:40:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe304fce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30015d490 0x7fe3000ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe304fce640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3000705c0 0x7fe3000acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe304fce640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006b850 con 0x7fe30015d870 2023-12-19T05:40:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe304fce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30006c6b0 con 0x7fe30015d490 2023-12-19T05:40:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe304fce640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30006f160 con 0x7fe3000705c0 2023-12-19T05:40:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.195+0000 7fe2fe59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30015d490 0x7fe3000ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30015d490 0x7fe3000ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60410/0 (socket says 172.21.15.49:60410) 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 -- 172.21.15.49:0/408827769 learned_addr learned my addr 172.21.15.49:0/408827769 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fed9d640 1 --2- 172.21.15.49:0/408827769 >> v2:172.21.15.115:3300/0 conn(0x7fe3000705c0 0x7fe3000acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 -- 172.21.15.49:0/408827769 >> v2:172.21.15.115:3300/0 conn(0x7fe3000705c0 msgr2=0x7fe3000acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/408827769 >> v2:172.21.15.115:3300/0 conn(0x7fe3000705c0 0x7fe3000acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 -- 172.21.15.49:0/408827769 >> v1:172.21.15.115:6789/0 conn(0x7fe30015d870 legacy=0x7fe300161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.196+0000 7fe2fe59c640 1 -- 172.21.15.49:0/408827769 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30006bb30 con 0x7fe30015d490 2023-12-19T05:40:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.197+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/408827769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe3000ac8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe30006b400 tx=0x7fe2f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da589213705da498 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.198+0000 7fe2fdd9b640 1 -- 172.21.15.49:0/408827769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0030860 con 0x7fe30015d490 2023-12-19T05:40:17.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.198+0000 7fe2fdd9b640 1 -- 172.21.15.49:0/408827769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00309c0 con 0x7fe30015d490 2023-12-19T05:40:17.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.198+0000 7fe2fdd9b640 1 -- 172.21.15.49:0/408827769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0030d50 con 0x7fe30015d490 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.198+0000 7fe304fce640 1 -- 172.21.15.49:0/408827769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 msgr2=0x7fe3000ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.198+0000 7fe304fce640 1 --2- 172.21.15.49:0/408827769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe3000ac8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe30006b400 tx=0x7fe2f002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 -- 172.21.15.49:0/408827769 shutdown_connections 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 --2- 172.21.15.49:0/408827769 >> v2:172.21.15.115:3300/0 conn(0x7fe3000705c0 0x7fe3000acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 --2- 172.21.15.49:0/408827769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe3000ac8b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 -- 172.21.15.49:0/408827769 >> 172.21.15.49:0/408827769 conn(0x7fe3000cf0b0 msgr2=0x7fe3000cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 -- 172.21.15.49:0/408827769 shutdown_connections 2023-12-19T05:40:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.199+0000 7fe304fce640 1 -- 172.21.15.49:0/408827769 wait complete. 2023-12-19T05:40:17.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.200+0000 7fe304fce640 1 Processor -- start 2023-12-19T05:40:17.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.201+0000 7fe304fce640 1 -- start start 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.201+0000 7fe304fce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 0x7fe30014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.201+0000 7fe304fce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.201+0000 7fe304fce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 0x7fe3000ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe304fce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30015f090 con 0x7fe30015d490 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe304fce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30015f370 con 0x7fe3000705c0 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe304fce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30015f650 con 0x7fe30015d870 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60416/0 (socket says 172.21.15.49:60416) 2023-12-19T05:40:17.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 -- 172.21.15.49:0/2592164945 learned_addr learned my addr 172.21.15.49:0/2592164945 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 0x7fe30014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2fed9d640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 0x7fe3000ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 -- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 msgr2=0x7fe3000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 0x7fe3000ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 -- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 msgr2=0x7fe30014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 0x7fe30014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2f7fff640 1 -- 172.21.15.49:0/2592164945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00094d0 con 0x7fe30015d490 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2fed9d640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 0x7fe3000ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.202+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 0x7fe30014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe2f7fff640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c400 tx=0x7fe2e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80052d0 con 0x7fe30015d490 2023-12-19T05:40:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8005430 con 0x7fe30015d490 2023-12-19T05:40:17.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8003830 con 0x7fe30015d490 2023-12-19T05:40:17.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30015f930 con 0x7fe30015d490 2023-12-19T05:40:17.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.203+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30014fd10 con 0x7fe30015d490 2023-12-19T05:40:17.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.204+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300074770 con 0x7fe30015d490 2023-12-19T05:40:17.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.205+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2e8003990 con 0x7fe30015d490 2023-12-19T05:40:17.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.206+0000 7fe2f6ffd640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 0x7fe2e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.206+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2e8087ae0 con 0x7fe30015d490 2023-12-19T05:40:17.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.207+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 0x7fe2e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.208+0000 7fe2fe59c640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 0x7fe2e006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0036000 tx=0x7fe2f003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.211+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2e80534b0 con 0x7fe30015d490 2023-12-19T05:40:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.405+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe300061910 con 0x7fe30015d490 2023-12-19T05:40:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.406+0000 7fe2f6ffd640 1 -- 172.21.15.49:0/2592164945 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe2e8017060 con 0x7fe30015d490 2023-12-19T05:40:17.407 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:17.407 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:40:17.407 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:17.407 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:40:17.408 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:40:17.408 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:17.408 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:40:17.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 msgr2=0x7fe2e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 0x7fe2e006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0036000 tx=0x7fe2f003b040 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 msgr2=0x7fe30015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c400 tx=0x7fe2e800c8c0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 shutdown_connections 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2e006a430 0x7fe2e006c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe30015d870 0x7fe3000ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30015d490 0x7fe30015fe50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 --2- 172.21.15.49:0/2592164945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3000705c0 0x7fe30014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 >> 172.21.15.49:0/2592164945 conn(0x7fe3000cf0b0 msgr2=0x7fe30006cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 shutdown_connections 2023-12-19T05:40:17.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.409+0000 7fe304fce640 1 -- 172.21.15.49:0/2592164945 wait complete. 2023-12-19T05:40:17.428 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:40:17.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:40:17.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.652+0000 7f7022873640 1 Processor -- start 2023-12-19T05:40:17.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.653+0000 7f7022873640 1 -- start start 2023-12-19T05:40:17.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701c06d070 0x7f701c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f701c0b02f0 0x7f701c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c0adc40 con 0x7f701c06d070 2023-12-19T05:40:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c0b0780 con 0x7f701c0b02f0 2023-12-19T05:40:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.654+0000 7f7022873640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c15f920 con 0x7f701c15afd0 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701c06d070 0x7f701c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f701c06d070 0x7f701c0afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60420/0 (socket says 172.21.15.49:60420) 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 -- 172.21.15.49:0/103369225 learned_addr learned my addr 172.21.15.49:0/103369225 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021871640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7022072640 1 --2- 172.21.15.49:0/103369225 >> v2:172.21.15.115:3300/0 conn(0x7f701c0b02f0 0x7f701c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 -- 172.21.15.49:0/103369225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 msgr2=0x7f701c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 -- 172.21.15.49:0/103369225 >> v2:172.21.15.115:3300/0 conn(0x7f701c0b02f0 msgr2=0x7f701c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 --2- 172.21.15.49:0/103369225 >> v2:172.21.15.115:3300/0 conn(0x7f701c0b02f0 0x7f701c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.655+0000 7f7021070640 1 -- 172.21.15.49:0/103369225 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c15ed10 con 0x7f701c06d070 2023-12-19T05:40:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.657+0000 7f7021070640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c06d070 0x7f701c0afdb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f701c0719c0 tx=0x7f700c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a039d249e7d48b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.657+0000 7f702086f640 1 -- 172.21.15.49:0/103369225 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c031870 con 0x7f701c06d070 2023-12-19T05:40:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.657+0000 7f702086f640 1 -- 172.21.15.49:0/103369225 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c0319d0 con 0x7f701c06d070 2023-12-19T05:40:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.657+0000 7f702086f640 1 -- 172.21.15.49:0/103369225 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c031d60 con 0x7f701c06d070 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 -- 172.21.15.49:0/103369225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c06d070 msgr2=0x7f701c0afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c06d070 0x7f701c0afdb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f701c0719c0 tx=0x7f700c02b910 comp rx=0 tx=0).stop 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 -- 172.21.15.49:0/103369225 shutdown_connections 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 --2- 172.21.15.49:0/103369225 >> v2:172.21.15.115:3300/0 conn(0x7f701c0b02f0 0x7f701c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c06d070 0x7f701c0afdb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 --2- 172.21.15.49:0/103369225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 -- 172.21.15.49:0/103369225 >> 172.21.15.49:0/103369225 conn(0x7f701c0b4750 msgr2=0x7f701c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 -- 172.21.15.49:0/103369225 shutdown_connections 2023-12-19T05:40:17.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.658+0000 7f7022873640 1 -- 172.21.15.49:0/103369225 wait complete. 2023-12-19T05:40:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.660+0000 7f7022873640 1 Processor -- start 2023-12-19T05:40:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.660+0000 7f7022873640 1 -- start start 2023-12-19T05:40:17.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f701c06d070 0x7f701c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c15c280 con 0x7f701c0b02f0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c15b3b0 con 0x7f701c06d070 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7022873640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c15c6a0 con 0x7f701c15afd0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.661+0000 7f7021070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60422/0 (socket says 172.21.15.49:60422) 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 -- 172.21.15.49:0/797043851 learned_addr learned my addr 172.21.15.49:0/797043851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021871640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f701c06d070 0x7f701c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 -- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 msgr2=0x7f701c06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 -- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f701c06d070 msgr2=0x7f701c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f701c06d070 0x7f701c157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 -- 172.21.15.49:0/797043851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0094d0 con 0x7f701c0b02f0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.662+0000 7f7021070640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f700c000c00 tx=0x7f700c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.663+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c03abe0 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.663+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c03ad40 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.663+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c14c090 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.663+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c044610 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.663+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c15b8e0 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.664+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c155040 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.665+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f700c044770 con 0x7f701c0b02f0 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.666+0000 7f70127fc640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 0x7f700006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:17.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.666+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f700c02d040 con 0x7f701c0b02f0 2023-12-19T05:40:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.667+0000 7f7021871640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 0x7f700006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:17.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.668+0000 7f7021871640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 0x7f700006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7018006fd0 tx=0x7f7018008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.670+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f700c076580 con 0x7f701c0b02f0 2023-12-19T05:40:17.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:17.865+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f701c061910 con 0x7f701c0b02f0 2023-12-19T05:40:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.699+0000 7f70127fc640 1 -- 172.21.15.49:0/797043851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f700c079ba0 con 0x7f701c0b02f0 2023-12-19T05:40:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 msgr2=0x7f700006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 0x7f700006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7018006fd0 tx=0x7f7018008040 comp rx=0 tx=0).stop 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 msgr2=0x7f701c156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f700c000c00 tx=0x7f700c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 shutdown_connections 2023-12-19T05:40:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f700006a430 0x7f700006c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f701c15afd0 0x7f701c06d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f701c0b02f0 0x7f701c156cf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 --2- 172.21.15.49:0/797043851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f701c06d070 0x7f701c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 >> 172.21.15.49:0/797043851 conn(0x7f701c0b4750 msgr2=0x7f701c06c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 shutdown_connections 2023-12-19T05:40:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.704+0000 7f7022873640 1 -- 172.21.15.49:0/797043851 wait complete. 2023-12-19T05:40:18.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:40:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.972+0000 7fb5e2470640 1 Processor -- start 2023-12-19T05:40:18.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.972+0000 7fb5e2470640 1 -- start start 2023-12-19T05:40:18.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5e2470640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5dc15eff0 0x7fb5dc06f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5e2470640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5dc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5e2470640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0c3660 con 0x7fb5dc144b60 2023-12-19T05:40:18.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5e2470640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b3120 con 0x7fb5dc15eff0 2023-12-19T05:40:18.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5e2470640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc06f410 con 0x7fb5dc0b2750 2023-12-19T05:40:18.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5dbfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb5dc144b60 0x7fb5dc0c2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39156/0 (socket says 172.21.15.49:39156) 2023-12-19T05:40:18.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.974+0000 7fb5dbfff640 1 -- 172.21.15.49:0/3920265140 learned_addr learned my addr 172.21.15.49:0/3920265140 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/3920265140 >> v2:172.21.15.115:3300/0 conn(0x7fb5dc15eff0 0x7fb5dc06f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368144013 0 0) 0x7fb5dc0c3660 con 0x7fb5dc144b60 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c4003520 con 0x7fb5dc144b60 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5e0a0d640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5dc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 701176733 0 0) 0x7fb5c4003520 con 0x7fb5dc144b60 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 msgr2=0x7fb5dc0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5dc0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 >> v2:172.21.15.115:3300/0 conn(0x7fb5dc15eff0 msgr2=0x7fb5dc06f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 --2- 172.21.15.49:0/3920265140 >> v2:172.21.15.115:3300/0 conn(0x7fb5dc15eff0 0x7fb5dc06f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc15f4f0 con 0x7fb5dc144b60 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb5cc001670 con 0x7fb5dc144b60 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 >> v1:172.21.15.49:6789/0 conn(0x7fb5dc144b60 legacy=0x7fb5dc0c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4003970 0x7fb5c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5c4004d00 0x7fb5c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b3120 con 0x7fb5c4004d00 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc06f410 con 0x7fb5c4003970 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.975+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c400ba00 con 0x7fb5dc0b2750 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5c4004d00 0x7fb5c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5dbfff640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4003970 0x7fb5c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 -- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 msgr2=0x7fb5c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 -- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4003970 msgr2=0x7fb5c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4003970 0x7fb5c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5e0a0d640 1 -- 172.21.15.49:0/3920265140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4003520 con 0x7fb5c4004d00 2023-12-19T05:40:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.976+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc0b2750 0x7fb5c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:18.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e0a0d640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5c4004d00 0x7fb5c4005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400ba30 tx=0x7fb5c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b23f8f940cf08b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:18.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4032640 con 0x7fb5c4004d00 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d40327a0 con 0x7fb5c4004d00 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5daffd640 1 -- 172.21.15.49:0/3920265140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4032b30 con 0x7fb5c4004d00 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e2470640 1 -- 172.21.15.49:0/3920265140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5c4004d00 msgr2=0x7fb5c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e2470640 1 --2- 172.21.15.49:0/3920265140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5c4004d00 0x7fb5c4005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400ba30 tx=0x7fb5c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e0a0d640 1 -- 172.21.15.49:0/3920265140 reap_dead start 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e2470640 1 -- 172.21.15.49:0/3920265140 shutdown_connections 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.978+0000 7fb5e2470640 1 -- 172.21.15.49:0/3920265140 >> 172.21.15.49:0/3920265140 conn(0x7fb5dc0d0110 msgr2=0x7fb5dc0d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.979+0000 7fb5e2470640 1 -- 172.21.15.49:0/3920265140 shutdown_connections 2023-12-19T05:40:18.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.979+0000 7fb5e2470640 1 -- 172.21.15.49:0/3920265140 wait complete. 2023-12-19T05:40:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.980+0000 7fb5e2470640 1 Processor -- start 2023-12-19T05:40:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.981+0000 7fb5e2470640 1 -- start start 2023-12-19T05:40:18.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 0x7fb5dc13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc1433b0 0x7fb5dc13d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc13f6c0 con 0x7fb5dc13b650 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc13f390 con 0x7fb5c4004d00 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5e2470640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1438c0 con 0x7fb5dc1433b0 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60440/0 (socket says 172.21.15.49:60440) 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 -- 172.21.15.49:0/332461539 learned_addr learned my addr 172.21.15.49:0/332461539 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5dbfff640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 0x7fb5dc13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 -- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc1433b0 msgr2=0x7fb5dc13d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc1433b0 0x7fb5dc13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 -- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 msgr2=0x7fb5dc13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 0x7fb5dc13aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5db7fe640 1 -- 172.21.15.49:0/332461539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc143ba0 con 0x7fb5dc13b650 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.982+0000 7fb5dbfff640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 0x7fb5dc13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:18.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5db7fe640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00101c0 tx=0x7fb5d0010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:18.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000e050 con 0x7fb5dc13b650 2023-12-19T05:40:18.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d000f040 con 0x7fb5dc13b650 2023-12-19T05:40:18.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003bb0 con 0x7fb5dc13b650 2023-12-19T05:40:18.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc143e80 con 0x7fb5dc13b650 2023-12-19T05:40:18.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.983+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc0ce1d0 con 0x7fb5dc13b650 2023-12-19T05:40:18.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.984+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc13f1f0 con 0x7fb5dc13b650 2023-12-19T05:40:18.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.985+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5d0003d10 con 0x7fb5dc13b650 2023-12-19T05:40:18.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.986+0000 7fb5d8ff9640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 0x7fb5c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:18.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.986+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb5d00896b0 con 0x7fb5dc13b650 2023-12-19T05:40:18.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.987+0000 7fb5dbfff640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 0x7fb5c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:18.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.988+0000 7fb5dbfff640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 0x7fb5c806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc001050 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:18.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:18.991+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5dc13f1f0 con 0x7fb5dc13b650 2023-12-19T05:40:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.190+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb5dc13f1f0 con 0x7fb5dc13b650 2023-12-19T05:40:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.710+0000 7fb5d8ff9640 1 -- 172.21.15.49:0/332461539 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb5dc13f1f0 con 0x7fb5dc13b650 2023-12-19T05:40:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:40:19.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.720+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 msgr2=0x7fb5c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.720+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 0x7fb5c806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc001050 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2023-12-19T05:40:19.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.720+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 msgr2=0x7fb5dc142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.720+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00101c0 tx=0x7fb5d0010680 comp rx=0 tx=0).stop 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 shutdown_connections 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb5c806a430 0x7fb5c806c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5dc1433b0 0x7fb5dc13d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5dc13b650 0x7fb5dc142e70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 --2- 172.21.15.49:0/332461539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5c4004d00 0x7fb5dc13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.721+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 >> 172.21.15.49:0/332461539 conn(0x7fb5dc0d0110 msgr2=0x7fb5dc158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.722+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 shutdown_connections 2023-12-19T05:40:19.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.722+0000 7fb5e2470640 1 -- 172.21.15.49:0/332461539 wait complete. 2023-12-19T05:40:19.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:40:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.953+0000 7fe6462ca640 1 Processor -- start 2023-12-19T05:40:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.954+0000 7fe6462ca640 1 -- start start 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.955+0000 7fe6462ca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe640146ff0 0x7fe6400d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.955+0000 7fe6462ca640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc40 0x7fe64015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.955+0000 7fe6462ca640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe640161e70 con 0x7fe6400b6430 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.955+0000 7fe6462ca640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe640161080 con 0x7fe640146ff0 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.955+0000 7fe6462ca640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe640161260 con 0x7fe64006fc40 2023-12-19T05:40:19.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe640146ff0 0x7fe6400d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6400b6430 0x7fe64006f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39170/0 (socket says 172.21.15.49:39170) 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63f7fe640 1 -- 172.21.15.49:0/1817540727 learned_addr learned my addr 172.21.15.49:0/1817540727 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe644867640 1 --2- 172.21.15.49:0/1817540727 >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc40 0x7fe64015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63ffff640 1 -- 172.21.15.49:0/1817540727 >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc40 msgr2=0x7fe64015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63ffff640 1 --2- 172.21.15.49:0/1817540727 >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc40 0x7fe64015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63ffff640 1 -- 172.21.15.49:0/1817540727 >> v1:172.21.15.49:6789/0 conn(0x7fe6400b6430 legacy=0x7fe64006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.956+0000 7fe63ffff640 1 -- 172.21.15.49:0/1817540727 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640161540 con 0x7fe640146ff0 2023-12-19T05:40:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.958+0000 7fe63ffff640 1 --2- 172.21.15.49:0/1817540727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe640146ff0 0x7fe6400d10f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279f493a7684c65a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.958+0000 7fe63effd640 1 -- 172.21.15.49:0/1817540727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63002cc60 con 0x7fe640146ff0 2023-12-19T05:40:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.958+0000 7fe63effd640 1 -- 172.21.15.49:0/1817540727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63002cdc0 con 0x7fe640146ff0 2023-12-19T05:40:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.958+0000 7fe63effd640 1 -- 172.21.15.49:0/1817540727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630034660 con 0x7fe640146ff0 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 -- 172.21.15.49:0/1817540727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe640146ff0 msgr2=0x7fe6400d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 --2- 172.21.15.49:0/1817540727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe640146ff0 0x7fe6400d10f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63002beb0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 -- 172.21.15.49:0/1817540727 shutdown_connections 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 --2- 172.21.15.49:0/1817540727 >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc40 0x7fe64015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 --2- 172.21.15.49:0/1817540727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe640146ff0 0x7fe6400d10f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 -- 172.21.15.49:0/1817540727 >> 172.21.15.49:0/1817540727 conn(0x7fe6400d3520 msgr2=0x7fe6400d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 -- 172.21.15.49:0/1817540727 shutdown_connections 2023-12-19T05:40:19.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.959+0000 7fe6462ca640 1 -- 172.21.15.49:0/1817540727 wait complete. 2023-12-19T05:40:19.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.961+0000 7fe6462ca640 1 Processor -- start 2023-12-19T05:40:19.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.961+0000 7fe6462ca640 1 -- start start 2023-12-19T05:40:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 0x7fe64015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 0x7fe640136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640138f70 con 0x7fe64006fc40 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640132fc0 con 0x7fe640146ff0 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe6462ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401332a0 con 0x7fe6400b6430 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60458/0 (socket says 172.21.15.49:60458) 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.962+0000 7fe63ffff640 1 -- 172.21.15.49:0/3326783571 learned_addr learned my addr 172.21.15.49:0/3326783571 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63f7fe640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 0x7fe64015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe644867640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 0x7fe640136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 -- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 msgr2=0x7fe64015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 0x7fe64015d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 -- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 msgr2=0x7fe640136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 0x7fe640136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 -- 172.21.15.49:0/3326783571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009a70 con 0x7fe64006fc40 2023-12-19T05:40:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63f7fe640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 0x7fe64015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe644867640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 0x7fe640136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.963+0000 7fe63ffff640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.964+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630040650 con 0x7fe64006fc40 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.964+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6300407b0 con 0x7fe64006fc40 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.964+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe640133580 con 0x7fe64006fc40 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.964+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630040b60 con 0x7fe64006fc40 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.964+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe640133b40 con 0x7fe64006fc40 2023-12-19T05:40:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.965+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640061910 con 0x7fe64006fc40 2023-12-19T05:40:19.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.967+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe630040cc0 con 0x7fe64006fc40 2023-12-19T05:40:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.969+0000 7fe63cff9640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.969+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe6300aba80 con 0x7fe64006fc40 2023-12-19T05:40:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.969+0000 7fe63f7fe640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.971+0000 7fe63f7fe640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe640071c50 tx=0x7fe628009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:19.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:19.973+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6300772f0 con 0x7fe64006fc40 2023-12-19T05:40:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.209+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe6400d43e0 con 0x7fe64006fc40 2023-12-19T05:40:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.221+0000 7fe63cff9640 1 -- 172.21.15.49:0/3326783571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe63007a910 con 0x7fe64006fc40 2023-12-19T05:40:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T05:40:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 msgr2=0x7fe62006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe640071c50 tx=0x7fe628009040 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 msgr2=0x7fe6400cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe630004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 shutdown_connections 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400b6430 0x7fe64015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe640146ff0 0x7fe640136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 --2- 172.21.15.49:0/3326783571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64006fc40 0x7fe6400cf690 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe630004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.226+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 >> 172.21.15.49:0/3326783571 conn(0x7fe6400d3520 msgr2=0x7fe6400b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.227+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 shutdown_connections 2023-12-19T05:40:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.229+0000 7fe6462ca640 1 -- 172.21.15.49:0/3326783571 wait complete. 2023-12-19T05:40:20.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:20.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.442+0000 7fa4323fd640 1 Processor -- start 2023-12-19T05:40:20.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.442+0000 7fa4323fd640 1 -- start start 2023-12-19T05:40:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.443+0000 7fa4323fd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa42c0ae110 0x7fa42c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.443+0000 7fa4323fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa42c0b0640 0x7fa42c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.443+0000 7fa4323fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0b0a60 con 0x7fa42c157bf0 2023-12-19T05:40:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.443+0000 7fa4323fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c06b8c0 con 0x7fa42c0b0640 2023-12-19T05:40:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.443+0000 7fa4323fd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0ae640 con 0x7fa42c0ae110 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa42c0b0640 0x7fa42c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa42c0b0640 0x7fa42c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60468/0 (socket says 172.21.15.49:60468) 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 -- 172.21.15.49:0/324831295 learned_addr learned my addr 172.21.15.49:0/324831295 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 -- 172.21.15.49:0/324831295 >> v2:172.21.15.115:3300/0 conn(0x7fa42c0ae110 msgr2=0x7fa42c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/324831295 >> v2:172.21.15.115:3300/0 conn(0x7fa42c0ae110 0x7fa42c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 --2- 172.21.15.49:0/324831295 >> v2:172.21.15.115:3300/0 conn(0x7fa42c0ae110 0x7fa42c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.444+0000 7fa43099a640 1 -- 172.21.15.49:0/324831295 >> v1:172.21.15.115:6789/0 conn(0x7fa42c157bf0 legacy=0x7fa42c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.445+0000 7fa43099a640 1 -- 172.21.15.49:0/324831295 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0ae920 con 0x7fa42c0b0640 2023-12-19T05:40:20.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.446+0000 7fa43099a640 1 --2- 172.21.15.49:0/324831295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c06d230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0af4b0 tx=0x7fa42402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b30b0e126989e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.446+0000 7fa42affd640 1 -- 172.21.15.49:0/324831295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424031870 con 0x7fa42c0b0640 2023-12-19T05:40:20.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.446+0000 7fa42affd640 1 -- 172.21.15.49:0/324831295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4240319d0 con 0x7fa42c0b0640 2023-12-19T05:40:20.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.446+0000 7fa42affd640 1 -- 172.21.15.49:0/324831295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424031d60 con 0x7fa42c0b0640 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 -- 172.21.15.49:0/324831295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 msgr2=0x7fa42c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 --2- 172.21.15.49:0/324831295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c06d230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0af4b0 tx=0x7fa42402b910 comp rx=0 tx=0).stop 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 -- 172.21.15.49:0/324831295 shutdown_connections 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 --2- 172.21.15.49:0/324831295 >> v2:172.21.15.115:3300/0 conn(0x7fa42c0ae110 0x7fa42c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 --2- 172.21.15.49:0/324831295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c06d230 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 -- 172.21.15.49:0/324831295 >> 172.21.15.49:0/324831295 conn(0x7fa42c0cbb70 msgr2=0x7fa42c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 -- 172.21.15.49:0/324831295 shutdown_connections 2023-12-19T05:40:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.447+0000 7fa4323fd640 1 -- 172.21.15.49:0/324831295 wait complete. 2023-12-19T05:40:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.449+0000 7fa4323fd640 1 Processor -- start 2023-12-19T05:40:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.449+0000 7fa4323fd640 1 -- start start 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa42c0ae110 0x7fa42c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa42c157bf0 0x7fa42c166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c150a30 con 0x7fa42c0b0640 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c151570 con 0x7fa42c157bf0 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa4323fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c150c40 con 0x7fa42c0ae110 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60478/0 (socket says 172.21.15.49:60478) 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 -- 172.21.15.49:0/1110371423 learned_addr learned my addr 172.21.15.49:0/1110371423 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 -- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa42c0ae110 msgr2=0x7fa42c0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa42c0ae110 0x7fa42c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 -- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa42c157bf0 msgr2=0x7fa42c166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa42c157bf0 0x7fa42c166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.450+0000 7fa42b7fe640 1 -- 172.21.15.49:0/1110371423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094d0 con 0x7fa42c0b0640 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c7f0 tx=0x7fa41400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414004220 con 0x7fa42c0b0640 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140043a0 con 0x7fa42c0b0640 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414007860 con 0x7fa42c0b0640 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c150f20 con 0x7fa42c0b0640 2023-12-19T05:40:20.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.451+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c167770 con 0x7fa42c0b0640 2023-12-19T05:40:20.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.452+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c061910 con 0x7fa42c0b0640 2023-12-19T05:40:20.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.454+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa414007bd0 con 0x7fa42c0b0640 2023-12-19T05:40:20.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.454+0000 7fa428ff9640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 0x7fa40c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.455+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa414088860 con 0x7fa42c0b0640 2023-12-19T05:40:20.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.455+0000 7fa42bfff640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 0x7fa40c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.456+0000 7fa42bfff640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 0x7fa40c06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ad540 tx=0x7fa41c009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.459+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa414053e50 con 0x7fa42c0b0640 2023-12-19T05:40:20.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.653+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa42c15ad90 con 0x7fa42c0b0640 2023-12-19T05:40:20.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.656+0000 7fa428ff9640 1 -- 172.21.15.49:0/1110371423 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fa41401e020 con 0x7fa42c0b0640 2023-12-19T05:40:20.658 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:20.658 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:20.211044+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:20.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 msgr2=0x7fa40c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 0x7fa40c06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ad540 tx=0x7fa41c009250 comp rx=0 tx=0).stop 2023-12-19T05:40:20.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 msgr2=0x7fa42c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c7f0 tx=0x7fa41400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 shutdown_connections 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa40c06a430 0x7fa40c06c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa42c157bf0 0x7fa42c166cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c0b0640 0x7fa42c151a00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 --2- 172.21.15.49:0/1110371423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa42c0ae110 0x7fa42c0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 >> 172.21.15.49:0/1110371423 conn(0x7fa42c0cbb70 msgr2=0x7fa42c06dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 shutdown_connections 2023-12-19T05:40:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.661+0000 7fa4323fd640 1 -- 172.21.15.49:0/1110371423 wait complete. 2023-12-19T05:40:20.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:20.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.912+0000 7fce86ab6640 1 Processor -- start 2023-12-19T05:40:20.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.912+0000 7fce86ab6640 1 -- start start 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce86ab6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce80157bf0 0x7fce8015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce86ab6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce800b0810 0x7fce8006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce86ab6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015b740 con 0x7fce800ae110 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce86ab6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8006b8c0 con 0x7fce80157bf0 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce86ab6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800ae640 con 0x7fce800b0810 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce84852640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce80157bf0 0x7fce8015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce84852640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce80157bf0 0x7fce8015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60480/0 (socket says 172.21.15.49:60480) 2023-12-19T05:40:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce84852640 1 -- 172.21.15.49:0/1433929542 learned_addr learned my addr 172.21.15.49:0/1433929542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.914+0000 7fce7ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce800ae110 0x7fce800b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39176/0 (socket says 172.21.15.49:39176) 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce85053640 1 --2- 172.21.15.49:0/1433929542 >> v2:172.21.15.115:3300/0 conn(0x7fce800b0810 0x7fce8006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce84852640 1 -- 172.21.15.49:0/1433929542 >> v2:172.21.15.115:3300/0 conn(0x7fce800b0810 msgr2=0x7fce8006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce84852640 1 --2- 172.21.15.49:0/1433929542 >> v2:172.21.15.115:3300/0 conn(0x7fce800b0810 0x7fce8006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce84852640 1 -- 172.21.15.49:0/1433929542 >> v1:172.21.15.49:6789/0 conn(0x7fce800ae110 legacy=0x7fce800b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce84852640 1 -- 172.21.15.49:0/1433929542 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800ae920 con 0x7fce80157bf0 2023-12-19T05:40:20.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.915+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1433929542 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777389137 0 0) 0x7fce8015b740 con 0x7fce800ae110 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.916+0000 7fce84852640 1 --2- 172.21.15.49:0/1433929542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8015b200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce800b1210 tx=0x7fce7402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f6c01bcba44cbf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.916+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1433929542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74030860 con 0x7fce80157bf0 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1433929542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740309c0 con 0x7fce80157bf0 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1433929542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74030d50 con 0x7fce80157bf0 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 -- 172.21.15.49:0/1433929542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 msgr2=0x7fce8015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 --2- 172.21.15.49:0/1433929542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8015b200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce800b1210 tx=0x7fce7402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 -- 172.21.15.49:0/1433929542 shutdown_connections 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 --2- 172.21.15.49:0/1433929542 >> v2:172.21.15.115:3300/0 conn(0x7fce800b0810 0x7fce8006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 --2- 172.21.15.49:0/1433929542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8015b200 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 -- 172.21.15.49:0/1433929542 >> 172.21.15.49:0/1433929542 conn(0x7fce800cbb70 msgr2=0x7fce800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 -- 172.21.15.49:0/1433929542 shutdown_connections 2023-12-19T05:40:20.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.917+0000 7fce86ab6640 1 -- 172.21.15.49:0/1433929542 wait complete. 2023-12-19T05:40:20.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.919+0000 7fce86ab6640 1 Processor -- start 2023-12-19T05:40:20.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.919+0000 7fce86ab6640 1 -- start start 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce800ae110 0x7fce80149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 0x7fce80159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cd9f0 con 0x7fce80157bf0 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cdb80 con 0x7fce800b0810 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce86ab6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80149b00 con 0x7fce800ae110 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.920+0000 7fce85053640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60492/0 (socket says 172.21.15.49:60492) 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 -- 172.21.15.49:0/593194881 learned_addr learned my addr 172.21.15.49:0/593194881 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce84852640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce800ae110 0x7fce80149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce7ffff640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 0x7fce80159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 -- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce800ae110 msgr2=0x7fce80149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce800ae110 0x7fce80149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 -- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 msgr2=0x7fce80159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 0x7fce80159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 -- 172.21.15.49:0/593194881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740094d0 con 0x7fce80157bf0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce7ffff640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 0x7fce80159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.921+0000 7fce85053640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce78007e40 tx=0x7fce7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.922+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78014620 con 0x7fce80157bf0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.922+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7800ee90 con 0x7fce80157bf0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.922+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780149e0 con 0x7fce80157bf0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.922+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80149de0 con 0x7fce80157bf0 2023-12-19T05:40:20.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.922+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8014a3a0 con 0x7fce80157bf0 2023-12-19T05:40:20.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.923+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce800cdd10 con 0x7fce80157bf0 2023-12-19T05:40:20.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.924+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce78014b40 con 0x7fce80157bf0 2023-12-19T05:40:20.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.925+0000 7fce7d7fa640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 0x7fce6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:20.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.925+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce78089360 con 0x7fce80157bf0 2023-12-19T05:40:20.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.926+0000 7fce84852640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 0x7fce6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:20.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.927+0000 7fce84852640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 0x7fce6406c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce74036000 tx=0x7fce7403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:20.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:20.929+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce780548b0 con 0x7fce80157bf0 2023-12-19T05:40:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.124+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce80061910 con 0x7fce80157bf0 2023-12-19T05:40:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.127+0000 7fce7d7fa640 1 -- 172.21.15.49:0/593194881 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fce78057ed0 con 0x7fce80157bf0 2023-12-19T05:40:21.128 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:21.129 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:20.211044+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:21.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.129+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 msgr2=0x7fce6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.129+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 0x7fce6406c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce74036000 tx=0x7fce7403b040 comp rx=0 tx=0).stop 2023-12-19T05:40:21.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 msgr2=0x7fce8006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce78007e40 tx=0x7fce7800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 shutdown_connections 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a430 0x7fce6406c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce80157bf0 0x7fce8006d160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce800b0810 0x7fce80159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 --2- 172.21.15.49:0/593194881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce800ae110 0x7fce80149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 >> 172.21.15.49:0/593194881 conn(0x7fce800cbb70 msgr2=0x7fce8014ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 shutdown_connections 2023-12-19T05:40:21.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.130+0000 7fce86ab6640 1 -- 172.21.15.49:0/593194881 wait complete. 2023-12-19T05:40:21.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:40:21.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.373+0000 7f18a3549640 1 Processor -- start 2023-12-19T05:40:21.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.373+0000 7f18a3549640 1 -- start start 2023-12-19T05:40:21.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.375+0000 7f18a3549640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 0x7f189c1614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.375+0000 7f18a3549640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c15d7d0 con 0x7f189c0b02f0 2023-12-19T05:40:21.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.375+0000 7f18a3549640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c0b0bf0 con 0x7f189c157710 2023-12-19T05:40:21.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.375+0000 7f18a3549640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0b2ea0 con 0x7f189c0b07a0 2023-12-19T05:40:21.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.375+0000 7f18a1d46640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f189c0b02f0 0x7f189c160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39188/0 (socket says 172.21.15.49:39188) 2023-12-19T05:40:21.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1d46640 1 -- 172.21.15.49:0/4172732018 learned_addr learned my addr 172.21.15.49:0/4172732018 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:21.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936490160 0 0) 0x7f189c15d7d0 con 0x7f189c0b02f0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888003520 con 0x7f189c0b02f0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a2d48640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 0x7f189c1614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687323385 0 0) 0x7f1888003520 con 0x7f189c0b02f0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 msgr2=0x7f189c1614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 0x7f189c1614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 >> v1:172.21.15.115:6789/0 conn(0x7f189c157710 legacy=0x7f189c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c15da90 con 0x7f189c0b02f0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f188c001670 con 0x7f189c0b02f0 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 >> v1:172.21.15.49:6789/0 conn(0x7f189c0b02f0 legacy=0x7f189c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1888003a10 0x7f1888003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18880047c0 0x7f1888004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.376+0000 7f18a1545640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 0x7f188800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0b2ea0 con 0x7f18880047c0 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188800bec0 con 0x7f1888003a10 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188800c000 con 0x7f189c0b07a0 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18880047c0 0x7f1888004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a2547640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1888003a10 0x7f1888003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 -- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 msgr2=0x7f188800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f189c0b07a0 0x7f188800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 -- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1888003a10 msgr2=0x7f1888003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1888003a10 0x7f1888003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a1d46640 1 -- 172.21.15.49:0/4172732018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888003520 con 0x7f18880047c0 2023-12-19T05:40:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.377+0000 7f18a2547640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1888003a10 0x7f1888003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.378+0000 7f18a1d46640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18880047c0 0x7f1888004c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c0e0 tx=0x7f18880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160adf6c6f797320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.378+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c005ad0 con 0x7f18880047c0 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c005c30 con 0x7f18880047c0 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a1545640 1 -- 172.21.15.49:0/4172732018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c02c810 con 0x7f18880047c0 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 -- 172.21.15.49:0/4172732018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18880047c0 msgr2=0x7f1888004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 --2- 172.21.15.49:0/4172732018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18880047c0 0x7f1888004c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c0e0 tx=0x7f18880057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a2d48640 1 -- 172.21.15.49:0/4172732018 reap_dead start 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 -- 172.21.15.49:0/4172732018 shutdown_connections 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 -- 172.21.15.49:0/4172732018 >> 172.21.15.49:0/4172732018 conn(0x7f189c0659a0 msgr2=0x7f189c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 -- 172.21.15.49:0/4172732018 shutdown_connections 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.379+0000 7f18a3549640 1 -- 172.21.15.49:0/4172732018 wait complete. 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.381+0000 7f18a3549640 1 Processor -- start 2023-12-19T05:40:21.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.381+0000 7f18a3549640 1 -- start start 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18880047c0 0x7f189c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f189c070210 0x7f189c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1f3840 con 0x7f189c1f2800 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c070bd0 con 0x7f189c070210 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a3549640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1f3560 con 0x7f18880047c0 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a2d48640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a2d48640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60516/0 (socket says 172.21.15.49:60516) 2023-12-19T05:40:21.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.382+0000 7f18a2d48640 1 -- 172.21.15.49:0/1872605529 learned_addr learned my addr 172.21.15.49:0/1872605529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2547640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18880047c0 0x7f189c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a1d46640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f189c070210 0x7f189c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 -- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18880047c0 msgr2=0x7f189c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18880047c0 0x7f189c14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 -- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f189c070210 msgr2=0x7f189c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f189c070210 0x7f189c070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 -- 172.21.15.49:0/1872605529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c06c550 con 0x7f189c1f2800 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.383+0000 7f18a2d48640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f189c15e940 tx=0x7f189400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.384+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400ad10 con 0x7f189c1f2800 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.384+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400ae70 con 0x7f189c1f2800 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.384+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894003bd0 con 0x7f189c1f2800 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.384+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c06c830 con 0x7f189c1f2800 2023-12-19T05:40:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.384+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c1f31c0 con 0x7f189c1f2800 2023-12-19T05:40:21.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.385+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c06c3b0 con 0x7f189c1f2800 2023-12-19T05:40:21.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.386+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1894003d30 con 0x7f189c1f2800 2023-12-19T05:40:21.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.387+0000 7f1892ffd640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 0x7f188006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:21.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.388+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1894088020 con 0x7f189c1f2800 2023-12-19T05:40:21.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.388+0000 7f18a2547640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 0x7f188006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:21.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.389+0000 7f18a2547640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 0x7f188006c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f189c1562d0 tx=0x7f1898009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:21.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.392+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f189c06c3b0 con 0x7f189c1f2800 2023-12-19T05:40:21.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:21.618+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f189c06c3b0 con 0x7f189c1f2800 2023-12-19T05:40:21.678 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-12-19T05:40:21.677+0000 7f7a45efc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:40:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.233+0000 7f1892ffd640 1 -- 172.21.15.49:0/1872605529 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f189c06c3b0 con 0x7f189c1f2800 2023-12-19T05:40:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 msgr2=0x7f188006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 0x7f188006c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f189c1562d0 tx=0x7f1898009040 comp rx=0 tx=0).stop 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 msgr2=0x7f189c1f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f189c15e940 tx=0x7f189400ce90 comp rx=0 tx=0).stop 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 shutdown_connections 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f188006a430 0x7f188006c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c1f2800 0x7f189c1f2c80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f189c070210 0x7f189c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 --2- 172.21.15.49:0/1872605529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18880047c0 0x7f189c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.236+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 >> 172.21.15.49:0/1872605529 conn(0x7f189c0659a0 msgr2=0x7f189c0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.237+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 shutdown_connections 2023-12-19T05:40:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.237+0000 7f18a3549640 1 -- 172.21.15.49:0/1872605529 wait complete. 2023-12-19T05:40:22.260 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:40:22.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:40:22.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.491+0000 7f620bfff640 1 Processor -- start 2023-12-19T05:40:22.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.492+0000 7f620bfff640 1 -- start start 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.493+0000 7f620bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f620c0b7360 0x7f620c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.493+0000 7f620bfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c0b7d00 con 0x7f620c146c40 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c06f160 con 0x7f620c0cf8e0 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620bfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620c0700c0 con 0x7f620c0b7360 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f620c0b7360 0x7f620c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f620c0b7360 0x7f620c0b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60532/0 (socket says 172.21.15.49:60532) 2023-12-19T05:40:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 -- 172.21.15.49:0/190609455 learned_addr learned my addr 172.21.15.49:0/190609455 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 -- 172.21.15.49:0/190609455 >> v1:172.21.15.115:6789/0 conn(0x7f620c0cf8e0 legacy=0x7f620c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 -- 172.21.15.49:0/190609455 >> v1:172.21.15.49:6789/0 conn(0x7f620c146c40 legacy=0x7f620c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.494+0000 7f620a7fc640 1 -- 172.21.15.49:0/190609455 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c06f440 con 0x7f620c0b7360 2023-12-19T05:40:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.496+0000 7f620a7fc640 1 --2- 172.21.15.49:0/190609455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c0b77c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6200009870 tx=0x7f620002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab4b99f133d6560 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.496+0000 7f6209ffb640 1 -- 172.21.15.49:0/190609455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200030860 con 0x7f620c0b7360 2023-12-19T05:40:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.496+0000 7f6209ffb640 1 -- 172.21.15.49:0/190609455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62000309c0 con 0x7f620c0b7360 2023-12-19T05:40:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.496+0000 7f6209ffb640 1 -- 172.21.15.49:0/190609455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200030d50 con 0x7f620c0b7360 2023-12-19T05:40:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 -- 172.21.15.49:0/190609455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 msgr2=0x7f620c0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 --2- 172.21.15.49:0/190609455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c0b77c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6200009870 tx=0x7f620002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 -- 172.21.15.49:0/190609455 shutdown_connections 2023-12-19T05:40:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 --2- 172.21.15.49:0/190609455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c0b77c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 -- 172.21.15.49:0/190609455 >> 172.21.15.49:0/190609455 conn(0x7f620c0d31b0 msgr2=0x7f620c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 -- 172.21.15.49:0/190609455 shutdown_connections 2023-12-19T05:40:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.497+0000 7f620bfff640 1 -- 172.21.15.49:0/190609455 wait complete. 2023-12-19T05:40:22.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.499+0000 7f620bfff640 1 Processor -- start 2023-12-19T05:40:22.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.499+0000 7f620bfff640 1 -- start start 2023-12-19T05:40:22.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f620c0cf8e0 0x7f620c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620c146c40 0x7f620c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c1f72b0 con 0x7f620c0b7360 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c13fa90 con 0x7f620c146c40 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c1f6cf0 con 0x7f620c0cf8e0 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.500+0000 7f620affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60542/0 (socket says 172.21.15.49:60542) 2023-12-19T05:40:22.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 -- 172.21.15.49:0/3368082777 learned_addr learned my addr 172.21.15.49:0/3368082777 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620a7fc640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f620c0cf8e0 0x7f620c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620b7fe640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620c146c40 0x7f620c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 -- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f620c0cf8e0 msgr2=0x7f620c1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f620c0cf8e0 0x7f620c1f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 -- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620c146c40 msgr2=0x7f620c15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620c146c40 0x7f620c15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.501+0000 7f620affd640 1 -- 172.21.15.49:0/3368082777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000094d0 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f620affd640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c400 tx=0x7f61fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0052d0 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc005430 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc003830 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620c1f6fd0 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.502+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620c1f2a70 con 0x7f620c0b7360 2023-12-19T05:40:22.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.503+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620c1f2c00 con 0x7f620c0b7360 2023-12-19T05:40:22.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.504+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61fc003990 con 0x7f620c0b7360 2023-12-19T05:40:22.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.505+0000 7f61f37fe640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 0x7f61f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:22.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.505+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61fc087ed0 con 0x7f620c0b7360 2023-12-19T05:40:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.506+0000 7f620a7fc640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 0x7f61f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.507+0000 7f620a7fc640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 0x7f61f806c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6200036000 tx=0x7f6200008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:22.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.509+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61fc0534b0 con 0x7f620c0b7360 2023-12-19T05:40:22.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:22.744+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f620c061910 con 0x7f620c0b7360 2023-12-19T05:40:23.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.245+0000 7f61f37fe640 1 -- 172.21.15.49:0/3368082777 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61fc056ad0 con 0x7f620c0b7360 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.248+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 msgr2=0x7f61f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.248+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 0x7f61f806c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6200036000 tx=0x7f6200008030 comp rx=0 tx=0).stop 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.248+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 msgr2=0x7f620c1f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.248+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c400 tx=0x7f61fc00c8c0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 shutdown_connections 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61f806a430 0x7f61f806c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f620c0cf8e0 0x7f620c1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620c146c40 0x7f620c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 --2- 172.21.15.49:0/3368082777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620c0b7360 0x7f620c1f2530 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 >> 172.21.15.49:0/3368082777 conn(0x7f620c0d31b0 msgr2=0x7f620c1450a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:23.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 shutdown_connections 2023-12-19T05:40:23.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.249+0000 7f620bfff640 1 -- 172.21.15.49:0/3368082777 wait complete. 2023-12-19T05:40:23.270 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:40:23.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.498+0000 7fee274fa640 1 Processor -- start 2023-12-19T05:40:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.498+0000 7fee274fa640 1 -- start start 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee20146e30 0x7fee200b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee200b7ea0 0x7fee200d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee200d0a90 0x7fee2006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee20147210 con 0x7fee200d0a90 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200d2370 con 0x7fee200b7ea0 2023-12-19T05:40:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee274fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200b8300 con 0x7fee20146e30 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee26cf9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee200d0a90 0x7fee2006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee26cf9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee200d0a90 0x7fee2006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60556/0 (socket says 172.21.15.49:60556) 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee26cf9640 1 -- 172.21.15.49:0/4282953631 learned_addr learned my addr 172.21.15.49:0/4282953631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee264f8640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee20146e30 0x7fee200b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.500+0000 7fee25cf7640 1 --2- 172.21.15.49:0/4282953631 >> v2:172.21.15.115:3300/0 conn(0x7fee200b7ea0 0x7fee200d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.501+0000 7fee26cf9640 1 -- 172.21.15.49:0/4282953631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee20146e30 msgr2=0x7fee200b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.501+0000 7fee26cf9640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee20146e30 0x7fee200b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.501+0000 7fee26cf9640 1 -- 172.21.15.49:0/4282953631 >> v2:172.21.15.115:3300/0 conn(0x7fee200b7ea0 msgr2=0x7fee200d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.501+0000 7fee26cf9640 1 --2- 172.21.15.49:0/4282953631 >> v2:172.21.15.115:3300/0 conn(0x7fee200b7ea0 0x7fee200d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.501+0000 7fee26cf9640 1 -- 172.21.15.49:0/4282953631 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200d12d0 con 0x7fee200d0a90 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.502+0000 7fee26cf9640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee200d0a90 0x7fee2006f160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fee20066470 tx=0x7fee1802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8fd88d9b66599c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.502+0000 7fee254f6640 1 -- 172.21.15.49:0/4282953631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1802c9e0 con 0x7fee200d0a90 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.502+0000 7fee254f6640 1 -- 172.21.15.49:0/4282953631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1802cb40 con 0x7fee200d0a90 2023-12-19T05:40:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.502+0000 7fee254f6640 1 -- 172.21.15.49:0/4282953631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180343f0 con 0x7fee200d0a90 2023-12-19T05:40:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 -- 172.21.15.49:0/4282953631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee200d0a90 msgr2=0x7fee2006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee200d0a90 0x7fee2006f160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fee20066470 tx=0x7fee1802be40 comp rx=0 tx=0).stop 2023-12-19T05:40:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 -- 172.21.15.49:0/4282953631 shutdown_connections 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee200d0a90 0x7fee2006f160 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 --2- 172.21.15.49:0/4282953631 >> v2:172.21.15.115:3300/0 conn(0x7fee200b7ea0 0x7fee200d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 --2- 172.21.15.49:0/4282953631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee20146e30 0x7fee200b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 -- 172.21.15.49:0/4282953631 >> 172.21.15.49:0/4282953631 conn(0x7fee200b2990 msgr2=0x7fee200b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 -- 172.21.15.49:0/4282953631 shutdown_connections 2023-12-19T05:40:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.503+0000 7fee274fa640 1 -- 172.21.15.49:0/4282953631 wait complete. 2023-12-19T05:40:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.505+0000 7fee274fa640 1 Processor -- start 2023-12-19T05:40:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.505+0000 7fee274fa640 1 -- start start 2023-12-19T05:40:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee200b7ea0 0x7fee20142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee200d0a90 0x7fee200c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200cad90 con 0x7fee20146e30 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200ca180 con 0x7fee200b7ea0 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.506+0000 7fee274fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200ca460 con 0x7fee200d0a90 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60566/0 (socket says 172.21.15.49:60566) 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 -- 172.21.15.49:0/495807989 learned_addr learned my addr 172.21.15.49:0/495807989 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee264f8640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee200b7ea0 0x7fee20142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee25cf7640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee200d0a90 0x7fee200c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 -- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee200d0a90 msgr2=0x7fee200c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee200d0a90 0x7fee200c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 -- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee200b7ea0 msgr2=0x7fee20142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee200b7ea0 0x7fee20142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.507+0000 7fee26cf9640 1 -- 172.21.15.49:0/495807989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18009b30 con 0x7fee20146e30 2023-12-19T05:40:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee26cf9640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fee18036040 tx=0x7fee18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18009510 con 0x7fee20146e30 2023-12-19T05:40:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1803e450 con 0x7fee20146e30 2023-12-19T05:40:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1803e7e0 con 0x7fee20146e30 2023-12-19T05:40:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200ca740 con 0x7fee20146e30 2023-12-19T05:40:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.508+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee200cbe60 con 0x7fee20146e30 2023-12-19T05:40:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.509+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee20061910 con 0x7fee20146e30 2023-12-19T05:40:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.511+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee1803e940 con 0x7fee20146e30 2023-12-19T05:40:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.511+0000 7fee16ffd640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 0x7fee0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.512+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee180ab6c0 con 0x7fee20146e30 2023-12-19T05:40:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.512+0000 7fee264f8640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 0x7fee0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.513+0000 7fee264f8640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 0x7fee0406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006fd0 tx=0x7fee1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.516+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee18076ca0 con 0x7fee20146e30 2023-12-19T05:40:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.746+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee200d1e40 con 0x7fee20146e30 2023-12-19T05:40:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.747+0000 7fee16ffd640 1 -- 172.21.15.49:0/495807989 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fee1807a2c0 con 0x7fee20146e30 2023-12-19T05:40:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:23.749 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:23.749 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 msgr2=0x7fee0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 0x7fee0406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006fd0 tx=0x7fee1c008040 comp rx=0 tx=0).stop 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 msgr2=0x7fee200cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fee18036040 tx=0x7fee18004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 shutdown_connections 2023-12-19T05:40:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee0406a430 0x7fee0406c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee200d0a90 0x7fee200c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee20146e30 0x7fee200cb920 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 --2- 172.21.15.49:0/495807989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee200b7ea0 0x7fee20142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 >> 172.21.15.49:0/495807989 conn(0x7fee200b2990 msgr2=0x7fee200b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 shutdown_connections 2023-12-19T05:40:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.750+0000 7fee274fa640 1 -- 172.21.15.49:0/495807989 wait complete. 2023-12-19T05:40:23.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:23.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.998+0000 7f2ea1217640 1 Processor -- start 2023-12-19T05:40:24.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:23.998+0000 7f2ea1217640 1 -- start start 2023-12-19T05:40:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2ea1217640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e9c157aa0 0x7f2e9c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2ea1217640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e9c15e040 0x7f2e9c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2ea1217640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c06e8c0 con 0x7f2e9c06e410 2023-12-19T05:40:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2ea1217640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c15e9f0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2ea1217640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b2600 con 0x7f2e9c15e040 2023-12-19T05:40:24.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2e9ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e9c157aa0 0x7f2e9c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2e9a59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2e9c06e410 0x7f2e9c161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46254/0 (socket says 172.21.15.49:46254) 2023-12-19T05:40:24.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.000+0000 7f2e9a59c640 1 -- 172.21.15.49:0/1713635794 learned_addr learned my addr 172.21.15.49:0/1713635794 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e9b59e640 1 --2- 172.21.15.49:0/1713635794 >> v2:172.21.15.115:3300/0 conn(0x7f2e9c15e040 0x7f2e9c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e9ad9d640 1 -- 172.21.15.49:0/1713635794 >> v2:172.21.15.115:3300/0 conn(0x7f2e9c15e040 msgr2=0x7f2e9c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e99d9b640 1 -- 172.21.15.49:0/1713635794 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049820259 0 0) 0x7f2e9c06e8c0 con 0x7f2e9c06e410 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e9ad9d640 1 --2- 172.21.15.49:0/1713635794 >> v2:172.21.15.115:3300/0 conn(0x7f2e9c15e040 0x7f2e9c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e9ad9d640 1 -- 172.21.15.49:0/1713635794 >> v1:172.21.15.49:6789/0 conn(0x7f2e9c06e410 legacy=0x7f2e9c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.001+0000 7f2e9ad9d640 1 -- 172.21.15.49:0/1713635794 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0b1d60 con 0x7f2e9c157aa0 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.002+0000 7f2e9ad9d640 1 --2- 172.21.15.49:0/1713635794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c0b1710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b1c50 tx=0x7f2e8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c99e89da6b3679 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2e99d9b640 1 -- 172.21.15.49:0/1713635794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c031830 con 0x7f2e9c157aa0 2023-12-19T05:40:24.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2e99d9b640 1 -- 172.21.15.49:0/1713635794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c031990 con 0x7f2e9c157aa0 2023-12-19T05:40:24.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2e99d9b640 1 -- 172.21.15.49:0/1713635794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c031d20 con 0x7f2e9c157aa0 2023-12-19T05:40:24.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 -- 172.21.15.49:0/1713635794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 msgr2=0x7f2e9c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 --2- 172.21.15.49:0/1713635794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c0b1710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b1c50 tx=0x7f2e8c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 -- 172.21.15.49:0/1713635794 shutdown_connections 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 --2- 172.21.15.49:0/1713635794 >> v2:172.21.15.115:3300/0 conn(0x7f2e9c15e040 0x7f2e9c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 --2- 172.21.15.49:0/1713635794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c0b1710 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.003+0000 7f2ea1217640 1 -- 172.21.15.49:0/1713635794 >> 172.21.15.49:0/1713635794 conn(0x7f2e9c0cbb70 msgr2=0x7f2e9c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.004+0000 7f2ea1217640 1 -- 172.21.15.49:0/1713635794 shutdown_connections 2023-12-19T05:40:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.004+0000 7f2ea1217640 1 -- 172.21.15.49:0/1713635794 wait complete. 2023-12-19T05:40:24.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.005+0000 7f2ea1217640 1 Processor -- start 2023-12-19T05:40:24.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.005+0000 7f2ea1217640 1 -- start start 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e9c06e410 0x7f2e9c143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e9c15e040 0x7f2e9c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c146490 con 0x7f2e9c157aa0 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c146730 con 0x7f2e9c06e410 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.006+0000 7f2ea1217640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c146a10 con 0x7f2e9c15e040 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58954/0 (socket says 172.21.15.49:58954) 2023-12-19T05:40:24.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 -- 172.21.15.49:0/4259524420 learned_addr learned my addr 172.21.15.49:0/4259524420 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:24.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9ad9d640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e9c06e410 0x7f2e9c143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9b59e640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e9c15e040 0x7f2e9c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 -- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e9c15e040 msgr2=0x7f2e9c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e9c15e040 0x7f2e9c158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 -- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e9c06e410 msgr2=0x7f2e9c143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e9c06e410 0x7f2e9c143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.007+0000 7f2e9a59c640 1 -- 172.21.15.49:0/4259524420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009400 con 0x7f2e9c157aa0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2e9a59c640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c430 tx=0x7f2e9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e900074e0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90007660 con 0x7f2e9c157aa0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004a20 con 0x7f2e9c157aa0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c146cf0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.008+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c143fb0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.009+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c06e200 con 0x7f2e9c157aa0 2023-12-19T05:40:24.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.010+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2e90004b80 con 0x7f2e9c157aa0 2023-12-19T05:40:24.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.011+0000 7f2e837fe640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 0x7f2e8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.011+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e90088860 con 0x7f2e9c157aa0 2023-12-19T05:40:24.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.012+0000 7f2e9ad9d640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 0x7f2e8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.013+0000 7f2e9ad9d640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 0x7f2e8806c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c036000 tx=0x7f2e8c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.015+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2e90053db0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.211+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9c061910 con 0x7f2e9c157aa0 2023-12-19T05:40:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.214+0000 7f2e837fe640 1 -- 172.21.15.49:0/4259524420 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f2e900573d0 con 0x7f2e9c157aa0 2023-12-19T05:40:24.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:24.216 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:21.215708+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:24.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 msgr2=0x7f2e8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 0x7f2e8806c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c036000 tx=0x7f2e8c03c040 comp rx=0 tx=0).stop 2023-12-19T05:40:24.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 msgr2=0x7f2e9c1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c430 tx=0x7f2e9000c8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 shutdown_connections 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2e8806a430 0x7f2e8806c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e9c15e040 0x7f2e9c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e9c157aa0 0x7f2e9c1581d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 --2- 172.21.15.49:0/4259524420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e9c06e410 0x7f2e9c143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 >> 172.21.15.49:0/4259524420 conn(0x7f2e9c0cbb70 msgr2=0x7f2e9c0cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 shutdown_connections 2023-12-19T05:40:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.217+0000 7f2ea1217640 1 -- 172.21.15.49:0/4259524420 wait complete. 2023-12-19T05:40:24.237 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:40:24.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:40:24.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.454+0000 7f6307451640 1 Processor -- start 2023-12-19T05:40:24.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.454+0000 7f6307451640 1 -- start start 2023-12-19T05:40:24.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 0x7f63000af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63000b0b50 0x7f630006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f630006b590 0x7f630006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000afb10 con 0x7f63000b0b50 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630006bb30 con 0x7f630006b590 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f6307451640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b0070 con 0x7f63001449e0 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f63049ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63000b0b50 0x7f630006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f63049ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63000b0b50 0x7f630006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58960/0 (socket says 172.21.15.49:58960) 2023-12-19T05:40:24.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.456+0000 7f63049ec640 1 -- 172.21.15.49:0/558283249 learned_addr learned my addr 172.21.15.49:0/558283249 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63051ed640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 0x7f63000af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63059ee640 1 --2- 172.21.15.49:0/558283249 >> v2:172.21.15.115:3300/0 conn(0x7f630006b590 0x7f630006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63049ec640 1 -- 172.21.15.49:0/558283249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 msgr2=0x7f63000af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63049ec640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 0x7f63000af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63049ec640 1 -- 172.21.15.49:0/558283249 >> v2:172.21.15.115:3300/0 conn(0x7f630006b590 msgr2=0x7f630006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63049ec640 1 --2- 172.21.15.49:0/558283249 >> v2:172.21.15.115:3300/0 conn(0x7f630006b590 0x7f630006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63049ec640 1 -- 172.21.15.49:0/558283249 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000b0350 con 0x7f63000b0b50 2023-12-19T05:40:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.457+0000 7f63051ed640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 0x7f63000af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.458+0000 7f63049ec640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63000b0b50 0x7f630006bfa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6300071c50 tx=0x7f62f002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01fba17056947ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.458+0000 7f62f7fff640 1 -- 172.21.15.49:0/558283249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0031860 con 0x7f63000b0b50 2023-12-19T05:40:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f62f7fff640 1 -- 172.21.15.49:0/558283249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00319c0 con 0x7f63000b0b50 2023-12-19T05:40:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f62f7fff640 1 -- 172.21.15.49:0/558283249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0031d50 con 0x7f63000b0b50 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 -- 172.21.15.49:0/558283249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63000b0b50 msgr2=0x7f630006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63000b0b50 0x7f630006bfa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6300071c50 tx=0x7f62f002b900 comp rx=0 tx=0).stop 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 -- 172.21.15.49:0/558283249 shutdown_connections 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 --2- 172.21.15.49:0/558283249 >> v2:172.21.15.115:3300/0 conn(0x7f630006b590 0x7f630006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63000b0b50 0x7f630006bfa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 --2- 172.21.15.49:0/558283249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001449e0 0x7f63000af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.459+0000 7f6307451640 1 -- 172.21.15.49:0/558283249 >> 172.21.15.49:0/558283249 conn(0x7f63000cbb70 msgr2=0x7f63000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.460+0000 7f6307451640 1 -- 172.21.15.49:0/558283249 shutdown_connections 2023-12-19T05:40:24.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.460+0000 7f6307451640 1 -- 172.21.15.49:0/558283249 wait complete. 2023-12-19T05:40:24.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.461+0000 7f6307451640 1 Processor -- start 2023-12-19T05:40:24.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.462+0000 7f6307451640 1 -- start start 2023-12-19T05:40:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.462+0000 7f6307451640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 0x7f630015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.462+0000 7f6307451640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63000b0b50 0x7f630015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.462+0000 7f6307451640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f6307451640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630015ab50 con 0x7f63001449e0 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f6307451640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630013fa50 con 0x7f630006b590 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f6307451640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630013ffd0 con 0x7f63000b0b50 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58962/0 (socket says 172.21.15.49:58962) 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 -- 172.21.15.49:0/1287167339 learned_addr learned my addr 172.21.15.49:0/1287167339 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63051ed640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 0x7f630015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63049ec640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63000b0b50 0x7f630015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 -- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63000b0b50 msgr2=0x7f630015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63000b0b50 0x7f630015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 -- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 msgr2=0x7f630015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 0x7f630015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63059ee640 1 -- 172.21.15.49:0/1287167339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00094d0 con 0x7f63001449e0 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.463+0000 7f63051ed640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 0x7f630015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f63059ee640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007d20 tx=0x7f62f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8014420 con 0x7f63001449e0 2023-12-19T05:40:24.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80145a0 con 0x7f63001449e0 2023-12-19T05:40:24.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8014950 con 0x7f63001449e0 2023-12-19T05:40:24.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63001f3780 con 0x7f63001449e0 2023-12-19T05:40:24.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.464+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63001f34a0 con 0x7f63001449e0 2023-12-19T05:40:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.465+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300061910 con 0x7f63001449e0 2023-12-19T05:40:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.466+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62f8014ab0 con 0x7f63001449e0 2023-12-19T05:40:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.467+0000 7f62f5ffb640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 0x7f62e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.467+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62f8089120 con 0x7f63001449e0 2023-12-19T05:40:24.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.468+0000 7f63051ed640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 0x7f62e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.469+0000 7f63051ed640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 0x7f62e406c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006fd0 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:24.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.472+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62f80547a0 con 0x7f63001449e0 2023-12-19T05:40:24.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.662+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63000ae560 con 0x7f62e406a430 2023-12-19T05:40:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.689+0000 7f62f5ffb640 1 -- 172.21.15.49:0/1287167339 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282796 (secure 0 0 0) 0x7f63000ae560 con 0x7f62e406a430 2023-12-19T05:40:24.694 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:40:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.695+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 msgr2=0x7f62e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.695+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 0x7f62e406c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006fd0 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2023-12-19T05:40:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.695+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 msgr2=0x7f63001f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.695+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007d20 tx=0x7f62f800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 shutdown_connections 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f62e406a430 0x7f62e406c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63000b0b50 0x7f630015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63001449e0 0x7f63001f26a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 --2- 172.21.15.49:0/1287167339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006b590 0x7f630015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 >> 172.21.15.49:0/1287167339 conn(0x7f63000cbb70 msgr2=0x7f63000ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 shutdown_connections 2023-12-19T05:40:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.696+0000 7f6307451640 1 -- 172.21.15.49:0/1287167339 wait complete. 2023-12-19T05:40:24.717 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-12-19T05:40:24.527937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560191,"statfs":{"total":1600000000,"available":1597636112,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.832269"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.229985+0000","last_change":"2023-12-19T05:40:20.229317+0000","last_active":"2023-12-19T05:40:20.229985+0000","last_peered":"2023-12-19T05:40:20.229985+0000","last_clean":"2023-12-19T05:40:20.229985+0000","last_became_active":"2023-12-19T05:40:20.228657+0000","last_became_peered":"2023-12-19T05:40:20.228657+0000","last_unstale":"2023-12-19T05:40:20.229985+0000","last_undegraded":"2023-12-19T05:40:20.229985+0000","last_fullsized":"2023-12-19T05:40:20.229985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230720+0000","last_change":"2023-12-19T05:40:20.247748+0000","last_active":"2023-12-19T05:40:21.230720+0000","last_peered":"2023-12-19T05:40:21.230720+0000","last_clean":"2023-12-19T05:40:21.230720+0000","last_became_active":"2023-12-19T05:40:20.247464+0000","last_became_peered":"2023-12-19T05:40:20.247464+0000","last_unstale":"2023-12-19T05:40:21.230720+0000","last_undegraded":"2023-12-19T05:40:21.230720+0000","last_fullsized":"2023-12-19T05:40:21.230720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230901+0000","last_change":"2023-12-19T05:40:20.230357+0000","last_active":"2023-12-19T05:40:20.230901+0000","last_peered":"2023-12-19T05:40:20.230901+0000","last_clean":"2023-12-19T05:40:20.230901+0000","last_became_active":"2023-12-19T05:40:20.230136+0000","last_became_peered":"2023-12-19T05:40:20.230136+0000","last_unstale":"2023-12-19T05:40:20.230901+0000","last_undegraded":"2023-12-19T05:40:20.230901+0000","last_fullsized":"2023-12-19T05:40:20.230901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:37.971569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.255444+0000","last_change":"2023-12-19T05:40:20.255310+0000","last_active":"2023-12-19T05:40:20.255444+0000","last_peered":"2023-12-19T05:40:20.255444+0000","last_clean":"2023-12-19T05:40:20.255444+0000","last_became_active":"2023-12-19T05:40:20.251734+0000","last_became_peered":"2023-12-19T05:40:20.251734+0000","last_unstale":"2023-12-19T05:40:20.255444+0000","last_undegraded":"2023-12-19T05:40:20.255444+0000","last_fullsized":"2023-12-19T05:40:20.255444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:25.695782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232270+0000","last_change":"2023-12-19T05:40:20.247913+0000","last_active":"2023-12-19T05:40:21.232270+0000","last_peered":"2023-12-19T05:40:21.232270+0000","last_clean":"2023-12-19T05:40:21.232270+0000","last_became_active":"2023-12-19T05:40:20.247579+0000","last_became_peered":"2023-12-19T05:40:20.247579+0000","last_unstale":"2023-12-19T05:40:21.232270+0000","last_undegraded":"2023-12-19T05:40:21.232270+0000","last_fullsized":"2023-12-19T05:40:21.232270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230254+0000","last_change":"2023-12-19T05:40:20.246662+0000","last_active":"2023-12-19T05:40:21.230254+0000","last_peered":"2023-12-19T05:40:21.230254+0000","last_clean":"2023-12-19T05:40:21.230254+0000","last_became_active":"2023-12-19T05:40:20.243071+0000","last_became_peered":"2023-12-19T05:40:20.243071+0000","last_unstale":"2023-12-19T05:40:21.230254+0000","last_undegraded":"2023-12-19T05:40:21.230254+0000","last_fullsized":"2023-12-19T05:40:21.230254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:11:36.351550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230957+0000","last_change":"2023-12-19T05:40:20.230880+0000","last_active":"2023-12-19T05:40:20.230957+0000","last_peered":"2023-12-19T05:40:20.230957+0000","last_clean":"2023-12-19T05:40:20.230957+0000","last_became_active":"2023-12-19T05:40:20.230657+0000","last_became_peered":"2023-12-19T05:40:20.230657+0000","last_unstale":"2023-12-19T05:40:20.230957+0000","last_undegraded":"2023-12-19T05:40:20.230957+0000","last_fullsized":"2023-12-19T05:40:20.230957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248375+0000","last_change":"2023-12-19T05:40:20.248322+0000","last_active":"2023-12-19T05:40:20.248375+0000","last_peered":"2023-12-19T05:40:20.248375+0000","last_clean":"2023-12-19T05:40:20.248375+0000","last_became_active":"2023-12-19T05:40:20.247877+0000","last_became_peered":"2023-12-19T05:40:20.247877+0000","last_unstale":"2023-12-19T05:40:20.248375+0000","last_undegraded":"2023-12-19T05:40:20.248375+0000","last_fullsized":"2023-12-19T05:40:20.248375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:51.283588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254972+0000","last_change":"2023-12-19T05:40:20.254893+0000","last_active":"2023-12-19T05:40:20.254972+0000","last_peered":"2023-12-19T05:40:20.254972+0000","last_clean":"2023-12-19T05:40:20.254972+0000","last_became_active":"2023-12-19T05:40:20.254642+0000","last_became_peered":"2023-12-19T05:40:20.254642+0000","last_unstale":"2023-12-19T05:40:20.254972+0000","last_undegraded":"2023-12-19T05:40:20.254972+0000","last_fullsized":"2023-12-19T05:40:20.254972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:53.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.251345+0000","last_change":"2023-12-19T05:40:20.250664+0000","last_active":"2023-12-19T05:40:20.251345+0000","last_peered":"2023-12-19T05:40:20.251345+0000","last_clean":"2023-12-19T05:40:20.251345+0000","last_became_active":"2023-12-19T05:40:20.250262+0000","last_became_peered":"2023-12-19T05:40:20.250262+0000","last_unstale":"2023-12-19T05:40:20.251345+0000","last_undegraded":"2023-12-19T05:40:20.251345+0000","last_fullsized":"2023-12-19T05:40:20.251345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228317+0000","last_change":"2023-12-19T05:40:20.245745+0000","last_active":"2023-12-19T05:40:21.228317+0000","last_peered":"2023-12-19T05:40:21.228317+0000","last_clean":"2023-12-19T05:40:21.228317+0000","last_became_active":"2023-12-19T05:40:20.245385+0000","last_became_peered":"2023-12-19T05:40:20.245385+0000","last_unstale":"2023-12-19T05:40:21.228317+0000","last_undegraded":"2023-12-19T05:40:21.228317+0000","last_fullsized":"2023-12-19T05:40:21.228317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:23.694304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.242198+0000","last_change":"2023-12-19T05:40:20.241880+0000","last_active":"2023-12-19T05:40:20.242198+0000","last_peered":"2023-12-19T05:40:20.242198+0000","last_clean":"2023-12-19T05:40:20.242198+0000","last_became_active":"2023-12-19T05:40:20.241625+0000","last_became_peered":"2023-12-19T05:40:20.241625+0000","last_unstale":"2023-12-19T05:40:20.242198+0000","last_undegraded":"2023-12-19T05:40:20.242198+0000","last_fullsized":"2023-12-19T05:40:20.242198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:43.519731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101464+0000","last_change":"2023-12-19T05:40:20.249050+0000","last_active":"2023-12-19T05:40:22.101464+0000","last_peered":"2023-12-19T05:40:22.101464+0000","last_clean":"2023-12-19T05:40:22.101464+0000","last_became_active":"2023-12-19T05:40:20.248484+0000","last_became_peered":"2023-12-19T05:40:20.248484+0000","last_unstale":"2023-12-19T05:40:22.101464+0000","last_undegraded":"2023-12-19T05:40:22.101464+0000","last_fullsized":"2023-12-19T05:40:22.101464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:06:55.544888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.256135+0000","last_change":"2023-12-19T05:40:20.256044+0000","last_active":"2023-12-19T05:40:20.256135+0000","last_peered":"2023-12-19T05:40:20.256135+0000","last_clean":"2023-12-19T05:40:20.256135+0000","last_became_active":"2023-12-19T05:40:20.254928+0000","last_became_peered":"2023-12-19T05:40:20.254928+0000","last_unstale":"2023-12-19T05:40:20.256135+0000","last_undegraded":"2023-12-19T05:40:20.256135+0000","last_fullsized":"2023-12-19T05:40:20.256135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.232443+0000","last_change":"2023-12-19T05:40:20.232215+0000","last_active":"2023-12-19T05:40:20.232443+0000","last_peered":"2023-12-19T05:40:20.232443+0000","last_clean":"2023-12-19T05:40:20.232443+0000","last_became_active":"2023-12-19T05:40:20.230243+0000","last_became_peered":"2023-12-19T05:40:20.230243+0000","last_unstale":"2023-12-19T05:40:20.232443+0000","last_undegraded":"2023-12-19T05:40:20.232443+0000","last_fullsized":"2023-12-19T05:40:20.232443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241463+0000","last_change":"2023-12-19T05:40:20.241323+0000","last_active":"2023-12-19T05:40:20.241463+0000","last_peered":"2023-12-19T05:40:20.241463+0000","last_clean":"2023-12-19T05:40:20.241463+0000","last_became_active":"2023-12-19T05:40:20.241027+0000","last_became_peered":"2023-12-19T05:40:20.241027+0000","last_unstale":"2023-12-19T05:40:20.241463+0000","last_undegraded":"2023-12-19T05:40:20.241463+0000","last_fullsized":"2023-12-19T05:40:20.241463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228258+0000","last_change":"2023-12-19T05:40:20.238091+0000","last_active":"2023-12-19T05:40:21.228258+0000","last_peered":"2023-12-19T05:40:21.228258+0000","last_clean":"2023-12-19T05:40:21.228258+0000","last_became_active":"2023-12-19T05:40:20.236003+0000","last_became_peered":"2023-12-19T05:40:20.236003+0000","last_unstale":"2023-12-19T05:40:21.228258+0000","last_undegraded":"2023-12-19T05:40:21.228258+0000","last_fullsized":"2023-12-19T05:40:21.228258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:26:34.619745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230182+0000","last_change":"2023-12-19T05:40:20.248628+0000","last_active":"2023-12-19T05:40:21.230182+0000","last_peered":"2023-12-19T05:40:21.230182+0000","last_clean":"2023-12-19T05:40:21.230182+0000","last_became_active":"2023-12-19T05:40:20.248292+0000","last_became_peered":"2023-12-19T05:40:20.248292+0000","last_unstale":"2023-12-19T05:40:21.230182+0000","last_undegraded":"2023-12-19T05:40:21.230182+0000","last_fullsized":"2023-12-19T05:40:21.230182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:11.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229537+0000","last_change":"2023-12-19T05:40:20.244576+0000","last_active":"2023-12-19T05:40:21.229537+0000","last_peered":"2023-12-19T05:40:21.229537+0000","last_clean":"2023-12-19T05:40:21.229537+0000","last_became_active":"2023-12-19T05:40:20.244215+0000","last_became_peered":"2023-12-19T05:40:20.244215+0000","last_unstale":"2023-12-19T05:40:21.229537+0000","last_undegraded":"2023-12-19T05:40:21.229537+0000","last_fullsized":"2023-12-19T05:40:21.229537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.493216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101394+0000","last_change":"2023-12-19T05:40:20.247543+0000","last_active":"2023-12-19T05:40:22.101394+0000","last_peered":"2023-12-19T05:40:22.101394+0000","last_clean":"2023-12-19T05:40:22.101394+0000","last_became_active":"2023-12-19T05:40:20.247320+0000","last_became_peered":"2023-12-19T05:40:20.247320+0000","last_unstale":"2023-12-19T05:40:22.101394+0000","last_undegraded":"2023-12-19T05:40:22.101394+0000","last_fullsized":"2023-12-19T05:40:22.101394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:52.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.242896+0000","last_change":"2023-12-19T05:40:20.242756+0000","last_active":"2023-12-19T05:40:20.242896+0000","last_peered":"2023-12-19T05:40:20.242896+0000","last_clean":"2023-12-19T05:40:20.242896+0000","last_became_active":"2023-12-19T05:40:20.242566+0000","last_became_peered":"2023-12-19T05:40:20.242566+0000","last_unstale":"2023-12-19T05:40:20.242896+0000","last_undegraded":"2023-12-19T05:40:20.242896+0000","last_fullsized":"2023-12-19T05:40:20.242896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241832+0000","last_change":"2023-12-19T05:40:20.241687+0000","last_active":"2023-12-19T05:40:20.241832+0000","last_peered":"2023-12-19T05:40:20.241832+0000","last_clean":"2023-12-19T05:40:20.241832+0000","last_became_active":"2023-12-19T05:40:20.241448+0000","last_became_peered":"2023-12-19T05:40:20.241448+0000","last_unstale":"2023-12-19T05:40:20.241832+0000","last_undegraded":"2023-12-19T05:40:20.241832+0000","last_fullsized":"2023-12-19T05:40:20.241832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101713+0000","last_change":"2023-12-19T05:40:20.244063+0000","last_active":"2023-12-19T05:40:22.101713+0000","last_peered":"2023-12-19T05:40:22.101713+0000","last_clean":"2023-12-19T05:40:22.101713+0000","last_became_active":"2023-12-19T05:40:20.243737+0000","last_became_peered":"2023-12-19T05:40:20.243737+0000","last_unstale":"2023-12-19T05:40:22.101713+0000","last_undegraded":"2023-12-19T05:40:22.101713+0000","last_fullsized":"2023-12-19T05:40:22.101713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:27:54.579039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254088+0000","last_change":"2023-12-19T05:40:20.254008+0000","last_active":"2023-12-19T05:40:20.254088+0000","last_peered":"2023-12-19T05:40:20.254088+0000","last_clean":"2023-12-19T05:40:20.254088+0000","last_became_active":"2023-12-19T05:40:20.253648+0000","last_became_peered":"2023-12-19T05:40:20.253648+0000","last_unstale":"2023-12-19T05:40:20.254088+0000","last_undegraded":"2023-12-19T05:40:20.254088+0000","last_fullsized":"2023-12-19T05:40:20.254088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244337+0000","last_change":"2023-12-19T05:40:20.242364+0000","last_active":"2023-12-19T05:40:20.244337+0000","last_peered":"2023-12-19T05:40:20.244337+0000","last_clean":"2023-12-19T05:40:20.244337+0000","last_became_active":"2023-12-19T05:40:20.242072+0000","last_became_peered":"2023-12-19T05:40:20.242072+0000","last_unstale":"2023-12-19T05:40:20.244337+0000","last_undegraded":"2023-12-19T05:40:20.244337+0000","last_fullsized":"2023-12-19T05:40:20.244337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:51.283588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241164+0000","last_change":"2023-12-19T05:40:20.240932+0000","last_active":"2023-12-19T05:40:20.241164+0000","last_peered":"2023-12-19T05:40:20.241164+0000","last_clean":"2023-12-19T05:40:20.241164+0000","last_became_active":"2023-12-19T05:40:20.240430+0000","last_became_peered":"2023-12-19T05:40:20.240430+0000","last_unstale":"2023-12-19T05:40:20.241164+0000","last_undegraded":"2023-12-19T05:40:20.241164+0000","last_fullsized":"2023-12-19T05:40:20.241164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232572+0000","last_change":"2023-12-19T05:40:20.227078+0000","last_active":"2023-12-19T05:40:21.232572+0000","last_peered":"2023-12-19T05:40:21.232572+0000","last_clean":"2023-12-19T05:40:21.232572+0000","last_became_active":"2023-12-19T05:40:20.226462+0000","last_became_peered":"2023-12-19T05:40:20.226462+0000","last_unstale":"2023-12-19T05:40:21.232572+0000","last_undegraded":"2023-12-19T05:40:21.232572+0000","last_fullsized":"2023-12-19T05:40:21.232572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248286+0000","last_change":"2023-12-19T05:40:20.248217+0000","last_active":"2023-12-19T05:40:20.248286+0000","last_peered":"2023-12-19T05:40:20.248286+0000","last_clean":"2023-12-19T05:40:20.248286+0000","last_became_active":"2023-12-19T05:40:20.247530+0000","last_became_peered":"2023-12-19T05:40:20.247530+0000","last_unstale":"2023-12-19T05:40:20.248286+0000","last_undegraded":"2023-12-19T05:40:20.248286+0000","last_fullsized":"2023-12-19T05:40:20.248286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.247267+0000","last_change":"2023-12-19T05:40:20.247168+0000","last_active":"2023-12-19T05:40:20.247267+0000","last_peered":"2023-12-19T05:40:20.247267+0000","last_clean":"2023-12-19T05:40:20.247267+0000","last_became_active":"2023-12-19T05:40:20.246877+0000","last_became_peered":"2023-12-19T05:40:20.246877+0000","last_unstale":"2023-12-19T05:40:20.247267+0000","last_undegraded":"2023-12-19T05:40:20.247267+0000","last_fullsized":"2023-12-19T05:40:20.247267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.222651+0000","last_change":"2023-12-19T05:40:20.222584+0000","last_active":"2023-12-19T05:40:20.222651+0000","last_peered":"2023-12-19T05:40:20.222651+0000","last_clean":"2023-12-19T05:40:20.222651+0000","last_became_active":"2023-12-19T05:40:20.222339+0000","last_became_peered":"2023-12-19T05:40:20.222339+0000","last_unstale":"2023-12-19T05:40:20.222651+0000","last_undegraded":"2023-12-19T05:40:20.222651+0000","last_fullsized":"2023-12-19T05:40:20.222651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244342+0000","last_change":"2023-12-19T05:40:20.244267+0000","last_active":"2023-12-19T05:40:20.244342+0000","last_peered":"2023-12-19T05:40:20.244342+0000","last_clean":"2023-12-19T05:40:20.244342+0000","last_became_active":"2023-12-19T05:40:20.243994+0000","last_became_peered":"2023-12-19T05:40:20.243994+0000","last_unstale":"2023-12-19T05:40:20.244342+0000","last_undegraded":"2023-12-19T05:40:20.244342+0000","last_fullsized":"2023-12-19T05:40:20.244342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228415+0000","last_change":"2023-12-19T05:40:20.237891+0000","last_active":"2023-12-19T05:40:21.228415+0000","last_peered":"2023-12-19T05:40:21.228415+0000","last_clean":"2023-12-19T05:40:21.228415+0000","last_became_active":"2023-12-19T05:40:20.232079+0000","last_became_peered":"2023-12-19T05:40:20.232079+0000","last_unstale":"2023-12-19T05:40:21.228415+0000","last_undegraded":"2023-12-19T05:40:21.228415+0000","last_fullsized":"2023-12-19T05:40:21.228415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:12:44.500392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.100678+0000","last_change":"2023-12-19T05:40:20.242610+0000","last_active":"2023-12-19T05:40:22.100678+0000","last_peered":"2023-12-19T05:40:22.100678+0000","last_clean":"2023-12-19T05:40:22.100678+0000","last_became_active":"2023-12-19T05:40:20.242287+0000","last_became_peered":"2023-12-19T05:40:20.242287+0000","last_unstale":"2023-12-19T05:40:22.100678+0000","last_undegraded":"2023-12-19T05:40:22.100678+0000","last_fullsized":"2023-12-19T05:40:22.100678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228447+0000","last_change":"2023-12-19T05:40:19.719012+0000","last_active":"2023-12-19T05:40:21.228447+0000","last_peered":"2023-12-19T05:40:21.228447+0000","last_clean":"2023-12-19T05:40:21.228447+0000","last_became_active":"2023-12-19T05:40:19.718674+0000","last_became_peered":"2023-12-19T05:40:19.718674+0000","last_unstale":"2023-12-19T05:40:21.228447+0000","last_undegraded":"2023-12-19T05:40:21.228447+0000","last_fullsized":"2023-12-19T05:40:21.228447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:15.034944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235152+0000","last_change":"2023-12-19T05:40:20.235080+0000","last_active":"2023-12-19T05:40:20.235152+0000","last_peered":"2023-12-19T05:40:20.235152+0000","last_clean":"2023-12-19T05:40:20.235152+0000","last_became_active":"2023-12-19T05:40:20.234817+0000","last_became_peered":"2023-12-19T05:40:20.234817+0000","last_unstale":"2023-12-19T05:40:20.235152+0000","last_undegraded":"2023-12-19T05:40:20.235152+0000","last_fullsized":"2023-12-19T05:40:20.235152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:06:55.544888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.257076+0000","last_change":"2023-12-19T05:40:19.729766+0000","last_active":"2023-12-19T05:40:20.257076+0000","last_peered":"2023-12-19T05:40:20.257076+0000","last_clean":"2023-12-19T05:40:20.257076+0000","last_became_active":"2023-12-19T05:40:19.727213+0000","last_became_peered":"2023-12-19T05:40:19.727213+0000","last_unstale":"2023-12-19T05:40:20.257076+0000","last_undegraded":"2023-12-19T05:40:20.257076+0000","last_fullsized":"2023-12-19T05:40:20.257076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241815+0000","last_change":"2023-12-19T05:40:20.241661+0000","last_active":"2023-12-19T05:40:20.241815+0000","last_peered":"2023-12-19T05:40:20.241815+0000","last_clean":"2023-12-19T05:40:20.241815+0000","last_became_active":"2023-12-19T05:40:20.241472+0000","last_became_peered":"2023-12-19T05:40:20.241472+0000","last_unstale":"2023-12-19T05:40:20.241815+0000","last_undegraded":"2023-12-19T05:40:20.241815+0000","last_fullsized":"2023-12-19T05:40:20.241815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231450+0000","last_change":"2023-12-19T05:40:19.729838+0000","last_active":"2023-12-19T05:40:21.231450+0000","last_peered":"2023-12-19T05:40:21.231450+0000","last_clean":"2023-12-19T05:40:21.231450+0000","last_became_active":"2023-12-19T05:40:19.729574+0000","last_became_peered":"2023-12-19T05:40:19.729574+0000","last_unstale":"2023-12-19T05:40:21.231450+0000","last_undegraded":"2023-12-19T05:40:21.231450+0000","last_fullsized":"2023-12-19T05:40:21.231450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:10.052480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248073+0000","last_change":"2023-12-19T05:40:20.246747+0000","last_active":"2023-12-19T05:40:20.248073+0000","last_peered":"2023-12-19T05:40:20.248073+0000","last_clean":"2023-12-19T05:40:20.248073+0000","last_became_active":"2023-12-19T05:40:20.246434+0000","last_became_peered":"2023-12-19T05:40:20.246434+0000","last_unstale":"2023-12-19T05:40:20.248073+0000","last_undegraded":"2023-12-19T05:40:20.248073+0000","last_fullsized":"2023-12-19T05:40:20.248073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244962+0000","last_change":"2023-12-19T05:40:19.728204+0000","last_active":"2023-12-19T05:40:20.244962+0000","last_peered":"2023-12-19T05:40:20.244962+0000","last_clean":"2023-12-19T05:40:20.244962+0000","last_became_active":"2023-12-19T05:40:19.727915+0000","last_became_peered":"2023-12-19T05:40:19.727915+0000","last_unstale":"2023-12-19T05:40:20.244962+0000","last_undegraded":"2023-12-19T05:40:20.244962+0000","last_fullsized":"2023-12-19T05:40:20.244962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:02.753984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.245490+0000","last_change":"2023-12-19T05:40:20.245401+0000","last_active":"2023-12-19T05:40:20.245490+0000","last_peered":"2023-12-19T05:40:20.245490+0000","last_clean":"2023-12-19T05:40:20.245490+0000","last_became_active":"2023-12-19T05:40:20.245216+0000","last_became_peered":"2023-12-19T05:40:20.245216+0000","last_unstale":"2023-12-19T05:40:20.245490+0000","last_undegraded":"2023-12-19T05:40:20.245490+0000","last_fullsized":"2023-12-19T05:40:20.245490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:40.143754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.243694+0000","last_change":"2023-12-19T05:40:19.726917+0000","last_active":"2023-12-19T05:40:20.243694+0000","last_peered":"2023-12-19T05:40:20.243694+0000","last_clean":"2023-12-19T05:40:20.243694+0000","last_became_active":"2023-12-19T05:40:19.726268+0000","last_became_peered":"2023-12-19T05:40:19.726268+0000","last_unstale":"2023-12-19T05:40:20.243694+0000","last_undegraded":"2023-12-19T05:40:20.243694+0000","last_fullsized":"2023-12-19T05:40:20.243694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:42.508332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244936+0000","last_change":"2023-12-19T05:40:20.244846+0000","last_active":"2023-12-19T05:40:20.244936+0000","last_peered":"2023-12-19T05:40:20.244936+0000","last_clean":"2023-12-19T05:40:20.244936+0000","last_became_active":"2023-12-19T05:40:20.244621+0000","last_became_peered":"2023-12-19T05:40:20.244621+0000","last_unstale":"2023-12-19T05:40:20.244936+0000","last_undegraded":"2023-12-19T05:40:20.244936+0000","last_fullsized":"2023-12-19T05:40:20.244936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248045+0000","last_change":"2023-12-19T05:40:19.730340+0000","last_active":"2023-12-19T05:40:20.248045+0000","last_peered":"2023-12-19T05:40:20.248045+0000","last_clean":"2023-12-19T05:40:20.248045+0000","last_became_active":"2023-12-19T05:40:19.729933+0000","last_became_peered":"2023-12-19T05:40:19.729933+0000","last_unstale":"2023-12-19T05:40:20.248045+0000","last_undegraded":"2023-12-19T05:40:20.248045+0000","last_fullsized":"2023-12-19T05:40:20.248045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:22.630482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235317+0000","last_change":"2023-12-19T05:40:20.235230+0000","last_active":"2023-12-19T05:40:20.235317+0000","last_peered":"2023-12-19T05:40:20.235317+0000","last_clean":"2023-12-19T05:40:20.235317+0000","last_became_active":"2023-12-19T05:40:20.234756+0000","last_became_peered":"2023-12-19T05:40:20.234756+0000","last_unstale":"2023-12-19T05:40:20.235317+0000","last_undegraded":"2023-12-19T05:40:20.235317+0000","last_fullsized":"2023-12-19T05:40:20.235317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:03.765382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230059+0000","last_change":"2023-12-19T05:40:19.729285+0000","last_active":"2023-12-19T05:40:21.230059+0000","last_peered":"2023-12-19T05:40:21.230059+0000","last_clean":"2023-12-19T05:40:21.230059+0000","last_became_active":"2023-12-19T05:40:19.726759+0000","last_became_peered":"2023-12-19T05:40:19.726759+0000","last_unstale":"2023-12-19T05:40:21.230059+0000","last_undegraded":"2023-12-19T05:40:21.230059+0000","last_fullsized":"2023-12-19T05:40:21.230059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:16.477575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.255621+0000","last_change":"2023-12-19T05:40:20.255470+0000","last_active":"2023-12-19T05:40:20.255621+0000","last_peered":"2023-12-19T05:40:20.255621+0000","last_clean":"2023-12-19T05:40:20.255621+0000","last_became_active":"2023-12-19T05:40:20.252154+0000","last_became_peered":"2023-12-19T05:40:20.252154+0000","last_unstale":"2023-12-19T05:40:20.255621+0000","last_undegraded":"2023-12-19T05:40:20.255621+0000","last_fullsized":"2023-12-19T05:40:20.255621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.227320+0000","last_change":"2023-12-19T05:40:19.728524+0000","last_active":"2023-12-19T05:40:20.227320+0000","last_peered":"2023-12-19T05:40:20.227320+0000","last_clean":"2023-12-19T05:40:20.227320+0000","last_became_active":"2023-12-19T05:40:19.728007+0000","last_became_peered":"2023-12-19T05:40:19.728007+0000","last_unstale":"2023-12-19T05:40:20.227320+0000","last_undegraded":"2023-12-19T05:40:20.227320+0000","last_fullsized":"2023-12-19T05:40:20.227320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228795+0000","last_change":"2023-12-19T05:40:20.242392+0000","last_active":"2023-12-19T05:40:21.228795+0000","last_peered":"2023-12-19T05:40:21.228795+0000","last_clean":"2023-12-19T05:40:21.228795+0000","last_became_active":"2023-12-19T05:40:20.242191+0000","last_became_peered":"2023-12-19T05:40:20.242191+0000","last_unstale":"2023-12-19T05:40:21.228795+0000","last_undegraded":"2023-12-19T05:40:21.228795+0000","last_fullsized":"2023-12-19T05:40:21.228795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:17.961210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231529+0000","last_change":"2023-12-19T05:40:19.725647+0000","last_active":"2023-12-19T05:40:21.231529+0000","last_peered":"2023-12-19T05:40:21.231529+0000","last_clean":"2023-12-19T05:40:21.231529+0000","last_became_active":"2023-12-19T05:40:19.725363+0000","last_became_peered":"2023-12-19T05:40:19.725363+0000","last_unstale":"2023-12-19T05:40:21.231529+0000","last_undegraded":"2023-12-19T05:40:21.231529+0000","last_fullsized":"2023-12-19T05:40:21.231529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:40.169550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.250806+0000","last_change":"2023-12-19T05:40:20.250483+0000","last_active":"2023-12-19T05:40:20.250806+0000","last_peered":"2023-12-19T05:40:20.250806+0000","last_clean":"2023-12-19T05:40:20.250806+0000","last_became_active":"2023-12-19T05:40:20.250239+0000","last_became_peered":"2023-12-19T05:40:20.250239+0000","last_unstale":"2023-12-19T05:40:20.250806+0000","last_undegraded":"2023-12-19T05:40:20.250806+0000","last_fullsized":"2023-12-19T05:40:20.250806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:08:07.417227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.233147+0000","last_change":"2023-12-19T05:40:19.718227+0000","last_active":"2023-12-19T05:40:21.233147+0000","last_peered":"2023-12-19T05:40:21.233147+0000","last_clean":"2023-12-19T05:40:21.233147+0000","last_became_active":"2023-12-19T05:40:19.717805+0000","last_became_peered":"2023-12-19T05:40:19.717805+0000","last_unstale":"2023-12-19T05:40:21.233147+0000","last_undegraded":"2023-12-19T05:40:21.233147+0000","last_fullsized":"2023-12-19T05:40:21.233147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:22:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254248+0000","last_change":"2023-12-19T05:40:20.254144+0000","last_active":"2023-12-19T05:40:20.254248+0000","last_peered":"2023-12-19T05:40:20.254248+0000","last_clean":"2023-12-19T05:40:20.254248+0000","last_became_active":"2023-12-19T05:40:20.246052+0000","last_became_peered":"2023-12-19T05:40:20.246052+0000","last_unstale":"2023-12-19T05:40:20.254248+0000","last_undegraded":"2023-12-19T05:40:20.254248+0000","last_fullsized":"2023-12-19T05:40:20.254248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:15.110325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228733+0000","last_change":"2023-12-19T05:40:19.724957+0000","last_active":"2023-12-19T05:40:21.228733+0000","last_peered":"2023-12-19T05:40:21.228733+0000","last_clean":"2023-12-19T05:40:21.228733+0000","last_became_active":"2023-12-19T05:40:19.724366+0000","last_became_peered":"2023-12-19T05:40:19.724366+0000","last_unstale":"2023-12-19T05:40:21.228733+0000","last_undegraded":"2023-12-19T05:40:21.228733+0000","last_fullsized":"2023-12-19T05:40:21.228733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:52.476210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228291+0000","last_change":"2023-12-19T05:40:20.245608+0000","last_active":"2023-12-19T05:40:21.228291+0000","last_peered":"2023-12-19T05:40:21.228291+0000","last_clean":"2023-12-19T05:40:21.228291+0000","last_became_active":"2023-12-19T05:40:20.245381+0000","last_became_peered":"2023-12-19T05:40:20.245381+0000","last_unstale":"2023-12-19T05:40:21.228291+0000","last_undegraded":"2023-12-19T05:40:21.228291+0000","last_fullsized":"2023-12-19T05:40:21.228291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:44.469491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101198+0000","last_change":"2023-12-19T05:40:19.731947+0000","last_active":"2023-12-19T05:40:22.101198+0000","last_peered":"2023-12-19T05:40:22.101198+0000","last_clean":"2023-12-19T05:40:22.101198+0000","last_became_active":"2023-12-19T05:40:19.731752+0000","last_became_peered":"2023-12-19T05:40:19.731752+0000","last_unstale":"2023-12-19T05:40:22.101198+0000","last_undegraded":"2023-12-19T05:40:22.101198+0000","last_fullsized":"2023-12-19T05:40:22.101198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:52.007533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101285+0000","last_change":"2023-12-19T05:40:20.250240+0000","last_active":"2023-12-19T05:40:22.101285+0000","last_peered":"2023-12-19T05:40:22.101285+0000","last_clean":"2023-12-19T05:40:22.101285+0000","last_became_active":"2023-12-19T05:40:20.249041+0000","last_became_peered":"2023-12-19T05:40:20.249041+0000","last_unstale":"2023-12-19T05:40:22.101285+0000","last_undegraded":"2023-12-19T05:40:22.101285+0000","last_fullsized":"2023-12-19T05:40:22.101285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.239402+0000","last_change":"2023-12-19T05:40:19.728381+0000","last_active":"2023-12-19T05:40:20.239402+0000","last_peered":"2023-12-19T05:40:20.239402+0000","last_clean":"2023-12-19T05:40:20.239402+0000","last_became_active":"2023-12-19T05:40:19.727659+0000","last_became_peered":"2023-12-19T05:40:19.727659+0000","last_unstale":"2023-12-19T05:40:20.239402+0000","last_undegraded":"2023-12-19T05:40:20.239402+0000","last_fullsized":"2023-12-19T05:40:20.239402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:36.960170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248051+0000","last_change":"2023-12-19T05:40:20.246148+0000","last_active":"2023-12-19T05:40:20.248051+0000","last_peered":"2023-12-19T05:40:20.248051+0000","last_clean":"2023-12-19T05:40:20.248051+0000","last_became_active":"2023-12-19T05:40:20.245121+0000","last_became_peered":"2023-12-19T05:40:20.245121+0000","last_unstale":"2023-12-19T05:40:20.248051+0000","last_undegraded":"2023-12-19T05:40:20.248051+0000","last_fullsized":"2023-12-19T05:40:20.248051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.236639+0000","last_change":"2023-12-19T05:40:19.721544+0000","last_active":"2023-12-19T05:40:20.236639+0000","last_peered":"2023-12-19T05:40:20.236639+0000","last_clean":"2023-12-19T05:40:20.236639+0000","last_became_active":"2023-12-19T05:40:19.720808+0000","last_became_peered":"2023-12-19T05:40:19.720808+0000","last_unstale":"2023-12-19T05:40:20.236639+0000","last_undegraded":"2023-12-19T05:40:20.236639+0000","last_fullsized":"2023-12-19T05:40:20.236639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:41.633853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230099+0000","last_change":"2023-12-19T05:40:20.229781+0000","last_active":"2023-12-19T05:40:20.230099+0000","last_peered":"2023-12-19T05:40:20.230099+0000","last_clean":"2023-12-19T05:40:20.230099+0000","last_became_active":"2023-12-19T05:40:20.229590+0000","last_became_peered":"2023-12-19T05:40:20.229590+0000","last_unstale":"2023-12-19T05:40:20.230099+0000","last_undegraded":"2023-12-19T05:40:20.230099+0000","last_fullsized":"2023-12-19T05:40:20.230099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230273+0000","last_change":"2023-12-19T05:40:19.727129+0000","last_active":"2023-12-19T05:40:20.230273+0000","last_peered":"2023-12-19T05:40:20.230273+0000","last_clean":"2023-12-19T05:40:20.230273+0000","last_became_active":"2023-12-19T05:40:19.726703+0000","last_became_peered":"2023-12-19T05:40:19.726703+0000","last_unstale":"2023-12-19T05:40:20.230273+0000","last_undegraded":"2023-12-19T05:40:20.230273+0000","last_fullsized":"2023-12-19T05:40:20.230273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:36.960170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228549+0000","last_change":"2023-12-19T05:40:20.236252+0000","last_active":"2023-12-19T05:40:21.228549+0000","last_peered":"2023-12-19T05:40:21.228549+0000","last_clean":"2023-12-19T05:40:21.228549+0000","last_became_active":"2023-12-19T05:40:20.231699+0000","last_became_peered":"2023-12-19T05:40:20.231699+0000","last_unstale":"2023-12-19T05:40:21.228549+0000","last_undegraded":"2023-12-19T05:40:21.228549+0000","last_fullsized":"2023-12-19T05:40:21.228549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:54.921257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230669+0000","last_change":"2023-12-19T05:40:19.727055+0000","last_active":"2023-12-19T05:40:21.230669+0000","last_peered":"2023-12-19T05:40:21.230669+0000","last_clean":"2023-12-19T05:40:21.230669+0000","last_became_active":"2023-12-19T05:40:19.726793+0000","last_became_peered":"2023-12-19T05:40:19.726793+0000","last_unstale":"2023-12-19T05:40:21.230669+0000","last_undegraded":"2023-12-19T05:40:21.230669+0000","last_fullsized":"2023-12-19T05:40:21.230669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:10.729938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229029+0000","last_change":"2023-12-19T05:40:20.245982+0000","last_active":"2023-12-19T05:40:21.229029+0000","last_peered":"2023-12-19T05:40:21.229029+0000","last_clean":"2023-12-19T05:40:21.229029+0000","last_became_active":"2023-12-19T05:40:20.245593+0000","last_became_peered":"2023-12-19T05:40:20.245593+0000","last_unstale":"2023-12-19T05:40:21.229029+0000","last_undegraded":"2023-12-19T05:40:21.229029+0000","last_fullsized":"2023-12-19T05:40:21.229029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:49.418394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230275+0000","last_change":"2023-12-19T05:40:19.731071+0000","last_active":"2023-12-19T05:40:21.230275+0000","last_peered":"2023-12-19T05:40:21.230275+0000","last_clean":"2023-12-19T05:40:21.230275+0000","last_became_active":"2023-12-19T05:40:19.730370+0000","last_became_peered":"2023-12-19T05:40:19.730370+0000","last_unstale":"2023-12-19T05:40:21.230275+0000","last_undegraded":"2023-12-19T05:40:21.230275+0000","last_fullsized":"2023-12-19T05:40:21.230275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:10.650186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.237024+0000","last_change":"2023-12-19T05:40:20.236876+0000","last_active":"2023-12-19T05:40:20.237024+0000","last_peered":"2023-12-19T05:40:20.237024+0000","last_clean":"2023-12-19T05:40:20.237024+0000","last_became_active":"2023-12-19T05:40:20.236672+0000","last_became_peered":"2023-12-19T05:40:20.236672+0000","last_unstale":"2023-12-19T05:40:20.237024+0000","last_undegraded":"2023-12-19T05:40:20.237024+0000","last_fullsized":"2023-12-19T05:40:20.237024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:25.966192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.239022+0000","last_change":"2023-12-19T05:40:19.728236+0000","last_active":"2023-12-19T05:40:20.239022+0000","last_peered":"2023-12-19T05:40:20.239022+0000","last_clean":"2023-12-19T05:40:20.239022+0000","last_became_active":"2023-12-19T05:40:19.727334+0000","last_became_peered":"2023-12-19T05:40:19.727334+0000","last_unstale":"2023-12-19T05:40:20.239022+0000","last_undegraded":"2023-12-19T05:40:20.239022+0000","last_fullsized":"2023-12-19T05:40:20.239022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:10.650186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232797+0000","last_change":"2023-12-19T05:40:20.235979+0000","last_active":"2023-12-19T05:40:21.232797+0000","last_peered":"2023-12-19T05:40:21.232797+0000","last_clean":"2023-12-19T05:40:21.232797+0000","last_became_active":"2023-12-19T05:40:20.235379+0000","last_became_peered":"2023-12-19T05:40:20.235379+0000","last_unstale":"2023-12-19T05:40:21.232797+0000","last_undegraded":"2023-12-19T05:40:21.232797+0000","last_fullsized":"2023-12-19T05:40:21.232797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228787+0000","last_change":"2023-12-19T05:40:19.728437+0000","last_active":"2023-12-19T05:40:21.228787+0000","last_peered":"2023-12-19T05:40:21.228787+0000","last_clean":"2023-12-19T05:40:21.228787+0000","last_became_active":"2023-12-19T05:40:19.727595+0000","last_became_peered":"2023-12-19T05:40:19.727595+0000","last_unstale":"2023-12-19T05:40:21.228787+0000","last_undegraded":"2023-12-19T05:40:21.228787+0000","last_fullsized":"2023-12-19T05:40:21.228787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:46.609488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231294+0000","last_change":"2023-12-19T05:40:20.247257+0000","last_active":"2023-12-19T05:40:21.231294+0000","last_peered":"2023-12-19T05:40:21.231294+0000","last_clean":"2023-12-19T05:40:21.231294+0000","last_became_active":"2023-12-19T05:40:20.243941+0000","last_became_peered":"2023-12-19T05:40:20.243941+0000","last_unstale":"2023-12-19T05:40:21.231294+0000","last_undegraded":"2023-12-19T05:40:21.231294+0000","last_fullsized":"2023-12-19T05:40:21.231294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:41.180949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.220454+0000","last_change":"2023-12-19T05:40:19.728762+0000","last_active":"2023-12-19T05:40:20.220454+0000","last_peered":"2023-12-19T05:40:20.220454+0000","last_clean":"2023-12-19T05:40:20.220454+0000","last_became_active":"2023-12-19T05:40:19.728466+0000","last_became_peered":"2023-12-19T05:40:19.728466+0000","last_unstale":"2023-12-19T05:40:20.220454+0000","last_undegraded":"2023-12-19T05:40:20.220454+0000","last_fullsized":"2023-12-19T05:40:20.220454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:10.796859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.100840+0000","last_change":"2023-12-19T05:40:20.238727+0000","last_active":"2023-12-19T05:40:22.100840+0000","last_peered":"2023-12-19T05:40:22.100840+0000","last_clean":"2023-12-19T05:40:22.100840+0000","last_became_active":"2023-12-19T05:40:20.238155+0000","last_became_peered":"2023-12-19T05:40:20.238155+0000","last_unstale":"2023-12-19T05:40:22.100840+0000","last_undegraded":"2023-12-19T05:40:22.100840+0000","last_fullsized":"2023-12-19T05:40:22.100840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:26:27.354167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231298+0000","last_change":"2023-12-19T05:40:19.728820+0000","last_active":"2023-12-19T05:40:21.231298+0000","last_peered":"2023-12-19T05:40:21.231298+0000","last_clean":"2023-12-19T05:40:21.231298+0000","last_became_active":"2023-12-19T05:40:19.726201+0000","last_became_peered":"2023-12-19T05:40:19.726201+0000","last_unstale":"2023-12-19T05:40:21.231298+0000","last_undegraded":"2023-12-19T05:40:21.231298+0000","last_fullsized":"2023-12-19T05:40:21.231298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:51.943796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230881+0000","last_change":"2023-12-19T05:40:20.245788+0000","last_active":"2023-12-19T05:40:21.230881+0000","last_peered":"2023-12-19T05:40:21.230881+0000","last_clean":"2023-12-19T05:40:21.230881+0000","last_became_active":"2023-12-19T05:40:20.245421+0000","last_became_peered":"2023-12-19T05:40:20.245421+0000","last_unstale":"2023-12-19T05:40:21.230881+0000","last_undegraded":"2023-12-19T05:40:21.230881+0000","last_fullsized":"2023-12-19T05:40:21.230881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.226569+0000","last_change":"2023-12-19T05:40:19.729626+0000","last_active":"2023-12-19T05:40:20.226569+0000","last_peered":"2023-12-19T05:40:20.226569+0000","last_clean":"2023-12-19T05:40:20.226569+0000","last_became_active":"2023-12-19T05:40:19.728833+0000","last_became_peered":"2023-12-19T05:40:19.728833+0000","last_unstale":"2023-12-19T05:40:20.226569+0000","last_undegraded":"2023-12-19T05:40:20.226569+0000","last_fullsized":"2023-12-19T05:40:20.226569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:10.052480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101510+0000","last_change":"2023-12-19T05:40:20.250432+0000","last_active":"2023-12-19T05:40:22.101510+0000","last_peered":"2023-12-19T05:40:22.101510+0000","last_clean":"2023-12-19T05:40:22.101510+0000","last_became_active":"2023-12-19T05:40:20.249375+0000","last_became_peered":"2023-12-19T05:40:20.249375+0000","last_unstale":"2023-12-19T05:40:22.101510+0000","last_undegraded":"2023-12-19T05:40:22.101510+0000","last_fullsized":"2023-12-19T05:40:22.101510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.228173+0000","last_change":"2023-12-19T05:40:19.729930+0000","last_active":"2023-12-19T05:40:20.228173+0000","last_peered":"2023-12-19T05:40:20.228173+0000","last_clean":"2023-12-19T05:40:20.228173+0000","last_became_active":"2023-12-19T05:40:19.729662+0000","last_became_peered":"2023-12-19T05:40:19.729662+0000","last_unstale":"2023-12-19T05:40:20.228173+0000","last_undegraded":"2023-12-19T05:40:20.228173+0000","last_fullsized":"2023-12-19T05:40:20.228173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:20:46.872317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235149+0000","last_change":"2023-12-19T05:40:20.235035+0000","last_active":"2023-12-19T05:40:20.235149+0000","last_peered":"2023-12-19T05:40:20.235149+0000","last_clean":"2023-12-19T05:40:20.235149+0000","last_became_active":"2023-12-19T05:40:20.234388+0000","last_became_peered":"2023-12-19T05:40:20.234388+0000","last_unstale":"2023-12-19T05:40:20.235149+0000","last_undegraded":"2023-12-19T05:40:20.235149+0000","last_fullsized":"2023-12-19T05:40:20.235149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:23.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229043+0000","last_change":"2023-12-19T05:40:19.727853+0000","last_active":"2023-12-19T05:40:21.229043+0000","last_peered":"2023-12-19T05:40:21.229043+0000","last_clean":"2023-12-19T05:40:21.229043+0000","last_became_active":"2023-12-19T05:40:19.724599+0000","last_became_peered":"2023-12-19T05:40:19.724599+0000","last_unstale":"2023-12-19T05:40:21.229043+0000","last_undegraded":"2023-12-19T05:40:21.229043+0000","last_fullsized":"2023-12-19T05:40:21.229043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:47.454686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230424+0000","last_change":"2023-12-19T05:40:20.247910+0000","last_active":"2023-12-19T05:40:21.230424+0000","last_peered":"2023-12-19T05:40:21.230424+0000","last_clean":"2023-12-19T05:40:21.230424+0000","last_became_active":"2023-12-19T05:40:20.245800+0000","last_became_peered":"2023-12-19T05:40:20.245800+0000","last_unstale":"2023-12-19T05:40:21.230424+0000","last_undegraded":"2023-12-19T05:40:21.230424+0000","last_fullsized":"2023-12-19T05:40:21.230424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:26.978106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101080+0000","last_change":"2023-12-19T05:40:19.724475+0000","last_active":"2023-12-19T05:40:22.101080+0000","last_peered":"2023-12-19T05:40:22.101080+0000","last_clean":"2023-12-19T05:40:22.101080+0000","last_became_active":"2023-12-19T05:40:19.724092+0000","last_became_peered":"2023-12-19T05:40:19.724092+0000","last_unstale":"2023-12-19T05:40:22.101080+0000","last_undegraded":"2023-12-19T05:40:22.101080+0000","last_fullsized":"2023-12-19T05:40:22.101080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:39.132355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228677+0000","last_change":"2023-12-19T05:40:20.243295+0000","last_active":"2023-12-19T05:40:21.228677+0000","last_peered":"2023-12-19T05:40:21.228677+0000","last_clean":"2023-12-19T05:40:21.228677+0000","last_became_active":"2023-12-19T05:40:20.243058+0000","last_became_peered":"2023-12-19T05:40:20.243058+0000","last_unstale":"2023-12-19T05:40:21.228677+0000","last_undegraded":"2023-12-19T05:40:21.228677+0000","last_fullsized":"2023-12-19T05:40:21.228677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:52.385149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231476+0000","last_change":"2023-12-19T05:40:19.727421+0000","last_active":"2023-12-19T05:40:21.231476+0000","last_peered":"2023-12-19T05:40:21.231476+0000","last_clean":"2023-12-19T05:40:21.231476+0000","last_became_active":"2023-12-19T05:40:19.725852+0000","last_became_peered":"2023-12-19T05:40:19.725852+0000","last_unstale":"2023-12-19T05:40:21.231476+0000","last_undegraded":"2023-12-19T05:40:21.231476+0000","last_fullsized":"2023-12-19T05:40:21.231476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:27:53.567641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229832+0000","last_change":"2023-12-19T05:40:20.256366+0000","last_active":"2023-12-19T05:40:21.229832+0000","last_peered":"2023-12-19T05:40:21.229832+0000","last_clean":"2023-12-19T05:40:21.229832+0000","last_became_active":"2023-12-19T05:40:20.256137+0000","last_became_peered":"2023-12-19T05:40:20.256137+0000","last_unstale":"2023-12-19T05:40:21.229832+0000","last_undegraded":"2023-12-19T05:40:21.229832+0000","last_fullsized":"2023-12-19T05:40:21.229832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:19.662114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101523+0000","last_change":"2023-12-19T05:40:19.729238+0000","last_active":"2023-12-19T05:40:22.101523+0000","last_peered":"2023-12-19T05:40:22.101523+0000","last_clean":"2023-12-19T05:40:22.101523+0000","last_became_active":"2023-12-19T05:40:19.728999+0000","last_became_peered":"2023-12-19T05:40:19.728999+0000","last_unstale":"2023-12-19T05:40:22.101523+0000","last_undegraded":"2023-12-19T05:40:22.101523+0000","last_fullsized":"2023-12-19T05:40:22.101523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:02.753984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244001+0000","last_change":"2023-12-19T05:40:20.243523+0000","last_active":"2023-12-19T05:40:20.244001+0000","last_peered":"2023-12-19T05:40:20.244001+0000","last_clean":"2023-12-19T05:40:20.244001+0000","last_became_active":"2023-12-19T05:40:20.243284+0000","last_became_peered":"2023-12-19T05:40:20.243284+0000","last_unstale":"2023-12-19T05:40:20.244001+0000","last_undegraded":"2023-12-19T05:40:20.244001+0000","last_fullsized":"2023-12-19T05:40:20.244001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101848+0000","last_change":"2023-12-19T05:40:19.727363+0000","last_active":"2023-12-19T05:40:22.101848+0000","last_peered":"2023-12-19T05:40:22.101848+0000","last_clean":"2023-12-19T05:40:22.101848+0000","last_became_active":"2023-12-19T05:40:19.726855+0000","last_became_peered":"2023-12-19T05:40:19.726855+0000","last_unstale":"2023-12-19T05:40:22.101848+0000","last_undegraded":"2023-12-19T05:40:22.101848+0000","last_fullsized":"2023-12-19T05:40:22.101848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:22.630482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248089+0000","last_change":"2023-12-19T05:40:20.246931+0000","last_active":"2023-12-19T05:40:20.248089+0000","last_peered":"2023-12-19T05:40:20.248089+0000","last_clean":"2023-12-19T05:40:20.248089+0000","last_became_active":"2023-12-19T05:40:20.246697+0000","last_became_peered":"2023-12-19T05:40:20.246697+0000","last_unstale":"2023-12-19T05:40:20.248089+0000","last_undegraded":"2023-12-19T05:40:20.248089+0000","last_fullsized":"2023-12-19T05:40:20.248089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101527+0000","last_change":"2023-12-19T05:40:19.721364+0000","last_active":"2023-12-19T05:40:22.101527+0000","last_peered":"2023-12-19T05:40:22.101527+0000","last_clean":"2023-12-19T05:40:22.101527+0000","last_became_active":"2023-12-19T05:40:19.720965+0000","last_became_peered":"2023-12-19T05:40:19.720965+0000","last_unstale":"2023-12-19T05:40:22.101527+0000","last_undegraded":"2023-12-19T05:40:22.101527+0000","last_fullsized":"2023-12-19T05:40:22.101527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254680+0000","last_change":"2023-12-19T05:40:20.254604+0000","last_active":"2023-12-19T05:40:20.254680+0000","last_peered":"2023-12-19T05:40:20.254680+0000","last_clean":"2023-12-19T05:40:20.254680+0000","last_became_active":"2023-12-19T05:40:20.248578+0000","last_became_peered":"2023-12-19T05:40:20.248578+0000","last_unstale":"2023-12-19T05:40:20.254680+0000","last_undegraded":"2023-12-19T05:40:20.254680+0000","last_fullsized":"2023-12-19T05:40:20.254680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:41:31.637820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.227989+0000","last_change":"2023-12-19T05:40:19.724252+0000","last_active":"2023-12-19T05:40:20.227989+0000","last_peered":"2023-12-19T05:40:20.227989+0000","last_clean":"2023-12-19T05:40:20.227989+0000","last_became_active":"2023-12-19T05:40:19.723901+0000","last_became_peered":"2023-12-19T05:40:19.723901+0000","last_unstale":"2023-12-19T05:40:20.227989+0000","last_undegraded":"2023-12-19T05:40:20.227989+0000","last_fullsized":"2023-12-19T05:40:20.227989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:39.132355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228598+0000","last_change":"2023-12-19T05:40:20.237382+0000","last_active":"2023-12-19T05:40:21.228598+0000","last_peered":"2023-12-19T05:40:21.228598+0000","last_clean":"2023-12-19T05:40:21.228598+0000","last_became_active":"2023-12-19T05:40:20.237043+0000","last_became_peered":"2023-12-19T05:40:20.237043+0000","last_unstale":"2023-12-19T05:40:21.228598+0000","last_undegraded":"2023-12-19T05:40:21.228598+0000","last_fullsized":"2023-12-19T05:40:21.228598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:15:02.206349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241258+0000","last_change":"2023-12-19T05:40:19.730762+0000","last_active":"2023-12-19T05:40:20.241258+0000","last_peered":"2023-12-19T05:40:20.241258+0000","last_clean":"2023-12-19T05:40:20.241258+0000","last_became_active":"2023-12-19T05:40:19.729426+0000","last_became_peered":"2023-12-19T05:40:19.729426+0000","last_unstale":"2023-12-19T05:40:20.241258+0000","last_undegraded":"2023-12-19T05:40:20.241258+0000","last_fullsized":"2023-12-19T05:40:20.241258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:52.007533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244352+0000","last_change":"2023-12-19T05:40:20.244259+0000","last_active":"2023-12-19T05:40:20.244352+0000","last_peered":"2023-12-19T05:40:20.244352+0000","last_clean":"2023-12-19T05:40:20.244352+0000","last_became_active":"2023-12-19T05:40:20.243685+0000","last_became_peered":"2023-12-19T05:40:20.243685+0000","last_unstale":"2023-12-19T05:40:20.244352+0000","last_undegraded":"2023-12-19T05:40:20.244352+0000","last_fullsized":"2023-12-19T05:40:20.244352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228378+0000","last_change":"2023-12-19T05:40:19.725258+0000","last_active":"2023-12-19T05:40:21.228378+0000","last_peered":"2023-12-19T05:40:21.228378+0000","last_clean":"2023-12-19T05:40:21.228378+0000","last_became_active":"2023-12-19T05:40:19.725008+0000","last_became_peered":"2023-12-19T05:40:19.725008+0000","last_unstale":"2023-12-19T05:40:21.228378+0000","last_undegraded":"2023-12-19T05:40:21.228378+0000","last_fullsized":"2023-12-19T05:40:21.228378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:34.886601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-19T05:40:19.720414+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:40:19.720414+0000","last_peered":"2023-12-19T05:40:19.720414+0000","last_clean":"2023-12-19T05:40:19.720414+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:40:19.720414+0000","last_undegraded":"2023-12-19T05:40:19.720414+0000","last_fullsized":"2023-12-19T05:40:19.720414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848737,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.375}]},{"osd":2,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.601}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.637}]},{"osd":5,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2929999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.496},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.7}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.7000000000000002,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.595},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.669}]},{"osd":2,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.5220000000000002,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.472},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.7749999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":4.6689999999999996,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.236}]},{"osd":5,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":4.5670000000000002,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":3.681,"5min":3.681,"15min":3.681},"last":1.7350000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.631},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":2.2360000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194587,"statfs":{"total":200000000,"available":199257809,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.415},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.044}]},{"osd":2,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.54}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":1.004}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.49},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.157}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.169},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.591}]},{"osd":7,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.655,"5min":1.655,"15min":1.655},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.2330000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853473,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.173},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.486}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.3520000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.4179999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.546},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.45}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.208},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.266}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3080000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199847983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89600000000000002}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.85099999999999998}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.2749999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.506},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0590000000000002,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.413}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.474}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.55},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.46}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199855025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.753}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.622},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.878},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264621,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.3}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3360000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.0859999999999999,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":1.161},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.0389999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.635},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.5}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.0539999999999998,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":1.738}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.89100000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.997}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.208}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.1719999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.153},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.7130000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.123}]}]}],"pool_statfs":[]}} 2023-12-19T05:40:24.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:40:24.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.993+0000 7f92a94cc640 1 Processor -- start 2023-12-19T05:40:24.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.993+0000 7f92a94cc640 1 -- start start 2023-12-19T05:40:24.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.995+0000 7f92a94cc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f92a415e5a0 0x7f92a40b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.995+0000 7f92a94cc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:24.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.995+0000 7f92a94cc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a415ec30 con 0x7f92a415f680 2023-12-19T05:40:24.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.995+0000 7f92a94cc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a40ce5a0 con 0x7f92a415e5a0 2023-12-19T05:40:24.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.995+0000 7f92a94cc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a415e980 con 0x7f92a40cdbf0 2023-12-19T05:40:24.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.996+0000 7f92a8ccb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.996+0000 7f92a3fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f92a415e5a0 0x7f92a40b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:24.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.996+0000 7f92a8ccb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55308/0 (socket says 172.21.15.49:55308) 2023-12-19T05:40:24.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.996+0000 7f92a8ccb640 1 -- 172.21.15.49:0/136361774 learned_addr learned my addr 172.21.15.49:0/136361774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:24.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.996+0000 7f929bfff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f92a415f680 0x7f92a40b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54874/0 (socket says 172.21.15.49:54874) 2023-12-19T05:40:24.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a37fe640 1 -- 172.21.15.49:0/136361774 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897703581 0 0) 0x7f92a415ec30 con 0x7f92a415f680 2023-12-19T05:40:24.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a37fe640 1 -- 172.21.15.49:0/136361774 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9290003520 con 0x7f92a415f680 2023-12-19T05:40:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a8ccb640 1 -- 172.21.15.49:0/136361774 >> v2:172.21.15.115:3300/0 conn(0x7f92a415e5a0 msgr2=0x7f92a40b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a8ccb640 1 --2- 172.21.15.49:0/136361774 >> v2:172.21.15.115:3300/0 conn(0x7f92a415e5a0 0x7f92a40b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a8ccb640 1 -- 172.21.15.49:0/136361774 >> v1:172.21.15.115:6789/0 conn(0x7f92a415f680 legacy=0x7f92a40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.997+0000 7f92a8ccb640 1 -- 172.21.15.49:0/136361774 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40b2f90 con 0x7f92a40cdbf0 2023-12-19T05:40:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.998+0000 7f92a8ccb640 1 --2- 172.21.15.49:0/136361774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f929c009e80 tx=0x7f929c02bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a114a87822496b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a37fe640 1 -- 172.21.15.49:0/136361774 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c02caf0 con 0x7f92a40cdbf0 2023-12-19T05:40:25.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a37fe640 1 -- 172.21.15.49:0/136361774 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c02cc50 con 0x7f92a40cdbf0 2023-12-19T05:40:25.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a37fe640 1 -- 172.21.15.49:0/136361774 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0343f0 con 0x7f92a40cdbf0 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a94cc640 1 -- 172.21.15.49:0/136361774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 msgr2=0x7f92a40ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a94cc640 1 --2- 172.21.15.49:0/136361774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f929c009e80 tx=0x7f929c02bf50 comp rx=0 tx=0).stop 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a94cc640 1 -- 172.21.15.49:0/136361774 shutdown_connections 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a94cc640 1 --2- 172.21.15.49:0/136361774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a40ce060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:24.999+0000 7f92a94cc640 1 --2- 172.21.15.49:0/136361774 >> v2:172.21.15.115:3300/0 conn(0x7f92a415e5a0 0x7f92a40b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.000+0000 7f92a94cc640 1 -- 172.21.15.49:0/136361774 >> 172.21.15.49:0/136361774 conn(0x7f92a40b0100 msgr2=0x7f92a40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.000+0000 7f92a94cc640 1 -- 172.21.15.49:0/136361774 shutdown_connections 2023-12-19T05:40:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.000+0000 7f92a94cc640 1 -- 172.21.15.49:0/136361774 wait complete. 2023-12-19T05:40:25.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.001+0000 7f92a94cc640 1 Processor -- start 2023-12-19T05:40:25.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.002+0000 7f92a94cc640 1 -- start start 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.002+0000 7f92a94cc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.002+0000 7f92a94cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.002+0000 7f92a94cc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92a415f680 0x7f92a415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f92a94cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4157fd0 con 0x7f92a415e5a0 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f92a94cc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4150070 con 0x7f92a415f680 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f92a94cc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a414f060 con 0x7f92a40cdbf0 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58970/0 (socket says 172.21.15.49:58970) 2023-12-19T05:40:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 -- 172.21.15.49:0/3343778266 learned_addr learned my addr 172.21.15.49:0/3343778266 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f92a8ccb640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92a415f680 0x7f92a415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f92a3fff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 -- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 msgr2=0x7f92a4150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a4150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 -- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92a415f680 msgr2=0x7f92a415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92a415f680 0x7f92a415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.003+0000 7f929bfff640 1 -- 172.21.15.49:0/3343778266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c009b30 con 0x7f92a415e5a0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f929bfff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c460 tx=0x7f928c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c007480 con 0x7f92a415e5a0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c007600 con 0x7f92a415e5a0 2023-12-19T05:40:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c004a20 con 0x7f92a415e5a0 2023-12-19T05:40:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a414f2b0 con 0x7f92a415e5a0 2023-12-19T05:40:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.004+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a414f870 con 0x7f92a415e5a0 2023-12-19T05:40:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.006+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a4061910 con 0x7f92a415e5a0 2023-12-19T05:40:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.006+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f928c004b80 con 0x7f92a415e5a0 2023-12-19T05:40:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.007+0000 7f92a17fa640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 0x7f928406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.007+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f928c087a70 con 0x7f92a415e5a0 2023-12-19T05:40:25.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.008+0000 7f92a3fff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 0x7f928406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.009+0000 7f92a3fff640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 0x7f928406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f92a4152040 tx=0x7f9294008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.012+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f928c0531b0 con 0x7f92a415e5a0 2023-12-19T05:40:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.202+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92a415ee80 con 0x7f928406a430 2023-12-19T05:40:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.225+0000 7f92a17fa640 1 -- 172.21.15.49:0/3343778266 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282796 (secure 0 0 0) 0x7f9294010870 con 0x7f928406a430 2023-12-19T05:40:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:40:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 msgr2=0x7f928406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 0x7f928406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f92a4152040 tx=0x7f9294008040 comp rx=0 tx=0).stop 2023-12-19T05:40:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 msgr2=0x7f92a415bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c460 tx=0x7f928c00c920 comp rx=0 tx=0).stop 2023-12-19T05:40:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 shutdown_connections 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f928406a430 0x7f928406c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92a415f680 0x7f92a415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92a415e5a0 0x7f92a415bb90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 --2- 172.21.15.49:0/3343778266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92a40cdbf0 0x7f92a4150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 >> 172.21.15.49:0/3343778266 conn(0x7f92a40b0100 msgr2=0x7f92a40af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 shutdown_connections 2023-12-19T05:40:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.233+0000 7f92a94cc640 1 -- 172.21.15.49:0/3343778266 wait complete. 2023-12-19T05:40:25.257 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-12-19T05:40:24.527937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560191,"statfs":{"total":1600000000,"available":1597636112,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.832269"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.229985+0000","last_change":"2023-12-19T05:40:20.229317+0000","last_active":"2023-12-19T05:40:20.229985+0000","last_peered":"2023-12-19T05:40:20.229985+0000","last_clean":"2023-12-19T05:40:20.229985+0000","last_became_active":"2023-12-19T05:40:20.228657+0000","last_became_peered":"2023-12-19T05:40:20.228657+0000","last_unstale":"2023-12-19T05:40:20.229985+0000","last_undegraded":"2023-12-19T05:40:20.229985+0000","last_fullsized":"2023-12-19T05:40:20.229985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230720+0000","last_change":"2023-12-19T05:40:20.247748+0000","last_active":"2023-12-19T05:40:21.230720+0000","last_peered":"2023-12-19T05:40:21.230720+0000","last_clean":"2023-12-19T05:40:21.230720+0000","last_became_active":"2023-12-19T05:40:20.247464+0000","last_became_peered":"2023-12-19T05:40:20.247464+0000","last_unstale":"2023-12-19T05:40:21.230720+0000","last_undegraded":"2023-12-19T05:40:21.230720+0000","last_fullsized":"2023-12-19T05:40:21.230720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230901+0000","last_change":"2023-12-19T05:40:20.230357+0000","last_active":"2023-12-19T05:40:20.230901+0000","last_peered":"2023-12-19T05:40:20.230901+0000","last_clean":"2023-12-19T05:40:20.230901+0000","last_became_active":"2023-12-19T05:40:20.230136+0000","last_became_peered":"2023-12-19T05:40:20.230136+0000","last_unstale":"2023-12-19T05:40:20.230901+0000","last_undegraded":"2023-12-19T05:40:20.230901+0000","last_fullsized":"2023-12-19T05:40:20.230901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:37.971569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.255444+0000","last_change":"2023-12-19T05:40:20.255310+0000","last_active":"2023-12-19T05:40:20.255444+0000","last_peered":"2023-12-19T05:40:20.255444+0000","last_clean":"2023-12-19T05:40:20.255444+0000","last_became_active":"2023-12-19T05:40:20.251734+0000","last_became_peered":"2023-12-19T05:40:20.251734+0000","last_unstale":"2023-12-19T05:40:20.255444+0000","last_undegraded":"2023-12-19T05:40:20.255444+0000","last_fullsized":"2023-12-19T05:40:20.255444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:25.695782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232270+0000","last_change":"2023-12-19T05:40:20.247913+0000","last_active":"2023-12-19T05:40:21.232270+0000","last_peered":"2023-12-19T05:40:21.232270+0000","last_clean":"2023-12-19T05:40:21.232270+0000","last_became_active":"2023-12-19T05:40:20.247579+0000","last_became_peered":"2023-12-19T05:40:20.247579+0000","last_unstale":"2023-12-19T05:40:21.232270+0000","last_undegraded":"2023-12-19T05:40:21.232270+0000","last_fullsized":"2023-12-19T05:40:21.232270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230254+0000","last_change":"2023-12-19T05:40:20.246662+0000","last_active":"2023-12-19T05:40:21.230254+0000","last_peered":"2023-12-19T05:40:21.230254+0000","last_clean":"2023-12-19T05:40:21.230254+0000","last_became_active":"2023-12-19T05:40:20.243071+0000","last_became_peered":"2023-12-19T05:40:20.243071+0000","last_unstale":"2023-12-19T05:40:21.230254+0000","last_undegraded":"2023-12-19T05:40:21.230254+0000","last_fullsized":"2023-12-19T05:40:21.230254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:11:36.351550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230957+0000","last_change":"2023-12-19T05:40:20.230880+0000","last_active":"2023-12-19T05:40:20.230957+0000","last_peered":"2023-12-19T05:40:20.230957+0000","last_clean":"2023-12-19T05:40:20.230957+0000","last_became_active":"2023-12-19T05:40:20.230657+0000","last_became_peered":"2023-12-19T05:40:20.230657+0000","last_unstale":"2023-12-19T05:40:20.230957+0000","last_undegraded":"2023-12-19T05:40:20.230957+0000","last_fullsized":"2023-12-19T05:40:20.230957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248375+0000","last_change":"2023-12-19T05:40:20.248322+0000","last_active":"2023-12-19T05:40:20.248375+0000","last_peered":"2023-12-19T05:40:20.248375+0000","last_clean":"2023-12-19T05:40:20.248375+0000","last_became_active":"2023-12-19T05:40:20.247877+0000","last_became_peered":"2023-12-19T05:40:20.247877+0000","last_unstale":"2023-12-19T05:40:20.248375+0000","last_undegraded":"2023-12-19T05:40:20.248375+0000","last_fullsized":"2023-12-19T05:40:20.248375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:51.283588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254972+0000","last_change":"2023-12-19T05:40:20.254893+0000","last_active":"2023-12-19T05:40:20.254972+0000","last_peered":"2023-12-19T05:40:20.254972+0000","last_clean":"2023-12-19T05:40:20.254972+0000","last_became_active":"2023-12-19T05:40:20.254642+0000","last_became_peered":"2023-12-19T05:40:20.254642+0000","last_unstale":"2023-12-19T05:40:20.254972+0000","last_undegraded":"2023-12-19T05:40:20.254972+0000","last_fullsized":"2023-12-19T05:40:20.254972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:53.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.251345+0000","last_change":"2023-12-19T05:40:20.250664+0000","last_active":"2023-12-19T05:40:20.251345+0000","last_peered":"2023-12-19T05:40:20.251345+0000","last_clean":"2023-12-19T05:40:20.251345+0000","last_became_active":"2023-12-19T05:40:20.250262+0000","last_became_peered":"2023-12-19T05:40:20.250262+0000","last_unstale":"2023-12-19T05:40:20.251345+0000","last_undegraded":"2023-12-19T05:40:20.251345+0000","last_fullsized":"2023-12-19T05:40:20.251345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228317+0000","last_change":"2023-12-19T05:40:20.245745+0000","last_active":"2023-12-19T05:40:21.228317+0000","last_peered":"2023-12-19T05:40:21.228317+0000","last_clean":"2023-12-19T05:40:21.228317+0000","last_became_active":"2023-12-19T05:40:20.245385+0000","last_became_peered":"2023-12-19T05:40:20.245385+0000","last_unstale":"2023-12-19T05:40:21.228317+0000","last_undegraded":"2023-12-19T05:40:21.228317+0000","last_fullsized":"2023-12-19T05:40:21.228317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:23.694304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.242198+0000","last_change":"2023-12-19T05:40:20.241880+0000","last_active":"2023-12-19T05:40:20.242198+0000","last_peered":"2023-12-19T05:40:20.242198+0000","last_clean":"2023-12-19T05:40:20.242198+0000","last_became_active":"2023-12-19T05:40:20.241625+0000","last_became_peered":"2023-12-19T05:40:20.241625+0000","last_unstale":"2023-12-19T05:40:20.242198+0000","last_undegraded":"2023-12-19T05:40:20.242198+0000","last_fullsized":"2023-12-19T05:40:20.242198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:43.519731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101464+0000","last_change":"2023-12-19T05:40:20.249050+0000","last_active":"2023-12-19T05:40:22.101464+0000","last_peered":"2023-12-19T05:40:22.101464+0000","last_clean":"2023-12-19T05:40:22.101464+0000","last_became_active":"2023-12-19T05:40:20.248484+0000","last_became_peered":"2023-12-19T05:40:20.248484+0000","last_unstale":"2023-12-19T05:40:22.101464+0000","last_undegraded":"2023-12-19T05:40:22.101464+0000","last_fullsized":"2023-12-19T05:40:22.101464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:06:55.544888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.256135+0000","last_change":"2023-12-19T05:40:20.256044+0000","last_active":"2023-12-19T05:40:20.256135+0000","last_peered":"2023-12-19T05:40:20.256135+0000","last_clean":"2023-12-19T05:40:20.256135+0000","last_became_active":"2023-12-19T05:40:20.254928+0000","last_became_peered":"2023-12-19T05:40:20.254928+0000","last_unstale":"2023-12-19T05:40:20.256135+0000","last_undegraded":"2023-12-19T05:40:20.256135+0000","last_fullsized":"2023-12-19T05:40:20.256135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.232443+0000","last_change":"2023-12-19T05:40:20.232215+0000","last_active":"2023-12-19T05:40:20.232443+0000","last_peered":"2023-12-19T05:40:20.232443+0000","last_clean":"2023-12-19T05:40:20.232443+0000","last_became_active":"2023-12-19T05:40:20.230243+0000","last_became_peered":"2023-12-19T05:40:20.230243+0000","last_unstale":"2023-12-19T05:40:20.232443+0000","last_undegraded":"2023-12-19T05:40:20.232443+0000","last_fullsized":"2023-12-19T05:40:20.232443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241463+0000","last_change":"2023-12-19T05:40:20.241323+0000","last_active":"2023-12-19T05:40:20.241463+0000","last_peered":"2023-12-19T05:40:20.241463+0000","last_clean":"2023-12-19T05:40:20.241463+0000","last_became_active":"2023-12-19T05:40:20.241027+0000","last_became_peered":"2023-12-19T05:40:20.241027+0000","last_unstale":"2023-12-19T05:40:20.241463+0000","last_undegraded":"2023-12-19T05:40:20.241463+0000","last_fullsized":"2023-12-19T05:40:20.241463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228258+0000","last_change":"2023-12-19T05:40:20.238091+0000","last_active":"2023-12-19T05:40:21.228258+0000","last_peered":"2023-12-19T05:40:21.228258+0000","last_clean":"2023-12-19T05:40:21.228258+0000","last_became_active":"2023-12-19T05:40:20.236003+0000","last_became_peered":"2023-12-19T05:40:20.236003+0000","last_unstale":"2023-12-19T05:40:21.228258+0000","last_undegraded":"2023-12-19T05:40:21.228258+0000","last_fullsized":"2023-12-19T05:40:21.228258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:26:34.619745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230182+0000","last_change":"2023-12-19T05:40:20.248628+0000","last_active":"2023-12-19T05:40:21.230182+0000","last_peered":"2023-12-19T05:40:21.230182+0000","last_clean":"2023-12-19T05:40:21.230182+0000","last_became_active":"2023-12-19T05:40:20.248292+0000","last_became_peered":"2023-12-19T05:40:20.248292+0000","last_unstale":"2023-12-19T05:40:21.230182+0000","last_undegraded":"2023-12-19T05:40:21.230182+0000","last_fullsized":"2023-12-19T05:40:21.230182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:11.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229537+0000","last_change":"2023-12-19T05:40:20.244576+0000","last_active":"2023-12-19T05:40:21.229537+0000","last_peered":"2023-12-19T05:40:21.229537+0000","last_clean":"2023-12-19T05:40:21.229537+0000","last_became_active":"2023-12-19T05:40:20.244215+0000","last_became_peered":"2023-12-19T05:40:20.244215+0000","last_unstale":"2023-12-19T05:40:21.229537+0000","last_undegraded":"2023-12-19T05:40:21.229537+0000","last_fullsized":"2023-12-19T05:40:21.229537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.493216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101394+0000","last_change":"2023-12-19T05:40:20.247543+0000","last_active":"2023-12-19T05:40:22.101394+0000","last_peered":"2023-12-19T05:40:22.101394+0000","last_clean":"2023-12-19T05:40:22.101394+0000","last_became_active":"2023-12-19T05:40:20.247320+0000","last_became_peered":"2023-12-19T05:40:20.247320+0000","last_unstale":"2023-12-19T05:40:22.101394+0000","last_undegraded":"2023-12-19T05:40:22.101394+0000","last_fullsized":"2023-12-19T05:40:22.101394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:52.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.242896+0000","last_change":"2023-12-19T05:40:20.242756+0000","last_active":"2023-12-19T05:40:20.242896+0000","last_peered":"2023-12-19T05:40:20.242896+0000","last_clean":"2023-12-19T05:40:20.242896+0000","last_became_active":"2023-12-19T05:40:20.242566+0000","last_became_peered":"2023-12-19T05:40:20.242566+0000","last_unstale":"2023-12-19T05:40:20.242896+0000","last_undegraded":"2023-12-19T05:40:20.242896+0000","last_fullsized":"2023-12-19T05:40:20.242896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241832+0000","last_change":"2023-12-19T05:40:20.241687+0000","last_active":"2023-12-19T05:40:20.241832+0000","last_peered":"2023-12-19T05:40:20.241832+0000","last_clean":"2023-12-19T05:40:20.241832+0000","last_became_active":"2023-12-19T05:40:20.241448+0000","last_became_peered":"2023-12-19T05:40:20.241448+0000","last_unstale":"2023-12-19T05:40:20.241832+0000","last_undegraded":"2023-12-19T05:40:20.241832+0000","last_fullsized":"2023-12-19T05:40:20.241832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101713+0000","last_change":"2023-12-19T05:40:20.244063+0000","last_active":"2023-12-19T05:40:22.101713+0000","last_peered":"2023-12-19T05:40:22.101713+0000","last_clean":"2023-12-19T05:40:22.101713+0000","last_became_active":"2023-12-19T05:40:20.243737+0000","last_became_peered":"2023-12-19T05:40:20.243737+0000","last_unstale":"2023-12-19T05:40:22.101713+0000","last_undegraded":"2023-12-19T05:40:22.101713+0000","last_fullsized":"2023-12-19T05:40:22.101713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:27:54.579039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254088+0000","last_change":"2023-12-19T05:40:20.254008+0000","last_active":"2023-12-19T05:40:20.254088+0000","last_peered":"2023-12-19T05:40:20.254088+0000","last_clean":"2023-12-19T05:40:20.254088+0000","last_became_active":"2023-12-19T05:40:20.253648+0000","last_became_peered":"2023-12-19T05:40:20.253648+0000","last_unstale":"2023-12-19T05:40:20.254088+0000","last_undegraded":"2023-12-19T05:40:20.254088+0000","last_fullsized":"2023-12-19T05:40:20.254088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244337+0000","last_change":"2023-12-19T05:40:20.242364+0000","last_active":"2023-12-19T05:40:20.244337+0000","last_peered":"2023-12-19T05:40:20.244337+0000","last_clean":"2023-12-19T05:40:20.244337+0000","last_became_active":"2023-12-19T05:40:20.242072+0000","last_became_peered":"2023-12-19T05:40:20.242072+0000","last_unstale":"2023-12-19T05:40:20.244337+0000","last_undegraded":"2023-12-19T05:40:20.244337+0000","last_fullsized":"2023-12-19T05:40:20.244337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:04:51.283588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241164+0000","last_change":"2023-12-19T05:40:20.240932+0000","last_active":"2023-12-19T05:40:20.241164+0000","last_peered":"2023-12-19T05:40:20.241164+0000","last_clean":"2023-12-19T05:40:20.241164+0000","last_became_active":"2023-12-19T05:40:20.240430+0000","last_became_peered":"2023-12-19T05:40:20.240430+0000","last_unstale":"2023-12-19T05:40:20.241164+0000","last_undegraded":"2023-12-19T05:40:20.241164+0000","last_fullsized":"2023-12-19T05:40:20.241164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232572+0000","last_change":"2023-12-19T05:40:20.227078+0000","last_active":"2023-12-19T05:40:21.232572+0000","last_peered":"2023-12-19T05:40:21.232572+0000","last_clean":"2023-12-19T05:40:21.232572+0000","last_became_active":"2023-12-19T05:40:20.226462+0000","last_became_peered":"2023-12-19T05:40:20.226462+0000","last_unstale":"2023-12-19T05:40:21.232572+0000","last_undegraded":"2023-12-19T05:40:21.232572+0000","last_fullsized":"2023-12-19T05:40:21.232572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248286+0000","last_change":"2023-12-19T05:40:20.248217+0000","last_active":"2023-12-19T05:40:20.248286+0000","last_peered":"2023-12-19T05:40:20.248286+0000","last_clean":"2023-12-19T05:40:20.248286+0000","last_became_active":"2023-12-19T05:40:20.247530+0000","last_became_peered":"2023-12-19T05:40:20.247530+0000","last_unstale":"2023-12-19T05:40:20.248286+0000","last_undegraded":"2023-12-19T05:40:20.248286+0000","last_fullsized":"2023-12-19T05:40:20.248286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.247267+0000","last_change":"2023-12-19T05:40:20.247168+0000","last_active":"2023-12-19T05:40:20.247267+0000","last_peered":"2023-12-19T05:40:20.247267+0000","last_clean":"2023-12-19T05:40:20.247267+0000","last_became_active":"2023-12-19T05:40:20.246877+0000","last_became_peered":"2023-12-19T05:40:20.246877+0000","last_unstale":"2023-12-19T05:40:20.247267+0000","last_undegraded":"2023-12-19T05:40:20.247267+0000","last_fullsized":"2023-12-19T05:40:20.247267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.222651+0000","last_change":"2023-12-19T05:40:20.222584+0000","last_active":"2023-12-19T05:40:20.222651+0000","last_peered":"2023-12-19T05:40:20.222651+0000","last_clean":"2023-12-19T05:40:20.222651+0000","last_became_active":"2023-12-19T05:40:20.222339+0000","last_became_peered":"2023-12-19T05:40:20.222339+0000","last_unstale":"2023-12-19T05:40:20.222651+0000","last_undegraded":"2023-12-19T05:40:20.222651+0000","last_fullsized":"2023-12-19T05:40:20.222651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244342+0000","last_change":"2023-12-19T05:40:20.244267+0000","last_active":"2023-12-19T05:40:20.244342+0000","last_peered":"2023-12-19T05:40:20.244342+0000","last_clean":"2023-12-19T05:40:20.244342+0000","last_became_active":"2023-12-19T05:40:20.243994+0000","last_became_peered":"2023-12-19T05:40:20.243994+0000","last_unstale":"2023-12-19T05:40:20.244342+0000","last_undegraded":"2023-12-19T05:40:20.244342+0000","last_fullsized":"2023-12-19T05:40:20.244342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228415+0000","last_change":"2023-12-19T05:40:20.237891+0000","last_active":"2023-12-19T05:40:21.228415+0000","last_peered":"2023-12-19T05:40:21.228415+0000","last_clean":"2023-12-19T05:40:21.228415+0000","last_became_active":"2023-12-19T05:40:20.232079+0000","last_became_peered":"2023-12-19T05:40:20.232079+0000","last_unstale":"2023-12-19T05:40:21.228415+0000","last_undegraded":"2023-12-19T05:40:21.228415+0000","last_fullsized":"2023-12-19T05:40:21.228415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:12:44.500392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.100678+0000","last_change":"2023-12-19T05:40:20.242610+0000","last_active":"2023-12-19T05:40:22.100678+0000","last_peered":"2023-12-19T05:40:22.100678+0000","last_clean":"2023-12-19T05:40:22.100678+0000","last_became_active":"2023-12-19T05:40:20.242287+0000","last_became_peered":"2023-12-19T05:40:20.242287+0000","last_unstale":"2023-12-19T05:40:22.100678+0000","last_undegraded":"2023-12-19T05:40:22.100678+0000","last_fullsized":"2023-12-19T05:40:22.100678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228447+0000","last_change":"2023-12-19T05:40:19.719012+0000","last_active":"2023-12-19T05:40:21.228447+0000","last_peered":"2023-12-19T05:40:21.228447+0000","last_clean":"2023-12-19T05:40:21.228447+0000","last_became_active":"2023-12-19T05:40:19.718674+0000","last_became_peered":"2023-12-19T05:40:19.718674+0000","last_unstale":"2023-12-19T05:40:21.228447+0000","last_undegraded":"2023-12-19T05:40:21.228447+0000","last_fullsized":"2023-12-19T05:40:21.228447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:15.034944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235152+0000","last_change":"2023-12-19T05:40:20.235080+0000","last_active":"2023-12-19T05:40:20.235152+0000","last_peered":"2023-12-19T05:40:20.235152+0000","last_clean":"2023-12-19T05:40:20.235152+0000","last_became_active":"2023-12-19T05:40:20.234817+0000","last_became_peered":"2023-12-19T05:40:20.234817+0000","last_unstale":"2023-12-19T05:40:20.235152+0000","last_undegraded":"2023-12-19T05:40:20.235152+0000","last_fullsized":"2023-12-19T05:40:20.235152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:06:55.544888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.257076+0000","last_change":"2023-12-19T05:40:19.729766+0000","last_active":"2023-12-19T05:40:20.257076+0000","last_peered":"2023-12-19T05:40:20.257076+0000","last_clean":"2023-12-19T05:40:20.257076+0000","last_became_active":"2023-12-19T05:40:19.727213+0000","last_became_peered":"2023-12-19T05:40:19.727213+0000","last_unstale":"2023-12-19T05:40:20.257076+0000","last_undegraded":"2023-12-19T05:40:20.257076+0000","last_fullsized":"2023-12-19T05:40:20.257076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241815+0000","last_change":"2023-12-19T05:40:20.241661+0000","last_active":"2023-12-19T05:40:20.241815+0000","last_peered":"2023-12-19T05:40:20.241815+0000","last_clean":"2023-12-19T05:40:20.241815+0000","last_became_active":"2023-12-19T05:40:20.241472+0000","last_became_peered":"2023-12-19T05:40:20.241472+0000","last_unstale":"2023-12-19T05:40:20.241815+0000","last_undegraded":"2023-12-19T05:40:20.241815+0000","last_fullsized":"2023-12-19T05:40:20.241815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231450+0000","last_change":"2023-12-19T05:40:19.729838+0000","last_active":"2023-12-19T05:40:21.231450+0000","last_peered":"2023-12-19T05:40:21.231450+0000","last_clean":"2023-12-19T05:40:21.231450+0000","last_became_active":"2023-12-19T05:40:19.729574+0000","last_became_peered":"2023-12-19T05:40:19.729574+0000","last_unstale":"2023-12-19T05:40:21.231450+0000","last_undegraded":"2023-12-19T05:40:21.231450+0000","last_fullsized":"2023-12-19T05:40:21.231450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:10.052480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248073+0000","last_change":"2023-12-19T05:40:20.246747+0000","last_active":"2023-12-19T05:40:20.248073+0000","last_peered":"2023-12-19T05:40:20.248073+0000","last_clean":"2023-12-19T05:40:20.248073+0000","last_became_active":"2023-12-19T05:40:20.246434+0000","last_became_peered":"2023-12-19T05:40:20.246434+0000","last_unstale":"2023-12-19T05:40:20.248073+0000","last_undegraded":"2023-12-19T05:40:20.248073+0000","last_fullsized":"2023-12-19T05:40:20.248073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244962+0000","last_change":"2023-12-19T05:40:19.728204+0000","last_active":"2023-12-19T05:40:20.244962+0000","last_peered":"2023-12-19T05:40:20.244962+0000","last_clean":"2023-12-19T05:40:20.244962+0000","last_became_active":"2023-12-19T05:40:19.727915+0000","last_became_peered":"2023-12-19T05:40:19.727915+0000","last_unstale":"2023-12-19T05:40:20.244962+0000","last_undegraded":"2023-12-19T05:40:20.244962+0000","last_fullsized":"2023-12-19T05:40:20.244962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:02.753984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.245490+0000","last_change":"2023-12-19T05:40:20.245401+0000","last_active":"2023-12-19T05:40:20.245490+0000","last_peered":"2023-12-19T05:40:20.245490+0000","last_clean":"2023-12-19T05:40:20.245490+0000","last_became_active":"2023-12-19T05:40:20.245216+0000","last_became_peered":"2023-12-19T05:40:20.245216+0000","last_unstale":"2023-12-19T05:40:20.245490+0000","last_undegraded":"2023-12-19T05:40:20.245490+0000","last_fullsized":"2023-12-19T05:40:20.245490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:40.143754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.243694+0000","last_change":"2023-12-19T05:40:19.726917+0000","last_active":"2023-12-19T05:40:20.243694+0000","last_peered":"2023-12-19T05:40:20.243694+0000","last_clean":"2023-12-19T05:40:20.243694+0000","last_became_active":"2023-12-19T05:40:19.726268+0000","last_became_peered":"2023-12-19T05:40:19.726268+0000","last_unstale":"2023-12-19T05:40:20.243694+0000","last_undegraded":"2023-12-19T05:40:20.243694+0000","last_fullsized":"2023-12-19T05:40:20.243694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:42.508332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244936+0000","last_change":"2023-12-19T05:40:20.244846+0000","last_active":"2023-12-19T05:40:20.244936+0000","last_peered":"2023-12-19T05:40:20.244936+0000","last_clean":"2023-12-19T05:40:20.244936+0000","last_became_active":"2023-12-19T05:40:20.244621+0000","last_became_peered":"2023-12-19T05:40:20.244621+0000","last_unstale":"2023-12-19T05:40:20.244936+0000","last_undegraded":"2023-12-19T05:40:20.244936+0000","last_fullsized":"2023-12-19T05:40:20.244936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:48.466084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248045+0000","last_change":"2023-12-19T05:40:19.730340+0000","last_active":"2023-12-19T05:40:20.248045+0000","last_peered":"2023-12-19T05:40:20.248045+0000","last_clean":"2023-12-19T05:40:20.248045+0000","last_became_active":"2023-12-19T05:40:19.729933+0000","last_became_peered":"2023-12-19T05:40:19.729933+0000","last_unstale":"2023-12-19T05:40:20.248045+0000","last_undegraded":"2023-12-19T05:40:20.248045+0000","last_fullsized":"2023-12-19T05:40:20.248045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:22.630482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235317+0000","last_change":"2023-12-19T05:40:20.235230+0000","last_active":"2023-12-19T05:40:20.235317+0000","last_peered":"2023-12-19T05:40:20.235317+0000","last_clean":"2023-12-19T05:40:20.235317+0000","last_became_active":"2023-12-19T05:40:20.234756+0000","last_became_peered":"2023-12-19T05:40:20.234756+0000","last_unstale":"2023-12-19T05:40:20.235317+0000","last_undegraded":"2023-12-19T05:40:20.235317+0000","last_fullsized":"2023-12-19T05:40:20.235317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:03.765382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230059+0000","last_change":"2023-12-19T05:40:19.729285+0000","last_active":"2023-12-19T05:40:21.230059+0000","last_peered":"2023-12-19T05:40:21.230059+0000","last_clean":"2023-12-19T05:40:21.230059+0000","last_became_active":"2023-12-19T05:40:19.726759+0000","last_became_peered":"2023-12-19T05:40:19.726759+0000","last_unstale":"2023-12-19T05:40:21.230059+0000","last_undegraded":"2023-12-19T05:40:21.230059+0000","last_fullsized":"2023-12-19T05:40:21.230059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:16.477575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.255621+0000","last_change":"2023-12-19T05:40:20.255470+0000","last_active":"2023-12-19T05:40:20.255621+0000","last_peered":"2023-12-19T05:40:20.255621+0000","last_clean":"2023-12-19T05:40:20.255621+0000","last_became_active":"2023-12-19T05:40:20.252154+0000","last_became_peered":"2023-12-19T05:40:20.252154+0000","last_unstale":"2023-12-19T05:40:20.255621+0000","last_undegraded":"2023-12-19T05:40:20.255621+0000","last_fullsized":"2023-12-19T05:40:20.255621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.227320+0000","last_change":"2023-12-19T05:40:19.728524+0000","last_active":"2023-12-19T05:40:20.227320+0000","last_peered":"2023-12-19T05:40:20.227320+0000","last_clean":"2023-12-19T05:40:20.227320+0000","last_became_active":"2023-12-19T05:40:19.728007+0000","last_became_peered":"2023-12-19T05:40:19.728007+0000","last_unstale":"2023-12-19T05:40:20.227320+0000","last_undegraded":"2023-12-19T05:40:20.227320+0000","last_fullsized":"2023-12-19T05:40:20.227320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228795+0000","last_change":"2023-12-19T05:40:20.242392+0000","last_active":"2023-12-19T05:40:21.228795+0000","last_peered":"2023-12-19T05:40:21.228795+0000","last_clean":"2023-12-19T05:40:21.228795+0000","last_became_active":"2023-12-19T05:40:20.242191+0000","last_became_peered":"2023-12-19T05:40:20.242191+0000","last_unstale":"2023-12-19T05:40:21.228795+0000","last_undegraded":"2023-12-19T05:40:21.228795+0000","last_fullsized":"2023-12-19T05:40:21.228795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:17.961210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231529+0000","last_change":"2023-12-19T05:40:19.725647+0000","last_active":"2023-12-19T05:40:21.231529+0000","last_peered":"2023-12-19T05:40:21.231529+0000","last_clean":"2023-12-19T05:40:21.231529+0000","last_became_active":"2023-12-19T05:40:19.725363+0000","last_became_peered":"2023-12-19T05:40:19.725363+0000","last_unstale":"2023-12-19T05:40:21.231529+0000","last_undegraded":"2023-12-19T05:40:21.231529+0000","last_fullsized":"2023-12-19T05:40:21.231529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:40.169550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.250806+0000","last_change":"2023-12-19T05:40:20.250483+0000","last_active":"2023-12-19T05:40:20.250806+0000","last_peered":"2023-12-19T05:40:20.250806+0000","last_clean":"2023-12-19T05:40:20.250806+0000","last_became_active":"2023-12-19T05:40:20.250239+0000","last_became_peered":"2023-12-19T05:40:20.250239+0000","last_unstale":"2023-12-19T05:40:20.250806+0000","last_undegraded":"2023-12-19T05:40:20.250806+0000","last_fullsized":"2023-12-19T05:40:20.250806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:08:07.417227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.233147+0000","last_change":"2023-12-19T05:40:19.718227+0000","last_active":"2023-12-19T05:40:21.233147+0000","last_peered":"2023-12-19T05:40:21.233147+0000","last_clean":"2023-12-19T05:40:21.233147+0000","last_became_active":"2023-12-19T05:40:19.717805+0000","last_became_peered":"2023-12-19T05:40:19.717805+0000","last_unstale":"2023-12-19T05:40:21.233147+0000","last_undegraded":"2023-12-19T05:40:21.233147+0000","last_fullsized":"2023-12-19T05:40:21.233147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:22:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254248+0000","last_change":"2023-12-19T05:40:20.254144+0000","last_active":"2023-12-19T05:40:20.254248+0000","last_peered":"2023-12-19T05:40:20.254248+0000","last_clean":"2023-12-19T05:40:20.254248+0000","last_became_active":"2023-12-19T05:40:20.246052+0000","last_became_peered":"2023-12-19T05:40:20.246052+0000","last_unstale":"2023-12-19T05:40:20.254248+0000","last_undegraded":"2023-12-19T05:40:20.254248+0000","last_fullsized":"2023-12-19T05:40:20.254248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:15.110325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228733+0000","last_change":"2023-12-19T05:40:19.724957+0000","last_active":"2023-12-19T05:40:21.228733+0000","last_peered":"2023-12-19T05:40:21.228733+0000","last_clean":"2023-12-19T05:40:21.228733+0000","last_became_active":"2023-12-19T05:40:19.724366+0000","last_became_peered":"2023-12-19T05:40:19.724366+0000","last_unstale":"2023-12-19T05:40:21.228733+0000","last_undegraded":"2023-12-19T05:40:21.228733+0000","last_fullsized":"2023-12-19T05:40:21.228733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:52.476210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228291+0000","last_change":"2023-12-19T05:40:20.245608+0000","last_active":"2023-12-19T05:40:21.228291+0000","last_peered":"2023-12-19T05:40:21.228291+0000","last_clean":"2023-12-19T05:40:21.228291+0000","last_became_active":"2023-12-19T05:40:20.245381+0000","last_became_peered":"2023-12-19T05:40:20.245381+0000","last_unstale":"2023-12-19T05:40:21.228291+0000","last_undegraded":"2023-12-19T05:40:21.228291+0000","last_fullsized":"2023-12-19T05:40:21.228291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:44.469491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101198+0000","last_change":"2023-12-19T05:40:19.731947+0000","last_active":"2023-12-19T05:40:22.101198+0000","last_peered":"2023-12-19T05:40:22.101198+0000","last_clean":"2023-12-19T05:40:22.101198+0000","last_became_active":"2023-12-19T05:40:19.731752+0000","last_became_peered":"2023-12-19T05:40:19.731752+0000","last_unstale":"2023-12-19T05:40:22.101198+0000","last_undegraded":"2023-12-19T05:40:22.101198+0000","last_fullsized":"2023-12-19T05:40:22.101198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:52.007533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101285+0000","last_change":"2023-12-19T05:40:20.250240+0000","last_active":"2023-12-19T05:40:22.101285+0000","last_peered":"2023-12-19T05:40:22.101285+0000","last_clean":"2023-12-19T05:40:22.101285+0000","last_became_active":"2023-12-19T05:40:20.249041+0000","last_became_peered":"2023-12-19T05:40:20.249041+0000","last_unstale":"2023-12-19T05:40:22.101285+0000","last_undegraded":"2023-12-19T05:40:22.101285+0000","last_fullsized":"2023-12-19T05:40:22.101285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:52:15.623077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.239402+0000","last_change":"2023-12-19T05:40:19.728381+0000","last_active":"2023-12-19T05:40:20.239402+0000","last_peered":"2023-12-19T05:40:20.239402+0000","last_clean":"2023-12-19T05:40:20.239402+0000","last_became_active":"2023-12-19T05:40:19.727659+0000","last_became_peered":"2023-12-19T05:40:19.727659+0000","last_unstale":"2023-12-19T05:40:20.239402+0000","last_undegraded":"2023-12-19T05:40:20.239402+0000","last_fullsized":"2023-12-19T05:40:20.239402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:36.960170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248051+0000","last_change":"2023-12-19T05:40:20.246148+0000","last_active":"2023-12-19T05:40:20.248051+0000","last_peered":"2023-12-19T05:40:20.248051+0000","last_clean":"2023-12-19T05:40:20.248051+0000","last_became_active":"2023-12-19T05:40:20.245121+0000","last_became_peered":"2023-12-19T05:40:20.245121+0000","last_unstale":"2023-12-19T05:40:20.248051+0000","last_undegraded":"2023-12-19T05:40:20.248051+0000","last_fullsized":"2023-12-19T05:40:20.248051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:47.620887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.236639+0000","last_change":"2023-12-19T05:40:19.721544+0000","last_active":"2023-12-19T05:40:20.236639+0000","last_peered":"2023-12-19T05:40:20.236639+0000","last_clean":"2023-12-19T05:40:20.236639+0000","last_became_active":"2023-12-19T05:40:19.720808+0000","last_became_peered":"2023-12-19T05:40:19.720808+0000","last_unstale":"2023-12-19T05:40:20.236639+0000","last_undegraded":"2023-12-19T05:40:20.236639+0000","last_fullsized":"2023-12-19T05:40:20.236639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:41.633853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230099+0000","last_change":"2023-12-19T05:40:20.229781+0000","last_active":"2023-12-19T05:40:20.230099+0000","last_peered":"2023-12-19T05:40:20.230099+0000","last_clean":"2023-12-19T05:40:20.230099+0000","last_became_active":"2023-12-19T05:40:20.229590+0000","last_became_peered":"2023-12-19T05:40:20.229590+0000","last_unstale":"2023-12-19T05:40:20.230099+0000","last_undegraded":"2023-12-19T05:40:20.230099+0000","last_fullsized":"2023-12-19T05:40:20.230099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.230273+0000","last_change":"2023-12-19T05:40:19.727129+0000","last_active":"2023-12-19T05:40:20.230273+0000","last_peered":"2023-12-19T05:40:20.230273+0000","last_clean":"2023-12-19T05:40:20.230273+0000","last_became_active":"2023-12-19T05:40:19.726703+0000","last_became_peered":"2023-12-19T05:40:19.726703+0000","last_unstale":"2023-12-19T05:40:20.230273+0000","last_undegraded":"2023-12-19T05:40:20.230273+0000","last_fullsized":"2023-12-19T05:40:20.230273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:10:36.960170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228549+0000","last_change":"2023-12-19T05:40:20.236252+0000","last_active":"2023-12-19T05:40:21.228549+0000","last_peered":"2023-12-19T05:40:21.228549+0000","last_clean":"2023-12-19T05:40:21.228549+0000","last_became_active":"2023-12-19T05:40:20.231699+0000","last_became_peered":"2023-12-19T05:40:20.231699+0000","last_unstale":"2023-12-19T05:40:21.228549+0000","last_undegraded":"2023-12-19T05:40:21.228549+0000","last_fullsized":"2023-12-19T05:40:21.228549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:54.921257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230669+0000","last_change":"2023-12-19T05:40:19.727055+0000","last_active":"2023-12-19T05:40:21.230669+0000","last_peered":"2023-12-19T05:40:21.230669+0000","last_clean":"2023-12-19T05:40:21.230669+0000","last_became_active":"2023-12-19T05:40:19.726793+0000","last_became_peered":"2023-12-19T05:40:19.726793+0000","last_unstale":"2023-12-19T05:40:21.230669+0000","last_undegraded":"2023-12-19T05:40:21.230669+0000","last_fullsized":"2023-12-19T05:40:21.230669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:10.729938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229029+0000","last_change":"2023-12-19T05:40:20.245982+0000","last_active":"2023-12-19T05:40:21.229029+0000","last_peered":"2023-12-19T05:40:21.229029+0000","last_clean":"2023-12-19T05:40:21.229029+0000","last_became_active":"2023-12-19T05:40:20.245593+0000","last_became_peered":"2023-12-19T05:40:20.245593+0000","last_unstale":"2023-12-19T05:40:21.229029+0000","last_undegraded":"2023-12-19T05:40:21.229029+0000","last_fullsized":"2023-12-19T05:40:21.229029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:49.418394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230275+0000","last_change":"2023-12-19T05:40:19.731071+0000","last_active":"2023-12-19T05:40:21.230275+0000","last_peered":"2023-12-19T05:40:21.230275+0000","last_clean":"2023-12-19T05:40:21.230275+0000","last_became_active":"2023-12-19T05:40:19.730370+0000","last_became_peered":"2023-12-19T05:40:19.730370+0000","last_unstale":"2023-12-19T05:40:21.230275+0000","last_undegraded":"2023-12-19T05:40:21.230275+0000","last_fullsized":"2023-12-19T05:40:21.230275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:10.650186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.237024+0000","last_change":"2023-12-19T05:40:20.236876+0000","last_active":"2023-12-19T05:40:20.237024+0000","last_peered":"2023-12-19T05:40:20.237024+0000","last_clean":"2023-12-19T05:40:20.237024+0000","last_became_active":"2023-12-19T05:40:20.236672+0000","last_became_peered":"2023-12-19T05:40:20.236672+0000","last_unstale":"2023-12-19T05:40:20.237024+0000","last_undegraded":"2023-12-19T05:40:20.237024+0000","last_fullsized":"2023-12-19T05:40:20.237024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:25.966192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.239022+0000","last_change":"2023-12-19T05:40:19.728236+0000","last_active":"2023-12-19T05:40:20.239022+0000","last_peered":"2023-12-19T05:40:20.239022+0000","last_clean":"2023-12-19T05:40:20.239022+0000","last_became_active":"2023-12-19T05:40:19.727334+0000","last_became_peered":"2023-12-19T05:40:19.727334+0000","last_unstale":"2023-12-19T05:40:20.239022+0000","last_undegraded":"2023-12-19T05:40:20.239022+0000","last_fullsized":"2023-12-19T05:40:20.239022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:19:10.650186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.232797+0000","last_change":"2023-12-19T05:40:20.235979+0000","last_active":"2023-12-19T05:40:21.232797+0000","last_peered":"2023-12-19T05:40:21.232797+0000","last_clean":"2023-12-19T05:40:21.232797+0000","last_became_active":"2023-12-19T05:40:20.235379+0000","last_became_peered":"2023-12-19T05:40:20.235379+0000","last_unstale":"2023-12-19T05:40:21.232797+0000","last_undegraded":"2023-12-19T05:40:21.232797+0000","last_fullsized":"2023-12-19T05:40:21.232797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:53.487608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228787+0000","last_change":"2023-12-19T05:40:19.728437+0000","last_active":"2023-12-19T05:40:21.228787+0000","last_peered":"2023-12-19T05:40:21.228787+0000","last_clean":"2023-12-19T05:40:21.228787+0000","last_became_active":"2023-12-19T05:40:19.727595+0000","last_became_peered":"2023-12-19T05:40:19.727595+0000","last_unstale":"2023-12-19T05:40:21.228787+0000","last_undegraded":"2023-12-19T05:40:21.228787+0000","last_fullsized":"2023-12-19T05:40:21.228787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:46.609488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231294+0000","last_change":"2023-12-19T05:40:20.247257+0000","last_active":"2023-12-19T05:40:21.231294+0000","last_peered":"2023-12-19T05:40:21.231294+0000","last_clean":"2023-12-19T05:40:21.231294+0000","last_became_active":"2023-12-19T05:40:20.243941+0000","last_became_peered":"2023-12-19T05:40:20.243941+0000","last_unstale":"2023-12-19T05:40:21.231294+0000","last_undegraded":"2023-12-19T05:40:21.231294+0000","last_fullsized":"2023-12-19T05:40:21.231294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:41.180949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.220454+0000","last_change":"2023-12-19T05:40:19.728762+0000","last_active":"2023-12-19T05:40:20.220454+0000","last_peered":"2023-12-19T05:40:20.220454+0000","last_clean":"2023-12-19T05:40:20.220454+0000","last_became_active":"2023-12-19T05:40:19.728466+0000","last_became_peered":"2023-12-19T05:40:19.728466+0000","last_unstale":"2023-12-19T05:40:20.220454+0000","last_undegraded":"2023-12-19T05:40:20.220454+0000","last_fullsized":"2023-12-19T05:40:20.220454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:10.796859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.100840+0000","last_change":"2023-12-19T05:40:20.238727+0000","last_active":"2023-12-19T05:40:22.100840+0000","last_peered":"2023-12-19T05:40:22.100840+0000","last_clean":"2023-12-19T05:40:22.100840+0000","last_became_active":"2023-12-19T05:40:20.238155+0000","last_became_peered":"2023-12-19T05:40:20.238155+0000","last_unstale":"2023-12-19T05:40:22.100840+0000","last_undegraded":"2023-12-19T05:40:22.100840+0000","last_fullsized":"2023-12-19T05:40:22.100840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:26:27.354167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231298+0000","last_change":"2023-12-19T05:40:19.728820+0000","last_active":"2023-12-19T05:40:21.231298+0000","last_peered":"2023-12-19T05:40:21.231298+0000","last_clean":"2023-12-19T05:40:21.231298+0000","last_became_active":"2023-12-19T05:40:19.726201+0000","last_became_peered":"2023-12-19T05:40:19.726201+0000","last_unstale":"2023-12-19T05:40:21.231298+0000","last_undegraded":"2023-12-19T05:40:21.231298+0000","last_fullsized":"2023-12-19T05:40:21.231298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:51.943796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230881+0000","last_change":"2023-12-19T05:40:20.245788+0000","last_active":"2023-12-19T05:40:21.230881+0000","last_peered":"2023-12-19T05:40:21.230881+0000","last_clean":"2023-12-19T05:40:21.230881+0000","last_became_active":"2023-12-19T05:40:20.245421+0000","last_became_peered":"2023-12-19T05:40:20.245421+0000","last_unstale":"2023-12-19T05:40:21.230881+0000","last_undegraded":"2023-12-19T05:40:21.230881+0000","last_fullsized":"2023-12-19T05:40:21.230881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:16.046342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.226569+0000","last_change":"2023-12-19T05:40:19.729626+0000","last_active":"2023-12-19T05:40:20.226569+0000","last_peered":"2023-12-19T05:40:20.226569+0000","last_clean":"2023-12-19T05:40:20.226569+0000","last_became_active":"2023-12-19T05:40:19.728833+0000","last_became_peered":"2023-12-19T05:40:19.728833+0000","last_unstale":"2023-12-19T05:40:20.226569+0000","last_undegraded":"2023-12-19T05:40:20.226569+0000","last_fullsized":"2023-12-19T05:40:20.226569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:10.052480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101510+0000","last_change":"2023-12-19T05:40:20.250432+0000","last_active":"2023-12-19T05:40:22.101510+0000","last_peered":"2023-12-19T05:40:22.101510+0000","last_clean":"2023-12-19T05:40:22.101510+0000","last_became_active":"2023-12-19T05:40:20.249375+0000","last_became_peered":"2023-12-19T05:40:20.249375+0000","last_unstale":"2023-12-19T05:40:22.101510+0000","last_undegraded":"2023-12-19T05:40:22.101510+0000","last_fullsized":"2023-12-19T05:40:22.101510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:33:40.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.228173+0000","last_change":"2023-12-19T05:40:19.729930+0000","last_active":"2023-12-19T05:40:20.228173+0000","last_peered":"2023-12-19T05:40:20.228173+0000","last_clean":"2023-12-19T05:40:20.228173+0000","last_became_active":"2023-12-19T05:40:19.729662+0000","last_became_peered":"2023-12-19T05:40:19.729662+0000","last_unstale":"2023-12-19T05:40:20.228173+0000","last_undegraded":"2023-12-19T05:40:20.228173+0000","last_fullsized":"2023-12-19T05:40:20.228173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:20:46.872317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.235149+0000","last_change":"2023-12-19T05:40:20.235035+0000","last_active":"2023-12-19T05:40:20.235149+0000","last_peered":"2023-12-19T05:40:20.235149+0000","last_clean":"2023-12-19T05:40:20.235149+0000","last_became_active":"2023-12-19T05:40:20.234388+0000","last_became_peered":"2023-12-19T05:40:20.234388+0000","last_unstale":"2023-12-19T05:40:20.235149+0000","last_undegraded":"2023-12-19T05:40:20.235149+0000","last_fullsized":"2023-12-19T05:40:20.235149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:23.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229043+0000","last_change":"2023-12-19T05:40:19.727853+0000","last_active":"2023-12-19T05:40:21.229043+0000","last_peered":"2023-12-19T05:40:21.229043+0000","last_clean":"2023-12-19T05:40:21.229043+0000","last_became_active":"2023-12-19T05:40:19.724599+0000","last_became_peered":"2023-12-19T05:40:19.724599+0000","last_unstale":"2023-12-19T05:40:21.229043+0000","last_undegraded":"2023-12-19T05:40:21.229043+0000","last_fullsized":"2023-12-19T05:40:21.229043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:47.454686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.230424+0000","last_change":"2023-12-19T05:40:20.247910+0000","last_active":"2023-12-19T05:40:21.230424+0000","last_peered":"2023-12-19T05:40:21.230424+0000","last_clean":"2023-12-19T05:40:21.230424+0000","last_became_active":"2023-12-19T05:40:20.245800+0000","last_became_peered":"2023-12-19T05:40:20.245800+0000","last_unstale":"2023-12-19T05:40:21.230424+0000","last_undegraded":"2023-12-19T05:40:21.230424+0000","last_fullsized":"2023-12-19T05:40:21.230424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:26.978106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101080+0000","last_change":"2023-12-19T05:40:19.724475+0000","last_active":"2023-12-19T05:40:22.101080+0000","last_peered":"2023-12-19T05:40:22.101080+0000","last_clean":"2023-12-19T05:40:22.101080+0000","last_became_active":"2023-12-19T05:40:19.724092+0000","last_became_peered":"2023-12-19T05:40:19.724092+0000","last_unstale":"2023-12-19T05:40:22.101080+0000","last_undegraded":"2023-12-19T05:40:22.101080+0000","last_fullsized":"2023-12-19T05:40:22.101080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:39.132355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228677+0000","last_change":"2023-12-19T05:40:20.243295+0000","last_active":"2023-12-19T05:40:21.228677+0000","last_peered":"2023-12-19T05:40:21.228677+0000","last_clean":"2023-12-19T05:40:21.228677+0000","last_became_active":"2023-12-19T05:40:20.243058+0000","last_became_peered":"2023-12-19T05:40:20.243058+0000","last_unstale":"2023-12-19T05:40:21.228677+0000","last_undegraded":"2023-12-19T05:40:21.228677+0000","last_fullsized":"2023-12-19T05:40:21.228677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:17:52.385149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.231476+0000","last_change":"2023-12-19T05:40:19.727421+0000","last_active":"2023-12-19T05:40:21.231476+0000","last_peered":"2023-12-19T05:40:21.231476+0000","last_clean":"2023-12-19T05:40:21.231476+0000","last_became_active":"2023-12-19T05:40:19.725852+0000","last_became_peered":"2023-12-19T05:40:19.725852+0000","last_unstale":"2023-12-19T05:40:21.231476+0000","last_undegraded":"2023-12-19T05:40:21.231476+0000","last_fullsized":"2023-12-19T05:40:21.231476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:27:53.567641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.229832+0000","last_change":"2023-12-19T05:40:20.256366+0000","last_active":"2023-12-19T05:40:21.229832+0000","last_peered":"2023-12-19T05:40:21.229832+0000","last_clean":"2023-12-19T05:40:21.229832+0000","last_became_active":"2023-12-19T05:40:20.256137+0000","last_became_peered":"2023-12-19T05:40:20.256137+0000","last_unstale":"2023-12-19T05:40:21.229832+0000","last_undegraded":"2023-12-19T05:40:21.229832+0000","last_fullsized":"2023-12-19T05:40:21.229832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:19.662114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101523+0000","last_change":"2023-12-19T05:40:19.729238+0000","last_active":"2023-12-19T05:40:22.101523+0000","last_peered":"2023-12-19T05:40:22.101523+0000","last_clean":"2023-12-19T05:40:22.101523+0000","last_became_active":"2023-12-19T05:40:19.728999+0000","last_became_peered":"2023-12-19T05:40:19.728999+0000","last_unstale":"2023-12-19T05:40:22.101523+0000","last_undegraded":"2023-12-19T05:40:22.101523+0000","last_fullsized":"2023-12-19T05:40:22.101523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:02.753984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244001+0000","last_change":"2023-12-19T05:40:20.243523+0000","last_active":"2023-12-19T05:40:20.244001+0000","last_peered":"2023-12-19T05:40:20.244001+0000","last_clean":"2023-12-19T05:40:20.244001+0000","last_became_active":"2023-12-19T05:40:20.243284+0000","last_became_peered":"2023-12-19T05:40:20.243284+0000","last_unstale":"2023-12-19T05:40:20.244001+0000","last_undegraded":"2023-12-19T05:40:20.244001+0000","last_fullsized":"2023-12-19T05:40:20.244001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:37.053338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101848+0000","last_change":"2023-12-19T05:40:19.727363+0000","last_active":"2023-12-19T05:40:22.101848+0000","last_peered":"2023-12-19T05:40:22.101848+0000","last_clean":"2023-12-19T05:40:22.101848+0000","last_became_active":"2023-12-19T05:40:19.726855+0000","last_became_peered":"2023-12-19T05:40:19.726855+0000","last_unstale":"2023-12-19T05:40:22.101848+0000","last_undegraded":"2023-12-19T05:40:22.101848+0000","last_fullsized":"2023-12-19T05:40:22.101848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:22.630482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.248089+0000","last_change":"2023-12-19T05:40:20.246931+0000","last_active":"2023-12-19T05:40:20.248089+0000","last_peered":"2023-12-19T05:40:20.248089+0000","last_clean":"2023-12-19T05:40:20.248089+0000","last_became_active":"2023-12-19T05:40:20.246697+0000","last_became_peered":"2023-12-19T05:40:20.246697+0000","last_unstale":"2023-12-19T05:40:20.248089+0000","last_undegraded":"2023-12-19T05:40:20.248089+0000","last_fullsized":"2023-12-19T05:40:20.248089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.669249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:22.101527+0000","last_change":"2023-12-19T05:40:19.721364+0000","last_active":"2023-12-19T05:40:22.101527+0000","last_peered":"2023-12-19T05:40:22.101527+0000","last_clean":"2023-12-19T05:40:22.101527+0000","last_became_active":"2023-12-19T05:40:19.720965+0000","last_became_peered":"2023-12-19T05:40:19.720965+0000","last_unstale":"2023-12-19T05:40:22.101527+0000","last_undegraded":"2023-12-19T05:40:22.101527+0000","last_fullsized":"2023-12-19T05:40:22.101527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:01:24.954794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.254680+0000","last_change":"2023-12-19T05:40:20.254604+0000","last_active":"2023-12-19T05:40:20.254680+0000","last_peered":"2023-12-19T05:40:20.254680+0000","last_clean":"2023-12-19T05:40:20.254680+0000","last_became_active":"2023-12-19T05:40:20.248578+0000","last_became_peered":"2023-12-19T05:40:20.248578+0000","last_unstale":"2023-12-19T05:40:20.254680+0000","last_undegraded":"2023-12-19T05:40:20.254680+0000","last_fullsized":"2023-12-19T05:40:20.254680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:41:31.637820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.227989+0000","last_change":"2023-12-19T05:40:19.724252+0000","last_active":"2023-12-19T05:40:20.227989+0000","last_peered":"2023-12-19T05:40:20.227989+0000","last_clean":"2023-12-19T05:40:20.227989+0000","last_became_active":"2023-12-19T05:40:19.723901+0000","last_became_peered":"2023-12-19T05:40:19.723901+0000","last_unstale":"2023-12-19T05:40:20.227989+0000","last_undegraded":"2023-12-19T05:40:20.227989+0000","last_fullsized":"2023-12-19T05:40:20.227989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:53:39.132355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228598+0000","last_change":"2023-12-19T05:40:20.237382+0000","last_active":"2023-12-19T05:40:21.228598+0000","last_peered":"2023-12-19T05:40:21.228598+0000","last_clean":"2023-12-19T05:40:21.228598+0000","last_became_active":"2023-12-19T05:40:20.237043+0000","last_became_peered":"2023-12-19T05:40:20.237043+0000","last_unstale":"2023-12-19T05:40:21.228598+0000","last_undegraded":"2023-12-19T05:40:21.228598+0000","last_fullsized":"2023-12-19T05:40:21.228598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:15:02.206349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.241258+0000","last_change":"2023-12-19T05:40:19.730762+0000","last_active":"2023-12-19T05:40:20.241258+0000","last_peered":"2023-12-19T05:40:20.241258+0000","last_clean":"2023-12-19T05:40:20.241258+0000","last_became_active":"2023-12-19T05:40:19.729426+0000","last_became_peered":"2023-12-19T05:40:19.729426+0000","last_unstale":"2023-12-19T05:40:20.241258+0000","last_undegraded":"2023-12-19T05:40:20.241258+0000","last_fullsized":"2023-12-19T05:40:20.241258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:52.007533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T05:40:20.244352+0000","last_change":"2023-12-19T05:40:20.244259+0000","last_active":"2023-12-19T05:40:20.244352+0000","last_peered":"2023-12-19T05:40:20.244352+0000","last_clean":"2023-12-19T05:40:20.244352+0000","last_became_active":"2023-12-19T05:40:20.243685+0000","last_became_peered":"2023-12-19T05:40:20.243685+0000","last_unstale":"2023-12-19T05:40:20.244352+0000","last_undegraded":"2023-12-19T05:40:20.244352+0000","last_fullsized":"2023-12-19T05:40:20.244352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:19.692994+0000","last_clean_scrub_stamp":"2023-12-19T05:40:19.692994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:35.898000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T05:40:21.228378+0000","last_change":"2023-12-19T05:40:19.725258+0000","last_active":"2023-12-19T05:40:21.228378+0000","last_peered":"2023-12-19T05:40:21.228378+0000","last_clean":"2023-12-19T05:40:21.228378+0000","last_became_active":"2023-12-19T05:40:19.725008+0000","last_became_peered":"2023-12-19T05:40:19.725008+0000","last_unstale":"2023-12-19T05:40:21.228378+0000","last_undegraded":"2023-12-19T05:40:21.228378+0000","last_fullsized":"2023-12-19T05:40:21.228378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:40:18.681595+0000","last_clean_scrub_stamp":"2023-12-19T05:40:18.681595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:53:34.886601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-19T05:40:19.720414+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:40:19.720414+0000","last_peered":"2023-12-19T05:40:19.720414+0000","last_clean":"2023-12-19T05:40:19.720414+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:40:19.720414+0000","last_undegraded":"2023-12-19T05:40:19.720414+0000","last_fullsized":"2023-12-19T05:40:19.720414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848737,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.375}]},{"osd":2,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.601}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.637}]},{"osd":5,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2929999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.496},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.7}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.7000000000000002,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.595},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.669}]},{"osd":2,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.5220000000000002,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.472},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.7749999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":4.6689999999999996,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.236}]},{"osd":5,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":4.5670000000000002,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":3.681,"5min":3.681,"15min":3.681},"last":1.7350000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:39:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.631},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":2.2360000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194587,"statfs":{"total":200000000,"available":199257809,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.415},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.044}]},{"osd":2,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.54}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":1.004}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.49},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.157}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.169},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.591}]},{"osd":7,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.655,"5min":1.655,"15min":1.655},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.2330000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853473,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.173},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.486}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.3520000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.4179999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.546},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.45}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.208},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.266}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3080000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199847983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89600000000000002}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.85099999999999998}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.2749999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.506},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0590000000000002,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.413}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.474}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.55},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.46}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199855025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.753}]},{"osd":3,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.622},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.878},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Dec 19 05:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264621,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.3}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3360000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.0859999999999999,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":1.161},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.0389999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.635},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.5}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.0539999999999998,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":1.738}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.89100000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.997}]},{"osd":4,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.208}]},{"osd":5,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.1719999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.153},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.7130000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.123}]}]}],"pool_statfs":[]}} 2023-12-19T05:40:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:40:25.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:40:25.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.547+0000 7fdbdbfff640 1 Processor -- start 2023-12-19T05:40:25.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.547+0000 7fdbdbfff640 1 -- start start 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.548+0000 7fdbdbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.548+0000 7fdbdbfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdbdc0b7a70 0x7fdbdc166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdbfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc070cf0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdbfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b3200 con 0x7fdbdc0b7a70 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc147140 con 0x7fdbdc146d60 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdb7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdbdc0b7a70 0x7fdbdc166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55326/0 (socket says 172.21.15.49:55326) 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbdaffd640 1 -- 172.21.15.49:0/3031775871 learned_addr learned my addr 172.21.15.49:0/3031775871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.549+0000 7fdbd27fc640 1 --1- 172.21.15.49:0/3031775871 >> v1:172.21.15.115:6789/0 conn(0x7fdbdc06fb70 0x7fdbdc0b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54888/0 (socket says 172.21.15.49:54888) 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.550+0000 7fdbdaffd640 1 -- 172.21.15.49:0/3031775871 >> v2:172.21.15.115:3300/0 conn(0x7fdbdc0b7a70 msgr2=0x7fdbdc166fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.550+0000 7fdbdaffd640 1 --2- 172.21.15.49:0/3031775871 >> v2:172.21.15.115:3300/0 conn(0x7fdbdc0b7a70 0x7fdbdc166fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.550+0000 7fdbdaffd640 1 -- 172.21.15.49:0/3031775871 >> v1:172.21.15.115:6789/0 conn(0x7fdbdc06fb70 legacy=0x7fdbdc0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.550+0000 7fdbdaffd640 1 -- 172.21.15.49:0/3031775871 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0b1470 con 0x7fdbdc146d60 2023-12-19T05:40:25.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.552+0000 7fdbdaffd640 1 --2- 172.21.15.49:0/3031775871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ea0 tx=0x7fdbcc02c030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b0586c1a390a4a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.552+0000 7fdbda7fc640 1 -- 172.21.15.49:0/3031775871 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02cbd0 con 0x7fdbdc146d60 2023-12-19T05:40:25.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.552+0000 7fdbda7fc640 1 -- 172.21.15.49:0/3031775871 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02cd30 con 0x7fdbdc146d60 2023-12-19T05:40:25.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.552+0000 7fdbda7fc640 1 -- 172.21.15.49:0/3031775871 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02cea0 con 0x7fdbdc146d60 2023-12-19T05:40:25.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 -- 172.21.15.49:0/3031775871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 msgr2=0x7fdbdc0b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/3031775871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ea0 tx=0x7fdbcc02c030 comp rx=0 tx=0).stop 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 -- 172.21.15.49:0/3031775871 shutdown_connections 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/3031775871 >> v2:172.21.15.115:3300/0 conn(0x7fdbdc0b7a70 0x7fdbdc166fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/3031775871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc146d60 0x7fdbdc0b6e20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 -- 172.21.15.49:0/3031775871 >> 172.21.15.49:0/3031775871 conn(0x7fdbdc0b2390 msgr2=0x7fdbdc0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 -- 172.21.15.49:0/3031775871 shutdown_connections 2023-12-19T05:40:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.553+0000 7fdbdbfff640 1 -- 172.21.15.49:0/3031775871 wait complete. 2023-12-19T05:40:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.555+0000 7fdbdbfff640 1 Processor -- start 2023-12-19T05:40:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.555+0000 7fdbdbfff640 1 -- start start 2023-12-19T05:40:25.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc0b7a70 0x7fdbdc159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 0x7fdbdc0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc1362b0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15a920 con 0x7fdbdc146d60 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.556+0000 7fdbdbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15ac00 con 0x7fdbdc0b7a70 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58986/0 (socket says 172.21.15.49:58986) 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 -- 172.21.15.49:0/540324040 learned_addr learned my addr 172.21.15.49:0/540324040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdb7fe640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 0x7fdbdc0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbd27fc640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc0b7a70 0x7fdbdc159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 -- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc0b7a70 msgr2=0x7fdbdc159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc0b7a70 0x7fdbdc159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 -- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 msgr2=0x7fdbdc0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 0x7fdbdc0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdaffd640 1 -- 172.21.15.49:0/540324040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009b30 con 0x7fdbdc06fb70 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.557+0000 7fdbdb7fe640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 0x7fdbdc0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbdaffd640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc000f80 tx=0x7fdbcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02cea0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc009510 con 0x7fdbdc06fb70 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc15aee0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc03e690 con 0x7fdbdc06fb70 2023-12-19T05:40:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.558+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc15b4a0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.559+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0d0ff0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.560+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdbcc03e7f0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.561+0000 7fdbd8ff9640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 0x7fdbbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.562+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbcc0ab580 con 0x7fdbdc06fb70 2023-12-19T05:40:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.562+0000 7fdbd27fc640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 0x7fdbbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:25.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.563+0000 7fdbd27fc640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 0x7fdbbc06c920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc15d570 tx=0x7fdbc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:25.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.566+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdbcc076ae0 con 0x7fdbdc06fb70 2023-12-19T05:40:25.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:25.648 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.830+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdbdc061910 con 0x7fdbdc06fb70 2023-12-19T05:40:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.838+0000 7fdbd8ff9640 1 -- 172.21.15.49:0/540324040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdbcc07a100 con 0x7fdbdc06fb70 2023-12-19T05:40:25.839 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 msgr2=0x7fdbbc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 0x7fdbbc06c920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc15d570 tx=0x7fdbc4009040 comp rx=0 tx=0).stop 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 msgr2=0x7fdbdc135d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc000f80 tx=0x7fdbcc004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 shutdown_connections 2023-12-19T05:40:25.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdbbc06a460 0x7fdbbc06c920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbdc0b7a70 0x7fdbdc159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc146d60 0x7fdbdc0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 --2- 172.21.15.49:0/540324040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbdc06fb70 0x7fdbdc135d70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 >> 172.21.15.49:0/540324040 conn(0x7fdbdc0b2390 msgr2=0x7fdbdc0af460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 shutdown_connections 2023-12-19T05:40:25.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:25.841+0000 7fdbdbfff640 1 -- 172.21.15.49:0/540324040 wait complete. 2023-12-19T05:40:25.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:26.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.100+0000 7f9faed01640 1 Processor -- start 2023-12-19T05:40:26.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.100+0000 7f9faed01640 1 -- start start 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 0x7f9fa80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 0x7f9fa80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9fa80cdbf0 0x7f9fa80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80ce5c0 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa815ec30 con 0x7f9fa815f680 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.102+0000 7f9faed01640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80b2cc0 con 0x7f9fa815e5a0 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9fa80cdbf0 0x7f9fa80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9fa80cdbf0 0x7f9fa80ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58998/0 (socket says 172.21.15.49:58998) 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 -- 172.21.15.49:0/3227333121 learned_addr learned my addr 172.21.15.49:0/3227333121 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fadcff640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 0x7f9fa80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fad4fe640 1 --2- 172.21.15.49:0/3227333121 >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 0x7f9fa80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 -- 172.21.15.49:0/3227333121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 msgr2=0x7f9fa80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 0x7f9fa80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 -- 172.21.15.49:0/3227333121 >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 msgr2=0x7f9fa80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 --2- 172.21.15.49:0/3227333121 >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 0x7f9fa80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fae500640 1 -- 172.21.15.49:0/3227333121 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa815e980 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fad4fe640 1 --2- 172.21.15.49:0/3227333121 >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 0x7f9fa80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:26.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.103+0000 7f9fadcff640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 0x7f9fa80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:26.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.104+0000 7f9fae500640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa80cdbf0 0x7f9fa80ce080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80cfe20 tx=0x7f9fa002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa51f3084b5000 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faccfd640 1 -- 172.21.15.49:0/3227333121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa002ca70 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faccfd640 1 -- 172.21.15.49:0/3227333121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa002cbd0 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faccfd640 1 -- 172.21.15.49:0/3227333121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00343f0 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 -- 172.21.15.49:0/3227333121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa80cdbf0 msgr2=0x7f9fa80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa80cdbf0 0x7f9fa80ce080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80cfe20 tx=0x7f9fa002bed0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 -- 172.21.15.49:0/3227333121 shutdown_connections 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa80cdbf0 0x7f9fa80ce080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 --2- 172.21.15.49:0/3227333121 >> v2:172.21.15.115:3300/0 conn(0x7f9fa815f680 0x7f9fa80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 --2- 172.21.15.49:0/3227333121 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa815e5a0 0x7f9fa80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.105+0000 7f9faed01640 1 -- 172.21.15.49:0/3227333121 >> 172.21.15.49:0/3227333121 conn(0x7f9fa80b0100 msgr2=0x7f9fa80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.106+0000 7f9faed01640 1 -- 172.21.15.49:0/3227333121 shutdown_connections 2023-12-19T05:40:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.106+0000 7f9faed01640 1 -- 172.21.15.49:0/3227333121 wait complete. 2023-12-19T05:40:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.107+0000 7f9faed01640 1 Processor -- start 2023-12-19T05:40:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.108+0000 7f9faed01640 1 -- start start 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa80cdbf0 0x7f9fa815a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fa815e5a0 0x7f9fa81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8153b40 con 0x7f9fa815f680 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8153e20 con 0x7f9fa815e5a0 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9faed01640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8154100 con 0x7f9fa80cdbf0 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59004/0 (socket says 172.21.15.49:59004) 2023-12-19T05:40:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 -- 172.21.15.49:0/1506429439 learned_addr learned my addr 172.21.15.49:0/1506429439 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fadcff640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa80cdbf0 0x7f9fa815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fad4fe640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fa815e5a0 0x7f9fa81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 -- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa80cdbf0 msgr2=0x7f9fa815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa80cdbf0 0x7f9fa815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 -- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fa815e5a0 msgr2=0x7f9fa81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.109+0000 7f9fae500640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fa815e5a0 0x7f9fa81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9fae500640 1 -- 172.21.15.49:0/1506429439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0009b30 con 0x7f9fa815f680 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9fae500640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0036040 tx=0x7f9fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0009510 con 0x7f9fa815f680 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa003e450 con 0x7f9fa815f680 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa003e7e0 con 0x7f9fa815f680 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa81543e0 con 0x7f9fa815f680 2023-12-19T05:40:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.110+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa81586f0 con 0x7f9fa815f680 2023-12-19T05:40:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.112+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa81548a0 con 0x7f9fa815f680 2023-12-19T05:40:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.113+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fa003e940 con 0x7f9fa815f680 2023-12-19T05:40:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.113+0000 7f9f9e7fc640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 0x7f9f8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.114+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa00ab760 con 0x7f9fa815f680 2023-12-19T05:40:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.114+0000 7f9fadcff640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 0x7f9f8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.115+0000 7f9fadcff640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 0x7f9f8c06c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4006fd0 tx=0x7f9fa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.118+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fa0076d40 con 0x7f9fa815f680 2023-12-19T05:40:26.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.356+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fa8158880 con 0x7f9fa815f680 2023-12-19T05:40:26.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.357+0000 7f9f9e7fc640 1 -- 172.21.15.49:0/1506429439 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f9fa007a360 con 0x7f9fa815f680 2023-12-19T05:40:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:26.359 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:26.359 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.360+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 msgr2=0x7f9f8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.360+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 0x7f9f8c06c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4006fd0 tx=0x7f9fa4008040 comp rx=0 tx=0).stop 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.360+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 msgr2=0x7f9fa81f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.360+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0036040 tx=0x7f9fa0004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 shutdown_connections 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f8c06a430 0x7f9f8c06c8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa815f680 0x7f9fa81f6090 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fa815e5a0 0x7f9fa81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 --2- 172.21.15.49:0/1506429439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fa80cdbf0 0x7f9fa815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:26.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 >> 172.21.15.49:0/1506429439 conn(0x7f9fa80b0100 msgr2=0x7f9fa806d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:26.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 shutdown_connections 2023-12-19T05:40:26.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:26.361+0000 7f9faed01640 1 -- 172.21.15.49:0/1506429439 wait complete. 2023-12-19T05:40:26.782 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:40:20.211569+0000', 'modified': '2023-12-19T05:40:23.230140+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6834/292473001', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 292473001}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 292473001}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:40:26.782 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:40:26.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:40:27.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.018+0000 7f2ad060b640 1 Processor -- start 2023-12-19T05:40:27.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.018+0000 7f2ad060b640 1 -- start start 2023-12-19T05:40:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ad060b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 0x7f2ac815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ad060b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ac80af540 0x7f2ac80af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ad060b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac815e400 con 0x7f2ac806e190 2023-12-19T05:40:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ad060b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac815daa0 con 0x7f2ac80af540 2023-12-19T05:40:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ad060b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80aff30 con 0x7f2ac81599c0 2023-12-19T05:40:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2aceba8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ac80af540 0x7f2ac80af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2acdba6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2ac806e190 0x7f2ac80cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46266/0 (socket says 172.21.15.49:46266) 2023-12-19T05:40:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2acdba6640 1 -- 172.21.15.49:0/798014820 learned_addr learned my addr 172.21.15.49:0/798014820 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.020+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/798014820 >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 0x7f2ac815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2aceba8640 1 -- 172.21.15.49:0/798014820 >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 msgr2=0x7f2ac815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2aceba8640 1 --2- 172.21.15.49:0/798014820 >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 0x7f2ac815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2aceba8640 1 -- 172.21.15.49:0/798014820 >> v1:172.21.15.49:6789/0 conn(0x7f2ac806e190 legacy=0x7f2ac80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2aceba8640 1 -- 172.21.15.49:0/798014820 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80ce780 con 0x7f2ac80af540 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2acd3a5640 1 -- 172.21.15.49:0/798014820 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823237589 0 0) 0x7f2ac815e400 con 0x7f2ac806e190 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.021+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/798014820 >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 0x7f2ac815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.022+0000 7f2aceba8640 1 --2- 172.21.15.49:0/798014820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac80af9f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b0e40 tx=0x7f2ac002bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadbb15eaf485372 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.022+0000 7f2acd3a5640 1 -- 172.21.15.49:0/798014820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac002cb50 con 0x7f2ac80af540 2023-12-19T05:40:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.022+0000 7f2acd3a5640 1 -- 172.21.15.49:0/798014820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac002ccb0 con 0x7f2ac80af540 2023-12-19T05:40:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.022+0000 7f2acd3a5640 1 -- 172.21.15.49:0/798014820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0034660 con 0x7f2ac80af540 2023-12-19T05:40:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 -- 172.21.15.49:0/798014820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 msgr2=0x7f2ac80af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 --2- 172.21.15.49:0/798014820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac80af9f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b0e40 tx=0x7f2ac002bda0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 -- 172.21.15.49:0/798014820 shutdown_connections 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 --2- 172.21.15.49:0/798014820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac80af9f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 --2- 172.21.15.49:0/798014820 >> v2:172.21.15.115:3300/0 conn(0x7f2ac81599c0 0x7f2ac815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 -- 172.21.15.49:0/798014820 >> 172.21.15.49:0/798014820 conn(0x7f2ac80cbb70 msgr2=0x7f2ac80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 -- 172.21.15.49:0/798014820 shutdown_connections 2023-12-19T05:40:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.023+0000 7f2ad060b640 1 -- 172.21.15.49:0/798014820 wait complete. 2023-12-19T05:40:27.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.025+0000 7f2ad060b640 1 Processor -- start 2023-12-19T05:40:27.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.025+0000 7f2ad060b640 1 -- start start 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ac806e190 0x7f2ac8149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac81599c0 0x7f2ac81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac814f540 con 0x7f2ac80af540 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81505f0 con 0x7f2ac81599c0 2023-12-19T05:40:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ad060b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac814e9c0 con 0x7f2ac806e190 2023-12-19T05:40:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59022/0 (socket says 172.21.15.49:59022) 2023-12-19T05:40:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2acdba6640 1 -- 172.21.15.49:0/2919809519 learned_addr learned my addr 172.21.15.49:0/2919809519 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2aceba8640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac81599c0 0x7f2ac81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.026+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ac806e190 0x7f2ac8149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 -- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ac806e190 msgr2=0x7f2ac8149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ac806e190 0x7f2ac8149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 -- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac81599c0 msgr2=0x7f2ac81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac81599c0 0x7f2ac81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 -- 172.21.15.49:0/2919809519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009a70 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c410 tx=0x7f2ab800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2abeffd640 1 -- 172.21.15.49:0/2919809519 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80074e0 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2abeffd640 1 -- 172.21.15.49:0/2919809519 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8007660 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2abeffd640 1 -- 172.21.15.49:0/2919809519 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8004a20 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac814eca0 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.027+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac814f260 con 0x7f2ac80af540 2023-12-19T05:40:27.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.030+0000 7f2abeffd640 1 -- 172.21.15.49:0/2919809519 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ab8004b80 con 0x7f2ac80af540 2023-12-19T05:40:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.030+0000 7f2abeffd640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 0x7f2aac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.031+0000 7f2abeffd640 1 -- 172.21.15.49:0/2919809519 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ab8088790 con 0x7f2ac80af540 2023-12-19T05:40:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.031+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 0x7f2aac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.031+0000 7f2ad3179740 1 Processor -- start 2023-12-19T05:40:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.032+0000 7f2ad3179740 1 -- start start 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.032+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 0x7f2aac06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400a950 tx=0x7f2ac4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2deb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2d2af80 con 0x55b8d2dbacb0 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2d28710 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2d24000 con 0x55b8d2dead30 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59026/0 (socket says 172.21.15.49:59026) 2023-12-19T05:40:27.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 -- 172.21.15.49:0/2559923704 learned_addr learned my addr 172.21.15.49:0/2559923704 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2deb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2aceba8640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 -- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 msgr2=0x55b8d2deb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2deb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 -- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 msgr2=0x55b8d2de84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2acdba6640 1 -- 172.21.15.49:0/2559923704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8d2ceb690 con 0x55b8d2dbacb0 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.033+0000 7f2aceba8640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.034+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80576a0 tx=0x7f2ab8058160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c693c01082015273 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.034+0000 7f2aabfff640 1 -- 172.21.15.49:0/2559923704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab805f980 con 0x55b8d2dbacb0 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.034+0000 7f2aabfff640 1 -- 172.21.15.49:0/2559923704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8055d40 con 0x55b8d2dbacb0 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.034+0000 7f2aabfff640 1 -- 172.21.15.49:0/2559923704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80540b0 con 0x55b8d2dbacb0 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.034+0000 7f2ad3179740 1 -- 172.21.15.49:0/2559923704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 msgr2=0x55b8d2de7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80576a0 tx=0x7f2ab8058160 comp rx=0 tx=0).stop 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 -- 172.21.15.49:0/2559923704 shutdown_connections 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbacb0 0x55b8d2de7fa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2559923704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2deb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 -- 172.21.15.49:0/2559923704 >> 172.21.15.49:0/2559923704 conn(0x55b8d2dbcfc0 msgr2=0x55b8d2e05b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 -- 172.21.15.49:0/2559923704 shutdown_connections 2023-12-19T05:40:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.035+0000 7f2ad3179740 1 -- 172.21.15.49:0/2559923704 wait complete. 2023-12-19T05:40:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.036+0000 7f2ad3179740 1 -- start start 2023-12-19T05:40:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.036+0000 7f2ad3179740 1 Processor -- start 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2dea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2ddfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2cc57d0 con 0x55b8d2de02b0 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2cc5470 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2a8bf20 con 0x55b8d2dead30 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ad3179740 10 client.0 _ll_register_callbacks cb 0x55b8d2d141b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2aceba8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2aceba8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59040/0 (socket says 172.21.15.49:59040) 2023-12-19T05:40:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2aceba8640 1 -- 172.21.15.49:0/1860548940 learned_addr learned my addr 172.21.15.49:0/1860548940 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.037+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2dea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2acdba6640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2ddfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 -- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 msgr2=0x55b8d2ddfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2ddfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 -- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 msgr2=0x55b8d2dea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2dea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 -- 172.21.15.49:0/1860548940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac814f260 con 0x55b8d2de02b0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2dea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aceba8640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009e80 tx=0x7f2ac0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3dbe83ee596a62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac002c950 con 0x55b8d2de02b0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ac002cab0 con 0x55b8d2de02b0 2023-12-19T05:40:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.038+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8d2d4e550 con 0x55b8d2de02b0 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.039+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ac0003990 con 0x55b8d2de02b0 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.039+0000 7f2ad3179740 10 client.5238 fetch_fsmap learned FSMap version 16 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.039+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b8d2d22680 con 0x55b8d2de02b0 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.039+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8d2d4e550 con 0x55b8d2de02b0 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ac0003af0 con 0x55b8d2de02b0 2023-12-19T05:40:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 10 client.5238 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 20 client.5238 populate_metadata read hostname 'smithi049' 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2de1fb0 0x55b8d2de2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 4 client.5238 mds_command: new command op to 5052 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 --> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8d2d16b50 con 0x55b8d2de1fb0 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.040+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2de1fb0 0x55b8d2de2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.041+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2de1fb0 0x55b8d2de2390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae43ae7301d8062f server_cookie=a0b5aee6ed07342a in_seq=0 out_seq=0 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.041+0000 7f2aa97fa640 10 client.5238 ms_handle_connect on v2:172.21.15.49:6832/292473001 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.041+0000 7f2aa97fa640 1 -- 172.21.15.49:0/1860548940 <== mds.0 v2:172.21.15.49:6832/292473001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b8d2d16b50 con 0x55b8d2de1fb0 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.041+0000 7f2aa97fa640 10 client.5238 handle_command_reply: tid=0 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.041+0000 7f2ad3179740 1 client.5238 shutdown 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 msgr2=0x55b8d2debf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009e80 tx=0x7f2ac0004ab0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 shutdown_connections 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2de1fb0 0x55b8d2de2390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2ddfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2debf20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1860548940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2dea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2aa97fa640 0 client.5238 ms_handle_reset on v2:172.21.15.49:6832/292473001 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 >> 172.21.15.49:0/1860548940 conn(0x55b8d2dbacb0 msgr2=0x55b8d2dbee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 shutdown_connections 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 1 -- 172.21.15.49:0/1860548940 wait complete. 2023-12-19T05:40:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.042+0000 7f2ad3179740 20 client.5238 trim_cache size 0 max 16384 2023-12-19T05:40:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.059+0000 7f2ad3179740 1 Processor -- start 2023-12-19T05:40:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.059+0000 7f2ad3179740 1 -- start start 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2de0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2e17ce0 con 0x55b8d2de02b0 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2de8200 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2dedd20 con 0x55b8d2dead30 2023-12-19T05:40:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2acdba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59048/0 (socket says 172.21.15.49:59048) 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2acdba6640 1 -- 172.21.15.49:0/1625896163 learned_addr learned my addr 172.21.15.49:0/1625896163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2aceba8640 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2de0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.060+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 -- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 msgr2=0x55b8d2de0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2de0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 -- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 msgr2=0x55b8d2de2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 -- 172.21.15.49:0/1625896163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8d2cc49e0 con 0x55b8d2de02b0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2acdba6640 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800cdd0 tx=0x7f2ab805b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afc54242c00c673 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2abcff9640 1 -- 172.21.15.49:0/1625896163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab805f980 con 0x55b8d2de02b0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2abcff9640 1 -- 172.21.15.49:0/1625896163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8086040 con 0x55b8d2de02b0 2023-12-19T05:40:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.061+0000 7f2abcff9640 1 -- 172.21.15.49:0/1625896163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80540b0 con 0x55b8d2de02b0 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 -- 172.21.15.49:0/1625896163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 msgr2=0x55b8d2de6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800cdd0 tx=0x7f2ab805b000 comp rx=0 tx=0).stop 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 -- 172.21.15.49:0/1625896163 shutdown_connections 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2de0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2de02b0 0x55b8d2de6f60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 --2- 172.21.15.49:0/1625896163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2de2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 -- 172.21.15.49:0/1625896163 >> 172.21.15.49:0/1625896163 conn(0x55b8d2dbacb0 msgr2=0x55b8d2de7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 -- 172.21.15.49:0/1625896163 shutdown_connections 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.062+0000 7f2ad3179740 1 -- 172.21.15.49:0/1625896163 wait complete. 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.063+0000 7f2ad3179740 1 -- start start 2023-12-19T05:40:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.063+0000 7f2ad3179740 1 Processor -- start 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2de02b0 0x55b8d2dee240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2dee780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2e07df0 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2e74db0 con 0x55b8d2de02b0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8d2de3290 con 0x55b8d2dead30 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ad3179740 10 client.0 _ll_register_callbacks cb 0x7f2ab8088040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ace3a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ace3a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59052/0 (socket says 172.21.15.49:59052) 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.064+0000 7f2ace3a7640 1 -- 172.21.15.49:0/2179742110 learned_addr learned my addr 172.21.15.49:0/2179742110 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2de02b0 0x55b8d2dee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2aceba8640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2dee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 -- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 msgr2=0x55b8d2dee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2dee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 -- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2de02b0 msgr2=0x55b8d2dee240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2de02b0 0x55b8d2dee240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 -- 172.21.15.49:0/2179742110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8d2ceb690 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ace3a7640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55b8d2de90b0 tx=0x7f2ac4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490994f90401cc7e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac402a030 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ac402b070 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.065+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ab8055d40 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ac40262c0 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 10 client.5244 fetch_fsmap learned FSMap version 16 2023-12-19T05:40:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b8d2ce9ef0 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8055d40 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ac4020040 con 0x55b8d2dbe8b0 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 10 client.5244 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 10 client.5244 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 20 client.5244 populate_metadata read hostname 'smithi049' 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2e74260 0x55b8d2e1e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 4 client.5244 mds_command: new command op to 5052 tid=0[{"prefix": "status"}] 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 --> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b8d2d1d080 con 0x55b8d2e74260 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.066+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2e74260 0x55b8d2e1e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2acdba6640 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2e74260 0x55b8d2e1e440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3c42ff69b4ce0e server_cookie=fe9732b476aadcf5 in_seq=0 out_seq=0 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2aa97fa640 10 client.5244 ms_handle_connect on v2:172.21.15.49:6832/292473001 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2aa97fa640 1 -- 172.21.15.49:0/2179742110 <== mds.0 v2:172.21.15.49:6832/292473001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b8d2d1d080 con 0x55b8d2e74260 2023-12-19T05:40:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2aa97fa640 10 client.5244 handle_command_reply: tid=0 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 client.5244 shutdown 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 msgr2=0x55b8d2e08210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55b8d2de90b0 tx=0x7f2ac4004730 comp rx=0 tx=0).stop 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 shutdown_connections 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:6832/292473001,v1:172.21.15.49:6834/292473001] conn(0x55b8d2e74260 0x55b8d2e1e440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55b8d2dead30 0x55b8d2dee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b8d2de02b0 0x55b8d2dee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2aa97fa640 0 client.5244 ms_handle_reset on v2:172.21.15.49:6832/292473001 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.067+0000 7f2ad3179740 1 --2- 172.21.15.49:0/2179742110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b8d2dbe8b0 0x55b8d2e08210 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 >> 172.21.15.49:0/2179742110 conn(0x55b8d2dbacb0 msgr2=0x55b8d2de08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 shutdown_connections 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad3179740 1 -- 172.21.15.49:0/2179742110 wait complete. 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad3179740 20 client.5244 trim_cache size 0 max 16384 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:40:27.074 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5052, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.8519329989999997, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 16, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 34, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 34, 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 16.135525879999999 2023-12-19T05:40:27.075 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:40:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 msgr2=0x7f2aac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 0x7f2aac06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400a950 tx=0x7f2ac4008040 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 msgr2=0x7f2ac814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.068+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c410 tx=0x7f2ab800c8d0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 shutdown_connections 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2aac06a430 0x7f2aac06c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac81599c0 0x7f2ac81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ac80af540 0x7f2ac814fb70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 --2- 172.21.15.49:0/2919809519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ac806e190 0x7f2ac8149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 >> 172.21.15.49:0/2919809519 conn(0x7f2ac80cbb70 msgr2=0x7f2ac806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 shutdown_connections 2023-12-19T05:40:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.069+0000 7f2ad060b640 1 -- 172.21.15.49:0/2919809519 wait complete. 2023-12-19T05:40:27.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:40:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.310+0000 7f05df59e640 1 Processor -- start 2023-12-19T05:40:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.310+0000 7f05df59e640 1 -- start start 2023-12-19T05:40:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05e0159810 0x7f05e0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05e006f9f0 0x7f05e006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e015d0e0 con 0x7f05e0159810 2023-12-19T05:40:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e0070350 con 0x7f05e006f9f0 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.311+0000 7f05df59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00cd360 con 0x7f05e00cc990 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05e0159810 0x7f05e0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05e0159810 0x7f05e0159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59060/0 (socket says 172.21.15.49:59060) 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 -- 172.21.15.49:0/3049106522 learned_addr learned my addr 172.21.15.49:0/3049106522 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05d7fff640 1 --2- 172.21.15.49:0/3049106522 >> v2:172.21.15.115:3300/0 conn(0x7f05e006f9f0 0x7f05e006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05ded9d640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 -- 172.21.15.49:0/3049106522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 msgr2=0x7f05e00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e00cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 -- 172.21.15.49:0/3049106522 >> v2:172.21.15.115:3300/0 conn(0x7f05e006f9f0 msgr2=0x7f05e006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 --2- 172.21.15.49:0/3049106522 >> v2:172.21.15.115:3300/0 conn(0x7f05e006f9f0 0x7f05e006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.312+0000 7f05de59c640 1 -- 172.21.15.49:0/3049106522 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00b1590 con 0x7f05e0159810 2023-12-19T05:40:27.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.313+0000 7f05de59c640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e0159810 0x7f05e0159bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f05e004e320 tx=0x7f05d002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88e9fd4b507b19b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05ddd9b640 1 -- 172.21.15.49:0/3049106522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d002ee00 con 0x7f05e0159810 2023-12-19T05:40:27.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05ddd9b640 1 -- 172.21.15.49:0/3049106522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0036440 con 0x7f05e0159810 2023-12-19T05:40:27.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05ddd9b640 1 -- 172.21.15.49:0/3049106522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d00367d0 con 0x7f05e0159810 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05df59e640 1 -- 172.21.15.49:0/3049106522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e0159810 msgr2=0x7f05e0159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05df59e640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e0159810 0x7f05e0159bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f05e004e320 tx=0x7f05d002e050 comp rx=0 tx=0).stop 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05df59e640 1 -- 172.21.15.49:0/3049106522 shutdown_connections 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.314+0000 7f05df59e640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e00cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.315+0000 7f05df59e640 1 --2- 172.21.15.49:0/3049106522 >> v2:172.21.15.115:3300/0 conn(0x7f05e006f9f0 0x7f05e006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.315+0000 7f05df59e640 1 --2- 172.21.15.49:0/3049106522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e0159810 0x7f05e0159bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.315+0000 7f05df59e640 1 -- 172.21.15.49:0/3049106522 >> 172.21.15.49:0/3049106522 conn(0x7f05e00b0100 msgr2=0x7f05e00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.315+0000 7f05df59e640 1 -- 172.21.15.49:0/3049106522 shutdown_connections 2023-12-19T05:40:27.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.315+0000 7f05df59e640 1 -- 172.21.15.49:0/3049106522 wait complete. 2023-12-19T05:40:27.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.316+0000 7f05df59e640 1 Processor -- start 2023-12-19T05:40:27.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 -- start start 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e013e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 0x7f05e0141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e006d3a0 con 0x7f05e006f9f0 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01418d0 con 0x7f05e0159810 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.317+0000 7f05df59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01557d0 con 0x7f05e00cc990 2023-12-19T05:40:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59062/0 (socket says 172.21.15.49:59062) 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 -- 172.21.15.49:0/1446437428 learned_addr learned my addr 172.21.15.49:0/1446437428 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05ded9d640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 0x7f05e0141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05d7fff640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e013e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 -- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 msgr2=0x7f05e013e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e013e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 -- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 msgr2=0x7f05e0141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 0x7f05e0141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05de59c640 1 -- 172.21.15.49:0/1446437428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d000b770 con 0x7f05e006f9f0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.318+0000 7f05ded9d640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 0x7f05e0141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05de59c640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0041830 con 0x7f05e006f9f0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0041990 con 0x7f05e006f9f0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0041d40 con 0x7f05e006f9f0 2023-12-19T05:40:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e006cd50 con 0x7f05e006f9f0 2023-12-19T05:40:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.319+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e006ca20 con 0x7f05e006f9f0 2023-12-19T05:40:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.320+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0061910 con 0x7f05e006f9f0 2023-12-19T05:40:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.322+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f05d003d040 con 0x7f05e006f9f0 2023-12-19T05:40:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.322+0000 7f05d6ffd640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 0x7f05c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.323+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05d00ad6f0 con 0x7f05e006f9f0 2023-12-19T05:40:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.323+0000 7f05d7fff640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 0x7f05c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.324+0000 7f05d7fff640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 0x7f05c006c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05e01f1b90 tx=0x7f05c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:27.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.327+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f05d0078c40 con 0x7f05e006f9f0 2023-12-19T05:40:27.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.558+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05e0070830 con 0x7f05e006f9f0 2023-12-19T05:40:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.559+0000 7f05d6ffd640 1 -- 172.21.15.49:0/1446437428 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f05d007c260 con 0x7f05e006f9f0 2023-12-19T05:40:27.654 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 msgr2=0x7f05c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 0x7f05c006c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05e01f1b90 tx=0x7f05c8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 msgr2=0x7f05e0155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d00046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 shutdown_connections 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05c006a430 0x7f05c006c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05e00cc990 0x7f05e013e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05e0159810 0x7f05e0141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 --2- 172.21.15.49:0/1446437428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05e006f9f0 0x7f05e0155190 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 >> 172.21.15.49:0/1446437428 conn(0x7f05e00b0100 msgr2=0x7f05e015b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 shutdown_connections 2023-12-19T05:40:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:27.562+0000 7f05df59e640 1 -- 172.21.15.49:0/1446437428 wait complete. 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:40:27.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:40:27.657 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:40:27.657 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:40:27.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:27.657 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.721 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42265sec preferred_lft 42265sec 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:40:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:27.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:27.724 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:40:27.830 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:40:27.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:27.835 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:40:27.892 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:40:27.892 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:40:27.892 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:40:27.892 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:40:27.892 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:40:27.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:40:27.893 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:40:28.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:28.114 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:40:28.174 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:40:28.174 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:40:28.174 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:40:28.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:28.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:40:28.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:40:28.293 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:40:28.352 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:40:28.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:40:28.353 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:40:28.407 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:40:28.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:28.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:28.567 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:28.567 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:40:28.604 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:28.604 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:40:28.604 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:40:28.604 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:40:28.604 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:40:28.608 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:40:28.608 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:40:28.608 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:40:28.609 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:40:28.609 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:40:28.612 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:40:28.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:28.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:40:28.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:28.705 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:28.777 INFO:teuthology.orchestra.run.smithi049.stdout:client4948 2023-12-19T05:40:28.777 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:28.777 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:28.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:40:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.071+0000 7f55afddc640 1 Processor -- start 2023-12-19T05:40:29.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.071+0000 7f55afddc640 1 -- start start 2023-12-19T05:40:29.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55afddc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f55a80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55afddc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a80cd840 con 0x7f55a8146e10 2023-12-19T05:40:29.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55afddc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a80b6e90 con 0x7f55a80d2b00 2023-12-19T05:40:29.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55afddc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a80d2430 con 0x7f55a80ce820 2023-12-19T05:40:29.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55adb78640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f55a8146e10 0x7f55a80b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46268/0 (socket says 172.21.15.49:46268) 2023-12-19T05:40:29.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55adb78640 1 -- 172.21.15.49:0/2015707460 learned_addr learned my addr 172.21.15.49:0/2015707460 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55ae379640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f55a80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022895728 0 0) 0x7f55a80cd840 con 0x7f55a8146e10 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.073+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5594003520 con 0x7f55a8146e10 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3589107708 0 0) 0x7f5594003520 con 0x7f55a8146e10 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 msgr2=0x7f55a80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f55a80d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 >> v1:172.21.15.115:6789/0 conn(0x7f55a80d2b00 legacy=0x7f55a80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80d2620 con 0x7f55a8146e10 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f55a4001670 con 0x7f55a8146e10 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 >> v1:172.21.15.49:6789/0 conn(0x7f55a8146e10 legacy=0x7f55a80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5594003a10 0x7f5594003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55940047c0 0x7f5594004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f559400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55940055c0 con 0x7f5594003a10 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559400bec0 con 0x7f55940047c0 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559400c000 con 0x7f55a80ce820 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.074+0000 7f55adb78640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5594003a10 0x7f5594003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55ad377640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55940047c0 0x7f5594004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55ae379640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f559400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55adb78640 1 -- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 msgr2=0x7f559400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55adb78640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a80ce820 0x7f559400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55adb78640 1 -- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55940047c0 msgr2=0x7f5594004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55adb78640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55940047c0 0x7f5594004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.075+0000 7f55adb78640 1 -- 172.21.15.49:0/2015707460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594003520 con 0x7f5594003a10 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.076+0000 7f55adb78640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5594003a10 0x7f5594003e30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c0e0 tx=0x7f55940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6369b1fe52a41ba3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.076+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4005ad0 con 0x7f5594003a10 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.076+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4005c30 con 0x7f5594003a10 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.076+0000 7f55acb76640 1 -- 172.21.15.49:0/2015707460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a402c810 con 0x7f5594003a10 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 -- 172.21.15.49:0/2015707460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5594003a10 msgr2=0x7f5594003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 --2- 172.21.15.49:0/2015707460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5594003a10 0x7f5594003e30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c0e0 tx=0x7f55940057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55ae379640 1 -- 172.21.15.49:0/2015707460 reap_dead start 2023-12-19T05:40:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 -- 172.21.15.49:0/2015707460 shutdown_connections 2023-12-19T05:40:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 -- 172.21.15.49:0/2015707460 >> 172.21.15.49:0/2015707460 conn(0x7f55a80b29c0 msgr2=0x7f55a80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 -- 172.21.15.49:0/2015707460 shutdown_connections 2023-12-19T05:40:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.077+0000 7f55afddc640 1 -- 172.21.15.49:0/2015707460 wait complete. 2023-12-19T05:40:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.079+0000 7f55afddc640 1 Processor -- start 2023-12-19T05:40:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.080+0000 7f55afddc640 1 -- start start 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594003a10 0x7f55a813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a81f2e50 0x7f55a81583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8157300 con 0x7f55a8155360 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a81575e0 con 0x7f5594003a10 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55afddc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a81578c0 con 0x7f55a81f2e50 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55ad377640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55ad377640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59070/0 (socket says 172.21.15.49:59070) 2023-12-19T05:40:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55ad377640 1 -- 172.21.15.49:0/3929392832 learned_addr learned my addr 172.21.15.49:0/3929392832 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55ae379640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a81f2e50 0x7f55a81583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55adb78640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594003a10 0x7f55a813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.081+0000 7f55ad377640 1 -- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a81f2e50 msgr2=0x7f55a81583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55ad377640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a81f2e50 0x7f55a81583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55ad377640 1 -- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594003a10 msgr2=0x7f55a813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55ad377640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594003a10 0x7f55a813cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55ad377640 1 -- 172.21.15.49:0/3929392832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8157ba0 con 0x7f55a8155360 2023-12-19T05:40:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55ad377640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f559800e600 tx=0x7f559800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980052e0 con 0x7f55a8155360 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598005440 con 0x7f55a8155360 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598003810 con 0x7f55a8155360 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a8157e80 con 0x7f55a8155360 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.082+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a81559c0 con 0x7f55a8155360 2023-12-19T05:40:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.084+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a8061910 con 0x7f55a8155360 2023-12-19T05:40:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.085+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5598003970 con 0x7f55a8155360 2023-12-19T05:40:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.085+0000 7f559e7fc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 0x7f558c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.086+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5598088690 con 0x7f55a8155360 2023-12-19T05:40:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.086+0000 7f55adb78640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 0x7f558c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.087+0000 7f55adb78640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 0x7f558c06c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55a4034000 tx=0x7f55a4009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:29.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.090+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5598053d10 con 0x7f55a8155360 2023-12-19T05:40:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.326+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55a80cf370 con 0x7f55a8155360 2023-12-19T05:40:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.327+0000 7f559e7fc640 1 -- 172.21.15.49:0/3929392832 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5598057330 con 0x7f55a8155360 2023-12-19T05:40:29.328 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:40:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 msgr2=0x7f558c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 0x7f558c06c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55a4034000 tx=0x7f55a4009030 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 msgr2=0x7f55a81f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f559800e600 tx=0x7f559800eac0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 shutdown_connections 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f558c06a460 0x7f558c06c920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55a81f2e50 0x7f55a81583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55a8155360 0x7f55a81f2910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 --2- 172.21.15.49:0/3929392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594003a10 0x7f55a813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 >> 172.21.15.49:0/3929392832 conn(0x7f55a80b29c0 msgr2=0x7f55a80d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 shutdown_connections 2023-12-19T05:40:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:29.330+0000 7f55afddc640 1 -- 172.21.15.49:0/3929392832 wait complete. 2023-12-19T05:40:29.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:40:29.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:40:29.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.353 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.415 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42280sec preferred_lft 42280sec 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:40:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:40:29.417 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:40:29.418 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:40:29.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.419 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:40:29.510 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:40:29.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.514 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:40:29.568 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:40:29.568 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:40:29.568 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:40:29.568 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:40:29.568 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:40:29.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:40:29.569 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:40:29.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.746 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:40:29.796 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:40:29.796 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:40:29.797 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:40:29.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:40:29.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:40:29.892 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:40:29.947 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:40:29.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:40:29.948 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:40:29.999 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:40:29.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:29.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:30.132 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:30.133 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:40:30.164 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:40:30.164 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:40:30.164 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:40:30.164 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:40:30.164 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:40:30.168 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:40:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:40:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:40:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:40:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:40:30.172 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:40:30.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:30.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:40:30.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:30.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:30.305 INFO:teuthology.orchestra.run.smithi115.stdout:client4957 2023-12-19T05:40:30.305 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:30.306 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:30.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.577+0000 7f7e19026640 1 Processor -- start 2023-12-19T05:40:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.577+0000 7f7e19026640 1 -- start start 2023-12-19T05:40:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.579+0000 7f7e19026640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7e140d01b0 0x7f7e1415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.579+0000 7f7e19026640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e1415efa0 0x7f7e1415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.579+0000 7f7e19026640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1415ece0 con 0x7f7e140d0590 2023-12-19T05:40:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.579+0000 7f7e19026640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140ce9d0 con 0x7f7e1415efa0 2023-12-19T05:40:30.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.579+0000 7f7e19026640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140ce6f0 con 0x7f7e140d01b0 2023-12-19T05:40:30.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e1415efa0 0x7f7e1415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e1415efa0 0x7f7e1415f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59080/0 (socket says 172.21.15.49:59080) 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 -- 172.21.15.49:0/1632382405 learned_addr learned my addr 172.21.15.49:0/1632382405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e12d9d640 1 --2- 172.21.15.49:0/1632382405 >> v2:172.21.15.115:3300/0 conn(0x7f7e140d01b0 0x7f7e1415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 -- 172.21.15.49:0/1632382405 >> v2:172.21.15.115:3300/0 conn(0x7f7e140d01b0 msgr2=0x7f7e1415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 --2- 172.21.15.49:0/1632382405 >> v2:172.21.15.115:3300/0 conn(0x7f7e140d01b0 0x7f7e1415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 -- 172.21.15.49:0/1632382405 >> v1:172.21.15.115:6789/0 conn(0x7f7e140d0590 legacy=0x7f7e140cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.580+0000 7f7e1359e640 1 -- 172.21.15.49:0/1632382405 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1415dcc0 con 0x7f7e1415efa0 2023-12-19T05:40:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.583+0000 7f7e1359e640 1 --2- 172.21.15.49:0/1632382405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1415efa0 0x7f7e1415f3d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b35a0 tx=0x7f7e0c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86839d713b9eab2f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.583+0000 7f7e11d9b640 1 -- 172.21.15.49:0/1632382405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c02cb20 con 0x7f7e1415efa0 2023-12-19T05:40:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.583+0000 7f7e11d9b640 1 -- 172.21.15.49:0/1632382405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c02cc80 con 0x7f7e1415efa0 2023-12-19T05:40:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.583+0000 7f7e11d9b640 1 -- 172.21.15.49:0/1632382405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0343f0 con 0x7f7e1415efa0 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 -- 172.21.15.49:0/1632382405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1415efa0 msgr2=0x7f7e1415f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 --2- 172.21.15.49:0/1632382405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1415efa0 0x7f7e1415f3d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b35a0 tx=0x7f7e0c02bf80 comp rx=0 tx=0).stop 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 -- 172.21.15.49:0/1632382405 shutdown_connections 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 --2- 172.21.15.49:0/1632382405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1415efa0 0x7f7e1415f3d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 --2- 172.21.15.49:0/1632382405 >> v2:172.21.15.115:3300/0 conn(0x7f7e140d01b0 0x7f7e1415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 -- 172.21.15.49:0/1632382405 >> 172.21.15.49:0/1632382405 conn(0x7f7e140b27a0 msgr2=0x7f7e140b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 -- 172.21.15.49:0/1632382405 shutdown_connections 2023-12-19T05:40:30.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.584+0000 7f7e19026640 1 -- 172.21.15.49:0/1632382405 wait complete. 2023-12-19T05:40:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.586+0000 7f7e19026640 1 Processor -- start 2023-12-19T05:40:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.586+0000 7f7e19026640 1 -- start start 2023-12-19T05:40:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 0x7f7e140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1415efa0 0x7f7e141f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b7ab0 con 0x7f7e140d0590 2023-12-19T05:40:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b7180 con 0x7f7e140d01b0 2023-12-19T05:40:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.587+0000 7f7e19026640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b7460 con 0x7f7e1415efa0 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59094/0 (socket says 172.21.15.49:59094) 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 -- 172.21.15.49:0/3884179990 learned_addr learned my addr 172.21.15.49:0/3884179990 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e12d9d640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 0x7f7e140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1359e640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1415efa0 0x7f7e141f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 -- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1415efa0 msgr2=0x7f7e141f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1415efa0 0x7f7e141f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 -- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 msgr2=0x7f7e140b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 0x7f7e140b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e1259c640 1 -- 172.21.15.49:0/3884179990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009b30 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.588+0000 7f7e12d9d640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 0x7f7e140b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7e1259c640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c450 tx=0x7f7e0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080052d0 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08005430 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08012870 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140b7740 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.589+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1414ee50 con 0x7f7e140d0590 2023-12-19T05:40:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.590+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140b7c20 con 0x7f7e140d0590 2023-12-19T05:40:30.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.591+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e080129d0 con 0x7f7e140d0590 2023-12-19T05:40:30.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.592+0000 7f7dfb7fe640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 0x7f7e0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:30.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.592+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e08088490 con 0x7f7e140d0590 2023-12-19T05:40:30.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.593+0000 7f7e12d9d640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 0x7f7e0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.594+0000 7f7e12d9d640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 0x7f7e0006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006fd0 tx=0x7f7e04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:30.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.597+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e08053a70 con 0x7f7e140d0590 2023-12-19T05:40:30.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.901+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e14061910 con 0x7f7e140d0590 2023-12-19T05:40:30.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.902+0000 7f7dfb7fe640 1 -- 172.21.15.49:0/3884179990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f7e08057090 con 0x7f7e140d0590 2023-12-19T05:40:30.904 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:30.904 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:30.904 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 msgr2=0x7f7e0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 0x7f7e0006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006fd0 tx=0x7f7e04008040 comp rx=0 tx=0).stop 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 msgr2=0x7f7e141f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c450 tx=0x7f7e0800c910 comp rx=0 tx=0).stop 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 shutdown_connections 2023-12-19T05:40:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e0006a430 0x7f7e0006c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1415efa0 0x7f7e141f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e140d0590 0x7f7e141f6290 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 --2- 172.21.15.49:0/3884179990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e140d01b0 0x7f7e140b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 >> 172.21.15.49:0/3884179990 conn(0x7f7e140b27a0 msgr2=0x7f7e1415bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 shutdown_connections 2023-12-19T05:40:30.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:30.905+0000 7f7e19026640 1 -- 172.21.15.49:0/3884179990 wait complete. 2023-12-19T05:40:30.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:40:31.164 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":5052,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.931172513,"mdsmap_epoch":16,"osdmap_epoch":34,"osdmap_epoch_barrier":34,"uptime":20.214779075999999} 2023-12-19T05:40:31.165 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 5052, "mdsmap_epoch": 16, "osdmap_epoch": 34, "osdmap_epoch_barrier": 34, "rank_uptime": 10.931172513, "state": "up:active", "uptime": 20.214779076, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:40:31.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-12-19T05:40:31.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.395+0000 7f0bcf08b640 1 Processor -- start 2023-12-19T05:40:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.395+0000 7f0bcf08b640 1 -- start start 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bcf08b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0bc81449e0 0x7f0bc80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bcf08b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bc80b0b50 0x7f0bc806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bcf08b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc80afb10 con 0x7f0bc806b590 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bcf08b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc806bb30 con 0x7f0bc80b0b50 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bcf08b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80b0070 con 0x7f0bc81449e0 2023-12-19T05:40:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.397+0000 7f0bc7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bc80b0b50 0x7f0bc806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bc80b0b50 0x7f0bc806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59108/0 (socket says 172.21.15.49:59108) 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 -- 172.21.15.49:0/201883319 learned_addr learned my addr 172.21.15.49:0/201883319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bcce27640 1 --2- 172.21.15.49:0/201883319 >> v2:172.21.15.115:3300/0 conn(0x7f0bc81449e0 0x7f0bc80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 -- 172.21.15.49:0/201883319 >> v2:172.21.15.115:3300/0 conn(0x7f0bc81449e0 msgr2=0x7f0bc80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 --2- 172.21.15.49:0/201883319 >> v2:172.21.15.115:3300/0 conn(0x7f0bc81449e0 0x7f0bc80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 -- 172.21.15.49:0/201883319 >> v1:172.21.15.115:6789/0 conn(0x7f0bc806b590 legacy=0x7f0bc815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.398+0000 7f0bc7fff640 1 -- 172.21.15.49:0/201883319 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80b0350 con 0x7f0bc80b0b50 2023-12-19T05:40:31.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.399+0000 7f0bc7fff640 1 --2- 172.21.15.49:0/201883319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc806bfa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8071cd0 tx=0x7f0bbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07b0ef11c3afa97 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:31.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bc77fe640 1 -- 172.21.15.49:0/201883319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc031870 con 0x7f0bc80b0b50 2023-12-19T05:40:31.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bc77fe640 1 -- 172.21.15.49:0/201883319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0319d0 con 0x7f0bc80b0b50 2023-12-19T05:40:31.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bc77fe640 1 -- 172.21.15.49:0/201883319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc031d60 con 0x7f0bc80b0b50 2023-12-19T05:40:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 -- 172.21.15.49:0/201883319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 msgr2=0x7f0bc806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/201883319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc806bfa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8071cd0 tx=0x7f0bbc02b910 comp rx=0 tx=0).stop 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 -- 172.21.15.49:0/201883319 shutdown_connections 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/201883319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc806bfa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/201883319 >> v2:172.21.15.115:3300/0 conn(0x7f0bc81449e0 0x7f0bc80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.400+0000 7f0bcf08b640 1 -- 172.21.15.49:0/201883319 >> 172.21.15.49:0/201883319 conn(0x7f0bc80cbb70 msgr2=0x7f0bc80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.401+0000 7f0bcf08b640 1 -- 172.21.15.49:0/201883319 shutdown_connections 2023-12-19T05:40:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.401+0000 7f0bcf08b640 1 -- 172.21.15.49:0/201883319 wait complete. 2023-12-19T05:40:31.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.403+0000 7f0bcf08b640 1 Processor -- start 2023-12-19T05:40:31.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.403+0000 7f0bcf08b640 1 -- start start 2023-12-19T05:40:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc806b590 0x7f0bc80cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc81449e0 0x7f0bc81fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80ce910 con 0x7f0bc80b0b50 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80ce630 con 0x7f0bc806b590 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcf08b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc815e960 con 0x7f0bc81449e0 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59112/0 (socket says 172.21.15.49:59112) 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 -- 172.21.15.49:0/1118347355 learned_addr learned my addr 172.21.15.49:0/1118347355 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 -- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc81449e0 msgr2=0x7f0bc81fa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc81449e0 0x7f0bc81fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 -- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc806b590 msgr2=0x7f0bc80cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bcce27640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc806b590 0x7f0bc80cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.405+0000 7f0bc7fff640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc806b590 0x7f0bc80cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bc7fff640 1 -- 172.21.15.49:0/1118347355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094d0 con 0x7f0bc80b0b50 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bc7fff640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc000c00 tx=0x7f0bbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc03abe0 con 0x7f0bc80b0b50 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc03ad40 con 0x7f0bc80b0b50 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc044610 con 0x7f0bc80b0b50 2023-12-19T05:40:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc80cdd00 con 0x7f0bc80b0b50 2023-12-19T05:40:31.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.406+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc80ce2c0 con 0x7f0bc80b0b50 2023-12-19T05:40:31.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.408+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc8134020 con 0x7f0bc80b0b50 2023-12-19T05:40:31.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.408+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bbc04d450 con 0x7f0bc80b0b50 2023-12-19T05:40:31.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.409+0000 7f0bc57fa640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 0x7f0bb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:31.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.410+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bbc02d040 con 0x7f0bc80b0b50 2023-12-19T05:40:31.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.410+0000 7f0bcce27640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 0x7f0bb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.412+0000 7f0bcce27640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 0x7f0bb406c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009e90 tx=0x7f0bb800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.414+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bc8134020 con 0x7f0bc80b0b50 2023-12-19T05:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.682+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0bc80ce770 con 0x7f0bc80b0b50 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.683+0000 7f0bc57fa640 1 -- 172.21.15.49:0/1118347355 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f0bc80ce770 con 0x7f0bc80b0b50 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "stats": { 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "total_bytes": 1600000000, 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "total_avail_bytes": 1597604612, 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_bytes": 2395388, 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_raw_bytes": 2395388, 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_raw_ratio": 0.0014971174532547593, 2023-12-19T05:40:31.684 INFO:teuthology.orchestra.run.smithi049.stdout: "num_osds": 8, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "num_per_pool_osds": 0, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "num_per_pool_omap_osds": 0 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "stats_by_class": { 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "hdd": { 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "total_bytes": 1600000000, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "total_avail_bytes": 1597604612, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_bytes": 2395388, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_raw_bytes": 2395388, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "total_used_raw_ratio": 0.0014971174532547593 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:40:31.685 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": ".mgr", 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "stats": { 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "stored": 590368, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "objects": 2, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "kb_used": 577, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "bytes_used": 590368, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "percent_used": 0.00052964512724429369, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "max_avail": 557028928 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs_metadata", 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4, 2023-12-19T05:40:31.686 INFO:teuthology.orchestra.run.smithi049.stdout: "stats": { 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "stored": 2362, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "objects": 22, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "kb_used": 3, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "bytes_used": 2362, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "percent_used": 2.1201726667641196e-06, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "max_avail": 557028928 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs_data", 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "stats": { 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "stored": 0, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "objects": 0, 2023-12-19T05:40:31.687 INFO:teuthology.orchestra.run.smithi049.stdout: "kb_used": 0, 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: "bytes_used": 0, 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: "percent_used": 0, 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: "max_avail": 557028928 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:40:31.688 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.685+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 msgr2=0x7f0bb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.685+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 0x7f0bb406c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009e90 tx=0x7f0bb800b040 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 msgr2=0x7f0bc815e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc000c00 tx=0x7f0bbc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 shutdown_connections 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0bb406a460 0x7f0bb406c920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc81449e0 0x7f0bc81fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc80b0b50 0x7f0bc815e420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 --2- 172.21.15.49:0/1118347355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc806b590 0x7f0bc80cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 >> 172.21.15.49:0/1118347355 conn(0x7f0bc80cbb70 msgr2=0x7f0bc8140a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 shutdown_connections 2023-12-19T05:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:31.686+0000 7f0bcf08b640 1 -- 172.21.15.49:0/1118347355 wait complete. 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:40:31.707 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:40:32.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:32.040 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:32.153 INFO:teuthology.orchestra.run.smithi049.stdout:client4948 2023-12-19T05:40:32.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:32.153 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4948/osdmap') 2023-12-19T05:40:32.265 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-19T05:40:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:40:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:40:32.267 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:40:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:40:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:40:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:795 bytes copied, 0.00013125 s, 6.1 MB/s 2023-12-19T05:40:32.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-19T05:40:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.503+0000 7f39e759e640 1 Processor -- start 2023-12-19T05:40:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.504+0000 7f39e759e640 1 -- start start 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.505+0000 7f39e759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39e80b7360 0x7f39e80b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.505+0000 7f39e759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80b7d00 con 0x7f39e80cf8e0 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.505+0000 7f39e759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e806f160 con 0x7f39e8146c40 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.505+0000 7f39e759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80700c0 con 0x7f39e80b7360 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.506+0000 7f39e6d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f39e80cf8e0 0x7f39e80cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46278/0 (socket says 172.21.15.49:46278) 2023-12-19T05:40:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.506+0000 7f39e6d9d640 1 -- 172.21.15.49:0/539086299 learned_addr learned my addr 172.21.15.49:0/539086299 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.506+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791591367 0 0) 0x7f39e80b7d00 con 0x7f39e80cf8e0 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.506+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d4003520 con 0x7f39e80cf8e0 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.506+0000 7f39e5d9b640 1 --2- 172.21.15.49:0/539086299 >> v2:172.21.15.115:3300/0 conn(0x7f39e80b7360 0x7f39e80b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261282069 0 0) 0x7f39d4003520 con 0x7f39e80cf8e0 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 >> v2:172.21.15.115:3300/0 conn(0x7f39e80b7360 msgr2=0x7f39e80b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:32.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 --2- 172.21.15.49:0/539086299 >> v2:172.21.15.115:3300/0 conn(0x7f39e80b7360 0x7f39e80b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 >> v1:172.21.15.115:6789/0 conn(0x7f39e8146c40 legacy=0x7f39e8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e806f440 con 0x7f39e80cf8e0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f39e0001670 con 0x7f39e80cf8e0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 >> v1:172.21.15.49:6789/0 conn(0x7f39e80cf8e0 legacy=0x7f39e80cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 0x7f39d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39d40047c0 0x7f39d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d40052a0 0x7f39d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80700c0 con 0x7f39d4003a30 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d400c1a0 con 0x7f39d40052a0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d400c360 con 0x7f39d40047c0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.507+0000 7f39e659c640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 0x7f39d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e5d9b640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39d40047c0 0x7f39d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e659c640 1 -- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39d40047c0 msgr2=0x7f39d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e659c640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39d40047c0 0x7f39d4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e659c640 1 -- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d40052a0 msgr2=0x7f39d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:32.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e659c640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d40052a0 0x7f39d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e659c640 1 -- 172.21.15.49:0/539086299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d4003520 con 0x7f39d4003a30 2023-12-19T05:40:32.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.508+0000 7f39e6d9d640 1 -- 172.21.15.49:0/539086299 reap_dead start 2023-12-19T05:40:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.509+0000 7f39e659c640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 0x7f39d4003e50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d8001e20 tx=0x7f39d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d4430d99ad0975 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.509+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003b70 con 0x7f39d4003a30 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.509+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8003cd0 con 0x7f39d4003a30 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.509+0000 7f39e559a640 1 -- 172.21.15.49:0/539086299 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8005310 con 0x7f39d4003a30 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 -- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 msgr2=0x7f39d4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 0x7f39d4003e50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d8001e20 tx=0x7f39d40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 -- 172.21.15.49:0/539086299 shutdown_connections 2023-12-19T05:40:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 --2- 172.21.15.49:0/539086299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d4003a30 0x7f39d4003e50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 -- 172.21.15.49:0/539086299 >> 172.21.15.49:0/539086299 conn(0x7f39e80d31b0 msgr2=0x7f39e80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 -- 172.21.15.49:0/539086299 shutdown_connections 2023-12-19T05:40:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.510+0000 7f39e759e640 1 -- 172.21.15.49:0/539086299 wait complete. 2023-12-19T05:40:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.512+0000 7f39e759e640 1 Processor -- start 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.512+0000 7f39e759e640 1 -- start start 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d4003a30 0x7f39e815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e813c3d0 0x7f39e81f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e813b9c0 con 0x7f39e813c850 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e813bf40 con 0x7f39d4003a30 2023-12-19T05:40:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81f39c0 con 0x7f39e813c3d0 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59124/0 (socket says 172.21.15.49:59124) 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e6d9d640 1 -- 172.21.15.49:0/4013209732 learned_addr learned my addr 172.21.15.49:0/4013209732 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e659c640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d4003a30 0x7f39e815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.513+0000 7f39e5d9b640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e813c3d0 0x7f39e81f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 -- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e813c3d0 msgr2=0x7f39e81f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e813c3d0 0x7f39e81f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 -- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d4003a30 msgr2=0x7f39e815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d4003a30 0x7f39e815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 -- 172.21.15.49:0/4013209732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e81f3ca0 con 0x7f39e813c850 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e6d9d640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39e80b8740 tx=0x7f39e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0004bf0 con 0x7f39e813c850 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0004d70 con 0x7f39e813c850 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0007270 con 0x7f39e813c850 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.514+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e813bbd0 con 0x7f39e813c850 2023-12-19T05:40:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.515+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e815d010 con 0x7f39e813c850 2023-12-19T05:40:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.516+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e813c0d0 con 0x7f39e813c850 2023-12-19T05:40:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.517+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39e00073d0 con 0x7f39e813c850 2023-12-19T05:40:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.518+0000 7f39deffd640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 0x7f39c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.518+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39e0087d30 con 0x7f39e813c850 2023-12-19T05:40:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.519+0000 7f39e659c640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 0x7f39c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.520+0000 7f39e659c640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 0x7f39c806c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39d8034000 tx=0x7f39d8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.522+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39e0053280 con 0x7f39e813c850 2023-12-19T05:40:32.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:32.729+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f39e81f3e30 con 0x7f39e813c850 2023-12-19T05:40:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.293+0000 7f39deffd640 1 -- 172.21.15.49:0/4013209732 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f39e0001930 con 0x7f39e813c850 2023-12-19T05:40:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:pauserd,pausewr is set 2023-12-19T05:40:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 msgr2=0x7f39c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 0x7f39c806c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39d8034000 tx=0x7f39d8009030 comp rx=0 tx=0).stop 2023-12-19T05:40:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 msgr2=0x7f39e81f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39e80b8740 tx=0x7f39e000c960 comp rx=0 tx=0).stop 2023-12-19T05:40:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 shutdown_connections 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f39c806a460 0x7f39c806c920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e813c3d0 0x7f39e81f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e813c850 0x7f39e81f33a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 --2- 172.21.15.49:0/4013209732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39d4003a30 0x7f39e815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 >> 172.21.15.49:0/4013209732 conn(0x7f39e80d31b0 msgr2=0x7f39e80b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 shutdown_connections 2023-12-19T05:40:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.298+0000 7f39e759e640 1 -- 172.21.15.49:0/4013209732 wait complete. 2023-12-19T05:40:33.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-19T05:40:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.554+0000 7fd242b2e640 1 Processor -- start 2023-12-19T05:40:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.554+0000 7fd242b2e640 1 -- start start 2023-12-19T05:40:33.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd242b2e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd23c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd242b2e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd23c15e040 0x7fd23c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd242b2e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c15e9c0 con 0x7fd23c157aa0 2023-12-19T05:40:33.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd242b2e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0b2600 con 0x7fd23c15e040 2023-12-19T05:40:33.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd242b2e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b1d60 con 0x7fd23c0b1710 2023-12-19T05:40:33.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd2408ca640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd23c157aa0 0x7fd23c161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46280/0 (socket says 172.21.15.49:46280) 2023-12-19T05:40:33.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd2408ca640 1 -- 172.21.15.49:0/3477553592 learned_addr learned my addr 172.21.15.49:0/3477553592 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd2410cb640 1 --2- 172.21.15.49:0/3477553592 >> v2:172.21.15.115:3300/0 conn(0x7fd23c15e040 0x7fd23c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd23bfff640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd23c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814892695 0 0) 0x7fd23c15e9c0 con 0x7fd23c157aa0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.556+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003520 con 0x7fd23c157aa0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182740736 0 0) 0x7fd22c003520 con 0x7fd23c157aa0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 msgr2=0x7fd23c06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd23c06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 >> v2:172.21.15.115:3300/0 conn(0x7fd23c15e040 msgr2=0x7fd23c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 --2- 172.21.15.49:0/3477553592 >> v2:172.21.15.115:3300/0 conn(0x7fd23c15e040 0x7fd23c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0b2040 con 0x7fd23c157aa0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd230001670 con 0x7fd23c157aa0 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 >> v1:172.21.15.49:6789/0 conn(0x7fd23c157aa0 legacy=0x7fd23c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd22c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22c003fb0 0x7fd22c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c004d00 0x7fd22c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b2600 con 0x7fd22c003fb0 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b1d60 con 0x7fd22c004d00 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00ba00 con 0x7fd23c0b1710 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.557+0000 7fd23bfff640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22c003fb0 0x7fd22c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd2408ca640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd22c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd2410cb640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c004d00 0x7fd22c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd23bfff640 1 -- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 msgr2=0x7fd22c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd23bfff640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd22c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd23bfff640 1 -- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c004d00 msgr2=0x7fd22c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd23bfff640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c004d00 0x7fd22c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd23bfff640 1 -- 172.21.15.49:0/3477553592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c003520 con 0x7fd22c003fb0 2023-12-19T05:40:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.558+0000 7fd2408ca640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c0b1710 0x7fd22c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.559+0000 7fd23bfff640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22c003fb0 0x7fd22c0047c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd228009ac0 tx=0x7fd22c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f29c43e81bb6b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.559+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22802c6b0 con 0x7fd22c003fb0 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.559+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22802c810 con 0x7fd22c003fb0 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.559+0000 7fd23b7fe640 1 -- 172.21.15.49:0/3477553592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22802cba0 con 0x7fd22c003fb0 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 -- 172.21.15.49:0/3477553592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22c003fb0 msgr2=0x7fd22c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 --2- 172.21.15.49:0/3477553592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22c003fb0 0x7fd22c0047c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd228009ac0 tx=0x7fd22c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd2410cb640 1 -- 172.21.15.49:0/3477553592 reap_dead start 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 -- 172.21.15.49:0/3477553592 shutdown_connections 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 -- 172.21.15.49:0/3477553592 >> 172.21.15.49:0/3477553592 conn(0x7fd23c0cbb70 msgr2=0x7fd23c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 -- 172.21.15.49:0/3477553592 shutdown_connections 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.560+0000 7fd242b2e640 1 -- 172.21.15.49:0/3477553592 wait complete. 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.562+0000 7fd242b2e640 1 Processor -- start 2023-12-19T05:40:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.562+0000 7fd242b2e640 1 -- start start 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c003fb0 0x7fd23c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c06b490 0x7fd23c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0aec40 con 0x7fd23c0ae280 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c143050 con 0x7fd22c003fb0 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd242b2e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c06c4a0 con 0x7fd23c06b490 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.563+0000 7fd2410cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59148/0 (socket says 172.21.15.49:59148) 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 -- 172.21.15.49:0/143536003 learned_addr learned my addr 172.21.15.49:0/143536003 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd23bfff640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c06b490 0x7fd23c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2408ca640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c003fb0 0x7fd23c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 -- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c06b490 msgr2=0x7fd23c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c06b490 0x7fd23c142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 -- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c003fb0 msgr2=0x7fd23c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:33.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c003fb0 0x7fd23c06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c06bc00 con 0x7fd23c0ae280 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.564+0000 7fd2410cb640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0cd800 tx=0x7fd2340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.565+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400e070 con 0x7fd23c0ae280 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.565+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234011e10 con 0x7fd23c0ae280 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.565+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234003990 con 0x7fd23c0ae280 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.565+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c06bee0 con 0x7fd23c0ae280 2023-12-19T05:40:33.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.565+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c143460 con 0x7fd23c0ae280 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.566+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c061910 con 0x7fd23c0ae280 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.567+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd234003af0 con 0x7fd23c0ae280 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.568+0000 7fd2397fa640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 0x7fd22006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.568+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd234089040 con 0x7fd23c0ae280 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.568+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=36+}) v3 -- 0x7fd220071f60 con 0x7fd23c0ae280 2023-12-19T05:40:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.569+0000 7fd2408ca640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 0x7fd22006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.570+0000 7fd2408ca640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 0x7fd22006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd230001860 tx=0x7fd230009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.572+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2340bbc80 con 0x7fd23c0ae280 2023-12-19T05:40:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:33.774+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fd23c071ae0 con 0x7fd23c0ae280 2023-12-19T05:40:34.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.293+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 288+0+0 (secure 0 0 0) 0x7fd2340589e0 con 0x7fd23c0ae280 2023-12-19T05:40:34.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.294+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7fd220072810 con 0x7fd23c0ae280 2023-12-19T05:40:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.297+0000 7fd2397fa640 1 -- 172.21.15.49:0/143536003 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd234054620 con 0x7fd23c0ae280 2023-12-19T05:40:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:pauserd,pausewr is unset 2023-12-19T05:40:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.301+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 msgr2=0x7fd22006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.301+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 0x7fd22006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd230001860 tx=0x7fd230009040 comp rx=0 tx=0).stop 2023-12-19T05:40:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.301+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 msgr2=0x7fd23c0ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.301+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0cd800 tx=0x7fd2340115a0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 shutdown_connections 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd22006a430 0x7fd22006c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd23c06b490 0x7fd23c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd23c0ae280 0x7fd23c0ae700 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 --2- 172.21.15.49:0/143536003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd22c003fb0 0x7fd23c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 >> 172.21.15.49:0/143536003 conn(0x7fd23c0cbb70 msgr2=0x7fd23c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 shutdown_connections 2023-12-19T05:40:34.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.302+0000 7fd242b2e640 1 -- 172.21.15.49:0/143536003 wait complete. 2023-12-19T05:40:34.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.552+0000 7fbcebfc9640 1 Processor -- start 2023-12-19T05:40:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.553+0000 7fbcebfc9640 1 -- start start 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.554+0000 7fbcebfc9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbce40d2b00 0x7fbce40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.554+0000 7fbcebfc9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40cd840 con 0x7fbce4146e10 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbcebfc9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40b6e90 con 0x7fbce40ce110 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbcebfc9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40d2430 con 0x7fbce40d2b00 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbce9d65640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbce4146e10 0x7fbce40b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36298/0 (socket says 172.21.15.49:36298) 2023-12-19T05:40:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbce9d65640 1 -- 172.21.15.49:0/1782011430 learned_addr learned my addr 172.21.15.49:0/1782011430 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001600787 0 0) 0x7fbce40cd840 con 0x7fbce4146e10 2023-12-19T05:40:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd0003520 con 0x7fbce4146e10 2023-12-19T05:40:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.555+0000 7fbce9564640 1 --2- 172.21.15.49:0/1782011430 >> v2:172.21.15.115:3300/0 conn(0x7fbce40d2b00 0x7fbce40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015001374 0 0) 0x7fbcd0003520 con 0x7fbce4146e10 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 >> v2:172.21.15.115:3300/0 conn(0x7fbce40d2b00 msgr2=0x7fbce40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 --2- 172.21.15.49:0/1782011430 >> v2:172.21.15.115:3300/0 conn(0x7fbce40d2b00 0x7fbce40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 >> v1:172.21.15.115:6789/0 conn(0x7fbce40ce110 legacy=0x7fbce40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40d2620 con 0x7fbce4146e10 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fbce0001670 con 0x7fbce4146e10 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 >> v1:172.21.15.49:6789/0 conn(0x7fbce4146e10 legacy=0x7fbce40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd0003a30 0x7fbcd0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbcd00047c0 0x7fbcd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbcd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c1e0 con 0x7fbcd0005380 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c350 con 0x7fbcd0003a30 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c510 con 0x7fbcd00047c0 2023-12-19T05:40:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.556+0000 7fbcea566640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbcd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 -- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbcd00047c0 msgr2=0x7fbcd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbcd00047c0 0x7fbcd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 -- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd0003a30 msgr2=0x7fbcd0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd0003a30 0x7fbcd0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 -- 172.21.15.49:0/1782011430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0003520 con 0x7fbcd0005380 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.557+0000 7fbcea566640 1 -- 172.21.15.49:0/1782011430 reap_dead start 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbcea566640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbcd000b980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0044b0 tx=0x7fbcd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7ee7e50d5c9972 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc006d50 con 0x7fbcd0005380 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc007020 con 0x7fbcd0005380 2023-12-19T05:40:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbce8d63640 1 -- 172.21.15.49:0/1782011430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0073d0 con 0x7fbcd0005380 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbcebfc9640 1 -- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 msgr2=0x7fbcd000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.558+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbcd000b980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0044b0 tx=0x7fbcd00057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.559+0000 7fbcebfc9640 1 -- 172.21.15.49:0/1782011430 shutdown_connections 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.559+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/1782011430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbcd000b980 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.559+0000 7fbcebfc9640 1 -- 172.21.15.49:0/1782011430 >> 172.21.15.49:0/1782011430 conn(0x7fbce40b29c0 msgr2=0x7fbce40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.559+0000 7fbcebfc9640 1 -- 172.21.15.49:0/1782011430 shutdown_connections 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.559+0000 7fbcebfc9640 1 -- 172.21.15.49:0/1782011430 wait complete. 2023-12-19T05:40:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.560+0000 7fbcebfc9640 1 Processor -- start 2023-12-19T05:40:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.561+0000 7fbcebfc9640 1 -- start start 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbce413c9b0 0x7fbce415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce415a890 0x7fbce41431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce413d260 con 0x7fbcd0005380 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce415ad10 con 0x7fbce415a890 2023-12-19T05:40:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbcebfc9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce415fb60 con 0x7fbce413c9b0 2023-12-19T05:40:34.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:34.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49988/0 (socket says 172.21.15.49:49988) 2023-12-19T05:40:34.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 -- 172.21.15.49:0/2500376810 learned_addr learned my addr 172.21.15.49:0/2500376810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 -- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbce413c9b0 msgr2=0x7fbce415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbce413c9b0 0x7fbce415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 -- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce415a890 msgr2=0x7fbce41431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce415a890 0x7fbce41431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.562+0000 7fbce9d65640 1 -- 172.21.15.49:0/2500376810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4159f70 con 0x7fbcd0005380 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbce9d65640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c760 tx=0x7fbce000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00072d0 con 0x7fbcd0005380 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0007430 con 0x7fbcd0005380 2023-12-19T05:40:34.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00047e0 con 0x7fbcd0005380 2023-12-19T05:40:34.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce415ef50 con 0x7fbcd0005380 2023-12-19T05:40:34.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.563+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce415f510 con 0x7fbcd0005380 2023-12-19T05:40:34.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.564+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4061910 con 0x7fbcd0005380 2023-12-19T05:40:34.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.566+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbce0004940 con 0x7fbcd0005380 2023-12-19T05:40:34.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.567+0000 7fbcd67fc640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 0x7fbcc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:34.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.567+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbce0087ba0 con 0x7fbcd0005380 2023-12-19T05:40:34.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.567+0000 7fbce9564640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 0x7fbcc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:34.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.569+0000 7fbce9564640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 0x7fbcc806c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006f00 tx=0x7fbcd8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:34.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.571+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbce0053180 con 0x7fbcd0005380 2023-12-19T05:40:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.767+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce40b4a50 con 0x7fbcd0005380 2023-12-19T05:40:34.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.770+0000 7fbcd67fc640 1 -- 172.21.15.49:0/2500376810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fbce0018020 con 0x7fbcd0005380 2023-12-19T05:40:34.772 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:34.772 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.772+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 msgr2=0x7fbcc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.772+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 0x7fbcc806c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006f00 tx=0x7fbcd8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.772+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 msgr2=0x7fbce415fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.772+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c760 tx=0x7fbce000cc20 comp rx=0 tx=0).stop 2023-12-19T05:40:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 shutdown_connections 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbcc806a430 0x7fbcc806c8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbce413c9b0 0x7fbce415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce415a890 0x7fbce41431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 --2- 172.21.15.49:0/2500376810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd0005380 0x7fbce415fff0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 >> 172.21.15.49:0/2500376810 conn(0x7fbce40b29c0 msgr2=0x7fbce40b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 shutdown_connections 2023-12-19T05:40:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:34.773+0000 7fbcebfc9640 1 -- 172.21.15.49:0/2500376810 wait complete. 2023-12-19T05:40:34.795 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:40:34.795 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:40:34.795 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:40:34.795 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:40:34.796 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:40:34.796 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:40:34.796 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:40:35.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:35.131 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:35.241 INFO:teuthology.orchestra.run.smithi049.stdout:client4948 2023-12-19T05:40:35.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:35.241 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4948/osdmap') 2023-12-19T05:40:35.343 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-19T05:40:35.343 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:40:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:40:35.345 INFO:teuthology.orchestra.run.smithi049.stderr:795 bytes copied, 8.7625e-05 s, 9.1 MB/s 2023-12-19T05:40:35.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:35.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.581+0000 7fc2c359e640 1 Processor -- start 2023-12-19T05:40:35.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.581+0000 7fc2c359e640 1 -- start start 2023-12-19T05:40:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2c4159f80 0x7fc2c406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 0x7fc2c415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c415a8a0 0x7fc2c415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c406b520 con 0x7fc2c4159f80 2023-12-19T05:40:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40b2b20 con 0x7fc2c415b1e0 2023-12-19T05:40:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b2fb0 con 0x7fc2c415a8a0 2023-12-19T05:40:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.583+0000 7fc2c259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2c4159f80 0x7fc2c406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2c4159f80 0x7fc2c406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49998/0 (socket says 172.21.15.49:49998) 2023-12-19T05:40:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 -- 172.21.15.49:0/3279880808 learned_addr learned my addr 172.21.15.49:0/3279880808 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c2d9d640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c415a8a0 0x7fc2c415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c1d9b640 1 --2- 172.21.15.49:0/3279880808 >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 0x7fc2c415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 -- 172.21.15.49:0/3279880808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c415a8a0 msgr2=0x7fc2c415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c415a8a0 0x7fc2c415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 -- 172.21.15.49:0/3279880808 >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 msgr2=0x7fc2c415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 --2- 172.21.15.49:0/3279880808 >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 0x7fc2c415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c259c640 1 -- 172.21.15.49:0/3279880808 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40b1f10 con 0x7fc2c4159f80 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.584+0000 7fc2c1d9b640 1 --2- 172.21.15.49:0/3279880808 >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 0x7fc2c415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.585+0000 7fc2c259c640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c4159f80 0x7fc2c406f160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40cff10 tx=0x7fc2b402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2b91969019d034 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.586+0000 7fc2c159a640 1 -- 172.21.15.49:0/3279880808 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4036440 con 0x7fc2c4159f80 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.586+0000 7fc2c159a640 1 -- 172.21.15.49:0/3279880808 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b40365a0 con 0x7fc2c4159f80 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.586+0000 7fc2c159a640 1 -- 172.21.15.49:0/3279880808 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4036930 con 0x7fc2c4159f80 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.586+0000 7fc2c359e640 1 -- 172.21.15.49:0/3279880808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c4159f80 msgr2=0x7fc2c406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.586+0000 7fc2c359e640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c4159f80 0x7fc2c406f160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40cff10 tx=0x7fc2b402e170 comp rx=0 tx=0).stop 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 -- 172.21.15.49:0/3279880808 shutdown_connections 2023-12-19T05:40:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c415a8a0 0x7fc2c415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 --2- 172.21.15.49:0/3279880808 >> v2:172.21.15.115:3300/0 conn(0x7fc2c415b1e0 0x7fc2c415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 --2- 172.21.15.49:0/3279880808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c4159f80 0x7fc2c406f160 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 -- 172.21.15.49:0/3279880808 >> 172.21.15.49:0/3279880808 conn(0x7fc2c40b0100 msgr2=0x7fc2c40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 -- 172.21.15.49:0/3279880808 shutdown_connections 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.587+0000 7fc2c359e640 1 -- 172.21.15.49:0/3279880808 wait complete. 2023-12-19T05:40:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.589+0000 7fc2c359e640 1 Processor -- start 2023-12-19T05:40:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.589+0000 7fc2c359e640 1 -- start start 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 0x7fc2c41f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c415b1e0 0x7fc2c41ee510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41f18b0 con 0x7fc2c415a8a0 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40afe80 con 0x7fc2c415b1e0 2023-12-19T05:40:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4152ca0 con 0x7fc2c4159f80 2023-12-19T05:40:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50002/0 (socket says 172.21.15.49:50002) 2023-12-19T05:40:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c1d9b640 1 -- 172.21.15.49:0/2960279101 learned_addr learned my addr 172.21.15.49:0/2960279101 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.590+0000 7fc2c259c640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 0x7fc2c41f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 -- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 msgr2=0x7fc2c41f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 0x7fc2c41f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 -- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c415b1e0 msgr2=0x7fc2c41ee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c415b1e0 0x7fc2c41ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 -- 172.21.15.49:0/2960279101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b400b770 con 0x7fc2c415a8a0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c259c640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 0x7fc2c41f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c1d9b640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800c7f0 tx=0x7fc2b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8007820 con 0x7fc2c415a8a0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8007980 con 0x7fc2c415a8a0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8007cf0 con 0x7fc2c415a8a0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c4152f80 con 0x7fc2c415a8a0 2023-12-19T05:40:35.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.591+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c4153540 con 0x7fc2c415a8a0 2023-12-19T05:40:35.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.593+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c40d0000 con 0x7fc2c415a8a0 2023-12-19T05:40:35.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.594+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2b80113f0 con 0x7fc2c415a8a0 2023-12-19T05:40:35.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.595+0000 7fc2b2ffd640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 0x7fc2a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:35.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.595+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2b8088ce0 con 0x7fc2c415a8a0 2023-12-19T05:40:35.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.595+0000 7fc2c259c640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 0x7fc2a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:35.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.596+0000 7fc2c259c640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 0x7fc2a406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4038000 tx=0x7fc2b4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:35.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.599+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2b8054230 con 0x7fc2c415a8a0 2023-12-19T05:40:35.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.842+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2c4061910 con 0x7fc2c415a8a0 2023-12-19T05:40:35.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.844+0000 7fc2b2ffd640 1 -- 172.21.15.49:0/2960279101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fc2b801f090 con 0x7fc2c415a8a0 2023-12-19T05:40:35.845 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:35.845 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 msgr2=0x7fc2a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 0x7fc2a406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4038000 tx=0x7fc2b4032000 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 msgr2=0x7fc2c40af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800c7f0 tx=0x7fc2b800ccb0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 shutdown_connections 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2a406a430 0x7fc2a406c8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c415b1e0 0x7fc2c41ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2c415a8a0 0x7fc2c40af940 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 --2- 172.21.15.49:0/2960279101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2c4159f80 0x7fc2c41f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 >> 172.21.15.49:0/2960279101 conn(0x7fc2c40b0100 msgr2=0x7fc2c40b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 shutdown_connections 2023-12-19T05:40:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:35.847+0000 7fc2c359e640 1 -- 172.21.15.49:0/2960279101 wait complete. 2023-12-19T05:40:35.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 36 2023-12-19T05:40:36.119 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-19T05:40:36.119 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:40:36.120 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:40:36.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:36.451 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:36.563 INFO:teuthology.orchestra.run.smithi049.stdout:client4948 2023-12-19T05:40:36.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:36.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4948/osdmap') 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:40:36.668 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:40:36.669 INFO:teuthology.orchestra.run.smithi049.stderr:795 bytes copied, 9.4164e-05 s, 8.4 MB/s 2023-12-19T05:40:36.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:36.672 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:40:36.738 INFO:teuthology.orchestra.run.smithi049.stdout:client4948 2023-12-19T05:40:36.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:36.738 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client4948/osdmap') 2023-12-19T05:40:36.846 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-19T05:40:36.846 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:40:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:40:36.848 INFO:teuthology.orchestra.run.smithi049.stderr:795 bytes copied, 8.6965e-05 s, 9.1 MB/s 2023-12-19T05:40:36.851 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:40:36.851 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:40:36.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:40:36.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:40:37.102 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:40:37.103 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:37.103 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:37.167 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:37.167 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:37.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:37.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.463+0000 7fbd7eddc640 1 Processor -- start 2023-12-19T05:40:37.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.463+0000 7fbd7eddc640 1 -- start start 2023-12-19T05:40:37.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.465+0000 7fbd7eddc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd7815e5a0 0x7fbd780b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.465+0000 7fbd7eddc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7815ec30 con 0x7fbd780cdbf0 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.465+0000 7fbd7eddc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7815e980 con 0x7fbd7815f680 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.465+0000 7fbd7eddc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd780b2f90 con 0x7fbd7815e5a0 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7e5db640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbd780cdbf0 0x7fbd7806c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36312/0 (socket says 172.21.15.49:36312) 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7e5db640 1 -- 172.21.15.49:0/3040767010 learned_addr learned my addr 172.21.15.49:0/3040767010 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7ddda640 1 --2- 172.21.15.49:0/3040767010 >> v2:172.21.15.49:3300/0 conn(0x7fbd7815e5a0 0x7fbd780b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7ddda640 1 -- 172.21.15.49:0/3040767010 >> v1:172.21.15.115:6789/0 conn(0x7fbd7815f680 legacy=0x7fbd780b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:37.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7ddda640 1 -- 172.21.15.49:0/3040767010 >> v1:172.21.15.49:6789/0 conn(0x7fbd780cdbf0 legacy=0x7fbd7806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.466+0000 7fbd7ddda640 1 -- 172.21.15.49:0/3040767010 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780b3270 con 0x7fbd7815e5a0 2023-12-19T05:40:37.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.467+0000 7fbd7ddda640 1 --2- 172.21.15.49:0/3040767010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd7815e5a0 0x7fbd780b2030 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097d0 tx=0x7fbd7402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c965141df08689be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7cdd8640 1 -- 172.21.15.49:0/3040767010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7402d040 con 0x7fbd7815e5a0 2023-12-19T05:40:37.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7cdd8640 1 -- 172.21.15.49:0/3040767010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74031810 con 0x7fbd7815e5a0 2023-12-19T05:40:37.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7cdd8640 1 -- 172.21.15.49:0/3040767010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74031ba0 con 0x7fbd7815e5a0 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 -- 172.21.15.49:0/3040767010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd7815e5a0 msgr2=0x7fbd780b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/3040767010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd7815e5a0 0x7fbd780b2030 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097d0 tx=0x7fbd7402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 -- 172.21.15.49:0/3040767010 shutdown_connections 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/3040767010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd7815e5a0 0x7fbd780b2030 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 -- 172.21.15.49:0/3040767010 >> 172.21.15.49:0/3040767010 conn(0x7fbd780b0100 msgr2=0x7fbd780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 -- 172.21.15.49:0/3040767010 shutdown_connections 2023-12-19T05:40:37.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.468+0000 7fbd7eddc640 1 -- 172.21.15.49:0/3040767010 wait complete. 2023-12-19T05:40:37.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.470+0000 7fbd7eddc640 1 Processor -- start 2023-12-19T05:40:37.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.470+0000 7fbd7eddc640 1 -- start start 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.471+0000 7fbd7eddc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7eddc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd7815e5a0 0x7fbd780ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7eddc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 0x7fbd780b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7eddc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780cc940 con 0x7fbd780cdbf0 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7eddc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781516b0 con 0x7fbd7815e5a0 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7eddc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780cbd30 con 0x7fbd7815f680 2023-12-19T05:40:37.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50010/0 (socket says 172.21.15.49:50010) 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 -- 172.21.15.49:0/571735846 learned_addr learned my addr 172.21.15.49:0/571735846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7e5db640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 0x7fbd780b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7d5d9640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd7815e5a0 0x7fbd780ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 -- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 msgr2=0x7fbd780b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 0x7fbd780b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 -- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd7815e5a0 msgr2=0x7fbd780ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd7815e5a0 0x7fbd780ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7ddda640 1 -- 172.21.15.49:0/571735846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009400 con 0x7fbd780cdbf0 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.472+0000 7fbd7e5db640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 0x7fbd780b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd7ddda640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402bec0 tx=0x7fbd740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740443f0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74044550 con 0x7fbd780cdbf0 2023-12-19T05:40:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74044900 con 0x7fbd780cdbf0 2023-12-19T05:40:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd780cc010 con 0x7fbd780cdbf0 2023-12-19T05:40:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.473+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd780cc5d0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.475+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7815fad0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.476+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd74044a60 con 0x7fbd780cdbf0 2023-12-19T05:40:37.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.477+0000 7fbd6e7fc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 0x7fbd5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.477+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd740aad20 con 0x7fbd780cdbf0 2023-12-19T05:40:37.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.478+0000 7fbd7d5d9640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 0x7fbd5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.479+0000 7fbd7d5d9640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 0x7fbd5c06c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006fd0 tx=0x7fbd68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.482+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd7815fad0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.681+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd7815fad0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.684+0000 7fbd6e7fc640 1 -- 172.21.15.49:0/571735846 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fbd7815fad0 con 0x7fbd780cdbf0 2023-12-19T05:40:37.687 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:37.687 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 msgr2=0x7fbd5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 0x7fbd5c06c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006fd0 tx=0x7fbd68008040 comp rx=0 tx=0).stop 2023-12-19T05:40:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 msgr2=0x7fbd78151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402bec0 tx=0x7fbd740046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 shutdown_connections 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd5c06a430 0x7fbd5c06c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd7815f680 0x7fbd780b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd7815e5a0 0x7fbd780ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 --2- 172.21.15.49:0/571735846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780cdbf0 0x7fbd78151170 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 >> 172.21.15.49:0/571735846 conn(0x7fbd780b0100 msgr2=0x7fbd7806d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 shutdown_connections 2023-12-19T05:40:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.687+0000 7fbd7eddc640 1 -- 172.21.15.49:0/571735846 wait complete. 2023-12-19T05:40:37.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:40:17.931596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:40:19.260485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:37.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.944+0000 7f1e73fff640 1 Processor -- start 2023-12-19T05:40:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.944+0000 7f1e73fff640 1 -- start start 2023-12-19T05:40:37.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.946+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e740afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.946+0000 7f1e73fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7406e220 con 0x7f1e740b02a0 2023-12-19T05:40:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.946+0000 7f1e73fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740b0700 con 0x7f1e7406dc00 2023-12-19T05:40:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.946+0000 7f1e73fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740cbea0 con 0x7f1e74141900 2023-12-19T05:40:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e727fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e740b02a0 0x7f1e7406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36326/0 (socket says 172.21.15.49:36326) 2023-12-19T05:40:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e727fc640 1 -- 172.21.15.49:0/2299878624 learned_addr learned my addr 172.21.15.49:0/2299878624 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e740afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169919055 0 0) 0x7f1e7406e220 con 0x7f1e740b02a0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e60003520 con 0x7f1e740b02a0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.947+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850857778 0 0) 0x7f1e60003520 con 0x7f1e740b02a0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 msgr2=0x7f1e740afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e740afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 >> v1:172.21.15.115:6789/0 conn(0x7f1e7406dc00 legacy=0x7f1e740ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740cc180 con 0x7f1e740b02a0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1e5c001670 con 0x7f1e740b02a0 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 >> v1:172.21.15.49:6789/0 conn(0x7f1e740b02a0 legacy=0x7f1e7406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600039a0 0x7f1e60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e600047c0 0x7f1e60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e600051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740cbea0 con 0x7f1e600047c0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6000ba90 con 0x7f1e600039a0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60010060 con 0x7f1e74141900 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e600047c0 0x7f1e60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e737fe640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e600051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 -- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 msgr2=0x7f1e600051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e600051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600039a0 0x7f1e60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 -- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600039a0 msgr2=0x7f1e60003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600039a0 0x7f1e60003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.948+0000 7f1e727fc640 1 -- 172.21.15.49:0/2299878624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60003520 con 0x7f1e600047c0 2023-12-19T05:40:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.949+0000 7f1e737fe640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74141900 0x7f1e600051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e727fc640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e600047c0 0x7f1e60004c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c210 tx=0x7f1e600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884e692f067fcbf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c005ad0 con 0x7f1e600047c0 2023-12-19T05:40:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c005c50 con 0x7f1e600047c0 2023-12-19T05:40:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e71ffb640 1 -- 172.21.15.49:0/2299878624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c02c8d0 con 0x7f1e600047c0 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e73fff640 1 -- 172.21.15.49:0/2299878624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e600047c0 msgr2=0x7f1e60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e73fff640 1 --2- 172.21.15.49:0/2299878624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e600047c0 0x7f1e60004c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c210 tx=0x7f1e600057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.950+0000 7f1e737fe640 1 -- 172.21.15.49:0/2299878624 reap_dead start 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.951+0000 7f1e73fff640 1 -- 172.21.15.49:0/2299878624 shutdown_connections 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.951+0000 7f1e73fff640 1 -- 172.21.15.49:0/2299878624 >> 172.21.15.49:0/2299878624 conn(0x7f1e7406f630 msgr2=0x7f1e7406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.951+0000 7f1e73fff640 1 -- 172.21.15.49:0/2299878624 shutdown_connections 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.951+0000 7f1e73fff640 1 -- 172.21.15.49:0/2299878624 wait complete. 2023-12-19T05:40:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.953+0000 7f1e73fff640 1 Processor -- start 2023-12-19T05:40:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.953+0000 7f1e73fff640 1 -- start start 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 0x7f1e7415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74131e00 0x7f1e741596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74159bf0 con 0x7f1e740aee90 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74132280 con 0x7f1e600047c0 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e73fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741567d0 con 0x7f1e74131e00 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50028/0 (socket says 172.21.15.49:50028) 2023-12-19T05:40:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 -- 172.21.15.49:0/350808088 learned_addr learned my addr 172.21.15.49:0/350808088 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 0x7f1e7415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 -- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74131e00 msgr2=0x7f1e741596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e727fc640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74131e00 0x7f1e741596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74131e00 0x7f1e741596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 -- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 msgr2=0x7f1e7415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.954+0000 7f1e737fe640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 0x7f1e7415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e737fe640 1 -- 172.21.15.49:0/350808088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74156a70 con 0x7f1e740aee90 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 0x7f1e7415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e737fe640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e74067480 tx=0x7f1e6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c006d50 con 0x7f1e740aee90 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c004910 con 0x7f1e740aee90 2023-12-19T05:40:37.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e74156d50 con 0x7f1e740aee90 2023-12-19T05:40:37.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c004cc0 con 0x7f1e740aee90 2023-12-19T05:40:37.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.955+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e74157310 con 0x7f1e740aee90 2023-12-19T05:40:37.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.957+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74157530 con 0x7f1e740aee90 2023-12-19T05:40:37.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.957+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e6c005030 con 0x7f1e740aee90 2023-12-19T05:40:37.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.959+0000 7f1e6b7fe640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 0x7f1e5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:37.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.959+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e6c088a40 con 0x7f1e740aee90 2023-12-19T05:40:37.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.960+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 0x7f1e5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:37.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.961+0000 7f1e72ffd640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 0x7f1e5406c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006fd0 tx=0x7f1e64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:37.964+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e6c08ae60 con 0x7f1e740aee90 2023-12-19T05:40:38.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.157+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e740cbbf0 con 0x7f1e740aee90 2023-12-19T05:40:38.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.158+0000 7f1e6b7fe640 1 -- 172.21.15.49:0/350808088 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e6c0540c0 con 0x7f1e740aee90 2023-12-19T05:40:38.161 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 msgr2=0x7f1e5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 0x7f1e5406c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006fd0 tx=0x7f1e64008040 comp rx=0 tx=0).stop 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 msgr2=0x7f1e74154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e74067480 tx=0x7f1e6c00dc00 comp rx=0 tx=0).stop 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 shutdown_connections 2023-12-19T05:40:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e5406a430 0x7f1e5406c8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e74131e00 0x7f1e741596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e740aee90 0x7f1e74154480 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 --2- 172.21.15.49:0/350808088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e600047c0 0x7f1e7415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 >> 172.21.15.49:0/350808088 conn(0x7f1e7406f630 msgr2=0x7f1e740cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 shutdown_connections 2023-12-19T05:40:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.161+0000 7f1e73fff640 1 -- 172.21.15.49:0/350808088 wait complete. 2023-12-19T05:40:38.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:40:38.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.412+0000 7f91910e5640 1 Processor -- start 2023-12-19T05:40:38.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.412+0000 7f91910e5640 1 -- start start 2023-12-19T05:40:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.414+0000 7f91910e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f918c157710 0x7f918c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.414+0000 7f91910e5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c15d7d0 con 0x7f918c0b0a00 2023-12-19T05:40:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.414+0000 7f91910e5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c0b2ea0 con 0x7f918c0b2990 2023-12-19T05:40:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.414+0000 7f91910e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918c15da90 con 0x7f918c157710 2023-12-19T05:40:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.415+0000 7f91908e4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f918c0b0a00 0x7f918c160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36338/0 (socket says 172.21.15.49:36338) 2023-12-19T05:40:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.415+0000 7f91908e4640 1 -- 172.21.15.49:0/1938252722 learned_addr learned my addr 172.21.15.49:0/1938252722 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.415+0000 7f918bfff640 1 --2- 172.21.15.49:0/1938252722 >> v2:172.21.15.115:3300/0 conn(0x7f918c157710 0x7f918c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.415+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559474275 0 0) 0x7f918c15d7d0 con 0x7f918c0b0a00 2023-12-19T05:40:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.415+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9174003520 con 0x7f918c0b0a00 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148434665 0 0) 0x7f9174003520 con 0x7f918c0b0a00 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 >> v2:172.21.15.115:3300/0 conn(0x7f918c157710 msgr2=0x7f918c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 --2- 172.21.15.49:0/1938252722 >> v2:172.21.15.115:3300/0 conn(0x7f918c157710 0x7f918c0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 >> v1:172.21.15.115:6789/0 conn(0x7f918c0b2990 legacy=0x7f918c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c15dd70 con 0x7f918c0b0a00 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f91840019f0 con 0x7f918c0b0a00 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 >> v1:172.21.15.49:6789/0 conn(0x7f918c0b0a00 legacy=0x7f918c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91740039e0 0x7f9174003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 0x7f9174004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9174005280 0x7f917400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c15da90 con 0x7f91740047c0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917400c1c0 con 0x7f9174005280 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917400c380 con 0x7f91740039e0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.416+0000 7f918b7fe640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 0x7f9174004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918bfff640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91740039e0 0x7f9174003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f91908e4640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9174005280 0x7f917400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918b7fe640 1 -- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91740039e0 msgr2=0x7f9174003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918b7fe640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91740039e0 0x7f9174003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918b7fe640 1 -- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9174005280 msgr2=0x7f917400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918b7fe640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9174005280 0x7f917400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f918b7fe640 1 -- 172.21.15.49:0/1938252722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174003520 con 0x7f91740047c0 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f91908e4640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9174005280 0x7f917400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.417+0000 7f91908e4640 1 -- 172.21.15.49:0/1938252722 reap_dead start 2023-12-19T05:40:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.418+0000 7f918b7fe640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 0x7f9174004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9180001750 tx=0x7f91740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acf26006054f373 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.418+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800052d0 con 0x7f91740047c0 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.418+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918002e050 con 0x7f91740047c0 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.418+0000 7f918affd640 1 -- 172.21.15.49:0/1938252722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180003830 con 0x7f91740047c0 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 -- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 msgr2=0x7f9174004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 0x7f9174004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9180001750 tx=0x7f91740057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 -- 172.21.15.49:0/1938252722 shutdown_connections 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 --2- 172.21.15.49:0/1938252722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91740047c0 0x7f9174004c40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 -- 172.21.15.49:0/1938252722 >> 172.21.15.49:0/1938252722 conn(0x7f918c0659a0 msgr2=0x7f918c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 -- 172.21.15.49:0/1938252722 shutdown_connections 2023-12-19T05:40:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.419+0000 7f91910e5640 1 -- 172.21.15.49:0/1938252722 wait complete. 2023-12-19T05:40:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.421+0000 7f91910e5640 1 Processor -- start 2023-12-19T05:40:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.421+0000 7f91910e5640 1 -- start start 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 0x7f918c1e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f918c159660 0x7f918c1f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c1f6610 con 0x7f918c159200 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c1f6880 con 0x7f91740047c0 2023-12-19T05:40:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f91910e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918c06c770 con 0x7f918c159660 2023-12-19T05:40:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f918b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f918b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50048/0 (socket says 172.21.15.49:50048) 2023-12-19T05:40:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f918b7fe640 1 -- 172.21.15.49:0/2080005926 learned_addr learned my addr 172.21.15.49:0/2080005926 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f918b7fe640 1 -- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f918c159660 msgr2=0x7f918c1f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.422+0000 7f918b7fe640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f918c159660 0x7f918c1f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918b7fe640 1 -- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 msgr2=0x7f918c1e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918bfff640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 0x7f918c1e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918b7fe640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 0x7f918c1e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918b7fe640 1 -- 172.21.15.49:0/2080005926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c06ca50 con 0x7f918c159200 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918bfff640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 0x7f918c1e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f918b7fe640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9180005040 tx=0x7f9180001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180007a30 con 0x7f918c159200 2023-12-19T05:40:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91800069e0 con 0x7f918c159200 2023-12-19T05:40:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180006d70 con 0x7f918c159200 2023-12-19T05:40:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.423+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918c06cd30 con 0x7f918c159200 2023-12-19T05:40:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.424+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918c152760 con 0x7f918c159200 2023-12-19T05:40:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.425+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918c061910 con 0x7f918c159200 2023-12-19T05:40:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.426+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91800035f0 con 0x7f918c159200 2023-12-19T05:40:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.427+0000 7f9188ff9640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 0x7f917806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.427+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91800aa9b0 con 0x7f918c159200 2023-12-19T05:40:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.427+0000 7f918bfff640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 0x7f917806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.429+0000 7f918bfff640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 0x7f917806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f917c009a60 tx=0x7f917c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.431+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9180075fa0 con 0x7f918c159200 2023-12-19T05:40:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.624+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f918c06c8b0 con 0x7f918c159200 2023-12-19T05:40:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.625+0000 7f9188ff9640 1 -- 172.21.15.49:0/2080005926 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f918c06c8b0 con 0x7f918c159200 2023-12-19T05:40:38.627 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:40:38.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.627+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 msgr2=0x7f917806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.627+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 0x7f917806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f917c009a60 tx=0x7f917c008040 comp rx=0 tx=0).stop 2023-12-19T05:40:38.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.627+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 msgr2=0x7f918c1f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.627+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9180005040 tx=0x7f9180001120 comp rx=0 tx=0).stop 2023-12-19T05:40:38.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 shutdown_connections 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f917806a430 0x7f917806c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f918c159660 0x7f918c1f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f918c159200 0x7f918c1f5b90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 --2- 172.21.15.49:0/2080005926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91740047c0 0x7f918c1e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 >> 172.21.15.49:0/2080005926 conn(0x7f918c0659a0 msgr2=0x7f918c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 shutdown_connections 2023-12-19T05:40:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.628+0000 7f91910e5640 1 -- 172.21.15.49:0/2080005926 wait complete. 2023-12-19T05:40:38.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:40:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.889+0000 7fcbbc3c9640 1 Processor -- start 2023-12-19T05:40:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.889+0000 7fcbbc3c9640 1 -- start start 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.891+0000 7fcbbc3c9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbb40cf5b0 0x7fcbb40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.891+0000 7fcbbc3c9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb415fde0 con 0x7fcbb415b1d0 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.891+0000 7fcbbc3c9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40b2bc0 con 0x7fcbb40b2760 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.891+0000 7fcbbc3c9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40b2400 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba165640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcbb415b1d0 0x7fcbb415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36342/0 (socket says 172.21.15.49:36342) 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba165640 1 -- 172.21.15.49:0/1994360001 learned_addr learned my addr 172.21.15.49:0/1994360001 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:38.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba966640 1 --2- 172.21.15.49:0/1994360001 >> v2:172.21.15.49:3300/0 conn(0x7fcbb40cf5b0 0x7fcbb40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbb9163640 1 -- 172.21.15.49:0/1994360001 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590063130 0 0) 0x7fcbb415fde0 con 0x7fcbb415b1d0 2023-12-19T05:40:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbb9163640 1 -- 172.21.15.49:0/1994360001 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba0003520 con 0x7fcbb415b1d0 2023-12-19T05:40:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba966640 1 -- 172.21.15.49:0/1994360001 >> v1:172.21.15.115:6789/0 conn(0x7fcbb40b2760 legacy=0x7fcbb40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba966640 1 -- 172.21.15.49:0/1994360001 >> v1:172.21.15.49:6789/0 conn(0x7fcbb415b1d0 legacy=0x7fcbb415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.892+0000 7fcbba966640 1 -- 172.21.15.49:0/1994360001 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb415ef10 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.893+0000 7fcbba966640 1 --2- 172.21.15.49:0/1994360001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb40cf5b0 0x7fcbb40b1ec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b69f27c83dd98c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.894+0000 7fcbb9163640 1 -- 172.21.15.49:0/1994360001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac02cd00 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.894+0000 7fcbb9163640 1 -- 172.21.15.49:0/1994360001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac02ce60 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.894+0000 7fcbb9163640 1 -- 172.21.15.49:0/1994360001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac034660 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.894+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1994360001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb40cf5b0 msgr2=0x7fcbb40b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.894+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1994360001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb40cf5b0 0x7fcbb40b1ec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac02bf50 comp rx=0 tx=0).stop 2023-12-19T05:40:38.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.895+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1994360001 shutdown_connections 2023-12-19T05:40:38.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.895+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1994360001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb40cf5b0 0x7fcbb40b1ec0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.895+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1994360001 >> 172.21.15.49:0/1994360001 conn(0x7fcbb4073150 msgr2=0x7fcbb40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:38.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.895+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1994360001 shutdown_connections 2023-12-19T05:40:38.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.895+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1994360001 wait complete. 2023-12-19T05:40:38.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.897+0000 7fcbbc3c9640 1 Processor -- start 2023-12-19T05:40:38.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.897+0000 7fcbbc3c9640 1 -- start start 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 0x7fcbb415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 0x7fcbb4147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41f6450 con 0x7fcbb415b1d0 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41f6090 con 0x7fcbb40b2760 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbbc3c9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb415e620 con 0x7fcbb40cf5b0 2023-12-19T05:40:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbba966640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbba966640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50058/0 (socket says 172.21.15.49:50058) 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbba966640 1 -- 172.21.15.49:0/1850434752 learned_addr learned my addr 172.21.15.49:0/1850434752 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbba165640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 0x7fcbb415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbba966640 1 -- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 msgr2=0x7fcbb4147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.898+0000 7fcbb9964640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 0x7fcbb4147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba966640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 0x7fcbb4147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba966640 1 -- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 msgr2=0x7fcbb415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba966640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 0x7fcbb415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba966640 1 -- 172.21.15.49:0/1850434752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009a70 con 0x7fcbb415b1d0 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba165640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 0x7fcbb415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbb9964640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 0x7fcbb4147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:38.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbba966640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac03d600 con 0x7fcbb415b1d0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac03d780 con 0x7fcbb415b1d0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb415e900 con 0x7fcbb415b1d0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.899+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac03db30 con 0x7fcbb415b1d0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.900+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb4148120 con 0x7fcbb415b1d0 2023-12-19T05:40:38.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.901+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb41f6590 con 0x7fcbb415b1d0 2023-12-19T05:40:38.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.901+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbac03b040 con 0x7fcbb415b1d0 2023-12-19T05:40:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.903+0000 7fcbaaffd640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 0x7fcb9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.903+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbac0aaf10 con 0x7fcbb415b1d0 2023-12-19T05:40:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.903+0000 7fcbba165640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 0x7fcb9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:38.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.904+0000 7fcbba165640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 0x7fcb9806c8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00011e0 tx=0x7fcbb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:38.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:38.907+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbb41f6590 con 0x7fcbb415b1d0 2023-12-19T05:40:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.104+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbb41f6590 con 0x7fcbb415b1d0 2023-12-19T05:40:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.105+0000 7fcbaaffd640 1 -- 172.21.15.49:0/1850434752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbac04e020 con 0x7fcbb415b1d0 2023-12-19T05:40:39.108 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:40:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 msgr2=0x7fcb9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 0x7fcb9806c8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00011e0 tx=0x7fcbb0009040 comp rx=0 tx=0).stop 2023-12-19T05:40:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 msgr2=0x7fcbb40af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 shutdown_connections 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb9806a430 0x7fcb9806c8f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb40cf5b0 0x7fcbb4147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb415b1d0 0x7fcbb40af2a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 --2- 172.21.15.49:0/1850434752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb40b2760 0x7fcbb415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.108+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 >> 172.21.15.49:0/1850434752 conn(0x7fcbb4073150 msgr2=0x7fcbb40cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.109+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 shutdown_connections 2023-12-19T05:40:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.109+0000 7fcbbc3c9640 1 -- 172.21.15.49:0/1850434752 wait complete. 2023-12-19T05:40:39.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:40:39.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.368+0000 7fbf51e73640 1 Processor -- start 2023-12-19T05:40:39.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.369+0000 7fbf51e73640 1 -- start start 2023-12-19T05:40:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 0x7fbf4c161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0700c0 con 0x7fbf4c0b7360 2023-12-19T05:40:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0b7d00 con 0x7fbf4c160ee0 2023-12-19T05:40:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.370+0000 7fbf51e73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c06f160 con 0x7fbf4c146c40 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50064/0 (socket says 172.21.15.49:50064) 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 -- 172.21.15.49:0/1332154426 learned_addr learned my addr 172.21.15.49:0/1332154426 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf50e71640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 -- 172.21.15.49:0/1332154426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 msgr2=0x7fbf4c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf51672640 1 --2- 172.21.15.49:0/1332154426 >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 0x7fbf4c161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 -- 172.21.15.49:0/1332154426 >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 msgr2=0x7fbf4c161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 --2- 172.21.15.49:0/1332154426 >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 0x7fbf4c161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf4bfff640 1 -- 172.21.15.49:0/1332154426 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c06f440 con 0x7fbf4c0b7360 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf50e71640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.371+0000 7fbf51672640 1 --2- 172.21.15.49:0/1332154426 >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 0x7fbf4c161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.372+0000 7fbf4bfff640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0d3db0 tx=0x7fbf4002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cf6e57df6d4369 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.373+0000 7fbf4b7fe640 1 -- 172.21.15.49:0/1332154426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031860 con 0x7fbf4c0b7360 2023-12-19T05:40:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.373+0000 7fbf4b7fe640 1 -- 172.21.15.49:0/1332154426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400319c0 con 0x7fbf4c0b7360 2023-12-19T05:40:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.373+0000 7fbf4b7fe640 1 -- 172.21.15.49:0/1332154426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031d50 con 0x7fbf4c0b7360 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 -- 172.21.15.49:0/1332154426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 msgr2=0x7fbf4c0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0d3db0 tx=0x7fbf4002b900 comp rx=0 tx=0).stop 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 -- 172.21.15.49:0/1332154426 shutdown_connections 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 --2- 172.21.15.49:0/1332154426 >> v2:172.21.15.115:3300/0 conn(0x7fbf4c160ee0 0x7fbf4c161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c0b77c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 --2- 172.21.15.49:0/1332154426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 -- 172.21.15.49:0/1332154426 >> 172.21.15.49:0/1332154426 conn(0x7fbf4c0d31b0 msgr2=0x7fbf4c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 -- 172.21.15.49:0/1332154426 shutdown_connections 2023-12-19T05:40:39.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.374+0000 7fbf51e73640 1 -- 172.21.15.49:0/1332154426 wait complete. 2023-12-19T05:40:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.376+0000 7fbf51e73640 1 Processor -- start 2023-12-19T05:40:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.376+0000 7fbf51e73640 1 -- start start 2023-12-19T05:40:39.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c13a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf4c160ee0 0x7fbf4c14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c13d890 con 0x7fbf4c0b7360 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c13cfa0 con 0x7fbf4c160ee0 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf51e73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c13dd20 con 0x7fbf4c146c40 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50066/0 (socket says 172.21.15.49:50066) 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 -- 172.21.15.49:0/3206714797 learned_addr learned my addr 172.21.15.49:0/3206714797 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 -- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 msgr2=0x7fbf4c13a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c13a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 -- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf4c160ee0 msgr2=0x7fbf4c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf4c160ee0 0x7fbf4c14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.377+0000 7fbf50e71640 1 -- 172.21.15.49:0/3206714797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094d0 con 0x7fbf4c0b7360 2023-12-19T05:40:39.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf50e71640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00cee0 tx=0x7fbf3c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00d840 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00d9a0 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00dd30 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c13d240 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.378+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c13a780 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.380+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c061910 con 0x7fbf4c0b7360 2023-12-19T05:40:39.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.380+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf3c015440 con 0x7fbf4c0b7360 2023-12-19T05:40:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.381+0000 7fbf497fa640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 0x7fbf3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.382+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf3c089230 con 0x7fbf4c0b7360 2023-12-19T05:40:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.382+0000 7fbf4bfff640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 0x7fbf3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.383+0000 7fbf4bfff640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 0x7fbf3806c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf40036000 tx=0x7fbf40030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:39.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.386+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf3c054960 con 0x7fbf4c0b7360 2023-12-19T05:40:39.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.591+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbf4c0b20b0 con 0x7fbf4c0b7360 2023-12-19T05:40:39.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.592+0000 7fbf497fa640 1 -- 172.21.15.49:0/3206714797 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbf3c057f80 con 0x7fbf4c0b7360 2023-12-19T05:40:39.594 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.594+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 msgr2=0x7fbf3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.594+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 0x7fbf3806c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf40036000 tx=0x7fbf40030000 comp rx=0 tx=0).stop 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.594+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 msgr2=0x7fbf4c140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.594+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00cee0 tx=0x7fbf3c00a710 comp rx=0 tx=0).stop 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 shutdown_connections 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbf3806a430 0x7fbf3806c8f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf4c146c40 0x7fbf4c13a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf4c160ee0 0x7fbf4c14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 --2- 172.21.15.49:0/3206714797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf4c0b7360 0x7fbf4c140e70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:39.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 >> 172.21.15.49:0/3206714797 conn(0x7fbf4c0d31b0 msgr2=0x7fbf4c1444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:39.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 shutdown_connections 2023-12-19T05:40:39.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:39.595+0000 7fbf51e73640 1 -- 172.21.15.49:0/3206714797 wait complete. 2023-12-19T05:40:39.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:40:39.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:39.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:40:39.752 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:40:39.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:39.753 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:40:39.805 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:39.805 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:39.851 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:39.851 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:39.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.192+0000 7ff28e1fd640 1 Processor -- start 2023-12-19T05:40:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.192+0000 7ff28e1fd640 1 -- start start 2023-12-19T05:40:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff28e1fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2880ce820 0x7ff2880d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff28e1fd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880cd840 con 0x7ff2880d2b00 2023-12-19T05:40:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff28e1fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880b6e90 con 0x7ff288146e10 2023-12-19T05:40:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff28e1fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880d2430 con 0x7ff2880ce820 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff287fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2880ce820 0x7ff2880d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff287fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2880ce820 0x7ff2880d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50082/0 (socket says 172.21.15.49:50082) 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff287fff640 1 -- 172.21.15.49:0/322841338 learned_addr learned my addr 172.21.15.49:0/322841338 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.194+0000 7ff286ffd640 1 --1- 172.21.15.49:0/322841338 >> v1:172.21.15.49:6789/0 conn(0x7ff2880d2b00 0x7ff2880ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36348/0 (socket says 172.21.15.49:36348) 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.195+0000 7ff287fff640 1 -- 172.21.15.49:0/322841338 >> v1:172.21.15.115:6789/0 conn(0x7ff288146e10 legacy=0x7ff2880b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.195+0000 7ff287fff640 1 -- 172.21.15.49:0/322841338 >> v1:172.21.15.49:6789/0 conn(0x7ff2880d2b00 legacy=0x7ff2880ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.195+0000 7ff287fff640 1 -- 172.21.15.49:0/322841338 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880d2620 con 0x7ff2880ce820 2023-12-19T05:40:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.196+0000 7ff287fff640 1 --2- 172.21.15.49:0/322841338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880ce820 0x7ff2880d1ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff280009870 tx=0x7ff28002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f376b2c51dce47d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.196+0000 7ff2867fc640 1 -- 172.21.15.49:0/322841338 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280031870 con 0x7ff2880ce820 2023-12-19T05:40:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.196+0000 7ff2867fc640 1 -- 172.21.15.49:0/322841338 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2800319d0 con 0x7ff2880ce820 2023-12-19T05:40:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.196+0000 7ff2867fc640 1 -- 172.21.15.49:0/322841338 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280031d60 con 0x7ff2880ce820 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 -- 172.21.15.49:0/322841338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880ce820 msgr2=0x7ff2880d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/322841338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880ce820 0x7ff2880d1ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff280009870 tx=0x7ff28002b910 comp rx=0 tx=0).stop 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 -- 172.21.15.49:0/322841338 shutdown_connections 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/322841338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880ce820 0x7ff2880d1ef0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 -- 172.21.15.49:0/322841338 >> 172.21.15.49:0/322841338 conn(0x7ff2880b29c0 msgr2=0x7ff2880b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 -- 172.21.15.49:0/322841338 shutdown_connections 2023-12-19T05:40:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.197+0000 7ff28e1fd640 1 -- 172.21.15.49:0/322841338 wait complete. 2023-12-19T05:40:40.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.199+0000 7ff28e1fd640 1 Processor -- start 2023-12-19T05:40:40.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.199+0000 7ff28e1fd640 1 -- start start 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2880ce820 0x7ff28815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff288146e10 0x7ff2881613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28813db20 con 0x7ff2880d2b00 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28813fc90 con 0x7ff2880ce820 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff28e1fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28815c9d0 con 0x7ff288146e10 2023-12-19T05:40:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50094/0 (socket says 172.21.15.49:50094) 2023-12-19T05:40:40.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff286ffd640 1 -- 172.21.15.49:0/3090957005 learned_addr learned my addr 172.21.15.49:0/3090957005 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.200+0000 7ff2877fe640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2880ce820 0x7ff28815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff287fff640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff288146e10 0x7ff2881613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 -- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff288146e10 msgr2=0x7ff2881613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff288146e10 0x7ff2881613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 -- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2880ce820 msgr2=0x7ff28815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2880ce820 0x7ff28815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 -- 172.21.15.49:0/3090957005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800094d0 con 0x7ff2880d2b00 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff286ffd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c4d0 tx=0x7ff27000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270007480 con 0x7ff2880d2b00 2023-12-19T05:40:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2700075e0 con 0x7ff2880d2b00 2023-12-19T05:40:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700049e0 con 0x7ff2880d2b00 2023-12-19T05:40:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.201+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28813f080 con 0x7ff2880d2b00 2023-12-19T05:40:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.202+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28813f640 con 0x7ff2880d2b00 2023-12-19T05:40:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.203+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28813fe00 con 0x7ff2880d2b00 2023-12-19T05:40:40.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.204+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff270004b40 con 0x7ff2880d2b00 2023-12-19T05:40:40.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.205+0000 7ff27ffff640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 0x7ff26806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.205+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2700879c0 con 0x7ff2880d2b00 2023-12-19T05:40:40.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.205+0000 7ff2877fe640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 0x7ff26806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.207+0000 7ff2877fe640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 0x7ff26806c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f20 tx=0x7ff2780094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.210+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff270053060 con 0x7ff2880d2b00 2023-12-19T05:40:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.407+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff288061910 con 0x7ff2880d2b00 2023-12-19T05:40:40.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.411+0000 7ff27ffff640 1 -- 172.21.15.49:0/3090957005 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7ff270018020 con 0x7ff2880d2b00 2023-12-19T05:40:40.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:40.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 msgr2=0x7ff26806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 0x7ff26806c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f20 tx=0x7ff2780094d0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 msgr2=0x7ff288140120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c4d0 tx=0x7ff27000c990 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 shutdown_connections 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff26806a430 0x7ff26806c8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff288146e10 0x7ff2881613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2880d2b00 0x7ff288140120 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 --2- 172.21.15.49:0/3090957005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2880ce820 0x7ff28815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 >> 172.21.15.49:0/3090957005 conn(0x7ff2880b29c0 msgr2=0x7ff28806f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 shutdown_connections 2023-12-19T05:40:40.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.414+0000 7ff28e1fd640 1 -- 172.21.15.49:0/3090957005 wait complete. 2023-12-19T05:40:40.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:40:17.931596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:40:19.260485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:40.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:40.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.678+0000 7fcf495c4640 1 Processor -- start 2023-12-19T05:40:40.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.678+0000 7fcf495c4640 1 -- start start 2023-12-19T05:40:40.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf440d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf440b6430 0x7fcf4406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf4406fa70 0x7fcf4415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf44161080 con 0x7fcf4406fa70 2023-12-19T05:40:40.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4406fed0 con 0x7fcf440b6430 2023-12-19T05:40:40.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.680+0000 7fcf495c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44161e70 con 0x7fcf44146ff0 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf4406fa70 0x7fcf4415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf3bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf440b6430 0x7fcf4406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf42ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf440d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf4406fa70 0x7fcf4415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50102/0 (socket says 172.21.15.49:50102) 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 -- 172.21.15.49:0/3649294649 learned_addr learned my addr 172.21.15.49:0/3649294649 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 -- 172.21.15.49:0/3649294649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 msgr2=0x7fcf440d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 --2- 172.21.15.49:0/3649294649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf440d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 -- 172.21.15.49:0/3649294649 >> v2:172.21.15.115:3300/0 conn(0x7fcf440b6430 msgr2=0x7fcf4406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.681+0000 7fcf437fe640 1 --2- 172.21.15.49:0/3649294649 >> v2:172.21.15.115:3300/0 conn(0x7fcf440b6430 0x7fcf4406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.682+0000 7fcf437fe640 1 -- 172.21.15.49:0/3649294649 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44161260 con 0x7fcf4406fa70 2023-12-19T05:40:40.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.684+0000 7fcf437fe640 1 --2- 172.21.15.49:0/3649294649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf4415dd40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf440671b0 tx=0x7fcf3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211105d8c4ea1f4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.684+0000 7fcf427fc640 1 -- 172.21.15.49:0/3649294649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c02ca70 con 0x7fcf4406fa70 2023-12-19T05:40:40.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.684+0000 7fcf427fc640 1 -- 172.21.15.49:0/3649294649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c02cbd0 con 0x7fcf4406fa70 2023-12-19T05:40:40.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.684+0000 7fcf427fc640 1 -- 172.21.15.49:0/3649294649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0343f0 con 0x7fcf4406fa70 2023-12-19T05:40:40.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 -- 172.21.15.49:0/3649294649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 msgr2=0x7fcf4415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 --2- 172.21.15.49:0/3649294649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf4415dd40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf440671b0 tx=0x7fcf3c02bed0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 -- 172.21.15.49:0/3649294649 shutdown_connections 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 --2- 172.21.15.49:0/3649294649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf4415dd40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 --2- 172.21.15.49:0/3649294649 >> v2:172.21.15.115:3300/0 conn(0x7fcf440b6430 0x7fcf4406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 --2- 172.21.15.49:0/3649294649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf440d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 -- 172.21.15.49:0/3649294649 >> 172.21.15.49:0/3649294649 conn(0x7fcf440d3520 msgr2=0x7fcf440d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 -- 172.21.15.49:0/3649294649 shutdown_connections 2023-12-19T05:40:40.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.685+0000 7fcf495c4640 1 -- 172.21.15.49:0/3649294649 wait complete. 2023-12-19T05:40:40.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.688+0000 7fcf495c4640 1 Processor -- start 2023-12-19T05:40:40.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.689+0000 7fcf495c4640 1 -- start start 2023-12-19T05:40:40.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf440b6430 0x7fcf440b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf44159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441444c0 con 0x7fcf4406fa70 2023-12-19T05:40:40.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44142670 con 0x7fcf440b6430 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf495c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44142950 con 0x7fcf44146ff0 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf42ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf42ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50116/0 (socket says 172.21.15.49:50116) 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.690+0000 7fcf42ffd640 1 -- 172.21.15.49:0/2190077714 learned_addr learned my addr 172.21.15.49:0/2190077714 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf437fe640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf44159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf3bfff640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf440b6430 0x7fcf440b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 -- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 msgr2=0x7fcf44159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf44159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 -- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf440b6430 msgr2=0x7fcf440b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf440b6430 0x7fcf440b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 -- 172.21.15.49:0/2190077714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c009b30 con 0x7fcf4406fa70 2023-12-19T05:40:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.691+0000 7fcf42ffd640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400e9b0 tx=0x7fcf3400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.692+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34009670 con 0x7fcf4406fa70 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.692+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400c9a0 con 0x7fcf4406fa70 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.692+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400cd50 con 0x7fcf4406fa70 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.692+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf44142c30 con 0x7fcf4406fa70 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.692+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf441431f0 con 0x7fcf4406fa70 2023-12-19T05:40:40.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.693+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44061910 con 0x7fcf4406fa70 2023-12-19T05:40:40.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.695+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf34013470 con 0x7fcf4406fa70 2023-12-19T05:40:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.697+0000 7fcf3b7fe640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 0x7fcf2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.697+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf34088c80 con 0x7fcf4406fa70 2023-12-19T05:40:40.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.698+0000 7fcf3bfff640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 0x7fcf2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.699+0000 7fcf3bfff640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 0x7fcf2406c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf4413b8b0 tx=0x7fcf2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.704+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf340541d0 con 0x7fcf4406fa70 2023-12-19T05:40:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.899+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf44070d10 con 0x7fcf4406fa70 2023-12-19T05:40:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.900+0000 7fcf3b7fe640 1 -- 172.21.15.49:0/2190077714 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf340170a0 con 0x7fcf4406fa70 2023-12-19T05:40:40.901 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 msgr2=0x7fcf2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 0x7fcf2406c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf4413b8b0 tx=0x7fcf2c008040 comp rx=0 tx=0).stop 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 msgr2=0x7fcf44143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400e9b0 tx=0x7fcf3400ee70 comp rx=0 tx=0).stop 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 shutdown_connections 2023-12-19T05:40:40.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf2406a430 0x7fcf2406c8f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf44146ff0 0x7fcf44159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf440b6430 0x7fcf440b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.902+0000 7fcf495c4640 1 --2- 172.21.15.49:0/2190077714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf4406fa70 0x7fcf44143f80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.903+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 >> 172.21.15.49:0/2190077714 conn(0x7fcf440d3520 msgr2=0x7fcf44071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.903+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 shutdown_connections 2023-12-19T05:40:40.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:40.903+0000 7fcf495c4640 1 -- 172.21.15.49:0/2190077714 wait complete. 2023-12-19T05:40:40.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:40:41.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.159+0000 7f85e9585640 1 Processor -- start 2023-12-19T05:40:41.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.159+0000 7f85e9585640 1 -- start start 2023-12-19T05:40:41.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.161+0000 7f85e9585640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e40b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.161+0000 7f85e9585640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85e40b2990 0x7f85e40b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.161+0000 7f85e9585640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415d7d0 con 0x7f85e40b0830 2023-12-19T05:40:41.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.161+0000 7f85e9585640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40b0ca0 con 0x7f85e40b2990 2023-12-19T05:40:41.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.161+0000 7f85e9585640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40b2ea0 con 0x7f85e4157710 2023-12-19T05:40:41.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85e40b2990 0x7f85e40b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85e40b2990 0x7f85e40b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50132/0 (socket says 172.21.15.49:50132) 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 -- 172.21.15.49:0/4280857407 learned_addr learned my addr 172.21.15.49:0/4280857407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85e3fff640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e40b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 -- 172.21.15.49:0/4280857407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 msgr2=0x7f85e40b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e40b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 -- 172.21.15.49:0/4280857407 >> v1:172.21.15.115:6789/0 conn(0x7f85e40b0830 legacy=0x7f85e40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.162+0000 7f85dbfff640 1 -- 172.21.15.49:0/4280857407 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e415da90 con 0x7f85e40b2990 2023-12-19T05:40:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.164+0000 7f85dbfff640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e40b02f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481c3d2fcb7a4ecb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.164+0000 7f85e37fe640 1 -- 172.21.15.49:0/4280857407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0317c0 con 0x7f85e40b2990 2023-12-19T05:40:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.164+0000 7f85e37fe640 1 -- 172.21.15.49:0/4280857407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc031920 con 0x7f85e40b2990 2023-12-19T05:40:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.164+0000 7f85e37fe640 1 -- 172.21.15.49:0/4280857407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc031cb0 con 0x7f85e40b2990 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 -- 172.21.15.49:0/4280857407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 msgr2=0x7f85e40b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e40b02f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc02b860 comp rx=0 tx=0).stop 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 -- 172.21.15.49:0/4280857407 shutdown_connections 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e40b02f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 --2- 172.21.15.49:0/4280857407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e40b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 -- 172.21.15.49:0/4280857407 >> 172.21.15.49:0/4280857407 conn(0x7f85e40659a0 msgr2=0x7f85e4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 -- 172.21.15.49:0/4280857407 shutdown_connections 2023-12-19T05:40:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.165+0000 7f85e9585640 1 -- 172.21.15.49:0/4280857407 wait complete. 2023-12-19T05:40:41.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.167+0000 7f85e9585640 1 Processor -- start 2023-12-19T05:40:41.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.167+0000 7f85e9585640 1 -- start start 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e40b0830 0x7f85e4144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4144bb0 con 0x7f85e40b2990 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e406c530 con 0x7f85e40b0830 2023-12-19T05:40:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85e9585640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e406bf70 con 0x7f85e4157710 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50148/0 (socket says 172.21.15.49:50148) 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.168+0000 7f85dbfff640 1 -- 172.21.15.49:0/2095022658 learned_addr learned my addr 172.21.15.49:0/2095022658 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85e3fff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e40b0830 0x7f85e4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85e8d84640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 -- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 msgr2=0x7f85e415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 -- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e40b0830 msgr2=0x7f85e4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e40b0830 0x7f85e4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 -- 172.21.15.49:0/2095022658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0094d0 con 0x7f85e40b2990 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85e8d84640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.169+0000 7f85dbfff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f85cc02b8a0 tx=0x7f85cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.170+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc032860 con 0x7f85e40b2990 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.170+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc0329c0 con 0x7f85e40b2990 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.170+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc032d70 con 0x7f85e40b2990 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.170+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e406c250 con 0x7f85e40b2990 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.170+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4157ee0 con 0x7f85e40b2990 2023-12-19T05:40:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.171+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e4061910 con 0x7f85e40b2990 2023-12-19T05:40:41.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.172+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85cc04e450 con 0x7f85e40b2990 2023-12-19T05:40:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.173+0000 7f85e17fa640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 0x7f85c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.173+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85cc0aaac0 con 0x7f85e40b2990 2023-12-19T05:40:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.174+0000 7f85e3fff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 0x7f85c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.175+0000 7f85e3fff640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 0x7f85c406c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009ad0 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.177+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85cc0760b0 con 0x7f85e40b2990 2023-12-19T05:40:41.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.374+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85e40ae7b0 con 0x7f85e40b2990 2023-12-19T05:40:41.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.375+0000 7f85e17fa640 1 -- 172.21.15.49:0/2095022658 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85cc0aae60 con 0x7f85e40b2990 2023-12-19T05:40:41.377 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:40:41.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 msgr2=0x7f85c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 0x7f85c406c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009ad0 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2023-12-19T05:40:41.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 msgr2=0x7f85e4159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f85cc02b8a0 tx=0x7f85cc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 shutdown_connections 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f85c406a430 0x7f85c406c8f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e4157710 0x7f85e415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85e40b2990 0x7f85e4159fb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 --2- 172.21.15.49:0/2095022658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e40b0830 0x7f85e4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.378+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 >> 172.21.15.49:0/2095022658 conn(0x7f85e40659a0 msgr2=0x7f85e4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:41.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.379+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 shutdown_connections 2023-12-19T05:40:41.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.379+0000 7f85e9585640 1 -- 172.21.15.49:0/2095022658 wait complete. 2023-12-19T05:40:41.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:40:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.625+0000 7fe266afa640 1 Processor -- start 2023-12-19T05:40:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.625+0000 7fe266afa640 1 -- start start 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe266afa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe26006cbe0 0x7fe26006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe266afa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2600ae720 0x7fe26006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe266afa640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe260066500 con 0x7fe2600ae270 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe266afa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe260161d90 con 0x7fe26006cbe0 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe266afa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600aca90 con 0x7fe2600ae720 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe265af8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe26006cbe0 0x7fe26006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe265af8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe26006cbe0 0x7fe26006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50158/0 (socket says 172.21.15.49:50158) 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.627+0000 7fe265af8640 1 -- 172.21.15.49:0/3623892378 learned_addr learned my addr 172.21.15.49:0/3623892378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.628+0000 7fe2662f9640 1 --2- 172.21.15.49:0/3623892378 >> v2:172.21.15.115:3300/0 conn(0x7fe2600ae720 0x7fe26006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.628+0000 7fe265af8640 1 -- 172.21.15.49:0/3623892378 >> v2:172.21.15.115:3300/0 conn(0x7fe2600ae720 msgr2=0x7fe26006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.628+0000 7fe265af8640 1 --2- 172.21.15.49:0/3623892378 >> v2:172.21.15.115:3300/0 conn(0x7fe2600ae720 0x7fe26006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.628+0000 7fe265af8640 1 -- 172.21.15.49:0/3623892378 >> v1:172.21.15.115:6789/0 conn(0x7fe2600ae270 legacy=0x7fe26006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.628+0000 7fe265af8640 1 -- 172.21.15.49:0/3623892378 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26015d8a0 con 0x7fe26006cbe0 2023-12-19T05:40:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.629+0000 7fe265af8640 1 --2- 172.21.15.49:0/3623892378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26006cbe0 0x7fe26006cfc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2600b3150 tx=0x7fe25002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdbe101b1b69300 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.630+0000 7fe264af6640 1 -- 172.21.15.49:0/3623892378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25002ca80 con 0x7fe26006cbe0 2023-12-19T05:40:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.630+0000 7fe264af6640 1 -- 172.21.15.49:0/3623892378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25002cbe0 con 0x7fe26006cbe0 2023-12-19T05:40:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.630+0000 7fe264af6640 1 -- 172.21.15.49:0/3623892378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2500343f0 con 0x7fe26006cbe0 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 -- 172.21.15.49:0/3623892378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26006cbe0 msgr2=0x7fe26006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 --2- 172.21.15.49:0/3623892378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26006cbe0 0x7fe26006cfc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2600b3150 tx=0x7fe25002bee0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 -- 172.21.15.49:0/3623892378 shutdown_connections 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 --2- 172.21.15.49:0/3623892378 >> v2:172.21.15.115:3300/0 conn(0x7fe2600ae720 0x7fe26006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 --2- 172.21.15.49:0/3623892378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26006cbe0 0x7fe26006cfc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 -- 172.21.15.49:0/3623892378 >> 172.21.15.49:0/3623892378 conn(0x7fe2600735a0 msgr2=0x7fe2600b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 -- 172.21.15.49:0/3623892378 shutdown_connections 2023-12-19T05:40:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.631+0000 7fe266afa640 1 -- 172.21.15.49:0/3623892378 wait complete. 2023-12-19T05:40:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.633+0000 7fe266afa640 1 Processor -- start 2023-12-19T05:40:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.633+0000 7fe266afa640 1 -- start start 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe26006cbe0 0x7fe2601f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2600ae720 0x7fe260152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014a190 con 0x7fe2600ae270 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601549c0 con 0x7fe2600ae720 2023-12-19T05:40:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe266afa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260160580 con 0x7fe26006cbe0 2023-12-19T05:40:41.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe2652f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe2652f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50170/0 (socket says 172.21.15.49:50170) 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe2652f7640 1 -- 172.21.15.49:0/693125949 learned_addr learned my addr 172.21.15.49:0/693125949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe2662f9640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2600ae720 0x7fe260152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.634+0000 7fe265af8640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe26006cbe0 0x7fe2601f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 -- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe26006cbe0 msgr2=0x7fe2601f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe26006cbe0 0x7fe2601f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 -- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2600ae720 msgr2=0x7fe260152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2600ae720 0x7fe260152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 -- 172.21.15.49:0/693125949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250009b30 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe2652f7640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b420 tx=0x7fe25400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011830 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011990 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011d40 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26015ffc0 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.635+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe260154650 con 0x7fe2600ae270 2023-12-19T05:40:41.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.637+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260154b70 con 0x7fe2600ae270 2023-12-19T05:40:41.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.638+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe25401b460 con 0x7fe2600ae270 2023-12-19T05:40:41.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.639+0000 7fe25e7fc640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 0x7fe24c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:41.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.639+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe254088480 con 0x7fe2600ae270 2023-12-19T05:40:41.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.640+0000 7fe265af8640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 0x7fe24c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:41.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.641+0000 7fe265af8640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 0x7fe24c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe250035000 tx=0x7fe250030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:41.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.644+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe260154b70 con 0x7fe2600ae270 2023-12-19T05:40:41.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.840+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe260154b70 con 0x7fe2600ae270 2023-12-19T05:40:41.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.841+0000 7fe25e7fc640 1 -- 172.21.15.49:0/693125949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe260154b70 con 0x7fe2600ae270 2023-12-19T05:40:41.843 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:40:41.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 msgr2=0x7fe24c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 0x7fe24c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe250035000 tx=0x7fe250030000 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 msgr2=0x7fe260152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b420 tx=0x7fe25400b8e0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 shutdown_connections 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe24c06a430 0x7fe24c06c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2600ae720 0x7fe260152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600ae270 0x7fe260152920 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 --2- 172.21.15.49:0/693125949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe26006cbe0 0x7fe2601f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 >> 172.21.15.49:0/693125949 conn(0x7fe2600735a0 msgr2=0x7fe2600acbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:41.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 shutdown_connections 2023-12-19T05:40:41.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:41.844+0000 7fe266afa640 1 -- 172.21.15.49:0/693125949 wait complete. 2023-12-19T05:40:41.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:40:42.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.094+0000 7f339c9c8640 1 Processor -- start 2023-12-19T05:40:42.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.095+0000 7f339c9c8640 1 -- start start 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.096+0000 7f339c9c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33980b0a00 0x7f339806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.096+0000 7f339c9c8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f339806ca80 0x7f33980cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.096+0000 7f339c9c8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339815c9c0 con 0x7f3398155460 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.096+0000 7f339c9c8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339806d270 con 0x7f339806ca80 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.096+0000 7f339c9c8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339806d550 con 0x7f33980b0a00 2023-12-19T05:40:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.097+0000 7f339759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f339806ca80 0x7f33980cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.097+0000 7f338ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33980b0a00 0x7f339806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.097+0000 7f3396d9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3398155460 0x7f33980b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:41532/0 (socket says 172.21.15.49:41532) 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.097+0000 7f3396d9d640 1 -- 172.21.15.49:0/334634281 learned_addr learned my addr 172.21.15.49:0/334634281 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.098+0000 7f339759e640 1 -- 172.21.15.49:0/334634281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33980b0a00 msgr2=0x7f339806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.098+0000 7f339759e640 1 --2- 172.21.15.49:0/334634281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33980b0a00 0x7f339806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.098+0000 7f339759e640 1 -- 172.21.15.49:0/334634281 >> v1:172.21.15.115:6789/0 conn(0x7f3398155460 legacy=0x7f33980b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.098+0000 7f339759e640 1 -- 172.21.15.49:0/334634281 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339806d830 con 0x7f339806ca80 2023-12-19T05:40:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.098+0000 7f339659c640 1 -- 172.21.15.49:0/334634281 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719400794 0 0) 0x7f339815c9c0 con 0x7f3398155460 2023-12-19T05:40:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.099+0000 7f339759e640 1 --2- 172.21.15.49:0/334634281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f339806ca80 0x7f33980cdcf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6a3e4472936f2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339659c640 1 -- 172.21.15.49:0/334634281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339002cc50 con 0x7f339806ca80 2023-12-19T05:40:42.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339659c640 1 -- 172.21.15.49:0/334634281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339002cdb0 con 0x7f339806ca80 2023-12-19T05:40:42.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339659c640 1 -- 172.21.15.49:0/334634281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390034660 con 0x7f339806ca80 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 -- 172.21.15.49:0/334634281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f339806ca80 msgr2=0x7f33980cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 --2- 172.21.15.49:0/334634281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f339806ca80 0x7f33980cdcf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339002bea0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 -- 172.21.15.49:0/334634281 shutdown_connections 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 --2- 172.21.15.49:0/334634281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33980b0a00 0x7f339806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 --2- 172.21.15.49:0/334634281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f339806ca80 0x7f33980cdcf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.100+0000 7f339c9c8640 1 -- 172.21.15.49:0/334634281 >> 172.21.15.49:0/334634281 conn(0x7f33980659a0 msgr2=0x7f3398065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.101+0000 7f339c9c8640 1 -- 172.21.15.49:0/334634281 shutdown_connections 2023-12-19T05:40:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.101+0000 7f339c9c8640 1 -- 172.21.15.49:0/334634281 wait complete. 2023-12-19T05:40:42.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.103+0000 7f339c9c8640 1 Processor -- start 2023-12-19T05:40:42.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.103+0000 7f339c9c8640 1 -- start start 2023-12-19T05:40:42.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 0x7f33981fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398155460 0x7f33980cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398145590 con 0x7f33980b0a00 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980cfc00 con 0x7f3398155460 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339c9c8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398157b90 con 0x7f339806ca80 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50178/0 (socket says 172.21.15.49:50178) 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 -- 172.21.15.49:0/2483468349 learned_addr learned my addr 172.21.15.49:0/2483468349 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f3396d9d640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 0x7f33981fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f339759e640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398155460 0x7f33980cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 -- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 msgr2=0x7f33981fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 0x7f33981fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 -- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398155460 msgr2=0x7f33980cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398155460 0x7f33980cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f338ffff640 1 -- 172.21.15.49:0/2483468349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009a70 con 0x7f33980b0a00 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.104+0000 7f3396d9d640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 0x7f33981fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f338ffff640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f338000e9b0 tx=0x7f338000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380009670 con 0x7f33980b0a00 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000c9a0 con 0x7f33980b0a00 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000cd50 con 0x7f33980b0a00 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33981fb590 con 0x7f33980b0a00 2023-12-19T05:40:42.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.105+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33981fafd0 con 0x7f33980b0a00 2023-12-19T05:40:42.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.106+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398061910 con 0x7f33980b0a00 2023-12-19T05:40:42.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.107+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3380013470 con 0x7f33980b0a00 2023-12-19T05:40:42.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.108+0000 7f338f7fe640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 0x7f337806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.108+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3380088b10 con 0x7f33980b0a00 2023-12-19T05:40:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.109+0000 7f3396d9d640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 0x7f337806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.110+0000 7f3396d9d640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 0x7f337806c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3388000f60 tx=0x7f3388009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.114+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3380054190 con 0x7f33980b0a00 2023-12-19T05:40:42.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.320+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3398157cd0 con 0x7f33980b0a00 2023-12-19T05:40:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.321+0000 7f338f7fe640 1 -- 172.21.15.49:0/2483468349 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3380017080 con 0x7f33980b0a00 2023-12-19T05:40:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:40:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 msgr2=0x7f337806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 0x7f337806c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3388000f60 tx=0x7f3388009040 comp rx=0 tx=0).stop 2023-12-19T05:40:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 msgr2=0x7f3398145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f338000e9b0 tx=0x7f338000ee70 comp rx=0 tx=0).stop 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 shutdown_connections 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f337806a460 0x7f337806c920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398155460 0x7f33980cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980b0a00 0x7f3398145050 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 --2- 172.21.15.49:0/2483468349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f339806ca80 0x7f33981fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 >> 172.21.15.49:0/2483468349 conn(0x7f33980659a0 msgr2=0x7f33981549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 shutdown_connections 2023-12-19T05:40:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.324+0000 7f339c9c8640 1 -- 172.21.15.49:0/2483468349 wait complete. 2023-12-19T05:40:42.346 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:40:42.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:42.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:40:42.458 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:40:42.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:40:42.459 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:40:42.510 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:42.510 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:42.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:40:42.576 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:42.577 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:42.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:40:42.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:42.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.876+0000 7fa2cf362640 1 Processor -- start 2023-12-19T05:40:42.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.876+0000 7fa2cf362640 1 -- start start 2023-12-19T05:40:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2c815e5a0 0x7fa2c80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815f680 0x7fa2c80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c80cdbf0 0x7fa2c80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c80ce5c0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c815ec30 con 0x7fa2c815e5a0 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2cf362640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80b2cc0 con 0x7fa2c815f680 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2ceb61640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c80cdbf0 0x7fa2c80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2ceb61640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c80cdbf0 0x7fa2c80ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50190/0 (socket says 172.21.15.49:50190) 2023-12-19T05:40:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.878+0000 7fa2ceb61640 1 -- 172.21.15.49:0/2678233711 learned_addr learned my addr 172.21.15.49:0/2678233711 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ce360640 1 --2- 172.21.15.49:0/2678233711 >> v2:172.21.15.115:3300/0 conn(0x7fa2c815e5a0 0x7fa2c80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2cdb5f640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815f680 0x7fa2c80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ceb61640 1 -- 172.21.15.49:0/2678233711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815f680 msgr2=0x7fa2c80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ceb61640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815f680 0x7fa2c80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ceb61640 1 -- 172.21.15.49:0/2678233711 >> v2:172.21.15.115:3300/0 conn(0x7fa2c815e5a0 msgr2=0x7fa2c80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ceb61640 1 --2- 172.21.15.49:0/2678233711 >> v2:172.21.15.115:3300/0 conn(0x7fa2c815e5a0 0x7fa2c80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.879+0000 7fa2ceb61640 1 -- 172.21.15.49:0/2678233711 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c815e980 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.881+0000 7fa2ceb61640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c80ce080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b5200 tx=0x7fa2c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60075b5685df5540 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.881+0000 7fa2cd35e640 1 -- 172.21.15.49:0/2678233711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c002ca70 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.881+0000 7fa2cd35e640 1 -- 172.21.15.49:0/2678233711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c002cbd0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.881+0000 7fa2cd35e640 1 -- 172.21.15.49:0/2678233711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00343f0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 -- 172.21.15.49:0/2678233711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 msgr2=0x7fa2c80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c80ce080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b5200 tx=0x7fa2c002bed0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 -- 172.21.15.49:0/2678233711 shutdown_connections 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c80ce080 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 --2- 172.21.15.49:0/2678233711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815f680 0x7fa2c80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 --2- 172.21.15.49:0/2678233711 >> v2:172.21.15.115:3300/0 conn(0x7fa2c815e5a0 0x7fa2c80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 -- 172.21.15.49:0/2678233711 >> 172.21.15.49:0/2678233711 conn(0x7fa2c80b0100 msgr2=0x7fa2c80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 -- 172.21.15.49:0/2678233711 shutdown_connections 2023-12-19T05:40:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.882+0000 7fa2cf362640 1 -- 172.21.15.49:0/2678233711 wait complete. 2023-12-19T05:40:42.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.884+0000 7fa2cf362640 1 Processor -- start 2023-12-19T05:40:42.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.884+0000 7fa2cf362640 1 -- start start 2023-12-19T05:40:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 0x7fa2c80acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c815f680 0x7fa2c814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80cc800 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81526e0 con 0x7fa2c815f680 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2cf362640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80cba80 con 0x7fa2c815e5a0 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2ce360640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2ce360640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50196/0 (socket says 172.21.15.49:50196) 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.885+0000 7fa2ce360640 1 -- 172.21.15.49:0/3821822271 learned_addr learned my addr 172.21.15.49:0/3821822271 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ceb61640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c815f680 0x7fa2c814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2cdb5f640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 0x7fa2c80acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 -- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 msgr2=0x7fa2c80acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 0x7fa2c80acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 -- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c815f680 msgr2=0x7fa2c814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c815f680 0x7fa2c814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 -- 172.21.15.49:0/3821822271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009b30 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2cdb5f640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 0x7fa2c80acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:42.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.886+0000 7fa2ce360640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d800 tx=0x7fa2c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.887+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400b6c0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.887+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400b820 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.887+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400bbb0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.887+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c8153600 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.887+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c80cc000 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.888+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c8061910 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.889+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2c400bd10 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.890+0000 7fa2beffd640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 0x7fa2ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.890+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2c4088ec0 con 0x7fa2c80cdbf0 2023-12-19T05:40:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.891+0000 7fa2cdb5f640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 0x7fa2ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:42.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.892+0000 7fa2cdb5f640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 0x7fa2ac06c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8006fd0 tx=0x7fa2b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:42.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:42.902+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2c4054410 con 0x7fa2c80cdbf0 2023-12-19T05:40:43.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.138+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2c80ce980 con 0x7fa2c80cdbf0 2023-12-19T05:40:43.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.139+0000 7fa2beffd640 1 -- 172.21.15.49:0/3821822271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fa2c4057a30 con 0x7fa2c80cdbf0 2023-12-19T05:40:43.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:43.142 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:43.142 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 msgr2=0x7fa2ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 0x7fa2ac06c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8006fd0 tx=0x7fa2b8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 msgr2=0x7fa2c81530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d800 tx=0x7fa2c400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 shutdown_connections 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa2ac06a430 0x7fa2ac06c8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c815e5a0 0x7fa2c80acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c815f680 0x7fa2c814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 --2- 172.21.15.49:0/3821822271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c80cdbf0 0x7fa2c81530c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 >> 172.21.15.49:0/3821822271 conn(0x7fa2c80b0100 msgr2=0x7fa2c806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 shutdown_connections 2023-12-19T05:40:43.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.142+0000 7fa2cf362640 1 -- 172.21.15.49:0/3821822271 wait complete. 2023-12-19T05:40:43.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:43.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.399+0000 7fdfc7fff640 1 Processor -- start 2023-12-19T05:40:43.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.400+0000 7fdfc7fff640 1 -- start start 2023-12-19T05:40:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc80cf670 0x7fdfc80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc7fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80b4120 con 0x7fdfc815d620 2023-12-19T05:40:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc7fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80b5b80 con 0x7fdfc815da00 2023-12-19T05:40:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc7fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80b6ee0 con 0x7fdfc80cf670 2023-12-19T05:40:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc6ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdfc815d620 0x7fdfc80cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36352/0 (socket says 172.21.15.49:36352) 2023-12-19T05:40:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.402+0000 7fdfc6ffd640 1 -- 172.21.15.49:0/1367487018 learned_addr learned my addr 172.21.15.49:0/1367487018 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772848414 0 0) 0x7fdfc80b4120 con 0x7fdfc815d620 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc67fc640 1 --2- 172.21.15.49:0/1367487018 >> v2:172.21.15.115:3300/0 conn(0x7fdfc80cf670 0x7fdfc80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb4003520 con 0x7fdfc815d620 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508222761 0 0) 0x7fdfb4003520 con 0x7fdfc815d620 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 >> v2:172.21.15.115:3300/0 conn(0x7fdfc80cf670 msgr2=0x7fdfc80b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 --2- 172.21.15.49:0/1367487018 >> v2:172.21.15.115:3300/0 conn(0x7fdfc80cf670 0x7fdfc80b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 >> v1:172.21.15.115:6789/0 conn(0x7fdfc815da00 legacy=0x7fdfc80b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80b71c0 con 0x7fdfc815d620 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fdfb80019f0 con 0x7fdfc815d620 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 >> v1:172.21.15.49:6789/0 conn(0x7fdfc815d620 legacy=0x7fdfc80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.403+0000 7fdfc5ffb640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfb40039c0 0x7fdfb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc5ffb640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfb40047c0 0x7fdfb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc5ffb640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80b6ee0 con 0x7fdfb4005180 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400c080 con 0x7fdfb40047c0 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400c240 con 0x7fdfb40039c0 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc67fc640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfb40047c0 0x7fdfb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc6ffd640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfb40039c0 0x7fdfb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 -- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfb40039c0 msgr2=0x7fdfb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfb40039c0 0x7fdfb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 -- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfb40047c0 msgr2=0x7fdfb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfb40047c0 0x7fdfb4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.404+0000 7fdfc77fe640 1 -- 172.21.15.49:0/1367487018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4003520 con 0x7fdfb4005180 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.405+0000 7fdfc77fe640 1 -- 172.21.15.49:0/1367487018 reap_dead start 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc77fe640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfb400b980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001720 tx=0x7fdfb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b44077bd1801278 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00052d0 con 0x7fdfb4005180 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc002e050 con 0x7fdfb4005180 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc5ffb640 1 -- 172.21.15.49:0/1367487018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00035f0 con 0x7fdfb4005180 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc7fff640 1 -- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 msgr2=0x7fdfb400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfb400b980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001720 tx=0x7fdfb40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc7fff640 1 -- 172.21.15.49:0/1367487018 shutdown_connections 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/1367487018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfb400b980 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.406+0000 7fdfc7fff640 1 -- 172.21.15.49:0/1367487018 >> 172.21.15.49:0/1367487018 conn(0x7fdfc80cfb90 msgr2=0x7fdfc80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.407+0000 7fdfc7fff640 1 -- 172.21.15.49:0/1367487018 shutdown_connections 2023-12-19T05:40:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.407+0000 7fdfc7fff640 1 -- 172.21.15.49:0/1367487018 wait complete. 2023-12-19T05:40:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.408+0000 7fdfc7fff640 1 Processor -- start 2023-12-19T05:40:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 -- start start 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfc80cd9d0 0x7fdfc8070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc80b6060 0x7fdfc80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc8146890 con 0x7fdfb4005180 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80b6a20 con 0x7fdfc80b6060 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.409+0000 7fdfc7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81456a0 con 0x7fdfc80cd9d0 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50200/0 (socket says 172.21.15.49:50200) 2023-12-19T05:40:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 -- 172.21.15.49:0/595630319 learned_addr learned my addr 172.21.15.49:0/595630319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc77fe640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc80b6060 0x7fdfc80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 -- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfc80cd9d0 msgr2=0x7fdfc8070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfc80cd9d0 0x7fdfc8070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 -- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc80b6060 msgr2=0x7fdfc80b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc80b6060 0x7fdfc80b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.410+0000 7fdfc6ffd640 1 -- 172.21.15.49:0/595630319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc81582c0 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfc6ffd640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8007a10 tx=0x7fdfb800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800edf0 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8013420 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8013790 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc8145930 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.411+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc8145ef0 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.412+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc8061910 con 0x7fdfb4005180 2023-12-19T05:40:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.414+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfb80138f0 con 0x7fdfb4005180 2023-12-19T05:40:43.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.415+0000 7fdfbf7fe640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 0x7fdfa806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.415+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfb8088fd0 con 0x7fdfb4005180 2023-12-19T05:40:43.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.416+0000 7fdfc67fc640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 0x7fdfa806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.417+0000 7fdfc67fc640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 0x7fdfa806c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80b6bb0 tx=0x7fdfb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.420+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdfb8054650 con 0x7fdfb4005180 2023-12-19T05:40:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.617+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc80b3bd0 con 0x7fdfb4005180 2023-12-19T05:40:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.620+0000 7fdfbf7fe640 1 -- 172.21.15.49:0/595630319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fdfb8057c70 con 0x7fdfb4005180 2023-12-19T05:40:43.622 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:43.622 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.623+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 msgr2=0x7fdfa806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.623+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 0x7fdfa806c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80b6bb0 tx=0x7fdfb0008040 comp rx=0 tx=0).stop 2023-12-19T05:40:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.623+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 msgr2=0x7fdfc81e4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.623+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8007a10 tx=0x7fdfb800e530 comp rx=0 tx=0).stop 2023-12-19T05:40:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 shutdown_connections 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfa806a430 0x7fdfa806c8f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfc80cd9d0 0x7fdfc8070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc80b6060 0x7fdfc80b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 --2- 172.21.15.49:0/595630319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb4005180 0x7fdfc81e4b40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 >> 172.21.15.49:0/595630319 conn(0x7fdfc80cfb90 msgr2=0x7fdfc8159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 shutdown_connections 2023-12-19T05:40:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.624+0000 7fdfc7fff640 1 -- 172.21.15.49:0/595630319 wait complete. 2023-12-19T05:40:43.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:40:17.931596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:40:19.260485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:43.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:43.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.881+0000 7f2d9ffff640 1 Processor -- start 2023-12-19T05:40:43.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.881+0000 7f2d9ffff640 1 -- start start 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 0x7f2da00afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2da00b02a0 0x7f2da00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9ffff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da015ea00 con 0x7f2da00cd4e0 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9ffff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00b06f0 con 0x7f2da00b02a0 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da015dae0 con 0x7f2da015e580 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9effd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2da00cd4e0 0x7f2da015a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36364/0 (socket says 172.21.15.49:36364) 2023-12-19T05:40:43.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9effd640 1 -- 172.21.15.49:0/1261671714 learned_addr learned my addr 172.21.15.49:0/1261671714 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:43.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/1261671714 >> v2:172.21.15.49:3300/0 conn(0x7f2da00b02a0 0x7f2da00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d967fc640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 0x7f2da00afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.884+0000 7f2d9e7fc640 1 -- 172.21.15.49:0/1261671714 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406226890 0 0) 0x7f2d90001110 con 0x7f2da00cd4e0 2023-12-19T05:40:43.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d9e7fc640 1 -- 172.21.15.49:0/1261671714 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c005730 con 0x7f2da00cd4e0 2023-12-19T05:40:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/1261671714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 msgr2=0x7f2da00afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 0x7f2da00afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/1261671714 >> v1:172.21.15.49:6789/0 conn(0x7f2da00cd4e0 legacy=0x7f2da015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/1261671714 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da015b000 con 0x7f2da00b02a0 2023-12-19T05:40:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.885+0000 7f2d967fc640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 0x7f2da00afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.886+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da00b02a0 0x7f2da00b1130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009d90 tx=0x7f2d9802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca003af982421850 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.886+0000 7f2d9e7fc640 1 -- 172.21.15.49:0/1261671714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9802cc50 con 0x7f2da00b02a0 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.886+0000 7f2d9e7fc640 1 -- 172.21.15.49:0/1261671714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9802cdb0 con 0x7f2da00b02a0 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.886+0000 7f2d9e7fc640 1 -- 172.21.15.49:0/1261671714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98034660 con 0x7f2da00b02a0 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 -- 172.21.15.49:0/1261671714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da00b02a0 msgr2=0x7f2da00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da00b02a0 0x7f2da00b1130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009d90 tx=0x7f2d9802bea0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 -- 172.21.15.49:0/1261671714 shutdown_connections 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da00b02a0 0x7f2da00b1130 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/1261671714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da015e580 0x7f2da00afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 -- 172.21.15.49:0/1261671714 >> 172.21.15.49:0/1261671714 conn(0x7f2da006f630 msgr2=0x7f2da006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 -- 172.21.15.49:0/1261671714 shutdown_connections 2023-12-19T05:40:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.887+0000 7f2d9ffff640 1 -- 172.21.15.49:0/1261671714 wait complete. 2023-12-19T05:40:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.889+0000 7f2d9ffff640 1 Processor -- start 2023-12-19T05:40:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.889+0000 7f2d9ffff640 1 -- start start 2023-12-19T05:40:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da00b02a0 0x7f2da014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2da00cd4e0 0x7f2da014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00af390 con 0x7f2da015e580 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da014d1f0 con 0x7f2da00cd4e0 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00ae730 con 0x7f2da00b02a0 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50220/0 (socket says 172.21.15.49:50220) 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/393640645 learned_addr learned my addr 172.21.15.49:0/393640645 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da00b02a0 msgr2=0x7f2da014ccb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d967fc640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2da00cd4e0 0x7f2da014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da00b02a0 0x7f2da014ccb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2da00cd4e0 msgr2=0x7f2da014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2da00cd4e0 0x7f2da014b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:43.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.890+0000 7f2d9f7fe640 1 -- 172.21.15.49:0/393640645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98009a70 con 0x7f2da015e580 2023-12-19T05:40:43.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d9f7fe640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009d90 tx=0x7f2d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98040650 con 0x7f2da015e580 2023-12-19T05:40:43.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980407b0 con 0x7f2da015e580 2023-12-19T05:40:43.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98040b60 con 0x7f2da015e580 2023-12-19T05:40:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00ae9f0 con 0x7f2da015e580 2023-12-19T05:40:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.891+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00aefb0 con 0x7f2da015e580 2023-12-19T05:40:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.892+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0061910 con 0x7f2da015e580 2023-12-19T05:40:43.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.893+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d98040cc0 con 0x7f2da015e580 2023-12-19T05:40:43.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.894+0000 7f2d97fff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 0x7f2d8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:43.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.894+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d980ab6d0 con 0x7f2da015e580 2023-12-19T05:40:43.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.895+0000 7f2d9effd640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 0x7f2d8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:43.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.896+0000 7f2d9effd640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 0x7f2d8006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2d90001560 tx=0x7f2d900010d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:43.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:43.899+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d98076cc0 con 0x7f2da015e580 2023-12-19T05:40:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.092+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2da015e030 con 0x7f2da015e580 2023-12-19T05:40:44.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.093+0000 7f2d97fff640 1 -- 172.21.15.49:0/393640645 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d98009450 con 0x7f2da015e580 2023-12-19T05:40:44.094 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.095+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 msgr2=0x7f2d8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.095+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 0x7f2d8006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2d90001560 tx=0x7f2d900010d0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.095+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 msgr2=0x7f2da014e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.095+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009d90 tx=0x7f2d98004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 shutdown_connections 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d8006a430 0x7f2d8006c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da015e580 0x7f2da014e7d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2da00cd4e0 0x7f2da014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 --2- 172.21.15.49:0/393640645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2da00b02a0 0x7f2da014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 >> 172.21.15.49:0/393640645 conn(0x7f2da006f630 msgr2=0x7f2da01521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 shutdown_connections 2023-12-19T05:40:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.096+0000 7f2d9ffff640 1 -- 172.21.15.49:0/393640645 wait complete. 2023-12-19T05:40:44.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:40:44.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.350+0000 7f4edb59e640 1 Processor -- start 2023-12-19T05:40:44.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.350+0000 7f4edb59e640 1 -- start start 2023-12-19T05:40:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.351+0000 7f4edb59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc159e40 0x7f4edc0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edb59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4edc0cd430 0x7f4edc0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edb59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4edc0b0830 0x7f4edc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edb59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc0b23e0 con 0x7f4edc0b0830 2023-12-19T05:40:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edb59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc06b3a0 con 0x7f4edc0cd430 2023-12-19T05:40:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edb59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0b0c80 con 0x7f4edc159e40 2023-12-19T05:40:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4edc0b0830 0x7f4edc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4edc0b0830 0x7f4edc15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55682/0 (socket says 172.21.15.49:55682) 2023-12-19T05:40:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4edad9d640 1 -- 172.21.15.49:0/3734906956 learned_addr learned my addr 172.21.15.49:0/3734906956 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4ed9d9b640 1 --2- 172.21.15.49:0/3734906956 >> v2:172.21.15.115:3300/0 conn(0x7f4edc0cd430 0x7f4edc0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.352+0000 7f4eda59c640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc159e40 0x7f4edc0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.353+0000 7f4edad9d640 1 -- 172.21.15.49:0/3734906956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc159e40 msgr2=0x7f4edc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.353+0000 7f4edad9d640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc159e40 0x7f4edc0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.353+0000 7f4edad9d640 1 -- 172.21.15.49:0/3734906956 >> v2:172.21.15.115:3300/0 conn(0x7f4edc0cd430 msgr2=0x7f4edc0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.353+0000 7f4edad9d640 1 --2- 172.21.15.49:0/3734906956 >> v2:172.21.15.115:3300/0 conn(0x7f4edc0cd430 0x7f4edc0b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.353+0000 7f4edad9d640 1 -- 172.21.15.49:0/3734906956 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0b1860 con 0x7f4edc0b0830 2023-12-19T05:40:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.354+0000 7f4edad9d640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc15da60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0b0f30 tx=0x7f4ed402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2da9cce9171c3d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.354+0000 7f4ed959a640 1 -- 172.21.15.49:0/3734906956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed402ed10 con 0x7f4edc0b0830 2023-12-19T05:40:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.354+0000 7f4ed959a640 1 -- 172.21.15.49:0/3734906956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed402ee70 con 0x7f4edc0b0830 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.354+0000 7f4ed959a640 1 -- 172.21.15.49:0/3734906956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40365f0 con 0x7f4edc0b0830 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 -- 172.21.15.49:0/3734906956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 msgr2=0x7f4edc15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc15da60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0b0f30 tx=0x7f4ed402e170 comp rx=0 tx=0).stop 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 -- 172.21.15.49:0/3734906956 shutdown_connections 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc15da60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3734906956 >> v2:172.21.15.115:3300/0 conn(0x7f4edc0cd430 0x7f4edc0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3734906956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc159e40 0x7f4edc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 -- 172.21.15.49:0/3734906956 >> 172.21.15.49:0/3734906956 conn(0x7f4edc0659a0 msgr2=0x7f4edc065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 -- 172.21.15.49:0/3734906956 shutdown_connections 2023-12-19T05:40:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.355+0000 7f4edb59e640 1 -- 172.21.15.49:0/3734906956 wait complete. 2023-12-19T05:40:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.357+0000 7f4edb59e640 1 Processor -- start 2023-12-19T05:40:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.357+0000 7f4edb59e640 1 -- start start 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc0cd430 0x7f4edc146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4edc159e40 0x7f4edc147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc149a20 con 0x7f4edc0b0830 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1ee0a0 con 0x7f4edc159e40 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4edb59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc14c160 con 0x7f4edc0cd430 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4eda59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4eda59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55684/0 (socket says 172.21.15.49:55684) 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.358+0000 7f4eda59c640 1 -- 172.21.15.49:0/3366424440 learned_addr learned my addr 172.21.15.49:0/3366424440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4edad9d640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4edc159e40 0x7f4edc147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4ed9d9b640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc0cd430 0x7f4edc146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 -- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc0cd430 msgr2=0x7f4edc146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc0cd430 0x7f4edc146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 -- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4edc159e40 msgr2=0x7f4edc147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4edc159e40 0x7f4edc147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 -- 172.21.15.49:0/3366424440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009b30 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4eda59c640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00d800 tx=0x7f4ecc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00b6c0 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00b820 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.359+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00bbb0 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.360+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc147960 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.360+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc1ee2d0 con 0x7f4edc0b0830 2023-12-19T05:40:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.361+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc061910 con 0x7f4edc0b0830 2023-12-19T05:40:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.362+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ecc00bd10 con 0x7f4edc0b0830 2023-12-19T05:40:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.363+0000 7f4ecaffd640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 0x7f4ebc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.363+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ecc088ce0 con 0x7f4edc0b0830 2023-12-19T05:40:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.364+0000 7f4ed9d9b640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 0x7f4ebc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.365+0000 7f4ed9d9b640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 0x7f4ebc06c920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0006fd0 tx=0x7f4ed0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.368+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ecc054360 con 0x7f4edc0b0830 2023-12-19T05:40:44.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.564+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4edc06f8d0 con 0x7f4edc0b0830 2023-12-19T05:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.565+0000 7f4ecaffd640 1 -- 172.21.15.49:0/3366424440 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ecc057980 con 0x7f4edc0b0830 2023-12-19T05:40:44.566 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 msgr2=0x7f4ebc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 0x7f4ebc06c920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0006fd0 tx=0x7f4ed0008040 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 msgr2=0x7f4edc14d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00d800 tx=0x7f4ecc00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 shutdown_connections 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ebc06a460 0x7f4ebc06c920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4edc0cd430 0x7f4edc146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4edc159e40 0x7f4edc147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 --2- 172.21.15.49:0/3366424440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4edc0b0830 0x7f4edc14d900 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.567+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 >> 172.21.15.49:0/3366424440 conn(0x7f4edc0659a0 msgr2=0x7f4edc06b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.568+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 shutdown_connections 2023-12-19T05:40:44.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.568+0000 7f4edb59e640 1 -- 172.21.15.49:0/3366424440 wait complete. 2023-12-19T05:40:44.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:40:44.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.812+0000 7fd58e78e640 1 Processor -- start 2023-12-19T05:40:44.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.813+0000 7fd58e78e640 1 -- start start 2023-12-19T05:40:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58e78e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd58815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58e78e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 0x7fd5880ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58e78e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880cd020 con 0x7fd5880ce750 2023-12-19T05:40:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58e78e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880cca30 con 0x7fd5880b2710 2023-12-19T05:40:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58e78e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880b2f20 con 0x7fd58815ae50 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58df8d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd5880ce750 0x7fd5880cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45414/0 (socket says 172.21.15.49:45414) 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58df8d640 1 -- 172.21.15.49:0/1373058017 learned_addr learned my addr 172.21.15.49:0/1373058017 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1373058017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd58815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.815+0000 7fd58cf8b640 1 --2- 172.21.15.49:0/1373058017 >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 0x7fd5880ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd57ffff640 1 -- 172.21.15.49:0/1373058017 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295655405 0 0) 0x7fd5880cd020 con 0x7fd5880ce750 2023-12-19T05:40:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd57ffff640 1 -- 172.21.15.49:0/1373058017 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd574003520 con 0x7fd5880ce750 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd58d78c640 1 -- 172.21.15.49:0/1373058017 >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 msgr2=0x7fd5880ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1373058017 >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 0x7fd5880ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd58d78c640 1 -- 172.21.15.49:0/1373058017 >> v1:172.21.15.49:6789/0 conn(0x7fd5880ce750 legacy=0x7fd5880cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd58d78c640 1 -- 172.21.15.49:0/1373058017 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880b3200 con 0x7fd58815ae50 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.816+0000 7fd58cf8b640 1 --2- 172.21.15.49:0/1373058017 >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 0x7fd5880ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:40:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.818+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1373058017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd58815e460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5840097a0 tx=0x7fd58402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26eeec6f8443274 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.818+0000 7fd57ffff640 1 -- 172.21.15.49:0/1373058017 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58402d040 con 0x7fd58815ae50 2023-12-19T05:40:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.818+0000 7fd57ffff640 1 -- 172.21.15.49:0/1373058017 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584031810 con 0x7fd58815ae50 2023-12-19T05:40:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.818+0000 7fd57ffff640 1 -- 172.21.15.49:0/1373058017 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584031b80 con 0x7fd58815ae50 2023-12-19T05:40:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 -- 172.21.15.49:0/1373058017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 msgr2=0x7fd58815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1373058017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd58815e460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5840097a0 tx=0x7fd58402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 -- 172.21.15.49:0/1373058017 shutdown_connections 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1373058017 >> v2:172.21.15.115:3300/0 conn(0x7fd5880b2710 0x7fd5880ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1373058017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd58815e460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 -- 172.21.15.49:0/1373058017 >> 172.21.15.49:0/1373058017 conn(0x7fd58806f630 msgr2=0x7fd58806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 -- 172.21.15.49:0/1373058017 shutdown_connections 2023-12-19T05:40:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.819+0000 7fd58e78e640 1 -- 172.21.15.49:0/1373058017 wait complete. 2023-12-19T05:40:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.822+0000 7fd58e78e640 1 Processor -- start 2023-12-19T05:40:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.822+0000 7fd58e78e640 1 -- start start 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.823+0000 7fd58e78e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5880b2710 0x7fd588145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.823+0000 7fd58e78e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.823+0000 7fd58e78e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd5880af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.823+0000 7fd58e78e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880aef90 con 0x7fd5880ce750 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58e78e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880af8f0 con 0x7fd5880b2710 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58e78e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58806e2b0 con 0x7fd58815ae50 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55694/0 (socket says 172.21.15.49:55694) 2023-12-19T05:40:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 -- 172.21.15.49:0/1705373624 learned_addr learned my addr 172.21.15.49:0/1705373624 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5880b2710 0x7fd588145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 -- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 msgr2=0x7fd5880af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd5880af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 -- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5880b2710 msgr2=0x7fd588145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5880b2710 0x7fd588145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.824+0000 7fd58cf8b640 1 -- 172.21.15.49:0/1705373624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009400 con 0x7fd5880ce750 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd58cf8b640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e990 tx=0x7fd57800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800c9e0 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800cb40 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800ced0 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd584009400 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.825+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5880ae5f0 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.827+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5880af0d0 con 0x7fd5880ce750 2023-12-19T05:40:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.827+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd578013470 con 0x7fd5880ce750 2023-12-19T05:40:44.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.828+0000 7fd57dffb640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.829+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd578088b90 con 0x7fd5880ce750 2023-12-19T05:40:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.829+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:44.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.830+0000 7fd58d78c640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 0x7fd56c06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd584036000 tx=0x7fd58403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:44.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:44.834+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5880af0d0 con 0x7fd5880ce750 2023-12-19T05:40:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.028+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5880af0d0 con 0x7fd5880ce750 2023-12-19T05:40:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.029+0000 7fd57dffb640 1 -- 172.21.15.49:0/1705373624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5880af0d0 con 0x7fd5880ce750 2023-12-19T05:40:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:40:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 msgr2=0x7fd56c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 0x7fd56c06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd584036000 tx=0x7fd58403c040 comp rx=0 tx=0).stop 2023-12-19T05:40:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 msgr2=0x7fd5880adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e990 tx=0x7fd57800ee50 comp rx=0 tx=0).stop 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 shutdown_connections 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd58815ae50 0x7fd5880af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5880ce750 0x7fd5880adc10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 --2- 172.21.15.49:0/1705373624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5880b2710 0x7fd588145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 >> 172.21.15.49:0/1705373624 conn(0x7fd58806f630 msgr2=0x7fd5881566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 shutdown_connections 2023-12-19T05:40:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.032+0000 7fd58e78e640 1 -- 172.21.15.49:0/1705373624 wait complete. 2023-12-19T05:40:45.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.283+0000 7f988a91c640 1 Processor -- start 2023-12-19T05:40:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.283+0000 7f988a91c640 1 -- start start 2023-12-19T05:40:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f988a91c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f988415e5a0 0x7f98840b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f988a91c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98840ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f988a91c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988415ec30 con 0x7f988415f680 2023-12-19T05:40:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f988a91c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98840ce5a0 con 0x7f988415e5a0 2023-12-19T05:40:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f988a91c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988415e980 con 0x7f98840cdbf0 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f9889119640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f988415f680 0x7f98840b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45424/0 (socket says 172.21.15.49:45424) 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.285+0000 7f9889119640 1 -- 172.21.15.49:0/3646214870 learned_addr learned my addr 172.21.15.49:0/3646214870 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f988991a640 1 --2- 172.21.15.49:0/3646214870 >> v2:172.21.15.115:3300/0 conn(0x7f988415e5a0 0x7f98840b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f988a11b640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98840ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229576838 0 0) 0x7f988415ec30 con 0x7f988415f680 2023-12-19T05:40:45.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9870003520 con 0x7f988415f680 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746211594 0 0) 0x7f9870003520 con 0x7f988415f680 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 msgr2=0x7f98840ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98840ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 >> v2:172.21.15.115:3300/0 conn(0x7f988415e5a0 msgr2=0x7f98840b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 --2- 172.21.15.49:0/3646214870 >> v2:172.21.15.115:3300/0 conn(0x7f988415e5a0 0x7f98840b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840b2f90 con 0x7f988415f680 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9874001670 con 0x7f988415f680 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 >> v1:172.21.15.49:6789/0 conn(0x7f988415f680 legacy=0x7f98840b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9870003970 0x7f9870003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9870004d00 0x7f9870005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840ce5a0 con 0x7f9870003970 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988415e980 con 0x7f9870004d00 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.286+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987000b980 con 0x7f98840cdbf0 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9870003970 0x7f9870003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f9889119640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988a11b640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9870004d00 0x7f9870005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 -- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 msgr2=0x7f98700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 -- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9870004d00 msgr2=0x7f9870005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9870004d00 0x7f9870005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f988991a640 1 -- 172.21.15.49:0/3646214870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870003520 con 0x7f9870003970 2023-12-19T05:40:45.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.287+0000 7f9889119640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98840cdbf0 0x7f98700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:45.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.288+0000 7f988991a640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9870003970 0x7f9870003d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9880009ac0 tx=0x7f98700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e68817da47b0465 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988002c710 con 0x7f9870003970 2023-12-19T05:40:45.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988002c870 con 0x7f9870003970 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f9888918640 1 -- 172.21.15.49:0/3646214870 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988002cc00 con 0x7f9870003970 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 -- 172.21.15.49:0/3646214870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9870003970 msgr2=0x7f9870003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 --2- 172.21.15.49:0/3646214870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9870003970 0x7f9870003d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9880009ac0 tx=0x7f98700057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a11b640 1 -- 172.21.15.49:0/3646214870 reap_dead start 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 -- 172.21.15.49:0/3646214870 shutdown_connections 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 -- 172.21.15.49:0/3646214870 >> 172.21.15.49:0/3646214870 conn(0x7f98840b0100 msgr2=0x7f98840b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 -- 172.21.15.49:0/3646214870 shutdown_connections 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.289+0000 7f988a91c640 1 -- 172.21.15.49:0/3646214870 wait complete. 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.291+0000 7f988a91c640 1 Processor -- start 2023-12-19T05:40:45.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.291+0000 7f988a91c640 1 -- start start 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9870003970 0x7f9884140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884153c80 0x7f9884154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988415b2c0 con 0x7f988415a900 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884151580 con 0x7f9884153c80 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.292+0000 7f988a91c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9884151860 con 0x7f9870003970 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55698/0 (socket says 172.21.15.49:55698) 2023-12-19T05:40:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 -- 172.21.15.49:0/654104971 learned_addr learned my addr 172.21.15.49:0/654104971 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f988a11b640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884153c80 0x7f9884154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f988991a640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9870003970 0x7f9884140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 -- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9870003970 msgr2=0x7f9884140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9870003970 0x7f9884140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 -- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884153c80 msgr2=0x7f9884154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884153c80 0x7f9884154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.293+0000 7f9889119640 1 -- 172.21.15.49:0/654104971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884151b40 con 0x7f988415a900 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f9889119640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9874001200 tx=0x7f987400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400c690 con 0x7f988415a900 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400c7f0 con 0x7f988415a900 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9884151e20 con 0x7f988415a900 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400cb60 con 0x7f988415a900 2023-12-19T05:40:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.294+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9884154670 con 0x7f988415a900 2023-12-19T05:40:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.295+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9884061910 con 0x7f988415a900 2023-12-19T05:40:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.297+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f987400ccc0 con 0x7f988415a900 2023-12-19T05:40:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.298+0000 7f987a7fc640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 0x7f986806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.298+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9874088830 con 0x7f988415a900 2023-12-19T05:40:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.299+0000 7f988991a640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 0x7f986806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.300+0000 7f988991a640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 0x7f986806c920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9880036000 tx=0x7f9880030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.303+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9874053e10 con 0x7f988415a900 2023-12-19T05:40:45.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.534+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f988415ddc0 con 0x7f988415a900 2023-12-19T05:40:45.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.535+0000 7f987a7fc640 1 -- 172.21.15.49:0/654104971 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f9874057430 con 0x7f988415a900 2023-12-19T05:40:45.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:45.537 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:45.537 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:45.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 msgr2=0x7f986806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 0x7f986806c920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9880036000 tx=0x7f9880030000 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 msgr2=0x7f988415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9874001200 tx=0x7f987400ec10 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 shutdown_connections 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986806a460 0x7f986806c920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884153c80 0x7f9884154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415a900 0x7f988415ad80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 --2- 172.21.15.49:0/654104971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9870003970 0x7f9884140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 >> 172.21.15.49:0/654104971 conn(0x7f98840b0100 msgr2=0x7f988406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 shutdown_connections 2023-12-19T05:40:45.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.538+0000 7f988a91c640 1 -- 172.21.15.49:0/654104971 wait complete. 2023-12-19T05:40:45.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.773+0000 7fa91d8e5640 1 Processor -- start 2023-12-19T05:40:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.773+0000 7fa91d8e5640 1 -- start start 2023-12-19T05:40:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d8e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa91815b1e0 0x7fa91815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d8e5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa91815a8a0 0x7fa91815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d8e5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91806b520 con 0x7fa918159f80 2023-12-19T05:40:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d8e5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9180b2b20 con 0x7fa91815a8a0 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d8e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9180b2fb0 con 0x7fa91815b1e0 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d0e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa91815a8a0 0x7fa91815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d0e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa91815a8a0 0x7fa91815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55714/0 (socket says 172.21.15.49:55714) 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.775+0000 7fa91d0e4640 1 -- 172.21.15.49:0/4156244302 learned_addr learned my addr 172.21.15.49:0/4156244302 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.776+0000 7fa917fff640 1 --2- 172.21.15.49:0/4156244302 >> v2:172.21.15.115:3300/0 conn(0x7fa91815b1e0 0x7fa91815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.776+0000 7fa91d0e4640 1 -- 172.21.15.49:0/4156244302 >> v2:172.21.15.115:3300/0 conn(0x7fa91815b1e0 msgr2=0x7fa91815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.776+0000 7fa91d0e4640 1 --2- 172.21.15.49:0/4156244302 >> v2:172.21.15.115:3300/0 conn(0x7fa91815b1e0 0x7fa91815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.776+0000 7fa91d0e4640 1 -- 172.21.15.49:0/4156244302 >> v1:172.21.15.115:6789/0 conn(0x7fa918159f80 legacy=0x7fa91806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.776+0000 7fa91d0e4640 1 -- 172.21.15.49:0/4156244302 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9180b1f10 con 0x7fa91815a8a0 2023-12-19T05:40:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.777+0000 7fa91d0e4640 1 --2- 172.21.15.49:0/4156244302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa91815a8a0 0x7fa91815b770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa9180cff10 tx=0x7fa91002e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c80eeff97be3e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.777+0000 7fa9177fe640 1 -- 172.21.15.49:0/4156244302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000b0d0 con 0x7fa91815a8a0 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.777+0000 7fa9177fe640 1 -- 172.21.15.49:0/4156244302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91000b230 con 0x7fa91815a8a0 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.777+0000 7fa9177fe640 1 -- 172.21.15.49:0/4156244302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910009600 con 0x7fa91815a8a0 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 -- 172.21.15.49:0/4156244302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa91815a8a0 msgr2=0x7fa91815b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/4156244302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa91815a8a0 0x7fa91815b770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa9180cff10 tx=0x7fa91002e180 comp rx=0 tx=0).stop 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 -- 172.21.15.49:0/4156244302 shutdown_connections 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/4156244302 >> v2:172.21.15.115:3300/0 conn(0x7fa91815b1e0 0x7fa91815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/4156244302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa91815a8a0 0x7fa91815b770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 -- 172.21.15.49:0/4156244302 >> 172.21.15.49:0/4156244302 conn(0x7fa9180b0100 msgr2=0x7fa9180b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 -- 172.21.15.49:0/4156244302 shutdown_connections 2023-12-19T05:40:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.778+0000 7fa91d8e5640 1 -- 172.21.15.49:0/4156244302 wait complete. 2023-12-19T05:40:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.780+0000 7fa91d8e5640 1 Processor -- start 2023-12-19T05:40:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.780+0000 7fa91d8e5640 1 -- start start 2023-12-19T05:40:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91815a8a0 0x7fa91815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa91815b1e0 0x7fa9181f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918147760 con 0x7fa918159f80 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91814d6f0 con 0x7fa91815b1e0 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91d8e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91815ccd0 con 0x7fa91815a8a0 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91c8e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91c8e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55718/0 (socket says 172.21.15.49:55718) 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.781+0000 7fa91c8e3640 1 -- 172.21.15.49:0/563357447 learned_addr learned my addr 172.21.15.49:0/563357447 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91d0e4640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa91815b1e0 0x7fa9181f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa917fff640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91815a8a0 0x7fa91815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 -- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91815a8a0 msgr2=0x7fa91815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91815a8a0 0x7fa91815c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 -- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa91815b1e0 msgr2=0x7fa9181f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa91815b1e0 0x7fa9181f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 -- 172.21.15.49:0/563357447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91000bd40 con 0x7fa918159f80 2023-12-19T05:40:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.782+0000 7fa91c8e3640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00c430 tx=0x7fa90c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.783+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c011790 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.783+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c0118f0 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.783+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c011ce0 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.783+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91815cfb0 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.783+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91815d290 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.784+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa918061910 con 0x7fa918159f80 2023-12-19T05:40:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.785+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa90c01c460 con 0x7fa918159f80 2023-12-19T05:40:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.786+0000 7fa9157fa640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 0x7fa8fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.786+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa90c088890 con 0x7fa918159f80 2023-12-19T05:40:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.786+0000 7fa917fff640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 0x7fa8fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.787+0000 7fa917fff640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 0x7fa8fc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.790+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa90c053e80 con 0x7fa918159f80 2023-12-19T05:40:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.985+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9180b0f70 con 0x7fa918159f80 2023-12-19T05:40:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.988+0000 7fa9157fa640 1 -- 172.21.15.49:0/563357447 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fa90c0574a0 con 0x7fa918159f80 2023-12-19T05:40:45.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:45.990 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 msgr2=0x7fa8fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 0x7fa8fc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).stop 2023-12-19T05:40:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 msgr2=0x7fa91815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00c430 tx=0x7fa90c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 shutdown_connections 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa8fc06a430 0x7fa8fc06c8f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91815a8a0 0x7fa91815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa91815b1e0 0x7fa9181f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 --2- 172.21.15.49:0/563357447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa918159f80 0x7fa91815c160 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 >> 172.21.15.49:0/563357447 conn(0x7fa9180b0100 msgr2=0x7fa9180b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 shutdown_connections 2023-12-19T05:40:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:45.991+0000 7fa91d8e5640 1 -- 172.21.15.49:0/563357447 wait complete. 2023-12-19T05:40:46.014 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:40:46.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:46.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.240+0000 7f842a270640 1 Processor -- start 2023-12-19T05:40:46.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.240+0000 7f842a270640 1 -- start start 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842a270640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84241449e0 0x7f84240af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842a270640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f842406c6b0 0x7f84240b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842a270640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240afb10 con 0x7f84240b0b50 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842a270640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842406bb30 con 0x7f842406c6b0 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842a270640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240b0070 con 0x7f84241449e0 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.242+0000 7f842880d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f842406c6b0 0x7f84240b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f84237fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84240b0b50 0x7f842406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45434/0 (socket says 172.21.15.49:45434) 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f84237fe640 1 -- 172.21.15.49:0/2963862068 learned_addr learned my addr 172.21.15.49:0/2963862068 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f842880d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f842406c6b0 0x7f84240b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55722/0 (socket says 172.21.15.49:55722) 2023-12-19T05:40:46.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f8423fff640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84241449e0 0x7f84240af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f842880d640 1 -- 172.21.15.49:0/2963862068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84241449e0 msgr2=0x7f84240af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f842880d640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84241449e0 0x7f84240af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f842880d640 1 -- 172.21.15.49:0/2963862068 >> v1:172.21.15.49:6789/0 conn(0x7f84240b0b50 legacy=0x7f842406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f842880d640 1 -- 172.21.15.49:0/2963862068 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240b0350 con 0x7f842406c6b0 2023-12-19T05:40:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.243+0000 7f8422ffd640 1 -- 172.21.15.49:0/2963862068 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088372292 0 0) 0x7f84240afb10 con 0x7f84240b0b50 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.244+0000 7f842880d640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f84240b1710 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f841c009d90 tx=0x7f841c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08df0e90b5296d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f8422ffd640 1 -- 172.21.15.49:0/2963862068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c02cc50 con 0x7f842406c6b0 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f8422ffd640 1 -- 172.21.15.49:0/2963862068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c02cdb0 con 0x7f842406c6b0 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f8422ffd640 1 -- 172.21.15.49:0/2963862068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c034660 con 0x7f842406c6b0 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 -- 172.21.15.49:0/2963862068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 msgr2=0x7f84240b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f84240b1710 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f841c009d90 tx=0x7f841c02bea0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 -- 172.21.15.49:0/2963862068 shutdown_connections 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f84240b1710 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 --2- 172.21.15.49:0/2963862068 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84241449e0 0x7f84240af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.245+0000 7f842a270640 1 -- 172.21.15.49:0/2963862068 >> 172.21.15.49:0/2963862068 conn(0x7f84240cbb70 msgr2=0x7f84240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.246+0000 7f842a270640 1 -- 172.21.15.49:0/2963862068 shutdown_connections 2023-12-19T05:40:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.246+0000 7f842a270640 1 -- 172.21.15.49:0/2963862068 wait complete. 2023-12-19T05:40:46.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.248+0000 7f842a270640 1 Processor -- start 2023-12-19T05:40:46.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.248+0000 7f842a270640 1 -- start start 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84240b0b50 0x7f842415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 0x7f84241f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842413c430 con 0x7f842406c6b0 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8424158560 con 0x7f84241449e0 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f842a270640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8424158840 con 0x7f84240b0b50 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.249+0000 7f8423fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55726/0 (socket says 172.21.15.49:55726) 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 -- 172.21.15.49:0/1643927977 learned_addr learned my addr 172.21.15.49:0/1643927977 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f842880d640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 0x7f84241f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f84237fe640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84240b0b50 0x7f842415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 -- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84240b0b50 msgr2=0x7f842415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84240b0b50 0x7f842415cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 -- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 msgr2=0x7f84241f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 0x7f84241f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 -- 172.21.15.49:0/1643927977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c009a70 con 0x7f842406c6b0 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f842880d640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 0x7f84241f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:46.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.250+0000 7f8423fff640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8414012ab0 tx=0x7f8414012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.251+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400d990 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.251+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414013040 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.251+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414010cc0 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.251+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8424158b20 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.251+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842413b6f0 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.252+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8424061910 con 0x7f842406c6b0 2023-12-19T05:40:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.253+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8414018480 con 0x7f842406c6b0 2023-12-19T05:40:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.254+0000 7f8420ff9640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 0x7f841006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.254+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f841408c8d0 con 0x7f842406c6b0 2023-12-19T05:40:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.255+0000 7f84237fe640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 0x7f841006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.256+0000 7f84237fe640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 0x7f841006c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8418007fd0 tx=0x7f8418009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.258+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8414057ec0 con 0x7f842406c6b0 2023-12-19T05:40:46.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.493+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f842415e9c0 con 0x7f842406c6b0 2023-12-19T05:40:46.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.495+0000 7f8420ff9640 1 -- 172.21.15.49:0/1643927977 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f841405b4e0 con 0x7f842406c6b0 2023-12-19T05:40:46.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:46.496 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:46.496 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.497+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 msgr2=0x7f841006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.497+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 0x7f841006c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8418007fd0 tx=0x7f8418009040 comp rx=0 tx=0).stop 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.497+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 msgr2=0x7f842413b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.497+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8414012ab0 tx=0x7f8414012f70 comp rx=0 tx=0).stop 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 shutdown_connections 2023-12-19T05:40:46.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841006a460 0x7f841006c920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84240b0b50 0x7f842415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84241449e0 0x7f84241f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 --2- 172.21.15.49:0/1643927977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842406c6b0 0x7f842413b1b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 >> 172.21.15.49:0/1643927977 conn(0x7f84240cbb70 msgr2=0x7f842406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 shutdown_connections 2023-12-19T05:40:46.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.498+0000 7f842a270640 1 -- 172.21.15.49:0/1643927977 wait complete. 2023-12-19T05:40:46.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:46.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.751+0000 7f0ed291c640 1 Processor -- start 2023-12-19T05:40:46.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.751+0000 7f0ed291c640 1 -- start start 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed291c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc15e5a0 0x7f0ecc0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed291c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ecc0cdbf0 0x7f0ecc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed291c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc15ec30 con 0x7f0ecc15f680 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed291c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc0ce5c0 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed291c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc15e980 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed211b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ecc0cdbf0 0x7f0ecc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed1119640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ecc15f680 0x7f0ecc0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45438/0 (socket says 172.21.15.49:45438) 2023-12-19T05:40:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed1119640 1 -- 172.21.15.49:0/1348214035 learned_addr learned my addr 172.21.15.49:0/1348214035 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.753+0000 7f0ed191a640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc15e5a0 0x7f0ecc0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.754+0000 7f0ed211b640 1 -- 172.21.15.49:0/1348214035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc15e5a0 msgr2=0x7f0ecc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.754+0000 7f0ed211b640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc15e5a0 0x7f0ecc0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.754+0000 7f0ed211b640 1 -- 172.21.15.49:0/1348214035 >> v1:172.21.15.49:6789/0 conn(0x7f0ecc15f680 legacy=0x7f0ecc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.754+0000 7f0ed211b640 1 -- 172.21.15.49:0/1348214035 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc0b2f90 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.754+0000 7f0ed0918640 1 -- 172.21.15.49:0/1348214035 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624971949 0 0) 0x7f0ecc15ec30 con 0x7f0ecc15f680 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.755+0000 7f0ed211b640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc0cdbf0 0x7f0ecc0ce080 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009d90 tx=0x7f0ec402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925d9c2035f5e2ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.755+0000 7f0ed0918640 1 -- 172.21.15.49:0/1348214035 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec402cc50 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.755+0000 7f0ed0918640 1 -- 172.21.15.49:0/1348214035 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec402cdb0 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.755+0000 7f0ed0918640 1 -- 172.21.15.49:0/1348214035 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4034660 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 -- 172.21.15.49:0/1348214035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc0cdbf0 msgr2=0x7f0ecc0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc0cdbf0 0x7f0ecc0ce080 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009d90 tx=0x7f0ec402bea0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 -- 172.21.15.49:0/1348214035 shutdown_connections 2023-12-19T05:40:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc0cdbf0 0x7f0ecc0ce080 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 --2- 172.21.15.49:0/1348214035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc15e5a0 0x7f0ecc0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 -- 172.21.15.49:0/1348214035 >> 172.21.15.49:0/1348214035 conn(0x7f0ecc0b0100 msgr2=0x7f0ecc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:46.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 -- 172.21.15.49:0/1348214035 shutdown_connections 2023-12-19T05:40:46.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.756+0000 7f0ed291c640 1 -- 172.21.15.49:0/1348214035 wait complete. 2023-12-19T05:40:46.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.758+0000 7f0ed291c640 1 Processor -- start 2023-12-19T05:40:46.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.758+0000 7f0ed291c640 1 -- start start 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 0x7f0ecc1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 0x7f0ecc0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc15b950 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc15bc10 con 0x7f0ecc15f680 2023-12-19T05:40:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed291c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc15bef0 con 0x7f0ecc0cdbf0 2023-12-19T05:40:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed1119640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed1119640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55750/0 (socket says 172.21.15.49:55750) 2023-12-19T05:40:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed1119640 1 -- 172.21.15.49:0/4230458982 learned_addr learned my addr 172.21.15.49:0/4230458982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.759+0000 7f0ed211b640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 0x7f0ecc0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed191a640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 0x7f0ecc1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 -- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 msgr2=0x7f0ecc1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 0x7f0ecc1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 -- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 msgr2=0x7f0ecc0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 0x7f0ecc0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 -- 172.21.15.49:0/4230458982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009a70 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed191a640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 0x7f0ecc1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed211b640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 0x7f0ecc0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed1119640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c430 tx=0x7f0ebc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0074e0 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc007660 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc004a20 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc15c1d0 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.760+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc1556f0 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.761+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc15c6f0 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.763+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ebc004b80 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.764+0000 7f0ec27fc640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 0x7f0eb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:46.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.764+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ebc0886b0 con 0x7f0ecc15e5a0 2023-12-19T05:40:46.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.764+0000 7f0ed191a640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 0x7f0eb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:46.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.765+0000 7f0ed191a640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 0x7f0eb006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006fd0 tx=0x7f0ec8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:46.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.768+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ecc15c6f0 con 0x7f0ecc15e5a0 2023-12-19T05:40:47.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:46.999+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ecc15c6f0 con 0x7f0ecc15e5a0 2023-12-19T05:40:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.001+0000 7f0ec27fc640 1 -- 172.21.15.49:0/4230458982 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f0ecc15c6f0 con 0x7f0ecc15e5a0 2023-12-19T05:40:47.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:47.002 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:40:20.211569+0000","modified":"2023-12-19T05:40:23.230140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6834/292473001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":292473001},{"type":"v1","addr":"172.21.15.49:6834","nonce":292473001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:40:47.003 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 msgr2=0x7f0eb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 0x7f0eb006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006fd0 tx=0x7f0ec8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 msgr2=0x7f0ecc0cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c430 tx=0x7f0ebc00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 shutdown_connections 2023-12-19T05:40:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0eb006a430 0x7f0eb006c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc15f680 0x7f0ecc0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ecc15e5a0 0x7f0ecc0cc730 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 --2- 172.21.15.49:0/4230458982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ecc0cdbf0 0x7f0ecc1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 >> 172.21.15.49:0/4230458982 conn(0x7f0ecc0b0100 msgr2=0x7f0ecc15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 shutdown_connections 2023-12-19T05:40:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.004+0000 7f0ed291c640 1 -- 172.21.15.49:0/4230458982 wait complete. 2023-12-19T05:40:47.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:47.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.247+0000 7f8b2e610640 1 Processor -- start 2023-12-19T05:40:47.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.247+0000 7f8b2e610640 1 -- start start 2023-12-19T05:40:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b2e610640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b2815d490 0x7f8b280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b2e610640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b280cf7c0 0x7f8b28161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b2e610640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280cfc20 con 0x7f8b28161850 2023-12-19T05:40:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b2e610640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b281620b0 con 0x7f8b2815d490 2023-12-19T05:40:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b2e610640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2806d900 con 0x7f8b280cf7c0 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b27fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b2815d490 0x7f8b280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b27fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b2815d490 0x7f8b280cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55752/0 (socket says 172.21.15.49:55752) 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b27fff640 1 -- 172.21.15.49:0/868127982 learned_addr learned my addr 172.21.15.49:0/868127982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.249+0000 7f8b277fe640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b280cf7c0 0x7f8b28161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.250+0000 7f8b27fff640 1 -- 172.21.15.49:0/868127982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b280cf7c0 msgr2=0x7f8b28161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.250+0000 7f8b27fff640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b280cf7c0 0x7f8b28161310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.250+0000 7f8b27fff640 1 -- 172.21.15.49:0/868127982 >> v1:172.21.15.115:6789/0 conn(0x7f8b28161850 legacy=0x7f8b280ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.250+0000 7f8b27fff640 1 -- 172.21.15.49:0/868127982 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2806dbe0 con 0x7f8b2815d490 2023-12-19T05:40:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.251+0000 7f8b27fff640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b2815d490 0x7f8b280cf280 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e50 tx=0x7f8b1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3621665bbd09656b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.251+0000 7f8b26ffd640 1 -- 172.21.15.49:0/868127982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1802ca70 con 0x7f8b2815d490 2023-12-19T05:40:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.251+0000 7f8b26ffd640 1 -- 172.21.15.49:0/868127982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1802cbd0 con 0x7f8b2815d490 2023-12-19T05:40:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.251+0000 7f8b26ffd640 1 -- 172.21.15.49:0/868127982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180343f0 con 0x7f8b2815d490 2023-12-19T05:40:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 -- 172.21.15.49:0/868127982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b2815d490 msgr2=0x7f8b280cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b2815d490 0x7f8b280cf280 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e50 tx=0x7f8b1802bed0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 -- 172.21.15.49:0/868127982 shutdown_connections 2023-12-19T05:40:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b280cf7c0 0x7f8b28161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 --2- 172.21.15.49:0/868127982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b2815d490 0x7f8b280cf280 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 -- 172.21.15.49:0/868127982 >> 172.21.15.49:0/868127982 conn(0x7f8b2806a2e0 msgr2=0x7f8b2806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 -- 172.21.15.49:0/868127982 shutdown_connections 2023-12-19T05:40:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.252+0000 7f8b2e610640 1 -- 172.21.15.49:0/868127982 wait complete. 2023-12-19T05:40:47.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.254+0000 7f8b2e610640 1 Processor -- start 2023-12-19T05:40:47.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.254+0000 7f8b2e610640 1 -- start start 2023-12-19T05:40:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b2815d490 0x7f8b280cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 0x7f8b280cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b6fe0 con 0x7f8b280cf7c0 2023-12-19T05:40:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b67d0 con 0x7f8b28161850 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.255+0000 7f8b2e610640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2815dd80 con 0x7f8b2815d490 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55760/0 (socket says 172.21.15.49:55760) 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 -- 172.21.15.49:0/454309137 learned_addr learned my addr 172.21.15.49:0/454309137 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b277fe640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b2815d490 0x7f8b280cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b2cbad640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 0x7f8b280cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 -- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b2815d490 msgr2=0x7f8b280cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b2815d490 0x7f8b280cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 -- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 msgr2=0x7f8b280cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 0x7f8b280cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 -- 172.21.15.49:0/454309137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18009b30 con 0x7f8b280cf7c0 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b2cbad640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 0x7f8b280cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.256+0000 7f8b27fff640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e50 tx=0x7f8b18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.257+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18009510 con 0x7f8b280cf7c0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.257+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1803e450 con 0x7f8b280cf7c0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.257+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2815c670 con 0x7f8b280cf7c0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.257+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1803e800 con 0x7f8b280cf7c0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.257+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280b6d00 con 0x7f8b280cf7c0 2023-12-19T05:40:47.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.258+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28061910 con 0x7f8b280cf7c0 2023-12-19T05:40:47.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.259+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b1803e960 con 0x7f8b280cf7c0 2023-12-19T05:40:47.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.260+0000 7f8b24ff9640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 0x7f8b0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.260+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b180ab6e0 con 0x7f8b280cf7c0 2023-12-19T05:40:47.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.261+0000 7f8b277fe640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 0x7f8b0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.262+0000 7f8b277fe640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 0x7f8b0806c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006fd0 tx=0x7f8b10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.264+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b18076cd0 con 0x7f8b280cf7c0 2023-12-19T05:40:47.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.464+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b280b31d0 con 0x7f8b280cf7c0 2023-12-19T05:40:47.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.468+0000 7f8b24ff9640 1 -- 172.21.15.49:0/454309137 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f8b1807a2f0 con 0x7f8b280cf7c0 2023-12-19T05:40:47.469 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:47.469 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:34.289981+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:40:17.931596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:40:19.260485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 msgr2=0x7f8b0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 0x7f8b0806c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006fd0 tx=0x7f8b10008040 comp rx=0 tx=0).stop 2023-12-19T05:40:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 msgr2=0x7f8b28155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e50 tx=0x7f8b18004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 shutdown_connections 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b0806a430 0x7f8b0806c8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b2815d490 0x7f8b280cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b28161850 0x7f8b280cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 --2- 172.21.15.49:0/454309137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b280cf7c0 0x7f8b28155000 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.470+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 >> 172.21.15.49:0/454309137 conn(0x7f8b2806a2e0 msgr2=0x7f8b28066290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.471+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 shutdown_connections 2023-12-19T05:40:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.471+0000 7f8b2e610640 1 -- 172.21.15.49:0/454309137 wait complete. 2023-12-19T05:40:47.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:40:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.721+0000 7f09e664c640 1 Processor -- start 2023-12-19T05:40:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.722+0000 7f09e664c640 1 -- start start 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.723+0000 7f09e664c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09e0161020 0x7f09e015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.723+0000 7f09e664c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0143230 0x7f09e0143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09e664c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e015df70 con 0x7f09e00b63c0 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09e664c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e015e1a0 con 0x7f09e0161020 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09e664c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e015e480 con 0x7f09e0143230 2023-12-19T05:40:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09dffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09e0161020 0x7f09e015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09dffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09e0161020 0x7f09e015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55768/0 (socket says 172.21.15.49:55768) 2023-12-19T05:40:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09dffff640 1 -- 172.21.15.49:0/3193846945 learned_addr learned my addr 172.21.15.49:0/3193846945 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.724+0000 7f09df7fe640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0143230 0x7f09e0143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.725+0000 7f09dffff640 1 -- 172.21.15.49:0/3193846945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0143230 msgr2=0x7f09e0143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.725+0000 7f09dffff640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0143230 0x7f09e0143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.725+0000 7f09dffff640 1 -- 172.21.15.49:0/3193846945 >> v1:172.21.15.49:6789/0 conn(0x7f09e00b63c0 legacy=0x7f09e00b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.725+0000 7f09dffff640 1 -- 172.21.15.49:0/3193846945 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e015e760 con 0x7f09e0161020 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.726+0000 7f09dffff640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0161020 0x7f09e015da30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009e50 tx=0x7f09d002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651164029d35e023 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.726+0000 7f09deffd640 1 -- 172.21.15.49:0/3193846945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d002cb00 con 0x7f09e0161020 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.726+0000 7f09deffd640 1 -- 172.21.15.49:0/3193846945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d002cc60 con 0x7f09e0161020 2023-12-19T05:40:47.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.726+0000 7f09deffd640 1 -- 172.21.15.49:0/3193846945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d00343f0 con 0x7f09e0161020 2023-12-19T05:40:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.726+0000 7f09e664c640 1 -- 172.21.15.49:0/3193846945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0161020 msgr2=0x7f09e015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0161020 0x7f09e015da30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009e50 tx=0x7f09d002bf60 comp rx=0 tx=0).stop 2023-12-19T05:40:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 -- 172.21.15.49:0/3193846945 shutdown_connections 2023-12-19T05:40:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0143230 0x7f09e0143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 --2- 172.21.15.49:0/3193846945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0161020 0x7f09e015da30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 -- 172.21.15.49:0/3193846945 >> 172.21.15.49:0/3193846945 conn(0x7f09e00b26f0 msgr2=0x7f09e00b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:47.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 -- 172.21.15.49:0/3193846945 shutdown_connections 2023-12-19T05:40:47.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.727+0000 7f09e664c640 1 -- 172.21.15.49:0/3193846945 wait complete. 2023-12-19T05:40:47.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.729+0000 7f09e664c640 1 Processor -- start 2023-12-19T05:40:47.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.729+0000 7f09e664c640 1 -- start start 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 0x7f09e013f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 0x7f09e014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0152960 con 0x7f09e0143230 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0155780 con 0x7f09e00b63c0 2023-12-19T05:40:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e664c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0155a60 con 0x7f09e0161020 2023-12-19T05:40:47.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55780/0 (socket says 172.21.15.49:55780) 2023-12-19T05:40:47.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09df7fe640 1 -- 172.21.15.49:0/1598816094 learned_addr learned my addr 172.21.15.49:0/1598816094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09dffff640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 0x7f09e013f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.730+0000 7f09e4be9640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 0x7f09e014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 -- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 msgr2=0x7f09e014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 0x7f09e014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 -- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 msgr2=0x7f09e013f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 0x7f09e013f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 -- 172.21.15.49:0/1598816094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009b30 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09dffff640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 0x7f09e013f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09e4be9640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 0x7f09e014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09df7fe640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f09c800d800 tx=0x7f09c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800b6c0 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800b820 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800bbb0 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e0152bb0 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.731+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e013f9f0 con 0x7f09e0143230 2023-12-19T05:40:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.732+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e0061910 con 0x7f09e0143230 2023-12-19T05:40:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.733+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09c800bd10 con 0x7f09e0143230 2023-12-19T05:40:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.734+0000 7f09dcff9640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 0x7f09c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.734+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09c8088eb0 con 0x7f09e0143230 2023-12-19T05:40:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.735+0000 7f09dffff640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 0x7f09c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.736+0000 7f09dffff640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 0x7f09c006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09d0035000 tx=0x7f09d0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:47.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.739+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09c8054410 con 0x7f09e0143230 2023-12-19T05:40:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.969+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09e00b2d20 con 0x7f09e0143230 2023-12-19T05:40:47.972 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:40:47.971+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:40:47.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.987+0000 7f09dcff9640 1 -- 172.21.15.49:0/1598816094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09c8057a30 con 0x7f09e0143230 2023-12-19T05:40:47.988 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:40:47.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.990+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 msgr2=0x7f09c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.990+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 0x7f09c006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09d0035000 tx=0x7f09d0030000 comp rx=0 tx=0).stop 2023-12-19T05:40:47.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.990+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 msgr2=0x7f09e0154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:47.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.990+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f09c800d800 tx=0x7f09c800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 shutdown_connections 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f09c006a430 0x7f09c006c8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09e0161020 0x7f09e014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e0143230 0x7f09e0154cc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 --2- 172.21.15.49:0/1598816094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e00b63c0 0x7f09e013f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 >> 172.21.15.49:0/1598816094 conn(0x7f09e00b26f0 msgr2=0x7f09e0157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 shutdown_connections 2023-12-19T05:40:47.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:47.991+0000 7f09e664c640 1 -- 172.21.15.49:0/1598816094 wait complete. 2023-12-19T05:40:48.002 INFO:tasks.ceph.mds.c.smithi049.stderr: -4986> 2023-12-19T05:40:21.677+0000 7f7a45efc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:40:48.021 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:40:48.070 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:40:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.223+0000 7f342bda4640 1 Processor -- start 2023-12-19T05:40:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.224+0000 7f342bda4640 1 -- start start 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.225+0000 7f342bda4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f342415efa0 0x7f342415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.225+0000 7f342bda4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240ce9d0 con 0x7f342415e7a0 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342bda4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240ce6f0 con 0x7f34240d01b0 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342bda4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342415dcc0 con 0x7f342415efa0 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342a341640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f342415efa0 0x7f342415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342a341640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f342415efa0 0x7f342415f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55816/0 (socket says 172.21.15.49:55816) 2023-12-19T05:40:48.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342a341640 1 -- 172.21.15.49:0/1117112362 learned_addr learned my addr 172.21.15.49:0/1117112362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342a341640 1 -- 172.21.15.49:0/1117112362 >> v1:172.21.15.115:6789/0 conn(0x7f34240d01b0 legacy=0x7f34240d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f342a341640 1 -- 172.21.15.49:0/1117112362 >> v1:172.21.15.49:6789/0 conn(0x7f342415e7a0 legacy=0x7f34240cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.226+0000 7f3428b3e640 1 -- 172.21.15.49:0/1117112362 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600484448 0 0) 0x7f34240ce9d0 con 0x7f342415e7a0 2023-12-19T05:40:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.227+0000 7f342a341640 1 -- 172.21.15.49:0/1117112362 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342415dfa0 con 0x7f342415efa0 2023-12-19T05:40:48.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.228+0000 7f342a341640 1 --2- 172.21.15.49:0/1117112362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f342415efa0 0x7f342415f3f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f341c009870 tx=0x7f341c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0d10c1555cab8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.228+0000 7f3428b3e640 1 -- 172.21.15.49:0/1117112362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c02f840 con 0x7f342415efa0 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.228+0000 7f3428b3e640 1 -- 172.21.15.49:0/1117112362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c02f9a0 con 0x7f342415efa0 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.228+0000 7f3428b3e640 1 -- 172.21.15.49:0/1117112362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c02fd30 con 0x7f342415efa0 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 -- 172.21.15.49:0/1117112362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f342415efa0 msgr2=0x7f342415f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 --2- 172.21.15.49:0/1117112362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f342415efa0 0x7f342415f3f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f341c009870 tx=0x7f341c02ba20 comp rx=0 tx=0).stop 2023-12-19T05:40:48.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 -- 172.21.15.49:0/1117112362 shutdown_connections 2023-12-19T05:40:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 --2- 172.21.15.49:0/1117112362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f342415efa0 0x7f342415f3f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 -- 172.21.15.49:0/1117112362 >> 172.21.15.49:0/1117112362 conn(0x7f34240b27a0 msgr2=0x7f34240b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 -- 172.21.15.49:0/1117112362 shutdown_connections 2023-12-19T05:40:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.229+0000 7f342bda4640 1 -- 172.21.15.49:0/1117112362 wait complete. 2023-12-19T05:40:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.231+0000 7f342bda4640 1 Processor -- start 2023-12-19T05:40:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.231+0000 7f342bda4640 1 -- start start 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342415e7a0 0x7f3424160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342415efa0 0x7f3424140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240b9100 con 0x7f34240d01b0 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34241528d0 con 0x7f342415e7a0 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f342bda4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34241549e0 con 0x7f342415efa0 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f3429b40640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f3429b40640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55832/0 (socket says 172.21.15.49:55832) 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.232+0000 7f3429b40640 1 -- 172.21.15.49:0/990976247 learned_addr learned my addr 172.21.15.49:0/990976247 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 -- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342415efa0 msgr2=0x7f3424140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342415efa0 0x7f3424140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 -- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342415e7a0 msgr2=0x7f3424160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342415e7a0 0x7f3424160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 -- 172.21.15.49:0/990976247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0094d0 con 0x7f34240d01b0 2023-12-19T05:40:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f3429b40640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f341800c870 tx=0x7f341800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418003b70 con 0x7f34240d01b0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418003cd0 con 0x7f34240d01b0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341800aa90 con 0x7f34240d01b0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.233+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3424154cc0 con 0x7f34240d01b0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.234+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3424155280 con 0x7f34240d01b0 2023-12-19T05:40:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.235+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34241554a0 con 0x7f34240d01b0 2023-12-19T05:40:48.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.236+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f341800abf0 con 0x7f34240d01b0 2023-12-19T05:40:48.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.237+0000 7f34227fc640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:48.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.237+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3418088830 con 0x7f34240d01b0 2023-12-19T05:40:48.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.237+0000 7f342933f640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:48.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.239+0000 7f342933f640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 0x7f340806c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f60 tx=0x7f3410007910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:48.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.241+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3418053db0 con 0x7f34240d01b0 2023-12-19T05:40:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.478+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3424061910 con 0x7f34240d01b0 2023-12-19T05:40:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.991+0000 7f34227fc640 1 -- 172.21.15.49:0/990976247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34180573d0 con 0x7f34240d01b0 2023-12-19T05:40:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.994+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 msgr2=0x7f340806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.994+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 0x7f340806c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f60 tx=0x7f3410007910 comp rx=0 tx=0).stop 2023-12-19T05:40:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 msgr2=0x7f34241521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f341800c870 tx=0x7f341800cd30 comp rx=0 tx=0).stop 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 shutdown_connections 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f340806a430 0x7f340806c8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342415efa0 0x7f3424140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342415e7a0 0x7f3424160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 --2- 172.21.15.49:0/990976247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240d01b0 0x7f34241521d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 >> 172.21.15.49:0/990976247 conn(0x7f34240b27a0 msgr2=0x7f34240b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 shutdown_connections 2023-12-19T05:40:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:48.995+0000 7f342bda4640 1 -- 172.21.15.49:0/990976247 wait complete. 2023-12-19T05:40:49.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:40:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.255+0000 7f0b6b59e640 1 Processor -- start 2023-12-19T05:40:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.255+0000 7f0b6b59e640 1 -- start start 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6b59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b6c15adf0 0x7f0b6c164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6b59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c06d340 con 0x7f0b6c06cf60 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6b59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c15b4a0 con 0x7f0b6c0cf100 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6b59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b2190 con 0x7f0b6c15adf0 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6a59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0b6c06cf60 0x7f0b6c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45472/0 (socket says 172.21.15.49:45472) 2023-12-19T05:40:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b6a59c640 1 -- 172.21.15.49:0/274476178 learned_addr learned my addr 172.21.15.49:0/274476178 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.257+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492888431 0 0) 0x7f0b6c06d340 con 0x7f0b6c06cf60 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b58005730 con 0x7f0b6c06cf60 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b6ad9d640 1 --2- 172.21.15.49:0/274476178 >> v2:172.21.15.115:3300/0 conn(0x7f0b6c15adf0 0x7f0b6c164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2466147805 0 0) 0x7f0b58005730 con 0x7f0b6c06cf60 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 >> v2:172.21.15.115:3300/0 conn(0x7f0b6c15adf0 msgr2=0x7f0b6c164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 --2- 172.21.15.49:0/274476178 >> v2:172.21.15.115:3300/0 conn(0x7f0b6c15adf0 0x7f0b6c164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 >> v1:172.21.15.115:6789/0 conn(0x7f0b6c0cf100 legacy=0x7f0b6c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0b25b0 con 0x7f0b6c06cf60 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0b5c001670 con 0x7f0b6c06cf60 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 >> v1:172.21.15.49:6789/0 conn(0x7f0b6c06cf60 legacy=0x7f0b6c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b58005bd0 0x7f0b58005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 0x7f0b58006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b58007390 0x7f0b5800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b2190 con 0x7f0b580069d0 2023-12-19T05:40:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5800e270 con 0x7f0b58005bd0 2023-12-19T05:40:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5800e430 con 0x7f0b58007390 2023-12-19T05:40:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.258+0000 7f0b63fff640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 0x7f0b58006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b6a59c640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b58005bd0 0x7f0b58005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b63fff640 1 -- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b58007390 msgr2=0x7f0b5800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b63fff640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b58007390 0x7f0b5800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b63fff640 1 -- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b58005bd0 msgr2=0x7f0b58005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b63fff640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b58005bd0 0x7f0b58005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b63fff640 1 -- 172.21.15.49:0/274476178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58005730 con 0x7f0b580069d0 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.259+0000 7f0b6ad9d640 1 -- 172.21.15.49:0/274476178 reap_dead start 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.260+0000 7f0b63fff640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 0x7f0b58006e50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001750 tx=0x7f0b58007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b776ced4d44cc0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.260+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540052d0 con 0x7f0b580069d0 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5402e050 con 0x7f0b580069d0 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b69d9b640 1 -- 172.21.15.49:0/274476178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003830 con 0x7f0b580069d0 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 -- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 msgr2=0x7f0b58006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 0x7f0b58006e50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001750 tx=0x7f0b58007a00 comp rx=0 tx=0).stop 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 -- 172.21.15.49:0/274476178 shutdown_connections 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/274476178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b580069d0 0x7f0b58006e50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 -- 172.21.15.49:0/274476178 >> 172.21.15.49:0/274476178 conn(0x7f0b6c0b4750 msgr2=0x7f0b6c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 -- 172.21.15.49:0/274476178 shutdown_connections 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.261+0000 7f0b6b59e640 1 -- 172.21.15.49:0/274476178 wait complete. 2023-12-19T05:40:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.263+0000 7f0b6b59e640 1 Processor -- start 2023-12-19T05:40:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.263+0000 7f0b6b59e640 1 -- start start 2023-12-19T05:40:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b580069d0 0x7f0b6c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14d7b0 0x7f0b6c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c153910 con 0x7f0b6c151e30 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c152350 con 0x7f0b6c14d7b0 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.264+0000 7f0b6b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c152610 con 0x7f0b580069d0 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55850/0 (socket says 172.21.15.49:55850) 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 -- 172.21.15.49:0/717424432 learned_addr learned my addr 172.21.15.49:0/717424432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b63fff640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14d7b0 0x7f0b6c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6a59c640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b580069d0 0x7f0b6c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 -- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b580069d0 msgr2=0x7f0b6c1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b580069d0 0x7f0b6c1533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 -- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14d7b0 msgr2=0x7f0b6c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14d7b0 0x7f0b6c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.265+0000 7f0b6ad9d640 1 -- 172.21.15.49:0/717424432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c1528f0 con 0x7f0b6c151e30 2023-12-19T05:40:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b6ad9d640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0cfd50 tx=0x7f0b6400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64010040 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400bb70 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64014400 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c152bd0 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.266+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c1576e0 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.267+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c061910 con 0x7f0b6c151e30 2023-12-19T05:40:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.268+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b64014560 con 0x7f0b6c151e30 2023-12-19T05:40:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.269+0000 7f0b62ffd640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 0x7f0b4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.269+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0b64088d50 con 0x7f0b6c151e30 2023-12-19T05:40:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.270+0000 7f0b6a59c640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 0x7f0b4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.271+0000 7f0b6a59c640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 0x7f0b4c06c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058b0 tx=0x7f0b5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.273+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0b64054240 con 0x7f0b6c151e30 2023-12-19T05:40:49.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:49.469+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b6c15d510 con 0x7f0b6c151e30 2023-12-19T05:40:50.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.391+0000 7f0b62ffd640 1 -- 172.21.15.49:0/717424432 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0b64057860 con 0x7f0b6c151e30 2023-12-19T05:40:50.393 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:40:50.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 msgr2=0x7f0b4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 0x7f0b4c06c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058b0 tx=0x7f0b5c009040 comp rx=0 tx=0).stop 2023-12-19T05:40:50.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 msgr2=0x7f0b6c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0cfd50 tx=0x7f0b6400ef30 comp rx=0 tx=0).stop 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 shutdown_connections 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b4c06a430 0x7f0b4c06c8f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b6c151e30 0x7f0b6c06b900 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14d7b0 0x7f0b6c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 --2- 172.21.15.49:0/717424432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b580069d0 0x7f0b6c1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 >> 172.21.15.49:0/717424432 conn(0x7f0b6c0b4750 msgr2=0x7f0b6c0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 shutdown_connections 2023-12-19T05:40:50.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.395+0000 7f0b6b59e640 1 -- 172.21.15.49:0/717424432 wait complete. 2023-12-19T05:40:50.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:40:50.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.656+0000 7ff46915c640 1 Processor -- start 2023-12-19T05:40:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.656+0000 7ff46915c640 1 -- start start 2023-12-19T05:40:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.658+0000 7ff46915c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4640ccb60 0x7ff4640aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.658+0000 7ff46915c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640b0770 con 0x7ff46406dea0 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.658+0000 7ff46915c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640b0490 con 0x7ff46406dac0 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.658+0000 7ff46915c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640afb60 con 0x7ff4640ccb60 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.658+0000 7ff46359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4640ccb60 0x7ff4640aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff453fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff46406dea0 0x7ff4641442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45474/0 (socket says 172.21.15.49:45474) 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff453fff640 1 -- 172.21.15.49:0/4238120286 learned_addr learned my addr 172.21.15.49:0/4238120286 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff46359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4640ccb60 0x7ff4640aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55866/0 (socket says 172.21.15.49:55866) 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff46359e640 1 -- 172.21.15.49:0/4238120286 >> v1:172.21.15.115:6789/0 conn(0x7ff46406dac0 legacy=0x7ff4640ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff46359e640 1 -- 172.21.15.49:0/4238120286 >> v1:172.21.15.49:6789/0 conn(0x7ff46406dea0 legacy=0x7ff4641442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.659+0000 7ff46359e640 1 -- 172.21.15.49:0/4238120286 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640afe40 con 0x7ff4640ccb60 2023-12-19T05:40:50.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.660+0000 7ff46359e640 1 --2- 172.21.15.49:0/4238120286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640ccb60 0x7ff4640aee40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097a0 tx=0x7ff45c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2218092c27d7977 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:50.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.661+0000 7ff46259c640 1 -- 172.21.15.49:0/4238120286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c030610 con 0x7ff4640ccb60 2023-12-19T05:40:50.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.661+0000 7ff46259c640 1 -- 172.21.15.49:0/4238120286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c030770 con 0x7ff4640ccb60 2023-12-19T05:40:50.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.661+0000 7ff46259c640 1 -- 172.21.15.49:0/4238120286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c030b00 con 0x7ff4640ccb60 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.661+0000 7ff46915c640 1 -- 172.21.15.49:0/4238120286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640ccb60 msgr2=0x7ff4640aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.661+0000 7ff46915c640 1 --2- 172.21.15.49:0/4238120286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640ccb60 0x7ff4640aee40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097a0 tx=0x7ff45c02b960 comp rx=0 tx=0).stop 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.662+0000 7ff46915c640 1 -- 172.21.15.49:0/4238120286 shutdown_connections 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.662+0000 7ff46915c640 1 --2- 172.21.15.49:0/4238120286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4640ccb60 0x7ff4640aee40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.662+0000 7ff46915c640 1 -- 172.21.15.49:0/4238120286 >> 172.21.15.49:0/4238120286 conn(0x7ff4640cf2f0 msgr2=0x7ff4640cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.662+0000 7ff46915c640 1 -- 172.21.15.49:0/4238120286 shutdown_connections 2023-12-19T05:40:50.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.662+0000 7ff46915c640 1 -- 172.21.15.49:0/4238120286 wait complete. 2023-12-19T05:40:50.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.663+0000 7ff46915c640 1 Processor -- start 2023-12-19T05:40:50.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.664+0000 7ff46915c640 1 -- start start 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 0x7ff464140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4640ccb60 0x7ff4640b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464141320 con 0x7ff46406dea0 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464158c60 con 0x7ff46406dac0 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46915c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640a95c0 con 0x7ff4640ccb60 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:50.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55880/0 (socket says 172.21.15.49:55880) 2023-12-19T05:40:50.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 -- 172.21.15.49:0/390659665 learned_addr learned my addr 172.21.15.49:0/390659665 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff462d9d640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 0x7ff464140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff46359e640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4640ccb60 0x7ff4640b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 -- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4640ccb60 msgr2=0x7ff4640b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4640ccb60 0x7ff4640b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 -- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 msgr2=0x7ff464140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 0x7ff464140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff453fff640 1 -- 172.21.15.49:0/390659665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009400 con 0x7ff46406dea0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.665+0000 7ff462d9d640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 0x7ff464140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff453fff640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c4a0 tx=0x7ff45800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458005ce0 con 0x7ff46406dea0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005e40 con 0x7ff46406dea0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458007270 con 0x7ff46406dea0 2023-12-19T05:40:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4640a98a0 con 0x7ff46406dea0 2023-12-19T05:40:50.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.666+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4640a9e60 con 0x7ff46406dea0 2023-12-19T05:40:50.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.667+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464074770 con 0x7ff46406dea0 2023-12-19T05:40:50.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.668+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff458007490 con 0x7ff46406dea0 2023-12-19T05:40:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.669+0000 7ff4537fe640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.669+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ff458087cd0 con 0x7ff46406dea0 2023-12-19T05:40:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.670+0000 7ff462d9d640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:50.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.671+0000 7ff462d9d640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff4540012e0 tx=0x7ff454009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.674+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff45808d020 con 0x7ff46406dea0 2023-12-19T05:40:50.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:50.866+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4640aa050 con 0x7ff46406dea0 2023-12-19T05:40:51.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.409+0000 7ff4537fe640 1 -- 172.21.15.49:0/390659665 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff4580170d0 con 0x7ff46406dea0 2023-12-19T05:40:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:40:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.414+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 msgr2=0x7ff44406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.414+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff4540012e0 tx=0x7ff454009040 comp rx=0 tx=0).stop 2023-12-19T05:40:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 msgr2=0x7ff4640ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c4a0 tx=0x7ff45800c960 comp rx=0 tx=0).stop 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 shutdown_connections 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff44406a430 0x7ff44406c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4640ccb60 0x7ff4640b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff46406dea0 0x7ff4640ae1d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 --2- 172.21.15.49:0/390659665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff46406dac0 0x7ff464140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 >> 172.21.15.49:0/390659665 conn(0x7ff4640cf2f0 msgr2=0x7ff4640cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 shutdown_connections 2023-12-19T05:40:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.415+0000 7ff46915c640 1 -- 172.21.15.49:0/390659665 wait complete. 2023-12-19T05:40:51.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:40:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.666+0000 7f5e7fe77640 1 Processor -- start 2023-12-19T05:40:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.667+0000 7f5e7fe77640 1 -- start start 2023-12-19T05:40:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7fe77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 0x7f5e780d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7fe77640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780d2d20 con 0x7f5e78146d60 2023-12-19T05:40:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7fe77640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780d3000 con 0x7f5e780d1c60 2023-12-19T05:40:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7fe77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780d20d0 con 0x7f5e7806f160 2023-12-19T05:40:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7dc13640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5e78146d60 0x7f5e780b6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45490/0 (socket says 172.21.15.49:45490) 2023-12-19T05:40:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.668+0000 7f5e7dc13640 1 -- 172.21.15.49:0/1056020099 learned_addr learned my addr 172.21.15.49:0/1056020099 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269946858 0 0) 0x7f5e780d2d20 con 0x7f5e78146d60 2023-12-19T05:40:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e68003520 con 0x7f5e78146d60 2023-12-19T05:40:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7d412640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 0x7f5e780d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085563982 0 0) 0x7f5e68003520 con 0x7f5e78146d60 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 msgr2=0x7f5e780d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 0x7f5e780d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 >> v1:172.21.15.115:6789/0 conn(0x7f5e780d1c60 legacy=0x7f5e7815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780b8c70 con 0x7f5e78146d60 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5e6c0019f0 con 0x7f5e78146d60 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 >> v1:172.21.15.49:6789/0 conn(0x7f5e78146d60 legacy=0x7f5e780b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e68003a10 0x7f5e68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 0x7f5e680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68004d70 0x7f5e680051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780d20d0 con 0x7f5e68003a10 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800bb90 con 0x7f5e68004d70 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.669+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800bd50 con 0x7f5e7806f160 2023-12-19T05:40:51.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e68003a10 0x7f5e68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7e414640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68004d70 0x7f5e680051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 -- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 msgr2=0x7f5e680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:51.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7806f160 0x7f5e680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 -- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68004d70 msgr2=0x7f5e680051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:51.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68004d70 0x7f5e680051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7dc13640 1 -- 172.21.15.49:0/1056020099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68003520 con 0x7f5e68003a10 2023-12-19T05:40:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.670+0000 7f5e7e414640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68004d70 0x7f5e680051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.671+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e68003a10 0x7f5e68003e30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c002230 tx=0x7f5e680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1d969de4a21ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c034630 con 0x7f5e68003a10 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c02f070 con 0x7f5e68003a10 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7cc11640 1 -- 172.21.15.49:0/1056020099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c034a10 con 0x7f5e68003a10 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1056020099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e68003a10 msgr2=0x7f5e68003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1056020099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e68003a10 0x7f5e68003e30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c002230 tx=0x7f5e680057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7e414640 1 -- 172.21.15.49:0/1056020099 reap_dead start 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1056020099 shutdown_connections 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1056020099 >> 172.21.15.49:0/1056020099 conn(0x7f5e780cfe10 msgr2=0x7f5e780d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.672+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1056020099 shutdown_connections 2023-12-19T05:40:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.673+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1056020099 wait complete. 2023-12-19T05:40:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.674+0000 7f5e7fe77640 1 Processor -- start 2023-12-19T05:40:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.674+0000 7f5e7fe77640 1 -- start start 2023-12-19T05:40:51.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 0x7f5e7815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7813c0d0 0x7f5e7813c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781405c0 con 0x7f5e7813b870 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7815fb20 con 0x7f5e68003a10 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.675+0000 7f5e7fe77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7815fdc0 con 0x7f5e7813c0d0 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55900/0 (socket says 172.21.15.49:55900) 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 -- 172.21.15.49:0/1370342057 learned_addr learned my addr 172.21.15.49:0/1370342057 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 0x7f5e7815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7e414640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7813c0d0 0x7f5e7813c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 -- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7813c0d0 msgr2=0x7f5e7813c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7813c0d0 0x7f5e7813c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 -- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 msgr2=0x7f5e7815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 0x7f5e7815f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7d412640 1 -- 172.21.15.49:0/1370342057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e781600a0 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.676+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 0x7f5e7815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e7d412640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400d800 tx=0x7f5e6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400b6c0 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6400b820 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400b9b0 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e78160380 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.677+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7813e790 con 0x7f5e7813b870 2023-12-19T05:40:51.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.678+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e78140730 con 0x7f5e7813b870 2023-12-19T05:40:51.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.679+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e6400bb10 con 0x7f5e7813b870 2023-12-19T05:40:51.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.680+0000 7f5e767fc640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 0x7f5e5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:51.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.680+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e64088710 con 0x7f5e7813b870 2023-12-19T05:40:51.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.681+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 0x7f5e5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:51.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.682+0000 7f5e7dc13640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 0x7f5e5c06c920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c034000 tx=0x7f5e6c02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:51.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.685+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e64054030 con 0x7f5e7813b870 2023-12-19T05:40:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.880+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e7813e790 con 0x7f5e7813b870 2023-12-19T05:40:51.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.889+0000 7f5e767fc640 1 -- 172.21.15.49:0/1370342057 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e7813e790 con 0x7f5e7813b870 2023-12-19T05:40:51.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.891+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 msgr2=0x7f5e5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.891+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 0x7f5e5c06c920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c034000 tx=0x7f5e6c02f000 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 msgr2=0x7f5e7813e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400d800 tx=0x7f5e6400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 shutdown_connections 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e5c06a460 0x7f5e5c06c920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e7813c0d0 0x7f5e7813c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e7813b870 0x7f5e7813e070 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 --2- 172.21.15.49:0/1370342057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e68003a10 0x7f5e7815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 >> 172.21.15.49:0/1370342057 conn(0x7f5e780cfe10 msgr2=0x7f5e780d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 shutdown_connections 2023-12-19T05:40:51.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:51.892+0000 7f5e7fe77640 1 -- 172.21.15.49:0/1370342057 wait complete. 2023-12-19T05:40:51.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-19T05:40:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.145+0000 7ff64bfff640 1 Processor -- start 2023-12-19T05:40:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.145+0000 7ff64bfff640 1 -- start start 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff64c06f870 0x7ff64c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64bfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0cc4e0 con 0x7ff64c15af40 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c15f190 con 0x7ff64c15ebd0 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64bfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c15f470 con 0x7ff64c06f870 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff64c15af40 0x7ff64c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45498/0 (socket says 172.21.15.49:45498) 2023-12-19T05:40:52.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.147+0000 7ff64affd640 1 -- 172.21.15.49:0/416564486 learned_addr learned my addr 172.21.15.49:0/416564486 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff64a7fc640 1 --2- 172.21.15.49:0/416564486 >> v2:172.21.15.115:3300/0 conn(0x7ff64c06f870 0x7ff64c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410577012 0 0) 0x7ff64c0cc4e0 con 0x7ff64c15af40 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff638003520 con 0x7ff64c15af40 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157212213 0 0) 0x7ff638003520 con 0x7ff64c15af40 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 >> v2:172.21.15.115:3300/0 conn(0x7ff64c06f870 msgr2=0x7ff64c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 --2- 172.21.15.49:0/416564486 >> v2:172.21.15.115:3300/0 conn(0x7ff64c06f870 0x7ff64c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 >> v1:172.21.15.115:6789/0 conn(0x7ff64c15ebd0 legacy=0x7ff64c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c15f750 con 0x7ff64c15af40 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff63c001a10 con 0x7ff64c15af40 2023-12-19T05:40:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 >> v1:172.21.15.49:6789/0 conn(0x7ff64c15af40 legacy=0x7ff64c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 0x7ff638003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6380047c0 0x7ff638004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.148+0000 7ff649ffb640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff638005180 0x7ff63800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c15f470 con 0x7ff638003970 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63800c020 con 0x7ff638005180 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63800c1e0 con 0x7ff6380047c0 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 0x7ff638003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64a7fc640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6380047c0 0x7ff638004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 -- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6380047c0 msgr2=0x7ff638004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6380047c0 0x7ff638004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 -- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff638005180 msgr2=0x7ff63800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff638005180 0x7ff63800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64affd640 1 -- 172.21.15.49:0/416564486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638003520 con 0x7ff638003970 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64b7fe640 1 -- 172.21.15.49:0/416564486 reap_dead start 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.149+0000 7ff64a7fc640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6380047c0 0x7ff638004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.150+0000 7ff64affd640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 0x7ff638003d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff64c15f0c0 tx=0x7ff6380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a605e579022ba8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.150+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c034630 con 0x7ff638003970 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c02f070 con 0x7ff638003970 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff649ffb640 1 -- 172.21.15.49:0/416564486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c034a30 con 0x7ff638003970 2023-12-19T05:40:52.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 -- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 msgr2=0x7ff638003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 0x7ff638003d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff64c15f0c0 tx=0x7ff6380057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 -- 172.21.15.49:0/416564486 shutdown_connections 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 --2- 172.21.15.49:0/416564486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff638003970 0x7ff638003d90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 -- 172.21.15.49:0/416564486 >> 172.21.15.49:0/416564486 conn(0x7ff64c0b25e0 msgr2=0x7ff64c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 -- 172.21.15.49:0/416564486 shutdown_connections 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.151+0000 7ff64bfff640 1 -- 172.21.15.49:0/416564486 wait complete. 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.153+0000 7ff64bfff640 1 Processor -- start 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.153+0000 7ff64bfff640 1 -- start start 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff638003970 0x7ff64c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff64c141840 0x7ff64c06d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1429a0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c141d20 con 0x7ff64c141840 2023-12-19T05:40:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.154+0000 7ff64bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c142000 con 0x7ff638003970 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55930/0 (socket says 172.21.15.49:55930) 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 -- 172.21.15.49:0/4087591440 learned_addr learned my addr 172.21.15.49:0/4087591440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64affd640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff638003970 0x7ff64c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64a7fc640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff64c141840 0x7ff64c06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 -- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff638003970 msgr2=0x7ff64c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff638003970 0x7ff64c15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 -- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff64c141840 msgr2=0x7ff64c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff64c141840 0x7ff64c06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 -- 172.21.15.49:0/4087591440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c1422e0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.155+0000 7ff64b7fe640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0cd270 tx=0x7ff64400c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.156+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440072d0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.156+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644007430 con 0x7ff64c1f28d0 2023-12-19T05:40:52.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.156+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440057c0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.156+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c1425c0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.156+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c15e920 con 0x7ff64c1f28d0 2023-12-19T05:40:52.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.157+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c061910 con 0x7ff64c1f28d0 2023-12-19T05:40:52.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.158+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff644005920 con 0x7ff64c1f28d0 2023-12-19T05:40:52.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.159+0000 7ff6437fe640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 0x7ff62c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:52.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.159+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6440877e0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.160+0000 7ff64affd640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 0x7ff62c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:52.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.161+0000 7ff64affd640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 0x7ff62c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff63c034000 tx=0x7ff63c02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:52.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.164+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6440530c0 con 0x7ff64c1f28d0 2023-12-19T05:40:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:52.435+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7ff64c0b08e0 con 0x7ff64c1f28d0 2023-12-19T05:40:53.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.410+0000 7ff6437fe640 1 -- 172.21.15.49:0/4087591440 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v116) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff6440566e0 con 0x7ff64c1f28d0 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 msgr2=0x7ff62c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 0x7ff62c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff63c034000 tx=0x7ff63c02f000 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 msgr2=0x7ff64c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0cd270 tx=0x7ff64400c5f0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 shutdown_connections 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff62c06a430 0x7ff62c06c8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff64c1f28d0 0x7ff64c06d9b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff64c141840 0x7ff64c06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 --2- 172.21.15.49:0/4087591440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff638003970 0x7ff64c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 >> 172.21.15.49:0/4087591440 conn(0x7ff64c0b25e0 msgr2=0x7ff64c0b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 shutdown_connections 2023-12-19T05:40:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.414+0000 7ff64bfff640 1 -- 172.21.15.49:0/4087591440 wait complete. 2023-12-19T05:40:53.438 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-19T05:40:53.439 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T05:40:53.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:53.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.668+0000 7fa402949640 1 Processor -- start 2023-12-19T05:40:53.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.669+0000 7fa402949640 1 -- start start 2023-12-19T05:40:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.670+0000 7fa402949640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3fc15d620 0x7fa3fc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.670+0000 7fa402949640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc0b6ca0 con 0x7fa3fc0b6870 2023-12-19T05:40:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa402949640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc0b4120 con 0x7fa3fc15da00 2023-12-19T05:40:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa402949640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b6ee0 con 0x7fa3fc15d620 2023-12-19T05:40:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa402148640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3fc0b6870 0x7fa3fc0b4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45504/0 (socket says 172.21.15.49:45504) 2023-12-19T05:40:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa402148640 1 -- 172.21.15.49:0/4156247075 learned_addr learned my addr 172.21.15.49:0/4156247075 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa401947640 1 --2- 172.21.15.49:0/4156247075 >> v2:172.21.15.115:3300/0 conn(0x7fa3fc15d620 0x7fa3fc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.671+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071431918 0 0) 0x7fa3f4001490 con 0x7fa3fc0b6870 2023-12-19T05:40:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e8003520 con 0x7fa3fc0b6870 2023-12-19T05:40:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614012033 0 0) 0x7fa3e8003520 con 0x7fa3fc0b6870 2023-12-19T05:40:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 >> v2:172.21.15.115:3300/0 conn(0x7fa3fc15d620 msgr2=0x7fa3fc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 --2- 172.21.15.49:0/4156247075 >> v2:172.21.15.115:3300/0 conn(0x7fa3fc15d620 0x7fa3fc0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 >> v1:172.21.15.115:6789/0 conn(0x7fa3fc15da00 legacy=0x7fa3fc0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0b71c0 con 0x7fa3fc0b6870 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa3f4001b80 con 0x7fa3fc0b6870 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 >> v1:172.21.15.49:6789/0 conn(0x7fa3fc0b6870 legacy=0x7fa3fc0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e80047c0 0x7fa3e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e8005180 0x7fa3e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b6ee0 con 0x7fa3e80039c0 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e800c060 con 0x7fa3e80047c0 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e800c220 con 0x7fa3e8005180 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.672+0000 7fa401947640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa401947640 1 -- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e8005180 msgr2=0x7fa3e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa401947640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e8005180 0x7fa3e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa401947640 1 -- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e80047c0 msgr2=0x7fa3e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa401947640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e80047c0 0x7fa3e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa401947640 1 -- 172.21.15.49:0/4156247075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8003520 con 0x7fa3e80039c0 2023-12-19T05:40:53.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.673+0000 7fa402148640 1 -- 172.21.15.49:0/4156247075 reap_dead start 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.674+0000 7fa401947640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003de0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009ac0 tx=0x7fa3e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edaf00a1422067 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.674+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f802c6b0 con 0x7fa3e80039c0 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.674+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f802c810 con 0x7fa3e80039c0 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.674+0000 7fa400945640 1 -- 172.21.15.49:0/4156247075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f802cba0 con 0x7fa3e80039c0 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 -- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 msgr2=0x7fa3e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003de0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009ac0 tx=0x7fa3e80057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 -- 172.21.15.49:0/4156247075 shutdown_connections 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 --2- 172.21.15.49:0/4156247075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003de0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 -- 172.21.15.49:0/4156247075 >> 172.21.15.49:0/4156247075 conn(0x7fa3fc0cfb90 msgr2=0x7fa3fc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 -- 172.21.15.49:0/4156247075 shutdown_connections 2023-12-19T05:40:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.675+0000 7fa402949640 1 -- 172.21.15.49:0/4156247075 wait complete. 2023-12-19T05:40:53.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.677+0000 7fa402949640 1 Processor -- start 2023-12-19T05:40:53.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.677+0000 7fa402949640 1 -- start start 2023-12-19T05:40:53.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e80039c0 0x7fa3fc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 0x7fa3fc15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc154630 con 0x7fa3fc1603d0 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc1574a0 con 0x7fa3fc140c50 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402949640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc15fa00 con 0x7fa3e80039c0 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402148640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402148640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55950/0 (socket says 172.21.15.49:55950) 2023-12-19T05:40:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.678+0000 7fa402148640 1 -- 172.21.15.49:0/2587971503 learned_addr learned my addr 172.21.15.49:0/2587971503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa401146640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 0x7fa3fc15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 -- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e80039c0 msgr2=0x7fa3fc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa401947640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e80039c0 0x7fa3fc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e80039c0 0x7fa3fc1540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 -- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 msgr2=0x7fa3fc15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 0x7fa3fc15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 -- 172.21.15.49:0/2587971503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc154820 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa401146640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 0x7fa3fc15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402148640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc072470 tx=0x7fa3f400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400cec0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400a5b0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.679+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc156ee0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.680+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400a960 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.680+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc140850 con 0x7fa3fc1603d0 2023-12-19T05:40:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.681+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc061910 con 0x7fa3fc1603d0 2023-12-19T05:40:53.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.682+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3f400aac0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.683+0000 7fa3f27fc640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 0x7fa3e006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:53.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.683+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa3f40882d0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.684+0000 7fa401947640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 0x7fa3e006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.685+0000 7fa401947640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 0x7fa3e006c940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8036000 tx=0x7fa3f8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:53.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.687+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3f4057730 con 0x7fa3fc1603d0 2023-12-19T05:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.882+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3fc0b6ca0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.884+0000 7fa3f27fc640 1 -- 172.21.15.49:0/2587971503 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12516 (secure 0 0 0) 0x7fa3fc0b6ca0 con 0x7fa3fc1603d0 2023-12-19T05:40:53.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:53.885 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:51.387985+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/292473001":"2023-12-20T05:40:47.970898+0000","172.21.15.49:6832/292473001":"2023-12-20T05:40:47.970898+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 msgr2=0x7fa3e006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 0x7fa3e006c940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8036000 tx=0x7fa3f8030000 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 msgr2=0x7fa3fc142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc072470 tx=0x7fa3f400ccd0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 shutdown_connections 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3e006a480 0x7fa3e006c940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc142ca0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3fc140c50 0x7fa3fc15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 --2- 172.21.15.49:0/2587971503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e80039c0 0x7fa3fc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 >> 172.21.15.49:0/2587971503 conn(0x7fa3fc0cfb90 msgr2=0x7fa3fc0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.886+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 shutdown_connections 2023-12-19T05:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:53.887+0000 7fa402949640 1 -- 172.21.15.49:0/2587971503 wait complete. 2023-12-19T05:40:53.908 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:53.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.142+0000 7f50c254c640 1 Processor -- start 2023-12-19T05:40:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.143+0000 7f50c254c640 1 -- start start 2023-12-19T05:40:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c254c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50bc0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c254c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f50bc06fba0 0x7f50bc0d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c254c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc070260 con 0x7f50bc0b6890 2023-12-19T05:40:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c254c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc1470b0 con 0x7f50bc06fba0 2023-12-19T05:40:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c254c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b6ea0 con 0x7f50bc146cd0 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c0d49640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f50bc0b6890 0x7f50bc06f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48876/0 (socket says 172.21.15.49:48876) 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c0d49640 1 -- 172.21.15.49:0/3144381706 learned_addr learned my addr 172.21.15.49:0/3144381706 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c1d4b640 1 --2- 172.21.15.49:0/3144381706 >> v2:172.21.15.115:3300/0 conn(0x7f50bc06fba0 0x7f50bc0d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.145+0000 7f50c154a640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50bc0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672771606 0 0) 0x7f50bc070260 con 0x7f50bc0b6890 2023-12-19T05:40:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a8003520 con 0x7f50bc0b6890 2023-12-19T05:40:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293235716 0 0) 0x7f50a8003520 con 0x7f50bc0b6890 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 msgr2=0x7f50bc0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50bc0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 >> v2:172.21.15.115:3300/0 conn(0x7f50bc06fba0 msgr2=0x7f50bc0d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 --2- 172.21.15.49:0/3144381706 >> v2:172.21.15.115:3300/0 conn(0x7f50bc06fba0 0x7f50bc0d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0b7180 con 0x7f50bc0b6890 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f50ac001670 con 0x7f50bc0b6890 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 >> v1:172.21.15.49:6789/0 conn(0x7f50bc0b6890 legacy=0x7f50bc06f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a8003ef0 0x7f50a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8004d00 0x7f50a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1470b0 con 0x7f50a8003ef0 2023-12-19T05:40:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b6ea0 con 0x7f50a8004d00 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.146+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a800b9d0 con 0x7f50bc146cd0 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a8003ef0 0x7f50a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c154a640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c1d4b640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8004d00 0x7f50a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 -- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 msgr2=0x7f50a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc146cd0 0x7f50a8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 -- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8004d00 msgr2=0x7f50a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8004d00 0x7f50a8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.147+0000 7f50c0d49640 1 -- 172.21.15.49:0/3144381706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0b7180 con 0x7f50a8003ef0 2023-12-19T05:40:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.148+0000 7f50c0d49640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a8003ef0 0x7f50a80047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c240 tx=0x7f50a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4838f58c08d666 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac005ad0 con 0x7f50a8003ef0 2023-12-19T05:40:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac005c50 con 0x7f50a8003ef0 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50b3fff640 1 -- 172.21.15.49:0/3144381706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac02c8d0 con 0x7f50a8003ef0 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c254c640 1 -- 172.21.15.49:0/3144381706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a8003ef0 msgr2=0x7f50a80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c254c640 1 --2- 172.21.15.49:0/3144381706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a8003ef0 0x7f50a80047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c240 tx=0x7f50a80057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c1d4b640 1 -- 172.21.15.49:0/3144381706 reap_dead start 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c254c640 1 -- 172.21.15.49:0/3144381706 shutdown_connections 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c254c640 1 -- 172.21.15.49:0/3144381706 >> 172.21.15.49:0/3144381706 conn(0x7f50bc0d3200 msgr2=0x7f50bc0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.149+0000 7f50c254c640 1 -- 172.21.15.49:0/3144381706 shutdown_connections 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.150+0000 7f50c254c640 1 -- 172.21.15.49:0/3144381706 wait complete. 2023-12-19T05:40:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.151+0000 7f50c254c640 1 Processor -- start 2023-12-19T05:40:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.152+0000 7f50c254c640 1 -- start start 2023-12-19T05:40:54.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8003ef0 0x7f50bc0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc0c8c80 0x7f50bc1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc150b40 con 0x7f50bc14fbd0 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc150580 con 0x7f50a8003ef0 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c254c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc150860 con 0x7f50bc0c8c80 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c1d4b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c1d4b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44468/0 (socket says 172.21.15.49:44468) 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c1d4b640 1 -- 172.21.15.49:0/3768060076 learned_addr learned my addr 172.21.15.49:0/3768060076 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c154a640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8003ef0 0x7f50bc0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c1d4b640 1 -- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc0c8c80 msgr2=0x7f50bc1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.153+0000 7f50c1d4b640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc0c8c80 0x7f50bc1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c1d4b640 1 -- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8003ef0 msgr2=0x7f50bc0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c1d4b640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8003ef0 0x7f50bc0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c1d4b640 1 -- 172.21.15.49:0/3768060076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc142ab0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c1d4b640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b80e0 tx=0x7f50b400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4017400 con 0x7f50bc14fbd0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4011040 con 0x7f50bc14fbd0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc142d90 con 0x7f50bc14fbd0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40177c0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.154+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc150050 con 0x7f50bc14fbd0 2023-12-19T05:40:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.155+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc1502d0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.156+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f50b4017920 con 0x7f50bc14fbd0 2023-12-19T05:40:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.157+0000 7f50b1ffb640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 0x7f50a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.157+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50b4088bf0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.158+0000 7f50c154a640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 0x7f50a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.160+0000 7f50c154a640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 0x7f50a006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009a20 tx=0x7f50b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.162+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f50b40544d0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.362+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50bc061910 con 0x7f50bc14fbd0 2023-12-19T05:40:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.363+0000 7f50b1ffb640 1 -- 172.21.15.49:0/3768060076 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50b4057af0 con 0x7f50bc14fbd0 2023-12-19T05:40:54.364 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 msgr2=0x7f50a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 0x7f50a006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009a20 tx=0x7f50b8008040 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 msgr2=0x7f50bc0b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b80e0 tx=0x7f50b400f4a0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 shutdown_connections 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50a006a430 0x7f50a006c8f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc0c8c80 0x7f50bc1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50bc14fbd0 0x7f50bc0b43e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 --2- 172.21.15.49:0/3768060076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50a8003ef0 0x7f50bc0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.365+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 >> 172.21.15.49:0/3768060076 conn(0x7f50bc0d3200 msgr2=0x7f50bc0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:54.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.366+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 shutdown_connections 2023-12-19T05:40:54.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.366+0000 7f50c254c640 1 -- 172.21.15.49:0/3768060076 wait complete. 2023-12-19T05:40:54.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-19T05:40:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.616+0000 7f7f2e1ae640 1 Processor -- start 2023-12-19T05:40:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.616+0000 7f7f2e1ae640 1 -- start start 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2e1ae640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f2815e5a0 0x7f7f280b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2e1ae640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815ec30 con 0x7f7f280cdbf0 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2e1ae640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815e980 con 0x7f7f2815f680 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2e1ae640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280b2f90 con 0x7f7f2815e5a0 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2d1ac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f2815e5a0 0x7f7f280b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2d1ac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f2815e5a0 0x7f7f280b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44476/0 (socket says 172.21.15.49:44476) 2023-12-19T05:40:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2d1ac640 1 -- 172.21.15.49:0/2249369661 learned_addr learned my addr 172.21.15.49:0/2249369661 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.618+0000 7f7f2d1ac640 1 -- 172.21.15.49:0/2249369661 >> v1:172.21.15.115:6789/0 conn(0x7f7f2815f680 legacy=0x7f7f280b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.619+0000 7f7f2d1ac640 1 -- 172.21.15.49:0/2249369661 >> v1:172.21.15.49:6789/0 conn(0x7f7f280cdbf0 legacy=0x7f7f2806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.619+0000 7f7f2d1ac640 1 -- 172.21.15.49:0/2249369661 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280b3270 con 0x7f7f2815e5a0 2023-12-19T05:40:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.620+0000 7f7f2d1ac640 1 --2- 172.21.15.49:0/2249369661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280b2030 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7f240098a0 tx=0x7f7f2402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddac7c9157b439e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.620+0000 7f7f1ffff640 1 -- 172.21.15.49:0/2249369661 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24030840 con 0x7f7f2815e5a0 2023-12-19T05:40:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.620+0000 7f7f1ffff640 1 -- 172.21.15.49:0/2249369661 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240309a0 con 0x7f7f2815e5a0 2023-12-19T05:40:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.620+0000 7f7f1ffff640 1 -- 172.21.15.49:0/2249369661 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24030d30 con 0x7f7f2815e5a0 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/2249369661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 msgr2=0x7f7f280b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/2249369661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280b2030 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7f240098a0 tx=0x7f7f2402b980 comp rx=0 tx=0).stop 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/2249369661 shutdown_connections 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/2249369661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280b2030 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/2249369661 >> 172.21.15.49:0/2249369661 conn(0x7f7f280b0100 msgr2=0x7f7f280b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/2249369661 shutdown_connections 2023-12-19T05:40:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.621+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/2249369661 wait complete. 2023-12-19T05:40:54.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.623+0000 7f7f2e1ae640 1 Processor -- start 2023-12-19T05:40:54.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.623+0000 7f7f2e1ae640 1 -- start start 2023-12-19T05:40:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f280cdbf0 0x7f7f2814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f2815f680 0x7f7f2806c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281f6660 con 0x7f7f2815e5a0 2023-12-19T05:40:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281f3090 con 0x7f7f280cdbf0 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2e1ae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28156010 con 0x7f7f2815f680 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.624+0000 7f7f2c9ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44484/0 (socket says 172.21.15.49:44484) 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 -- 172.21.15.49:0/1888893216 learned_addr learned my addr 172.21.15.49:0/1888893216 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2d1ac640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f280cdbf0 0x7f7f2814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2d9ad640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f2815f680 0x7f7f2806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 -- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f2815f680 msgr2=0x7f7f2806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f2815f680 0x7f7f2806c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 -- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f280cdbf0 msgr2=0x7f7f2814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f280cdbf0 0x7f7f2814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 -- 172.21.15.49:0/1888893216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240094d0 con 0x7f7f2815e5a0 2023-12-19T05:40:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.625+0000 7f7f2c9ab640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b3e0 tx=0x7f7f1800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.626+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011830 con 0x7f7f2815e5a0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.626+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180119b0 con 0x7f7f2815e5a0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.626+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011d60 con 0x7f7f2815e5a0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.626+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2814e150 con 0x7f7f2815e5a0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.626+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f281f6b50 con 0x7f7f2815e5a0 2023-12-19T05:40:54.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.627+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f28061910 con 0x7f7f2815e5a0 2023-12-19T05:40:54.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.628+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f1801a400 con 0x7f7f2815e5a0 2023-12-19T05:40:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.629+0000 7f7f1dffb640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 0x7f7f0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.629+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f180887e0 con 0x7f7f2815e5a0 2023-12-19T05:40:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.630+0000 7f7f2d1ac640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 0x7f7f0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.631+0000 7f7f2d1ac640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 0x7f7f0c06c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f24036000 tx=0x7f7f24008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:54.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.634+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f18054030 con 0x7f7f2815e5a0 2023-12-19T05:40:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:54.897+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f7f280ce980 con 0x7f7f2815e5a0 2023-12-19T05:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.421+0000 7f7f1dffb640 1 -- 172.21.15.49:0/1888893216 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v118) v1 ==== 145+0+0 (secure 0 0 0) 0x7f7f180150d0 con 0x7f7f2815e5a0 2023-12-19T05:40:55.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 msgr2=0x7f7f0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 0x7f7f0c06c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f24036000 tx=0x7f7f24008030 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 msgr2=0x7f7f280cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b3e0 tx=0x7f7f1800b8a0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 shutdown_connections 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7f0c06a430 0x7f7f0c06c8f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f2815f680 0x7f7f2806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f2815e5a0 0x7f7f280cd240 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 --2- 172.21.15.49:0/1888893216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f280cdbf0 0x7f7f2814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 >> 172.21.15.49:0/1888893216 conn(0x7f7f280b0100 msgr2=0x7f7f2806d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 shutdown_connections 2023-12-19T05:40:55.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.425+0000 7f7f2e1ae640 1 -- 172.21.15.49:0/1888893216 wait complete. 2023-12-19T05:40:55.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T05:40:55.691 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_objectstore":"memstore"} 2023-12-19T05:40:55.691 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T05:40:55.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:40:55.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:55.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.925+0000 7f32ac99b640 1 Processor -- start 2023-12-19T05:40:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.925+0000 7f32ac99b640 1 -- start start 2023-12-19T05:40:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.927+0000 7f32ac99b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32a815ae50 0x7f32a815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.927+0000 7f32ac99b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a80b2710 0x7f32a80ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.927+0000 7f32ac99b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a80cd020 con 0x7f32a80ce750 2023-12-19T05:40:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.927+0000 7f32ac99b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a80cca30 con 0x7f32a815ae50 2023-12-19T05:40:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.927+0000 7f32ac99b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b2f20 con 0x7f32a80b2710 2023-12-19T05:40:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.928+0000 7f32a77fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32a815ae50 0x7f32a815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.928+0000 7f32a7fff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f32a80ce750 0x7f32a80cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:53452/0 (socket says 172.21.15.49:53452) 2023-12-19T05:40:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.928+0000 7f32a7fff640 1 -- 172.21.15.49:0/1449514264 learned_addr learned my addr 172.21.15.49:0/1449514264 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.928+0000 7f32a6ffd640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a80b2710 0x7f32a80ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.929+0000 7f32a77fe640 1 -- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a80b2710 msgr2=0x7f32a80ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.929+0000 7f32a77fe640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a80b2710 0x7f32a80ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.929+0000 7f32a77fe640 1 -- 172.21.15.49:0/1449514264 >> v1:172.21.15.115:6789/0 conn(0x7f32a80ce750 legacy=0x7f32a80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.929+0000 7f32a77fe640 1 -- 172.21.15.49:0/1449514264 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80b3200 con 0x7f32a815ae50 2023-12-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.930+0000 7f32a77fe640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a815ae50 0x7f32a815e460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32980097a0 tx=0x7f329802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6865c8fc4346c02c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.931+0000 7f32a67fc640 1 -- 172.21.15.49:0/1449514264 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329802d040 con 0x7f32a815ae50 2023-12-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.931+0000 7f32a67fc640 1 -- 172.21.15.49:0/1449514264 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298031810 con 0x7f32a815ae50 2023-12-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.931+0000 7f32a67fc640 1 -- 172.21.15.49:0/1449514264 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298031ba0 con 0x7f32a815ae50 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 -- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a815ae50 msgr2=0x7f32a815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a815ae50 0x7f32a815e460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32980097a0 tx=0x7f329802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 -- 172.21.15.49:0/1449514264 shutdown_connections 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a80b2710 0x7f32a80ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 --2- 172.21.15.49:0/1449514264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a815ae50 0x7f32a815e460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 -- 172.21.15.49:0/1449514264 >> 172.21.15.49:0/1449514264 conn(0x7f32a806f630 msgr2=0x7f32a806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 -- 172.21.15.49:0/1449514264 shutdown_connections 2023-12-19T05:40:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.932+0000 7f32ac99b640 1 -- 172.21.15.49:0/1449514264 wait complete. 2023-12-19T05:40:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.934+0000 7f32ac99b640 1 Processor -- start 2023-12-19T05:40:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.935+0000 7f32ac99b640 1 -- start start 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 0x7f32a806b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a815ae50 0x7f32a80adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a8157240 con 0x7f32a80b2710 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806c610 con 0x7f32a80ce750 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32ac99b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806b760 con 0x7f32a815ae50 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44498/0 (socket says 172.21.15.49:44498) 2023-12-19T05:40:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32a77fe640 1 -- 172.21.15.49:0/352955931 learned_addr learned my addr 172.21.15.49:0/352955931 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.936+0000 7f32a6ffd640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 0x7f32a806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a7fff640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a815ae50 0x7f32a80adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 -- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a815ae50 msgr2=0x7f32a80adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a815ae50 0x7f32a80adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 -- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 msgr2=0x7f32a806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 0x7f32a806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 -- 172.21.15.49:0/352955931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298009400 con 0x7f32a80b2710 2023-12-19T05:40:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a6ffd640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 0x7f32a806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.937+0000 7f32a77fe640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f329802b8f0 tx=0x7f32980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.938+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298006e10 con 0x7f32a80b2710 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.938+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329803ad60 con 0x7f32a80b2710 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.938+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298044630 con 0x7f32a80b2710 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.938+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a806ba00 con 0x7f32a80b2710 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.938+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a806bfc0 con 0x7f32a80b2710 2023-12-19T05:40:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.939+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8061910 con 0x7f32a80b2710 2023-12-19T05:40:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.940+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f329804d450 con 0x7f32a80b2710 2023-12-19T05:40:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.941+0000 7f328ffff640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 0x7f329406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.941+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f32980aa7d0 con 0x7f32a80b2710 2023-12-19T05:40:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.942+0000 7f32a6ffd640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 0x7f329406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.943+0000 7f32a6ffd640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 0x7f329406c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32a806e410 tx=0x7f329c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:55.946+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3298076150 con 0x7f32a80b2710 2023-12-19T05:40:56.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.139+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f32a815e5d0 con 0x7f32a80b2710 2023-12-19T05:40:56.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.147+0000 7f328ffff640 1 -- 172.21.15.49:0/352955931 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3298035020 con 0x7f32a80b2710 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 msgr2=0x7f329406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 0x7f329406c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32a806e410 tx=0x7f329c008040 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 msgr2=0x7f32a80b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f329802b8f0 tx=0x7f32980046c0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 shutdown_connections 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f329406a460 0x7f329406c920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32a815ae50 0x7f32a80adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32a80ce750 0x7f32a806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 --2- 172.21.15.49:0/352955931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a80b2710 0x7f32a80b05a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 >> 172.21.15.49:0/352955931 conn(0x7f32a806f630 msgr2=0x7f32a815b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 shutdown_connections 2023-12-19T05:40:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.150+0000 7f32ac99b640 1 -- 172.21.15.49:0/352955931 wait complete. 2023-12-19T05:40:56.171 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:40:56.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:40:56.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:40:56.469 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:40:56.469 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:56.469 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:56.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:40:56.534 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:56.535 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:56.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:40:56.592 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:40:56.592 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:56.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:40:56.656 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:40:56.656 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:40:56.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:40:56.716 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:40:56.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:40:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.955+0000 7f6d8eba9640 1 Processor -- start 2023-12-19T05:40:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.955+0000 7f6d8eba9640 1 -- start start 2023-12-19T05:40:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.957+0000 7f6d8eba9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d8815e5a0 0x7f6d880b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.957+0000 7f6d8eba9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d880cdbf0 0x7f6d880ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.957+0000 7f6d8eba9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8815ec30 con 0x7f6d8815f680 2023-12-19T05:40:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.957+0000 7f6d8eba9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880ce5a0 con 0x7f6d8815e5a0 2023-12-19T05:40:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.957+0000 7f6d8eba9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815e980 con 0x7f6d880cdbf0 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8dba7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d8815e5a0 0x7f6d880b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8dba7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d8815e5a0 0x7f6d880b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44508/0 (socket says 172.21.15.49:44508) 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8dba7640 1 -- 172.21.15.49:0/1510113045 learned_addr learned my addr 172.21.15.49:0/1510113045 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8e3a8640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d880cdbf0 0x7f6d880ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8dba7640 1 -- 172.21.15.49:0/1510113045 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d880cdbf0 msgr2=0x7f6d880ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.958+0000 7f6d8dba7640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d880cdbf0 0x7f6d880ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.959+0000 7f6d8dba7640 1 -- 172.21.15.49:0/1510113045 >> v1:172.21.15.115:6789/0 conn(0x7f6d8815f680 legacy=0x7f6d880b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.959+0000 7f6d8dba7640 1 -- 172.21.15.49:0/1510113045 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880b2f90 con 0x7f6d8815e5a0 2023-12-19T05:40:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.960+0000 7f6d8dba7640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d8815e5a0 0x7f6d880b2030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098a0 tx=0x7f6d8402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddbb3d9ae8e0f7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.961+0000 7f6d8cba5640 1 -- 172.21.15.49:0/1510113045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84030840 con 0x7f6d8815e5a0 2023-12-19T05:40:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.961+0000 7f6d8cba5640 1 -- 172.21.15.49:0/1510113045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840309a0 con 0x7f6d8815e5a0 2023-12-19T05:40:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.961+0000 7f6d8cba5640 1 -- 172.21.15.49:0/1510113045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84030d30 con 0x7f6d8815e5a0 2023-12-19T05:40:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.961+0000 7f6d8eba9640 1 -- 172.21.15.49:0/1510113045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d8815e5a0 msgr2=0x7f6d880b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.961+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d8815e5a0 0x7f6d880b2030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098a0 tx=0x7f6d8402b980 comp rx=0 tx=0).stop 2023-12-19T05:40:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 -- 172.21.15.49:0/1510113045 shutdown_connections 2023-12-19T05:40:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d880cdbf0 0x7f6d880ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/1510113045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d8815e5a0 0x7f6d880b2030 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 -- 172.21.15.49:0/1510113045 >> 172.21.15.49:0/1510113045 conn(0x7f6d880b0100 msgr2=0x7f6d880b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 -- 172.21.15.49:0/1510113045 shutdown_connections 2023-12-19T05:40:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.962+0000 7f6d8eba9640 1 -- 172.21.15.49:0/1510113045 wait complete. 2023-12-19T05:40:56.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.964+0000 7f6d8eba9640 1 Processor -- start 2023-12-19T05:40:56.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.964+0000 7f6d8eba9640 1 -- start start 2023-12-19T05:40:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 0x7f6d880cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d8815f680 0x7f6d8815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881f3010 con 0x7f6d880cdbf0 2023-12-19T05:40:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880cc750 con 0x7f6d8815e5a0 2023-12-19T05:40:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8eba9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880cc9d0 con 0x7f6d8815f680 2023-12-19T05:40:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44522/0 (socket says 172.21.15.49:44522) 2023-12-19T05:40:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 -- 172.21.15.49:0/2352092727 learned_addr learned my addr 172.21.15.49:0/2352092727 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 -- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d8815f680 msgr2=0x7f6d8815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d8815f680 0x7f6d8815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.965+0000 7f6d8dba7640 1 -- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 msgr2=0x7f6d880cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8d3a6640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 0x7f6d880cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8dba7640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 0x7f6d880cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8dba7640 1 -- 172.21.15.49:0/2352092727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840094d0 con 0x7f6d880cdbf0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8d3a6640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 0x7f6d880cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8dba7640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84039c90 con 0x7f6d880cdbf0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84039df0 con 0x7f6d880cdbf0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84043640 con 0x7f6d880cdbf0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.966+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880cccb0 con 0x7f6d880cdbf0 2023-12-19T05:40:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.967+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d880cd270 con 0x7f6d880cdbf0 2023-12-19T05:40:56.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.968+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d88061910 con 0x7f6d880cdbf0 2023-12-19T05:40:56.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.969+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d840437a0 con 0x7f6d880cdbf0 2023-12-19T05:40:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.970+0000 7f6d7e7fc640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 0x7f6d6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.970+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d8403e070 con 0x7f6d880cdbf0 2023-12-19T05:40:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.970+0000 7f6d8d3a6640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 0x7f6d6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.972+0000 7f6d8d3a6640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 0x7f6d6c06c920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6d881f6340 tx=0x7f6d78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:56.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:56.975+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d84076fc0 con 0x7f6d880cdbf0 2023-12-19T05:40:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.206+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d880afad0 con 0x7f6d880cdbf0 2023-12-19T05:40:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.207+0000 7f6d7e7fc640 1 -- 172.21.15.49:0/2352092727 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6d84034de0 con 0x7f6d880cdbf0 2023-12-19T05:40:57.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:57.209 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2416006029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2416006029},{"type":"v1","addr":"172.21.15.115:6837","nonce":2416006029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3376910379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3376910379},{"type":"v1","addr":"172.21.15.49:6835","nonce":3376910379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2243372541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2243372541},{"type":"v1","addr":"172.21.15.115:6836","nonce":2243372541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3918307781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3918307781},{"type":"v1","addr":"172.21.15.49:6834","nonce":3918307781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-12-19T05:40:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-12-19T05:40:57.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 msgr2=0x7f6d6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 0x7f6d6c06c920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6d881f6340 tx=0x7f6d78009040 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 msgr2=0x7f6d880c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84004730 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 shutdown_connections 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d6c06a460 0x7f6d6c06c920 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d8815f680 0x7f6d8815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d8815e5a0 0x7f6d880cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 --2- 172.21.15.49:0/2352092727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d880cdbf0 0x7f6d880c8e30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 >> 172.21.15.49:0/2352092727 conn(0x7f6d880b0100 msgr2=0x7f6d880b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 shutdown_connections 2023-12-19T05:40:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.210+0000 7f6d8eba9640 1 -- 172.21.15.49:0/2352092727 wait complete. 2023-12-19T05:40:57.230 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:40:57.230 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:40:57.230 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:40:57.230 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:57.230 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:40:57.231 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:40:57.231 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:40:57.231 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:57.231 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:40:57.231 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:40:57.231 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:40:57.231 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:57.232 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:40:57.232 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:40:57.232 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:40:57.232 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:40:57.250 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:40:57.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:40:57.251 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:40:57.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:40:57.254 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:40:57.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:40:57.258 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:40:57.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:40:57.299 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:40:57.299 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:57.305 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:40:57.305 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:57.306 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:40:57.306 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:57.315 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:40:57.316 DEBUG:teuthology.parallel:result is None 2023-12-19T05:40:57.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:40:57.463 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:40:57.463 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:40:57.464 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-12-19T05:40:57.464+0000 7f0e3e9c9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-12-19T05:40:57.482 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:40:57.483 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:40:57.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.521+0000 7fa79428b640 1 Processor -- start 2023-12-19T05:40:57.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.522+0000 7fa79428b640 1 -- start start 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa78c143d00 0x7fa78c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c15b500 0x7fa78c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa78c06cbf0 0x7fa78c070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c06d080 con 0x7fa78c06cbf0 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c15bd70 con 0x7fa78c143d00 2023-12-19T05:40:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa79428b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c15e650 con 0x7fa78c15b500 2023-12-19T05:40:57.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa792828640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa78c06cbf0 0x7fa78c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa792828640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa78c06cbf0 0x7fa78c070270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44586/0 (socket says 172.21.15.49:44586) 2023-12-19T05:40:57.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa792828640 1 -- 172.21.15.49:0/535386104 learned_addr learned my addr 172.21.15.49:0/535386104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:57.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa791826640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c15b500 0x7fa78c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.523+0000 7fa792027640 1 --2- 172.21.15.49:0/535386104 >> v2:172.21.15.115:3300/0 conn(0x7fa78c143d00 0x7fa78c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.524+0000 7fa792828640 1 -- 172.21.15.49:0/535386104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c15b500 msgr2=0x7fa78c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.524+0000 7fa792828640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c15b500 0x7fa78c06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.524+0000 7fa792828640 1 -- 172.21.15.49:0/535386104 >> v2:172.21.15.115:3300/0 conn(0x7fa78c143d00 msgr2=0x7fa78c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.524+0000 7fa792828640 1 --2- 172.21.15.49:0/535386104 >> v2:172.21.15.115:3300/0 conn(0x7fa78c143d00 0x7fa78c15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.524+0000 7fa792828640 1 -- 172.21.15.49:0/535386104 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c15e930 con 0x7fa78c06cbf0 2023-12-19T05:40:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.525+0000 7fa792828640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c070270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa78c06ea50 tx=0x7fa78402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1961237b0b3c8e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.525+0000 7fa791025640 1 -- 172.21.15.49:0/535386104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78402c9e0 con 0x7fa78c06cbf0 2023-12-19T05:40:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa791025640 1 -- 172.21.15.49:0/535386104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78402cb40 con 0x7fa78c06cbf0 2023-12-19T05:40:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa791025640 1 -- 172.21.15.49:0/535386104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840343f0 con 0x7fa78c06cbf0 2023-12-19T05:40:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 -- 172.21.15.49:0/535386104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 msgr2=0x7fa78c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c070270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa78c06ea50 tx=0x7fa78402be40 comp rx=0 tx=0).stop 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 -- 172.21.15.49:0/535386104 shutdown_connections 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c070270 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 --2- 172.21.15.49:0/535386104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c15b500 0x7fa78c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 --2- 172.21.15.49:0/535386104 >> v2:172.21.15.115:3300/0 conn(0x7fa78c143d00 0x7fa78c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 -- 172.21.15.49:0/535386104 >> 172.21.15.49:0/535386104 conn(0x7fa78c0d01a0 msgr2=0x7fa78c0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 -- 172.21.15.49:0/535386104 shutdown_connections 2023-12-19T05:40:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.526+0000 7fa79428b640 1 -- 172.21.15.49:0/535386104 wait complete. 2023-12-19T05:40:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.528+0000 7fa79428b640 1 Processor -- start 2023-12-19T05:40:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.528+0000 7fa79428b640 1 -- start start 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c143d00 0x7fa78c13aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa78c15b500 0x7fa78c13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c1576f0 con 0x7fa78c06cbf0 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c1579d0 con 0x7fa78c15b500 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa79428b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c157cb0 con 0x7fa78c143d00 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa792027640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa792027640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44598/0 (socket says 172.21.15.49:44598) 2023-12-19T05:40:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.529+0000 7fa792027640 1 -- 172.21.15.49:0/3937705394 learned_addr learned my addr 172.21.15.49:0/3937705394 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa791826640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c143d00 0x7fa78c13aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792828640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa78c15b500 0x7fa78c13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 -- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c143d00 msgr2=0x7fa78c13aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c143d00 0x7fa78c13aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 -- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa78c15b500 msgr2=0x7fa78c13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa78c15b500 0x7fa78c13c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 -- 172.21.15.49:0/3937705394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784009b30 con 0x7fa78c06cbf0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa792027640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e870 tx=0x7fa78800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.530+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800ee60 con 0x7fa78c06cbf0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.531+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800c940 con 0x7fa78c06cbf0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.531+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800ccf0 con 0x7fa78c06cbf0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.531+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c157f90 con 0x7fa78c06cbf0 2023-12-19T05:40:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.531+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c157310 con 0x7fa78c06cbf0 2023-12-19T05:40:57.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.532+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c061910 con 0x7fa78c06cbf0 2023-12-19T05:40:57.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.533+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa788013470 con 0x7fa78c06cbf0 2023-12-19T05:40:57.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.535+0000 7fa782ffd640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 0x7fa77006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.535+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa788088790 con 0x7fa78c06cbf0 2023-12-19T05:40:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.535+0000 7fa791826640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 0x7fa77006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.536+0000 7fa791826640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 0x7fa77006c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa78c159930 tx=0x7fa77c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:57.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.539+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa788053fe0 con 0x7fa78c06cbf0 2023-12-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:57.745+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa78c157830 con 0x7fa78c06cbf0 2023-12-19T05:40:58.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.517+0000 7fa782ffd640 1 -- 172.21.15.49:0/3937705394 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa78c157830 con 0x7fa78c06cbf0 2023-12-19T05:40:58.519 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:40:58.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.520+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 msgr2=0x7fa77006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.520+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 0x7fa77006c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa78c159930 tx=0x7fa77c008040 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.520+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 msgr2=0x7fa78c141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.520+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e870 tx=0x7fa78800ed30 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 shutdown_connections 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa77006a430 0x7fa77006c8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa78c143d00 0x7fa78c13aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa78c15b500 0x7fa78c13c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 --2- 172.21.15.49:0/3937705394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa78c06cbf0 0x7fa78c141140 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 >> 172.21.15.49:0/3937705394 conn(0x7fa78c0d01a0 msgr2=0x7fa78c142ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:58.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 shutdown_connections 2023-12-19T05:40:58.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.521+0000 7fa79428b640 1 -- 172.21.15.49:0/3937705394 wait complete. 2023-12-19T05:40:58.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:40:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.775+0000 7f5186a04640 1 Processor -- start 2023-12-19T05:40:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.776+0000 7f5186a04640 1 -- start start 2023-12-19T05:40:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5186a04640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f518015e5a0 0x7f51800b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5186a04640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51800cdbf0 0x7f51800ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5186a04640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518015ec30 con 0x7f518015f680 2023-12-19T05:40:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5186a04640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800ce5a0 con 0x7f518015e5a0 2023-12-19T05:40:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5186a04640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518015e980 con 0x7f51800cdbf0 2023-12-19T05:40:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5185201640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f518015f680 0x7f51800b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48894/0 (socket says 172.21.15.49:48894) 2023-12-19T05:40:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.777+0000 7f5185201640 1 -- 172.21.15.49:0/3486501251 learned_addr learned my addr 172.21.15.49:0/3486501251 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5185a02640 1 --2- 172.21.15.49:0/3486501251 >> v2:172.21.15.115:3300/0 conn(0x7f518015e5a0 0x7f51800b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5186203640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51800cdbf0 0x7f51800ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478769119 0 0) 0x7f518015ec30 con 0x7f518015f680 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f516c003520 con 0x7f518015f680 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2313090434 0 0) 0x7f516c003520 con 0x7f518015f680 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51800cdbf0 msgr2=0x7f51800ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51800cdbf0 0x7f51800ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 >> v2:172.21.15.115:3300/0 conn(0x7f518015e5a0 msgr2=0x7f51800b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 --2- 172.21.15.49:0/3486501251 >> v2:172.21.15.115:3300/0 conn(0x7f518015e5a0 0x7f51800b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800b2f90 con 0x7f518015f680 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5170001670 con 0x7f518015f680 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 >> v1:172.21.15.49:6789/0 conn(0x7f518015f680 legacy=0x7f51800b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c003970 0x7f516c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0047c0 0x7f516c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c005180 0x7f516c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51800ce5a0 con 0x7f516c003970 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518015e980 con 0x7f516c0047c0 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c00bef0 con 0x7f516c005180 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.778+0000 7f5186203640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51800cdbf0 0x7f51800ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c003970 0x7f516c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185201640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0047c0 0x7f516c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 -- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c005180 msgr2=0x7f516c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c005180 0x7f516c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 -- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0047c0 msgr2=0x7f516c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0047c0 0x7f516c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185a02640 1 -- 172.21.15.49:0/3486501251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c003520 con 0x7f516c003970 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.779+0000 7f5185201640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0047c0 0x7f516c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.780+0000 7f5185a02640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c003970 0x7f516c003d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f517c009ac0 tx=0x7f516c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b70369b5a9badd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.780+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c02c6d0 con 0x7f516c003970 2023-12-19T05:40:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.780+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c02c830 con 0x7f516c003970 2023-12-19T05:40:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.780+0000 7f5184a00640 1 -- 172.21.15.49:0/3486501251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c02cbc0 con 0x7f516c003970 2023-12-19T05:40:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 -- 172.21.15.49:0/3486501251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c003970 msgr2=0x7f516c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 --2- 172.21.15.49:0/3486501251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c003970 0x7f516c003d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f517c009ac0 tx=0x7f516c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186203640 1 -- 172.21.15.49:0/3486501251 reap_dead start 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 -- 172.21.15.49:0/3486501251 shutdown_connections 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 -- 172.21.15.49:0/3486501251 >> 172.21.15.49:0/3486501251 conn(0x7f51800b0100 msgr2=0x7f51800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 -- 172.21.15.49:0/3486501251 shutdown_connections 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.781+0000 7f5186a04640 1 -- 172.21.15.49:0/3486501251 wait complete. 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.783+0000 7f5186a04640 1 Processor -- start 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.783+0000 7f5186a04640 1 -- start start 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 0x7f51800adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 0x7f5180155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518015ba30 con 0x7f51801f28d0 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801562e0 con 0x7f5180155920 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186a04640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51801f3650 con 0x7f516c003970 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186203640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186203640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44624/0 (socket says 172.21.15.49:44624) 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.784+0000 7f5186203640 1 -- 172.21.15.49:0/60081332 learned_addr learned my addr 172.21.15.49:0/60081332 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5185201640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 0x7f5180155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5185a02640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 0x7f51800adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 -- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 msgr2=0x7f51800adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 0x7f51800adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 -- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 msgr2=0x7f5180155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 0x7f5180155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 -- 172.21.15.49:0/60081332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800ccac0 con 0x7f51801f28d0 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5185a02640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 0x7f51800adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5185201640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 0x7f5180155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f5186203640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f51800cdfd0 tx=0x7f517800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.785+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800dcb0 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.786+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800f040 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.786+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178003990 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.786+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51800ccda0 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.786+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51800cd360 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.787+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51800cd580 con 0x7f51801f28d0 2023-12-19T05:40:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.788+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5178003af0 con 0x7f51801f28d0 2023-12-19T05:40:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.789+0000 7f51767fc640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 0x7f516406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.789+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5178088420 con 0x7f51801f28d0 2023-12-19T05:40:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.790+0000 7f5185a02640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 0x7f516406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.791+0000 7f5185a02640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 0x7f516406c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:58.794+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5178053df0 con 0x7f51801f28d0 2023-12-19T05:40:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.059+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5180061910 con 0x7f51801f28d0 2023-12-19T05:40:59.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.060+0000 7f51767fc640 1 -- 172.21.15.49:0/60081332 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5178057410 con 0x7f51801f28d0 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.071 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.072 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:40:59.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:40:59.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:40:59.076 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:40:59.077 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.062+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 msgr2=0x7f516406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.062+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 0x7f516406c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c030000 comp rx=0 tx=0).stop 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.062+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 msgr2=0x7f51801f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.062+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f51800cdfd0 tx=0x7f517800d4a0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 shutdown_connections 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f516406a430 0x7f516406c8f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51801f28d0 0x7f51801f2d30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5180155920 0x7f5180155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 --2- 172.21.15.49:0/60081332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f516c003970 0x7f51800adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 >> 172.21.15.49:0/60081332 conn(0x7f51800b0100 msgr2=0x7f518006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:59.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 shutdown_connections 2023-12-19T05:40:59.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.063+0000 7f5186a04640 1 -- 172.21.15.49:0/60081332 wait complete. 2023-12-19T05:40:59.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:40:59.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.314+0000 7f0ad29fd640 1 Processor -- start 2023-12-19T05:40:59.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.314+0000 7f0ad29fd640 1 -- start start 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.315+0000 7f0ad29fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0acc15d620 0x7f0acc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad29fd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 0x7f0acc0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad29fd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0b6ca0 con 0x7f0acc0b6160 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad29fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0b4120 con 0x7f0acc15d620 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad29fd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0b5b80 con 0x7f0acc15da00 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad19fb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0acc15d620 0x7f0acc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad21fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0acc0b6160 0x7f0acc0b6590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48902/0 (socket says 172.21.15.49:48902) 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad19fb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0acc15d620 0x7f0acc0cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44638/0 (socket says 172.21.15.49:44638) 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad21fc640 1 -- 172.21.15.49:0/139333273 learned_addr learned my addr 172.21.15.49:0/139333273 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.316+0000 7f0ad11fa640 1 --2- 172.21.15.49:0/139333273 >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 0x7f0acc0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.317+0000 7f0ad19fb640 1 -- 172.21.15.49:0/139333273 >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 msgr2=0x7f0acc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.317+0000 7f0ad19fb640 1 --2- 172.21.15.49:0/139333273 >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 0x7f0acc0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.317+0000 7f0ad19fb640 1 -- 172.21.15.49:0/139333273 >> v1:172.21.15.49:6789/0 conn(0x7f0acc0b6160 legacy=0x7f0acc0b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.317+0000 7f0ad19fb640 1 -- 172.21.15.49:0/139333273 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0b6ee0 con 0x7f0acc15d620 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.317+0000 7f0ad11fa640 1 --2- 172.21.15.49:0/139333273 >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 0x7f0acc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad19fb640 1 --2- 172.21.15.49:0/139333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc15d620 0x7f0acc0cef60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06e8f0 tx=0x7f0abc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0da7146e7278e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad09f9640 1 -- 172.21.15.49:0/139333273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02cd10 con 0x7f0acc15d620 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad09f9640 1 -- 172.21.15.49:0/139333273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc02ce70 con 0x7f0acc15d620 2023-12-19T05:40:59.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad09f9640 1 -- 172.21.15.49:0/139333273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc034640 con 0x7f0acc15d620 2023-12-19T05:40:59.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad29fd640 1 -- 172.21.15.49:0/139333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc15d620 msgr2=0x7f0acc0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.318+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/139333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc15d620 0x7f0acc0cef60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06e8f0 tx=0x7f0abc02bf60 comp rx=0 tx=0).stop 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 -- 172.21.15.49:0/139333273 shutdown_connections 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/139333273 >> v2:172.21.15.115:3300/0 conn(0x7f0acc15da00 0x7f0acc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/139333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc15d620 0x7f0acc0cef60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 -- 172.21.15.49:0/139333273 >> 172.21.15.49:0/139333273 conn(0x7f0acc0cfb90 msgr2=0x7f0acc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 -- 172.21.15.49:0/139333273 shutdown_connections 2023-12-19T05:40:59.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.319+0000 7f0ad29fd640 1 -- 172.21.15.49:0/139333273 wait complete. 2023-12-19T05:40:59.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.320+0000 7f0ad29fd640 1 Processor -- start 2023-12-19T05:40:59.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.321+0000 7f0ad29fd640 1 -- start start 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc15d620 0x7f0acc15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0acc15da00 0x7f0acc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc1e7850 con 0x7f0acc0b6160 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15b8e0 con 0x7f0acc15d620 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad29fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc1e6c40 con 0x7f0acc15da00 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44642/0 (socket says 172.21.15.49:44642) 2023-12-19T05:40:59.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 -- 172.21.15.49:0/3993518393 learned_addr learned my addr 172.21.15.49:0/3993518393 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 -- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0acc15da00 msgr2=0x7f0acc15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0acc15da00 0x7f0acc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 -- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc15d620 msgr2=0x7f0acc15aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc15d620 0x7f0acc15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.322+0000 7f0ad19fb640 1 -- 172.21.15.49:0/3993518393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009a70 con 0x7f0acc0b6160 2023-12-19T05:40:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.323+0000 7f0ad19fb640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0abc02c570 tx=0x7f0abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.323+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc03d600 con 0x7f0acc0b6160 2023-12-19T05:40:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.324+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc03d780 con 0x7f0acc0b6160 2023-12-19T05:40:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.324+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc1e6f20 con 0x7f0acc0b6160 2023-12-19T05:40:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.324+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc1e74e0 con 0x7f0acc0b6160 2023-12-19T05:40:59.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.324+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc03db30 con 0x7f0acc0b6160 2023-12-19T05:40:59.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.325+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc061910 con 0x7f0acc0b6160 2023-12-19T05:40:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.327+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0abc03b040 con 0x7f0acc0b6160 2023-12-19T05:40:59.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.327+0000 7f0aca7fc640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 0x7f0ab806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.328+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0abc0aadf0 con 0x7f0acc0b6160 2023-12-19T05:40:59.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.328+0000 7f0ad11fa640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 0x7f0ab806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.330+0000 7f0ad11fa640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 0x7f0ab806c920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006fd0 tx=0x7f0ac0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.332+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0abc076690 con 0x7f0acc0b6160 2023-12-19T05:40:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.529+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0acc0d2e60 con 0x7f0acc0b6160 2023-12-19T05:40:59.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.531+0000 7f0aca7fc640 1 -- 172.21.15.49:0/3993518393 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f0abc039090 con 0x7f0acc0b6160 2023-12-19T05:40:59.532 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:40:59.532 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:40:58.505312+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 msgr2=0x7f0ab806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 0x7f0ab806c920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006fd0 tx=0x7f0ac0008040 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 msgr2=0x7f0acc14bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0abc02c570 tx=0x7f0abc004a40 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 shutdown_connections 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ab806a460 0x7f0ab806c920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0acc15da00 0x7f0acc15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc15d620 0x7f0acc15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 --2- 172.21.15.49:0/3993518393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0acc0b6160 0x7f0acc14bdc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.533+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 >> 172.21.15.49:0/3993518393 conn(0x7f0acc0cfb90 msgr2=0x7f0acc14ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.534+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 shutdown_connections 2023-12-19T05:40:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.534+0000 7f0ad29fd640 1 -- 172.21.15.49:0/3993518393 wait complete. 2023-12-19T05:40:59.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:40:59.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:40:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.791+0000 7f00d5f88640 1 Processor -- start 2023-12-19T05:40:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.792+0000 7f00d5f88640 1 -- start start 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5f88640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00d0146cd0 0x7f00d00b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5f88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 0x7f00d006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5f88640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d006fe30 con 0x7f00d006f9d0 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5f88640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d01470b0 con 0x7f00d0146cd0 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5f88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0070260 con 0x7f00d00b6890 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5787640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f00d006f9d0 0x7f00d0160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48912/0 (socket says 172.21.15.49:48912) 2023-12-19T05:40:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d5787640 1 -- 172.21.15.49:0/3460271688 learned_addr learned my addr 172.21.15.49:0/3460271688 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:40:59.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00d4f86640 1 --2- 172.21.15.49:0/3460271688 >> v2:172.21.15.115:3300/0 conn(0x7f00d0146cd0 0x7f00d00b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.794+0000 7f00cffff640 1 --2- 172.21.15.49:0/3460271688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 0x7f00d006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060818664 0 0) 0x7f00d006fe30 con 0x7f00d006f9d0 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b8003520 con 0x7f00d006f9d0 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cffff640 1 -- 172.21.15.49:0/3460271688 >> v2:172.21.15.115:3300/0 conn(0x7f00d0146cd0 msgr2=0x7f00d00b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cffff640 1 --2- 172.21.15.49:0/3460271688 >> v2:172.21.15.115:3300/0 conn(0x7f00d0146cd0 0x7f00d00b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981901908 0 0) 0x7f00b8003520 con 0x7f00d006f9d0 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cffff640 1 -- 172.21.15.49:0/3460271688 >> v1:172.21.15.49:6789/0 conn(0x7f00d006f9d0 legacy=0x7f00d0160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.795+0000 7f00cffff640 1 -- 172.21.15.49:0/3460271688 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00b6ea0 con 0x7f00d00b6890 2023-12-19T05:40:59.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.797+0000 7f00cffff640 1 --2- 172.21.15.49:0/3460271688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 0x7f00d006f490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59450d7623dae9ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.797+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8001670 con 0x7f00d00b6890 2023-12-19T05:40:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.797+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c402e050 con 0x7f00d00b6890 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.797+0000 7f00cf7fe640 1 -- 172.21.15.49:0/3460271688 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4030730 con 0x7f00d00b6890 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 -- 172.21.15.49:0/3460271688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 msgr2=0x7f00d006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 --2- 172.21.15.49:0/3460271688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 0x7f00d006f490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402b710 comp rx=0 tx=0).stop 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 -- 172.21.15.49:0/3460271688 shutdown_connections 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 --2- 172.21.15.49:0/3460271688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d00b6890 0x7f00d006f490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 --2- 172.21.15.49:0/3460271688 >> v2:172.21.15.115:3300/0 conn(0x7f00d0146cd0 0x7f00d00b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 -- 172.21.15.49:0/3460271688 >> 172.21.15.49:0/3460271688 conn(0x7f00d00d3200 msgr2=0x7f00d00d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 -- 172.21.15.49:0/3460271688 shutdown_connections 2023-12-19T05:40:59.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.798+0000 7f00d5f88640 1 -- 172.21.15.49:0/3460271688 wait complete. 2023-12-19T05:40:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.801+0000 7f00d5f88640 1 Processor -- start 2023-12-19T05:40:59.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.801+0000 7f00d5f88640 1 -- start start 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d006f9d0 0x7f00d00ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d0146cd0 0x7f00d015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0161090 con 0x7f00d00b6890 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d01619f0 con 0x7f00d0146cd0 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.802+0000 7f00d5f88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d015e070 con 0x7f00d006f9d0 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44658/0 (socket says 172.21.15.49:44658) 2023-12-19T05:40:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 -- 172.21.15.49:0/916493459 learned_addr learned my addr 172.21.15.49:0/916493459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:40:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00d4f86640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d006f9d0 0x7f00d00ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00d5787640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d0146cd0 0x7f00d015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 -- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d006f9d0 msgr2=0x7f00d00ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d006f9d0 0x7f00d00ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 -- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d0146cd0 msgr2=0x7f00d015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d0146cd0 0x7f00d015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.803+0000 7f00cffff640 1 -- 172.21.15.49:0/916493459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4009400 con 0x7f00d00b6890 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00cffff640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f00c40096f0 tx=0x7f00c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c403b810 con 0x7f00d00b6890 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c403b970 con 0x7f00d00b6890 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c403bd20 con 0x7f00d00b6890 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d00cef40 con 0x7f00d00b6890 2023-12-19T05:40:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.804+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0160cb0 con 0x7f00d00b6890 2023-12-19T05:40:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.805+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d0061910 con 0x7f00d00b6890 2023-12-19T05:40:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.806+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f00c4039040 con 0x7f00d00b6890 2023-12-19T05:40:59.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.807+0000 7f00cd7fa640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 0x7f00bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:59.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.807+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00c40a9c40 con 0x7f00d00b6890 2023-12-19T05:40:59.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.808+0000 7f00d4f86640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 0x7f00bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:59.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.809+0000 7f00d4f86640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 0x7f00bc06c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00c0011340 tx=0x7f00c000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:59.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:40:59.812+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f00c4075630 con 0x7f00d00b6890 2023-12-19T05:41:00.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.005+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00d015bfe0 con 0x7f00d00b6890 2023-12-19T05:41:00.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.006+0000 7f00cd7fa640 1 -- 172.21.15.49:0/916493459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00c40370a0 con 0x7f00d00b6890 2023-12-19T05:41:00.008 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:41:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 msgr2=0x7f00bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 0x7f00bc06c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00c0011340 tx=0x7f00c000b040 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 msgr2=0x7f00d01614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f00c40096f0 tx=0x7f00c40046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 shutdown_connections 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00bc06a430 0x7f00bc06c8f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d0146cd0 0x7f00d015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d00b6890 0x7f00d01614b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 --2- 172.21.15.49:0/916493459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d006f9d0 0x7f00d00ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 >> 172.21.15.49:0/916493459 conn(0x7f00d00d3200 msgr2=0x7f00d00d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 shutdown_connections 2023-12-19T05:41:00.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.009+0000 7f00d5f88640 1 -- 172.21.15.49:0/916493459 wait complete. 2023-12-19T05:41:00.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:41:00.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.263+0000 7fa6f284d640 1 Processor -- start 2023-12-19T05:41:00.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.263+0000 7fa6f284d640 1 -- start start 2023-12-19T05:41:00.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6ec1449f0 0x7fa6ec15b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6ec15bad0 0x7fa6ec0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec15c5f0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec06cb40 con 0x7fa6ec15bad0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f284d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec06c530 con 0x7fa6ec0cbda0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f184b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6ec1449f0 0x7fa6ec15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f184b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6ec1449f0 0x7fa6ec15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44672/0 (socket says 172.21.15.49:44672) 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.265+0000 7fa6f184b640 1 -- 172.21.15.49:0/184879443 learned_addr learned my addr 172.21.15.49:0/184879443 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f104a640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f184b640 1 -- 172.21.15.49:0/184879443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 msgr2=0x7fa6ec0b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f204c640 1 --2- 172.21.15.49:0/184879443 >> v2:172.21.15.115:3300/0 conn(0x7fa6ec15bad0 0x7fa6ec0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f184b640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec0b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f184b640 1 -- 172.21.15.49:0/184879443 >> v2:172.21.15.115:3300/0 conn(0x7fa6ec15bad0 msgr2=0x7fa6ec0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f184b640 1 --2- 172.21.15.49:0/184879443 >> v2:172.21.15.115:3300/0 conn(0x7fa6ec15bad0 0x7fa6ec0b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f184b640 1 -- 172.21.15.49:0/184879443 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec15c030 con 0x7fa6ec1449f0 2023-12-19T05:41:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.266+0000 7fa6f104a640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec0b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.267+0000 7fa6f184b640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec15b590 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec06cab0 tx=0x7fa6e802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddd3599545f6b28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.267+0000 7fa6f0849640 1 -- 172.21.15.49:0/184879443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80317e0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.267+0000 7fa6f0849640 1 -- 172.21.15.49:0/184879443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8031940 con 0x7fa6ec1449f0 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.267+0000 7fa6f0849640 1 -- 172.21.15.49:0/184879443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8031cd0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 -- 172.21.15.49:0/184879443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 msgr2=0x7fa6ec15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec15b590 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec06cab0 tx=0x7fa6e802b880 comp rx=0 tx=0).stop 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 -- 172.21.15.49:0/184879443 shutdown_connections 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 --2- 172.21.15.49:0/184879443 >> v2:172.21.15.115:3300/0 conn(0x7fa6ec15bad0 0x7fa6ec0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec0b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 --2- 172.21.15.49:0/184879443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec15b590 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 -- 172.21.15.49:0/184879443 >> 172.21.15.49:0/184879443 conn(0x7fa6ec0659a0 msgr2=0x7fa6ec065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 -- 172.21.15.49:0/184879443 shutdown_connections 2023-12-19T05:41:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.268+0000 7fa6f284d640 1 -- 172.21.15.49:0/184879443 wait complete. 2023-12-19T05:41:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.270+0000 7fa6f284d640 1 Processor -- start 2023-12-19T05:41:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.270+0000 7fa6f284d640 1 -- start start 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec1e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6ec15bad0 0x7fa6ec15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec1e5690 con 0x7fa6ec1449f0 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec1e4a80 con 0x7fa6ec15bad0 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f284d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec1e4d60 con 0x7fa6ec0cbda0 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f104a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f104a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44684/0 (socket says 172.21.15.49:44684) 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.271+0000 7fa6f104a640 1 -- 172.21.15.49:0/2876872094 learned_addr learned my addr 172.21.15.49:0/2876872094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f184b640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec1e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f204c640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6ec15bad0 0x7fa6ec15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 -- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 msgr2=0x7fa6ec1e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec1e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 -- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6ec15bad0 msgr2=0x7fa6ec15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6ec15bad0 0x7fa6ec15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 -- 172.21.15.49:0/2876872094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80094d0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.272+0000 7fa6f104a640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c7c0 tx=0x7fa6dc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.273+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc007820 con 0x7fa6ec1449f0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.273+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc007980 con 0x7fa6ec1449f0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.273+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc007d10 con 0x7fa6ec1449f0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.273+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec1e5040 con 0x7fa6ec1449f0 2023-12-19T05:41:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.273+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec1e4790 con 0x7fa6ec1449f0 2023-12-19T05:41:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.274+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec061910 con 0x7fa6ec1449f0 2023-12-19T05:41:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.275+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6dc0113f0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.276+0000 7fa6e27fc640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 0x7fa6d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.276+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6dc0886f0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.276+0000 7fa6f184b640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 0x7fa6d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.277+0000 7fa6f184b640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 0x7fa6d006c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8036000 tx=0x7fa6e803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.281+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa6dc053f90 con 0x7fa6ec1449f0 2023-12-19T05:41:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.476+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa6ec06d430 con 0x7fa6ec1449f0 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.477+0000 7fa6e27fc640 1 -- 172.21.15.49:0/2876872094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa6dc0575b0 con 0x7fa6ec1449f0 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:00.479 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 msgr2=0x7fa6d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 0x7fa6d006c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8036000 tx=0x7fa6e803d040 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 msgr2=0x7fa6ec1e4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c7c0 tx=0x7fa6dc00cc80 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 shutdown_connections 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6d006a430 0x7fa6d006c8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6ec15bad0 0x7fa6ec15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ec1449f0 0x7fa6ec1e4250 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 --2- 172.21.15.49:0/2876872094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6ec0cbda0 0x7fa6ec1e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 >> 172.21.15.49:0/2876872094 conn(0x7fa6ec0659a0 msgr2=0x7fa6ec0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:00.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.480+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 shutdown_connections 2023-12-19T05:41:00.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.481+0000 7fa6f284d640 1 -- 172.21.15.49:0/2876872094 wait complete. 2023-12-19T05:41:00.503 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:41:00.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:41:00.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.746+0000 7f1d9759e640 1 Processor -- start 2023-12-19T05:41:00.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.746+0000 7f1d9759e640 1 -- start start 2023-12-19T05:41:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d9759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9806cf60 0x7f1d980ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d9759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d980cef30 0x7f1d9815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d9759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980cf370 con 0x7f1d9815ac20 2023-12-19T05:41:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d9759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980b2190 con 0x7f1d980cef30 2023-12-19T05:41:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d9759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9806d340 con 0x7f1d9806cf60 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.748+0000 7f1d95d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d980cef30 0x7f1d9815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d96d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1d9815ac20 0x7f1d9815dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48926/0 (socket says 172.21.15.49:48926) 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d96d9d640 1 -- 172.21.15.49:0/102303966 learned_addr learned my addr 172.21.15.49:0/102303966 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d9659c640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9806cf60 0x7f1d980ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d95d9b640 1 -- 172.21.15.49:0/102303966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9806cf60 msgr2=0x7f1d980ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d95d9b640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9806cf60 0x7f1d980ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d95d9b640 1 -- 172.21.15.49:0/102303966 >> v1:172.21.15.49:6789/0 conn(0x7f1d9815ac20 legacy=0x7f1d9815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.749+0000 7f1d95d9b640 1 -- 172.21.15.49:0/102303966 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9815b4a0 con 0x7f1d980cef30 2023-12-19T05:41:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.750+0000 7f1d95d9b640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d9815a6e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0097a0 tx=0x7f1d8c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942b0d655c4f335e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9559a640 1 -- 172.21.15.49:0/102303966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c030800 con 0x7f1d980cef30 2023-12-19T05:41:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9559a640 1 -- 172.21.15.49:0/102303966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c030960 con 0x7f1d980cef30 2023-12-19T05:41:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9559a640 1 -- 172.21.15.49:0/102303966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c030cf0 con 0x7f1d980cef30 2023-12-19T05:41:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 -- 172.21.15.49:0/102303966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 msgr2=0x7f1d9815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d9815a6e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0097a0 tx=0x7f1d8c02b940 comp rx=0 tx=0).stop 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 -- 172.21.15.49:0/102303966 shutdown_connections 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d9815a6e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 --2- 172.21.15.49:0/102303966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9806cf60 0x7f1d980ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.751+0000 7f1d9759e640 1 -- 172.21.15.49:0/102303966 >> 172.21.15.49:0/102303966 conn(0x7f1d980b4750 msgr2=0x7f1d980659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.752+0000 7f1d9759e640 1 -- 172.21.15.49:0/102303966 shutdown_connections 2023-12-19T05:41:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.752+0000 7f1d9759e640 1 -- 172.21.15.49:0/102303966 wait complete. 2023-12-19T05:41:00.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.753+0000 7f1d9759e640 1 Processor -- start 2023-12-19T05:41:00.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.753+0000 7f1d9759e640 1 -- start start 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d9806cf60 0x7f1d98152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9815ac20 0x7f1d980b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98156ee0 con 0x7f1d980cef30 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98156640 con 0x7f1d9806cf60 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.754+0000 7f1d9759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98156920 con 0x7f1d9815ac20 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44696/0 (socket says 172.21.15.49:44696) 2023-12-19T05:41:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 -- 172.21.15.49:0/3559728589 learned_addr learned my addr 172.21.15.49:0/3559728589 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d96d9d640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9815ac20 0x7f1d980b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d9659c640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d9806cf60 0x7f1d98152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 -- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9815ac20 msgr2=0x7f1d980b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9815ac20 0x7f1d980b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 -- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d9806cf60 msgr2=0x7f1d98152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d9806cf60 0x7f1d98152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.755+0000 7f1d95d9b640 1 -- 172.21.15.49:0/3559728589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009400 con 0x7f1d980cef30 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d95d9b640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c02bf50 tx=0x7f1d8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c03e040 con 0x7f1d980cef30 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c039d70 con 0x7f1d980cef30 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d98156c00 con 0x7f1d980cef30 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c044630 con 0x7f1d980cef30 2023-12-19T05:41:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.756+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9815cc60 con 0x7f1d980cef30 2023-12-19T05:41:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.757+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d981f2c90 con 0x7f1d980cef30 2023-12-19T05:41:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.758+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d8c043390 con 0x7f1d980cef30 2023-12-19T05:41:00.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.760+0000 7f1d86ffd640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 0x7f1d7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:00.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.760+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d8c0aa8e0 con 0x7f1d980cef30 2023-12-19T05:41:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.761+0000 7f1d9659c640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 0x7f1d7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:00.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.762+0000 7f1d9659c640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 0x7f1d7806c920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:00.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.765+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d8c076290 con 0x7f1d980cef30 2023-12-19T05:41:00.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:00.963+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1d98061910 con 0x7f1d980cef30 2023-12-19T05:41:01.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.469+0000 7f1d86ffd640 1 -- 172.21.15.49:0/3559728589 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1d8c0798b0 con 0x7f1d980cef30 2023-12-19T05:41:01.473 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:41:01.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 msgr2=0x7f1d7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 0x7f1d7806c920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88008040 comp rx=0 tx=0).stop 2023-12-19T05:41:01.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 msgr2=0x7f1d98155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c02bf50 tx=0x7f1d8c004730 comp rx=0 tx=0).stop 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 shutdown_connections 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d7806a460 0x7f1d7806c920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.475+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d9815ac20 0x7f1d980b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.476+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d980cef30 0x7f1d98155c60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.476+0000 7f1d9759e640 1 --2- 172.21.15.49:0/3559728589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d9806cf60 0x7f1d98152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.476+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 >> 172.21.15.49:0/3559728589 conn(0x7f1d980b4750 msgr2=0x7f1d980b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.476+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 shutdown_connections 2023-12-19T05:41:01.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.476+0000 7f1d9759e640 1 -- 172.21.15.49:0/3559728589 wait complete. 2023-12-19T05:41:01.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:41:01.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.736+0000 7f6d49e79640 1 Processor -- start 2023-12-19T05:41:01.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.736+0000 7f6d49e79640 1 -- start start 2023-12-19T05:41:01.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.738+0000 7f6d49e79640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6d4415a090 0x7f6d440b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.738+0000 7f6d49e79640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d440b0a40 0x7f6d4406b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.738+0000 7f6d49e79640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4415a470 con 0x7f6d440b2770 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.738+0000 7f6d49e79640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440b2400 con 0x7f6d4415a090 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.738+0000 7f6d49e79640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4406b4d0 con 0x7f6d440b0a40 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.739+0000 7f6d49678640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d440b0a40 0x7f6d4406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.739+0000 7f6d3bfff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6d440b2770 0x7f6d440b0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:53482/0 (socket says 172.21.15.49:53482) 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.739+0000 7f6d3bfff640 1 -- 172.21.15.49:0/1229178000 learned_addr learned my addr 172.21.15.49:0/1229178000 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:01.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.739+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1229178000 >> v2:172.21.15.115:3300/0 conn(0x7f6d4415a090 0x7f6d440b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.740+0000 7f6d48e77640 1 -- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d440b0a40 msgr2=0x7f6d4406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:01.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.740+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d440b0a40 0x7f6d4406b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.740+0000 7f6d48e77640 1 -- 172.21.15.49:0/1229178000 >> v1:172.21.15.115:6789/0 conn(0x7f6d440b2770 legacy=0x7f6d440b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.740+0000 7f6d48e77640 1 -- 172.21.15.49:0/1229178000 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4406e380 con 0x7f6d4415a090 2023-12-19T05:41:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.741+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d4415a090 0x7f6d440b12a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009d90 tx=0x7f6d4002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af602083626f7198 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d3b7fe640 1 -- 172.21.15.49:0/1229178000 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4002cc50 con 0x7f6d4415a090 2023-12-19T05:41:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d3b7fe640 1 -- 172.21.15.49:0/1229178000 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4002cdb0 con 0x7f6d4415a090 2023-12-19T05:41:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d3b7fe640 1 -- 172.21.15.49:0/1229178000 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40034660 con 0x7f6d4415a090 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 -- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d4415a090 msgr2=0x7f6d440b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d4415a090 0x7f6d440b12a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009d90 tx=0x7f6d4002bea0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 -- 172.21.15.49:0/1229178000 shutdown_connections 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d440b0a40 0x7f6d4406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1229178000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d4415a090 0x7f6d440b12a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.742+0000 7f6d49e79640 1 -- 172.21.15.49:0/1229178000 >> 172.21.15.49:0/1229178000 conn(0x7f6d440659a0 msgr2=0x7f6d44065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.743+0000 7f6d49e79640 1 -- 172.21.15.49:0/1229178000 shutdown_connections 2023-12-19T05:41:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.743+0000 7f6d49e79640 1 -- 172.21.15.49:0/1229178000 wait complete. 2023-12-19T05:41:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.745+0000 7f6d49e79640 1 Processor -- start 2023-12-19T05:41:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.745+0000 7f6d49e79640 1 -- start start 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 0x7f6d44153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d4415a090 0x7f6d4406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44154ba0 con 0x7f6d440b2770 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4415b0f0 con 0x7f6d440b0a40 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.746+0000 7f6d49e79640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440c5780 con 0x7f6d4415a090 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44700/0 (socket says 172.21.15.49:44700) 2023-12-19T05:41:01.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 -- 172.21.15.49:0/1985560496 learned_addr learned my addr 172.21.15.49:0/1985560496 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:01.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 0x7f6d44153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d49678640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d4415a090 0x7f6d4406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 -- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d4415a090 msgr2=0x7f6d4406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d4415a090 0x7f6d4406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 -- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 msgr2=0x7f6d44153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 0x7f6d44153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d3bfff640 1 -- 172.21.15.49:0/1985560496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009a70 con 0x7f6d440b2770 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.747+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 0x7f6d44153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d3bfff640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c4b0 tx=0x7f6d3400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34005ce0 con 0x7f6d440b2770 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4415a7c0 con 0x7f6d440b2770 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34005e40 con 0x7f6d440b2770 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34007270 con 0x7f6d440b2770 2023-12-19T05:41:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.748+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4415ad80 con 0x7f6d440b2770 2023-12-19T05:41:01.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.749+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4415b2a0 con 0x7f6d440b2770 2023-12-19T05:41:01.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.751+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d340073d0 con 0x7f6d440b2770 2023-12-19T05:41:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.752+0000 7f6d397fa640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 0x7f6d3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.752+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6d34088110 con 0x7f6d440b2770 2023-12-19T05:41:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.753+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 0x7f6d3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.754+0000 7f6d48e77640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 0x7f6d3006c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d40036000 tx=0x7f6d40030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.755+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d34053980 con 0x7f6d440b2770 2023-12-19T05:41:01.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:01.950+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6d44061910 con 0x7f6d440b2770 2023-12-19T05:41:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.478+0000 7f6d397fa640 1 -- 172.21.15.49:0/1985560496 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6d34056fa0 con 0x7f6d440b2770 2023-12-19T05:41:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:41:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.489+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 msgr2=0x7f6d3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.489+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 0x7f6d3006c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d40036000 tx=0x7f6d40030000 comp rx=0 tx=0).stop 2023-12-19T05:41:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.489+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 msgr2=0x7f6d4406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.489+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c4b0 tx=0x7f6d3400c970 comp rx=0 tx=0).stop 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 shutdown_connections 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d3006a430 0x7f6d3006c8f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d4415a090 0x7f6d4406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d440b2770 0x7f6d4406f120 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 --2- 172.21.15.49:0/1985560496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d440b0a40 0x7f6d44153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.490+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 >> 172.21.15.49:0/1985560496 conn(0x7f6d440659a0 msgr2=0x7f6d44070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.492+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 shutdown_connections 2023-12-19T05:41:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.494+0000 7f6d49e79640 1 -- 172.21.15.49:0/1985560496 wait complete. 2023-12-19T05:41:02.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:41:02.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.721+0000 7f028ed77640 1 Processor -- start 2023-12-19T05:41:02.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.721+0000 7f028ed77640 1 -- start start 2023-12-19T05:41:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0288161700 0x7f02880cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02880b1830 0x7f02880b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02880b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288166300 con 0x7f0288161700 2023-12-19T05:41:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880cc530 con 0x7f02880b1830 2023-12-19T05:41:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028ed77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880cb920 con 0x7f02880b21e0 2023-12-19T05:41:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.723+0000 7f028cb13640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0288161700 0x7f02880cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0288161700 0x7f02880cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44714/0 (socket says 172.21.15.49:44714) 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 -- 172.21.15.49:0/4289850361 learned_addr learned my addr 172.21.15.49:0/4289850361 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028d314640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02880b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f0287fff640 1 --2- 172.21.15.49:0/4289850361 >> v2:172.21.15.115:3300/0 conn(0x7f02880b1830 0x7f02880b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 -- 172.21.15.49:0/4289850361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 msgr2=0x7f02880b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02880b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 -- 172.21.15.49:0/4289850361 >> v2:172.21.15.115:3300/0 conn(0x7f02880b1830 msgr2=0x7f02880b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 --2- 172.21.15.49:0/4289850361 >> v2:172.21.15.115:3300/0 conn(0x7f02880b1830 0x7f02880b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.724+0000 7f028cb13640 1 -- 172.21.15.49:0/4289850361 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880cbc00 con 0x7f0288161700 2023-12-19T05:41:02.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.726+0000 7f028cb13640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02880cc9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02880b1560 tx=0x7f027802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69f88b04d135192 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:02.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.726+0000 7f02877fe640 1 -- 172.21.15.49:0/4289850361 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027802ca80 con 0x7f0288161700 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.726+0000 7f02877fe640 1 -- 172.21.15.49:0/4289850361 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027802cbe0 con 0x7f0288161700 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.726+0000 7f02877fe640 1 -- 172.21.15.49:0/4289850361 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780343f0 con 0x7f0288161700 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 -- 172.21.15.49:0/4289850361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 msgr2=0x7f02880cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02880cc9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02880b1560 tx=0x7f027802bee0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 -- 172.21.15.49:0/4289850361 shutdown_connections 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02880b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 --2- 172.21.15.49:0/4289850361 >> v2:172.21.15.115:3300/0 conn(0x7f02880b1830 0x7f02880b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 --2- 172.21.15.49:0/4289850361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02880cc9c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 -- 172.21.15.49:0/4289850361 >> 172.21.15.49:0/4289850361 conn(0x7f0288073150 msgr2=0x7f02880659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 -- 172.21.15.49:0/4289850361 shutdown_connections 2023-12-19T05:41:02.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.727+0000 7f028ed77640 1 -- 172.21.15.49:0/4289850361 wait complete. 2023-12-19T05:41:02.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.729+0000 7f028ed77640 1 Processor -- start 2023-12-19T05:41:02.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.729+0000 7f028ed77640 1 -- start start 2023-12-19T05:41:02.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880b1830 0x7f02881f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02881f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02881f6fd0 con 0x7f0288161700 2023-12-19T05:41:02.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028806e2a0 con 0x7f02880b1830 2023-12-19T05:41:02.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.730+0000 7f028ed77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02881550a0 con 0x7f02880b21e0 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44720/0 (socket says 172.21.15.49:44720) 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 -- 172.21.15.49:0/1986569777 learned_addr learned my addr 172.21.15.49:0/1986569777 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028cb13640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880b1830 0x7f02881f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f0287fff640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02881f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 -- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 msgr2=0x7f02881f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02881f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 -- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880b1830 msgr2=0x7f02881f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880b1830 0x7f02881f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 -- 172.21.15.49:0/1986569777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009b30 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f0287fff640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02881f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.731+0000 7f028d314640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f028000d800 tx=0x7f028000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.732+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000b6c0 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.732+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000b840 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.732+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000bbf0 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.732+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0288155380 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.732+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0288155940 con 0x7f0288161700 2023-12-19T05:41:02.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.733+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0288163d30 con 0x7f0288161700 2023-12-19T05:41:02.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.735+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f028000bd50 con 0x7f0288161700 2023-12-19T05:41:02.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.736+0000 7f02857fa640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 0x7f026806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:02.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.737+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0280089830 con 0x7f0288161700 2023-12-19T05:41:02.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.737+0000 7f028cb13640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 0x7f026806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:02.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.738+0000 7f028cb13640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 0x7f026806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0278035000 tx=0x7f0278030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:02.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.740+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0280054ef0 con 0x7f0288161700 2023-12-19T05:41:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.972+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0288061910 con 0x7f0288161700 2023-12-19T05:41:02.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.985+0000 7f02857fa640 1 -- 172.21.15.49:0/1986569777 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0280058510 con 0x7f0288161700 2023-12-19T05:41:02.986 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 6 and data pool 7 2023-12-19T05:41:02.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.989+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 msgr2=0x7f026806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.989+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 0x7f026806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0278035000 tx=0x7f0278030000 comp rx=0 tx=0).stop 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.989+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 msgr2=0x7f02881f73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.989+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f028000d800 tx=0x7f028000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 shutdown_connections 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f026806a430 0x7f026806c8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02880b21e0 0x7f02881f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288161700 0x7f02881f73e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 --2- 172.21.15.49:0/1986569777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880b1830 0x7f02881f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.990+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 >> 172.21.15.49:0/1986569777 conn(0x7f0288073150 msgr2=0x7f0288163f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.991+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 shutdown_connections 2023-12-19T05:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:02.991+0000 7f028ed77640 1 -- 172.21.15.49:0/1986569777 wait complete. 2023-12-19T05:41:03.021 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:03.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.211+0000 7efcc2bc1640 1 Processor -- start 2023-12-19T05:41:03.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.212+0000 7efcc2bc1640 1 -- start start 2023-12-19T05:41:03.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 0x7efcbc0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcbc0b7ea0 0x7efcbc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0d0a90 0x7efcbc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc147210 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc0b8330 con 0x7efcbc146e30 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc2bc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0d2370 con 0x7efcbc0d0a90 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc13be640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcbc0b7ea0 0x7efcbc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc13be640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcbc0b7ea0 0x7efcbc0d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44722/0 (socket says 172.21.15.49:44722) 2023-12-19T05:41:03.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.213+0000 7efcc13be640 1 -- 172.21.15.49:0/288620080 learned_addr learned my addr 172.21.15.49:0/288620080 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc1bbf640 1 --2- 172.21.15.49:0/288620080 >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 0x7efcbc0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc13be640 1 -- 172.21.15.49:0/288620080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0d0a90 msgr2=0x7efcbc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc13be640 1 --2- 172.21.15.49:0/288620080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0d0a90 0x7efcbc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc13be640 1 -- 172.21.15.49:0/288620080 >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 msgr2=0x7efcbc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc13be640 1 --2- 172.21.15.49:0/288620080 >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 0x7efcbc0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc13be640 1 -- 172.21.15.49:0/288620080 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0d12d0 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.214+0000 7efcc1bbf640 1 --2- 172.21.15.49:0/288620080 >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 0x7efcbc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.215+0000 7efcc13be640 1 --2- 172.21.15.49:0/288620080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0b7ea0 0x7efcbc0d0550 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0b85a0 tx=0x7efcac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbc3e25a237c81d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.215+0000 7efcc0bbd640 1 -- 172.21.15.49:0/288620080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0317c0 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.215+0000 7efcc0bbd640 1 -- 172.21.15.49:0/288620080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac031920 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.215+0000 7efcc0bbd640 1 -- 172.21.15.49:0/288620080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac031cb0 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 -- 172.21.15.49:0/288620080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0b7ea0 msgr2=0x7efcbc0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/288620080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0b7ea0 0x7efcbc0d0550 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0b85a0 tx=0x7efcac02b860 comp rx=0 tx=0).stop 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 -- 172.21.15.49:0/288620080 shutdown_connections 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/288620080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0d0a90 0x7efcbc06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/288620080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0b7ea0 0x7efcbc0d0550 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/288620080 >> v2:172.21.15.115:3300/0 conn(0x7efcbc146e30 0x7efcbc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 -- 172.21.15.49:0/288620080 >> 172.21.15.49:0/288620080 conn(0x7efcbc0b2990 msgr2=0x7efcbc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 -- 172.21.15.49:0/288620080 shutdown_connections 2023-12-19T05:41:03.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.216+0000 7efcc2bc1640 1 -- 172.21.15.49:0/288620080 wait complete. 2023-12-19T05:41:03.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.218+0000 7efcc2bc1640 1 Processor -- start 2023-12-19T05:41:03.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.218+0000 7efcc2bc1640 1 -- start start 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0b7ea0 0x7efcbc1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcbc146e30 0x7efcbc0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1f2730 con 0x7efcbc0d0a90 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1f2a10 con 0x7efcbc146e30 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.219+0000 7efcc2bc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1f2cf0 con 0x7efcbc0b7ea0 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44738/0 (socket says 172.21.15.49:44738) 2023-12-19T05:41:03.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 -- 172.21.15.49:0/1588941130 learned_addr learned my addr 172.21.15.49:0/1588941130 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:03.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 -- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0b7ea0 msgr2=0x7efcbc1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0b7ea0 0x7efcbc1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 -- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcbc146e30 msgr2=0x7efcbc0c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcbc146e30 0x7efcbc0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 -- 172.21.15.49:0/1588941130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0094d0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.220+0000 7efcc13be640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efcac02b8a0 tx=0x7efcac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.221+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0329a0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.221+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac032b40 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.221+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc13b450 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.221+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0453f0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.221+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc1f2fd0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.222+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc061910 con 0x7efcbc0d0a90 2023-12-19T05:41:03.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.223+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcac04e450 con 0x7efcbc0d0a90 2023-12-19T05:41:03.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.224+0000 7efcb27fc640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 0x7efca006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.224+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcac0aad40 con 0x7efcbc0d0a90 2023-12-19T05:41:03.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.225+0000 7efcc1bbf640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 0x7efca006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.226+0000 7efcc1bbf640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 0x7efca006c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efcb8006fd0 tx=0x7efcb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.228+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcac0763b0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.424+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcbc0b3bd0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.427+0000 7efcb27fc640 1 -- 172.21.15.49:0/1588941130 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16054 (secure 0 0 0) 0x7efcac0799d0 con 0x7efcbc0d0a90 2023-12-19T05:41:03.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:03.429 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:02.974339+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.429+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 msgr2=0x7efca006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.429+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 0x7efca006c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efcb8006fd0 tx=0x7efcb8008040 comp rx=0 tx=0).stop 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 msgr2=0x7efcbc1e8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efcac02b8a0 tx=0x7efcac0046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 shutdown_connections 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efca006a430 0x7efca006c8f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcbc146e30 0x7efcbc0c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcbc0d0a90 0x7efcbc1e8c40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 --2- 172.21.15.49:0/1588941130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcbc0b7ea0 0x7efcbc1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 >> 172.21.15.49:0/1588941130 conn(0x7efcbc0b2990 msgr2=0x7efcbc0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:03.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 shutdown_connections 2023-12-19T05:41:03.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.430+0000 7efcc2bc1640 1 -- 172.21.15.49:0/1588941130 wait complete. 2023-12-19T05:41:03.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:03.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.684+0000 7f71db4a1640 1 Processor -- start 2023-12-19T05:41:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.684+0000 7f71db4a1640 1 -- start start 2023-12-19T05:41:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71db4a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71d406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71db4a1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d40b2600 con 0x7f71d4157aa0 2023-12-19T05:41:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71db4a1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d40b1d60 con 0x7f71d415e040 2023-12-19T05:41:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71db4a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40b2040 con 0x7f71d40b1710 2023-12-19T05:41:03.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71d923d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71d4157aa0 0x7f71d4161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48936/0 (socket says 172.21.15.49:48936) 2023-12-19T05:41:03.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.686+0000 7f71d923d640 1 -- 172.21.15.49:0/1923988884 learned_addr learned my addr 172.21.15.49:0/1923988884 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:03.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71d406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467566982 0 0) 0x7f71d40b2600 con 0x7f71d4157aa0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c0003520 con 0x7f71d4157aa0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898454919 0 0) 0x7f71c0003520 con 0x7f71d4157aa0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 msgr2=0x7f71d406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71d406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 >> v1:172.21.15.115:6789/0 conn(0x7f71d415e040 legacy=0x7f71d415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40b2320 con 0x7f71d4157aa0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.687+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f71d0001670 con 0x7f71d4157aa0 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 >> v1:172.21.15.49:6789/0 conn(0x7f71d4157aa0 legacy=0x7f71d4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40b2040 con 0x7f71c0003a10 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000ba90 con 0x7f71c0004d00 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000bc50 con 0x7f71d40b1710 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 -- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 msgr2=0x7f71c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 -- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71c0004d00 msgr2=0x7f71c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d9a3e640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d923d640 1 -- 172.21.15.49:0/1923988884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0003520 con 0x7f71c0003a10 2023-12-19T05:41:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.688+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d40b1710 0x7f71c00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:03.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.689+0000 7f71d923d640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71c0003e30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c210 tx=0x7f71c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18434ebd74c015d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0005ad0 con 0x7f71c0003a10 2023-12-19T05:41:03.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0005c30 con 0x7f71c0003a10 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71cbfff640 1 -- 172.21.15.49:0/1923988884 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d002c7c0 con 0x7f71c0003a10 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 -- 172.21.15.49:0/1923988884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 msgr2=0x7f71c0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 --2- 172.21.15.49:0/1923988884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71c0003e30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c210 tx=0x7f71c00057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71d9a3e640 1 -- 172.21.15.49:0/1923988884 reap_dead start 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 -- 172.21.15.49:0/1923988884 shutdown_connections 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 -- 172.21.15.49:0/1923988884 >> 172.21.15.49:0/1923988884 conn(0x7f71d40cbb70 msgr2=0x7f71d40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 -- 172.21.15.49:0/1923988884 shutdown_connections 2023-12-19T05:41:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.690+0000 7f71db4a1640 1 -- 172.21.15.49:0/1923988884 wait complete. 2023-12-19T05:41:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.692+0000 7f71db4a1640 1 Processor -- start 2023-12-19T05:41:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.692+0000 7f71db4a1640 1 -- start start 2023-12-19T05:41:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d4151af0 0x7f71d40ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d4151f70 0x7f71d40ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415f9c0 con 0x7f71c0003a10 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415fca0 con 0x7f71d4151f70 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71db4a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d41551a0 con 0x7f71d4151af0 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.693+0000 7f71d923d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44756/0 (socket says 172.21.15.49:44756) 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 -- 172.21.15.49:0/2706693924 learned_addr learned my addr 172.21.15.49:0/2706693924 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d4151af0 0x7f71d40ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d9a3e640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d4151f70 0x7f71d40ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 -- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d4151af0 msgr2=0x7f71d40ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d4151af0 0x7f71d40ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 -- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d4151f70 msgr2=0x7f71d40ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d4151f70 0x7f71d40ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 -- 172.21.15.49:0/2706693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4155480 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.694+0000 7f71d923d640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71d0001930 tx=0x7f71d0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.695+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d003c040 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.695+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d002cbd0 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.695+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007070 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.695+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d4155760 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.695+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d4155c80 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.696+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4061910 con 0x7f71c0003a10 2023-12-19T05:41:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.697+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71d0032070 con 0x7f71c0003a10 2023-12-19T05:41:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.698+0000 7f71c9ffb640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 0x7f71b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.698+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d00a9900 con 0x7f71c0003a10 2023-12-19T05:41:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.699+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 0x7f71b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.700+0000 7f71d8a3c640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 0x7f71b806c920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71d415ff50 tx=0x7f71c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.704+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71d0074e50 con 0x7f71c0003a10 2023-12-19T05:41:03.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.899+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71d40cb900 con 0x7f71c0003a10 2023-12-19T05:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.901+0000 7f71c9ffb640 1 -- 172.21.15.49:0/2706693924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f71d0078470 con 0x7f71c0003a10 2023-12-19T05:41:03.903 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:03.903 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:02.974339+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:03.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 msgr2=0x7f71b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 0x7f71b806c920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71d415ff50 tx=0x7f71c4008040 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 msgr2=0x7f71d414dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71d0001930 tx=0x7f71d0001a00 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 shutdown_connections 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f71b806a460 0x7f71b806c920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71d4151af0 0x7f71d40ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d4151f70 0x7f71d40ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 --2- 172.21.15.49:0/2706693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71c0003a10 0x7f71d414dd50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 >> 172.21.15.49:0/2706693924 conn(0x7f71d40cbb70 msgr2=0x7f71d415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 shutdown_connections 2023-12-19T05:41:03.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:03.904+0000 7f71db4a1640 1 -- 172.21.15.49:0/2706693924 wait complete. 2023-12-19T05:41:03.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:41:04.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.161+0000 7f9704f6e640 1 Processor -- start 2023-12-19T05:41:04.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.162+0000 7f9704f6e640 1 -- start start 2023-12-19T05:41:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f9704f6e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f970015b3c0 0x7f970015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f9704f6e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97000cc540 0x7f970006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f9704f6e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9700161510 con 0x7f970006f6a0 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f9704f6e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970015ed70 con 0x7f97000cc540 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f9704f6e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970015e4d0 con 0x7f970015b3c0 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f96fdd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97000cc540 0x7f970006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f96fed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f970006f6a0 0x7f970006c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39054/0 (socket says 172.21.15.49:39054) 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f96fed9d640 1 -- 172.21.15.49:0/3042377452 learned_addr learned my addr 172.21.15.49:0/3042377452 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:04.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.163+0000 7f96fdd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97000cc540 0x7f970006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42694/0 (socket says 172.21.15.49:42694) 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.164+0000 7f96fe59c640 1 --2- 172.21.15.49:0/3042377452 >> v2:172.21.15.115:3300/0 conn(0x7f970015b3c0 0x7f970015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.164+0000 7f96fdd9b640 1 -- 172.21.15.49:0/3042377452 >> v2:172.21.15.115:3300/0 conn(0x7f970015b3c0 msgr2=0x7f970015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.164+0000 7f96fdd9b640 1 --2- 172.21.15.49:0/3042377452 >> v2:172.21.15.115:3300/0 conn(0x7f970015b3c0 0x7f970015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.164+0000 7f96fdd9b640 1 -- 172.21.15.49:0/3042377452 >> v1:172.21.15.49:6789/0 conn(0x7f970006f6a0 legacy=0x7f970006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.164+0000 7f96fdd9b640 1 -- 172.21.15.49:0/3042377452 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970015e7b0 con 0x7f97000cc540 2023-12-19T05:41:04.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.165+0000 7f96fdd9b640 1 --2- 172.21.15.49:0/3042377452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97000cc540 0x7f970006f160 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097a0 tx=0x7f96e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4400fd8c2a093ad2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:04.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.165+0000 7f96fd59a640 1 -- 172.21.15.49:0/3042377452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8031830 con 0x7f97000cc540 2023-12-19T05:41:04.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f96fd59a640 1 -- 172.21.15.49:0/3042377452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8031990 con 0x7f97000cc540 2023-12-19T05:41:04.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f96fd59a640 1 -- 172.21.15.49:0/3042377452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8031d20 con 0x7f97000cc540 2023-12-19T05:41:04.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 -- 172.21.15.49:0/3042377452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97000cc540 msgr2=0x7f970006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 --2- 172.21.15.49:0/3042377452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97000cc540 0x7f970006f160 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097a0 tx=0x7f96e802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 -- 172.21.15.49:0/3042377452 shutdown_connections 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 --2- 172.21.15.49:0/3042377452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97000cc540 0x7f970006f160 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 --2- 172.21.15.49:0/3042377452 >> v2:172.21.15.115:3300/0 conn(0x7f970015b3c0 0x7f970015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 -- 172.21.15.49:0/3042377452 >> 172.21.15.49:0/3042377452 conn(0x7f97000d01a0 msgr2=0x7f97000d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 -- 172.21.15.49:0/3042377452 shutdown_connections 2023-12-19T05:41:04.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.166+0000 7f9704f6e640 1 -- 172.21.15.49:0/3042377452 wait complete. 2023-12-19T05:41:04.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.168+0000 7f9704f6e640 1 Processor -- start 2023-12-19T05:41:04.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.168+0000 7f9704f6e640 1 -- start start 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97000cc540 0x7f97000ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970015b3c0 0x7f97001f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97000ce140 con 0x7f970006f6a0 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97001f74e0 con 0x7f970015b3c0 2023-12-19T05:41:04.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f9704f6e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970015a3c0 con 0x7f97000cc540 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.169+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42696/0 (socket says 172.21.15.49:42696) 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 -- 172.21.15.49:0/2890842837 learned_addr learned my addr 172.21.15.49:0/2890842837 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fdd9b640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97000cc540 0x7f97000ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fed9d640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970015b3c0 0x7f97001f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 -- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97000cc540 msgr2=0x7f97000ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97000cc540 0x7f97000ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 -- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970015b3c0 msgr2=0x7f97001f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970015b3c0 0x7f97001f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 -- 172.21.15.49:0/2890842837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009400 con 0x7f970006f6a0 2023-12-19T05:41:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.170+0000 7f96fe59c640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96f0007ef0 tx=0x7f96f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.171+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0014620 con 0x7f970006f6a0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.171+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0014780 con 0x7f970006f6a0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.171+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0014b30 con 0x7f970006f6a0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.171+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97000ce2d0 con 0x7f970006f6a0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.171+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97000cb130 con 0x7f970006f6a0 2023-12-19T05:41:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.172+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97000674e0 con 0x7f970006f6a0 2023-12-19T05:41:04.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.173+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96f0014c90 con 0x7f970006f6a0 2023-12-19T05:41:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.174+0000 7f96f6ffd640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 0x7f96e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.174+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96f00893c0 con 0x7f970006f6a0 2023-12-19T05:41:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.174+0000 7f96fdd9b640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 0x7f96e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.176+0000 7f96fdd9b640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 0x7f96e006c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96e8036000 tx=0x7f96e8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:04.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.178+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f96f0054910 con 0x7f970006f6a0 2023-12-19T05:41:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:04.409+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9700061910 con 0x7f970006f6a0 2023-12-19T05:41:05.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.005+0000 7f96f6ffd640 1 -- 172.21.15.49:0/2890842837 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f96f0057f30 con 0x7f970006f6a0 2023-12-19T05:41:05.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 msgr2=0x7f96e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 0x7f96e006c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96e8036000 tx=0x7f96e8008030 comp rx=0 tx=0).stop 2023-12-19T05:41:05.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 msgr2=0x7f97001427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96f0007ef0 tx=0x7f96f000e4b0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 shutdown_connections 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e006a430 0x7f96e006c8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97000cc540 0x7f97000ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970015b3c0 0x7f97001f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 --2- 172.21.15.49:0/2890842837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f970006f6a0 0x7f97001427a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 >> 172.21.15.49:0/2890842837 conn(0x7f97000d01a0 msgr2=0x7f97001564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 shutdown_connections 2023-12-19T05:41:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.009+0000 7f9704f6e640 1 -- 172.21.15.49:0/2890842837 wait complete. 2023-12-19T05:41:05.030 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:41:05.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:41:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.241+0000 7f50e8851640 1 Processor -- start 2023-12-19T05:41:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.242+0000 7f50e8851640 1 -- start start 2023-12-19T05:41:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.243+0000 7f50e8851640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.243+0000 7f50e8851640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f50e415e040 0x7f50e415e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.243+0000 7f50e8851640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e406e890 con 0x7f50e406e410 2023-12-19T05:41:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.243+0000 7f50e8851640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e415e9c0 con 0x7f50e415e040 2023-12-19T05:41:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.243+0000 7f50e8851640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b2600 con 0x7f50e4157aa0 2023-12-19T05:41:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.244+0000 7f50e259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.244+0000 7f50e259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:58882/0 (socket says 172.21.15.49:58882) 2023-12-19T05:41:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.244+0000 7f50e259c640 1 -- 172.21.15.49:0/2513139180 learned_addr learned my addr 172.21.15.49:0/2513139180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.244+0000 7f50e2d9d640 1 --2- 172.21.15.49:0/2513139180 >> v2:172.21.15.115:3300/0 conn(0x7f50e415e040 0x7f50e415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.245+0000 7f50e259c640 1 -- 172.21.15.49:0/2513139180 >> v2:172.21.15.115:3300/0 conn(0x7f50e415e040 msgr2=0x7f50e415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.245+0000 7f50e259c640 1 --2- 172.21.15.49:0/2513139180 >> v2:172.21.15.115:3300/0 conn(0x7f50e415e040 0x7f50e415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.245+0000 7f50e259c640 1 -- 172.21.15.49:0/2513139180 >> v1:172.21.15.115:6789/0 conn(0x7f50e406e410 legacy=0x7f50e4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.245+0000 7f50e259c640 1 -- 172.21.15.49:0/2513139180 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40b1d60 con 0x7f50e4157aa0 2023-12-19T05:41:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.247+0000 7f50e259c640 1 --2- 172.21.15.49:0/2513139180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009870 tx=0x7f50d402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38076e317f89eb94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.247+0000 7f50e1d9b640 1 -- 172.21.15.49:0/2513139180 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4030840 con 0x7f50e4157aa0 2023-12-19T05:41:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.247+0000 7f50e1d9b640 1 -- 172.21.15.49:0/2513139180 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d40309a0 con 0x7f50e4157aa0 2023-12-19T05:41:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.247+0000 7f50e1d9b640 1 -- 172.21.15.49:0/2513139180 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4030d30 con 0x7f50e4157aa0 2023-12-19T05:41:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 -- 172.21.15.49:0/2513139180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 msgr2=0x7f50e40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 --2- 172.21.15.49:0/2513139180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009870 tx=0x7f50d402b980 comp rx=0 tx=0).stop 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 -- 172.21.15.49:0/2513139180 shutdown_connections 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 --2- 172.21.15.49:0/2513139180 >> v2:172.21.15.115:3300/0 conn(0x7f50e415e040 0x7f50e415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 --2- 172.21.15.49:0/2513139180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e4157aa0 0x7f50e40b1710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 -- 172.21.15.49:0/2513139180 >> 172.21.15.49:0/2513139180 conn(0x7f50e40cbb70 msgr2=0x7f50e40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 -- 172.21.15.49:0/2513139180 shutdown_connections 2023-12-19T05:41:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.248+0000 7f50e8851640 1 -- 172.21.15.49:0/2513139180 wait complete. 2023-12-19T05:41:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.250+0000 7f50e8851640 1 Processor -- start 2023-12-19T05:41:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.250+0000 7f50e8851640 1 -- start start 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50e4157aa0 0x7f50e41603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e415e040 0x7f50e414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4158c80 con 0x7f50e406e410 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4158f60 con 0x7f50e4157aa0 2023-12-19T05:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e8851640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4159240 con 0x7f50e415e040 2023-12-19T05:41:05.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42710/0 (socket says 172.21.15.49:42710) 2023-12-19T05:41:05.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e259c640 1 -- 172.21.15.49:0/577261616 learned_addr learned my addr 172.21.15.49:0/577261616 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50dbfff640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50e4157aa0 0x7f50e41603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.252+0000 7f50e2d9d640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e415e040 0x7f50e414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 -- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e415e040 msgr2=0x7f50e414c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e415e040 0x7f50e414c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 -- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50e4157aa0 msgr2=0x7f50e41603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50e4157aa0 0x7f50e41603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 -- 172.21.15.49:0/577261616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40094d0 con 0x7f50e406e410 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e259c640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000c00 tx=0x7f50d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4039c90 con 0x7f50e406e410 2023-12-19T05:41:05.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4039df0 con 0x7f50e406e410 2023-12-19T05:41:05.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4043640 con 0x7f50e406e410 2023-12-19T05:41:05.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.253+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4159520 con 0x7f50e406e410 2023-12-19T05:41:05.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.254+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4160920 con 0x7f50e406e410 2023-12-19T05:41:05.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.255+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e4160ab0 con 0x7f50e406e410 2023-12-19T05:41:05.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.256+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f50d40437a0 con 0x7f50e406e410 2023-12-19T05:41:05.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.257+0000 7f50daffd640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 0x7f50c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:05.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.257+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50d403e070 con 0x7f50e406e410 2023-12-19T05:41:05.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.258+0000 7f50dbfff640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 0x7f50c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:05.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.259+0000 7f50dbfff640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 0x7f50c406c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50e415a4c0 tx=0x7f50cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:05.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.262+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f50d4076f40 con 0x7f50e406e410 2023-12-19T05:41:05.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:05.499+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f50e4061910 con 0x7f50e406e410 2023-12-19T05:41:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.205+0000 7f50daffd640 1 -- 172.21.15.49:0/577261616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50d407a560 con 0x7f50e406e410 2023-12-19T05:41:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 msgr2=0x7f50c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 0x7f50c406c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50e415a4c0 tx=0x7f50cc009040 comp rx=0 tx=0).stop 2023-12-19T05:41:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 msgr2=0x7f50e4159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000c00 tx=0x7f50d4004730 comp rx=0 tx=0).stop 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 shutdown_connections 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f50c406a430 0x7f50c406c8f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50e415e040 0x7f50e414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50e4157aa0 0x7f50e41603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 --2- 172.21.15.49:0/577261616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e406e410 0x7f50e4159d20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 >> 172.21.15.49:0/577261616 conn(0x7f50e40cbb70 msgr2=0x7f50e40ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.209+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 shutdown_connections 2023-12-19T05:41:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.210+0000 7f50e8851640 1 -- 172.21.15.49:0/577261616 wait complete. 2023-12-19T05:41:06.233 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:41:06.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:06.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.462+0000 7f3cf08a1640 1 Processor -- start 2023-12-19T05:41:06.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.462+0000 7f3cf08a1640 1 -- start start 2023-12-19T05:41:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cf08a1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3cec1449e0 0x7f3cec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cf08a1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cec0b0b50 0x7f3cec06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cf08a1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0afb10 con 0x7f3cec06b590 2023-12-19T05:41:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cf08a1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec06bb30 con 0x7f3cec0b0b50 2023-12-19T05:41:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cf08a1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec0b0070 con 0x7f3cec1449e0 2023-12-19T05:41:06.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3cead9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3cec06b590 0x7f3cec15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39066/0 (socket says 172.21.15.49:39066) 2023-12-19T05:41:06.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3cead9d640 1 -- 172.21.15.49:0/2024219983 learned_addr learned my addr 172.21.15.49:0/2024219983 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.464+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/2024219983 >> v2:172.21.15.49:3300/0 conn(0x7f3cec0b0b50 0x7f3cec06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3cea59c640 1 --2- 172.21.15.49:0/2024219983 >> v2:172.21.15.115:3300/0 conn(0x7f3cec1449e0 0x7f3cec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3ce3fff640 1 -- 172.21.15.49:0/2024219983 >> v2:172.21.15.115:3300/0 conn(0x7f3cec1449e0 msgr2=0x7f3cec0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/2024219983 >> v2:172.21.15.115:3300/0 conn(0x7f3cec1449e0 0x7f3cec0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3ce3fff640 1 -- 172.21.15.49:0/2024219983 >> v1:172.21.15.49:6789/0 conn(0x7f3cec06b590 legacy=0x7f3cec15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3ce3fff640 1 -- 172.21.15.49:0/2024219983 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0b0350 con 0x7f3cec0b0b50 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.465+0000 7f3ce9d9b640 1 -- 172.21.15.49:0/2024219983 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044674644 0 0) 0x7f3cec0afb10 con 0x7f3cec06b590 2023-12-19T05:41:06.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.466+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/2024219983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec06bfa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3cec071cd0 tx=0x7f3cd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2bd8fe1eb7b71d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3ce9d9b640 1 -- 172.21.15.49:0/2024219983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4031830 con 0x7f3cec0b0b50 2023-12-19T05:41:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3ce9d9b640 1 -- 172.21.15.49:0/2024219983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4031990 con 0x7f3cec0b0b50 2023-12-19T05:41:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3ce9d9b640 1 -- 172.21.15.49:0/2024219983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4031d20 con 0x7f3cec0b0b50 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3cf08a1640 1 -- 172.21.15.49:0/2024219983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 msgr2=0x7f3cec06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/2024219983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec06bfa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3cec071cd0 tx=0x7f3cd402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3cf08a1640 1 -- 172.21.15.49:0/2024219983 shutdown_connections 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.467+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/2024219983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec06bfa0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.468+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/2024219983 >> v2:172.21.15.115:3300/0 conn(0x7f3cec1449e0 0x7f3cec0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.468+0000 7f3cf08a1640 1 -- 172.21.15.49:0/2024219983 >> 172.21.15.49:0/2024219983 conn(0x7f3cec0cbb70 msgr2=0x7f3cec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.468+0000 7f3cf08a1640 1 -- 172.21.15.49:0/2024219983 shutdown_connections 2023-12-19T05:41:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.468+0000 7f3cf08a1640 1 -- 172.21.15.49:0/2024219983 wait complete. 2023-12-19T05:41:06.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.469+0000 7f3cf08a1640 1 Processor -- start 2023-12-19T05:41:06.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.470+0000 7f3cf08a1640 1 -- start start 2023-12-19T05:41:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec06b590 0x7f3cec1f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cec1449e0 0x7f3cec06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec15cda0 con 0x7f3cec0b0b50 2023-12-19T05:41:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1f7430 con 0x7f3cec06b590 2023-12-19T05:41:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cf08a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1f6e70 con 0x7f3cec1449e0 2023-12-19T05:41:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42732/0 (socket says 172.21.15.49:42732) 2023-12-19T05:41:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 -- 172.21.15.49:0/4063654235 learned_addr learned my addr 172.21.15.49:0/4063654235 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cead9d640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cec1449e0 0x7f3cec06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3cea59c640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec06b590 0x7f3cec1f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 -- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cec1449e0 msgr2=0x7f3cec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cec1449e0 0x7f3cec06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 -- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec06b590 msgr2=0x7f3cec1f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec06b590 0x7f3cec1f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.471+0000 7f3ce3fff640 1 -- 172.21.15.49:0/4063654235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009400 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3ce3fff640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4004230 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40043b0 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec1f7150 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4004520 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.472+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec15d290 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.473+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec15d480 con 0x7f3cec0b0b50 2023-12-19T05:41:06.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.474+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cd403a8a0 con 0x7f3cec0b0b50 2023-12-19T05:41:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.475+0000 7f3ce2ffd640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 0x7f3ccc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.475+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cd40aaf00 con 0x7f3cec0b0b50 2023-12-19T05:41:06.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.476+0000 7f3cea59c640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 0x7f3ccc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.477+0000 7f3cea59c640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 0x7f3ccc06c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006fd0 tx=0x7f3cdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.480+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3cd40766a0 con 0x7f3cec0b0b50 2023-12-19T05:41:06.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.712+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cec061910 con 0x7f3cec0b0b50 2023-12-19T05:41:06.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.713+0000 7f3ce2ffd640 1 -- 172.21.15.49:0/4063654235 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f3cd4079cc0 con 0x7f3cec0b0b50 2023-12-19T05:41:06.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:06.715 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:06.715 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.715+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 msgr2=0x7f3ccc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.715+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 0x7f3ccc06c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006fd0 tx=0x7f3cdc008040 comp rx=0 tx=0).stop 2023-12-19T05:41:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.715+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 msgr2=0x7f3cec13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.715+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd40046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 shutdown_connections 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ccc06a460 0x7f3ccc06c920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cec1449e0 0x7f3cec06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cec0b0b50 0x7f3cec13ea50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 --2- 172.21.15.49:0/4063654235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec06b590 0x7f3cec1f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 >> 172.21.15.49:0/4063654235 conn(0x7f3cec0cbb70 msgr2=0x7f3cec0701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 shutdown_connections 2023-12-19T05:41:06.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.716+0000 7f3cf08a1640 1 -- 172.21.15.49:0/4063654235 wait complete. 2023-12-19T05:41:06.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.964+0000 7f76ed7f6640 1 Processor -- start 2023-12-19T05:41:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.964+0000 7f76ed7f6640 1 -- start start 2023-12-19T05:41:06.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.966+0000 7f76ed7f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 0x7f76e806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.966+0000 7f76ed7f6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76e815e040 0x7f76e815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.966+0000 7f76ed7f6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e815e9c0 con 0x7f76e8157aa0 2023-12-19T05:41:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.966+0000 7f76ed7f6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e80b2600 con 0x7f76e815e040 2023-12-19T05:41:06.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.966+0000 7f76ed7f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80b1d60 con 0x7f76e80b1710 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e6ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f76e8157aa0 0x7f76e8161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39068/0 (socket says 172.21.15.49:39068) 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e6ffd640 1 -- 172.21.15.49:0/4169610795 learned_addr learned my addr 172.21.15.49:0/4169610795 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e67fc640 1 --2- 172.21.15.49:0/4169610795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 0x7f76e806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e77fe640 1 --2- 172.21.15.49:0/4169610795 >> v2:172.21.15.115:3300/0 conn(0x7f76e815e040 0x7f76e815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e5ffb640 1 -- 172.21.15.49:0/4169610795 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803695889 0 0) 0x7f76e815e9c0 con 0x7f76e8157aa0 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.967+0000 7f76e5ffb640 1 -- 172.21.15.49:0/4169610795 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d0003520 con 0x7f76e8157aa0 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.968+0000 7f76e67fc640 1 -- 172.21.15.49:0/4169610795 >> v2:172.21.15.115:3300/0 conn(0x7f76e815e040 msgr2=0x7f76e815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.968+0000 7f76e67fc640 1 --2- 172.21.15.49:0/4169610795 >> v2:172.21.15.115:3300/0 conn(0x7f76e815e040 0x7f76e815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.968+0000 7f76e67fc640 1 -- 172.21.15.49:0/4169610795 >> v1:172.21.15.49:6789/0 conn(0x7f76e8157aa0 legacy=0x7f76e8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.968+0000 7f76e67fc640 1 -- 172.21.15.49:0/4169610795 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80b2040 con 0x7f76e80b1710 2023-12-19T05:41:06.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.969+0000 7f76e67fc640 1 --2- 172.21.15.49:0/4169610795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 0x7f76e806e410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0097a0 tx=0x7f76dc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31d73061862bac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.969+0000 7f76e5ffb640 1 -- 172.21.15.49:0/4169610795 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc02d040 con 0x7f76e80b1710 2023-12-19T05:41:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76e5ffb640 1 -- 172.21.15.49:0/4169610795 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc031810 con 0x7f76e80b1710 2023-12-19T05:41:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76e5ffb640 1 -- 172.21.15.49:0/4169610795 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc031ba0 con 0x7f76e80b1710 2023-12-19T05:41:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 -- 172.21.15.49:0/4169610795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 msgr2=0x7f76e806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/4169610795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 0x7f76e806e410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0097a0 tx=0x7f76dc02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 -- 172.21.15.49:0/4169610795 shutdown_connections 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/4169610795 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e80b1710 0x7f76e806e410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/4169610795 >> v2:172.21.15.115:3300/0 conn(0x7f76e815e040 0x7f76e815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 -- 172.21.15.49:0/4169610795 >> 172.21.15.49:0/4169610795 conn(0x7f76e80cbb70 msgr2=0x7f76e80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 -- 172.21.15.49:0/4169610795 shutdown_connections 2023-12-19T05:41:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.970+0000 7f76ed7f6640 1 -- 172.21.15.49:0/4169610795 wait complete. 2023-12-19T05:41:06.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.972+0000 7f76ed7f6640 1 Processor -- start 2023-12-19T05:41:06.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.972+0000 7f76ed7f6640 1 -- start start 2023-12-19T05:41:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 0x7f76e8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e815e040 0x7f76e806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81585a0 con 0x7f76e8157aa0 2023-12-19T05:41:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80709e0 con 0x7f76e80b1710 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.973+0000 7f76ed7f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e806d640 con 0x7f76e815e040 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42736/0 (socket says 172.21.15.49:42736) 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 -- 172.21.15.49:0/1921195535 learned_addr learned my addr 172.21.15.49:0/1921195535 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e77fe640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e815e040 0x7f76e806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e6ffd640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 0x7f76e8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 -- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e815e040 msgr2=0x7f76e806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e815e040 0x7f76e806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 -- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 msgr2=0x7f76e8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 0x7f76e8154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e67fc640 1 -- 172.21.15.49:0/1921195535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc009400 con 0x7f76e8157aa0 2023-12-19T05:41:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.974+0000 7f76e6ffd640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 0x7f76e8154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76e67fc640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0098c0 tx=0x7f76dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc03ad60 con 0x7f76e8157aa0 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc044400 con 0x7f76e8157aa0 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e806d080 con 0x7f76e8157aa0 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0445b0 con 0x7f76e8157aa0 2023-12-19T05:41:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.975+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e81581c0 con 0x7f76e8157aa0 2023-12-19T05:41:06.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.976+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e81586e0 con 0x7f76e8157aa0 2023-12-19T05:41:06.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.977+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76dc04d440 con 0x7f76e8157aa0 2023-12-19T05:41:06.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.978+0000 7f76cf7fe640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 0x7f76d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:06.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.978+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76dc0aab50 con 0x7f76e8157aa0 2023-12-19T05:41:06.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.979+0000 7f76e6ffd640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 0x7f76d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:06.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.980+0000 7f76e6ffd640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 0x7f76d406c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76d80011e0 tx=0x7f76d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:06.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:06.982+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76e81586e0 con 0x7f76e8157aa0 2023-12-19T05:41:07.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.176+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e81586e0 con 0x7f76e8157aa0 2023-12-19T05:41:07.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.179+0000 7f76cf7fe640 1 -- 172.21.15.49:0/1921195535 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f76e81586e0 con 0x7f76e8157aa0 2023-12-19T05:41:07.181 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:07.181 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:03.979105+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:07.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 msgr2=0x7f76d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 0x7f76d406c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76d80011e0 tx=0x7f76d8009040 comp rx=0 tx=0).stop 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 msgr2=0x7f76e80cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0098c0 tx=0x7f76dc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 shutdown_connections 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f76d406a430 0x7f76d406c8f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e815e040 0x7f76e806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e8157aa0 0x7f76e80cf700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 --2- 172.21.15.49:0/1921195535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e80b1710 0x7f76e8154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 >> 172.21.15.49:0/1921195535 conn(0x7f76e80cbb70 msgr2=0x7f76e815cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.182+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 shutdown_connections 2023-12-19T05:41:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.183+0000 7f76ed7f6640 1 -- 172.21.15.49:0/1921195535 wait complete. 2023-12-19T05:41:07.205 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:41:07.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:41:07.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.425+0000 7fca88856640 1 Processor -- start 2023-12-19T05:41:07.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.426+0000 7fca88856640 1 -- start start 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.427+0000 7fca88856640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca8415e3f0 0x7fca840b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.427+0000 7fca88856640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca840acfc0 0x7fca8406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.427+0000 7fca88856640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840b2fa0 con 0x7fca840b2460 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.427+0000 7fca88856640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8406f600 con 0x7fca840acfc0 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.427+0000 7fca88856640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8415e7d0 con 0x7fca8415e3f0 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca840acfc0 0x7fca8406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca840acfc0 0x7fca8406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42752/0 (socket says 172.21.15.49:42752) 2023-12-19T05:41:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 -- 172.21.15.49:0/1758187388 learned_addr learned my addr 172.21.15.49:0/1758187388 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca82d9d640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca8415e3f0 0x7fca840b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 -- 172.21.15.49:0/1758187388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca8415e3f0 msgr2=0x7fca840b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca8415e3f0 0x7fca840b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 -- 172.21.15.49:0/1758187388 >> v1:172.21.15.115:6789/0 conn(0x7fca840b2460 legacy=0x7fca840ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.428+0000 7fca8359e640 1 -- 172.21.15.49:0/1758187388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840b29e0 con 0x7fca840acfc0 2023-12-19T05:41:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca8359e640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca840acfc0 0x7fca8406fa90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e50 tx=0x7fca7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b14134c59afc1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca8259c640 1 -- 172.21.15.49:0/1758187388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c02c9e0 con 0x7fca840acfc0 2023-12-19T05:41:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca8259c640 1 -- 172.21.15.49:0/1758187388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c02cb40 con 0x7fca840acfc0 2023-12-19T05:41:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca8259c640 1 -- 172.21.15.49:0/1758187388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0343f0 con 0x7fca840acfc0 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca88856640 1 -- 172.21.15.49:0/1758187388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca840acfc0 msgr2=0x7fca8406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.430+0000 7fca88856640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca840acfc0 0x7fca8406fa90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e50 tx=0x7fca7c02be40 comp rx=0 tx=0).stop 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 -- 172.21.15.49:0/1758187388 shutdown_connections 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca840acfc0 0x7fca8406fa90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 --2- 172.21.15.49:0/1758187388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca8415e3f0 0x7fca840b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 -- 172.21.15.49:0/1758187388 >> 172.21.15.49:0/1758187388 conn(0x7fca840b0100 msgr2=0x7fca840b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 -- 172.21.15.49:0/1758187388 shutdown_connections 2023-12-19T05:41:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.431+0000 7fca88856640 1 -- 172.21.15.49:0/1758187388 wait complete. 2023-12-19T05:41:07.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.432+0000 7fca88856640 1 Processor -- start 2023-12-19T05:41:07.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.433+0000 7fca88856640 1 -- start start 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.433+0000 7fca88856640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca840acfc0 0x7fca841585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.433+0000 7fca88856640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca840b2460 0x7fca84142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca88856640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca88856640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84145660 con 0x7fca8415e3f0 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca88856640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84159df0 con 0x7fca840acfc0 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca88856640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca84143510 con 0x7fca840b2460 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42768/0 (socket says 172.21.15.49:42768) 2023-12-19T05:41:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 -- 172.21.15.49:0/548364179 learned_addr learned my addr 172.21.15.49:0/548364179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 -- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca840b2460 msgr2=0x7fca84142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca840b2460 0x7fca84142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 -- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca840acfc0 msgr2=0x7fca841585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca840acfc0 0x7fca841585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.434+0000 7fca8359e640 1 -- 172.21.15.49:0/548364179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009b30 con 0x7fca8415e3f0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca8359e640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fca7c036040 tx=0x7fca7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c03e450 con 0x7fca8415e3f0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c03e5d0 con 0x7fca8415e3f0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c03e980 con 0x7fca8415e3f0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca84144a50 con 0x7fca8415e3f0 2023-12-19T05:41:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.435+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca84145010 con 0x7fca8415e3f0 2023-12-19T05:41:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.436+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca84061910 con 0x7fca8415e3f0 2023-12-19T05:41:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.437+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca7c03eae0 con 0x7fca8415e3f0 2023-12-19T05:41:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.438+0000 7fca7b7fe640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 0x7fca6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.439+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca7c0ab7c0 con 0x7fca8415e3f0 2023-12-19T05:41:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.439+0000 7fca82d9d640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 0x7fca6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.440+0000 7fca82d9d640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 0x7fca6406c8f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca74006fd0 tx=0x7fca74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.443+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca7c076e50 con 0x7fca8415e3f0 2023-12-19T05:41:07.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.634+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca8406f290 con 0x7fca6406a430 2023-12-19T05:41:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.660+0000 7fca7b7fe640 1 -- 172.21.15.49:0/548364179 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279596 (secure 0 0 0) 0x7fca7400ae20 con 0x7fca6406a430 2023-12-19T05:41:07.663 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:41:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.666+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 msgr2=0x7fca6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.666+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 0x7fca6406c8f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca74006fd0 tx=0x7fca74008040 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.666+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 msgr2=0x7fca84144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.666+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fca7c036040 tx=0x7fca7c004a40 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 shutdown_connections 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca6406a430 0x7fca6406c8f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca840b2460 0x7fca84142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8415e3f0 0x7fca84144160 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 --2- 172.21.15.49:0/548364179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca840acfc0 0x7fca841585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 >> 172.21.15.49:0/548364179 conn(0x7fca840b0100 msgr2=0x7fca84157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 shutdown_connections 2023-12-19T05:41:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.667+0000 7fca88856640 1 -- 172.21.15.49:0/548364179 wait complete. 2023-12-19T05:41:07.689 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T05:41:06.541629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559688,"statfs":{"total":1600000000,"available":1597121472,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077435"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489940+0000","last_change":"2023-12-19T05:41:02.489940+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489940+0000","last_undegraded":"2023-12-19T05:41:02.489940+0000","last_fullsized":"2023-12-19T05:41:02.489940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.908180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493814+0000","last_change":"2023-12-19T05:41:02.493814+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493814+0000","last_undegraded":"2023-12-19T05:41:02.493814+0000","last_fullsized":"2023-12-19T05:41:02.493814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485618+0000","last_change":"2023-12-19T05:41:02.485618+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485618+0000","last_undegraded":"2023-12-19T05:41:02.485618+0000","last_fullsized":"2023-12-19T05:41:02.485618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:05:42.452542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481710+0000","last_change":"2023-12-19T05:41:02.481710+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481710+0000","last_undegraded":"2023-12-19T05:41:02.481710+0000","last_fullsized":"2023-12-19T05:41:02.481710+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:19.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.488336+0000","last_change":"2023-12-19T05:41:02.488336+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.488336+0000","last_undegraded":"2023-12-19T05:41:02.488336+0000","last_fullsized":"2023-12-19T05:41:02.488336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:13.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481067+0000","last_change":"2023-12-19T05:41:02.481067+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481067+0000","last_undegraded":"2023-12-19T05:41:02.481067+0000","last_fullsized":"2023-12-19T05:41:02.481067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:16:31.087909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.486325+0000","last_change":"2023-12-19T05:41:02.486325+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.486325+0000","last_undegraded":"2023-12-19T05:41:02.486325+0000","last_fullsized":"2023-12-19T05:41:02.486325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:47.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482660+0000","last_change":"2023-12-19T05:41:02.482660+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482660+0000","last_undegraded":"2023-12-19T05:41:02.482660+0000","last_fullsized":"2023-12-19T05:41:02.482660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482372+0000","last_change":"2023-12-19T05:41:02.482372+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482372+0000","last_undegraded":"2023-12-19T05:41:02.482372+0000","last_fullsized":"2023-12-19T05:41:02.482372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.494229+0000","last_change":"2023-12-19T05:41:02.494229+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.494229+0000","last_undegraded":"2023-12-19T05:41:02.494229+0000","last_fullsized":"2023-12-19T05:41:02.494229+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485463+0000","last_change":"2023-12-19T05:41:02.485463+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485463+0000","last_undegraded":"2023-12-19T05:41:02.485463+0000","last_fullsized":"2023-12-19T05:41:02.485463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493470+0000","last_change":"2023-12-19T05:41:02.493470+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493470+0000","last_undegraded":"2023-12-19T05:41:02.493470+0000","last_fullsized":"2023-12-19T05:41:02.493470+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:09.915767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482325+0000","last_change":"2023-12-19T05:41:02.482325+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482325+0000","last_undegraded":"2023-12-19T05:41:02.482325+0000","last_fullsized":"2023-12-19T05:41:02.482325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:54.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479334+0000","last_change":"2023-12-19T05:41:02.479334+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479334+0000","last_undegraded":"2023-12-19T05:41:02.479334+0000","last_fullsized":"2023-12-19T05:41:02.479334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479027+0000","last_change":"2023-12-19T05:41:02.479027+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479027+0000","last_undegraded":"2023-12-19T05:41:02.479027+0000","last_fullsized":"2023-12-19T05:41:02.479027+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:15.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489208+0000","last_change":"2023-12-19T05:41:02.489208+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489208+0000","last_undegraded":"2023-12-19T05:41:02.489208+0000","last_fullsized":"2023-12-19T05:41:02.489208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493102+0000","last_change":"2023-12-19T05:41:02.493102+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493102+0000","last_undegraded":"2023-12-19T05:41:02.493102+0000","last_fullsized":"2023-12-19T05:41:02.493102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:08.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485138+0000","last_change":"2023-12-19T05:41:02.485138+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485138+0000","last_undegraded":"2023-12-19T05:41:02.485138+0000","last_fullsized":"2023-12-19T05:41:02.485138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487980+0000","last_change":"2023-12-19T05:41:02.487980+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487980+0000","last_undegraded":"2023-12-19T05:41:02.487980+0000","last_fullsized":"2023-12-19T05:41:02.487980+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:59.457152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.490038+0000","last_change":"2023-12-19T05:41:02.490038+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.490038+0000","last_undegraded":"2023-12-19T05:41:02.490038+0000","last_fullsized":"2023-12-19T05:41:02.490038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480134+0000","last_change":"2023-12-19T05:41:02.480134+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480134+0000","last_undegraded":"2023-12-19T05:41:02.480134+0000","last_fullsized":"2023-12-19T05:41:02.480134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483910+0000","last_change":"2023-12-19T05:41:02.483910+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483910+0000","last_undegraded":"2023-12-19T05:41:02.483910+0000","last_fullsized":"2023-12-19T05:41:02.483910+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:06.461247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485634+0000","last_change":"2023-12-19T05:41:02.485634+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485634+0000","last_undegraded":"2023-12-19T05:41:02.485634+0000","last_fullsized":"2023-12-19T05:41:02.485634+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:49:50.832272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480613+0000","last_change":"2023-12-19T05:41:02.480613+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480613+0000","last_undegraded":"2023-12-19T05:41:02.480613+0000","last_fullsized":"2023-12-19T05:41:02.480613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:56:31.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487535+0000","last_change":"2023-12-19T05:41:02.487535+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487535+0000","last_undegraded":"2023-12-19T05:41:02.487535+0000","last_fullsized":"2023-12-19T05:41:02.487535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479133+0000","last_change":"2023-12-19T05:41:02.479133+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479133+0000","last_undegraded":"2023-12-19T05:41:02.479133+0000","last_fullsized":"2023-12-19T05:41:02.479133+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483586+0000","last_change":"2023-12-19T05:41:02.483586+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483586+0000","last_undegraded":"2023-12-19T05:41:02.483586+0000","last_fullsized":"2023-12-19T05:41:02.483586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:50.412798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484126+0000","last_change":"2023-12-19T05:41:02.484126+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484126+0000","last_undegraded":"2023-12-19T05:41:02.484126+0000","last_fullsized":"2023-12-19T05:41:02.484126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:35:19.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489376+0000","last_change":"2023-12-19T05:41:02.489376+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489376+0000","last_undegraded":"2023-12-19T05:41:02.489376+0000","last_fullsized":"2023-12-19T05:41:02.489376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485693+0000","last_change":"2023-12-19T05:41:02.485693+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485693+0000","last_undegraded":"2023-12-19T05:41:02.485693+0000","last_fullsized":"2023-12-19T05:41:02.485693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:53.641231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478738+0000","last_change":"2023-12-19T05:41:02.478738+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478738+0000","last_undegraded":"2023-12-19T05:41:02.478738+0000","last_fullsized":"2023-12-19T05:41:02.478738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477187+0000","last_change":"2023-12-19T05:41:02.477187+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477187+0000","last_undegraded":"2023-12-19T05:41:02.477187+0000","last_fullsized":"2023-12-19T05:41:02.477187+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485846+0000","last_change":"2023-12-19T05:41:02.485846+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485846+0000","last_undegraded":"2023-12-19T05:41:02.485846+0000","last_fullsized":"2023-12-19T05:41:02.485846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:08.427930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.495974+0000","last_change":"2023-12-19T05:41:02.495810+0000","last_active":"2023-12-19T05:41:02.495974+0000","last_peered":"2023-12-19T05:41:02.495974+0000","last_clean":"2023-12-19T05:41:02.495974+0000","last_became_active":"2023-12-19T05:41:02.495379+0000","last_became_peered":"2023-12-19T05:41:02.495379+0000","last_unstale":"2023-12-19T05:41:02.495974+0000","last_undegraded":"2023-12-19T05:41:02.495974+0000","last_fullsized":"2023-12-19T05:41:02.495974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:05.447594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485953+0000","last_change":"2023-12-19T05:41:02.485953+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485953+0000","last_undegraded":"2023-12-19T05:41:02.485953+0000","last_fullsized":"2023-12-19T05:41:02.485953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.491045+0000","last_change":"2023-12-19T05:41:02.490941+0000","last_active":"2023-12-19T05:41:02.491045+0000","last_peered":"2023-12-19T05:41:02.491045+0000","last_clean":"2023-12-19T05:41:02.491045+0000","last_became_active":"2023-12-19T05:41:02.490755+0000","last_became_peered":"2023-12-19T05:41:02.490755+0000","last_unstale":"2023-12-19T05:41:02.491045+0000","last_undegraded":"2023-12-19T05:41:02.491045+0000","last_fullsized":"2023-12-19T05:41:02.491045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:26.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482468+0000","last_change":"2023-12-19T05:41:02.482468+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482468+0000","last_undegraded":"2023-12-19T05:41:02.482468+0000","last_fullsized":"2023-12-19T05:41:02.482468+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:51:11.564108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.497137+0000","last_change":"2023-12-19T05:41:02.496221+0000","last_active":"2023-12-19T05:41:02.497137+0000","last_peered":"2023-12-19T05:41:02.497137+0000","last_clean":"2023-12-19T05:41:02.497137+0000","last_became_active":"2023-12-19T05:41:02.495521+0000","last_became_peered":"2023-12-19T05:41:02.495521+0000","last_unstale":"2023-12-19T05:41:02.497137+0000","last_undegraded":"2023-12-19T05:41:02.497137+0000","last_fullsized":"2023-12-19T05:41:02.497137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:42.544673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478106+0000","last_change":"2023-12-19T05:41:02.478106+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478106+0000","last_undegraded":"2023-12-19T05:41:02.478106+0000","last_fullsized":"2023-12-19T05:41:02.478106+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:23.470088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496494+0000","last_change":"2023-12-19T05:41:02.496412+0000","last_active":"2023-12-19T05:41:02.496494+0000","last_peered":"2023-12-19T05:41:02.496494+0000","last_clean":"2023-12-19T05:41:02.496494+0000","last_became_active":"2023-12-19T05:41:02.496196+0000","last_became_peered":"2023-12-19T05:41:02.496196+0000","last_unstale":"2023-12-19T05:41:02.496494+0000","last_undegraded":"2023-12-19T05:41:02.496494+0000","last_fullsized":"2023-12-19T05:41:02.496494+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:36:59.476802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483606+0000","last_change":"2023-12-19T05:41:02.483606+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483606+0000","last_undegraded":"2023-12-19T05:41:02.483606+0000","last_fullsized":"2023-12-19T05:41:02.483606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:14.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.500884+0000","last_change":"2023-12-19T05:41:02.500464+0000","last_active":"2023-12-19T05:41:02.500884+0000","last_peered":"2023-12-19T05:41:02.500884+0000","last_clean":"2023-12-19T05:41:02.500884+0000","last_became_active":"2023-12-19T05:41:02.499014+0000","last_became_peered":"2023-12-19T05:41:02.499014+0000","last_unstale":"2023-12-19T05:41:02.500884+0000","last_undegraded":"2023-12-19T05:41:02.500884+0000","last_fullsized":"2023-12-19T05:41:02.500884+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:31.232661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493797+0000","last_change":"2023-12-19T05:41:02.493797+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493797+0000","last_undegraded":"2023-12-19T05:41:02.493797+0000","last_fullsized":"2023-12-19T05:41:02.493797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494314+0000","last_change":"2023-12-19T05:41:02.493834+0000","last_active":"2023-12-19T05:41:02.494314+0000","last_peered":"2023-12-19T05:41:02.494314+0000","last_clean":"2023-12-19T05:41:02.494314+0000","last_became_active":"2023-12-19T05:41:02.493485+0000","last_became_peered":"2023-12-19T05:41:02.493485+0000","last_unstale":"2023-12-19T05:41:02.494314+0000","last_undegraded":"2023-12-19T05:41:02.494314+0000","last_fullsized":"2023-12-19T05:41:02.494314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:18.657294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491572+0000","last_change":"2023-12-19T05:41:02.491572+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491572+0000","last_undegraded":"2023-12-19T05:41:02.491572+0000","last_fullsized":"2023-12-19T05:41:02.491572+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494115+0000","last_change":"2023-12-19T05:41:02.493998+0000","last_active":"2023-12-19T05:41:02.494115+0000","last_peered":"2023-12-19T05:41:02.494115+0000","last_clean":"2023-12-19T05:41:02.494115+0000","last_became_active":"2023-12-19T05:41:02.493564+0000","last_became_peered":"2023-12-19T05:41:02.493564+0000","last_unstale":"2023-12-19T05:41:02.494115+0000","last_undegraded":"2023-12-19T05:41:02.494115+0000","last_fullsized":"2023-12-19T05:41:02.494115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483220+0000","last_change":"2023-12-19T05:41:02.483220+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483220+0000","last_undegraded":"2023-12-19T05:41:02.483220+0000","last_fullsized":"2023-12-19T05:41:02.483220+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:14.010176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.497219+0000","last_change":"2023-12-19T05:41:02.496935+0000","last_active":"2023-12-19T05:41:02.497219+0000","last_peered":"2023-12-19T05:41:02.497219+0000","last_clean":"2023-12-19T05:41:02.497219+0000","last_became_active":"2023-12-19T05:41:02.496695+0000","last_became_peered":"2023-12-19T05:41:02.496695+0000","last_unstale":"2023-12-19T05:41:02.497219+0000","last_undegraded":"2023-12-19T05:41:02.497219+0000","last_fullsized":"2023-12-19T05:41:02.497219+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484741+0000","last_change":"2023-12-19T05:41:02.484741+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484741+0000","last_undegraded":"2023-12-19T05:41:02.484741+0000","last_fullsized":"2023-12-19T05:41:02.484741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499849+0000","last_change":"2023-12-19T05:41:02.499014+0000","last_active":"2023-12-19T05:41:02.499849+0000","last_peered":"2023-12-19T05:41:02.499849+0000","last_clean":"2023-12-19T05:41:02.499849+0000","last_became_active":"2023-12-19T05:41:02.498040+0000","last_became_peered":"2023-12-19T05:41:02.498040+0000","last_unstale":"2023-12-19T05:41:02.499849+0000","last_undegraded":"2023-12-19T05:41:02.499849+0000","last_fullsized":"2023-12-19T05:41:02.499849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:01:03.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.495317+0000","last_change":"2023-12-19T05:41:02.495317+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.495317+0000","last_undegraded":"2023-12-19T05:41:02.495317+0000","last_fullsized":"2023-12-19T05:41:02.495317+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:26.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502017+0000","last_change":"2023-12-19T05:41:02.499304+0000","last_active":"2023-12-19T05:41:02.502017+0000","last_peered":"2023-12-19T05:41:02.502017+0000","last_clean":"2023-12-19T05:41:02.502017+0000","last_became_active":"2023-12-19T05:41:02.498787+0000","last_became_peered":"2023-12-19T05:41:02.498787+0000","last_unstale":"2023-12-19T05:41:02.502017+0000","last_undegraded":"2023-12-19T05:41:02.502017+0000","last_fullsized":"2023-12-19T05:41:02.502017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:01.874064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.475460+0000","last_change":"2023-12-19T05:41:02.475460+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.475460+0000","last_undegraded":"2023-12-19T05:41:02.475460+0000","last_fullsized":"2023-12-19T05:41:02.475460+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.493970+0000","last_change":"2023-12-19T05:41:02.492843+0000","last_active":"2023-12-19T05:41:02.493970+0000","last_peered":"2023-12-19T05:41:02.493970+0000","last_clean":"2023-12-19T05:41:02.493970+0000","last_became_active":"2023-12-19T05:41:02.492468+0000","last_became_peered":"2023-12-19T05:41:02.492468+0000","last_unstale":"2023-12-19T05:41:02.493970+0000","last_undegraded":"2023-12-19T05:41:02.493970+0000","last_fullsized":"2023-12-19T05:41:02.493970+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483089+0000","last_change":"2023-12-19T05:41:02.483089+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483089+0000","last_undegraded":"2023-12-19T05:41:02.483089+0000","last_fullsized":"2023-12-19T05:41:02.483089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:22.133325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501272+0000","last_change":"2023-12-19T05:41:02.500015+0000","last_active":"2023-12-19T05:41:02.501272+0000","last_peered":"2023-12-19T05:41:02.501272+0000","last_clean":"2023-12-19T05:41:02.501272+0000","last_became_active":"2023-12-19T05:41:02.496783+0000","last_became_peered":"2023-12-19T05:41:02.496783+0000","last_unstale":"2023-12-19T05:41:02.501272+0000","last_undegraded":"2023-12-19T05:41:02.501272+0000","last_fullsized":"2023-12-19T05:41:02.501272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:40.888340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487850+0000","last_change":"2023-12-19T05:41:02.487850+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487850+0000","last_undegraded":"2023-12-19T05:41:02.487850+0000","last_fullsized":"2023-12-19T05:41:02.487850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:48:33.267654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499267+0000","last_change":"2023-12-19T05:41:02.497837+0000","last_active":"2023-12-19T05:41:02.499267+0000","last_peered":"2023-12-19T05:41:02.499267+0000","last_clean":"2023-12-19T05:41:02.499267+0000","last_became_active":"2023-12-19T05:41:02.497404+0000","last_became_peered":"2023-12-19T05:41:02.497404+0000","last_unstale":"2023-12-19T05:41:02.499267+0000","last_undegraded":"2023-12-19T05:41:02.499267+0000","last_fullsized":"2023-12-19T05:41:02.499267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:08.475846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485351+0000","last_change":"2023-12-19T05:41:02.485351+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485351+0000","last_undegraded":"2023-12-19T05:41:02.485351+0000","last_fullsized":"2023-12-19T05:41:02.485351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494968+0000","last_change":"2023-12-19T05:41:02.494828+0000","last_active":"2023-12-19T05:41:02.494968+0000","last_peered":"2023-12-19T05:41:02.494968+0000","last_clean":"2023-12-19T05:41:02.494968+0000","last_became_active":"2023-12-19T05:41:02.491941+0000","last_became_peered":"2023-12-19T05:41:02.491941+0000","last_unstale":"2023-12-19T05:41:02.494968+0000","last_undegraded":"2023-12-19T05:41:02.494968+0000","last_fullsized":"2023-12-19T05:41:02.494968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482803+0000","last_change":"2023-12-19T05:41:02.482803+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482803+0000","last_undegraded":"2023-12-19T05:41:02.482803+0000","last_fullsized":"2023-12-19T05:41:02.482803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501299+0000","last_change":"2023-12-19T05:41:02.501217+0000","last_active":"2023-12-19T05:41:02.501299+0000","last_peered":"2023-12-19T05:41:02.501299+0000","last_clean":"2023-12-19T05:41:02.501299+0000","last_became_active":"2023-12-19T05:41:02.500050+0000","last_became_peered":"2023-12-19T05:41:02.500050+0000","last_unstale":"2023-12-19T05:41:02.501299+0000","last_undegraded":"2023-12-19T05:41:02.501299+0000","last_fullsized":"2023-12-19T05:41:02.501299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:07.414277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.492728+0000","last_change":"2023-12-19T05:41:02.492728+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.492728+0000","last_undegraded":"2023-12-19T05:41:02.492728+0000","last_fullsized":"2023-12-19T05:41:02.492728+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501993+0000","last_change":"2023-12-19T05:41:02.501660+0000","last_active":"2023-12-19T05:41:02.501993+0000","last_peered":"2023-12-19T05:41:02.501993+0000","last_clean":"2023-12-19T05:41:02.501993+0000","last_became_active":"2023-12-19T05:41:02.500442+0000","last_became_peered":"2023-12-19T05:41:02.500442+0000","last_unstale":"2023-12-19T05:41:02.501993+0000","last_undegraded":"2023-12-19T05:41:02.501993+0000","last_fullsized":"2023-12-19T05:41:02.501993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:55.432045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484451+0000","last_change":"2023-12-19T05:41:02.484451+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484451+0000","last_undegraded":"2023-12-19T05:41:02.484451+0000","last_fullsized":"2023-12-19T05:41:02.484451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:02.802901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502918+0000","last_change":"2023-12-19T05:41:02.502812+0000","last_active":"2023-12-19T05:41:02.502918+0000","last_peered":"2023-12-19T05:41:02.502918+0000","last_clean":"2023-12-19T05:41:02.502918+0000","last_became_active":"2023-12-19T05:41:02.501062+0000","last_became_peered":"2023-12-19T05:41:02.501062+0000","last_unstale":"2023-12-19T05:41:02.502918+0000","last_undegraded":"2023-12-19T05:41:02.502918+0000","last_fullsized":"2023-12-19T05:41:02.502918+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481507+0000","last_change":"2023-12-19T05:41:02.481507+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481507+0000","last_undegraded":"2023-12-19T05:41:02.481507+0000","last_fullsized":"2023-12-19T05:41:02.481507+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:21.641940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499831+0000","last_change":"2023-12-19T05:41:02.498877+0000","last_active":"2023-12-19T05:41:02.499831+0000","last_peered":"2023-12-19T05:41:02.499831+0000","last_clean":"2023-12-19T05:41:02.499831+0000","last_became_active":"2023-12-19T05:41:02.498484+0000","last_became_peered":"2023-12-19T05:41:02.498484+0000","last_unstale":"2023-12-19T05:41:02.499831+0000","last_undegraded":"2023-12-19T05:41:02.499831+0000","last_fullsized":"2023-12-19T05:41:02.499831+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:11.775990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.488677+0000","last_change":"2023-12-19T05:41:02.488677+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.488677+0000","last_undegraded":"2023-12-19T05:41:02.488677+0000","last_fullsized":"2023-12-19T05:41:02.488677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499864+0000","last_change":"2023-12-19T05:41:02.499221+0000","last_active":"2023-12-19T05:41:02.499864+0000","last_peered":"2023-12-19T05:41:02.499864+0000","last_clean":"2023-12-19T05:41:02.499864+0000","last_became_active":"2023-12-19T05:41:02.498665+0000","last_became_peered":"2023-12-19T05:41:02.498665+0000","last_unstale":"2023-12-19T05:41:02.499864+0000","last_undegraded":"2023-12-19T05:41:02.499864+0000","last_fullsized":"2023-12-19T05:41:02.499864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:20.971597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487050+0000","last_change":"2023-12-19T05:41:02.487050+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487050+0000","last_undegraded":"2023-12-19T05:41:02.487050+0000","last_fullsized":"2023-12-19T05:41:02.487050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:12.177921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501247+0000","last_change":"2023-12-19T05:41:02.500885+0000","last_active":"2023-12-19T05:41:02.501247+0000","last_peered":"2023-12-19T05:41:02.501247+0000","last_clean":"2023-12-19T05:41:02.501247+0000","last_became_active":"2023-12-19T05:41:02.499575+0000","last_became_peered":"2023-12-19T05:41:02.499575+0000","last_unstale":"2023-12-19T05:41:02.501247+0000","last_undegraded":"2023-12-19T05:41:02.501247+0000","last_fullsized":"2023-12-19T05:41:02.501247+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:20.628288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491726+0000","last_change":"2023-12-19T05:41:02.491726+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491726+0000","last_undegraded":"2023-12-19T05:41:02.491726+0000","last_fullsized":"2023-12-19T05:41:02.491726+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501297+0000","last_change":"2023-12-19T05:41:02.498001+0000","last_active":"2023-12-19T05:41:02.501297+0000","last_peered":"2023-12-19T05:41:02.501297+0000","last_clean":"2023-12-19T05:41:02.501297+0000","last_became_active":"2023-12-19T05:41:02.497640+0000","last_became_peered":"2023-12-19T05:41:02.497640+0000","last_unstale":"2023-12-19T05:41:02.501297+0000","last_undegraded":"2023-12-19T05:41:02.501297+0000","last_fullsized":"2023-12-19T05:41:02.501297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:07.684487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479251+0000","last_change":"2023-12-19T05:41:02.479251+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479251+0000","last_undegraded":"2023-12-19T05:41:02.479251+0000","last_fullsized":"2023-12-19T05:41:02.479251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:41.901992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501629+0000","last_change":"2023-12-19T05:41:02.501432+0000","last_active":"2023-12-19T05:41:02.501629+0000","last_peered":"2023-12-19T05:41:02.501629+0000","last_clean":"2023-12-19T05:41:02.501629+0000","last_became_active":"2023-12-19T05:41:02.500921+0000","last_became_peered":"2023-12-19T05:41:02.500921+0000","last_unstale":"2023-12-19T05:41:02.501629+0000","last_undegraded":"2023-12-19T05:41:02.501629+0000","last_fullsized":"2023-12-19T05:41:02.501629+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:46:43.175554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478209+0000","last_change":"2023-12-19T05:41:02.478209+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478209+0000","last_undegraded":"2023-12-19T05:41:02.478209+0000","last_fullsized":"2023-12-19T05:41:02.478209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.503185+0000","last_change":"2023-12-19T05:41:02.502611+0000","last_active":"2023-12-19T05:41:02.503185+0000","last_peered":"2023-12-19T05:41:02.503185+0000","last_clean":"2023-12-19T05:41:02.503185+0000","last_became_active":"2023-12-19T05:41:02.502340+0000","last_became_peered":"2023-12-19T05:41:02.502340+0000","last_unstale":"2023-12-19T05:41:02.503185+0000","last_undegraded":"2023-12-19T05:41:02.503185+0000","last_fullsized":"2023-12-19T05:41:02.503185+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:30.259577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477272+0000","last_change":"2023-12-19T05:41:02.477272+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477272+0000","last_undegraded":"2023-12-19T05:41:02.477272+0000","last_fullsized":"2023-12-19T05:41:02.477272+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:30:44.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.482394+0000","last_change":"2023-12-19T05:41:02.482151+0000","last_active":"2023-12-19T05:41:02.482394+0000","last_peered":"2023-12-19T05:41:02.482394+0000","last_clean":"2023-12-19T05:41:02.482394+0000","last_became_active":"2023-12-19T05:41:02.481408+0000","last_became_peered":"2023-12-19T05:41:02.481408+0000","last_unstale":"2023-12-19T05:41:02.482394+0000","last_undegraded":"2023-12-19T05:41:02.482394+0000","last_fullsized":"2023-12-19T05:41:02.482394+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:09.900893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482611+0000","last_change":"2023-12-19T05:41:02.482611+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482611+0000","last_undegraded":"2023-12-19T05:41:02.482611+0000","last_fullsized":"2023-12-19T05:41:02.482611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:44.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492018+0000","last_change":"2023-12-19T05:41:02.491086+0000","last_active":"2023-12-19T05:41:02.492018+0000","last_peered":"2023-12-19T05:41:02.492018+0000","last_clean":"2023-12-19T05:41:02.492018+0000","last_became_active":"2023-12-19T05:41:02.487771+0000","last_became_peered":"2023-12-19T05:41:02.487771+0000","last_unstale":"2023-12-19T05:41:02.492018+0000","last_undegraded":"2023-12-19T05:41:02.492018+0000","last_fullsized":"2023-12-19T05:41:02.492018+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491192+0000","last_change":"2023-12-19T05:41:02.491192+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491192+0000","last_undegraded":"2023-12-19T05:41:02.491192+0000","last_fullsized":"2023-12-19T05:41:02.491192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501322+0000","last_change":"2023-12-19T05:41:02.501207+0000","last_active":"2023-12-19T05:41:02.501322+0000","last_peered":"2023-12-19T05:41:02.501322+0000","last_clean":"2023-12-19T05:41:02.501322+0000","last_became_active":"2023-12-19T05:41:02.500475+0000","last_became_peered":"2023-12-19T05:41:02.500475+0000","last_unstale":"2023-12-19T05:41:02.501322+0000","last_undegraded":"2023-12-19T05:41:02.501322+0000","last_fullsized":"2023-12-19T05:41:02.501322+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:26.639795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482652+0000","last_change":"2023-12-19T05:41:02.482652+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482652+0000","last_undegraded":"2023-12-19T05:41:02.482652+0000","last_fullsized":"2023-12-19T05:41:02.482652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:21.890762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502028+0000","last_change":"2023-12-19T05:41:02.499981+0000","last_active":"2023-12-19T05:41:02.502028+0000","last_peered":"2023-12-19T05:41:02.502028+0000","last_clean":"2023-12-19T05:41:02.502028+0000","last_became_active":"2023-12-19T05:41:02.499733+0000","last_became_peered":"2023-12-19T05:41:02.499733+0000","last_unstale":"2023-12-19T05:41:02.502028+0000","last_undegraded":"2023-12-19T05:41:02.502028+0000","last_fullsized":"2023-12-19T05:41:02.502028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493326+0000","last_change":"2023-12-19T05:41:02.493326+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493326+0000","last_undegraded":"2023-12-19T05:41:02.493326+0000","last_fullsized":"2023-12-19T05:41:02.493326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496304+0000","last_change":"2023-12-19T05:41:02.495242+0000","last_active":"2023-12-19T05:41:02.496304+0000","last_peered":"2023-12-19T05:41:02.496304+0000","last_clean":"2023-12-19T05:41:02.496304+0000","last_became_active":"2023-12-19T05:41:02.494329+0000","last_became_peered":"2023-12-19T05:41:02.494329+0000","last_unstale":"2023-12-19T05:41:02.496304+0000","last_undegraded":"2023-12-19T05:41:02.496304+0000","last_fullsized":"2023-12-19T05:41:02.496304+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:50.527425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477076+0000","last_change":"2023-12-19T05:41:02.477076+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477076+0000","last_undegraded":"2023-12-19T05:41:02.477076+0000","last_fullsized":"2023-12-19T05:41:02.477076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:23.806072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496477+0000","last_change":"2023-12-19T05:41:02.495475+0000","last_active":"2023-12-19T05:41:02.496477+0000","last_peered":"2023-12-19T05:41:02.496477+0000","last_clean":"2023-12-19T05:41:02.496477+0000","last_became_active":"2023-12-19T05:41:02.495251+0000","last_became_peered":"2023-12-19T05:41:02.495251+0000","last_unstale":"2023-12-19T05:41:02.496477+0000","last_undegraded":"2023-12-19T05:41:02.496477+0000","last_fullsized":"2023-12-19T05:41:02.496477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:22.792419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487108+0000","last_change":"2023-12-19T05:41:02.487108+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487108+0000","last_undegraded":"2023-12-19T05:41:02.487108+0000","last_fullsized":"2023-12-19T05:41:02.487108+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492316+0000","last_change":"2023-12-19T05:41:02.490841+0000","last_active":"2023-12-19T05:41:02.492316+0000","last_peered":"2023-12-19T05:41:02.492316+0000","last_clean":"2023-12-19T05:41:02.492316+0000","last_became_active":"2023-12-19T05:41:02.486586+0000","last_became_peered":"2023-12-19T05:41:02.486586+0000","last_unstale":"2023-12-19T05:41:02.492316+0000","last_undegraded":"2023-12-19T05:41:02.492316+0000","last_fullsized":"2023-12-19T05:41:02.492316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480486+0000","last_change":"2023-12-19T05:41:02.480486+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480486+0000","last_undegraded":"2023-12-19T05:41:02.480486+0000","last_fullsized":"2023-12-19T05:41:02.480486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502614+0000","last_change":"2023-12-19T05:41:02.502475+0000","last_active":"2023-12-19T05:41:02.502614+0000","last_peered":"2023-12-19T05:41:02.502614+0000","last_clean":"2023-12-19T05:41:02.502614+0000","last_became_active":"2023-12-19T05:41:02.502142+0000","last_became_peered":"2023-12-19T05:41:02.502142+0000","last_unstale":"2023-12-19T05:41:02.502614+0000","last_undegraded":"2023-12-19T05:41:02.502614+0000","last_fullsized":"2023-12-19T05:41:02.502614+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:19:26.512158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.475894+0000","last_change":"2023-12-19T05:41:02.475894+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.475894+0000","last_undegraded":"2023-12-19T05:41:02.475894+0000","last_fullsized":"2023-12-19T05:41:02.475894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492140+0000","last_change":"2023-12-19T05:41:02.491690+0000","last_active":"2023-12-19T05:41:02.492140+0000","last_peered":"2023-12-19T05:41:02.492140+0000","last_clean":"2023-12-19T05:41:02.492140+0000","last_became_active":"2023-12-19T05:41:02.491325+0000","last_became_peered":"2023-12-19T05:41:02.491325+0000","last_unstale":"2023-12-19T05:41:02.492140+0000","last_undegraded":"2023-12-19T05:41:02.492140+0000","last_fullsized":"2023-12-19T05:41:02.492140+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:09.559440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-19T05:41:01.465045+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:41:01.465045+0000","last_peered":"2023-12-19T05:41:01.465045+0000","last_clean":"2023-12-19T05:41:01.465045+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:41:01.465045+0000","last_undegraded":"2023-12-19T05:41:01.465045+0000","last_fullsized":"2023-12-19T05:41:01.465045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.25},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.034,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3939999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.579}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2330000000000001,"15min":1.2410000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5189999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.153},{"interface":"front","average":{"1min":1.085,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.135,"15min":1.119},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.72,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.496}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.034,"15min":1.01},"min":{"1min":0.84299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.25,"15min":1.234},"min":{"1min":1.0169999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.694,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3069999999999999,"15min":1.304},"min":{"1min":0.96099999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.216,"15min":1.212},"min":{"1min":0.82999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.458,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.079}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":1.232,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.677},{"interface":"front","average":{"1min":1.454,"5min":1.369,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.946,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.7270000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5089999999999999,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.022},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.0249999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.145,"15min":1.131},"min":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.327,"15min":1.345},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.851,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.518}]},{"osd":2,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2,"5min":2,"15min":2},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.3180000000000001,"15min":1.3360000000000001},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.738,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3740000000000001,"15min":1.409},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.857,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.379,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1579999999999999,"5min":4.452,"15min":4.452},"last":1.335}]},{"osd":4,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3720000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9219999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.474,"15min":1.514},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.7240000000000002,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.6930000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5920000000000001,"15min":1.6279999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5070000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.7589999999999999,"15min":1.8109999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0630000000000002,"5min":3.681,"15min":3.681},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5369999999999999,"15min":1.5629999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8089999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.927},{"interface":"front","average":{"1min":1.617,"5min":1.639,"15min":1.643},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.4609999999999999,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.6779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.536,"5min":2.085,"15min":2.085},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4339999999999999,"5min":2.641,"15min":2.641},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.24,"15min":1.2470000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.375},"min":{"1min":0.89400000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.984,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2490000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.2230000000000001,"15min":1.252},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5169999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.23,"15min":1.23},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.54,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.456,"15min":1.486},"min":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.998,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.4339999999999999,"15min":1.4650000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.706,"5min":2.754,"15min":2.754},"last":1.038}]},{"osd":4,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.508,"15min":1.546},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.7010000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.121},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.611,"15min":1.653},"min":{"1min":0.83399999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.8879999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.081}]},{"osd":6,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5129999999999999,"15min":1.5469999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8640000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.179},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.6950000000000001,"15min":1.7350000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8999999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.2290000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.7270000000000001,"15min":1.7649999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.0510000000000002,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.6140000000000001,"15min":1.641},"min":{"1min":0.65000000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.042,"15min":1.0509999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.27}]},{"osd":1,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":1.577},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1259999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.617},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.2},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.478,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2450000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.204}]},{"osd":5,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.431},{"interface":"front","average":{"1min":1.331,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.93700000000000006,"5min":0.75,"15min":0.75},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.401}]},{"osd":6,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.349,"15min":1.361},"min":{"1min":1.016,"5min":0.872,"15min":0.872},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.381,"15min":1.389},"min":{"1min":1.081,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.6899999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.528}]},{"osd":7,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3280000000000001,"15min":1.323},"min":{"1min":0.94299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.492},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.4470000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.863}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.524,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5089999999999999,"5min":2.702,"15min":2.702},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.41299999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.505},{"interface":"front","average":{"1min":1.111,"5min":1.048,"15min":1.038},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6140000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.149,"15min":1.149},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6779999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.877,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.8180000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3129999999999999,"15min":1.304},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.876},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7689999999999999,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8580000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.321,"15min":1.3220000000000001},"min":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8009999999999999,"5min":2.02,"15min":2.02},"last":0.72699999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9710000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.002},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.423,"15min":1.423},"min":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.968,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.748,"15min":0.747},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.097},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1919999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.012,"15min":1.024},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.464,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4790000000000001,"5min":1.595,"15min":1.595},"last":0.76500000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.542,"5min":1.704,"15min":1.704},"last":1.1559999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.256},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2030000000000001,"15min":1.2050000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.97199999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.254,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.589,"5min":1.702,"15min":1.702},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2689999999999999,"15min":1.2829999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6379999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.111}]},{"osd":6,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2649999999999999,"15min":1.27},"min":{"1min":0.84899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.802,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.288,"15min":1.288},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.379}]},{"osd":7,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3999999999999999},"min":{"1min":0.91800000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.746,"5min":2.714,"15min":2.714},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.48399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.145,"5min":2.992,"15min":2.992},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.3,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.1200000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.073,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.996},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.079},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.45,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.95899999999999996}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3029999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.595,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.206,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8680000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.76100000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.872,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.508,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.679,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.7150000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3069999999999999,"15min":1.3220000000000001},"min":{"1min":0.82699999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7909999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.899,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.8620000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3779999999999999,"15min":1.389},"min":{"1min":0.78000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7729999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3879999999999999,"15min":1.397},"min":{"1min":0.88700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6839999999999999,"5min":2.319,"15min":2.319},"last":1.7749999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4770000000000001,"15min":1.4910000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7390000000000001,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.821},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.5589999999999999,"15min":1.579},"min":{"1min":1.038,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.853,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":1.6319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.79100000000000004,"15min":0.77400000000000002},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4119999999999999,"5min":1.427,"15min":1.427},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85699999999999998,"15min":0.86399999999999999},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.0469999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.496,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.1259999999999999,"15min":1.143},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6259999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.25}]},{"osd":3,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3160000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.071},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.601,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.79100000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.571,"15min":1.571},"last":1.194},{"interface":"front","average":{"1min":1.208,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.71799999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.292,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5920000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.452},{"interface":"front","average":{"1min":1.26,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.645,"5min":1.714,"15min":1.714},"last":1.476}]},{"osd":6,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.363,"15min":1.379},"min":{"1min":0.81100000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6919999999999999,"5min":1.891,"15min":1.891},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.91600000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.593}]},{"osd":7,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.397,"15min":1.399},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.722},{"interface":"front","average":{"1min":1.339,"5min":1.349,"15min":1.351},"min":{"1min":0.96399999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.6319999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T05:41:07.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:41:07.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.968+0000 7fa3789ef640 1 Processor -- start 2023-12-19T05:41:07.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.968+0000 7fa3789ef640 1 -- start start 2023-12-19T05:41:07.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa3789ef640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa374161810 0x7fa3740cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa3789ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa37406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa3789ef640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740b22b0 con 0x7fa3740cc8a0 2023-12-19T05:41:07.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa3789ef640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa374161bf0 con 0x7fa374161810 2023-12-19T05:41:07.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa3789ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740b2830 con 0x7fa3740ce660 2023-12-19T05:41:07.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa36bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3740cc8a0 0x7fa3740cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39082/0 (socket says 172.21.15.49:39082) 2023-12-19T05:41:07.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.970+0000 7fa36bfff640 1 -- 172.21.15.49:0/2074863497 learned_addr learned my addr 172.21.15.49:0/2074863497 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa372d9d640 1 --2- 172.21.15.49:0/2074863497 >> v2:172.21.15.115:3300/0 conn(0x7fa374161810 0x7fa3740cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37359e640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa37406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314812826 0 0) 0x7fa3740b22b0 con 0x7fa3740cc8a0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa360003520 con 0x7fa3740cc8a0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785649626 0 0) 0x7fa360003520 con 0x7fa3740cc8a0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 msgr2=0x7fa37406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa37406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 >> v2:172.21.15.115:3300/0 conn(0x7fa374161810 msgr2=0x7fa3740cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 --2- 172.21.15.49:0/2074863497 >> v2:172.21.15.115:3300/0 conn(0x7fa374161810 0x7fa3740cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740b2550 con 0x7fa3740cc8a0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa35c001670 con 0x7fa3740cc8a0 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 >> v1:172.21.15.49:6789/0 conn(0x7fa3740cc8a0 legacy=0x7fa3740cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.971+0000 7fa37259c640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa360003970 0x7fa360003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37259c640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3600047c0 0x7fa360004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37259c640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa360005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374161bf0 con 0x7fa360003970 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740b2830 con 0x7fa3600047c0 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36000ba60 con 0x7fa3740ce660 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa360003970 0x7fa360003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa36bfff640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3600047c0 0x7fa360004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37359e640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa360005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 -- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 msgr2=0x7fa360005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa360005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 -- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3600047c0 msgr2=0x7fa360004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3600047c0 0x7fa360004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa372d9d640 1 -- 172.21.15.49:0/2074863497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360003520 con 0x7fa360003970 2023-12-19T05:41:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.972+0000 7fa37359e640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3740ce660 0x7fa360005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:07.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa372d9d640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa360003970 0x7fa360003d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa364009a90 tx=0x7fa3600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1311195b4324ed7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36402c6b0 con 0x7fa360003970 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36402c810 con 0x7fa360003970 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa37259c640 1 -- 172.21.15.49:0/2074863497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36402cba0 con 0x7fa360003970 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa3789ef640 1 -- 172.21.15.49:0/2074863497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa360003970 msgr2=0x7fa360003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa3789ef640 1 --2- 172.21.15.49:0/2074863497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa360003970 0x7fa360003d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa364009a90 tx=0x7fa3600057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.974+0000 7fa37359e640 1 -- 172.21.15.49:0/2074863497 reap_dead start 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.975+0000 7fa3789ef640 1 -- 172.21.15.49:0/2074863497 shutdown_connections 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.975+0000 7fa3789ef640 1 -- 172.21.15.49:0/2074863497 >> 172.21.15.49:0/2074863497 conn(0x7fa3740b0100 msgr2=0x7fa3740b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.975+0000 7fa3789ef640 1 -- 172.21.15.49:0/2074863497 shutdown_connections 2023-12-19T05:41:07.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.975+0000 7fa3789ef640 1 -- 172.21.15.49:0/2074863497 wait complete. 2023-12-19T05:41:07.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.976+0000 7fa3789ef640 1 Processor -- start 2023-12-19T05:41:07.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.977+0000 7fa3789ef640 1 -- start start 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa360003970 0x7fa3741f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa37415d440 0x7fa3741f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740af0f0 con 0x7fa3740ae730 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741fae00 con 0x7fa360003970 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa3789ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741f7a60 con 0x7fa37415d440 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42796/0 (socket says 172.21.15.49:42796) 2023-12-19T05:41:07.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 -- 172.21.15.49:0/1251819435 learned_addr learned my addr 172.21.15.49:0/1251819435 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 -- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa37415d440 msgr2=0x7fa3741f97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa37415d440 0x7fa3741f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 -- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa360003970 msgr2=0x7fa3741f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa372d9d640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa360003970 0x7fa3741f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa360003970 0x7fa3741f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.978+0000 7fa37359e640 1 -- 172.21.15.49:0/1251819435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3741fa1f0 con 0x7fa3740ae730 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa37359e640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b1530 tx=0x7fa36c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c017400 con 0x7fa3740ae730 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c011040 con 0x7fa3740ae730 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c017780 con 0x7fa3740ae730 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3741fa4d0 con 0x7fa3740ae730 2023-12-19T05:41:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.979+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3741faa90 con 0x7fa3740ae730 2023-12-19T05:41:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.980+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa374061910 con 0x7fa3740ae730 2023-12-19T05:41:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.981+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa36c0203b0 con 0x7fa3740ae730 2023-12-19T05:41:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.982+0000 7fa36b7fe640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 0x7fa35406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.982+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa36c088c50 con 0x7fa3740ae730 2023-12-19T05:41:07.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.983+0000 7fa372d9d640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 0x7fa35406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.984+0000 7fa372d9d640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 0x7fa35406c920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa364036000 tx=0x7fa364030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:07.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:07.987+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa36c0541a0 con 0x7fa3740ae730 2023-12-19T05:41:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.176+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3740b3010 con 0x7fa35406a460 2023-12-19T05:41:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.199+0000 7fa36b7fe640 1 -- 172.21.15.49:0/1251819435 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279596 (secure 0 0 0) 0x7fa3640040c0 con 0x7fa35406a460 2023-12-19T05:41:08.207 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:41:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 msgr2=0x7fa35406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 0x7fa35406c920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa364036000 tx=0x7fa364030000 comp rx=0 tx=0).stop 2023-12-19T05:41:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 msgr2=0x7fa3740aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b1530 tx=0x7fa36c00f4a0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 shutdown_connections 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa35406a460 0x7fa35406c920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa37415d440 0x7fa3741f97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740ae730 0x7fa3740aebb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 --2- 172.21.15.49:0/1251819435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa360003970 0x7fa3741f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 >> 172.21.15.49:0/1251819435 conn(0x7fa3740b0100 msgr2=0x7fa37415bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.205+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 shutdown_connections 2023-12-19T05:41:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.206+0000 7fa3789ef640 1 -- 172.21.15.49:0/1251819435 wait complete. 2023-12-19T05:41:08.229 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T05:41:06.541629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559688,"statfs":{"total":1600000000,"available":1597121472,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077435"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489940+0000","last_change":"2023-12-19T05:41:02.489940+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489940+0000","last_undegraded":"2023-12-19T05:41:02.489940+0000","last_fullsized":"2023-12-19T05:41:02.489940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.908180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493814+0000","last_change":"2023-12-19T05:41:02.493814+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493814+0000","last_undegraded":"2023-12-19T05:41:02.493814+0000","last_fullsized":"2023-12-19T05:41:02.493814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485618+0000","last_change":"2023-12-19T05:41:02.485618+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485618+0000","last_undegraded":"2023-12-19T05:41:02.485618+0000","last_fullsized":"2023-12-19T05:41:02.485618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:05:42.452542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481710+0000","last_change":"2023-12-19T05:41:02.481710+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481710+0000","last_undegraded":"2023-12-19T05:41:02.481710+0000","last_fullsized":"2023-12-19T05:41:02.481710+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:19.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.488336+0000","last_change":"2023-12-19T05:41:02.488336+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.488336+0000","last_undegraded":"2023-12-19T05:41:02.488336+0000","last_fullsized":"2023-12-19T05:41:02.488336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:13.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481067+0000","last_change":"2023-12-19T05:41:02.481067+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481067+0000","last_undegraded":"2023-12-19T05:41:02.481067+0000","last_fullsized":"2023-12-19T05:41:02.481067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:16:31.087909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.486325+0000","last_change":"2023-12-19T05:41:02.486325+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.486325+0000","last_undegraded":"2023-12-19T05:41:02.486325+0000","last_fullsized":"2023-12-19T05:41:02.486325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:47.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482660+0000","last_change":"2023-12-19T05:41:02.482660+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482660+0000","last_undegraded":"2023-12-19T05:41:02.482660+0000","last_fullsized":"2023-12-19T05:41:02.482660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482372+0000","last_change":"2023-12-19T05:41:02.482372+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482372+0000","last_undegraded":"2023-12-19T05:41:02.482372+0000","last_fullsized":"2023-12-19T05:41:02.482372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.494229+0000","last_change":"2023-12-19T05:41:02.494229+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.494229+0000","last_undegraded":"2023-12-19T05:41:02.494229+0000","last_fullsized":"2023-12-19T05:41:02.494229+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485463+0000","last_change":"2023-12-19T05:41:02.485463+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485463+0000","last_undegraded":"2023-12-19T05:41:02.485463+0000","last_fullsized":"2023-12-19T05:41:02.485463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493470+0000","last_change":"2023-12-19T05:41:02.493470+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493470+0000","last_undegraded":"2023-12-19T05:41:02.493470+0000","last_fullsized":"2023-12-19T05:41:02.493470+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:09.915767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482325+0000","last_change":"2023-12-19T05:41:02.482325+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482325+0000","last_undegraded":"2023-12-19T05:41:02.482325+0000","last_fullsized":"2023-12-19T05:41:02.482325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:54.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479334+0000","last_change":"2023-12-19T05:41:02.479334+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479334+0000","last_undegraded":"2023-12-19T05:41:02.479334+0000","last_fullsized":"2023-12-19T05:41:02.479334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479027+0000","last_change":"2023-12-19T05:41:02.479027+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479027+0000","last_undegraded":"2023-12-19T05:41:02.479027+0000","last_fullsized":"2023-12-19T05:41:02.479027+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:15.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489208+0000","last_change":"2023-12-19T05:41:02.489208+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489208+0000","last_undegraded":"2023-12-19T05:41:02.489208+0000","last_fullsized":"2023-12-19T05:41:02.489208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493102+0000","last_change":"2023-12-19T05:41:02.493102+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493102+0000","last_undegraded":"2023-12-19T05:41:02.493102+0000","last_fullsized":"2023-12-19T05:41:02.493102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:08.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485138+0000","last_change":"2023-12-19T05:41:02.485138+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485138+0000","last_undegraded":"2023-12-19T05:41:02.485138+0000","last_fullsized":"2023-12-19T05:41:02.485138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487980+0000","last_change":"2023-12-19T05:41:02.487980+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487980+0000","last_undegraded":"2023-12-19T05:41:02.487980+0000","last_fullsized":"2023-12-19T05:41:02.487980+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:59.457152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.490038+0000","last_change":"2023-12-19T05:41:02.490038+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.490038+0000","last_undegraded":"2023-12-19T05:41:02.490038+0000","last_fullsized":"2023-12-19T05:41:02.490038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480134+0000","last_change":"2023-12-19T05:41:02.480134+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480134+0000","last_undegraded":"2023-12-19T05:41:02.480134+0000","last_fullsized":"2023-12-19T05:41:02.480134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483910+0000","last_change":"2023-12-19T05:41:02.483910+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483910+0000","last_undegraded":"2023-12-19T05:41:02.483910+0000","last_fullsized":"2023-12-19T05:41:02.483910+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:06.461247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485634+0000","last_change":"2023-12-19T05:41:02.485634+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485634+0000","last_undegraded":"2023-12-19T05:41:02.485634+0000","last_fullsized":"2023-12-19T05:41:02.485634+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:49:50.832272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480613+0000","last_change":"2023-12-19T05:41:02.480613+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480613+0000","last_undegraded":"2023-12-19T05:41:02.480613+0000","last_fullsized":"2023-12-19T05:41:02.480613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:56:31.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487535+0000","last_change":"2023-12-19T05:41:02.487535+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487535+0000","last_undegraded":"2023-12-19T05:41:02.487535+0000","last_fullsized":"2023-12-19T05:41:02.487535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479133+0000","last_change":"2023-12-19T05:41:02.479133+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479133+0000","last_undegraded":"2023-12-19T05:41:02.479133+0000","last_fullsized":"2023-12-19T05:41:02.479133+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483586+0000","last_change":"2023-12-19T05:41:02.483586+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483586+0000","last_undegraded":"2023-12-19T05:41:02.483586+0000","last_fullsized":"2023-12-19T05:41:02.483586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:50.412798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484126+0000","last_change":"2023-12-19T05:41:02.484126+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484126+0000","last_undegraded":"2023-12-19T05:41:02.484126+0000","last_fullsized":"2023-12-19T05:41:02.484126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:35:19.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.489376+0000","last_change":"2023-12-19T05:41:02.489376+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.489376+0000","last_undegraded":"2023-12-19T05:41:02.489376+0000","last_fullsized":"2023-12-19T05:41:02.489376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485693+0000","last_change":"2023-12-19T05:41:02.485693+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485693+0000","last_undegraded":"2023-12-19T05:41:02.485693+0000","last_fullsized":"2023-12-19T05:41:02.485693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:53.641231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478738+0000","last_change":"2023-12-19T05:41:02.478738+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478738+0000","last_undegraded":"2023-12-19T05:41:02.478738+0000","last_fullsized":"2023-12-19T05:41:02.478738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477187+0000","last_change":"2023-12-19T05:41:02.477187+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477187+0000","last_undegraded":"2023-12-19T05:41:02.477187+0000","last_fullsized":"2023-12-19T05:41:02.477187+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485846+0000","last_change":"2023-12-19T05:41:02.485846+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485846+0000","last_undegraded":"2023-12-19T05:41:02.485846+0000","last_fullsized":"2023-12-19T05:41:02.485846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:08.427930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.495974+0000","last_change":"2023-12-19T05:41:02.495810+0000","last_active":"2023-12-19T05:41:02.495974+0000","last_peered":"2023-12-19T05:41:02.495974+0000","last_clean":"2023-12-19T05:41:02.495974+0000","last_became_active":"2023-12-19T05:41:02.495379+0000","last_became_peered":"2023-12-19T05:41:02.495379+0000","last_unstale":"2023-12-19T05:41:02.495974+0000","last_undegraded":"2023-12-19T05:41:02.495974+0000","last_fullsized":"2023-12-19T05:41:02.495974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:05.447594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485953+0000","last_change":"2023-12-19T05:41:02.485953+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485953+0000","last_undegraded":"2023-12-19T05:41:02.485953+0000","last_fullsized":"2023-12-19T05:41:02.485953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.491045+0000","last_change":"2023-12-19T05:41:02.490941+0000","last_active":"2023-12-19T05:41:02.491045+0000","last_peered":"2023-12-19T05:41:02.491045+0000","last_clean":"2023-12-19T05:41:02.491045+0000","last_became_active":"2023-12-19T05:41:02.490755+0000","last_became_peered":"2023-12-19T05:41:02.490755+0000","last_unstale":"2023-12-19T05:41:02.491045+0000","last_undegraded":"2023-12-19T05:41:02.491045+0000","last_fullsized":"2023-12-19T05:41:02.491045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:26.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482468+0000","last_change":"2023-12-19T05:41:02.482468+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482468+0000","last_undegraded":"2023-12-19T05:41:02.482468+0000","last_fullsized":"2023-12-19T05:41:02.482468+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:51:11.564108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.497137+0000","last_change":"2023-12-19T05:41:02.496221+0000","last_active":"2023-12-19T05:41:02.497137+0000","last_peered":"2023-12-19T05:41:02.497137+0000","last_clean":"2023-12-19T05:41:02.497137+0000","last_became_active":"2023-12-19T05:41:02.495521+0000","last_became_peered":"2023-12-19T05:41:02.495521+0000","last_unstale":"2023-12-19T05:41:02.497137+0000","last_undegraded":"2023-12-19T05:41:02.497137+0000","last_fullsized":"2023-12-19T05:41:02.497137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:42.544673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478106+0000","last_change":"2023-12-19T05:41:02.478106+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478106+0000","last_undegraded":"2023-12-19T05:41:02.478106+0000","last_fullsized":"2023-12-19T05:41:02.478106+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:23.470088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496494+0000","last_change":"2023-12-19T05:41:02.496412+0000","last_active":"2023-12-19T05:41:02.496494+0000","last_peered":"2023-12-19T05:41:02.496494+0000","last_clean":"2023-12-19T05:41:02.496494+0000","last_became_active":"2023-12-19T05:41:02.496196+0000","last_became_peered":"2023-12-19T05:41:02.496196+0000","last_unstale":"2023-12-19T05:41:02.496494+0000","last_undegraded":"2023-12-19T05:41:02.496494+0000","last_fullsized":"2023-12-19T05:41:02.496494+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:36:59.476802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483606+0000","last_change":"2023-12-19T05:41:02.483606+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483606+0000","last_undegraded":"2023-12-19T05:41:02.483606+0000","last_fullsized":"2023-12-19T05:41:02.483606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:14.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.500884+0000","last_change":"2023-12-19T05:41:02.500464+0000","last_active":"2023-12-19T05:41:02.500884+0000","last_peered":"2023-12-19T05:41:02.500884+0000","last_clean":"2023-12-19T05:41:02.500884+0000","last_became_active":"2023-12-19T05:41:02.499014+0000","last_became_peered":"2023-12-19T05:41:02.499014+0000","last_unstale":"2023-12-19T05:41:02.500884+0000","last_undegraded":"2023-12-19T05:41:02.500884+0000","last_fullsized":"2023-12-19T05:41:02.500884+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:31.232661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493797+0000","last_change":"2023-12-19T05:41:02.493797+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493797+0000","last_undegraded":"2023-12-19T05:41:02.493797+0000","last_fullsized":"2023-12-19T05:41:02.493797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494314+0000","last_change":"2023-12-19T05:41:02.493834+0000","last_active":"2023-12-19T05:41:02.494314+0000","last_peered":"2023-12-19T05:41:02.494314+0000","last_clean":"2023-12-19T05:41:02.494314+0000","last_became_active":"2023-12-19T05:41:02.493485+0000","last_became_peered":"2023-12-19T05:41:02.493485+0000","last_unstale":"2023-12-19T05:41:02.494314+0000","last_undegraded":"2023-12-19T05:41:02.494314+0000","last_fullsized":"2023-12-19T05:41:02.494314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:18.657294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491572+0000","last_change":"2023-12-19T05:41:02.491572+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491572+0000","last_undegraded":"2023-12-19T05:41:02.491572+0000","last_fullsized":"2023-12-19T05:41:02.491572+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494115+0000","last_change":"2023-12-19T05:41:02.493998+0000","last_active":"2023-12-19T05:41:02.494115+0000","last_peered":"2023-12-19T05:41:02.494115+0000","last_clean":"2023-12-19T05:41:02.494115+0000","last_became_active":"2023-12-19T05:41:02.493564+0000","last_became_peered":"2023-12-19T05:41:02.493564+0000","last_unstale":"2023-12-19T05:41:02.494115+0000","last_undegraded":"2023-12-19T05:41:02.494115+0000","last_fullsized":"2023-12-19T05:41:02.494115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483220+0000","last_change":"2023-12-19T05:41:02.483220+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483220+0000","last_undegraded":"2023-12-19T05:41:02.483220+0000","last_fullsized":"2023-12-19T05:41:02.483220+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:14.010176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.497219+0000","last_change":"2023-12-19T05:41:02.496935+0000","last_active":"2023-12-19T05:41:02.497219+0000","last_peered":"2023-12-19T05:41:02.497219+0000","last_clean":"2023-12-19T05:41:02.497219+0000","last_became_active":"2023-12-19T05:41:02.496695+0000","last_became_peered":"2023-12-19T05:41:02.496695+0000","last_unstale":"2023-12-19T05:41:02.497219+0000","last_undegraded":"2023-12-19T05:41:02.497219+0000","last_fullsized":"2023-12-19T05:41:02.497219+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484741+0000","last_change":"2023-12-19T05:41:02.484741+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484741+0000","last_undegraded":"2023-12-19T05:41:02.484741+0000","last_fullsized":"2023-12-19T05:41:02.484741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499849+0000","last_change":"2023-12-19T05:41:02.499014+0000","last_active":"2023-12-19T05:41:02.499849+0000","last_peered":"2023-12-19T05:41:02.499849+0000","last_clean":"2023-12-19T05:41:02.499849+0000","last_became_active":"2023-12-19T05:41:02.498040+0000","last_became_peered":"2023-12-19T05:41:02.498040+0000","last_unstale":"2023-12-19T05:41:02.499849+0000","last_undegraded":"2023-12-19T05:41:02.499849+0000","last_fullsized":"2023-12-19T05:41:02.499849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:01:03.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.495317+0000","last_change":"2023-12-19T05:41:02.495317+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.495317+0000","last_undegraded":"2023-12-19T05:41:02.495317+0000","last_fullsized":"2023-12-19T05:41:02.495317+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:26.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502017+0000","last_change":"2023-12-19T05:41:02.499304+0000","last_active":"2023-12-19T05:41:02.502017+0000","last_peered":"2023-12-19T05:41:02.502017+0000","last_clean":"2023-12-19T05:41:02.502017+0000","last_became_active":"2023-12-19T05:41:02.498787+0000","last_became_peered":"2023-12-19T05:41:02.498787+0000","last_unstale":"2023-12-19T05:41:02.502017+0000","last_undegraded":"2023-12-19T05:41:02.502017+0000","last_fullsized":"2023-12-19T05:41:02.502017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:01.874064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.475460+0000","last_change":"2023-12-19T05:41:02.475460+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.475460+0000","last_undegraded":"2023-12-19T05:41:02.475460+0000","last_fullsized":"2023-12-19T05:41:02.475460+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.493970+0000","last_change":"2023-12-19T05:41:02.492843+0000","last_active":"2023-12-19T05:41:02.493970+0000","last_peered":"2023-12-19T05:41:02.493970+0000","last_clean":"2023-12-19T05:41:02.493970+0000","last_became_active":"2023-12-19T05:41:02.492468+0000","last_became_peered":"2023-12-19T05:41:02.492468+0000","last_unstale":"2023-12-19T05:41:02.493970+0000","last_undegraded":"2023-12-19T05:41:02.493970+0000","last_fullsized":"2023-12-19T05:41:02.493970+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.483089+0000","last_change":"2023-12-19T05:41:02.483089+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.483089+0000","last_undegraded":"2023-12-19T05:41:02.483089+0000","last_fullsized":"2023-12-19T05:41:02.483089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:22.133325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501272+0000","last_change":"2023-12-19T05:41:02.500015+0000","last_active":"2023-12-19T05:41:02.501272+0000","last_peered":"2023-12-19T05:41:02.501272+0000","last_clean":"2023-12-19T05:41:02.501272+0000","last_became_active":"2023-12-19T05:41:02.496783+0000","last_became_peered":"2023-12-19T05:41:02.496783+0000","last_unstale":"2023-12-19T05:41:02.501272+0000","last_undegraded":"2023-12-19T05:41:02.501272+0000","last_fullsized":"2023-12-19T05:41:02.501272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:40.888340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487850+0000","last_change":"2023-12-19T05:41:02.487850+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487850+0000","last_undegraded":"2023-12-19T05:41:02.487850+0000","last_fullsized":"2023-12-19T05:41:02.487850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:48:33.267654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499267+0000","last_change":"2023-12-19T05:41:02.497837+0000","last_active":"2023-12-19T05:41:02.499267+0000","last_peered":"2023-12-19T05:41:02.499267+0000","last_clean":"2023-12-19T05:41:02.499267+0000","last_became_active":"2023-12-19T05:41:02.497404+0000","last_became_peered":"2023-12-19T05:41:02.497404+0000","last_unstale":"2023-12-19T05:41:02.499267+0000","last_undegraded":"2023-12-19T05:41:02.499267+0000","last_fullsized":"2023-12-19T05:41:02.499267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:08.475846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.485351+0000","last_change":"2023-12-19T05:41:02.485351+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.485351+0000","last_undegraded":"2023-12-19T05:41:02.485351+0000","last_fullsized":"2023-12-19T05:41:02.485351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.494968+0000","last_change":"2023-12-19T05:41:02.494828+0000","last_active":"2023-12-19T05:41:02.494968+0000","last_peered":"2023-12-19T05:41:02.494968+0000","last_clean":"2023-12-19T05:41:02.494968+0000","last_became_active":"2023-12-19T05:41:02.491941+0000","last_became_peered":"2023-12-19T05:41:02.491941+0000","last_unstale":"2023-12-19T05:41:02.494968+0000","last_undegraded":"2023-12-19T05:41:02.494968+0000","last_fullsized":"2023-12-19T05:41:02.494968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482803+0000","last_change":"2023-12-19T05:41:02.482803+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482803+0000","last_undegraded":"2023-12-19T05:41:02.482803+0000","last_fullsized":"2023-12-19T05:41:02.482803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501299+0000","last_change":"2023-12-19T05:41:02.501217+0000","last_active":"2023-12-19T05:41:02.501299+0000","last_peered":"2023-12-19T05:41:02.501299+0000","last_clean":"2023-12-19T05:41:02.501299+0000","last_became_active":"2023-12-19T05:41:02.500050+0000","last_became_peered":"2023-12-19T05:41:02.500050+0000","last_unstale":"2023-12-19T05:41:02.501299+0000","last_undegraded":"2023-12-19T05:41:02.501299+0000","last_fullsized":"2023-12-19T05:41:02.501299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:07.414277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.492728+0000","last_change":"2023-12-19T05:41:02.492728+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.492728+0000","last_undegraded":"2023-12-19T05:41:02.492728+0000","last_fullsized":"2023-12-19T05:41:02.492728+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501993+0000","last_change":"2023-12-19T05:41:02.501660+0000","last_active":"2023-12-19T05:41:02.501993+0000","last_peered":"2023-12-19T05:41:02.501993+0000","last_clean":"2023-12-19T05:41:02.501993+0000","last_became_active":"2023-12-19T05:41:02.500442+0000","last_became_peered":"2023-12-19T05:41:02.500442+0000","last_unstale":"2023-12-19T05:41:02.501993+0000","last_undegraded":"2023-12-19T05:41:02.501993+0000","last_fullsized":"2023-12-19T05:41:02.501993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:55.432045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.484451+0000","last_change":"2023-12-19T05:41:02.484451+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.484451+0000","last_undegraded":"2023-12-19T05:41:02.484451+0000","last_fullsized":"2023-12-19T05:41:02.484451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:02.802901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502918+0000","last_change":"2023-12-19T05:41:02.502812+0000","last_active":"2023-12-19T05:41:02.502918+0000","last_peered":"2023-12-19T05:41:02.502918+0000","last_clean":"2023-12-19T05:41:02.502918+0000","last_became_active":"2023-12-19T05:41:02.501062+0000","last_became_peered":"2023-12-19T05:41:02.501062+0000","last_unstale":"2023-12-19T05:41:02.502918+0000","last_undegraded":"2023-12-19T05:41:02.502918+0000","last_fullsized":"2023-12-19T05:41:02.502918+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.481507+0000","last_change":"2023-12-19T05:41:02.481507+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.481507+0000","last_undegraded":"2023-12-19T05:41:02.481507+0000","last_fullsized":"2023-12-19T05:41:02.481507+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:21.641940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499831+0000","last_change":"2023-12-19T05:41:02.498877+0000","last_active":"2023-12-19T05:41:02.499831+0000","last_peered":"2023-12-19T05:41:02.499831+0000","last_clean":"2023-12-19T05:41:02.499831+0000","last_became_active":"2023-12-19T05:41:02.498484+0000","last_became_peered":"2023-12-19T05:41:02.498484+0000","last_unstale":"2023-12-19T05:41:02.499831+0000","last_undegraded":"2023-12-19T05:41:02.499831+0000","last_fullsized":"2023-12-19T05:41:02.499831+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:11.775990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.488677+0000","last_change":"2023-12-19T05:41:02.488677+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.488677+0000","last_undegraded":"2023-12-19T05:41:02.488677+0000","last_fullsized":"2023-12-19T05:41:02.488677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.499864+0000","last_change":"2023-12-19T05:41:02.499221+0000","last_active":"2023-12-19T05:41:02.499864+0000","last_peered":"2023-12-19T05:41:02.499864+0000","last_clean":"2023-12-19T05:41:02.499864+0000","last_became_active":"2023-12-19T05:41:02.498665+0000","last_became_peered":"2023-12-19T05:41:02.498665+0000","last_unstale":"2023-12-19T05:41:02.499864+0000","last_undegraded":"2023-12-19T05:41:02.499864+0000","last_fullsized":"2023-12-19T05:41:02.499864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:20.971597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487050+0000","last_change":"2023-12-19T05:41:02.487050+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487050+0000","last_undegraded":"2023-12-19T05:41:02.487050+0000","last_fullsized":"2023-12-19T05:41:02.487050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:12.177921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501247+0000","last_change":"2023-12-19T05:41:02.500885+0000","last_active":"2023-12-19T05:41:02.501247+0000","last_peered":"2023-12-19T05:41:02.501247+0000","last_clean":"2023-12-19T05:41:02.501247+0000","last_became_active":"2023-12-19T05:41:02.499575+0000","last_became_peered":"2023-12-19T05:41:02.499575+0000","last_unstale":"2023-12-19T05:41:02.501247+0000","last_undegraded":"2023-12-19T05:41:02.501247+0000","last_fullsized":"2023-12-19T05:41:02.501247+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:20.628288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491726+0000","last_change":"2023-12-19T05:41:02.491726+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491726+0000","last_undegraded":"2023-12-19T05:41:02.491726+0000","last_fullsized":"2023-12-19T05:41:02.491726+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501297+0000","last_change":"2023-12-19T05:41:02.498001+0000","last_active":"2023-12-19T05:41:02.501297+0000","last_peered":"2023-12-19T05:41:02.501297+0000","last_clean":"2023-12-19T05:41:02.501297+0000","last_became_active":"2023-12-19T05:41:02.497640+0000","last_became_peered":"2023-12-19T05:41:02.497640+0000","last_unstale":"2023-12-19T05:41:02.501297+0000","last_undegraded":"2023-12-19T05:41:02.501297+0000","last_fullsized":"2023-12-19T05:41:02.501297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:07.684487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.479251+0000","last_change":"2023-12-19T05:41:02.479251+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.479251+0000","last_undegraded":"2023-12-19T05:41:02.479251+0000","last_fullsized":"2023-12-19T05:41:02.479251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:41.901992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501629+0000","last_change":"2023-12-19T05:41:02.501432+0000","last_active":"2023-12-19T05:41:02.501629+0000","last_peered":"2023-12-19T05:41:02.501629+0000","last_clean":"2023-12-19T05:41:02.501629+0000","last_became_active":"2023-12-19T05:41:02.500921+0000","last_became_peered":"2023-12-19T05:41:02.500921+0000","last_unstale":"2023-12-19T05:41:02.501629+0000","last_undegraded":"2023-12-19T05:41:02.501629+0000","last_fullsized":"2023-12-19T05:41:02.501629+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:46:43.175554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.478209+0000","last_change":"2023-12-19T05:41:02.478209+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.478209+0000","last_undegraded":"2023-12-19T05:41:02.478209+0000","last_fullsized":"2023-12-19T05:41:02.478209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.503185+0000","last_change":"2023-12-19T05:41:02.502611+0000","last_active":"2023-12-19T05:41:02.503185+0000","last_peered":"2023-12-19T05:41:02.503185+0000","last_clean":"2023-12-19T05:41:02.503185+0000","last_became_active":"2023-12-19T05:41:02.502340+0000","last_became_peered":"2023-12-19T05:41:02.502340+0000","last_unstale":"2023-12-19T05:41:02.503185+0000","last_undegraded":"2023-12-19T05:41:02.503185+0000","last_fullsized":"2023-12-19T05:41:02.503185+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:30.259577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477272+0000","last_change":"2023-12-19T05:41:02.477272+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477272+0000","last_undegraded":"2023-12-19T05:41:02.477272+0000","last_fullsized":"2023-12-19T05:41:02.477272+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:30:44.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.482394+0000","last_change":"2023-12-19T05:41:02.482151+0000","last_active":"2023-12-19T05:41:02.482394+0000","last_peered":"2023-12-19T05:41:02.482394+0000","last_clean":"2023-12-19T05:41:02.482394+0000","last_became_active":"2023-12-19T05:41:02.481408+0000","last_became_peered":"2023-12-19T05:41:02.481408+0000","last_unstale":"2023-12-19T05:41:02.482394+0000","last_undegraded":"2023-12-19T05:41:02.482394+0000","last_fullsized":"2023-12-19T05:41:02.482394+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:09.900893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482611+0000","last_change":"2023-12-19T05:41:02.482611+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482611+0000","last_undegraded":"2023-12-19T05:41:02.482611+0000","last_fullsized":"2023-12-19T05:41:02.482611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:44.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492018+0000","last_change":"2023-12-19T05:41:02.491086+0000","last_active":"2023-12-19T05:41:02.492018+0000","last_peered":"2023-12-19T05:41:02.492018+0000","last_clean":"2023-12-19T05:41:02.492018+0000","last_became_active":"2023-12-19T05:41:02.487771+0000","last_became_peered":"2023-12-19T05:41:02.487771+0000","last_unstale":"2023-12-19T05:41:02.492018+0000","last_undegraded":"2023-12-19T05:41:02.492018+0000","last_fullsized":"2023-12-19T05:41:02.492018+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.491192+0000","last_change":"2023-12-19T05:41:02.491192+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.491192+0000","last_undegraded":"2023-12-19T05:41:02.491192+0000","last_fullsized":"2023-12-19T05:41:02.491192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.501322+0000","last_change":"2023-12-19T05:41:02.501207+0000","last_active":"2023-12-19T05:41:02.501322+0000","last_peered":"2023-12-19T05:41:02.501322+0000","last_clean":"2023-12-19T05:41:02.501322+0000","last_became_active":"2023-12-19T05:41:02.500475+0000","last_became_peered":"2023-12-19T05:41:02.500475+0000","last_unstale":"2023-12-19T05:41:02.501322+0000","last_undegraded":"2023-12-19T05:41:02.501322+0000","last_fullsized":"2023-12-19T05:41:02.501322+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:26.639795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.482652+0000","last_change":"2023-12-19T05:41:02.482652+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.482652+0000","last_undegraded":"2023-12-19T05:41:02.482652+0000","last_fullsized":"2023-12-19T05:41:02.482652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:21.890762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502028+0000","last_change":"2023-12-19T05:41:02.499981+0000","last_active":"2023-12-19T05:41:02.502028+0000","last_peered":"2023-12-19T05:41:02.502028+0000","last_clean":"2023-12-19T05:41:02.502028+0000","last_became_active":"2023-12-19T05:41:02.499733+0000","last_became_peered":"2023-12-19T05:41:02.499733+0000","last_unstale":"2023-12-19T05:41:02.502028+0000","last_undegraded":"2023-12-19T05:41:02.502028+0000","last_fullsized":"2023-12-19T05:41:02.502028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.493326+0000","last_change":"2023-12-19T05:41:02.493326+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.493326+0000","last_undegraded":"2023-12-19T05:41:02.493326+0000","last_fullsized":"2023-12-19T05:41:02.493326+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496304+0000","last_change":"2023-12-19T05:41:02.495242+0000","last_active":"2023-12-19T05:41:02.496304+0000","last_peered":"2023-12-19T05:41:02.496304+0000","last_clean":"2023-12-19T05:41:02.496304+0000","last_became_active":"2023-12-19T05:41:02.494329+0000","last_became_peered":"2023-12-19T05:41:02.494329+0000","last_unstale":"2023-12-19T05:41:02.496304+0000","last_undegraded":"2023-12-19T05:41:02.496304+0000","last_fullsized":"2023-12-19T05:41:02.496304+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:50.527425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.477076+0000","last_change":"2023-12-19T05:41:02.477076+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.477076+0000","last_undegraded":"2023-12-19T05:41:02.477076+0000","last_fullsized":"2023-12-19T05:41:02.477076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:23.806072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.496477+0000","last_change":"2023-12-19T05:41:02.495475+0000","last_active":"2023-12-19T05:41:02.496477+0000","last_peered":"2023-12-19T05:41:02.496477+0000","last_clean":"2023-12-19T05:41:02.496477+0000","last_became_active":"2023-12-19T05:41:02.495251+0000","last_became_peered":"2023-12-19T05:41:02.495251+0000","last_unstale":"2023-12-19T05:41:02.496477+0000","last_undegraded":"2023-12-19T05:41:02.496477+0000","last_fullsized":"2023-12-19T05:41:02.496477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:22.792419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.487108+0000","last_change":"2023-12-19T05:41:02.487108+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.487108+0000","last_undegraded":"2023-12-19T05:41:02.487108+0000","last_fullsized":"2023-12-19T05:41:02.487108+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492316+0000","last_change":"2023-12-19T05:41:02.490841+0000","last_active":"2023-12-19T05:41:02.492316+0000","last_peered":"2023-12-19T05:41:02.492316+0000","last_clean":"2023-12-19T05:41:02.492316+0000","last_became_active":"2023-12-19T05:41:02.486586+0000","last_became_peered":"2023-12-19T05:41:02.486586+0000","last_unstale":"2023-12-19T05:41:02.492316+0000","last_undegraded":"2023-12-19T05:41:02.492316+0000","last_fullsized":"2023-12-19T05:41:02.492316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.480486+0000","last_change":"2023-12-19T05:41:02.480486+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.480486+0000","last_undegraded":"2023-12-19T05:41:02.480486+0000","last_fullsized":"2023-12-19T05:41:02.480486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.502614+0000","last_change":"2023-12-19T05:41:02.502475+0000","last_active":"2023-12-19T05:41:02.502614+0000","last_peered":"2023-12-19T05:41:02.502614+0000","last_clean":"2023-12-19T05:41:02.502614+0000","last_became_active":"2023-12-19T05:41:02.502142+0000","last_became_peered":"2023-12-19T05:41:02.502142+0000","last_unstale":"2023-12-19T05:41:02.502614+0000","last_undegraded":"2023-12-19T05:41:02.502614+0000","last_fullsized":"2023-12-19T05:41:02.502614+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:19:26.512158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-12-19T05:41:02.475894+0000","last_change":"2023-12-19T05:41:02.475894+0000","last_active":"2023-12-19T05:41:02.461449+0000","last_peered":"2023-12-19T05:41:02.461449+0000","last_clean":"2023-12-19T05:41:02.461449+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:41:02.475894+0000","last_undegraded":"2023-12-19T05:41:02.475894+0000","last_fullsized":"2023-12-19T05:41:02.475894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.492140+0000","last_change":"2023-12-19T05:41:02.491690+0000","last_active":"2023-12-19T05:41:02.492140+0000","last_peered":"2023-12-19T05:41:02.492140+0000","last_clean":"2023-12-19T05:41:02.492140+0000","last_became_active":"2023-12-19T05:41:02.491325+0000","last_became_peered":"2023-12-19T05:41:02.491325+0000","last_unstale":"2023-12-19T05:41:02.492140+0000","last_undegraded":"2023-12-19T05:41:02.492140+0000","last_fullsized":"2023-12-19T05:41:02.492140+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:09.559440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-19T05:41:01.465045+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:41:01.465045+0000","last_peered":"2023-12-19T05:41:01.465045+0000","last_clean":"2023-12-19T05:41:01.465045+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:41:01.465045+0000","last_undegraded":"2023-12-19T05:41:01.465045+0000","last_fullsized":"2023-12-19T05:41:01.465045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.25},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.034,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3939999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.579}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2330000000000001,"15min":1.2410000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5189999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.153},{"interface":"front","average":{"1min":1.085,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.135,"15min":1.119},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.72,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.496}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.034,"15min":1.01},"min":{"1min":0.84299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.25,"15min":1.234},"min":{"1min":1.0169999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.694,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3069999999999999,"15min":1.304},"min":{"1min":0.96099999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.216,"15min":1.212},"min":{"1min":0.82999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.458,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.079}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":1.232,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.677},{"interface":"front","average":{"1min":1.454,"5min":1.369,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.946,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.7270000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5089999999999999,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.022},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.0249999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.145,"15min":1.131},"min":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.327,"15min":1.345},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.851,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.518}]},{"osd":2,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2,"5min":2,"15min":2},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.3180000000000001,"15min":1.3360000000000001},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.738,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3740000000000001,"15min":1.409},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.857,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.379,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1579999999999999,"5min":4.452,"15min":4.452},"last":1.335}]},{"osd":4,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3720000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9219999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.474,"15min":1.514},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.7240000000000002,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.6930000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5920000000000001,"15min":1.6279999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5070000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.7589999999999999,"15min":1.8109999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0630000000000002,"5min":3.681,"15min":3.681},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5369999999999999,"15min":1.5629999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8089999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.927},{"interface":"front","average":{"1min":1.617,"5min":1.639,"15min":1.643},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.4609999999999999,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.6779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.536,"5min":2.085,"15min":2.085},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4339999999999999,"5min":2.641,"15min":2.641},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.24,"15min":1.2470000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.375},"min":{"1min":0.89400000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.984,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2490000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.2230000000000001,"15min":1.252},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5169999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.23,"15min":1.23},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.54,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.456,"15min":1.486},"min":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.998,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.4339999999999999,"15min":1.4650000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.706,"5min":2.754,"15min":2.754},"last":1.038}]},{"osd":4,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.508,"15min":1.546},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.7010000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.121},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.611,"15min":1.653},"min":{"1min":0.83399999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.8879999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.081}]},{"osd":6,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5129999999999999,"15min":1.5469999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8640000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.179},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.6950000000000001,"15min":1.7350000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8999999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.2290000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.7270000000000001,"15min":1.7649999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.0510000000000002,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.6140000000000001,"15min":1.641},"min":{"1min":0.65000000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.042,"15min":1.0509999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.27}]},{"osd":1,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":1.577},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1259999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.617},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.2},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.478,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2450000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.204}]},{"osd":5,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.431},{"interface":"front","average":{"1min":1.331,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.93700000000000006,"5min":0.75,"15min":0.75},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.401}]},{"osd":6,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.349,"15min":1.361},"min":{"1min":1.016,"5min":0.872,"15min":0.872},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.381,"15min":1.389},"min":{"1min":1.081,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.6899999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.528}]},{"osd":7,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3280000000000001,"15min":1.323},"min":{"1min":0.94299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.492},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.4470000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.863}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.524,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5089999999999999,"5min":2.702,"15min":2.702},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.41299999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.505},{"interface":"front","average":{"1min":1.111,"5min":1.048,"15min":1.038},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6140000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.149,"15min":1.149},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6779999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.877,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.8180000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3129999999999999,"15min":1.304},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.876},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7689999999999999,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8580000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.321,"15min":1.3220000000000001},"min":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8009999999999999,"5min":2.02,"15min":2.02},"last":0.72699999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9710000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.002},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.423,"15min":1.423},"min":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.968,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.748,"15min":0.747},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.097},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1919999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.012,"15min":1.024},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.464,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4790000000000001,"5min":1.595,"15min":1.595},"last":0.76500000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.542,"5min":1.704,"15min":1.704},"last":1.1559999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.256},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2030000000000001,"15min":1.2050000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.97199999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.254,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.589,"5min":1.702,"15min":1.702},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2689999999999999,"15min":1.2829999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6379999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.111}]},{"osd":6,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2649999999999999,"15min":1.27},"min":{"1min":0.84899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.802,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.288,"15min":1.288},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.379}]},{"osd":7,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3999999999999999},"min":{"1min":0.91800000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.746,"5min":2.714,"15min":2.714},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.48399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.145,"5min":2.992,"15min":2.992},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.3,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.1200000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.073,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.996},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.079},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.45,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.95899999999999996}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3029999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.595,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.206,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8680000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.76100000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.872,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.508,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.679,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.7150000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3069999999999999,"15min":1.3220000000000001},"min":{"1min":0.82699999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7909999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.899,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.8620000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3779999999999999,"15min":1.389},"min":{"1min":0.78000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7729999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3879999999999999,"15min":1.397},"min":{"1min":0.88700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6839999999999999,"5min":2.319,"15min":2.319},"last":1.7749999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4770000000000001,"15min":1.4910000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7390000000000001,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.821},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.5589999999999999,"15min":1.579},"min":{"1min":1.038,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.853,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":1.6319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195105,"statfs":{"total":200000000,"available":199787776,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.79100000000000004,"15min":0.77400000000000002},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4119999999999999,"5min":1.427,"15min":1.427},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85699999999999998,"15min":0.86399999999999999},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.0469999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.496,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.1259999999999999,"15min":1.143},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6259999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.25}]},{"osd":3,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3160000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.071},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.601,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.79100000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.571,"15min":1.571},"last":1.194},{"interface":"front","average":{"1min":1.208,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.71799999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.292,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5920000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.452},{"interface":"front","average":{"1min":1.26,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.645,"5min":1.714,"15min":1.714},"last":1.476}]},{"osd":6,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.363,"15min":1.379},"min":{"1min":0.81100000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6919999999999999,"5min":1.891,"15min":1.891},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.91600000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.593}]},{"osd":7,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.397,"15min":1.399},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.722},{"interface":"front","average":{"1min":1.339,"5min":1.349,"15min":1.351},"min":{"1min":0.96399999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.6319999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T05:41:08.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:41:08.456 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-12-19T05:41:08.454+0000 7fa8e6201640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:41:08.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.508+0000 7f01cb9c4640 1 Processor -- start 2023-12-19T05:41:08.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.508+0000 7f01cb9c4640 1 -- start start 2023-12-19T05:41:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01cb9c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f01c40ae110 0x7f01c40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01cb9c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c40b0640 0x7f01c406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01cb9c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c40ae640 con 0x7f01c4157bf0 2023-12-19T05:41:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01cb9c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c406b8c0 con 0x7f01c40ae110 2023-12-19T05:41:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01cb9c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40b0ab0 con 0x7f01c40b0640 2023-12-19T05:41:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01c9760640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f01c4157bf0 0x7f01c415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39088/0 (socket says 172.21.15.49:39088) 2023-12-19T05:41:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01c9760640 1 -- 172.21.15.49:0/2587231896 learned_addr learned my addr 172.21.15.49:0/2587231896 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.510+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/2587231896 >> v2:172.21.15.49:3300/0 conn(0x7f01c40ae110 0x7f01c40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01c9f61640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c40b0640 0x7f01c406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01bbfff640 1 -- 172.21.15.49:0/2587231896 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601139930 0 0) 0x7f01c40ae640 con 0x7f01c4157bf0 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01c8f5f640 1 -- 172.21.15.49:0/2587231896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c40b0640 msgr2=0x7f01c406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c40b0640 0x7f01c406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01c8f5f640 1 -- 172.21.15.49:0/2587231896 >> v1:172.21.15.49:6789/0 conn(0x7f01c4157bf0 legacy=0x7f01c415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.511+0000 7f01c8f5f640 1 -- 172.21.15.49:0/2587231896 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40ae920 con 0x7f01c40ae110 2023-12-19T05:41:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.512+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c40b0100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f01b40097d0 tx=0x7f01b402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7dbf9369629e89 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.512+0000 7f01bbfff640 1 -- 172.21.15.49:0/2587231896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b402d040 con 0x7f01c40ae110 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.512+0000 7f01bbfff640 1 -- 172.21.15.49:0/2587231896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4031810 con 0x7f01c40ae110 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.512+0000 7f01bbfff640 1 -- 172.21.15.49:0/2587231896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4031ba0 con 0x7f01c40ae110 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 -- 172.21.15.49:0/2587231896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 msgr2=0x7f01c40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c40b0100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f01b40097d0 tx=0x7f01b402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 -- 172.21.15.49:0/2587231896 shutdown_connections 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c40b0640 0x7f01c406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/2587231896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c40b0100 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 -- 172.21.15.49:0/2587231896 >> 172.21.15.49:0/2587231896 conn(0x7f01c40cbb70 msgr2=0x7f01c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 -- 172.21.15.49:0/2587231896 shutdown_connections 2023-12-19T05:41:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.513+0000 7f01cb9c4640 1 -- 172.21.15.49:0/2587231896 wait complete. 2023-12-19T05:41:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.515+0000 7f01cb9c4640 1 Processor -- start 2023-12-19T05:41:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.515+0000 7f01cb9c4640 1 -- start start 2023-12-19T05:41:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 0x7f01c4142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 0x7f01c413f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41403c0 con 0x7f01c40ae110 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41428a0 con 0x7f01c40b0640 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.516+0000 7f01cb9c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4142b80 con 0x7f01c4157bf0 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42822/0 (socket says 172.21.15.49:42822) 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 -- 172.21.15.49:0/1700532583 learned_addr learned my addr 172.21.15.49:0/1700532583 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 0x7f01c4142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9f61640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 0x7f01c413f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 -- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 msgr2=0x7f01c413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 0x7f01c413f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 -- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 msgr2=0x7f01c4142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 0x7f01c4142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 -- 172.21.15.49:0/1700532583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009400 con 0x7f01c40ae110 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 0x7f01c4142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9f61640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 0x7f01c413f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:08.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.517+0000 7f01c9760640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c400 tx=0x7f01c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:08.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.518+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0005ce0 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.518+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0005e40 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.518+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0007310 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.518+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c4142e60 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.518+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c41425b0 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.519+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c4140500 con 0x7f01c40ae110 2023-12-19T05:41:08.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.520+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f01c0007530 con 0x7f01c40ae110 2023-12-19T05:41:08.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.521+0000 7f01b9ffb640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 0x7f01a806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:08.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.521+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01c0087f70 con 0x7f01c40ae110 2023-12-19T05:41:08.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.522+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 0x7f01a806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:08.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.523+0000 7f01c8f5f640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 0x7f01a806c940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01b4036000 tx=0x7f01b403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.526+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f01c4140500 con 0x7f01c40ae110 2023-12-19T05:41:08.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.717+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01c40aeee0 con 0x7f01a806a480 2023-12-19T05:41:08.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.740+0000 7f01b9ffb640 1 -- 172.21.15.49:0/1700532583 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282560 (secure 0 0 0) 0x7f01b403a420 con 0x7f01a806a480 2023-12-19T05:41:08.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:08.747 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:41:08.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 msgr2=0x7f01a806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 0x7f01a806c940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01b4036000 tx=0x7f01b403c040 comp rx=0 tx=0).stop 2023-12-19T05:41:08.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 msgr2=0x7f01c415d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c400 tx=0x7f01c000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 shutdown_connections 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f01a806a480 0x7f01a806c940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01c4157bf0 0x7f01c413f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01c40b0640 0x7f01c4142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 --2- 172.21.15.49:0/1700532583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01c40ae110 0x7f01c415d070 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.745+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 >> 172.21.15.49:0/1700532583 conn(0x7f01c40cbb70 msgr2=0x7f01c4156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.746+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 shutdown_connections 2023-12-19T05:41:08.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:08.746+0000 7f01cb9c4640 1 -- 172.21.15.49:0/1700532583 wait complete. 2023-12-19T05:41:08.768 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-19T05:41:08.542149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559533,"statfs":{"total":1600000000,"available":1596961948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.069821"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008146+0000","last_change":"2023-12-19T05:41:03.008059+0000","last_active":"2023-12-19T05:41:03.008146+0000","last_peered":"2023-12-19T05:41:03.008146+0000","last_clean":"2023-12-19T05:41:03.008146+0000","last_became_active":"2023-12-19T05:41:03.007775+0000","last_became_peered":"2023-12-19T05:41:03.007775+0000","last_unstale":"2023-12-19T05:41:03.008146+0000","last_undegraded":"2023-12-19T05:41:03.008146+0000","last_fullsized":"2023-12-19T05:41:03.008146+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.908180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009441+0000","last_change":"2023-12-19T05:41:03.007711+0000","last_active":"2023-12-19T05:41:03.009441+0000","last_peered":"2023-12-19T05:41:03.009441+0000","last_clean":"2023-12-19T05:41:03.009441+0000","last_became_active":"2023-12-19T05:41:03.006894+0000","last_became_peered":"2023-12-19T05:41:03.006894+0000","last_unstale":"2023-12-19T05:41:03.009441+0000","last_undegraded":"2023-12-19T05:41:03.009441+0000","last_fullsized":"2023-12-19T05:41:03.009441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011824+0000","last_change":"2023-12-19T05:41:03.011727+0000","last_active":"2023-12-19T05:41:03.011824+0000","last_peered":"2023-12-19T05:41:03.011824+0000","last_clean":"2023-12-19T05:41:03.011824+0000","last_became_active":"2023-12-19T05:41:03.011503+0000","last_became_peered":"2023-12-19T05:41:03.011503+0000","last_unstale":"2023-12-19T05:41:03.011824+0000","last_undegraded":"2023-12-19T05:41:03.011824+0000","last_fullsized":"2023-12-19T05:41:03.011824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:05:42.452542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012986+0000","last_change":"2023-12-19T05:41:03.007914+0000","last_active":"2023-12-19T05:41:03.012986+0000","last_peered":"2023-12-19T05:41:03.012986+0000","last_clean":"2023-12-19T05:41:03.012986+0000","last_became_active":"2023-12-19T05:41:03.001895+0000","last_became_peered":"2023-12-19T05:41:03.001895+0000","last_unstale":"2023-12-19T05:41:03.012986+0000","last_undegraded":"2023-12-19T05:41:03.012986+0000","last_fullsized":"2023-12-19T05:41:03.012986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:19.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010380+0000","last_change":"2023-12-19T05:41:03.010256+0000","last_active":"2023-12-19T05:41:03.010380+0000","last_peered":"2023-12-19T05:41:03.010380+0000","last_clean":"2023-12-19T05:41:03.010380+0000","last_became_active":"2023-12-19T05:41:03.010053+0000","last_became_peered":"2023-12-19T05:41:03.010053+0000","last_unstale":"2023-12-19T05:41:03.010380+0000","last_undegraded":"2023-12-19T05:41:03.010380+0000","last_fullsized":"2023-12-19T05:41:03.010380+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:13.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017837+0000","last_change":"2023-12-19T05:41:03.016519+0000","last_active":"2023-12-19T05:41:03.017837+0000","last_peered":"2023-12-19T05:41:03.017837+0000","last_clean":"2023-12-19T05:41:03.017837+0000","last_became_active":"2023-12-19T05:41:03.016292+0000","last_became_peered":"2023-12-19T05:41:03.016292+0000","last_unstale":"2023-12-19T05:41:03.017837+0000","last_undegraded":"2023-12-19T05:41:03.017837+0000","last_fullsized":"2023-12-19T05:41:03.017837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:16:31.087909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004751+0000","last_change":"2023-12-19T05:41:03.004481+0000","last_active":"2023-12-19T05:41:03.004751+0000","last_peered":"2023-12-19T05:41:03.004751+0000","last_clean":"2023-12-19T05:41:03.004751+0000","last_became_active":"2023-12-19T05:41:02.998031+0000","last_became_peered":"2023-12-19T05:41:02.998031+0000","last_unstale":"2023-12-19T05:41:03.004751+0000","last_undegraded":"2023-12-19T05:41:03.004751+0000","last_fullsized":"2023-12-19T05:41:03.004751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:47.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012927+0000","last_change":"2023-12-19T05:41:03.006337+0000","last_active":"2023-12-19T05:41:03.012927+0000","last_peered":"2023-12-19T05:41:03.012927+0000","last_clean":"2023-12-19T05:41:03.012927+0000","last_became_active":"2023-12-19T05:41:03.005528+0000","last_became_peered":"2023-12-19T05:41:03.005528+0000","last_unstale":"2023-12-19T05:41:03.012927+0000","last_undegraded":"2023-12-19T05:41:03.012927+0000","last_fullsized":"2023-12-19T05:41:03.012927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013757+0000","last_change":"2023-12-19T05:41:03.013415+0000","last_active":"2023-12-19T05:41:03.013757+0000","last_peered":"2023-12-19T05:41:03.013757+0000","last_clean":"2023-12-19T05:41:03.013757+0000","last_became_active":"2023-12-19T05:41:03.013107+0000","last_became_peered":"2023-12-19T05:41:03.013107+0000","last_unstale":"2023-12-19T05:41:03.013757+0000","last_undegraded":"2023-12-19T05:41:03.013757+0000","last_fullsized":"2023-12-19T05:41:03.013757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005712+0000","last_change":"2023-12-19T05:41:03.005606+0000","last_active":"2023-12-19T05:41:03.005712+0000","last_peered":"2023-12-19T05:41:03.005712+0000","last_clean":"2023-12-19T05:41:03.005712+0000","last_became_active":"2023-12-19T05:41:03.004235+0000","last_became_peered":"2023-12-19T05:41:03.004235+0000","last_unstale":"2023-12-19T05:41:03.005712+0000","last_undegraded":"2023-12-19T05:41:03.005712+0000","last_fullsized":"2023-12-19T05:41:03.005712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017805+0000","last_change":"2023-12-19T05:41:03.017661+0000","last_active":"2023-12-19T05:41:03.017805+0000","last_peered":"2023-12-19T05:41:03.017805+0000","last_clean":"2023-12-19T05:41:03.017805+0000","last_became_active":"2023-12-19T05:41:03.016872+0000","last_became_peered":"2023-12-19T05:41:03.016872+0000","last_unstale":"2023-12-19T05:41:03.017805+0000","last_undegraded":"2023-12-19T05:41:03.017805+0000","last_fullsized":"2023-12-19T05:41:03.017805+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001022+0000","last_change":"2023-12-19T05:41:03.000938+0000","last_active":"2023-12-19T05:41:03.001022+0000","last_peered":"2023-12-19T05:41:03.001022+0000","last_clean":"2023-12-19T05:41:03.001022+0000","last_became_active":"2023-12-19T05:41:03.000638+0000","last_became_peered":"2023-12-19T05:41:03.000638+0000","last_unstale":"2023-12-19T05:41:03.001022+0000","last_undegraded":"2023-12-19T05:41:03.001022+0000","last_fullsized":"2023-12-19T05:41:03.001022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:09.915767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016201+0000","last_change":"2023-12-19T05:41:03.015225+0000","last_active":"2023-12-19T05:41:03.016201+0000","last_peered":"2023-12-19T05:41:03.016201+0000","last_clean":"2023-12-19T05:41:03.016201+0000","last_became_active":"2023-12-19T05:41:03.015004+0000","last_became_peered":"2023-12-19T05:41:03.015004+0000","last_unstale":"2023-12-19T05:41:03.016201+0000","last_undegraded":"2023-12-19T05:41:03.016201+0000","last_fullsized":"2023-12-19T05:41:03.016201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:54.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015603+0000","last_change":"2023-12-19T05:41:03.014709+0000","last_active":"2023-12-19T05:41:03.015603+0000","last_peered":"2023-12-19T05:41:03.015603+0000","last_clean":"2023-12-19T05:41:03.015603+0000","last_became_active":"2023-12-19T05:41:03.014109+0000","last_became_peered":"2023-12-19T05:41:03.014109+0000","last_unstale":"2023-12-19T05:41:03.015603+0000","last_undegraded":"2023-12-19T05:41:03.015603+0000","last_fullsized":"2023-12-19T05:41:03.015603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013075+0000","last_change":"2023-12-19T05:41:03.011931+0000","last_active":"2023-12-19T05:41:03.013075+0000","last_peered":"2023-12-19T05:41:03.013075+0000","last_clean":"2023-12-19T05:41:03.013075+0000","last_became_active":"2023-12-19T05:41:03.011198+0000","last_became_peered":"2023-12-19T05:41:03.011198+0000","last_unstale":"2023-12-19T05:41:03.013075+0000","last_undegraded":"2023-12-19T05:41:03.013075+0000","last_fullsized":"2023-12-19T05:41:03.013075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:15.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015174+0000","last_change":"2023-12-19T05:41:03.014917+0000","last_active":"2023-12-19T05:41:03.015174+0000","last_peered":"2023-12-19T05:41:03.015174+0000","last_clean":"2023-12-19T05:41:03.015174+0000","last_became_active":"2023-12-19T05:41:03.014678+0000","last_became_peered":"2023-12-19T05:41:03.014678+0000","last_unstale":"2023-12-19T05:41:03.015174+0000","last_undegraded":"2023-12-19T05:41:03.015174+0000","last_fullsized":"2023-12-19T05:41:03.015174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009413+0000","last_change":"2023-12-19T05:41:03.007149+0000","last_active":"2023-12-19T05:41:03.009413+0000","last_peered":"2023-12-19T05:41:03.009413+0000","last_clean":"2023-12-19T05:41:03.009413+0000","last_became_active":"2023-12-19T05:41:03.002455+0000","last_became_peered":"2023-12-19T05:41:03.002455+0000","last_unstale":"2023-12-19T05:41:03.009413+0000","last_undegraded":"2023-12-19T05:41:03.009413+0000","last_fullsized":"2023-12-19T05:41:03.009413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:08.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009269+0000","last_change":"2023-12-19T05:41:03.009075+0000","last_active":"2023-12-19T05:41:03.009269+0000","last_peered":"2023-12-19T05:41:03.009269+0000","last_clean":"2023-12-19T05:41:03.009269+0000","last_became_active":"2023-12-19T05:41:03.008821+0000","last_became_peered":"2023-12-19T05:41:03.008821+0000","last_unstale":"2023-12-19T05:41:03.009269+0000","last_undegraded":"2023-12-19T05:41:03.009269+0000","last_fullsized":"2023-12-19T05:41:03.009269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009629+0000","last_change":"2023-12-19T05:41:03.009557+0000","last_active":"2023-12-19T05:41:03.009629+0000","last_peered":"2023-12-19T05:41:03.009629+0000","last_clean":"2023-12-19T05:41:03.009629+0000","last_became_active":"2023-12-19T05:41:03.009328+0000","last_became_peered":"2023-12-19T05:41:03.009328+0000","last_unstale":"2023-12-19T05:41:03.009629+0000","last_undegraded":"2023-12-19T05:41:03.009629+0000","last_fullsized":"2023-12-19T05:41:03.009629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:59.457152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019744+0000","last_change":"2023-12-19T05:41:03.016004+0000","last_active":"2023-12-19T05:41:03.019744+0000","last_peered":"2023-12-19T05:41:03.019744+0000","last_clean":"2023-12-19T05:41:03.019744+0000","last_became_active":"2023-12-19T05:41:03.015777+0000","last_became_peered":"2023-12-19T05:41:03.015777+0000","last_unstale":"2023-12-19T05:41:03.019744+0000","last_undegraded":"2023-12-19T05:41:03.019744+0000","last_fullsized":"2023-12-19T05:41:03.019744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015971+0000","last_change":"2023-12-19T05:41:03.015899+0000","last_active":"2023-12-19T05:41:03.015971+0000","last_peered":"2023-12-19T05:41:03.015971+0000","last_clean":"2023-12-19T05:41:03.015971+0000","last_became_active":"2023-12-19T05:41:03.013249+0000","last_became_peered":"2023-12-19T05:41:03.013249+0000","last_unstale":"2023-12-19T05:41:03.015971+0000","last_undegraded":"2023-12-19T05:41:03.015971+0000","last_fullsized":"2023-12-19T05:41:03.015971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008694+0000","last_change":"2023-12-19T05:41:03.006660+0000","last_active":"2023-12-19T05:41:03.008694+0000","last_peered":"2023-12-19T05:41:03.008694+0000","last_clean":"2023-12-19T05:41:03.008694+0000","last_became_active":"2023-12-19T05:41:03.005924+0000","last_became_peered":"2023-12-19T05:41:03.005924+0000","last_unstale":"2023-12-19T05:41:03.008694+0000","last_undegraded":"2023-12-19T05:41:03.008694+0000","last_fullsized":"2023-12-19T05:41:03.008694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:06.461247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000471+0000","last_change":"2023-12-19T05:41:03.000382+0000","last_active":"2023-12-19T05:41:03.000471+0000","last_peered":"2023-12-19T05:41:03.000471+0000","last_clean":"2023-12-19T05:41:03.000471+0000","last_became_active":"2023-12-19T05:41:02.999889+0000","last_became_peered":"2023-12-19T05:41:02.999889+0000","last_unstale":"2023-12-19T05:41:03.000471+0000","last_undegraded":"2023-12-19T05:41:03.000471+0000","last_fullsized":"2023-12-19T05:41:03.000471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:49:50.832272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007038+0000","last_change":"2023-12-19T05:41:03.006055+0000","last_active":"2023-12-19T05:41:03.007038+0000","last_peered":"2023-12-19T05:41:03.007038+0000","last_clean":"2023-12-19T05:41:03.007038+0000","last_became_active":"2023-12-19T05:41:03.005697+0000","last_became_peered":"2023-12-19T05:41:03.005697+0000","last_unstale":"2023-12-19T05:41:03.007038+0000","last_undegraded":"2023-12-19T05:41:03.007038+0000","last_fullsized":"2023-12-19T05:41:03.007038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:56:31.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007702+0000","last_change":"2023-12-19T05:41:03.007591+0000","last_active":"2023-12-19T05:41:03.007702+0000","last_peered":"2023-12-19T05:41:03.007702+0000","last_clean":"2023-12-19T05:41:03.007702+0000","last_became_active":"2023-12-19T05:41:03.007339+0000","last_became_peered":"2023-12-19T05:41:03.007339+0000","last_unstale":"2023-12-19T05:41:03.007702+0000","last_undegraded":"2023-12-19T05:41:03.007702+0000","last_fullsized":"2023-12-19T05:41:03.007702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017648+0000","last_change":"2023-12-19T05:41:03.017504+0000","last_active":"2023-12-19T05:41:03.017648+0000","last_peered":"2023-12-19T05:41:03.017648+0000","last_clean":"2023-12-19T05:41:03.017648+0000","last_became_active":"2023-12-19T05:41:03.016525+0000","last_became_peered":"2023-12-19T05:41:03.016525+0000","last_unstale":"2023-12-19T05:41:03.017648+0000","last_undegraded":"2023-12-19T05:41:03.017648+0000","last_fullsized":"2023-12-19T05:41:03.017648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004945+0000","last_change":"2023-12-19T05:41:03.004847+0000","last_active":"2023-12-19T05:41:03.004945+0000","last_peered":"2023-12-19T05:41:03.004945+0000","last_clean":"2023-12-19T05:41:03.004945+0000","last_became_active":"2023-12-19T05:41:03.002066+0000","last_became_peered":"2023-12-19T05:41:03.002066+0000","last_unstale":"2023-12-19T05:41:03.004945+0000","last_undegraded":"2023-12-19T05:41:03.004945+0000","last_fullsized":"2023-12-19T05:41:03.004945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:50.412798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.003072+0000","last_change":"2023-12-19T05:41:03.002989+0000","last_active":"2023-12-19T05:41:03.003072+0000","last_peered":"2023-12-19T05:41:03.003072+0000","last_clean":"2023-12-19T05:41:03.003072+0000","last_became_active":"2023-12-19T05:41:03.002684+0000","last_became_peered":"2023-12-19T05:41:03.002684+0000","last_unstale":"2023-12-19T05:41:03.003072+0000","last_undegraded":"2023-12-19T05:41:03.003072+0000","last_fullsized":"2023-12-19T05:41:03.003072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:35:19.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019536+0000","last_change":"2023-12-19T05:41:03.019444+0000","last_active":"2023-12-19T05:41:03.019536+0000","last_peered":"2023-12-19T05:41:03.019536+0000","last_clean":"2023-12-19T05:41:03.019536+0000","last_became_active":"2023-12-19T05:41:03.019159+0000","last_became_peered":"2023-12-19T05:41:03.019159+0000","last_unstale":"2023-12-19T05:41:03.019536+0000","last_undegraded":"2023-12-19T05:41:03.019536+0000","last_fullsized":"2023-12-19T05:41:03.019536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995562+0000","last_change":"2023-12-19T05:41:02.995490+0000","last_active":"2023-12-19T05:41:02.995562+0000","last_peered":"2023-12-19T05:41:02.995562+0000","last_clean":"2023-12-19T05:41:02.995562+0000","last_became_active":"2023-12-19T05:41:02.995259+0000","last_became_peered":"2023-12-19T05:41:02.995259+0000","last_unstale":"2023-12-19T05:41:02.995562+0000","last_undegraded":"2023-12-19T05:41:02.995562+0000","last_fullsized":"2023-12-19T05:41:02.995562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:53.641231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008073+0000","last_change":"2023-12-19T05:41:03.007140+0000","last_active":"2023-12-19T05:41:03.008073+0000","last_peered":"2023-12-19T05:41:03.008073+0000","last_clean":"2023-12-19T05:41:03.008073+0000","last_became_active":"2023-12-19T05:41:03.005769+0000","last_became_peered":"2023-12-19T05:41:03.005769+0000","last_unstale":"2023-12-19T05:41:03.008073+0000","last_undegraded":"2023-12-19T05:41:03.008073+0000","last_fullsized":"2023-12-19T05:41:03.008073+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013002+0000","last_change":"2023-12-19T05:41:03.009800+0000","last_active":"2023-12-19T05:41:03.013002+0000","last_peered":"2023-12-19T05:41:03.013002+0000","last_clean":"2023-12-19T05:41:03.013002+0000","last_became_active":"2023-12-19T05:41:03.007818+0000","last_became_peered":"2023-12-19T05:41:03.007818+0000","last_unstale":"2023-12-19T05:41:03.013002+0000","last_undegraded":"2023-12-19T05:41:03.013002+0000","last_fullsized":"2023-12-19T05:41:03.013002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014537+0000","last_change":"2023-12-19T05:41:03.014042+0000","last_active":"2023-12-19T05:41:03.014537+0000","last_peered":"2023-12-19T05:41:03.014537+0000","last_clean":"2023-12-19T05:41:03.014537+0000","last_became_active":"2023-12-19T05:41:03.013681+0000","last_became_peered":"2023-12-19T05:41:03.013681+0000","last_unstale":"2023-12-19T05:41:03.014537+0000","last_undegraded":"2023-12-19T05:41:03.014537+0000","last_fullsized":"2023-12-19T05:41:03.014537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:08.427930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016659+0000","last_change":"2023-12-19T05:41:02.495810+0000","last_active":"2023-12-19T05:41:03.016659+0000","last_peered":"2023-12-19T05:41:03.016659+0000","last_clean":"2023-12-19T05:41:03.016659+0000","last_became_active":"2023-12-19T05:41:02.495379+0000","last_became_peered":"2023-12-19T05:41:02.495379+0000","last_unstale":"2023-12-19T05:41:03.016659+0000","last_undegraded":"2023-12-19T05:41:03.016659+0000","last_fullsized":"2023-12-19T05:41:03.016659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:05.447594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010365+0000","last_change":"2023-12-19T05:41:03.009982+0000","last_active":"2023-12-19T05:41:03.010365+0000","last_peered":"2023-12-19T05:41:03.010365+0000","last_clean":"2023-12-19T05:41:03.010365+0000","last_became_active":"2023-12-19T05:41:03.009742+0000","last_became_peered":"2023-12-19T05:41:03.009742+0000","last_unstale":"2023-12-19T05:41:03.010365+0000","last_undegraded":"2023-12-19T05:41:03.010365+0000","last_fullsized":"2023-12-19T05:41:03.010365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001839+0000","last_change":"2023-12-19T05:41:02.490941+0000","last_active":"2023-12-19T05:41:03.001839+0000","last_peered":"2023-12-19T05:41:03.001839+0000","last_clean":"2023-12-19T05:41:03.001839+0000","last_became_active":"2023-12-19T05:41:02.490755+0000","last_became_peered":"2023-12-19T05:41:02.490755+0000","last_unstale":"2023-12-19T05:41:03.001839+0000","last_undegraded":"2023-12-19T05:41:03.001839+0000","last_fullsized":"2023-12-19T05:41:03.001839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:26.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004716+0000","last_change":"2023-12-19T05:41:03.004435+0000","last_active":"2023-12-19T05:41:03.004716+0000","last_peered":"2023-12-19T05:41:03.004716+0000","last_clean":"2023-12-19T05:41:03.004716+0000","last_became_active":"2023-12-19T05:41:03.004175+0000","last_became_peered":"2023-12-19T05:41:03.004175+0000","last_unstale":"2023-12-19T05:41:03.004716+0000","last_undegraded":"2023-12-19T05:41:03.004716+0000","last_fullsized":"2023-12-19T05:41:03.004716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:51:11.564108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015796+0000","last_change":"2023-12-19T05:41:02.496221+0000","last_active":"2023-12-19T05:41:03.015796+0000","last_peered":"2023-12-19T05:41:03.015796+0000","last_clean":"2023-12-19T05:41:03.015796+0000","last_became_active":"2023-12-19T05:41:02.495521+0000","last_became_peered":"2023-12-19T05:41:02.495521+0000","last_unstale":"2023-12-19T05:41:03.015796+0000","last_undegraded":"2023-12-19T05:41:03.015796+0000","last_fullsized":"2023-12-19T05:41:03.015796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:42.544673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005801+0000","last_change":"2023-12-19T05:41:03.004337+0000","last_active":"2023-12-19T05:41:03.005801+0000","last_peered":"2023-12-19T05:41:03.005801+0000","last_clean":"2023-12-19T05:41:03.005801+0000","last_became_active":"2023-12-19T05:41:03.004102+0000","last_became_peered":"2023-12-19T05:41:03.004102+0000","last_unstale":"2023-12-19T05:41:03.005801+0000","last_undegraded":"2023-12-19T05:41:03.005801+0000","last_fullsized":"2023-12-19T05:41:03.005801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:23.470088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004240+0000","last_change":"2023-12-19T05:41:02.496412+0000","last_active":"2023-12-19T05:41:03.004240+0000","last_peered":"2023-12-19T05:41:03.004240+0000","last_clean":"2023-12-19T05:41:03.004240+0000","last_became_active":"2023-12-19T05:41:02.496196+0000","last_became_peered":"2023-12-19T05:41:02.496196+0000","last_unstale":"2023-12-19T05:41:03.004240+0000","last_undegraded":"2023-12-19T05:41:03.004240+0000","last_fullsized":"2023-12-19T05:41:03.004240+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:36:59.476802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997824+0000","last_change":"2023-12-19T05:41:02.996900+0000","last_active":"2023-12-19T05:41:02.997824+0000","last_peered":"2023-12-19T05:41:02.997824+0000","last_clean":"2023-12-19T05:41:02.997824+0000","last_became_active":"2023-12-19T05:41:02.996691+0000","last_became_peered":"2023-12-19T05:41:02.996691+0000","last_unstale":"2023-12-19T05:41:02.997824+0000","last_undegraded":"2023-12-19T05:41:02.997824+0000","last_fullsized":"2023-12-19T05:41:02.997824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:14.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011571+0000","last_change":"2023-12-19T05:41:02.500464+0000","last_active":"2023-12-19T05:41:03.011571+0000","last_peered":"2023-12-19T05:41:03.011571+0000","last_clean":"2023-12-19T05:41:03.011571+0000","last_became_active":"2023-12-19T05:41:02.499014+0000","last_became_peered":"2023-12-19T05:41:02.499014+0000","last_unstale":"2023-12-19T05:41:03.011571+0000","last_undegraded":"2023-12-19T05:41:03.011571+0000","last_fullsized":"2023-12-19T05:41:03.011571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:31.232661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019938+0000","last_change":"2023-12-19T05:41:03.018924+0000","last_active":"2023-12-19T05:41:03.019938+0000","last_peered":"2023-12-19T05:41:03.019938+0000","last_clean":"2023-12-19T05:41:03.019938+0000","last_became_active":"2023-12-19T05:41:03.018596+0000","last_became_peered":"2023-12-19T05:41:03.018596+0000","last_unstale":"2023-12-19T05:41:03.019938+0000","last_undegraded":"2023-12-19T05:41:03.019938+0000","last_fullsized":"2023-12-19T05:41:03.019938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002838+0000","last_change":"2023-12-19T05:41:02.493834+0000","last_active":"2023-12-19T05:41:03.002838+0000","last_peered":"2023-12-19T05:41:03.002838+0000","last_clean":"2023-12-19T05:41:03.002838+0000","last_became_active":"2023-12-19T05:41:02.493485+0000","last_became_peered":"2023-12-19T05:41:02.493485+0000","last_unstale":"2023-12-19T05:41:03.002838+0000","last_undegraded":"2023-12-19T05:41:03.002838+0000","last_fullsized":"2023-12-19T05:41:03.002838+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:18.657294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017277+0000","last_change":"2023-12-19T05:41:03.009178+0000","last_active":"2023-12-19T05:41:03.017277+0000","last_peered":"2023-12-19T05:41:03.017277+0000","last_clean":"2023-12-19T05:41:03.017277+0000","last_became_active":"2023-12-19T05:41:03.005093+0000","last_became_peered":"2023-12-19T05:41:03.005093+0000","last_unstale":"2023-12-19T05:41:03.017277+0000","last_undegraded":"2023-12-19T05:41:03.017277+0000","last_fullsized":"2023-12-19T05:41:03.017277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997104+0000","last_change":"2023-12-19T05:41:02.493998+0000","last_active":"2023-12-19T05:41:02.997104+0000","last_peered":"2023-12-19T05:41:02.997104+0000","last_clean":"2023-12-19T05:41:02.997104+0000","last_became_active":"2023-12-19T05:41:02.493564+0000","last_became_peered":"2023-12-19T05:41:02.493564+0000","last_unstale":"2023-12-19T05:41:02.997104+0000","last_undegraded":"2023-12-19T05:41:02.997104+0000","last_fullsized":"2023-12-19T05:41:02.997104+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994944+0000","last_change":"2023-12-19T05:41:02.994868+0000","last_active":"2023-12-19T05:41:02.994944+0000","last_peered":"2023-12-19T05:41:02.994944+0000","last_clean":"2023-12-19T05:41:02.994944+0000","last_became_active":"2023-12-19T05:41:02.994442+0000","last_became_peered":"2023-12-19T05:41:02.994442+0000","last_unstale":"2023-12-19T05:41:02.994944+0000","last_undegraded":"2023-12-19T05:41:02.994944+0000","last_fullsized":"2023-12-19T05:41:02.994944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:14.010176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002626+0000","last_change":"2023-12-19T05:41:02.496935+0000","last_active":"2023-12-19T05:41:03.002626+0000","last_peered":"2023-12-19T05:41:03.002626+0000","last_clean":"2023-12-19T05:41:03.002626+0000","last_became_active":"2023-12-19T05:41:02.496695+0000","last_became_peered":"2023-12-19T05:41:02.496695+0000","last_unstale":"2023-12-19T05:41:03.002626+0000","last_undegraded":"2023-12-19T05:41:03.002626+0000","last_fullsized":"2023-12-19T05:41:03.002626+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009230+0000","last_change":"2023-12-19T05:41:03.008549+0000","last_active":"2023-12-19T05:41:03.009230+0000","last_peered":"2023-12-19T05:41:03.009230+0000","last_clean":"2023-12-19T05:41:03.009230+0000","last_became_active":"2023-12-19T05:41:03.008269+0000","last_became_peered":"2023-12-19T05:41:03.008269+0000","last_unstale":"2023-12-19T05:41:03.009230+0000","last_undegraded":"2023-12-19T05:41:03.009230+0000","last_fullsized":"2023-12-19T05:41:03.009230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992488+0000","last_change":"2023-12-19T05:41:02.499014+0000","last_active":"2023-12-19T05:41:02.992488+0000","last_peered":"2023-12-19T05:41:02.992488+0000","last_clean":"2023-12-19T05:41:02.992488+0000","last_became_active":"2023-12-19T05:41:02.498040+0000","last_became_peered":"2023-12-19T05:41:02.498040+0000","last_unstale":"2023-12-19T05:41:02.992488+0000","last_undegraded":"2023-12-19T05:41:02.992488+0000","last_fullsized":"2023-12-19T05:41:02.992488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:01:03.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005672+0000","last_change":"2023-12-19T05:41:03.005603+0000","last_active":"2023-12-19T05:41:03.005672+0000","last_peered":"2023-12-19T05:41:03.005672+0000","last_clean":"2023-12-19T05:41:03.005672+0000","last_became_active":"2023-12-19T05:41:03.004845+0000","last_became_peered":"2023-12-19T05:41:03.004845+0000","last_unstale":"2023-12-19T05:41:03.005672+0000","last_undegraded":"2023-12-19T05:41:03.005672+0000","last_fullsized":"2023-12-19T05:41:03.005672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:26.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995924+0000","last_change":"2023-12-19T05:41:02.499304+0000","last_active":"2023-12-19T05:41:02.995924+0000","last_peered":"2023-12-19T05:41:02.995924+0000","last_clean":"2023-12-19T05:41:02.995924+0000","last_became_active":"2023-12-19T05:41:02.498787+0000","last_became_peered":"2023-12-19T05:41:02.498787+0000","last_unstale":"2023-12-19T05:41:02.995924+0000","last_undegraded":"2023-12-19T05:41:02.995924+0000","last_fullsized":"2023-12-19T05:41:02.995924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:01.874064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014588+0000","last_change":"2023-12-19T05:41:03.014318+0000","last_active":"2023-12-19T05:41:03.014588+0000","last_peered":"2023-12-19T05:41:03.014588+0000","last_clean":"2023-12-19T05:41:03.014588+0000","last_became_active":"2023-12-19T05:41:03.013483+0000","last_became_peered":"2023-12-19T05:41:03.013483+0000","last_unstale":"2023-12-19T05:41:03.014588+0000","last_undegraded":"2023-12-19T05:41:03.014588+0000","last_fullsized":"2023-12-19T05:41:03.014588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010661+0000","last_change":"2023-12-19T05:41:02.492843+0000","last_active":"2023-12-19T05:41:03.010661+0000","last_peered":"2023-12-19T05:41:03.010661+0000","last_clean":"2023-12-19T05:41:03.010661+0000","last_became_active":"2023-12-19T05:41:02.492468+0000","last_became_peered":"2023-12-19T05:41:02.492468+0000","last_unstale":"2023-12-19T05:41:03.010661+0000","last_undegraded":"2023-12-19T05:41:03.010661+0000","last_fullsized":"2023-12-19T05:41:03.010661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995171+0000","last_change":"2023-12-19T05:41:02.995054+0000","last_active":"2023-12-19T05:41:02.995171+0000","last_peered":"2023-12-19T05:41:02.995171+0000","last_clean":"2023-12-19T05:41:02.995171+0000","last_became_active":"2023-12-19T05:41:02.992024+0000","last_became_peered":"2023-12-19T05:41:02.992024+0000","last_unstale":"2023-12-19T05:41:02.995171+0000","last_undegraded":"2023-12-19T05:41:02.995171+0000","last_fullsized":"2023-12-19T05:41:02.995171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:22.133325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020186+0000","last_change":"2023-12-19T05:41:02.500015+0000","last_active":"2023-12-19T05:41:03.020186+0000","last_peered":"2023-12-19T05:41:03.020186+0000","last_clean":"2023-12-19T05:41:03.020186+0000","last_became_active":"2023-12-19T05:41:02.496783+0000","last_became_peered":"2023-12-19T05:41:02.496783+0000","last_unstale":"2023-12-19T05:41:03.020186+0000","last_undegraded":"2023-12-19T05:41:03.020186+0000","last_fullsized":"2023-12-19T05:41:03.020186+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:40.888340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015659+0000","last_change":"2023-12-19T05:41:03.015566+0000","last_active":"2023-12-19T05:41:03.015659+0000","last_peered":"2023-12-19T05:41:03.015659+0000","last_clean":"2023-12-19T05:41:03.015659+0000","last_became_active":"2023-12-19T05:41:03.015334+0000","last_became_peered":"2023-12-19T05:41:03.015334+0000","last_unstale":"2023-12-19T05:41:03.015659+0000","last_undegraded":"2023-12-19T05:41:03.015659+0000","last_fullsized":"2023-12-19T05:41:03.015659+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:48:33.267654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008833+0000","last_change":"2023-12-19T05:41:02.497837+0000","last_active":"2023-12-19T05:41:03.008833+0000","last_peered":"2023-12-19T05:41:03.008833+0000","last_clean":"2023-12-19T05:41:03.008833+0000","last_became_active":"2023-12-19T05:41:02.497404+0000","last_became_peered":"2023-12-19T05:41:02.497404+0000","last_unstale":"2023-12-19T05:41:03.008833+0000","last_undegraded":"2023-12-19T05:41:03.008833+0000","last_fullsized":"2023-12-19T05:41:03.008833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:08.475846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005173+0000","last_change":"2023-12-19T05:41:03.002205+0000","last_active":"2023-12-19T05:41:03.005173+0000","last_peered":"2023-12-19T05:41:03.005173+0000","last_clean":"2023-12-19T05:41:03.005173+0000","last_became_active":"2023-12-19T05:41:02.999043+0000","last_became_peered":"2023-12-19T05:41:02.999043+0000","last_unstale":"2023-12-19T05:41:03.005173+0000","last_undegraded":"2023-12-19T05:41:03.005173+0000","last_fullsized":"2023-12-19T05:41:03.005173+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.998914+0000","last_change":"2023-12-19T05:41:02.494828+0000","last_active":"2023-12-19T05:41:02.998914+0000","last_peered":"2023-12-19T05:41:02.998914+0000","last_clean":"2023-12-19T05:41:02.998914+0000","last_became_active":"2023-12-19T05:41:02.491941+0000","last_became_peered":"2023-12-19T05:41:02.491941+0000","last_unstale":"2023-12-19T05:41:02.998914+0000","last_undegraded":"2023-12-19T05:41:02.998914+0000","last_fullsized":"2023-12-19T05:41:02.998914+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012720+0000","last_change":"2023-12-19T05:41:03.012524+0000","last_active":"2023-12-19T05:41:03.012720+0000","last_peered":"2023-12-19T05:41:03.012720+0000","last_clean":"2023-12-19T05:41:03.012720+0000","last_became_active":"2023-12-19T05:41:03.012270+0000","last_became_peered":"2023-12-19T05:41:03.012270+0000","last_unstale":"2023-12-19T05:41:03.012720+0000","last_undegraded":"2023-12-19T05:41:03.012720+0000","last_fullsized":"2023-12-19T05:41:03.012720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992791+0000","last_change":"2023-12-19T05:41:02.501217+0000","last_active":"2023-12-19T05:41:02.992791+0000","last_peered":"2023-12-19T05:41:02.992791+0000","last_clean":"2023-12-19T05:41:02.992791+0000","last_became_active":"2023-12-19T05:41:02.500050+0000","last_became_peered":"2023-12-19T05:41:02.500050+0000","last_unstale":"2023-12-19T05:41:02.992791+0000","last_undegraded":"2023-12-19T05:41:02.992791+0000","last_fullsized":"2023-12-19T05:41:02.992791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:07.414277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007021+0000","last_change":"2023-12-19T05:41:03.002723+0000","last_active":"2023-12-19T05:41:03.007021+0000","last_peered":"2023-12-19T05:41:03.007021+0000","last_clean":"2023-12-19T05:41:03.007021+0000","last_became_active":"2023-12-19T05:41:03.002111+0000","last_became_peered":"2023-12-19T05:41:03.002111+0000","last_unstale":"2023-12-19T05:41:03.007021+0000","last_undegraded":"2023-12-19T05:41:03.007021+0000","last_fullsized":"2023-12-19T05:41:03.007021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020088+0000","last_change":"2023-12-19T05:41:02.501660+0000","last_active":"2023-12-19T05:41:03.020088+0000","last_peered":"2023-12-19T05:41:03.020088+0000","last_clean":"2023-12-19T05:41:03.020088+0000","last_became_active":"2023-12-19T05:41:02.500442+0000","last_became_peered":"2023-12-19T05:41:02.500442+0000","last_unstale":"2023-12-19T05:41:03.020088+0000","last_undegraded":"2023-12-19T05:41:03.020088+0000","last_fullsized":"2023-12-19T05:41:03.020088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:55.432045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000214+0000","last_change":"2023-12-19T05:41:02.999611+0000","last_active":"2023-12-19T05:41:03.000214+0000","last_peered":"2023-12-19T05:41:03.000214+0000","last_clean":"2023-12-19T05:41:03.000214+0000","last_became_active":"2023-12-19T05:41:02.997252+0000","last_became_peered":"2023-12-19T05:41:02.997252+0000","last_unstale":"2023-12-19T05:41:03.000214+0000","last_undegraded":"2023-12-19T05:41:03.000214+0000","last_fullsized":"2023-12-19T05:41:03.000214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:02.802901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.018411+0000","last_change":"2023-12-19T05:41:02.502812+0000","last_active":"2023-12-19T05:41:03.018411+0000","last_peered":"2023-12-19T05:41:03.018411+0000","last_clean":"2023-12-19T05:41:03.018411+0000","last_became_active":"2023-12-19T05:41:02.501062+0000","last_became_peered":"2023-12-19T05:41:02.501062+0000","last_unstale":"2023-12-19T05:41:03.018411+0000","last_undegraded":"2023-12-19T05:41:03.018411+0000","last_fullsized":"2023-12-19T05:41:03.018411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014517+0000","last_change":"2023-12-19T05:41:03.013899+0000","last_active":"2023-12-19T05:41:03.014517+0000","last_peered":"2023-12-19T05:41:03.014517+0000","last_clean":"2023-12-19T05:41:03.014517+0000","last_became_active":"2023-12-19T05:41:03.013363+0000","last_became_peered":"2023-12-19T05:41:03.013363+0000","last_unstale":"2023-12-19T05:41:03.014517+0000","last_undegraded":"2023-12-19T05:41:03.014517+0000","last_fullsized":"2023-12-19T05:41:03.014517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:21.641940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000812+0000","last_change":"2023-12-19T05:41:02.498877+0000","last_active":"2023-12-19T05:41:03.000812+0000","last_peered":"2023-12-19T05:41:03.000812+0000","last_clean":"2023-12-19T05:41:03.000812+0000","last_became_active":"2023-12-19T05:41:02.498484+0000","last_became_peered":"2023-12-19T05:41:02.498484+0000","last_unstale":"2023-12-19T05:41:03.000812+0000","last_undegraded":"2023-12-19T05:41:03.000812+0000","last_fullsized":"2023-12-19T05:41:03.000812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:11.775990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009458+0000","last_change":"2023-12-19T05:41:03.007814+0000","last_active":"2023-12-19T05:41:03.009458+0000","last_peered":"2023-12-19T05:41:03.009458+0000","last_clean":"2023-12-19T05:41:03.009458+0000","last_became_active":"2023-12-19T05:41:03.007396+0000","last_became_peered":"2023-12-19T05:41:03.007396+0000","last_unstale":"2023-12-19T05:41:03.009458+0000","last_undegraded":"2023-12-19T05:41:03.009458+0000","last_fullsized":"2023-12-19T05:41:03.009458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005061+0000","last_change":"2023-12-19T05:41:02.499221+0000","last_active":"2023-12-19T05:41:03.005061+0000","last_peered":"2023-12-19T05:41:03.005061+0000","last_clean":"2023-12-19T05:41:03.005061+0000","last_became_active":"2023-12-19T05:41:02.498665+0000","last_became_peered":"2023-12-19T05:41:02.498665+0000","last_unstale":"2023-12-19T05:41:03.005061+0000","last_undegraded":"2023-12-19T05:41:03.005061+0000","last_fullsized":"2023-12-19T05:41:03.005061+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:20.971597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005816+0000","last_change":"2023-12-19T05:41:03.005755+0000","last_active":"2023-12-19T05:41:03.005816+0000","last_peered":"2023-12-19T05:41:03.005816+0000","last_clean":"2023-12-19T05:41:03.005816+0000","last_became_active":"2023-12-19T05:41:03.005306+0000","last_became_peered":"2023-12-19T05:41:03.005306+0000","last_unstale":"2023-12-19T05:41:03.005816+0000","last_undegraded":"2023-12-19T05:41:03.005816+0000","last_fullsized":"2023-12-19T05:41:03.005816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:12.177921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.993025+0000","last_change":"2023-12-19T05:41:02.500885+0000","last_active":"2023-12-19T05:41:02.993025+0000","last_peered":"2023-12-19T05:41:02.993025+0000","last_clean":"2023-12-19T05:41:02.993025+0000","last_became_active":"2023-12-19T05:41:02.499575+0000","last_became_peered":"2023-12-19T05:41:02.499575+0000","last_unstale":"2023-12-19T05:41:02.993025+0000","last_undegraded":"2023-12-19T05:41:02.993025+0000","last_fullsized":"2023-12-19T05:41:02.993025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:20.628288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017313+0000","last_change":"2023-12-19T05:41:03.011238+0000","last_active":"2023-12-19T05:41:03.017313+0000","last_peered":"2023-12-19T05:41:03.017313+0000","last_clean":"2023-12-19T05:41:03.017313+0000","last_became_active":"2023-12-19T05:41:03.010909+0000","last_became_peered":"2023-12-19T05:41:03.010909+0000","last_unstale":"2023-12-19T05:41:03.017313+0000","last_undegraded":"2023-12-19T05:41:03.017313+0000","last_fullsized":"2023-12-19T05:41:03.017313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020718+0000","last_change":"2023-12-19T05:41:02.498001+0000","last_active":"2023-12-19T05:41:03.020718+0000","last_peered":"2023-12-19T05:41:03.020718+0000","last_clean":"2023-12-19T05:41:03.020718+0000","last_became_active":"2023-12-19T05:41:02.497640+0000","last_became_peered":"2023-12-19T05:41:02.497640+0000","last_unstale":"2023-12-19T05:41:03.020718+0000","last_undegraded":"2023-12-19T05:41:03.020718+0000","last_fullsized":"2023-12-19T05:41:03.020718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:07.684487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005258+0000","last_change":"2023-12-19T05:41:03.003993+0000","last_active":"2023-12-19T05:41:03.005258+0000","last_peered":"2023-12-19T05:41:03.005258+0000","last_clean":"2023-12-19T05:41:03.005258+0000","last_became_active":"2023-12-19T05:41:03.003702+0000","last_became_peered":"2023-12-19T05:41:03.003702+0000","last_unstale":"2023-12-19T05:41:03.005258+0000","last_undegraded":"2023-12-19T05:41:03.005258+0000","last_fullsized":"2023-12-19T05:41:03.005258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:41.901992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997254+0000","last_change":"2023-12-19T05:41:02.501432+0000","last_active":"2023-12-19T05:41:02.997254+0000","last_peered":"2023-12-19T05:41:02.997254+0000","last_clean":"2023-12-19T05:41:02.997254+0000","last_became_active":"2023-12-19T05:41:02.500921+0000","last_became_peered":"2023-12-19T05:41:02.500921+0000","last_unstale":"2023-12-19T05:41:02.997254+0000","last_undegraded":"2023-12-19T05:41:02.997254+0000","last_fullsized":"2023-12-19T05:41:02.997254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:46:43.175554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013818+0000","last_change":"2023-12-19T05:41:03.013626+0000","last_active":"2023-12-19T05:41:03.013818+0000","last_peered":"2023-12-19T05:41:03.013818+0000","last_clean":"2023-12-19T05:41:03.013818+0000","last_became_active":"2023-12-19T05:41:03.005094+0000","last_became_peered":"2023-12-19T05:41:03.005094+0000","last_unstale":"2023-12-19T05:41:03.013818+0000","last_undegraded":"2023-12-19T05:41:03.013818+0000","last_fullsized":"2023-12-19T05:41:03.013818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002816+0000","last_change":"2023-12-19T05:41:02.502611+0000","last_active":"2023-12-19T05:41:03.002816+0000","last_peered":"2023-12-19T05:41:03.002816+0000","last_clean":"2023-12-19T05:41:03.002816+0000","last_became_active":"2023-12-19T05:41:02.502340+0000","last_became_peered":"2023-12-19T05:41:02.502340+0000","last_unstale":"2023-12-19T05:41:03.002816+0000","last_undegraded":"2023-12-19T05:41:03.002816+0000","last_fullsized":"2023-12-19T05:41:03.002816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:30.259577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013091+0000","last_change":"2023-12-19T05:41:03.012107+0000","last_active":"2023-12-19T05:41:03.013091+0000","last_peered":"2023-12-19T05:41:03.013091+0000","last_clean":"2023-12-19T05:41:03.013091+0000","last_became_active":"2023-12-19T05:41:03.011666+0000","last_became_peered":"2023-12-19T05:41:03.011666+0000","last_unstale":"2023-12-19T05:41:03.013091+0000","last_undegraded":"2023-12-19T05:41:03.013091+0000","last_fullsized":"2023-12-19T05:41:03.013091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:30:44.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.981451+0000","last_change":"2023-12-19T05:41:02.482151+0000","last_active":"2023-12-19T05:41:02.981451+0000","last_peered":"2023-12-19T05:41:02.981451+0000","last_clean":"2023-12-19T05:41:02.981451+0000","last_became_active":"2023-12-19T05:41:02.481408+0000","last_became_peered":"2023-12-19T05:41:02.481408+0000","last_unstale":"2023-12-19T05:41:02.981451+0000","last_undegraded":"2023-12-19T05:41:02.981451+0000","last_fullsized":"2023-12-19T05:41:02.981451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:09.900893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004770+0000","last_change":"2023-12-19T05:41:03.004678+0000","last_active":"2023-12-19T05:41:03.004770+0000","last_peered":"2023-12-19T05:41:03.004770+0000","last_clean":"2023-12-19T05:41:03.004770+0000","last_became_active":"2023-12-19T05:41:02.998579+0000","last_became_peered":"2023-12-19T05:41:02.998579+0000","last_unstale":"2023-12-19T05:41:03.004770+0000","last_undegraded":"2023-12-19T05:41:03.004770+0000","last_fullsized":"2023-12-19T05:41:03.004770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:44.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T05:41:04.031885+0000","last_change":"2023-12-19T05:41:02.491086+0000","last_active":"2023-12-19T05:41:04.031885+0000","last_peered":"2023-12-19T05:41:04.031885+0000","last_clean":"2023-12-19T05:41:04.031885+0000","last_became_active":"2023-12-19T05:41:02.487771+0000","last_became_peered":"2023-12-19T05:41:02.487771+0000","last_unstale":"2023-12-19T05:41:04.031885+0000","last_undegraded":"2023-12-19T05:41:04.031885+0000","last_fullsized":"2023-12-19T05:41:04.031885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017255+0000","last_change":"2023-12-19T05:41:03.005809+0000","last_active":"2023-12-19T05:41:03.017255+0000","last_peered":"2023-12-19T05:41:03.017255+0000","last_clean":"2023-12-19T05:41:03.017255+0000","last_became_active":"2023-12-19T05:41:03.004652+0000","last_became_peered":"2023-12-19T05:41:03.004652+0000","last_unstale":"2023-12-19T05:41:03.017255+0000","last_undegraded":"2023-12-19T05:41:03.017255+0000","last_fullsized":"2023-12-19T05:41:03.017255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997446+0000","last_change":"2023-12-19T05:41:02.501207+0000","last_active":"2023-12-19T05:41:02.997446+0000","last_peered":"2023-12-19T05:41:02.997446+0000","last_clean":"2023-12-19T05:41:02.997446+0000","last_became_active":"2023-12-19T05:41:02.500475+0000","last_became_peered":"2023-12-19T05:41:02.500475+0000","last_unstale":"2023-12-19T05:41:02.997446+0000","last_undegraded":"2023-12-19T05:41:02.997446+0000","last_fullsized":"2023-12-19T05:41:02.997446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:26.639795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994769+0000","last_change":"2023-12-19T05:41:02.994695+0000","last_active":"2023-12-19T05:41:02.994769+0000","last_peered":"2023-12-19T05:41:02.994769+0000","last_clean":"2023-12-19T05:41:02.994769+0000","last_became_active":"2023-12-19T05:41:02.994094+0000","last_became_peered":"2023-12-19T05:41:02.994094+0000","last_unstale":"2023-12-19T05:41:02.994769+0000","last_undegraded":"2023-12-19T05:41:02.994769+0000","last_fullsized":"2023-12-19T05:41:02.994769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:21.890762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986535+0000","last_change":"2023-12-19T05:41:02.499981+0000","last_active":"2023-12-19T05:41:02.986535+0000","last_peered":"2023-12-19T05:41:02.986535+0000","last_clean":"2023-12-19T05:41:02.986535+0000","last_became_active":"2023-12-19T05:41:02.499733+0000","last_became_peered":"2023-12-19T05:41:02.499733+0000","last_unstale":"2023-12-19T05:41:02.986535+0000","last_undegraded":"2023-12-19T05:41:02.986535+0000","last_fullsized":"2023-12-19T05:41:02.986535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017798+0000","last_change":"2023-12-19T05:41:03.014284+0000","last_active":"2023-12-19T05:41:03.017798+0000","last_peered":"2023-12-19T05:41:03.017798+0000","last_clean":"2023-12-19T05:41:03.017798+0000","last_became_active":"2023-12-19T05:41:03.011821+0000","last_became_peered":"2023-12-19T05:41:03.011821+0000","last_unstale":"2023-12-19T05:41:03.017798+0000","last_undegraded":"2023-12-19T05:41:03.017798+0000","last_fullsized":"2023-12-19T05:41:03.017798+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.999008+0000","last_change":"2023-12-19T05:41:02.495242+0000","last_active":"2023-12-19T05:41:02.999008+0000","last_peered":"2023-12-19T05:41:02.999008+0000","last_clean":"2023-12-19T05:41:02.999008+0000","last_became_active":"2023-12-19T05:41:02.494329+0000","last_became_peered":"2023-12-19T05:41:02.494329+0000","last_unstale":"2023-12-19T05:41:02.999008+0000","last_undegraded":"2023-12-19T05:41:02.999008+0000","last_fullsized":"2023-12-19T05:41:02.999008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:50.527425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013537+0000","last_change":"2023-12-19T05:41:03.013464+0000","last_active":"2023-12-19T05:41:03.013537+0000","last_peered":"2023-12-19T05:41:03.013537+0000","last_clean":"2023-12-19T05:41:03.013537+0000","last_became_active":"2023-12-19T05:41:03.004819+0000","last_became_peered":"2023-12-19T05:41:03.004819+0000","last_unstale":"2023-12-19T05:41:03.013537+0000","last_undegraded":"2023-12-19T05:41:03.013537+0000","last_fullsized":"2023-12-19T05:41:03.013537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:23.806072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.982958+0000","last_change":"2023-12-19T05:41:02.495475+0000","last_active":"2023-12-19T05:41:02.982958+0000","last_peered":"2023-12-19T05:41:02.982958+0000","last_clean":"2023-12-19T05:41:02.982958+0000","last_became_active":"2023-12-19T05:41:02.495251+0000","last_became_peered":"2023-12-19T05:41:02.495251+0000","last_unstale":"2023-12-19T05:41:02.982958+0000","last_undegraded":"2023-12-19T05:41:02.982958+0000","last_fullsized":"2023-12-19T05:41:02.982958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:22.792419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005389+0000","last_change":"2023-12-19T05:41:03.005005+0000","last_active":"2023-12-19T05:41:03.005389+0000","last_peered":"2023-12-19T05:41:03.005389+0000","last_clean":"2023-12-19T05:41:03.005389+0000","last_became_active":"2023-12-19T05:41:03.003890+0000","last_became_peered":"2023-12-19T05:41:03.003890+0000","last_unstale":"2023-12-19T05:41:03.005389+0000","last_undegraded":"2023-12-19T05:41:03.005389+0000","last_fullsized":"2023-12-19T05:41:03.005389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997360+0000","last_change":"2023-12-19T05:41:02.490841+0000","last_active":"2023-12-19T05:41:02.997360+0000","last_peered":"2023-12-19T05:41:02.997360+0000","last_clean":"2023-12-19T05:41:02.997360+0000","last_became_active":"2023-12-19T05:41:02.486586+0000","last_became_peered":"2023-12-19T05:41:02.486586+0000","last_unstale":"2023-12-19T05:41:02.997360+0000","last_undegraded":"2023-12-19T05:41:02.997360+0000","last_fullsized":"2023-12-19T05:41:02.997360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007002+0000","last_change":"2023-12-19T05:41:03.005594+0000","last_active":"2023-12-19T05:41:03.007002+0000","last_peered":"2023-12-19T05:41:03.007002+0000","last_clean":"2023-12-19T05:41:03.007002+0000","last_became_active":"2023-12-19T05:41:03.005233+0000","last_became_peered":"2023-12-19T05:41:03.005233+0000","last_unstale":"2023-12-19T05:41:03.007002+0000","last_undegraded":"2023-12-19T05:41:03.007002+0000","last_fullsized":"2023-12-19T05:41:03.007002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986090+0000","last_change":"2023-12-19T05:41:02.502475+0000","last_active":"2023-12-19T05:41:02.986090+0000","last_peered":"2023-12-19T05:41:02.986090+0000","last_clean":"2023-12-19T05:41:02.986090+0000","last_became_active":"2023-12-19T05:41:02.502142+0000","last_became_peered":"2023-12-19T05:41:02.502142+0000","last_unstale":"2023-12-19T05:41:02.986090+0000","last_undegraded":"2023-12-19T05:41:02.986090+0000","last_fullsized":"2023-12-19T05:41:02.986090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:19:26.512158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012953+0000","last_change":"2023-12-19T05:41:03.006611+0000","last_active":"2023-12-19T05:41:03.012953+0000","last_peered":"2023-12-19T05:41:03.012953+0000","last_clean":"2023-12-19T05:41:03.012953+0000","last_became_active":"2023-12-19T05:41:03.005974+0000","last_became_peered":"2023-12-19T05:41:03.005974+0000","last_unstale":"2023-12-19T05:41:03.012953+0000","last_undegraded":"2023-12-19T05:41:03.012953+0000","last_fullsized":"2023-12-19T05:41:03.012953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015771+0000","last_change":"2023-12-19T05:41:02.491690+0000","last_active":"2023-12-19T05:41:03.015771+0000","last_peered":"2023-12-19T05:41:03.015771+0000","last_clean":"2023-12-19T05:41:03.015771+0000","last_became_active":"2023-12-19T05:41:02.491325+0000","last_became_peered":"2023-12-19T05:41:02.491325+0000","last_unstale":"2023-12-19T05:41:03.015771+0000","last_undegraded":"2023-12-19T05:41:03.015771+0000","last_fullsized":"2023-12-19T05:41:03.015771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:09.559440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.991237+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:41:02.991237+0000","last_peered":"2023-12-19T05:41:02.991237+0000","last_clean":"2023-12-19T05:41:02.991237+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:41:02.991237+0000","last_undegraded":"2023-12-19T05:41:02.991237+0000","last_fullsized":"2023-12-19T05:41:02.991237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.321},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.034,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3939999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.5820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.502}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2330000000000001,"15min":1.2410000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5189999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.216},{"interface":"front","average":{"1min":1.085,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1850000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.135,"15min":1.119},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.72,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.034,"15min":1.01},"min":{"1min":0.84299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.091},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.25,"15min":1.234},"min":{"1min":1.0169999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.694,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.141}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3069999999999999,"15min":1.304},"min":{"1min":0.96099999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.028},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.216,"15min":1.212},"min":{"1min":0.82999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.458,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":1.232,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.369,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.946,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.4510000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5089999999999999,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.022},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.0249999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.145,"15min":1.131},"min":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.327,"15min":1.345},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.851,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.518}]},{"osd":2,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2,"5min":2,"15min":2},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.3180000000000001,"15min":1.3360000000000001},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.738,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3740000000000001,"15min":1.409},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.857,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.379,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1579999999999999,"5min":4.452,"15min":4.452},"last":1.335}]},{"osd":4,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3720000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9219999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.474,"15min":1.514},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.7240000000000002,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.6930000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5920000000000001,"15min":1.6279999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5070000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.7589999999999999,"15min":1.8109999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0630000000000002,"5min":3.681,"15min":3.681},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5369999999999999,"15min":1.5629999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8089999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.927},{"interface":"front","average":{"1min":1.617,"5min":1.639,"15min":1.643},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.4609999999999999,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.6779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.536,"5min":2.085,"15min":2.085},"last":0.995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4339999999999999,"5min":2.641,"15min":2.641},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.24,"15min":1.2470000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.359},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.375},"min":{"1min":0.89400000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.984,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1859999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.2230000000000001,"15min":1.252},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5169999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.105},{"interface":"front","average":{"1min":1.232,"5min":1.23,"15min":1.23},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.54,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.2270000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.456,"15min":1.486},"min":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.998,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.4339999999999999,"15min":1.4650000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.706,"5min":2.754,"15min":2.754},"last":1.581}]},{"osd":4,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.508,"15min":1.546},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.7010000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.647},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.611,"15min":1.653},"min":{"1min":0.83399999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.8879999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.5289999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5129999999999999,"15min":1.5469999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8640000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.6890000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.6950000000000001,"15min":1.7350000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8999999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.4870000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.7270000000000001,"15min":1.7649999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.0510000000000002,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.6140000000000001,"15min":1.641},"min":{"1min":0.65000000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.762}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.042,"15min":1.0509999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.02}]},{"osd":1,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":1.577},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1970000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.2},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.478,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.464}]},{"osd":5,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.292},{"interface":"front","average":{"1min":1.331,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.93700000000000006,"5min":0.75,"15min":0.75},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2509999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.349,"15min":1.361},"min":{"1min":1.016,"5min":0.872,"15min":0.872},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.381,"15min":1.389},"min":{"1min":1.081,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.6899999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.395}]},{"osd":7,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3280000000000001,"15min":1.323},"min":{"1min":0.94299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.4470000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.524,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5089999999999999,"5min":2.702,"15min":2.702},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.048,"15min":1.038},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6140000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.149,"15min":1.149},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6779999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.877,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.8180000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.369}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3129999999999999,"15min":1.304},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7689999999999999,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8580000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.321,"15min":1.3220000000000001},"min":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8009999999999999,"5min":2.02,"15min":2.02},"last":1.615}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9710000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.423,"15min":1.423},"min":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.968,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.268}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768336,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.748,"15min":0.747},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.012,"15min":1.024},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.464,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4790000000000001,"5min":1.595,"15min":1.595},"last":0.746}]},{"osd":3,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.542,"5min":1.704,"15min":1.704},"last":0.58999999999999997}]},{"osd":4,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2030000000000001,"15min":1.2050000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.95299999999999996}]},{"osd":5,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.254,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.589,"5min":1.702,"15min":1.702},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2689999999999999,"15min":1.2829999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6379999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2649999999999999,"15min":1.27},"min":{"1min":0.84899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.802,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.157},{"interface":"front","average":{"1min":1.286,"5min":1.288,"15min":1.288},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0509999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.006},{"interface":"front","average":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3999999999999999},"min":{"1min":0.91800000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.746,"5min":2.714,"15min":2.714},"last":1.0269999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.48399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.145,"5min":2.992,"15min":2.992},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.3,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.073,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.079},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.45,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.522}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3029999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.595,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.206,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8680000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.872,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.508,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.679,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.3340000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3069999999999999,"15min":1.3220000000000001},"min":{"1min":0.82699999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7909999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.899,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.056}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3779999999999999,"15min":1.389},"min":{"1min":0.78000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7729999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3879999999999999,"15min":1.397},"min":{"1min":0.88700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6839999999999999,"5min":2.319,"15min":2.319},"last":1.3620000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4770000000000001,"15min":1.4910000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7390000000000001,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.5589999999999999,"15min":1.579},"min":{"1min":1.038,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.853,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.97799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767754,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.79100000000000004,"15min":0.77400000000000002},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4119999999999999,"5min":1.427,"15min":1.427},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85699999999999998,"15min":0.86399999999999999},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.0469999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.496,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.1259999999999999,"15min":1.143},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6259999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.516}]},{"osd":3,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3160000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.601,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.79100000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.571,"15min":1.571},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.71799999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.804}]},{"osd":5,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.292,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5920000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.645,"5min":1.714,"15min":1.714},"last":1.879}]},{"osd":6,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.363,"15min":1.379},"min":{"1min":0.81100000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6919999999999999,"5min":1.891,"15min":1.891},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.91600000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.397,"15min":1.399},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.04},{"interface":"front","average":{"1min":1.339,"5min":1.349,"15min":1.351},"min":{"1min":0.96399999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.7470000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:41:08.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T05:41:09.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.048+0000 7fca3bfff640 1 Processor -- start 2023-12-19T05:41:09.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.048+0000 7fca3bfff640 1 -- start start 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca3c164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3bfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c06b520 con 0x7fca3c159f80 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0b2b20 con 0x7fca3c15b1e0 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0b2fb0 con 0x7fca3c15aa70 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fca3c159f80 0x7fca3c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39094/0 (socket says 172.21.15.49:39094) 2023-12-19T05:41:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3affd640 1 -- 172.21.15.49:0/953501927 learned_addr learned my addr 172.21.15.49:0/953501927 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892054891 0 0) 0x7fca3c06b520 con 0x7fca3c159f80 2023-12-19T05:41:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.050+0000 7fca3b7fe640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca3c164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca28005730 con 0x7fca3c159f80 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699808342 0 0) 0x7fca28005730 con 0x7fca3c159f80 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 msgr2=0x7fca3c164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca3c164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 >> v1:172.21.15.115:6789/0 conn(0x7fca3c15b1e0 legacy=0x7fca3c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c0b1f10 con 0x7fca3c159f80 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fca2c001670 con 0x7fca3c159f80 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 >> v1:172.21.15.49:6789/0 conn(0x7fca3c159f80 legacy=0x7fca3c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca28005bb0 0x7fca28005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca280069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28006f10 0x7fca28007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0b2fb0 con 0x7fca28005bb0 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2800dcd0 con 0x7fca28006f10 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2800de90 con 0x7fca3c15aa70 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.051+0000 7fca3affd640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca28005bb0 0x7fca28005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3b7fe640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28006f10 0x7fca28007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca33fff640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca280069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3affd640 1 -- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 msgr2=0x7fca280069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3affd640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c15aa70 0x7fca280069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3affd640 1 -- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28006f10 msgr2=0x7fca28007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3affd640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28006f10 0x7fca28007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3affd640 1 -- 172.21.15.49:0/953501927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28005730 con 0x7fca28005bb0 2023-12-19T05:41:09.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.052+0000 7fca3b7fe640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28006f10 0x7fca28007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.053+0000 7fca3affd640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca28005bb0 0x7fca28005fd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c210 tx=0x7fca28007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fd3d4c71944302 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.053+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c005ad0 con 0x7fca28005bb0 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.053+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c005c30 con 0x7fca28005bb0 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.053+0000 7fca3a7fc640 1 -- 172.21.15.49:0/953501927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c02c890 con 0x7fca28005bb0 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 -- 172.21.15.49:0/953501927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca28005bb0 msgr2=0x7fca28005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 --2- 172.21.15.49:0/953501927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca28005bb0 0x7fca28005fd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c210 tx=0x7fca28007a00 comp rx=0 tx=0).stop 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3b7fe640 1 -- 172.21.15.49:0/953501927 reap_dead start 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 -- 172.21.15.49:0/953501927 shutdown_connections 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 -- 172.21.15.49:0/953501927 >> 172.21.15.49:0/953501927 conn(0x7fca3c0b0100 msgr2=0x7fca3c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 -- 172.21.15.49:0/953501927 shutdown_connections 2023-12-19T05:41:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.054+0000 7fca3bfff640 1 -- 172.21.15.49:0/953501927 wait complete. 2023-12-19T05:41:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.056+0000 7fca3bfff640 1 Processor -- start 2023-12-19T05:41:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.056+0000 7fca3bfff640 1 -- start start 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28005bb0 0x7fca3c1e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c0ae070 0x7fca3c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c1f28b0 con 0x7fca3c06d810 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0aea30 con 0x7fca28005bb0 2023-12-19T05:41:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.057+0000 7fca3bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c147ee0 con 0x7fca3c0ae070 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42846/0 (socket says 172.21.15.49:42846) 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 -- 172.21.15.49:0/4265747443 learned_addr learned my addr 172.21.15.49:0/4265747443 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca3affd640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28005bb0 0x7fca3c1e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca3b7fe640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c0ae070 0x7fca3c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 -- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c0ae070 msgr2=0x7fca3c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c0ae070 0x7fca3c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 -- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28005bb0 msgr2=0x7fca3c1e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28005bb0 0x7fca3c1e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 -- 172.21.15.49:0/4265747443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c06dfb0 con 0x7fca3c06d810 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.058+0000 7fca33fff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fca2400e550 tx=0x7fca2400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.059+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240052e0 con 0x7fca3c06d810 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.059+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24005440 con 0x7fca3c06d810 2023-12-19T05:41:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.059+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24003810 con 0x7fca3c06d810 2023-12-19T05:41:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.059+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c06e290 con 0x7fca3c06d810 2023-12-19T05:41:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.059+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c1e50a0 con 0x7fca3c06d810 2023-12-19T05:41:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.060+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c061910 con 0x7fca3c06d810 2023-12-19T05:41:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.061+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca24003970 con 0x7fca3c06d810 2023-12-19T05:41:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.063+0000 7fca337fe640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 0x7fca1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.063+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca240886d0 con 0x7fca3c06d810 2023-12-19T05:41:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.063+0000 7fca3affd640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 0x7fca1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.064+0000 7fca3affd640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 0x7fca1c06c920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca2c034000 tx=0x7fca2c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.068+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca24053c30 con 0x7fca3c06d810 2023-12-19T05:41:09.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.340+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fca3c0b0f70 con 0x7fca3c06d810 2023-12-19T05:41:09.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.341+0000 7fca337fe640 1 -- 172.21.15.49:0/4265747443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1425 (secure 0 0 0) 0x7fca24057250 con 0x7fca3c06d810 2023-12-19T05:41:09.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:09.343 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1702964331,"num_in_osds":8,"osd_in_since":1702964328,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":3038052,"bytes_avail":1596961948,"bytes_total":1600000000,"write_bytes_sec":2361,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5541}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-19T05:40:48.536605+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T05:41:09.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.343+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 msgr2=0x7fca1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.343+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 0x7fca1c06c920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca2c034000 tx=0x7fca2c009030 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.343+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 msgr2=0x7fca3c1479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fca2400e550 tx=0x7fca2400ea10 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 shutdown_connections 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fca1c06a460 0x7fca1c06c920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca3c0ae070 0x7fca3c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca3c06d810 0x7fca3c1479a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 --2- 172.21.15.49:0/4265747443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca28005bb0 0x7fca3c1e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 >> 172.21.15.49:0/4265747443 conn(0x7fca3c0b0100 msgr2=0x7fca3c0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 shutdown_connections 2023-12-19T05:41:09.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.344+0000 7fca3bfff640 1 -- 172.21.15.49:0/4265747443 wait complete. 2023-12-19T05:41:09.364 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T05:41:09.364 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:41:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.597+0000 7f50228a1640 1 Processor -- start 2023-12-19T05:41:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.598+0000 7f50228a1640 1 -- start start 2023-12-19T05:41:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.599+0000 7f50228a1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f501c146e10 0x7f501c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.599+0000 7f50228a1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0d2b00 0x7f501c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.599+0000 7f50228a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f50228a1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0d2430 con 0x7f501c0d2b00 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f50228a1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0ceac0 con 0x7f501c146e10 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f50228a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0cd840 con 0x7f501c0ce110 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f501b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0d2b00 0x7f501c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f501b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0d2b00 0x7f501c0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42852/0 (socket says 172.21.15.49:42852) 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f501b7fe640 1 -- 172.21.15.49:0/1146688393 learned_addr learned my addr 172.21.15.49:0/1146688393 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f501bfff640 1 --2- 172.21.15.49:0/1146688393 >> v2:172.21.15.115:3300/0 conn(0x7f501c146e10 0x7f501c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.600+0000 7f5020e3e640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.601+0000 7f501b7fe640 1 -- 172.21.15.49:0/1146688393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 msgr2=0x7f501c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.601+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.601+0000 7f501b7fe640 1 -- 172.21.15.49:0/1146688393 >> v2:172.21.15.115:3300/0 conn(0x7f501c146e10 msgr2=0x7f501c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.601+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1146688393 >> v2:172.21.15.115:3300/0 conn(0x7f501c146e10 0x7f501c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.601+0000 7f501b7fe640 1 -- 172.21.15.49:0/1146688393 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0d2620 con 0x7f501c0d2b00 2023-12-19T05:41:09.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.602+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c0b6780 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f501c0d0720 tx=0x7f500402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c4c77a30f7d08b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.602+0000 7f501affd640 1 -- 172.21.15.49:0/1146688393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004031640 con 0x7f501c0d2b00 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.602+0000 7f501affd640 1 -- 172.21.15.49:0/1146688393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50040317a0 con 0x7f501c0d2b00 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.602+0000 7f501affd640 1 -- 172.21.15.49:0/1146688393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004031b30 con 0x7f501c0d2b00 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 -- 172.21.15.49:0/1146688393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 msgr2=0x7f501c0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c0b6780 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f501c0d0720 tx=0x7f500402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 -- 172.21.15.49:0/1146688393 shutdown_connections 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 --2- 172.21.15.49:0/1146688393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c0b6780 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 --2- 172.21.15.49:0/1146688393 >> v2:172.21.15.115:3300/0 conn(0x7f501c146e10 0x7f501c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 -- 172.21.15.49:0/1146688393 >> 172.21.15.49:0/1146688393 conn(0x7f501c0b29c0 msgr2=0x7f501c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 -- 172.21.15.49:0/1146688393 shutdown_connections 2023-12-19T05:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.603+0000 7f50228a1640 1 -- 172.21.15.49:0/1146688393 wait complete. 2023-12-19T05:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.605+0000 7f50228a1640 1 Processor -- start 2023-12-19T05:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.605+0000 7f50228a1640 1 -- start start 2023-12-19T05:41:09.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 0x7f501c0d1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c156c50 con 0x7f501c0d2b00 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c156f30 con 0x7f501c146e10 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f50228a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c157210 con 0x7f501c0ce110 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42864/0 (socket says 172.21.15.49:42864) 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.606+0000 7f501b7fe640 1 -- 172.21.15.49:0/1776399980 learned_addr learned my addr 172.21.15.49:0/1776399980 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501bfff640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f5020e3e640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 0x7f501c0d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 -- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 msgr2=0x7f501c157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 -- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 msgr2=0x7f501c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 0x7f501c0d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 -- 172.21.15.49:0/1776399980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040094d0 con 0x7f501c0d2b00 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f5020e3e640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 0x7f501c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.607+0000 7f501b7fe640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c00 tx=0x7f50040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.608+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500403ac60 con 0x7f501c0d2b00 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.608+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500403adc0 con 0x7f501c0d2b00 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.608+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004044630 con 0x7f501c0d2b00 2023-12-19T05:41:09.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.608+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c1574f0 con 0x7f501c0d2b00 2023-12-19T05:41:09.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.608+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c156940 con 0x7f501c0d2b00 2023-12-19T05:41:09.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.609+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c061910 con 0x7f501c0d2b00 2023-12-19T05:41:09.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.610+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f500402f050 con 0x7f501c0d2b00 2023-12-19T05:41:09.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.611+0000 7f5018ff9640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 0x7f4ffc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:09.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.611+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50040aa830 con 0x7f501c0d2b00 2023-12-19T05:41:09.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.611+0000 7f501bfff640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 0x7f4ffc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:09.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.613+0000 7f501bfff640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 0x7f4ffc06c8f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f500c009e90 tx=0x7f500c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.615+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5004075e20 con 0x7f501c0d2b00 2023-12-19T05:41:09.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.812+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f501c1570a0 con 0x7f4ffc06a430 2023-12-19T05:41:09.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.835+0000 7f5018ff9640 1 -- 172.21.15.49:0/1776399980 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282560 (secure 0 0 0) 0x7f501c1570a0 con 0x7f4ffc06a430 2023-12-19T05:41:09.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:09.842 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:41:09.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 msgr2=0x7f4ffc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 0x7f4ffc06c8f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f500c009e90 tx=0x7f500c00b040 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 msgr2=0x7f501c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c00 tx=0x7f50040046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 shutdown_connections 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4ffc06a430 0x7f4ffc06c8f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c146e10 0x7f501c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0d2b00 0x7f501c156400 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 --2- 172.21.15.49:0/1776399980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0ce110 0x7f501c157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 >> 172.21.15.49:0/1776399980 conn(0x7f501c0b29c0 msgr2=0x7f501c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 shutdown_connections 2023-12-19T05:41:09.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:09.840+0000 7f50228a1640 1 -- 172.21.15.49:0/1776399980 wait complete. 2023-12-19T05:41:09.861 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-19T05:41:08.542149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559533,"statfs":{"total":1600000000,"available":1596961948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.069821"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008146+0000","last_change":"2023-12-19T05:41:03.008059+0000","last_active":"2023-12-19T05:41:03.008146+0000","last_peered":"2023-12-19T05:41:03.008146+0000","last_clean":"2023-12-19T05:41:03.008146+0000","last_became_active":"2023-12-19T05:41:03.007775+0000","last_became_peered":"2023-12-19T05:41:03.007775+0000","last_unstale":"2023-12-19T05:41:03.008146+0000","last_undegraded":"2023-12-19T05:41:03.008146+0000","last_fullsized":"2023-12-19T05:41:03.008146+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.908180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009441+0000","last_change":"2023-12-19T05:41:03.007711+0000","last_active":"2023-12-19T05:41:03.009441+0000","last_peered":"2023-12-19T05:41:03.009441+0000","last_clean":"2023-12-19T05:41:03.009441+0000","last_became_active":"2023-12-19T05:41:03.006894+0000","last_became_peered":"2023-12-19T05:41:03.006894+0000","last_unstale":"2023-12-19T05:41:03.009441+0000","last_undegraded":"2023-12-19T05:41:03.009441+0000","last_fullsized":"2023-12-19T05:41:03.009441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011824+0000","last_change":"2023-12-19T05:41:03.011727+0000","last_active":"2023-12-19T05:41:03.011824+0000","last_peered":"2023-12-19T05:41:03.011824+0000","last_clean":"2023-12-19T05:41:03.011824+0000","last_became_active":"2023-12-19T05:41:03.011503+0000","last_became_peered":"2023-12-19T05:41:03.011503+0000","last_unstale":"2023-12-19T05:41:03.011824+0000","last_undegraded":"2023-12-19T05:41:03.011824+0000","last_fullsized":"2023-12-19T05:41:03.011824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:05:42.452542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012986+0000","last_change":"2023-12-19T05:41:03.007914+0000","last_active":"2023-12-19T05:41:03.012986+0000","last_peered":"2023-12-19T05:41:03.012986+0000","last_clean":"2023-12-19T05:41:03.012986+0000","last_became_active":"2023-12-19T05:41:03.001895+0000","last_became_peered":"2023-12-19T05:41:03.001895+0000","last_unstale":"2023-12-19T05:41:03.012986+0000","last_undegraded":"2023-12-19T05:41:03.012986+0000","last_fullsized":"2023-12-19T05:41:03.012986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:19.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010380+0000","last_change":"2023-12-19T05:41:03.010256+0000","last_active":"2023-12-19T05:41:03.010380+0000","last_peered":"2023-12-19T05:41:03.010380+0000","last_clean":"2023-12-19T05:41:03.010380+0000","last_became_active":"2023-12-19T05:41:03.010053+0000","last_became_peered":"2023-12-19T05:41:03.010053+0000","last_unstale":"2023-12-19T05:41:03.010380+0000","last_undegraded":"2023-12-19T05:41:03.010380+0000","last_fullsized":"2023-12-19T05:41:03.010380+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:13.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017837+0000","last_change":"2023-12-19T05:41:03.016519+0000","last_active":"2023-12-19T05:41:03.017837+0000","last_peered":"2023-12-19T05:41:03.017837+0000","last_clean":"2023-12-19T05:41:03.017837+0000","last_became_active":"2023-12-19T05:41:03.016292+0000","last_became_peered":"2023-12-19T05:41:03.016292+0000","last_unstale":"2023-12-19T05:41:03.017837+0000","last_undegraded":"2023-12-19T05:41:03.017837+0000","last_fullsized":"2023-12-19T05:41:03.017837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:16:31.087909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004751+0000","last_change":"2023-12-19T05:41:03.004481+0000","last_active":"2023-12-19T05:41:03.004751+0000","last_peered":"2023-12-19T05:41:03.004751+0000","last_clean":"2023-12-19T05:41:03.004751+0000","last_became_active":"2023-12-19T05:41:02.998031+0000","last_became_peered":"2023-12-19T05:41:02.998031+0000","last_unstale":"2023-12-19T05:41:03.004751+0000","last_undegraded":"2023-12-19T05:41:03.004751+0000","last_fullsized":"2023-12-19T05:41:03.004751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:47.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012927+0000","last_change":"2023-12-19T05:41:03.006337+0000","last_active":"2023-12-19T05:41:03.012927+0000","last_peered":"2023-12-19T05:41:03.012927+0000","last_clean":"2023-12-19T05:41:03.012927+0000","last_became_active":"2023-12-19T05:41:03.005528+0000","last_became_peered":"2023-12-19T05:41:03.005528+0000","last_unstale":"2023-12-19T05:41:03.012927+0000","last_undegraded":"2023-12-19T05:41:03.012927+0000","last_fullsized":"2023-12-19T05:41:03.012927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013757+0000","last_change":"2023-12-19T05:41:03.013415+0000","last_active":"2023-12-19T05:41:03.013757+0000","last_peered":"2023-12-19T05:41:03.013757+0000","last_clean":"2023-12-19T05:41:03.013757+0000","last_became_active":"2023-12-19T05:41:03.013107+0000","last_became_peered":"2023-12-19T05:41:03.013107+0000","last_unstale":"2023-12-19T05:41:03.013757+0000","last_undegraded":"2023-12-19T05:41:03.013757+0000","last_fullsized":"2023-12-19T05:41:03.013757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005712+0000","last_change":"2023-12-19T05:41:03.005606+0000","last_active":"2023-12-19T05:41:03.005712+0000","last_peered":"2023-12-19T05:41:03.005712+0000","last_clean":"2023-12-19T05:41:03.005712+0000","last_became_active":"2023-12-19T05:41:03.004235+0000","last_became_peered":"2023-12-19T05:41:03.004235+0000","last_unstale":"2023-12-19T05:41:03.005712+0000","last_undegraded":"2023-12-19T05:41:03.005712+0000","last_fullsized":"2023-12-19T05:41:03.005712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017805+0000","last_change":"2023-12-19T05:41:03.017661+0000","last_active":"2023-12-19T05:41:03.017805+0000","last_peered":"2023-12-19T05:41:03.017805+0000","last_clean":"2023-12-19T05:41:03.017805+0000","last_became_active":"2023-12-19T05:41:03.016872+0000","last_became_peered":"2023-12-19T05:41:03.016872+0000","last_unstale":"2023-12-19T05:41:03.017805+0000","last_undegraded":"2023-12-19T05:41:03.017805+0000","last_fullsized":"2023-12-19T05:41:03.017805+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001022+0000","last_change":"2023-12-19T05:41:03.000938+0000","last_active":"2023-12-19T05:41:03.001022+0000","last_peered":"2023-12-19T05:41:03.001022+0000","last_clean":"2023-12-19T05:41:03.001022+0000","last_became_active":"2023-12-19T05:41:03.000638+0000","last_became_peered":"2023-12-19T05:41:03.000638+0000","last_unstale":"2023-12-19T05:41:03.001022+0000","last_undegraded":"2023-12-19T05:41:03.001022+0000","last_fullsized":"2023-12-19T05:41:03.001022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:09.915767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016201+0000","last_change":"2023-12-19T05:41:03.015225+0000","last_active":"2023-12-19T05:41:03.016201+0000","last_peered":"2023-12-19T05:41:03.016201+0000","last_clean":"2023-12-19T05:41:03.016201+0000","last_became_active":"2023-12-19T05:41:03.015004+0000","last_became_peered":"2023-12-19T05:41:03.015004+0000","last_unstale":"2023-12-19T05:41:03.016201+0000","last_undegraded":"2023-12-19T05:41:03.016201+0000","last_fullsized":"2023-12-19T05:41:03.016201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:54.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015603+0000","last_change":"2023-12-19T05:41:03.014709+0000","last_active":"2023-12-19T05:41:03.015603+0000","last_peered":"2023-12-19T05:41:03.015603+0000","last_clean":"2023-12-19T05:41:03.015603+0000","last_became_active":"2023-12-19T05:41:03.014109+0000","last_became_peered":"2023-12-19T05:41:03.014109+0000","last_unstale":"2023-12-19T05:41:03.015603+0000","last_undegraded":"2023-12-19T05:41:03.015603+0000","last_fullsized":"2023-12-19T05:41:03.015603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013075+0000","last_change":"2023-12-19T05:41:03.011931+0000","last_active":"2023-12-19T05:41:03.013075+0000","last_peered":"2023-12-19T05:41:03.013075+0000","last_clean":"2023-12-19T05:41:03.013075+0000","last_became_active":"2023-12-19T05:41:03.011198+0000","last_became_peered":"2023-12-19T05:41:03.011198+0000","last_unstale":"2023-12-19T05:41:03.013075+0000","last_undegraded":"2023-12-19T05:41:03.013075+0000","last_fullsized":"2023-12-19T05:41:03.013075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:15.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015174+0000","last_change":"2023-12-19T05:41:03.014917+0000","last_active":"2023-12-19T05:41:03.015174+0000","last_peered":"2023-12-19T05:41:03.015174+0000","last_clean":"2023-12-19T05:41:03.015174+0000","last_became_active":"2023-12-19T05:41:03.014678+0000","last_became_peered":"2023-12-19T05:41:03.014678+0000","last_unstale":"2023-12-19T05:41:03.015174+0000","last_undegraded":"2023-12-19T05:41:03.015174+0000","last_fullsized":"2023-12-19T05:41:03.015174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009413+0000","last_change":"2023-12-19T05:41:03.007149+0000","last_active":"2023-12-19T05:41:03.009413+0000","last_peered":"2023-12-19T05:41:03.009413+0000","last_clean":"2023-12-19T05:41:03.009413+0000","last_became_active":"2023-12-19T05:41:03.002455+0000","last_became_peered":"2023-12-19T05:41:03.002455+0000","last_unstale":"2023-12-19T05:41:03.009413+0000","last_undegraded":"2023-12-19T05:41:03.009413+0000","last_fullsized":"2023-12-19T05:41:03.009413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:08.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009269+0000","last_change":"2023-12-19T05:41:03.009075+0000","last_active":"2023-12-19T05:41:03.009269+0000","last_peered":"2023-12-19T05:41:03.009269+0000","last_clean":"2023-12-19T05:41:03.009269+0000","last_became_active":"2023-12-19T05:41:03.008821+0000","last_became_peered":"2023-12-19T05:41:03.008821+0000","last_unstale":"2023-12-19T05:41:03.009269+0000","last_undegraded":"2023-12-19T05:41:03.009269+0000","last_fullsized":"2023-12-19T05:41:03.009269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009629+0000","last_change":"2023-12-19T05:41:03.009557+0000","last_active":"2023-12-19T05:41:03.009629+0000","last_peered":"2023-12-19T05:41:03.009629+0000","last_clean":"2023-12-19T05:41:03.009629+0000","last_became_active":"2023-12-19T05:41:03.009328+0000","last_became_peered":"2023-12-19T05:41:03.009328+0000","last_unstale":"2023-12-19T05:41:03.009629+0000","last_undegraded":"2023-12-19T05:41:03.009629+0000","last_fullsized":"2023-12-19T05:41:03.009629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:59.457152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019744+0000","last_change":"2023-12-19T05:41:03.016004+0000","last_active":"2023-12-19T05:41:03.019744+0000","last_peered":"2023-12-19T05:41:03.019744+0000","last_clean":"2023-12-19T05:41:03.019744+0000","last_became_active":"2023-12-19T05:41:03.015777+0000","last_became_peered":"2023-12-19T05:41:03.015777+0000","last_unstale":"2023-12-19T05:41:03.019744+0000","last_undegraded":"2023-12-19T05:41:03.019744+0000","last_fullsized":"2023-12-19T05:41:03.019744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015971+0000","last_change":"2023-12-19T05:41:03.015899+0000","last_active":"2023-12-19T05:41:03.015971+0000","last_peered":"2023-12-19T05:41:03.015971+0000","last_clean":"2023-12-19T05:41:03.015971+0000","last_became_active":"2023-12-19T05:41:03.013249+0000","last_became_peered":"2023-12-19T05:41:03.013249+0000","last_unstale":"2023-12-19T05:41:03.015971+0000","last_undegraded":"2023-12-19T05:41:03.015971+0000","last_fullsized":"2023-12-19T05:41:03.015971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008694+0000","last_change":"2023-12-19T05:41:03.006660+0000","last_active":"2023-12-19T05:41:03.008694+0000","last_peered":"2023-12-19T05:41:03.008694+0000","last_clean":"2023-12-19T05:41:03.008694+0000","last_became_active":"2023-12-19T05:41:03.005924+0000","last_became_peered":"2023-12-19T05:41:03.005924+0000","last_unstale":"2023-12-19T05:41:03.008694+0000","last_undegraded":"2023-12-19T05:41:03.008694+0000","last_fullsized":"2023-12-19T05:41:03.008694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:06.461247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000471+0000","last_change":"2023-12-19T05:41:03.000382+0000","last_active":"2023-12-19T05:41:03.000471+0000","last_peered":"2023-12-19T05:41:03.000471+0000","last_clean":"2023-12-19T05:41:03.000471+0000","last_became_active":"2023-12-19T05:41:02.999889+0000","last_became_peered":"2023-12-19T05:41:02.999889+0000","last_unstale":"2023-12-19T05:41:03.000471+0000","last_undegraded":"2023-12-19T05:41:03.000471+0000","last_fullsized":"2023-12-19T05:41:03.000471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:49:50.832272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007038+0000","last_change":"2023-12-19T05:41:03.006055+0000","last_active":"2023-12-19T05:41:03.007038+0000","last_peered":"2023-12-19T05:41:03.007038+0000","last_clean":"2023-12-19T05:41:03.007038+0000","last_became_active":"2023-12-19T05:41:03.005697+0000","last_became_peered":"2023-12-19T05:41:03.005697+0000","last_unstale":"2023-12-19T05:41:03.007038+0000","last_undegraded":"2023-12-19T05:41:03.007038+0000","last_fullsized":"2023-12-19T05:41:03.007038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:56:31.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007702+0000","last_change":"2023-12-19T05:41:03.007591+0000","last_active":"2023-12-19T05:41:03.007702+0000","last_peered":"2023-12-19T05:41:03.007702+0000","last_clean":"2023-12-19T05:41:03.007702+0000","last_became_active":"2023-12-19T05:41:03.007339+0000","last_became_peered":"2023-12-19T05:41:03.007339+0000","last_unstale":"2023-12-19T05:41:03.007702+0000","last_undegraded":"2023-12-19T05:41:03.007702+0000","last_fullsized":"2023-12-19T05:41:03.007702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017648+0000","last_change":"2023-12-19T05:41:03.017504+0000","last_active":"2023-12-19T05:41:03.017648+0000","last_peered":"2023-12-19T05:41:03.017648+0000","last_clean":"2023-12-19T05:41:03.017648+0000","last_became_active":"2023-12-19T05:41:03.016525+0000","last_became_peered":"2023-12-19T05:41:03.016525+0000","last_unstale":"2023-12-19T05:41:03.017648+0000","last_undegraded":"2023-12-19T05:41:03.017648+0000","last_fullsized":"2023-12-19T05:41:03.017648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004945+0000","last_change":"2023-12-19T05:41:03.004847+0000","last_active":"2023-12-19T05:41:03.004945+0000","last_peered":"2023-12-19T05:41:03.004945+0000","last_clean":"2023-12-19T05:41:03.004945+0000","last_became_active":"2023-12-19T05:41:03.002066+0000","last_became_peered":"2023-12-19T05:41:03.002066+0000","last_unstale":"2023-12-19T05:41:03.004945+0000","last_undegraded":"2023-12-19T05:41:03.004945+0000","last_fullsized":"2023-12-19T05:41:03.004945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:50.412798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.003072+0000","last_change":"2023-12-19T05:41:03.002989+0000","last_active":"2023-12-19T05:41:03.003072+0000","last_peered":"2023-12-19T05:41:03.003072+0000","last_clean":"2023-12-19T05:41:03.003072+0000","last_became_active":"2023-12-19T05:41:03.002684+0000","last_became_peered":"2023-12-19T05:41:03.002684+0000","last_unstale":"2023-12-19T05:41:03.003072+0000","last_undegraded":"2023-12-19T05:41:03.003072+0000","last_fullsized":"2023-12-19T05:41:03.003072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:35:19.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019536+0000","last_change":"2023-12-19T05:41:03.019444+0000","last_active":"2023-12-19T05:41:03.019536+0000","last_peered":"2023-12-19T05:41:03.019536+0000","last_clean":"2023-12-19T05:41:03.019536+0000","last_became_active":"2023-12-19T05:41:03.019159+0000","last_became_peered":"2023-12-19T05:41:03.019159+0000","last_unstale":"2023-12-19T05:41:03.019536+0000","last_undegraded":"2023-12-19T05:41:03.019536+0000","last_fullsized":"2023-12-19T05:41:03.019536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995562+0000","last_change":"2023-12-19T05:41:02.995490+0000","last_active":"2023-12-19T05:41:02.995562+0000","last_peered":"2023-12-19T05:41:02.995562+0000","last_clean":"2023-12-19T05:41:02.995562+0000","last_became_active":"2023-12-19T05:41:02.995259+0000","last_became_peered":"2023-12-19T05:41:02.995259+0000","last_unstale":"2023-12-19T05:41:02.995562+0000","last_undegraded":"2023-12-19T05:41:02.995562+0000","last_fullsized":"2023-12-19T05:41:02.995562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:53.641231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008073+0000","last_change":"2023-12-19T05:41:03.007140+0000","last_active":"2023-12-19T05:41:03.008073+0000","last_peered":"2023-12-19T05:41:03.008073+0000","last_clean":"2023-12-19T05:41:03.008073+0000","last_became_active":"2023-12-19T05:41:03.005769+0000","last_became_peered":"2023-12-19T05:41:03.005769+0000","last_unstale":"2023-12-19T05:41:03.008073+0000","last_undegraded":"2023-12-19T05:41:03.008073+0000","last_fullsized":"2023-12-19T05:41:03.008073+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013002+0000","last_change":"2023-12-19T05:41:03.009800+0000","last_active":"2023-12-19T05:41:03.013002+0000","last_peered":"2023-12-19T05:41:03.013002+0000","last_clean":"2023-12-19T05:41:03.013002+0000","last_became_active":"2023-12-19T05:41:03.007818+0000","last_became_peered":"2023-12-19T05:41:03.007818+0000","last_unstale":"2023-12-19T05:41:03.013002+0000","last_undegraded":"2023-12-19T05:41:03.013002+0000","last_fullsized":"2023-12-19T05:41:03.013002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014537+0000","last_change":"2023-12-19T05:41:03.014042+0000","last_active":"2023-12-19T05:41:03.014537+0000","last_peered":"2023-12-19T05:41:03.014537+0000","last_clean":"2023-12-19T05:41:03.014537+0000","last_became_active":"2023-12-19T05:41:03.013681+0000","last_became_peered":"2023-12-19T05:41:03.013681+0000","last_unstale":"2023-12-19T05:41:03.014537+0000","last_undegraded":"2023-12-19T05:41:03.014537+0000","last_fullsized":"2023-12-19T05:41:03.014537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:08.427930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016659+0000","last_change":"2023-12-19T05:41:02.495810+0000","last_active":"2023-12-19T05:41:03.016659+0000","last_peered":"2023-12-19T05:41:03.016659+0000","last_clean":"2023-12-19T05:41:03.016659+0000","last_became_active":"2023-12-19T05:41:02.495379+0000","last_became_peered":"2023-12-19T05:41:02.495379+0000","last_unstale":"2023-12-19T05:41:03.016659+0000","last_undegraded":"2023-12-19T05:41:03.016659+0000","last_fullsized":"2023-12-19T05:41:03.016659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:05.447594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010365+0000","last_change":"2023-12-19T05:41:03.009982+0000","last_active":"2023-12-19T05:41:03.010365+0000","last_peered":"2023-12-19T05:41:03.010365+0000","last_clean":"2023-12-19T05:41:03.010365+0000","last_became_active":"2023-12-19T05:41:03.009742+0000","last_became_peered":"2023-12-19T05:41:03.009742+0000","last_unstale":"2023-12-19T05:41:03.010365+0000","last_undegraded":"2023-12-19T05:41:03.010365+0000","last_fullsized":"2023-12-19T05:41:03.010365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001839+0000","last_change":"2023-12-19T05:41:02.490941+0000","last_active":"2023-12-19T05:41:03.001839+0000","last_peered":"2023-12-19T05:41:03.001839+0000","last_clean":"2023-12-19T05:41:03.001839+0000","last_became_active":"2023-12-19T05:41:02.490755+0000","last_became_peered":"2023-12-19T05:41:02.490755+0000","last_unstale":"2023-12-19T05:41:03.001839+0000","last_undegraded":"2023-12-19T05:41:03.001839+0000","last_fullsized":"2023-12-19T05:41:03.001839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:26.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004716+0000","last_change":"2023-12-19T05:41:03.004435+0000","last_active":"2023-12-19T05:41:03.004716+0000","last_peered":"2023-12-19T05:41:03.004716+0000","last_clean":"2023-12-19T05:41:03.004716+0000","last_became_active":"2023-12-19T05:41:03.004175+0000","last_became_peered":"2023-12-19T05:41:03.004175+0000","last_unstale":"2023-12-19T05:41:03.004716+0000","last_undegraded":"2023-12-19T05:41:03.004716+0000","last_fullsized":"2023-12-19T05:41:03.004716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:51:11.564108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015796+0000","last_change":"2023-12-19T05:41:02.496221+0000","last_active":"2023-12-19T05:41:03.015796+0000","last_peered":"2023-12-19T05:41:03.015796+0000","last_clean":"2023-12-19T05:41:03.015796+0000","last_became_active":"2023-12-19T05:41:02.495521+0000","last_became_peered":"2023-12-19T05:41:02.495521+0000","last_unstale":"2023-12-19T05:41:03.015796+0000","last_undegraded":"2023-12-19T05:41:03.015796+0000","last_fullsized":"2023-12-19T05:41:03.015796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:42.544673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005801+0000","last_change":"2023-12-19T05:41:03.004337+0000","last_active":"2023-12-19T05:41:03.005801+0000","last_peered":"2023-12-19T05:41:03.005801+0000","last_clean":"2023-12-19T05:41:03.005801+0000","last_became_active":"2023-12-19T05:41:03.004102+0000","last_became_peered":"2023-12-19T05:41:03.004102+0000","last_unstale":"2023-12-19T05:41:03.005801+0000","last_undegraded":"2023-12-19T05:41:03.005801+0000","last_fullsized":"2023-12-19T05:41:03.005801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:23.470088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004240+0000","last_change":"2023-12-19T05:41:02.496412+0000","last_active":"2023-12-19T05:41:03.004240+0000","last_peered":"2023-12-19T05:41:03.004240+0000","last_clean":"2023-12-19T05:41:03.004240+0000","last_became_active":"2023-12-19T05:41:02.496196+0000","last_became_peered":"2023-12-19T05:41:02.496196+0000","last_unstale":"2023-12-19T05:41:03.004240+0000","last_undegraded":"2023-12-19T05:41:03.004240+0000","last_fullsized":"2023-12-19T05:41:03.004240+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:36:59.476802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997824+0000","last_change":"2023-12-19T05:41:02.996900+0000","last_active":"2023-12-19T05:41:02.997824+0000","last_peered":"2023-12-19T05:41:02.997824+0000","last_clean":"2023-12-19T05:41:02.997824+0000","last_became_active":"2023-12-19T05:41:02.996691+0000","last_became_peered":"2023-12-19T05:41:02.996691+0000","last_unstale":"2023-12-19T05:41:02.997824+0000","last_undegraded":"2023-12-19T05:41:02.997824+0000","last_fullsized":"2023-12-19T05:41:02.997824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:14.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011571+0000","last_change":"2023-12-19T05:41:02.500464+0000","last_active":"2023-12-19T05:41:03.011571+0000","last_peered":"2023-12-19T05:41:03.011571+0000","last_clean":"2023-12-19T05:41:03.011571+0000","last_became_active":"2023-12-19T05:41:02.499014+0000","last_became_peered":"2023-12-19T05:41:02.499014+0000","last_unstale":"2023-12-19T05:41:03.011571+0000","last_undegraded":"2023-12-19T05:41:03.011571+0000","last_fullsized":"2023-12-19T05:41:03.011571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:31.232661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019938+0000","last_change":"2023-12-19T05:41:03.018924+0000","last_active":"2023-12-19T05:41:03.019938+0000","last_peered":"2023-12-19T05:41:03.019938+0000","last_clean":"2023-12-19T05:41:03.019938+0000","last_became_active":"2023-12-19T05:41:03.018596+0000","last_became_peered":"2023-12-19T05:41:03.018596+0000","last_unstale":"2023-12-19T05:41:03.019938+0000","last_undegraded":"2023-12-19T05:41:03.019938+0000","last_fullsized":"2023-12-19T05:41:03.019938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002838+0000","last_change":"2023-12-19T05:41:02.493834+0000","last_active":"2023-12-19T05:41:03.002838+0000","last_peered":"2023-12-19T05:41:03.002838+0000","last_clean":"2023-12-19T05:41:03.002838+0000","last_became_active":"2023-12-19T05:41:02.493485+0000","last_became_peered":"2023-12-19T05:41:02.493485+0000","last_unstale":"2023-12-19T05:41:03.002838+0000","last_undegraded":"2023-12-19T05:41:03.002838+0000","last_fullsized":"2023-12-19T05:41:03.002838+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:18.657294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017277+0000","last_change":"2023-12-19T05:41:03.009178+0000","last_active":"2023-12-19T05:41:03.017277+0000","last_peered":"2023-12-19T05:41:03.017277+0000","last_clean":"2023-12-19T05:41:03.017277+0000","last_became_active":"2023-12-19T05:41:03.005093+0000","last_became_peered":"2023-12-19T05:41:03.005093+0000","last_unstale":"2023-12-19T05:41:03.017277+0000","last_undegraded":"2023-12-19T05:41:03.017277+0000","last_fullsized":"2023-12-19T05:41:03.017277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997104+0000","last_change":"2023-12-19T05:41:02.493998+0000","last_active":"2023-12-19T05:41:02.997104+0000","last_peered":"2023-12-19T05:41:02.997104+0000","last_clean":"2023-12-19T05:41:02.997104+0000","last_became_active":"2023-12-19T05:41:02.493564+0000","last_became_peered":"2023-12-19T05:41:02.493564+0000","last_unstale":"2023-12-19T05:41:02.997104+0000","last_undegraded":"2023-12-19T05:41:02.997104+0000","last_fullsized":"2023-12-19T05:41:02.997104+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994944+0000","last_change":"2023-12-19T05:41:02.994868+0000","last_active":"2023-12-19T05:41:02.994944+0000","last_peered":"2023-12-19T05:41:02.994944+0000","last_clean":"2023-12-19T05:41:02.994944+0000","last_became_active":"2023-12-19T05:41:02.994442+0000","last_became_peered":"2023-12-19T05:41:02.994442+0000","last_unstale":"2023-12-19T05:41:02.994944+0000","last_undegraded":"2023-12-19T05:41:02.994944+0000","last_fullsized":"2023-12-19T05:41:02.994944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:14.010176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002626+0000","last_change":"2023-12-19T05:41:02.496935+0000","last_active":"2023-12-19T05:41:03.002626+0000","last_peered":"2023-12-19T05:41:03.002626+0000","last_clean":"2023-12-19T05:41:03.002626+0000","last_became_active":"2023-12-19T05:41:02.496695+0000","last_became_peered":"2023-12-19T05:41:02.496695+0000","last_unstale":"2023-12-19T05:41:03.002626+0000","last_undegraded":"2023-12-19T05:41:03.002626+0000","last_fullsized":"2023-12-19T05:41:03.002626+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009230+0000","last_change":"2023-12-19T05:41:03.008549+0000","last_active":"2023-12-19T05:41:03.009230+0000","last_peered":"2023-12-19T05:41:03.009230+0000","last_clean":"2023-12-19T05:41:03.009230+0000","last_became_active":"2023-12-19T05:41:03.008269+0000","last_became_peered":"2023-12-19T05:41:03.008269+0000","last_unstale":"2023-12-19T05:41:03.009230+0000","last_undegraded":"2023-12-19T05:41:03.009230+0000","last_fullsized":"2023-12-19T05:41:03.009230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992488+0000","last_change":"2023-12-19T05:41:02.499014+0000","last_active":"2023-12-19T05:41:02.992488+0000","last_peered":"2023-12-19T05:41:02.992488+0000","last_clean":"2023-12-19T05:41:02.992488+0000","last_became_active":"2023-12-19T05:41:02.498040+0000","last_became_peered":"2023-12-19T05:41:02.498040+0000","last_unstale":"2023-12-19T05:41:02.992488+0000","last_undegraded":"2023-12-19T05:41:02.992488+0000","last_fullsized":"2023-12-19T05:41:02.992488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:01:03.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005672+0000","last_change":"2023-12-19T05:41:03.005603+0000","last_active":"2023-12-19T05:41:03.005672+0000","last_peered":"2023-12-19T05:41:03.005672+0000","last_clean":"2023-12-19T05:41:03.005672+0000","last_became_active":"2023-12-19T05:41:03.004845+0000","last_became_peered":"2023-12-19T05:41:03.004845+0000","last_unstale":"2023-12-19T05:41:03.005672+0000","last_undegraded":"2023-12-19T05:41:03.005672+0000","last_fullsized":"2023-12-19T05:41:03.005672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:26.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995924+0000","last_change":"2023-12-19T05:41:02.499304+0000","last_active":"2023-12-19T05:41:02.995924+0000","last_peered":"2023-12-19T05:41:02.995924+0000","last_clean":"2023-12-19T05:41:02.995924+0000","last_became_active":"2023-12-19T05:41:02.498787+0000","last_became_peered":"2023-12-19T05:41:02.498787+0000","last_unstale":"2023-12-19T05:41:02.995924+0000","last_undegraded":"2023-12-19T05:41:02.995924+0000","last_fullsized":"2023-12-19T05:41:02.995924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:01.874064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014588+0000","last_change":"2023-12-19T05:41:03.014318+0000","last_active":"2023-12-19T05:41:03.014588+0000","last_peered":"2023-12-19T05:41:03.014588+0000","last_clean":"2023-12-19T05:41:03.014588+0000","last_became_active":"2023-12-19T05:41:03.013483+0000","last_became_peered":"2023-12-19T05:41:03.013483+0000","last_unstale":"2023-12-19T05:41:03.014588+0000","last_undegraded":"2023-12-19T05:41:03.014588+0000","last_fullsized":"2023-12-19T05:41:03.014588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010661+0000","last_change":"2023-12-19T05:41:02.492843+0000","last_active":"2023-12-19T05:41:03.010661+0000","last_peered":"2023-12-19T05:41:03.010661+0000","last_clean":"2023-12-19T05:41:03.010661+0000","last_became_active":"2023-12-19T05:41:02.492468+0000","last_became_peered":"2023-12-19T05:41:02.492468+0000","last_unstale":"2023-12-19T05:41:03.010661+0000","last_undegraded":"2023-12-19T05:41:03.010661+0000","last_fullsized":"2023-12-19T05:41:03.010661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995171+0000","last_change":"2023-12-19T05:41:02.995054+0000","last_active":"2023-12-19T05:41:02.995171+0000","last_peered":"2023-12-19T05:41:02.995171+0000","last_clean":"2023-12-19T05:41:02.995171+0000","last_became_active":"2023-12-19T05:41:02.992024+0000","last_became_peered":"2023-12-19T05:41:02.992024+0000","last_unstale":"2023-12-19T05:41:02.995171+0000","last_undegraded":"2023-12-19T05:41:02.995171+0000","last_fullsized":"2023-12-19T05:41:02.995171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:22.133325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020186+0000","last_change":"2023-12-19T05:41:02.500015+0000","last_active":"2023-12-19T05:41:03.020186+0000","last_peered":"2023-12-19T05:41:03.020186+0000","last_clean":"2023-12-19T05:41:03.020186+0000","last_became_active":"2023-12-19T05:41:02.496783+0000","last_became_peered":"2023-12-19T05:41:02.496783+0000","last_unstale":"2023-12-19T05:41:03.020186+0000","last_undegraded":"2023-12-19T05:41:03.020186+0000","last_fullsized":"2023-12-19T05:41:03.020186+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:40.888340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015659+0000","last_change":"2023-12-19T05:41:03.015566+0000","last_active":"2023-12-19T05:41:03.015659+0000","last_peered":"2023-12-19T05:41:03.015659+0000","last_clean":"2023-12-19T05:41:03.015659+0000","last_became_active":"2023-12-19T05:41:03.015334+0000","last_became_peered":"2023-12-19T05:41:03.015334+0000","last_unstale":"2023-12-19T05:41:03.015659+0000","last_undegraded":"2023-12-19T05:41:03.015659+0000","last_fullsized":"2023-12-19T05:41:03.015659+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:48:33.267654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008833+0000","last_change":"2023-12-19T05:41:02.497837+0000","last_active":"2023-12-19T05:41:03.008833+0000","last_peered":"2023-12-19T05:41:03.008833+0000","last_clean":"2023-12-19T05:41:03.008833+0000","last_became_active":"2023-12-19T05:41:02.497404+0000","last_became_peered":"2023-12-19T05:41:02.497404+0000","last_unstale":"2023-12-19T05:41:03.008833+0000","last_undegraded":"2023-12-19T05:41:03.008833+0000","last_fullsized":"2023-12-19T05:41:03.008833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:08.475846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005173+0000","last_change":"2023-12-19T05:41:03.002205+0000","last_active":"2023-12-19T05:41:03.005173+0000","last_peered":"2023-12-19T05:41:03.005173+0000","last_clean":"2023-12-19T05:41:03.005173+0000","last_became_active":"2023-12-19T05:41:02.999043+0000","last_became_peered":"2023-12-19T05:41:02.999043+0000","last_unstale":"2023-12-19T05:41:03.005173+0000","last_undegraded":"2023-12-19T05:41:03.005173+0000","last_fullsized":"2023-12-19T05:41:03.005173+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.998914+0000","last_change":"2023-12-19T05:41:02.494828+0000","last_active":"2023-12-19T05:41:02.998914+0000","last_peered":"2023-12-19T05:41:02.998914+0000","last_clean":"2023-12-19T05:41:02.998914+0000","last_became_active":"2023-12-19T05:41:02.491941+0000","last_became_peered":"2023-12-19T05:41:02.491941+0000","last_unstale":"2023-12-19T05:41:02.998914+0000","last_undegraded":"2023-12-19T05:41:02.998914+0000","last_fullsized":"2023-12-19T05:41:02.998914+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012720+0000","last_change":"2023-12-19T05:41:03.012524+0000","last_active":"2023-12-19T05:41:03.012720+0000","last_peered":"2023-12-19T05:41:03.012720+0000","last_clean":"2023-12-19T05:41:03.012720+0000","last_became_active":"2023-12-19T05:41:03.012270+0000","last_became_peered":"2023-12-19T05:41:03.012270+0000","last_unstale":"2023-12-19T05:41:03.012720+0000","last_undegraded":"2023-12-19T05:41:03.012720+0000","last_fullsized":"2023-12-19T05:41:03.012720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992791+0000","last_change":"2023-12-19T05:41:02.501217+0000","last_active":"2023-12-19T05:41:02.992791+0000","last_peered":"2023-12-19T05:41:02.992791+0000","last_clean":"2023-12-19T05:41:02.992791+0000","last_became_active":"2023-12-19T05:41:02.500050+0000","last_became_peered":"2023-12-19T05:41:02.500050+0000","last_unstale":"2023-12-19T05:41:02.992791+0000","last_undegraded":"2023-12-19T05:41:02.992791+0000","last_fullsized":"2023-12-19T05:41:02.992791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:07.414277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007021+0000","last_change":"2023-12-19T05:41:03.002723+0000","last_active":"2023-12-19T05:41:03.007021+0000","last_peered":"2023-12-19T05:41:03.007021+0000","last_clean":"2023-12-19T05:41:03.007021+0000","last_became_active":"2023-12-19T05:41:03.002111+0000","last_became_peered":"2023-12-19T05:41:03.002111+0000","last_unstale":"2023-12-19T05:41:03.007021+0000","last_undegraded":"2023-12-19T05:41:03.007021+0000","last_fullsized":"2023-12-19T05:41:03.007021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020088+0000","last_change":"2023-12-19T05:41:02.501660+0000","last_active":"2023-12-19T05:41:03.020088+0000","last_peered":"2023-12-19T05:41:03.020088+0000","last_clean":"2023-12-19T05:41:03.020088+0000","last_became_active":"2023-12-19T05:41:02.500442+0000","last_became_peered":"2023-12-19T05:41:02.500442+0000","last_unstale":"2023-12-19T05:41:03.020088+0000","last_undegraded":"2023-12-19T05:41:03.020088+0000","last_fullsized":"2023-12-19T05:41:03.020088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:55.432045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000214+0000","last_change":"2023-12-19T05:41:02.999611+0000","last_active":"2023-12-19T05:41:03.000214+0000","last_peered":"2023-12-19T05:41:03.000214+0000","last_clean":"2023-12-19T05:41:03.000214+0000","last_became_active":"2023-12-19T05:41:02.997252+0000","last_became_peered":"2023-12-19T05:41:02.997252+0000","last_unstale":"2023-12-19T05:41:03.000214+0000","last_undegraded":"2023-12-19T05:41:03.000214+0000","last_fullsized":"2023-12-19T05:41:03.000214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:02.802901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.018411+0000","last_change":"2023-12-19T05:41:02.502812+0000","last_active":"2023-12-19T05:41:03.018411+0000","last_peered":"2023-12-19T05:41:03.018411+0000","last_clean":"2023-12-19T05:41:03.018411+0000","last_became_active":"2023-12-19T05:41:02.501062+0000","last_became_peered":"2023-12-19T05:41:02.501062+0000","last_unstale":"2023-12-19T05:41:03.018411+0000","last_undegraded":"2023-12-19T05:41:03.018411+0000","last_fullsized":"2023-12-19T05:41:03.018411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014517+0000","last_change":"2023-12-19T05:41:03.013899+0000","last_active":"2023-12-19T05:41:03.014517+0000","last_peered":"2023-12-19T05:41:03.014517+0000","last_clean":"2023-12-19T05:41:03.014517+0000","last_became_active":"2023-12-19T05:41:03.013363+0000","last_became_peered":"2023-12-19T05:41:03.013363+0000","last_unstale":"2023-12-19T05:41:03.014517+0000","last_undegraded":"2023-12-19T05:41:03.014517+0000","last_fullsized":"2023-12-19T05:41:03.014517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:21.641940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000812+0000","last_change":"2023-12-19T05:41:02.498877+0000","last_active":"2023-12-19T05:41:03.000812+0000","last_peered":"2023-12-19T05:41:03.000812+0000","last_clean":"2023-12-19T05:41:03.000812+0000","last_became_active":"2023-12-19T05:41:02.498484+0000","last_became_peered":"2023-12-19T05:41:02.498484+0000","last_unstale":"2023-12-19T05:41:03.000812+0000","last_undegraded":"2023-12-19T05:41:03.000812+0000","last_fullsized":"2023-12-19T05:41:03.000812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:11.775990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009458+0000","last_change":"2023-12-19T05:41:03.007814+0000","last_active":"2023-12-19T05:41:03.009458+0000","last_peered":"2023-12-19T05:41:03.009458+0000","last_clean":"2023-12-19T05:41:03.009458+0000","last_became_active":"2023-12-19T05:41:03.007396+0000","last_became_peered":"2023-12-19T05:41:03.007396+0000","last_unstale":"2023-12-19T05:41:03.009458+0000","last_undegraded":"2023-12-19T05:41:03.009458+0000","last_fullsized":"2023-12-19T05:41:03.009458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005061+0000","last_change":"2023-12-19T05:41:02.499221+0000","last_active":"2023-12-19T05:41:03.005061+0000","last_peered":"2023-12-19T05:41:03.005061+0000","last_clean":"2023-12-19T05:41:03.005061+0000","last_became_active":"2023-12-19T05:41:02.498665+0000","last_became_peered":"2023-12-19T05:41:02.498665+0000","last_unstale":"2023-12-19T05:41:03.005061+0000","last_undegraded":"2023-12-19T05:41:03.005061+0000","last_fullsized":"2023-12-19T05:41:03.005061+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:20.971597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005816+0000","last_change":"2023-12-19T05:41:03.005755+0000","last_active":"2023-12-19T05:41:03.005816+0000","last_peered":"2023-12-19T05:41:03.005816+0000","last_clean":"2023-12-19T05:41:03.005816+0000","last_became_active":"2023-12-19T05:41:03.005306+0000","last_became_peered":"2023-12-19T05:41:03.005306+0000","last_unstale":"2023-12-19T05:41:03.005816+0000","last_undegraded":"2023-12-19T05:41:03.005816+0000","last_fullsized":"2023-12-19T05:41:03.005816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:12.177921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.993025+0000","last_change":"2023-12-19T05:41:02.500885+0000","last_active":"2023-12-19T05:41:02.993025+0000","last_peered":"2023-12-19T05:41:02.993025+0000","last_clean":"2023-12-19T05:41:02.993025+0000","last_became_active":"2023-12-19T05:41:02.499575+0000","last_became_peered":"2023-12-19T05:41:02.499575+0000","last_unstale":"2023-12-19T05:41:02.993025+0000","last_undegraded":"2023-12-19T05:41:02.993025+0000","last_fullsized":"2023-12-19T05:41:02.993025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:20.628288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017313+0000","last_change":"2023-12-19T05:41:03.011238+0000","last_active":"2023-12-19T05:41:03.017313+0000","last_peered":"2023-12-19T05:41:03.017313+0000","last_clean":"2023-12-19T05:41:03.017313+0000","last_became_active":"2023-12-19T05:41:03.010909+0000","last_became_peered":"2023-12-19T05:41:03.010909+0000","last_unstale":"2023-12-19T05:41:03.017313+0000","last_undegraded":"2023-12-19T05:41:03.017313+0000","last_fullsized":"2023-12-19T05:41:03.017313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020718+0000","last_change":"2023-12-19T05:41:02.498001+0000","last_active":"2023-12-19T05:41:03.020718+0000","last_peered":"2023-12-19T05:41:03.020718+0000","last_clean":"2023-12-19T05:41:03.020718+0000","last_became_active":"2023-12-19T05:41:02.497640+0000","last_became_peered":"2023-12-19T05:41:02.497640+0000","last_unstale":"2023-12-19T05:41:03.020718+0000","last_undegraded":"2023-12-19T05:41:03.020718+0000","last_fullsized":"2023-12-19T05:41:03.020718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:07.684487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005258+0000","last_change":"2023-12-19T05:41:03.003993+0000","last_active":"2023-12-19T05:41:03.005258+0000","last_peered":"2023-12-19T05:41:03.005258+0000","last_clean":"2023-12-19T05:41:03.005258+0000","last_became_active":"2023-12-19T05:41:03.003702+0000","last_became_peered":"2023-12-19T05:41:03.003702+0000","last_unstale":"2023-12-19T05:41:03.005258+0000","last_undegraded":"2023-12-19T05:41:03.005258+0000","last_fullsized":"2023-12-19T05:41:03.005258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:41.901992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997254+0000","last_change":"2023-12-19T05:41:02.501432+0000","last_active":"2023-12-19T05:41:02.997254+0000","last_peered":"2023-12-19T05:41:02.997254+0000","last_clean":"2023-12-19T05:41:02.997254+0000","last_became_active":"2023-12-19T05:41:02.500921+0000","last_became_peered":"2023-12-19T05:41:02.500921+0000","last_unstale":"2023-12-19T05:41:02.997254+0000","last_undegraded":"2023-12-19T05:41:02.997254+0000","last_fullsized":"2023-12-19T05:41:02.997254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:46:43.175554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013818+0000","last_change":"2023-12-19T05:41:03.013626+0000","last_active":"2023-12-19T05:41:03.013818+0000","last_peered":"2023-12-19T05:41:03.013818+0000","last_clean":"2023-12-19T05:41:03.013818+0000","last_became_active":"2023-12-19T05:41:03.005094+0000","last_became_peered":"2023-12-19T05:41:03.005094+0000","last_unstale":"2023-12-19T05:41:03.013818+0000","last_undegraded":"2023-12-19T05:41:03.013818+0000","last_fullsized":"2023-12-19T05:41:03.013818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002816+0000","last_change":"2023-12-19T05:41:02.502611+0000","last_active":"2023-12-19T05:41:03.002816+0000","last_peered":"2023-12-19T05:41:03.002816+0000","last_clean":"2023-12-19T05:41:03.002816+0000","last_became_active":"2023-12-19T05:41:02.502340+0000","last_became_peered":"2023-12-19T05:41:02.502340+0000","last_unstale":"2023-12-19T05:41:03.002816+0000","last_undegraded":"2023-12-19T05:41:03.002816+0000","last_fullsized":"2023-12-19T05:41:03.002816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:30.259577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013091+0000","last_change":"2023-12-19T05:41:03.012107+0000","last_active":"2023-12-19T05:41:03.013091+0000","last_peered":"2023-12-19T05:41:03.013091+0000","last_clean":"2023-12-19T05:41:03.013091+0000","last_became_active":"2023-12-19T05:41:03.011666+0000","last_became_peered":"2023-12-19T05:41:03.011666+0000","last_unstale":"2023-12-19T05:41:03.013091+0000","last_undegraded":"2023-12-19T05:41:03.013091+0000","last_fullsized":"2023-12-19T05:41:03.013091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:30:44.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.981451+0000","last_change":"2023-12-19T05:41:02.482151+0000","last_active":"2023-12-19T05:41:02.981451+0000","last_peered":"2023-12-19T05:41:02.981451+0000","last_clean":"2023-12-19T05:41:02.981451+0000","last_became_active":"2023-12-19T05:41:02.481408+0000","last_became_peered":"2023-12-19T05:41:02.481408+0000","last_unstale":"2023-12-19T05:41:02.981451+0000","last_undegraded":"2023-12-19T05:41:02.981451+0000","last_fullsized":"2023-12-19T05:41:02.981451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:09.900893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004770+0000","last_change":"2023-12-19T05:41:03.004678+0000","last_active":"2023-12-19T05:41:03.004770+0000","last_peered":"2023-12-19T05:41:03.004770+0000","last_clean":"2023-12-19T05:41:03.004770+0000","last_became_active":"2023-12-19T05:41:02.998579+0000","last_became_peered":"2023-12-19T05:41:02.998579+0000","last_unstale":"2023-12-19T05:41:03.004770+0000","last_undegraded":"2023-12-19T05:41:03.004770+0000","last_fullsized":"2023-12-19T05:41:03.004770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:44.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T05:41:04.031885+0000","last_change":"2023-12-19T05:41:02.491086+0000","last_active":"2023-12-19T05:41:04.031885+0000","last_peered":"2023-12-19T05:41:04.031885+0000","last_clean":"2023-12-19T05:41:04.031885+0000","last_became_active":"2023-12-19T05:41:02.487771+0000","last_became_peered":"2023-12-19T05:41:02.487771+0000","last_unstale":"2023-12-19T05:41:04.031885+0000","last_undegraded":"2023-12-19T05:41:04.031885+0000","last_fullsized":"2023-12-19T05:41:04.031885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017255+0000","last_change":"2023-12-19T05:41:03.005809+0000","last_active":"2023-12-19T05:41:03.017255+0000","last_peered":"2023-12-19T05:41:03.017255+0000","last_clean":"2023-12-19T05:41:03.017255+0000","last_became_active":"2023-12-19T05:41:03.004652+0000","last_became_peered":"2023-12-19T05:41:03.004652+0000","last_unstale":"2023-12-19T05:41:03.017255+0000","last_undegraded":"2023-12-19T05:41:03.017255+0000","last_fullsized":"2023-12-19T05:41:03.017255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997446+0000","last_change":"2023-12-19T05:41:02.501207+0000","last_active":"2023-12-19T05:41:02.997446+0000","last_peered":"2023-12-19T05:41:02.997446+0000","last_clean":"2023-12-19T05:41:02.997446+0000","last_became_active":"2023-12-19T05:41:02.500475+0000","last_became_peered":"2023-12-19T05:41:02.500475+0000","last_unstale":"2023-12-19T05:41:02.997446+0000","last_undegraded":"2023-12-19T05:41:02.997446+0000","last_fullsized":"2023-12-19T05:41:02.997446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:26.639795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994769+0000","last_change":"2023-12-19T05:41:02.994695+0000","last_active":"2023-12-19T05:41:02.994769+0000","last_peered":"2023-12-19T05:41:02.994769+0000","last_clean":"2023-12-19T05:41:02.994769+0000","last_became_active":"2023-12-19T05:41:02.994094+0000","last_became_peered":"2023-12-19T05:41:02.994094+0000","last_unstale":"2023-12-19T05:41:02.994769+0000","last_undegraded":"2023-12-19T05:41:02.994769+0000","last_fullsized":"2023-12-19T05:41:02.994769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:21.890762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986535+0000","last_change":"2023-12-19T05:41:02.499981+0000","last_active":"2023-12-19T05:41:02.986535+0000","last_peered":"2023-12-19T05:41:02.986535+0000","last_clean":"2023-12-19T05:41:02.986535+0000","last_became_active":"2023-12-19T05:41:02.499733+0000","last_became_peered":"2023-12-19T05:41:02.499733+0000","last_unstale":"2023-12-19T05:41:02.986535+0000","last_undegraded":"2023-12-19T05:41:02.986535+0000","last_fullsized":"2023-12-19T05:41:02.986535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017798+0000","last_change":"2023-12-19T05:41:03.014284+0000","last_active":"2023-12-19T05:41:03.017798+0000","last_peered":"2023-12-19T05:41:03.017798+0000","last_clean":"2023-12-19T05:41:03.017798+0000","last_became_active":"2023-12-19T05:41:03.011821+0000","last_became_peered":"2023-12-19T05:41:03.011821+0000","last_unstale":"2023-12-19T05:41:03.017798+0000","last_undegraded":"2023-12-19T05:41:03.017798+0000","last_fullsized":"2023-12-19T05:41:03.017798+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.999008+0000","last_change":"2023-12-19T05:41:02.495242+0000","last_active":"2023-12-19T05:41:02.999008+0000","last_peered":"2023-12-19T05:41:02.999008+0000","last_clean":"2023-12-19T05:41:02.999008+0000","last_became_active":"2023-12-19T05:41:02.494329+0000","last_became_peered":"2023-12-19T05:41:02.494329+0000","last_unstale":"2023-12-19T05:41:02.999008+0000","last_undegraded":"2023-12-19T05:41:02.999008+0000","last_fullsized":"2023-12-19T05:41:02.999008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:50.527425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013537+0000","last_change":"2023-12-19T05:41:03.013464+0000","last_active":"2023-12-19T05:41:03.013537+0000","last_peered":"2023-12-19T05:41:03.013537+0000","last_clean":"2023-12-19T05:41:03.013537+0000","last_became_active":"2023-12-19T05:41:03.004819+0000","last_became_peered":"2023-12-19T05:41:03.004819+0000","last_unstale":"2023-12-19T05:41:03.013537+0000","last_undegraded":"2023-12-19T05:41:03.013537+0000","last_fullsized":"2023-12-19T05:41:03.013537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:23.806072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.982958+0000","last_change":"2023-12-19T05:41:02.495475+0000","last_active":"2023-12-19T05:41:02.982958+0000","last_peered":"2023-12-19T05:41:02.982958+0000","last_clean":"2023-12-19T05:41:02.982958+0000","last_became_active":"2023-12-19T05:41:02.495251+0000","last_became_peered":"2023-12-19T05:41:02.495251+0000","last_unstale":"2023-12-19T05:41:02.982958+0000","last_undegraded":"2023-12-19T05:41:02.982958+0000","last_fullsized":"2023-12-19T05:41:02.982958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:22.792419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005389+0000","last_change":"2023-12-19T05:41:03.005005+0000","last_active":"2023-12-19T05:41:03.005389+0000","last_peered":"2023-12-19T05:41:03.005389+0000","last_clean":"2023-12-19T05:41:03.005389+0000","last_became_active":"2023-12-19T05:41:03.003890+0000","last_became_peered":"2023-12-19T05:41:03.003890+0000","last_unstale":"2023-12-19T05:41:03.005389+0000","last_undegraded":"2023-12-19T05:41:03.005389+0000","last_fullsized":"2023-12-19T05:41:03.005389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997360+0000","last_change":"2023-12-19T05:41:02.490841+0000","last_active":"2023-12-19T05:41:02.997360+0000","last_peered":"2023-12-19T05:41:02.997360+0000","last_clean":"2023-12-19T05:41:02.997360+0000","last_became_active":"2023-12-19T05:41:02.486586+0000","last_became_peered":"2023-12-19T05:41:02.486586+0000","last_unstale":"2023-12-19T05:41:02.997360+0000","last_undegraded":"2023-12-19T05:41:02.997360+0000","last_fullsized":"2023-12-19T05:41:02.997360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007002+0000","last_change":"2023-12-19T05:41:03.005594+0000","last_active":"2023-12-19T05:41:03.007002+0000","last_peered":"2023-12-19T05:41:03.007002+0000","last_clean":"2023-12-19T05:41:03.007002+0000","last_became_active":"2023-12-19T05:41:03.005233+0000","last_became_peered":"2023-12-19T05:41:03.005233+0000","last_unstale":"2023-12-19T05:41:03.007002+0000","last_undegraded":"2023-12-19T05:41:03.007002+0000","last_fullsized":"2023-12-19T05:41:03.007002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986090+0000","last_change":"2023-12-19T05:41:02.502475+0000","last_active":"2023-12-19T05:41:02.986090+0000","last_peered":"2023-12-19T05:41:02.986090+0000","last_clean":"2023-12-19T05:41:02.986090+0000","last_became_active":"2023-12-19T05:41:02.502142+0000","last_became_peered":"2023-12-19T05:41:02.502142+0000","last_unstale":"2023-12-19T05:41:02.986090+0000","last_undegraded":"2023-12-19T05:41:02.986090+0000","last_fullsized":"2023-12-19T05:41:02.986090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:19:26.512158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012953+0000","last_change":"2023-12-19T05:41:03.006611+0000","last_active":"2023-12-19T05:41:03.012953+0000","last_peered":"2023-12-19T05:41:03.012953+0000","last_clean":"2023-12-19T05:41:03.012953+0000","last_became_active":"2023-12-19T05:41:03.005974+0000","last_became_peered":"2023-12-19T05:41:03.005974+0000","last_unstale":"2023-12-19T05:41:03.012953+0000","last_undegraded":"2023-12-19T05:41:03.012953+0000","last_fullsized":"2023-12-19T05:41:03.012953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015771+0000","last_change":"2023-12-19T05:41:02.491690+0000","last_active":"2023-12-19T05:41:03.015771+0000","last_peered":"2023-12-19T05:41:03.015771+0000","last_clean":"2023-12-19T05:41:03.015771+0000","last_became_active":"2023-12-19T05:41:02.491325+0000","last_became_peered":"2023-12-19T05:41:02.491325+0000","last_unstale":"2023-12-19T05:41:03.015771+0000","last_undegraded":"2023-12-19T05:41:03.015771+0000","last_fullsized":"2023-12-19T05:41:03.015771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:09.559440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.991237+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:41:02.991237+0000","last_peered":"2023-12-19T05:41:02.991237+0000","last_clean":"2023-12-19T05:41:02.991237+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:41:02.991237+0000","last_undegraded":"2023-12-19T05:41:02.991237+0000","last_fullsized":"2023-12-19T05:41:02.991237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.321},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.034,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3939999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.5820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.502}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2330000000000001,"15min":1.2410000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5189999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.216},{"interface":"front","average":{"1min":1.085,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1850000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.135,"15min":1.119},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.72,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.034,"15min":1.01},"min":{"1min":0.84299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.091},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.25,"15min":1.234},"min":{"1min":1.0169999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.694,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.141}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3069999999999999,"15min":1.304},"min":{"1min":0.96099999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.028},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.216,"15min":1.212},"min":{"1min":0.82999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.458,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":1.232,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.369,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.946,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.4510000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5089999999999999,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.022},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.0249999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0820000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.145,"15min":1.131},"min":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.327,"15min":1.345},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.851,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.518}]},{"osd":2,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2,"5min":2,"15min":2},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.3180000000000001,"15min":1.3360000000000001},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.738,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3740000000000001,"15min":1.409},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.857,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.379,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1579999999999999,"5min":4.452,"15min":4.452},"last":1.335}]},{"osd":4,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3720000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9219999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.474,"15min":1.514},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.7240000000000002,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.6930000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5920000000000001,"15min":1.6279999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5070000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.7589999999999999,"15min":1.8109999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0630000000000002,"5min":3.681,"15min":3.681},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5369999999999999,"15min":1.5629999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8089999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.927},{"interface":"front","average":{"1min":1.617,"5min":1.639,"15min":1.643},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.4609999999999999,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.6779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.536,"5min":2.085,"15min":2.085},"last":0.995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4339999999999999,"5min":2.641,"15min":2.641},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.24,"15min":1.2470000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.359},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.375},"min":{"1min":0.89400000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.984,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1859999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.2230000000000001,"15min":1.252},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5169999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.105},{"interface":"front","average":{"1min":1.232,"5min":1.23,"15min":1.23},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.54,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.2270000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.456,"15min":1.486},"min":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.998,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.4339999999999999,"15min":1.4650000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.706,"5min":2.754,"15min":2.754},"last":1.581}]},{"osd":4,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.508,"15min":1.546},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.7010000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.647},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.611,"15min":1.653},"min":{"1min":0.83399999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.8879999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.5289999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5129999999999999,"15min":1.5469999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8640000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.6890000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.6950000000000001,"15min":1.7350000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8999999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.4870000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.7270000000000001,"15min":1.7649999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.0510000000000002,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.6140000000000001,"15min":1.641},"min":{"1min":0.65000000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.762}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.042,"15min":1.0509999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.02}]},{"osd":1,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":1.577},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1970000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.2},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.478,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.464}]},{"osd":5,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.292},{"interface":"front","average":{"1min":1.331,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.93700000000000006,"5min":0.75,"15min":0.75},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2509999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.349,"15min":1.361},"min":{"1min":1.016,"5min":0.872,"15min":0.872},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.381,"15min":1.389},"min":{"1min":1.081,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.6899999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.395}]},{"osd":7,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3280000000000001,"15min":1.323},"min":{"1min":0.94299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.4470000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.524,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5089999999999999,"5min":2.702,"15min":2.702},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.048,"15min":1.038},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6140000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.149,"15min":1.149},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6779999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.877,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.8180000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.369}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3129999999999999,"15min":1.304},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7689999999999999,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8580000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.321,"15min":1.3220000000000001},"min":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8009999999999999,"5min":2.02,"15min":2.02},"last":1.615}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9710000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.423,"15min":1.423},"min":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.968,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.268}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768336,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.748,"15min":0.747},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.012,"15min":1.024},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.464,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4790000000000001,"5min":1.595,"15min":1.595},"last":0.746}]},{"osd":3,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.542,"5min":1.704,"15min":1.704},"last":0.58999999999999997}]},{"osd":4,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2030000000000001,"15min":1.2050000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.95299999999999996}]},{"osd":5,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.254,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.589,"5min":1.702,"15min":1.702},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2689999999999999,"15min":1.2829999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6379999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2649999999999999,"15min":1.27},"min":{"1min":0.84899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.802,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.157},{"interface":"front","average":{"1min":1.286,"5min":1.288,"15min":1.288},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0509999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.006},{"interface":"front","average":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3999999999999999},"min":{"1min":0.91800000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.746,"5min":2.714,"15min":2.714},"last":1.0269999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.48399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.145,"5min":2.992,"15min":2.992},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.3,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.073,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.079},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.45,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.522}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3029999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.595,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.206,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8680000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.872,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.508,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.679,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.3340000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3069999999999999,"15min":1.3220000000000001},"min":{"1min":0.82699999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7909999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.899,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.056}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3779999999999999,"15min":1.389},"min":{"1min":0.78000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7729999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3879999999999999,"15min":1.397},"min":{"1min":0.88700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6839999999999999,"5min":2.319,"15min":2.319},"last":1.3620000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4770000000000001,"15min":1.4910000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7390000000000001,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.5589999999999999,"15min":1.579},"min":{"1min":1.038,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.853,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.97799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767754,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.79100000000000004,"15min":0.77400000000000002},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4119999999999999,"5min":1.427,"15min":1.427},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85699999999999998,"15min":0.86399999999999999},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.0469999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.496,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.1259999999999999,"15min":1.143},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6259999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.516}]},{"osd":3,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3160000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.601,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.79100000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.571,"15min":1.571},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.71799999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.804}]},{"osd":5,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.292,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5920000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.645,"5min":1.714,"15min":1.714},"last":1.879}]},{"osd":6,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.363,"15min":1.379},"min":{"1min":0.81100000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6919999999999999,"5min":1.891,"15min":1.891},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.91600000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.397,"15min":1.399},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.04},{"interface":"front","average":{"1min":1.339,"5min":1.349,"15min":1.351},"min":{"1min":0.96399999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.7470000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:41:12.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:41:13.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.112+0000 7f5578eec640 1 Processor -- start 2023-12-19T05:41:13.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.112+0000 7f5578eec640 1 -- start start 2023-12-19T05:41:13.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5574157aa0 0x7f55740b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 0x7f5574161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557406e8c0 con 0x7f5574157aa0 2023-12-19T05:41:13.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740b2600 con 0x7f557406e410 2023-12-19T05:41:13.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.114+0000 7f5578eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740b1d60 con 0x7f5574161540 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5574157aa0 0x7f55740b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5574157aa0 0x7f55740b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42872/0 (socket says 172.21.15.49:42872) 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 -- 172.21.15.49:0/1810878085 learned_addr learned my addr 172.21.15.49:0/1810878085 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f5572d9d640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f5571d9b640 1 --2- 172.21.15.49:0/1810878085 >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 0x7f5574161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 -- 172.21.15.49:0/1810878085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 msgr2=0x7f557415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 -- 172.21.15.49:0/1810878085 >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 msgr2=0x7f5574161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 --2- 172.21.15.49:0/1810878085 >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 0x7f5574161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f557259c640 1 -- 172.21.15.49:0/1810878085 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740b2040 con 0x7f5574157aa0 2023-12-19T05:41:13.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.115+0000 7f5571d9b640 1 --2- 172.21.15.49:0/1810878085 >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 0x7f5574161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.116+0000 7f557259c640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55740b1710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f557406db00 tx=0x7f556402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68094b1ad41ff81e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.117+0000 7f557159a640 1 -- 172.21.15.49:0/1810878085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564031870 con 0x7f5574157aa0 2023-12-19T05:41:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.117+0000 7f557159a640 1 -- 172.21.15.49:0/1810878085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55640319d0 con 0x7f5574157aa0 2023-12-19T05:41:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.117+0000 7f557159a640 1 -- 172.21.15.49:0/1810878085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564031d60 con 0x7f5574157aa0 2023-12-19T05:41:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.117+0000 7f5578eec640 1 -- 172.21.15.49:0/1810878085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 msgr2=0x7f55740b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.117+0000 7f5578eec640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55740b1710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f557406db00 tx=0x7f556402b910 comp rx=0 tx=0).stop 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 -- 172.21.15.49:0/1810878085 shutdown_connections 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 --2- 172.21.15.49:0/1810878085 >> v2:172.21.15.115:3300/0 conn(0x7f557406e410 0x7f5574161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 --2- 172.21.15.49:0/1810878085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55740b1710 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 -- 172.21.15.49:0/1810878085 >> 172.21.15.49:0/1810878085 conn(0x7f55740cbb70 msgr2=0x7f55740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 -- 172.21.15.49:0/1810878085 shutdown_connections 2023-12-19T05:41:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.118+0000 7f5578eec640 1 -- 172.21.15.49:0/1810878085 wait complete. 2023-12-19T05:41:13.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.119+0000 7f5578eec640 1 Processor -- start 2023-12-19T05:41:13.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.120+0000 7f5578eec640 1 -- start start 2023-12-19T05:41:13.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f557406e410 0x7f55741588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55741e9650 con 0x7f5574157aa0 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574155890 con 0x7f557406e410 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5578eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5574155b70 con 0x7f5574161540 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42880/0 (socket says 172.21.15.49:42880) 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 -- 172.21.15.49:0/727391018 learned_addr learned my addr 172.21.15.49:0/727391018 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f557259c640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f557406e410 0x7f55741588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 -- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 msgr2=0x7f557415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 -- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f557406e410 msgr2=0x7f55741588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f557406e410 0x7f55741588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.121+0000 7f5571d9b640 1 -- 172.21.15.49:0/727391018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640094d0 con 0x7f5574157aa0 2023-12-19T05:41:13.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5571d9b640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f556800c7f0 tx=0x7f556800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568007820 con 0x7f5574157aa0 2023-12-19T05:41:13.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568007980 con 0x7f5574157aa0 2023-12-19T05:41:13.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568007d30 con 0x7f5574157aa0 2023-12-19T05:41:13.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5574155e50 con 0x7f5574157aa0 2023-12-19T05:41:13.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.122+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5574158f80 con 0x7f5574157aa0 2023-12-19T05:41:13.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.124+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574156370 con 0x7f5574157aa0 2023-12-19T05:41:13.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.124+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55680113f0 con 0x7f5574157aa0 2023-12-19T05:41:13.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.125+0000 7f5562ffd640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 0x7f555406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.125+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5568088d00 con 0x7f5574157aa0 2023-12-19T05:41:13.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.126+0000 7f557259c640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 0x7f555406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.127+0000 7f557259c640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 0x7f555406c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5564036000 tx=0x7f556403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.130+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5574156370 con 0x7f5574157aa0 2023-12-19T05:41:13.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.326+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f557415db20 con 0x7f555406a430 2023-12-19T05:41:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.349+0000 7f5562ffd640 1 -- 172.21.15.49:0/727391018 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282415 (secure 0 0 0) 0x7f556403a420 con 0x7f555406a430 2023-12-19T05:41:13.353 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:41:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 msgr2=0x7f555406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 0x7f555406c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5564036000 tx=0x7f556403c040 comp rx=0 tx=0).stop 2023-12-19T05:41:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 msgr2=0x7f55741e9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f556800c7f0 tx=0x7f556800ccb0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 shutdown_connections 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f555406a430 0x7f555406c8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5574161540 0x7f557415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5574157aa0 0x7f55741e9110 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 --2- 172.21.15.49:0/727391018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f557406e410 0x7f55741588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 >> 172.21.15.49:0/727391018 conn(0x7f55740cbb70 msgr2=0x7f55740cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 shutdown_connections 2023-12-19T05:41:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.356+0000 7f5578eec640 1 -- 172.21.15.49:0/727391018 wait complete. 2023-12-19T05:41:13.380 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-12-19T05:41:12.543783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559533,"statfs":{"total":1600000000,"available":1596961948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.561528"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008146+0000","last_change":"2023-12-19T05:41:03.008059+0000","last_active":"2023-12-19T05:41:03.008146+0000","last_peered":"2023-12-19T05:41:03.008146+0000","last_clean":"2023-12-19T05:41:03.008146+0000","last_became_active":"2023-12-19T05:41:03.007775+0000","last_became_peered":"2023-12-19T05:41:03.007775+0000","last_unstale":"2023-12-19T05:41:03.008146+0000","last_undegraded":"2023-12-19T05:41:03.008146+0000","last_fullsized":"2023-12-19T05:41:03.008146+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.908180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009441+0000","last_change":"2023-12-19T05:41:03.007711+0000","last_active":"2023-12-19T05:41:03.009441+0000","last_peered":"2023-12-19T05:41:03.009441+0000","last_clean":"2023-12-19T05:41:03.009441+0000","last_became_active":"2023-12-19T05:41:03.006894+0000","last_became_peered":"2023-12-19T05:41:03.006894+0000","last_unstale":"2023-12-19T05:41:03.009441+0000","last_undegraded":"2023-12-19T05:41:03.009441+0000","last_fullsized":"2023-12-19T05:41:03.009441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011824+0000","last_change":"2023-12-19T05:41:03.011727+0000","last_active":"2023-12-19T05:41:03.011824+0000","last_peered":"2023-12-19T05:41:03.011824+0000","last_clean":"2023-12-19T05:41:03.011824+0000","last_became_active":"2023-12-19T05:41:03.011503+0000","last_became_peered":"2023-12-19T05:41:03.011503+0000","last_unstale":"2023-12-19T05:41:03.011824+0000","last_undegraded":"2023-12-19T05:41:03.011824+0000","last_fullsized":"2023-12-19T05:41:03.011824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:05:42.452542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012986+0000","last_change":"2023-12-19T05:41:03.007914+0000","last_active":"2023-12-19T05:41:03.012986+0000","last_peered":"2023-12-19T05:41:03.012986+0000","last_clean":"2023-12-19T05:41:03.012986+0000","last_became_active":"2023-12-19T05:41:03.001895+0000","last_became_peered":"2023-12-19T05:41:03.001895+0000","last_unstale":"2023-12-19T05:41:03.012986+0000","last_undegraded":"2023-12-19T05:41:03.012986+0000","last_fullsized":"2023-12-19T05:41:03.012986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:19.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010380+0000","last_change":"2023-12-19T05:41:03.010256+0000","last_active":"2023-12-19T05:41:03.010380+0000","last_peered":"2023-12-19T05:41:03.010380+0000","last_clean":"2023-12-19T05:41:03.010380+0000","last_became_active":"2023-12-19T05:41:03.010053+0000","last_became_peered":"2023-12-19T05:41:03.010053+0000","last_unstale":"2023-12-19T05:41:03.010380+0000","last_undegraded":"2023-12-19T05:41:03.010380+0000","last_fullsized":"2023-12-19T05:41:03.010380+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:13.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017837+0000","last_change":"2023-12-19T05:41:03.016519+0000","last_active":"2023-12-19T05:41:03.017837+0000","last_peered":"2023-12-19T05:41:03.017837+0000","last_clean":"2023-12-19T05:41:03.017837+0000","last_became_active":"2023-12-19T05:41:03.016292+0000","last_became_peered":"2023-12-19T05:41:03.016292+0000","last_unstale":"2023-12-19T05:41:03.017837+0000","last_undegraded":"2023-12-19T05:41:03.017837+0000","last_fullsized":"2023-12-19T05:41:03.017837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:16:31.087909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004751+0000","last_change":"2023-12-19T05:41:03.004481+0000","last_active":"2023-12-19T05:41:03.004751+0000","last_peered":"2023-12-19T05:41:03.004751+0000","last_clean":"2023-12-19T05:41:03.004751+0000","last_became_active":"2023-12-19T05:41:02.998031+0000","last_became_peered":"2023-12-19T05:41:02.998031+0000","last_unstale":"2023-12-19T05:41:03.004751+0000","last_undegraded":"2023-12-19T05:41:03.004751+0000","last_fullsized":"2023-12-19T05:41:03.004751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:47.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012927+0000","last_change":"2023-12-19T05:41:03.006337+0000","last_active":"2023-12-19T05:41:03.012927+0000","last_peered":"2023-12-19T05:41:03.012927+0000","last_clean":"2023-12-19T05:41:03.012927+0000","last_became_active":"2023-12-19T05:41:03.005528+0000","last_became_peered":"2023-12-19T05:41:03.005528+0000","last_unstale":"2023-12-19T05:41:03.012927+0000","last_undegraded":"2023-12-19T05:41:03.012927+0000","last_fullsized":"2023-12-19T05:41:03.012927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013757+0000","last_change":"2023-12-19T05:41:03.013415+0000","last_active":"2023-12-19T05:41:03.013757+0000","last_peered":"2023-12-19T05:41:03.013757+0000","last_clean":"2023-12-19T05:41:03.013757+0000","last_became_active":"2023-12-19T05:41:03.013107+0000","last_became_peered":"2023-12-19T05:41:03.013107+0000","last_unstale":"2023-12-19T05:41:03.013757+0000","last_undegraded":"2023-12-19T05:41:03.013757+0000","last_fullsized":"2023-12-19T05:41:03.013757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005712+0000","last_change":"2023-12-19T05:41:03.005606+0000","last_active":"2023-12-19T05:41:03.005712+0000","last_peered":"2023-12-19T05:41:03.005712+0000","last_clean":"2023-12-19T05:41:03.005712+0000","last_became_active":"2023-12-19T05:41:03.004235+0000","last_became_peered":"2023-12-19T05:41:03.004235+0000","last_unstale":"2023-12-19T05:41:03.005712+0000","last_undegraded":"2023-12-19T05:41:03.005712+0000","last_fullsized":"2023-12-19T05:41:03.005712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017805+0000","last_change":"2023-12-19T05:41:03.017661+0000","last_active":"2023-12-19T05:41:03.017805+0000","last_peered":"2023-12-19T05:41:03.017805+0000","last_clean":"2023-12-19T05:41:03.017805+0000","last_became_active":"2023-12-19T05:41:03.016872+0000","last_became_peered":"2023-12-19T05:41:03.016872+0000","last_unstale":"2023-12-19T05:41:03.017805+0000","last_undegraded":"2023-12-19T05:41:03.017805+0000","last_fullsized":"2023-12-19T05:41:03.017805+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:10.914545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001022+0000","last_change":"2023-12-19T05:41:03.000938+0000","last_active":"2023-12-19T05:41:03.001022+0000","last_peered":"2023-12-19T05:41:03.001022+0000","last_clean":"2023-12-19T05:41:03.001022+0000","last_became_active":"2023-12-19T05:41:03.000638+0000","last_became_peered":"2023-12-19T05:41:03.000638+0000","last_unstale":"2023-12-19T05:41:03.001022+0000","last_undegraded":"2023-12-19T05:41:03.001022+0000","last_fullsized":"2023-12-19T05:41:03.001022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:09.915767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016201+0000","last_change":"2023-12-19T05:41:03.015225+0000","last_active":"2023-12-19T05:41:03.016201+0000","last_peered":"2023-12-19T05:41:03.016201+0000","last_clean":"2023-12-19T05:41:03.016201+0000","last_became_active":"2023-12-19T05:41:03.015004+0000","last_became_peered":"2023-12-19T05:41:03.015004+0000","last_unstale":"2023-12-19T05:41:03.016201+0000","last_undegraded":"2023-12-19T05:41:03.016201+0000","last_fullsized":"2023-12-19T05:41:03.016201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:32:54.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015603+0000","last_change":"2023-12-19T05:41:03.014709+0000","last_active":"2023-12-19T05:41:03.015603+0000","last_peered":"2023-12-19T05:41:03.015603+0000","last_clean":"2023-12-19T05:41:03.015603+0000","last_became_active":"2023-12-19T05:41:03.014109+0000","last_became_peered":"2023-12-19T05:41:03.014109+0000","last_unstale":"2023-12-19T05:41:03.015603+0000","last_undegraded":"2023-12-19T05:41:03.015603+0000","last_fullsized":"2023-12-19T05:41:03.015603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013075+0000","last_change":"2023-12-19T05:41:03.011931+0000","last_active":"2023-12-19T05:41:03.013075+0000","last_peered":"2023-12-19T05:41:03.013075+0000","last_clean":"2023-12-19T05:41:03.013075+0000","last_became_active":"2023-12-19T05:41:03.011198+0000","last_became_peered":"2023-12-19T05:41:03.011198+0000","last_unstale":"2023-12-19T05:41:03.013075+0000","last_undegraded":"2023-12-19T05:41:03.013075+0000","last_fullsized":"2023-12-19T05:41:03.013075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:15.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015174+0000","last_change":"2023-12-19T05:41:03.014917+0000","last_active":"2023-12-19T05:41:03.015174+0000","last_peered":"2023-12-19T05:41:03.015174+0000","last_clean":"2023-12-19T05:41:03.015174+0000","last_became_active":"2023-12-19T05:41:03.014678+0000","last_became_peered":"2023-12-19T05:41:03.014678+0000","last_unstale":"2023-12-19T05:41:03.015174+0000","last_undegraded":"2023-12-19T05:41:03.015174+0000","last_fullsized":"2023-12-19T05:41:03.015174+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:37:33.762502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009413+0000","last_change":"2023-12-19T05:41:03.007149+0000","last_active":"2023-12-19T05:41:03.009413+0000","last_peered":"2023-12-19T05:41:03.009413+0000","last_clean":"2023-12-19T05:41:03.009413+0000","last_became_active":"2023-12-19T05:41:03.002455+0000","last_became_peered":"2023-12-19T05:41:03.002455+0000","last_unstale":"2023-12-19T05:41:03.009413+0000","last_undegraded":"2023-12-19T05:41:03.009413+0000","last_fullsized":"2023-12-19T05:41:03.009413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:08.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009269+0000","last_change":"2023-12-19T05:41:03.009075+0000","last_active":"2023-12-19T05:41:03.009269+0000","last_peered":"2023-12-19T05:41:03.009269+0000","last_clean":"2023-12-19T05:41:03.009269+0000","last_became_active":"2023-12-19T05:41:03.008821+0000","last_became_peered":"2023-12-19T05:41:03.008821+0000","last_unstale":"2023-12-19T05:41:03.009269+0000","last_undegraded":"2023-12-19T05:41:03.009269+0000","last_fullsized":"2023-12-19T05:41:03.009269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009629+0000","last_change":"2023-12-19T05:41:03.009557+0000","last_active":"2023-12-19T05:41:03.009629+0000","last_peered":"2023-12-19T05:41:03.009629+0000","last_clean":"2023-12-19T05:41:03.009629+0000","last_became_active":"2023-12-19T05:41:03.009328+0000","last_became_peered":"2023-12-19T05:41:03.009328+0000","last_unstale":"2023-12-19T05:41:03.009629+0000","last_undegraded":"2023-12-19T05:41:03.009629+0000","last_fullsized":"2023-12-19T05:41:03.009629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:59.457152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019744+0000","last_change":"2023-12-19T05:41:03.016004+0000","last_active":"2023-12-19T05:41:03.019744+0000","last_peered":"2023-12-19T05:41:03.019744+0000","last_clean":"2023-12-19T05:41:03.019744+0000","last_became_active":"2023-12-19T05:41:03.015777+0000","last_became_peered":"2023-12-19T05:41:03.015777+0000","last_unstale":"2023-12-19T05:41:03.019744+0000","last_undegraded":"2023-12-19T05:41:03.019744+0000","last_fullsized":"2023-12-19T05:41:03.019744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015971+0000","last_change":"2023-12-19T05:41:03.015899+0000","last_active":"2023-12-19T05:41:03.015971+0000","last_peered":"2023-12-19T05:41:03.015971+0000","last_clean":"2023-12-19T05:41:03.015971+0000","last_became_active":"2023-12-19T05:41:03.013249+0000","last_became_peered":"2023-12-19T05:41:03.013249+0000","last_unstale":"2023-12-19T05:41:03.015971+0000","last_undegraded":"2023-12-19T05:41:03.015971+0000","last_fullsized":"2023-12-19T05:41:03.015971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008694+0000","last_change":"2023-12-19T05:41:03.006660+0000","last_active":"2023-12-19T05:41:03.008694+0000","last_peered":"2023-12-19T05:41:03.008694+0000","last_clean":"2023-12-19T05:41:03.008694+0000","last_became_active":"2023-12-19T05:41:03.005924+0000","last_became_peered":"2023-12-19T05:41:03.005924+0000","last_unstale":"2023-12-19T05:41:03.008694+0000","last_undegraded":"2023-12-19T05:41:03.008694+0000","last_fullsized":"2023-12-19T05:41:03.008694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:06.461247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000471+0000","last_change":"2023-12-19T05:41:03.000382+0000","last_active":"2023-12-19T05:41:03.000471+0000","last_peered":"2023-12-19T05:41:03.000471+0000","last_clean":"2023-12-19T05:41:03.000471+0000","last_became_active":"2023-12-19T05:41:02.999889+0000","last_became_peered":"2023-12-19T05:41:02.999889+0000","last_unstale":"2023-12-19T05:41:03.000471+0000","last_undegraded":"2023-12-19T05:41:03.000471+0000","last_fullsized":"2023-12-19T05:41:03.000471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:49:50.832272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007038+0000","last_change":"2023-12-19T05:41:03.006055+0000","last_active":"2023-12-19T05:41:03.007038+0000","last_peered":"2023-12-19T05:41:03.007038+0000","last_clean":"2023-12-19T05:41:03.007038+0000","last_became_active":"2023-12-19T05:41:03.005697+0000","last_became_peered":"2023-12-19T05:41:03.005697+0000","last_unstale":"2023-12-19T05:41:03.007038+0000","last_undegraded":"2023-12-19T05:41:03.007038+0000","last_fullsized":"2023-12-19T05:41:03.007038+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:56:31.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007702+0000","last_change":"2023-12-19T05:41:03.007591+0000","last_active":"2023-12-19T05:41:03.007702+0000","last_peered":"2023-12-19T05:41:03.007702+0000","last_clean":"2023-12-19T05:41:03.007702+0000","last_became_active":"2023-12-19T05:41:03.007339+0000","last_became_peered":"2023-12-19T05:41:03.007339+0000","last_unstale":"2023-12-19T05:41:03.007702+0000","last_undegraded":"2023-12-19T05:41:03.007702+0000","last_fullsized":"2023-12-19T05:41:03.007702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017648+0000","last_change":"2023-12-19T05:41:03.017504+0000","last_active":"2023-12-19T05:41:03.017648+0000","last_peered":"2023-12-19T05:41:03.017648+0000","last_clean":"2023-12-19T05:41:03.017648+0000","last_became_active":"2023-12-19T05:41:03.016525+0000","last_became_peered":"2023-12-19T05:41:03.016525+0000","last_unstale":"2023-12-19T05:41:03.017648+0000","last_undegraded":"2023-12-19T05:41:03.017648+0000","last_fullsized":"2023-12-19T05:41:03.017648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004945+0000","last_change":"2023-12-19T05:41:03.004847+0000","last_active":"2023-12-19T05:41:03.004945+0000","last_peered":"2023-12-19T05:41:03.004945+0000","last_clean":"2023-12-19T05:41:03.004945+0000","last_became_active":"2023-12-19T05:41:03.002066+0000","last_became_peered":"2023-12-19T05:41:03.002066+0000","last_unstale":"2023-12-19T05:41:03.004945+0000","last_undegraded":"2023-12-19T05:41:03.004945+0000","last_fullsized":"2023-12-19T05:41:03.004945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:50.412798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.003072+0000","last_change":"2023-12-19T05:41:03.002989+0000","last_active":"2023-12-19T05:41:03.003072+0000","last_peered":"2023-12-19T05:41:03.003072+0000","last_clean":"2023-12-19T05:41:03.003072+0000","last_became_active":"2023-12-19T05:41:03.002684+0000","last_became_peered":"2023-12-19T05:41:03.002684+0000","last_unstale":"2023-12-19T05:41:03.003072+0000","last_undegraded":"2023-12-19T05:41:03.003072+0000","last_fullsized":"2023-12-19T05:41:03.003072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:35:19.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019536+0000","last_change":"2023-12-19T05:41:03.019444+0000","last_active":"2023-12-19T05:41:03.019536+0000","last_peered":"2023-12-19T05:41:03.019536+0000","last_clean":"2023-12-19T05:41:03.019536+0000","last_became_active":"2023-12-19T05:41:03.019159+0000","last_became_peered":"2023-12-19T05:41:03.019159+0000","last_unstale":"2023-12-19T05:41:03.019536+0000","last_undegraded":"2023-12-19T05:41:03.019536+0000","last_fullsized":"2023-12-19T05:41:03.019536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995562+0000","last_change":"2023-12-19T05:41:02.995490+0000","last_active":"2023-12-19T05:41:02.995562+0000","last_peered":"2023-12-19T05:41:02.995562+0000","last_clean":"2023-12-19T05:41:02.995562+0000","last_became_active":"2023-12-19T05:41:02.995259+0000","last_became_peered":"2023-12-19T05:41:02.995259+0000","last_unstale":"2023-12-19T05:41:02.995562+0000","last_undegraded":"2023-12-19T05:41:02.995562+0000","last_fullsized":"2023-12-19T05:41:02.995562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:53.641231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008073+0000","last_change":"2023-12-19T05:41:03.007140+0000","last_active":"2023-12-19T05:41:03.008073+0000","last_peered":"2023-12-19T05:41:03.008073+0000","last_clean":"2023-12-19T05:41:03.008073+0000","last_became_active":"2023-12-19T05:41:03.005769+0000","last_became_peered":"2023-12-19T05:41:03.005769+0000","last_unstale":"2023-12-19T05:41:03.008073+0000","last_undegraded":"2023-12-19T05:41:03.008073+0000","last_fullsized":"2023-12-19T05:41:03.008073+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013002+0000","last_change":"2023-12-19T05:41:03.009800+0000","last_active":"2023-12-19T05:41:03.013002+0000","last_peered":"2023-12-19T05:41:03.013002+0000","last_clean":"2023-12-19T05:41:03.013002+0000","last_became_active":"2023-12-19T05:41:03.007818+0000","last_became_peered":"2023-12-19T05:41:03.007818+0000","last_unstale":"2023-12-19T05:41:03.013002+0000","last_undegraded":"2023-12-19T05:41:03.013002+0000","last_fullsized":"2023-12-19T05:41:03.013002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:52.999866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014537+0000","last_change":"2023-12-19T05:41:03.014042+0000","last_active":"2023-12-19T05:41:03.014537+0000","last_peered":"2023-12-19T05:41:03.014537+0000","last_clean":"2023-12-19T05:41:03.014537+0000","last_became_active":"2023-12-19T05:41:03.013681+0000","last_became_peered":"2023-12-19T05:41:03.013681+0000","last_unstale":"2023-12-19T05:41:03.014537+0000","last_undegraded":"2023-12-19T05:41:03.014537+0000","last_fullsized":"2023-12-19T05:41:03.014537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:08.427930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.016659+0000","last_change":"2023-12-19T05:41:02.495810+0000","last_active":"2023-12-19T05:41:03.016659+0000","last_peered":"2023-12-19T05:41:03.016659+0000","last_clean":"2023-12-19T05:41:03.016659+0000","last_became_active":"2023-12-19T05:41:02.495379+0000","last_became_peered":"2023-12-19T05:41:02.495379+0000","last_unstale":"2023-12-19T05:41:03.016659+0000","last_undegraded":"2023-12-19T05:41:03.016659+0000","last_fullsized":"2023-12-19T05:41:03.016659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:05.447594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010365+0000","last_change":"2023-12-19T05:41:03.009982+0000","last_active":"2023-12-19T05:41:03.010365+0000","last_peered":"2023-12-19T05:41:03.010365+0000","last_clean":"2023-12-19T05:41:03.010365+0000","last_became_active":"2023-12-19T05:41:03.009742+0000","last_became_peered":"2023-12-19T05:41:03.009742+0000","last_unstale":"2023-12-19T05:41:03.010365+0000","last_undegraded":"2023-12-19T05:41:03.010365+0000","last_fullsized":"2023-12-19T05:41:03.010365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:13:55.319588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.001839+0000","last_change":"2023-12-19T05:41:02.490941+0000","last_active":"2023-12-19T05:41:03.001839+0000","last_peered":"2023-12-19T05:41:03.001839+0000","last_clean":"2023-12-19T05:41:03.001839+0000","last_became_active":"2023-12-19T05:41:02.490755+0000","last_became_peered":"2023-12-19T05:41:02.490755+0000","last_unstale":"2023-12-19T05:41:03.001839+0000","last_undegraded":"2023-12-19T05:41:03.001839+0000","last_fullsized":"2023-12-19T05:41:03.001839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:26.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004716+0000","last_change":"2023-12-19T05:41:03.004435+0000","last_active":"2023-12-19T05:41:03.004716+0000","last_peered":"2023-12-19T05:41:03.004716+0000","last_clean":"2023-12-19T05:41:03.004716+0000","last_became_active":"2023-12-19T05:41:03.004175+0000","last_became_peered":"2023-12-19T05:41:03.004175+0000","last_unstale":"2023-12-19T05:41:03.004716+0000","last_undegraded":"2023-12-19T05:41:03.004716+0000","last_fullsized":"2023-12-19T05:41:03.004716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:51:11.564108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015796+0000","last_change":"2023-12-19T05:41:02.496221+0000","last_active":"2023-12-19T05:41:03.015796+0000","last_peered":"2023-12-19T05:41:03.015796+0000","last_clean":"2023-12-19T05:41:03.015796+0000","last_became_active":"2023-12-19T05:41:02.495521+0000","last_became_peered":"2023-12-19T05:41:02.495521+0000","last_unstale":"2023-12-19T05:41:03.015796+0000","last_undegraded":"2023-12-19T05:41:03.015796+0000","last_fullsized":"2023-12-19T05:41:03.015796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:42.544673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005801+0000","last_change":"2023-12-19T05:41:03.004337+0000","last_active":"2023-12-19T05:41:03.005801+0000","last_peered":"2023-12-19T05:41:03.005801+0000","last_clean":"2023-12-19T05:41:03.005801+0000","last_became_active":"2023-12-19T05:41:03.004102+0000","last_became_peered":"2023-12-19T05:41:03.004102+0000","last_unstale":"2023-12-19T05:41:03.005801+0000","last_undegraded":"2023-12-19T05:41:03.005801+0000","last_fullsized":"2023-12-19T05:41:03.005801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:23.470088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004240+0000","last_change":"2023-12-19T05:41:02.496412+0000","last_active":"2023-12-19T05:41:03.004240+0000","last_peered":"2023-12-19T05:41:03.004240+0000","last_clean":"2023-12-19T05:41:03.004240+0000","last_became_active":"2023-12-19T05:41:02.496196+0000","last_became_peered":"2023-12-19T05:41:02.496196+0000","last_unstale":"2023-12-19T05:41:03.004240+0000","last_undegraded":"2023-12-19T05:41:03.004240+0000","last_fullsized":"2023-12-19T05:41:03.004240+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:36:59.476802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997824+0000","last_change":"2023-12-19T05:41:02.996900+0000","last_active":"2023-12-19T05:41:02.997824+0000","last_peered":"2023-12-19T05:41:02.997824+0000","last_clean":"2023-12-19T05:41:02.997824+0000","last_became_active":"2023-12-19T05:41:02.996691+0000","last_became_peered":"2023-12-19T05:41:02.996691+0000","last_unstale":"2023-12-19T05:41:02.997824+0000","last_undegraded":"2023-12-19T05:41:02.997824+0000","last_fullsized":"2023-12-19T05:41:02.997824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:14.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.011571+0000","last_change":"2023-12-19T05:41:02.500464+0000","last_active":"2023-12-19T05:41:03.011571+0000","last_peered":"2023-12-19T05:41:03.011571+0000","last_clean":"2023-12-19T05:41:03.011571+0000","last_became_active":"2023-12-19T05:41:02.499014+0000","last_became_peered":"2023-12-19T05:41:02.499014+0000","last_unstale":"2023-12-19T05:41:03.011571+0000","last_undegraded":"2023-12-19T05:41:03.011571+0000","last_fullsized":"2023-12-19T05:41:03.011571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:31.232661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.019938+0000","last_change":"2023-12-19T05:41:03.018924+0000","last_active":"2023-12-19T05:41:03.019938+0000","last_peered":"2023-12-19T05:41:03.019938+0000","last_clean":"2023-12-19T05:41:03.019938+0000","last_became_active":"2023-12-19T05:41:03.018596+0000","last_became_peered":"2023-12-19T05:41:03.018596+0000","last_unstale":"2023-12-19T05:41:03.019938+0000","last_undegraded":"2023-12-19T05:41:03.019938+0000","last_fullsized":"2023-12-19T05:41:03.019938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:08:33.772351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002838+0000","last_change":"2023-12-19T05:41:02.493834+0000","last_active":"2023-12-19T05:41:03.002838+0000","last_peered":"2023-12-19T05:41:03.002838+0000","last_clean":"2023-12-19T05:41:03.002838+0000","last_became_active":"2023-12-19T05:41:02.493485+0000","last_became_peered":"2023-12-19T05:41:02.493485+0000","last_unstale":"2023-12-19T05:41:03.002838+0000","last_undegraded":"2023-12-19T05:41:03.002838+0000","last_fullsized":"2023-12-19T05:41:03.002838+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:18.657294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017277+0000","last_change":"2023-12-19T05:41:03.009178+0000","last_active":"2023-12-19T05:41:03.017277+0000","last_peered":"2023-12-19T05:41:03.017277+0000","last_clean":"2023-12-19T05:41:03.017277+0000","last_became_active":"2023-12-19T05:41:03.005093+0000","last_became_peered":"2023-12-19T05:41:03.005093+0000","last_unstale":"2023-12-19T05:41:03.017277+0000","last_undegraded":"2023-12-19T05:41:03.017277+0000","last_fullsized":"2023-12-19T05:41:03.017277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:27.805870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997104+0000","last_change":"2023-12-19T05:41:02.493998+0000","last_active":"2023-12-19T05:41:02.997104+0000","last_peered":"2023-12-19T05:41:02.997104+0000","last_clean":"2023-12-19T05:41:02.997104+0000","last_became_active":"2023-12-19T05:41:02.493564+0000","last_became_peered":"2023-12-19T05:41:02.493564+0000","last_unstale":"2023-12-19T05:41:02.997104+0000","last_undegraded":"2023-12-19T05:41:02.997104+0000","last_fullsized":"2023-12-19T05:41:02.997104+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994944+0000","last_change":"2023-12-19T05:41:02.994868+0000","last_active":"2023-12-19T05:41:02.994944+0000","last_peered":"2023-12-19T05:41:02.994944+0000","last_clean":"2023-12-19T05:41:02.994944+0000","last_became_active":"2023-12-19T05:41:02.994442+0000","last_became_peered":"2023-12-19T05:41:02.994442+0000","last_unstale":"2023-12-19T05:41:02.994944+0000","last_undegraded":"2023-12-19T05:41:02.994944+0000","last_fullsized":"2023-12-19T05:41:02.994944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:14.010176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002626+0000","last_change":"2023-12-19T05:41:02.496935+0000","last_active":"2023-12-19T05:41:03.002626+0000","last_peered":"2023-12-19T05:41:03.002626+0000","last_clean":"2023-12-19T05:41:03.002626+0000","last_became_active":"2023-12-19T05:41:02.496695+0000","last_became_peered":"2023-12-19T05:41:02.496695+0000","last_unstale":"2023-12-19T05:41:03.002626+0000","last_undegraded":"2023-12-19T05:41:03.002626+0000","last_fullsized":"2023-12-19T05:41:03.002626+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:08.902114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009230+0000","last_change":"2023-12-19T05:41:03.008549+0000","last_active":"2023-12-19T05:41:03.009230+0000","last_peered":"2023-12-19T05:41:03.009230+0000","last_clean":"2023-12-19T05:41:03.009230+0000","last_became_active":"2023-12-19T05:41:03.008269+0000","last_became_peered":"2023-12-19T05:41:03.008269+0000","last_unstale":"2023-12-19T05:41:03.009230+0000","last_undegraded":"2023-12-19T05:41:03.009230+0000","last_fullsized":"2023-12-19T05:41:03.009230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992488+0000","last_change":"2023-12-19T05:41:02.499014+0000","last_active":"2023-12-19T05:41:02.992488+0000","last_peered":"2023-12-19T05:41:02.992488+0000","last_clean":"2023-12-19T05:41:02.992488+0000","last_became_active":"2023-12-19T05:41:02.498040+0000","last_became_peered":"2023-12-19T05:41:02.498040+0000","last_unstale":"2023-12-19T05:41:02.992488+0000","last_undegraded":"2023-12-19T05:41:02.992488+0000","last_fullsized":"2023-12-19T05:41:02.992488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:01:03.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005672+0000","last_change":"2023-12-19T05:41:03.005603+0000","last_active":"2023-12-19T05:41:03.005672+0000","last_peered":"2023-12-19T05:41:03.005672+0000","last_clean":"2023-12-19T05:41:03.005672+0000","last_became_active":"2023-12-19T05:41:03.004845+0000","last_became_peered":"2023-12-19T05:41:03.004845+0000","last_unstale":"2023-12-19T05:41:03.005672+0000","last_undegraded":"2023-12-19T05:41:03.005672+0000","last_fullsized":"2023-12-19T05:41:03.005672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:26.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995924+0000","last_change":"2023-12-19T05:41:02.499304+0000","last_active":"2023-12-19T05:41:02.995924+0000","last_peered":"2023-12-19T05:41:02.995924+0000","last_clean":"2023-12-19T05:41:02.995924+0000","last_became_active":"2023-12-19T05:41:02.498787+0000","last_became_peered":"2023-12-19T05:41:02.498787+0000","last_unstale":"2023-12-19T05:41:02.995924+0000","last_undegraded":"2023-12-19T05:41:02.995924+0000","last_fullsized":"2023-12-19T05:41:02.995924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:01.874064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014588+0000","last_change":"2023-12-19T05:41:03.014318+0000","last_active":"2023-12-19T05:41:03.014588+0000","last_peered":"2023-12-19T05:41:03.014588+0000","last_clean":"2023-12-19T05:41:03.014588+0000","last_became_active":"2023-12-19T05:41:03.013483+0000","last_became_peered":"2023-12-19T05:41:03.013483+0000","last_unstale":"2023-12-19T05:41:03.014588+0000","last_undegraded":"2023-12-19T05:41:03.014588+0000","last_fullsized":"2023-12-19T05:41:03.014588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.010661+0000","last_change":"2023-12-19T05:41:02.492843+0000","last_active":"2023-12-19T05:41:03.010661+0000","last_peered":"2023-12-19T05:41:03.010661+0000","last_clean":"2023-12-19T05:41:03.010661+0000","last_became_active":"2023-12-19T05:41:02.492468+0000","last_became_peered":"2023-12-19T05:41:02.492468+0000","last_unstale":"2023-12-19T05:41:03.010661+0000","last_undegraded":"2023-12-19T05:41:03.010661+0000","last_fullsized":"2023-12-19T05:41:03.010661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.995171+0000","last_change":"2023-12-19T05:41:02.995054+0000","last_active":"2023-12-19T05:41:02.995171+0000","last_peered":"2023-12-19T05:41:02.995171+0000","last_clean":"2023-12-19T05:41:02.995171+0000","last_became_active":"2023-12-19T05:41:02.992024+0000","last_became_peered":"2023-12-19T05:41:02.992024+0000","last_unstale":"2023-12-19T05:41:02.995171+0000","last_undegraded":"2023-12-19T05:41:02.995171+0000","last_fullsized":"2023-12-19T05:41:02.995171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:22.133325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020186+0000","last_change":"2023-12-19T05:41:02.500015+0000","last_active":"2023-12-19T05:41:03.020186+0000","last_peered":"2023-12-19T05:41:03.020186+0000","last_clean":"2023-12-19T05:41:03.020186+0000","last_became_active":"2023-12-19T05:41:02.496783+0000","last_became_peered":"2023-12-19T05:41:02.496783+0000","last_unstale":"2023-12-19T05:41:03.020186+0000","last_undegraded":"2023-12-19T05:41:03.020186+0000","last_fullsized":"2023-12-19T05:41:03.020186+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:40.888340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015659+0000","last_change":"2023-12-19T05:41:03.015566+0000","last_active":"2023-12-19T05:41:03.015659+0000","last_peered":"2023-12-19T05:41:03.015659+0000","last_clean":"2023-12-19T05:41:03.015659+0000","last_became_active":"2023-12-19T05:41:03.015334+0000","last_became_peered":"2023-12-19T05:41:03.015334+0000","last_unstale":"2023-12-19T05:41:03.015659+0000","last_undegraded":"2023-12-19T05:41:03.015659+0000","last_fullsized":"2023-12-19T05:41:03.015659+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:48:33.267654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.008833+0000","last_change":"2023-12-19T05:41:02.497837+0000","last_active":"2023-12-19T05:41:03.008833+0000","last_peered":"2023-12-19T05:41:03.008833+0000","last_clean":"2023-12-19T05:41:03.008833+0000","last_became_active":"2023-12-19T05:41:02.497404+0000","last_became_peered":"2023-12-19T05:41:02.497404+0000","last_unstale":"2023-12-19T05:41:03.008833+0000","last_undegraded":"2023-12-19T05:41:03.008833+0000","last_fullsized":"2023-12-19T05:41:03.008833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:08.475846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005173+0000","last_change":"2023-12-19T05:41:03.002205+0000","last_active":"2023-12-19T05:41:03.005173+0000","last_peered":"2023-12-19T05:41:03.005173+0000","last_clean":"2023-12-19T05:41:03.005173+0000","last_became_active":"2023-12-19T05:41:02.999043+0000","last_became_peered":"2023-12-19T05:41:02.999043+0000","last_unstale":"2023-12-19T05:41:03.005173+0000","last_undegraded":"2023-12-19T05:41:03.005173+0000","last_fullsized":"2023-12-19T05:41:03.005173+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:49.564474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.998914+0000","last_change":"2023-12-19T05:41:02.494828+0000","last_active":"2023-12-19T05:41:02.998914+0000","last_peered":"2023-12-19T05:41:02.998914+0000","last_clean":"2023-12-19T05:41:02.998914+0000","last_became_active":"2023-12-19T05:41:02.491941+0000","last_became_peered":"2023-12-19T05:41:02.491941+0000","last_unstale":"2023-12-19T05:41:02.998914+0000","last_undegraded":"2023-12-19T05:41:02.998914+0000","last_fullsized":"2023-12-19T05:41:02.998914+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012720+0000","last_change":"2023-12-19T05:41:03.012524+0000","last_active":"2023-12-19T05:41:03.012720+0000","last_peered":"2023-12-19T05:41:03.012720+0000","last_clean":"2023-12-19T05:41:03.012720+0000","last_became_active":"2023-12-19T05:41:03.012270+0000","last_became_peered":"2023-12-19T05:41:03.012270+0000","last_unstale":"2023-12-19T05:41:03.012720+0000","last_undegraded":"2023-12-19T05:41:03.012720+0000","last_fullsized":"2023-12-19T05:41:03.012720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.992791+0000","last_change":"2023-12-19T05:41:02.501217+0000","last_active":"2023-12-19T05:41:02.992791+0000","last_peered":"2023-12-19T05:41:02.992791+0000","last_clean":"2023-12-19T05:41:02.992791+0000","last_became_active":"2023-12-19T05:41:02.500050+0000","last_became_peered":"2023-12-19T05:41:02.500050+0000","last_unstale":"2023-12-19T05:41:02.992791+0000","last_undegraded":"2023-12-19T05:41:02.992791+0000","last_fullsized":"2023-12-19T05:41:02.992791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:07.414277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007021+0000","last_change":"2023-12-19T05:41:03.002723+0000","last_active":"2023-12-19T05:41:03.007021+0000","last_peered":"2023-12-19T05:41:03.007021+0000","last_clean":"2023-12-19T05:41:03.007021+0000","last_became_active":"2023-12-19T05:41:03.002111+0000","last_became_peered":"2023-12-19T05:41:03.002111+0000","last_unstale":"2023-12-19T05:41:03.007021+0000","last_undegraded":"2023-12-19T05:41:03.007021+0000","last_fullsized":"2023-12-19T05:41:03.007021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:02.887716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020088+0000","last_change":"2023-12-19T05:41:02.501660+0000","last_active":"2023-12-19T05:41:03.020088+0000","last_peered":"2023-12-19T05:41:03.020088+0000","last_clean":"2023-12-19T05:41:03.020088+0000","last_became_active":"2023-12-19T05:41:02.500442+0000","last_became_peered":"2023-12-19T05:41:02.500442+0000","last_unstale":"2023-12-19T05:41:03.020088+0000","last_undegraded":"2023-12-19T05:41:03.020088+0000","last_fullsized":"2023-12-19T05:41:03.020088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:55.432045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000214+0000","last_change":"2023-12-19T05:41:02.999611+0000","last_active":"2023-12-19T05:41:03.000214+0000","last_peered":"2023-12-19T05:41:03.000214+0000","last_clean":"2023-12-19T05:41:03.000214+0000","last_became_active":"2023-12-19T05:41:02.997252+0000","last_became_peered":"2023-12-19T05:41:02.997252+0000","last_unstale":"2023-12-19T05:41:03.000214+0000","last_undegraded":"2023-12-19T05:41:03.000214+0000","last_fullsized":"2023-12-19T05:41:03.000214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:02.802901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.018411+0000","last_change":"2023-12-19T05:41:02.502812+0000","last_active":"2023-12-19T05:41:03.018411+0000","last_peered":"2023-12-19T05:41:03.018411+0000","last_clean":"2023-12-19T05:41:03.018411+0000","last_became_active":"2023-12-19T05:41:02.501062+0000","last_became_peered":"2023-12-19T05:41:02.501062+0000","last_unstale":"2023-12-19T05:41:03.018411+0000","last_undegraded":"2023-12-19T05:41:03.018411+0000","last_fullsized":"2023-12-19T05:41:03.018411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:23:57.029442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.014517+0000","last_change":"2023-12-19T05:41:03.013899+0000","last_active":"2023-12-19T05:41:03.014517+0000","last_peered":"2023-12-19T05:41:03.014517+0000","last_clean":"2023-12-19T05:41:03.014517+0000","last_became_active":"2023-12-19T05:41:03.013363+0000","last_became_peered":"2023-12-19T05:41:03.013363+0000","last_unstale":"2023-12-19T05:41:03.014517+0000","last_undegraded":"2023-12-19T05:41:03.014517+0000","last_fullsized":"2023-12-19T05:41:03.014517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:21.641940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.000812+0000","last_change":"2023-12-19T05:41:02.498877+0000","last_active":"2023-12-19T05:41:03.000812+0000","last_peered":"2023-12-19T05:41:03.000812+0000","last_clean":"2023-12-19T05:41:03.000812+0000","last_became_active":"2023-12-19T05:41:02.498484+0000","last_became_peered":"2023-12-19T05:41:02.498484+0000","last_unstale":"2023-12-19T05:41:03.000812+0000","last_undegraded":"2023-12-19T05:41:03.000812+0000","last_fullsized":"2023-12-19T05:41:03.000812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:11.775990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.009458+0000","last_change":"2023-12-19T05:41:03.007814+0000","last_active":"2023-12-19T05:41:03.009458+0000","last_peered":"2023-12-19T05:41:03.009458+0000","last_clean":"2023-12-19T05:41:03.009458+0000","last_became_active":"2023-12-19T05:41:03.007396+0000","last_became_peered":"2023-12-19T05:41:03.007396+0000","last_unstale":"2023-12-19T05:41:03.009458+0000","last_undegraded":"2023-12-19T05:41:03.009458+0000","last_fullsized":"2023-12-19T05:41:03.009458+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:31.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005061+0000","last_change":"2023-12-19T05:41:02.499221+0000","last_active":"2023-12-19T05:41:03.005061+0000","last_peered":"2023-12-19T05:41:03.005061+0000","last_clean":"2023-12-19T05:41:03.005061+0000","last_became_active":"2023-12-19T05:41:02.498665+0000","last_became_peered":"2023-12-19T05:41:02.498665+0000","last_unstale":"2023-12-19T05:41:03.005061+0000","last_undegraded":"2023-12-19T05:41:03.005061+0000","last_fullsized":"2023-12-19T05:41:03.005061+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:20.971597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005816+0000","last_change":"2023-12-19T05:41:03.005755+0000","last_active":"2023-12-19T05:41:03.005816+0000","last_peered":"2023-12-19T05:41:03.005816+0000","last_clean":"2023-12-19T05:41:03.005816+0000","last_became_active":"2023-12-19T05:41:03.005306+0000","last_became_peered":"2023-12-19T05:41:03.005306+0000","last_unstale":"2023-12-19T05:41:03.005816+0000","last_undegraded":"2023-12-19T05:41:03.005816+0000","last_fullsized":"2023-12-19T05:41:03.005816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:12.177921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.993025+0000","last_change":"2023-12-19T05:41:02.500885+0000","last_active":"2023-12-19T05:41:02.993025+0000","last_peered":"2023-12-19T05:41:02.993025+0000","last_clean":"2023-12-19T05:41:02.993025+0000","last_became_active":"2023-12-19T05:41:02.499575+0000","last_became_peered":"2023-12-19T05:41:02.499575+0000","last_unstale":"2023-12-19T05:41:02.993025+0000","last_undegraded":"2023-12-19T05:41:02.993025+0000","last_fullsized":"2023-12-19T05:41:02.993025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:20.628288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017313+0000","last_change":"2023-12-19T05:41:03.011238+0000","last_active":"2023-12-19T05:41:03.017313+0000","last_peered":"2023-12-19T05:41:03.017313+0000","last_clean":"2023-12-19T05:41:03.017313+0000","last_became_active":"2023-12-19T05:41:03.010909+0000","last_became_peered":"2023-12-19T05:41:03.010909+0000","last_unstale":"2023-12-19T05:41:03.017313+0000","last_undegraded":"2023-12-19T05:41:03.017313+0000","last_fullsized":"2023-12-19T05:41:03.017313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:19.670947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.020718+0000","last_change":"2023-12-19T05:41:02.498001+0000","last_active":"2023-12-19T05:41:03.020718+0000","last_peered":"2023-12-19T05:41:03.020718+0000","last_clean":"2023-12-19T05:41:03.020718+0000","last_became_active":"2023-12-19T05:41:02.497640+0000","last_became_peered":"2023-12-19T05:41:02.497640+0000","last_unstale":"2023-12-19T05:41:03.020718+0000","last_undegraded":"2023-12-19T05:41:03.020718+0000","last_fullsized":"2023-12-19T05:41:03.020718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:59:07.684487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005258+0000","last_change":"2023-12-19T05:41:03.003993+0000","last_active":"2023-12-19T05:41:03.005258+0000","last_peered":"2023-12-19T05:41:03.005258+0000","last_clean":"2023-12-19T05:41:03.005258+0000","last_became_active":"2023-12-19T05:41:03.003702+0000","last_became_peered":"2023-12-19T05:41:03.003702+0000","last_unstale":"2023-12-19T05:41:03.005258+0000","last_undegraded":"2023-12-19T05:41:03.005258+0000","last_fullsized":"2023-12-19T05:41:03.005258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:35:41.901992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997254+0000","last_change":"2023-12-19T05:41:02.501432+0000","last_active":"2023-12-19T05:41:02.997254+0000","last_peered":"2023-12-19T05:41:02.997254+0000","last_clean":"2023-12-19T05:41:02.997254+0000","last_became_active":"2023-12-19T05:41:02.500921+0000","last_became_peered":"2023-12-19T05:41:02.500921+0000","last_unstale":"2023-12-19T05:41:02.997254+0000","last_undegraded":"2023-12-19T05:41:02.997254+0000","last_fullsized":"2023-12-19T05:41:02.997254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:46:43.175554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013818+0000","last_change":"2023-12-19T05:41:03.013626+0000","last_active":"2023-12-19T05:41:03.013818+0000","last_peered":"2023-12-19T05:41:03.013818+0000","last_clean":"2023-12-19T05:41:03.013818+0000","last_became_active":"2023-12-19T05:41:03.005094+0000","last_became_peered":"2023-12-19T05:41:03.005094+0000","last_unstale":"2023-12-19T05:41:03.013818+0000","last_undegraded":"2023-12-19T05:41:03.013818+0000","last_fullsized":"2023-12-19T05:41:03.013818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.002816+0000","last_change":"2023-12-19T05:41:02.502611+0000","last_active":"2023-12-19T05:41:03.002816+0000","last_peered":"2023-12-19T05:41:03.002816+0000","last_clean":"2023-12-19T05:41:03.002816+0000","last_became_active":"2023-12-19T05:41:02.502340+0000","last_became_peered":"2023-12-19T05:41:02.502340+0000","last_unstale":"2023-12-19T05:41:03.002816+0000","last_undegraded":"2023-12-19T05:41:03.002816+0000","last_fullsized":"2023-12-19T05:41:03.002816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:50:30.259577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013091+0000","last_change":"2023-12-19T05:41:03.012107+0000","last_active":"2023-12-19T05:41:03.013091+0000","last_peered":"2023-12-19T05:41:03.013091+0000","last_clean":"2023-12-19T05:41:03.013091+0000","last_became_active":"2023-12-19T05:41:03.011666+0000","last_became_peered":"2023-12-19T05:41:03.011666+0000","last_unstale":"2023-12-19T05:41:03.013091+0000","last_undegraded":"2023-12-19T05:41:03.013091+0000","last_fullsized":"2023-12-19T05:41:03.013091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:30:44.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.981451+0000","last_change":"2023-12-19T05:41:02.482151+0000","last_active":"2023-12-19T05:41:02.981451+0000","last_peered":"2023-12-19T05:41:02.981451+0000","last_clean":"2023-12-19T05:41:02.981451+0000","last_became_active":"2023-12-19T05:41:02.481408+0000","last_became_peered":"2023-12-19T05:41:02.481408+0000","last_unstale":"2023-12-19T05:41:02.981451+0000","last_undegraded":"2023-12-19T05:41:02.981451+0000","last_fullsized":"2023-12-19T05:41:02.981451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:09.900893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.004770+0000","last_change":"2023-12-19T05:41:03.004678+0000","last_active":"2023-12-19T05:41:03.004770+0000","last_peered":"2023-12-19T05:41:03.004770+0000","last_clean":"2023-12-19T05:41:03.004770+0000","last_became_active":"2023-12-19T05:41:02.998579+0000","last_became_peered":"2023-12-19T05:41:02.998579+0000","last_unstale":"2023-12-19T05:41:03.004770+0000","last_undegraded":"2023-12-19T05:41:03.004770+0000","last_fullsized":"2023-12-19T05:41:03.004770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:44.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-19T05:41:04.031885+0000","last_change":"2023-12-19T05:41:02.491086+0000","last_active":"2023-12-19T05:41:04.031885+0000","last_peered":"2023-12-19T05:41:04.031885+0000","last_clean":"2023-12-19T05:41:04.031885+0000","last_became_active":"2023-12-19T05:41:02.487771+0000","last_became_peered":"2023-12-19T05:41:02.487771+0000","last_unstale":"2023-12-19T05:41:04.031885+0000","last_undegraded":"2023-12-19T05:41:04.031885+0000","last_fullsized":"2023-12-19T05:41:04.031885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:52.627578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017255+0000","last_change":"2023-12-19T05:41:03.005809+0000","last_active":"2023-12-19T05:41:03.017255+0000","last_peered":"2023-12-19T05:41:03.017255+0000","last_clean":"2023-12-19T05:41:03.017255+0000","last_became_active":"2023-12-19T05:41:03.004652+0000","last_became_peered":"2023-12-19T05:41:03.004652+0000","last_unstale":"2023-12-19T05:41:03.017255+0000","last_undegraded":"2023-12-19T05:41:03.017255+0000","last_fullsized":"2023-12-19T05:41:03.017255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:37:00.490455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997446+0000","last_change":"2023-12-19T05:41:02.501207+0000","last_active":"2023-12-19T05:41:02.997446+0000","last_peered":"2023-12-19T05:41:02.997446+0000","last_clean":"2023-12-19T05:41:02.997446+0000","last_became_active":"2023-12-19T05:41:02.500475+0000","last_became_peered":"2023-12-19T05:41:02.500475+0000","last_unstale":"2023-12-19T05:41:02.997446+0000","last_undegraded":"2023-12-19T05:41:02.997446+0000","last_fullsized":"2023-12-19T05:41:02.997446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:08:26.639795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.994769+0000","last_change":"2023-12-19T05:41:02.994695+0000","last_active":"2023-12-19T05:41:02.994769+0000","last_peered":"2023-12-19T05:41:02.994769+0000","last_clean":"2023-12-19T05:41:02.994769+0000","last_became_active":"2023-12-19T05:41:02.994094+0000","last_became_peered":"2023-12-19T05:41:02.994094+0000","last_unstale":"2023-12-19T05:41:02.994769+0000","last_undegraded":"2023-12-19T05:41:02.994769+0000","last_fullsized":"2023-12-19T05:41:02.994769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:21.890762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986535+0000","last_change":"2023-12-19T05:41:02.499981+0000","last_active":"2023-12-19T05:41:02.986535+0000","last_peered":"2023-12-19T05:41:02.986535+0000","last_clean":"2023-12-19T05:41:02.986535+0000","last_became_active":"2023-12-19T05:41:02.499733+0000","last_became_peered":"2023-12-19T05:41:02.499733+0000","last_unstale":"2023-12-19T05:41:02.986535+0000","last_undegraded":"2023-12-19T05:41:02.986535+0000","last_fullsized":"2023-12-19T05:41:02.986535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:11:01.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.017798+0000","last_change":"2023-12-19T05:41:03.014284+0000","last_active":"2023-12-19T05:41:03.017798+0000","last_peered":"2023-12-19T05:41:03.017798+0000","last_clean":"2023-12-19T05:41:03.017798+0000","last_became_active":"2023-12-19T05:41:03.011821+0000","last_became_peered":"2023-12-19T05:41:03.011821+0000","last_unstale":"2023-12-19T05:41:03.017798+0000","last_undegraded":"2023-12-19T05:41:03.017798+0000","last_fullsized":"2023-12-19T05:41:03.017798+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:40.699410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.999008+0000","last_change":"2023-12-19T05:41:02.495242+0000","last_active":"2023-12-19T05:41:02.999008+0000","last_peered":"2023-12-19T05:41:02.999008+0000","last_clean":"2023-12-19T05:41:02.999008+0000","last_became_active":"2023-12-19T05:41:02.494329+0000","last_became_peered":"2023-12-19T05:41:02.494329+0000","last_unstale":"2023-12-19T05:41:02.999008+0000","last_undegraded":"2023-12-19T05:41:02.999008+0000","last_fullsized":"2023-12-19T05:41:02.999008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:50.527425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.013537+0000","last_change":"2023-12-19T05:41:03.013464+0000","last_active":"2023-12-19T05:41:03.013537+0000","last_peered":"2023-12-19T05:41:03.013537+0000","last_clean":"2023-12-19T05:41:03.013537+0000","last_became_active":"2023-12-19T05:41:03.004819+0000","last_became_peered":"2023-12-19T05:41:03.004819+0000","last_unstale":"2023-12-19T05:41:03.013537+0000","last_undegraded":"2023-12-19T05:41:03.013537+0000","last_fullsized":"2023-12-19T05:41:03.013537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:23.806072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.982958+0000","last_change":"2023-12-19T05:41:02.495475+0000","last_active":"2023-12-19T05:41:02.982958+0000","last_peered":"2023-12-19T05:41:02.982958+0000","last_clean":"2023-12-19T05:41:02.982958+0000","last_became_active":"2023-12-19T05:41:02.495251+0000","last_became_peered":"2023-12-19T05:41:02.495251+0000","last_unstale":"2023-12-19T05:41:02.982958+0000","last_undegraded":"2023-12-19T05:41:02.982958+0000","last_fullsized":"2023-12-19T05:41:02.982958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:36:22.792419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.005389+0000","last_change":"2023-12-19T05:41:03.005005+0000","last_active":"2023-12-19T05:41:03.005389+0000","last_peered":"2023-12-19T05:41:03.005389+0000","last_clean":"2023-12-19T05:41:03.005389+0000","last_became_active":"2023-12-19T05:41:03.003890+0000","last_became_peered":"2023-12-19T05:41:03.003890+0000","last_unstale":"2023-12-19T05:41:03.005389+0000","last_undegraded":"2023-12-19T05:41:03.005389+0000","last_fullsized":"2023-12-19T05:41:03.005389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:59:43.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.997360+0000","last_change":"2023-12-19T05:41:02.490841+0000","last_active":"2023-12-19T05:41:02.997360+0000","last_peered":"2023-12-19T05:41:02.997360+0000","last_clean":"2023-12-19T05:41:02.997360+0000","last_became_active":"2023-12-19T05:41:02.486586+0000","last_became_peered":"2023-12-19T05:41:02.486586+0000","last_unstale":"2023-12-19T05:41:02.997360+0000","last_undegraded":"2023-12-19T05:41:02.997360+0000","last_fullsized":"2023-12-19T05:41:02.997360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:01.789248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.007002+0000","last_change":"2023-12-19T05:41:03.005594+0000","last_active":"2023-12-19T05:41:03.007002+0000","last_peered":"2023-12-19T05:41:03.007002+0000","last_clean":"2023-12-19T05:41:03.007002+0000","last_became_active":"2023-12-19T05:41:03.005233+0000","last_became_peered":"2023-12-19T05:41:03.005233+0000","last_unstale":"2023-12-19T05:41:03.007002+0000","last_undegraded":"2023-12-19T05:41:03.007002+0000","last_fullsized":"2023-12-19T05:41:03.007002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:52:56.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.986090+0000","last_change":"2023-12-19T05:41:02.502475+0000","last_active":"2023-12-19T05:41:02.986090+0000","last_peered":"2023-12-19T05:41:02.986090+0000","last_clean":"2023-12-19T05:41:02.986090+0000","last_became_active":"2023-12-19T05:41:02.502142+0000","last_became_peered":"2023-12-19T05:41:02.502142+0000","last_unstale":"2023-12-19T05:41:02.986090+0000","last_undegraded":"2023-12-19T05:41:02.986090+0000","last_fullsized":"2023-12-19T05:41:02.986090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:19:26.512158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.012953+0000","last_change":"2023-12-19T05:41:03.006611+0000","last_active":"2023-12-19T05:41:03.012953+0000","last_peered":"2023-12-19T05:41:03.012953+0000","last_clean":"2023-12-19T05:41:03.012953+0000","last_became_active":"2023-12-19T05:41:03.005974+0000","last_became_peered":"2023-12-19T05:41:03.005974+0000","last_unstale":"2023-12-19T05:41:03.012953+0000","last_undegraded":"2023-12-19T05:41:03.012953+0000","last_fullsized":"2023-12-19T05:41:03.012953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:02.461449+0000","last_clean_scrub_stamp":"2023-12-19T05:41:02.461449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:10.573093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:03.015771+0000","last_change":"2023-12-19T05:41:02.491690+0000","last_active":"2023-12-19T05:41:03.015771+0000","last_peered":"2023-12-19T05:41:03.015771+0000","last_clean":"2023-12-19T05:41:03.015771+0000","last_became_active":"2023-12-19T05:41:02.491325+0000","last_became_peered":"2023-12-19T05:41:02.491325+0000","last_unstale":"2023-12-19T05:41:03.015771+0000","last_undegraded":"2023-12-19T05:41:03.015771+0000","last_fullsized":"2023-12-19T05:41:03.015771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:41:01.447796+0000","last_clean_scrub_stamp":"2023-12-19T05:41:01.447796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:03:09.559440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-19T05:41:02.991237+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:41:02.991237+0000","last_peered":"2023-12-19T05:41:02.991237+0000","last_clean":"2023-12-19T05:41:02.991237+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:41:02.991237+0000","last_undegraded":"2023-12-19T05:41:02.991237+0000","last_fullsized":"2023-12-19T05:41:02.991237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.034,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3939999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0049999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2330000000000001,"15min":1.2410000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5189999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.093},{"interface":"front","average":{"1min":1.085,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.0640000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.135,"15min":1.119},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.032},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.72,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2549999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.034,"15min":1.01},"min":{"1min":0.84299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.25,"15min":1.234},"min":{"1min":1.0169999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.694,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.121}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3069999999999999,"15min":1.304},"min":{"1min":0.96099999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.337},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.216,"15min":1.212},"min":{"1min":0.82999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.458,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":1.232,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.47},{"interface":"front","average":{"1min":1.454,"5min":1.369,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.946,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5089999999999999,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.129},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.0249999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.038}]},{"osd":1,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.145,"15min":1.131},"min":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.327,"15min":1.345},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.851,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2,"5min":2,"15min":2},"last":1.343},{"interface":"front","average":{"1min":1.206,"5min":1.3180000000000001,"15min":1.3360000000000001},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.738,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.379}]},{"osd":3,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3740000000000001,"15min":1.409},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.857,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.593},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.379,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1579999999999999,"5min":4.452,"15min":4.452},"last":1.4670000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3720000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9219999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.474,"15min":1.514},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.7240000000000002,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.702}]},{"osd":5,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5920000000000001,"15min":1.6279999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5070000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.7589999999999999,"15min":1.8109999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0630000000000002,"5min":3.681,"15min":3.681},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5369999999999999,"15min":1.5629999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8089999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.76},{"interface":"front","average":{"1min":1.617,"5min":1.639,"15min":1.643},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.4609999999999999,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.6419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.536,"5min":2.085,"15min":2.085},"last":1.002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4339999999999999,"5min":2.641,"15min":2.641},"last":1.107}]},{"osd":1,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.24,"15min":1.2470000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.375},"min":{"1min":0.89400000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.984,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2370000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.2230000000000001,"15min":1.252},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5169999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.399},{"interface":"front","average":{"1min":1.232,"5min":1.23,"15min":1.23},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.54,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.2070000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.456,"15min":1.486},"min":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.998,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.171},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.4339999999999999,"15min":1.4650000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.706,"5min":2.754,"15min":2.754},"last":1.2589999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.508,"15min":1.546},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.7010000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.611,"15min":1.653},"min":{"1min":0.83399999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.8879999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.0509999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5129999999999999,"15min":1.5469999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8640000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.876},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.6950000000000001,"15min":1.7350000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8999999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.4530000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.7270000000000001,"15min":1.7649999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.0510000000000002,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.6140000000000001,"15min":1.641},"min":{"1min":0.65000000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.492}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.242},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.042,"15min":1.0509999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":1.577},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.675}]},{"osd":2,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.421},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.2},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.478,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.7390000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.087},{"interface":"front","average":{"1min":1.167,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.3080000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.532},{"interface":"front","average":{"1min":1.331,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.93700000000000006,"5min":0.75,"15min":0.75},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.363}]},{"osd":6,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.349,"15min":1.361},"min":{"1min":1.016,"5min":0.872,"15min":0.872},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.381,"15min":1.389},"min":{"1min":1.081,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.6899999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.79}]},{"osd":7,"last update":"Tue Dec 19 05:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3280000000000001,"15min":1.323},"min":{"1min":0.94299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.4470000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.6339999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.524,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.621},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5089999999999999,"5min":2.702,"15min":2.702},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.111,"5min":1.048,"15min":1.038},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6140000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.196}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.149,"15min":1.149},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6779999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.877,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.8180000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.3859999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3129999999999999,"15min":1.304},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.135},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7689999999999999,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.4350000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8580000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.341},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.321,"15min":1.3220000000000001},"min":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8009999999999999,"5min":2.02,"15min":2.02},"last":1.264}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9710000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.423,"15min":1.423},"min":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.968,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.4750000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768336,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.748,"15min":0.747},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0369999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.012,"15min":1.024},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.464,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4790000000000001,"5min":1.595,"15min":1.595},"last":1.4419999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.542,"5min":1.704,"15min":1.704},"last":1.5049999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.329},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2030000000000001,"15min":1.2050000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.181}]},{"osd":5,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.254,"15min":1.252},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.589,"5min":1.702,"15min":1.702},"last":1.294},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2689999999999999,"15min":1.2829999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6379999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.772}]},{"osd":6,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2649999999999999,"15min":1.27},"min":{"1min":0.84899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.802,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.288,"15min":1.288},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.71}]},{"osd":7,"last update":"Tue Dec 19 05:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3999999999999999},"min":{"1min":0.91800000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.746,"5min":2.714,"15min":2.714},"last":1.5620000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.48399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.145,"5min":2.992,"15min":2.992},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.3,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.91500000000000004}]},{"osd":2,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.073,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.079},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.45,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3029999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.595,"5min":3.0859999999999999,"15min":3.0859999999999999},"last":1.821},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.206,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.8680000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.675}]},{"osd":4,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.872,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.508,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.373},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.679,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.5349999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3069999999999999,"15min":1.3220000000000001},"min":{"1min":0.82699999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7909999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.444},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.899,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.7230000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3779999999999999,"15min":1.389},"min":{"1min":0.78000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7729999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.772},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3879999999999999,"15min":1.397},"min":{"1min":0.88700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6839999999999999,"5min":2.319,"15min":2.319},"last":1.9059999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:40:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4770000000000001,"15min":1.4910000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7390000000000001,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":1.698},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.5589999999999999,"15min":1.579},"min":{"1min":1.038,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.853,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":1.8620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767754,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.79100000000000004,"15min":0.77400000000000002},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4119999999999999,"5min":1.427,"15min":1.427},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85699999999999998,"15min":0.86399999999999999},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":1.1459999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.0469999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.496,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.022,"5min":1.1259999999999999,"15min":1.143},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6259999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.381}]},{"osd":3,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3160000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.601,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.79100000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.49,"5min":1.571,"15min":1.571},"last":1.256},{"interface":"front","average":{"1min":1.208,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.71799999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.097}]},{"osd":5,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.292,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5920000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.645,"5min":1.714,"15min":1.714},"last":1.4350000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.363,"15min":1.379},"min":{"1min":0.81100000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6919999999999999,"5min":1.891,"15min":1.891},"last":1.304},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.91600000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.631}]},{"osd":7,"last update":"Tue Dec 19 05:40:52 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.397,"15min":1.399},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.536},{"interface":"front","average":{"1min":1.339,"5min":1.349,"15min":1.351},"min":{"1min":0.96399999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.4830000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:41:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:41:13.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:41:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.666+0000 7f23f7a51640 1 Processor -- start 2023-12-19T05:41:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.666+0000 7f23f7a51640 1 -- start start 2023-12-19T05:41:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f7a51640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 0x7f23f00b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f7a51640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23f00ca110 0x7f23f00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f7a51640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f00b1770 con 0x7f23f0159ba0 2023-12-19T05:41:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f7a51640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00c9e40 con 0x7f23f00ca110 2023-12-19T05:41:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f7a51640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00caae0 con 0x7f23f00ad780 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f5fee640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23f00ca110 0x7f23f00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f5fee640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23f00ca110 0x7f23f00ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:37808/0 (socket says 172.21.15.49:37808) 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f5fee640 1 -- 172.21.15.49:0/3478301895 learned_addr learned my addr 172.21.15.49:0/3478301895 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.668+0000 7f23f4fec640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 0x7f23f00b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.669+0000 7f23f5fee640 1 -- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 msgr2=0x7f23f00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.669+0000 7f23f5fee640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 0x7f23f00b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.669+0000 7f23f5fee640 1 -- 172.21.15.49:0/3478301895 >> v1:172.21.15.115:6789/0 conn(0x7f23f0159ba0 legacy=0x7f23f00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.669+0000 7f23f5fee640 1 -- 172.21.15.49:0/3478301895 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00c8ea0 con 0x7f23f00ca110 2023-12-19T05:41:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.669+0000 7f23f4fec640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 0x7f23f00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:41:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.671+0000 7f23f5fee640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ca110 0x7f23f00ca5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e802dba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e18d04665c2b597 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.671+0000 7f23effff640 1 -- 172.21.15.49:0/3478301895 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e802e950 con 0x7f23f00ca110 2023-12-19T05:41:13.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.671+0000 7f23effff640 1 -- 172.21.15.49:0/3478301895 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e802eab0 con 0x7f23f00ca110 2023-12-19T05:41:13.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.671+0000 7f23effff640 1 -- 172.21.15.49:0/3478301895 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e802ee40 con 0x7f23f00ca110 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 -- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ca110 msgr2=0x7f23f00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ca110 0x7f23f00ca5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e802dba0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 -- 172.21.15.49:0/3478301895 shutdown_connections 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ca110 0x7f23f00ca5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 --2- 172.21.15.49:0/3478301895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ad780 0x7f23f00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 -- 172.21.15.49:0/3478301895 >> 172.21.15.49:0/3478301895 conn(0x7f23f00659d0 msgr2=0x7f23f0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 -- 172.21.15.49:0/3478301895 shutdown_connections 2023-12-19T05:41:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.672+0000 7f23f7a51640 1 -- 172.21.15.49:0/3478301895 wait complete. 2023-12-19T05:41:13.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.675+0000 7f23f7a51640 1 Processor -- start 2023-12-19T05:41:13.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.675+0000 7f23f7a51640 1 -- start start 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.676+0000 7f23f7a51640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ad780 0x7f23f01508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f7a51640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 0x7f23f015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f7a51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f7a51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f015c4d0 con 0x7f23f0159ba0 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f7a51640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f015b660 con 0x7f23f00ad780 2023-12-19T05:41:13.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f7a51640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f0150e30 con 0x7f23f00ca110 2023-12-19T05:41:13.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f5fee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f5fee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42892/0 (socket says 172.21.15.49:42892) 2023-12-19T05:41:13.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f5fee640 1 -- 172.21.15.49:0/1565493686 learned_addr learned my addr 172.21.15.49:0/1565493686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f57ed640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ad780 0x7f23f01508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f4fec640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 0x7f23f015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.677+0000 7f23f5fee640 1 -- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 msgr2=0x7f23f015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f5fee640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 0x7f23f015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f5fee640 1 -- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ad780 msgr2=0x7f23f01508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f5fee640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ad780 0x7f23f01508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f5fee640 1 -- 172.21.15.49:0/1565493686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009400 con 0x7f23f0159ba0 2023-12-19T05:41:13.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f4fec640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 0x7f23f015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f5fee640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f23e80097f0 tx=0x7f23e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8040600 con 0x7f23f0159ba0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e8040760 con 0x7f23f0159ba0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8040af0 con 0x7f23f0159ba0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.678+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80094d0 con 0x7f23f0159ba0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.679+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f015be10 con 0x7f23f0159ba0 2023-12-19T05:41:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.680+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f015c610 con 0x7f23f0159ba0 2023-12-19T05:41:13.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.681+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23e8040c50 con 0x7f23f0159ba0 2023-12-19T05:41:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.682+0000 7f23edffb640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 0x7f23dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.682+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23e80ab5b0 con 0x7f23f0159ba0 2023-12-19T05:41:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.682+0000 7f23f57ed640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 0x7f23dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.683+0000 7f23f57ed640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 0x7f23dc06c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23e0001d40 tx=0x7f23e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:13.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.686+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23f015c610 con 0x7f23f0159ba0 2023-12-19T05:41:13.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.950+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f23f015c610 con 0x7f23f0159ba0 2023-12-19T05:41:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.959+0000 7f23edffb640 1 -- 172.21.15.49:0/1565493686 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f23f015c610 con 0x7f23f0159ba0 2023-12-19T05:41:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:41:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 msgr2=0x7f23dc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 0x7f23dc06c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23e0001d40 tx=0x7f23e0009040 comp rx=0 tx=0).stop 2023-12-19T05:41:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 msgr2=0x7f23f015abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f23e80097f0 tx=0x7f23e80046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 shutdown_connections 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23dc06a460 0x7f23dc06c920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23f00ca110 0x7f23f015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f0159ba0 0x7f23f015abc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 --2- 172.21.15.49:0/1565493686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23f00ad780 0x7f23f01508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 >> 172.21.15.49:0/1565493686 conn(0x7f23f00659d0 msgr2=0x7f23f0153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 shutdown_connections 2023-12-19T05:41:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:13.962+0000 7f23f7a51640 1 -- 172.21.15.49:0/1565493686 wait complete. 2023-12-19T05:41:13.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:14.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.209+0000 7f4549b0a640 1 Processor -- start 2023-12-19T05:41:14.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.209+0000 7f4549b0a640 1 -- start start 2023-12-19T05:41:14.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.211+0000 7f4549b0a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45441449e0 0x7f45440af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.211+0000 7f4549b0a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f454406c6b0 0x7f45440b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.211+0000 7f4549b0a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45440afb10 con 0x7f45440b0b50 2023-12-19T05:41:14.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.211+0000 7f4549b0a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454406bb30 con 0x7f45441449e0 2023-12-19T05:41:14.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.211+0000 7f4549b0a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45440b0070 con 0x7f454406c6b0 2023-12-19T05:41:14.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45441449e0 0x7f45440af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45441449e0 0x7f45440af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43368/0 (socket says 172.21.15.49:43368) 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 -- 172.21.15.49:0/1431332772 learned_addr learned my addr 172.21.15.49:0/1431332772 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f4543fff640 1 --2- 172.21.15.49:0/1431332772 >> v2:172.21.15.115:3300/0 conn(0x7f454406c6b0 0x7f45440b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 -- 172.21.15.49:0/1431332772 >> v2:172.21.15.115:3300/0 conn(0x7f454406c6b0 msgr2=0x7f45440b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 --2- 172.21.15.49:0/1431332772 >> v2:172.21.15.115:3300/0 conn(0x7f454406c6b0 0x7f45440b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 -- 172.21.15.49:0/1431332772 >> v1:172.21.15.115:6789/0 conn(0x7f45440b0b50 legacy=0x7f454406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.212+0000 7f45437fe640 1 -- 172.21.15.49:0/1431332772 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440b0350 con 0x7f45441449e0 2023-12-19T05:41:14.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.214+0000 7f45437fe640 1 --2- 172.21.15.49:0/1431332772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45440af5d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f45440b1270 tx=0x7f452c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc077cfc2f4dfe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:14.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.214+0000 7f45427fc640 1 -- 172.21.15.49:0/1431332772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c030860 con 0x7f45441449e0 2023-12-19T05:41:14.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f45427fc640 1 -- 172.21.15.49:0/1431332772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c0309c0 con 0x7f45441449e0 2023-12-19T05:41:14.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f45427fc640 1 -- 172.21.15.49:0/1431332772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c030d50 con 0x7f45441449e0 2023-12-19T05:41:14.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 -- 172.21.15.49:0/1431332772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 msgr2=0x7f45440af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1431332772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45440af5d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f45440b1270 tx=0x7f452c02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 -- 172.21.15.49:0/1431332772 shutdown_connections 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1431332772 >> v2:172.21.15.115:3300/0 conn(0x7f454406c6b0 0x7f45440b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1431332772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45440af5d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 -- 172.21.15.49:0/1431332772 >> 172.21.15.49:0/1431332772 conn(0x7f45440cbb70 msgr2=0x7f45440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 -- 172.21.15.49:0/1431332772 shutdown_connections 2023-12-19T05:41:14.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.215+0000 7f4549b0a640 1 -- 172.21.15.49:0/1431332772 wait complete. 2023-12-19T05:41:14.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.217+0000 7f4549b0a640 1 Processor -- start 2023-12-19T05:41:14.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.217+0000 7f4549b0a640 1 -- start start 2023-12-19T05:41:14.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f454406c6b0 0x7f45440cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45440b0b50 0x7f45441429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544144100 con 0x7f45441449e0 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544143480 con 0x7f45440b0b50 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.218+0000 7f4549b0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4544143760 con 0x7f454406c6b0 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43382/0 (socket says 172.21.15.49:43382) 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 -- 172.21.15.49:0/1812818499 learned_addr learned my addr 172.21.15.49:0/1812818499 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4542ffd640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45440b0b50 0x7f45441429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f45437fe640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f454406c6b0 0x7f45440cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 -- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f454406c6b0 msgr2=0x7f45440cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f454406c6b0 0x7f45440cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 -- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45440b0b50 msgr2=0x7f45441429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45440b0b50 0x7f45441429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 -- 172.21.15.49:0/1812818499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0094d0 con 0x7f45441449e0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.219+0000 7f4543fff640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f453c007e40 tx=0x7f453c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.220+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c014620 con 0x7f45441449e0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.220+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c00ee90 con 0x7f45441449e0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.220+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c0149e0 con 0x7f45441449e0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.220+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544143a40 con 0x7f45441449e0 2023-12-19T05:41:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.220+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454413bbc0 con 0x7f45441449e0 2023-12-19T05:41:14.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.221+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4544061910 con 0x7f45441449e0 2023-12-19T05:41:14.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.222+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f453c014b40 con 0x7f45441449e0 2023-12-19T05:41:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.224+0000 7f453bfff640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.225+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f453c089240 con 0x7f45441449e0 2023-12-19T05:41:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.225+0000 7f45437fe640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:14.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.226+0000 7f45437fe640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 0x7f452406c920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f452c036000 tx=0x7f452c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:14.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.231+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f453c054820 con 0x7f45441449e0 2023-12-19T05:41:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.469+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45440ae560 con 0x7f45441449e0 2023-12-19T05:41:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.469+0000 7f453bfff640 1 -- 172.21.15.49:0/1812818499 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f453c057e40 con 0x7f45441449e0 2023-12-19T05:41:14.472 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:14.472 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 msgr2=0x7f452406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 0x7f452406c920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f452c036000 tx=0x7f452c03b040 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 msgr2=0x7f45441546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f453c007e40 tx=0x7f453c00e4b0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 shutdown_connections 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45441449e0 0x7f45441546e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45440b0b50 0x7f45441429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 --2- 172.21.15.49:0/1812818499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f454406c6b0 0x7f45440cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.472+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 >> 172.21.15.49:0/1812818499 conn(0x7f45440cbb70 msgr2=0x7f45440706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.473+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 shutdown_connections 2023-12-19T05:41:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:14.473+0000 7f4549b0a640 1 -- 172.21.15.49:0/1812818499 wait complete. 2023-12-19T05:41:14.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:41:02.974860+0000', 'modified': '2023-12-19T05:41:06.199018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5541}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5541': {'gid': 5541, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/4133391224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4133391224}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4133391224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:41:14.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:41:14.897 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T05:41:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.143+0000 7fcefec0e640 1 Processor -- start 2023-12-19T05:41:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.143+0000 7fcefec0e640 1 -- start start 2023-12-19T05:41:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.144+0000 7fcefec0e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcef80b7360 0x7fcef80b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.144+0000 7fcefec0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 0x7fcef80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.144+0000 7fcefec0e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80b7d00 con 0x7fcef8146c40 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.144+0000 7fcefec0e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80700c0 con 0x7fcef80b7360 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.144+0000 7fcefec0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806f160 con 0x7fcef80cf8e0 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.145+0000 7fcefdc0c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcef8146c40 0x7fcef8070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50588/0 (socket says 172.21.15.49:50588) 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.145+0000 7fcefdc0c640 1 -- 172.21.15.49:0/781273192 learned_addr learned my addr 172.21.15.49:0/781273192 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.145+0000 7fcefe40d640 1 --2- 172.21.15.49:0/781273192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 0x7fcef80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.145+0000 7fcefd40b640 1 --2- 172.21.15.49:0/781273192 >> v2:172.21.15.115:3300/0 conn(0x7fcef80b7360 0x7fcef80b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.146+0000 7fcefcc0a640 1 -- 172.21.15.49:0/781273192 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600306144 0 0) 0x7fcef80b7d00 con 0x7fcef8146c40 2023-12-19T05:41:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.146+0000 7fcefe40d640 1 -- 172.21.15.49:0/781273192 >> v2:172.21.15.115:3300/0 conn(0x7fcef80b7360 msgr2=0x7fcef80b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.146+0000 7fcefe40d640 1 --2- 172.21.15.49:0/781273192 >> v2:172.21.15.115:3300/0 conn(0x7fcef80b7360 0x7fcef80b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.146+0000 7fcefe40d640 1 -- 172.21.15.49:0/781273192 >> v1:172.21.15.115:6789/0 conn(0x7fcef8146c40 legacy=0x7fcef8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.146+0000 7fcefe40d640 1 -- 172.21.15.49:0/781273192 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef806f440 con 0x7fcef80cf8e0 2023-12-19T05:41:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.148+0000 7fcefe40d640 1 --2- 172.21.15.49:0/781273192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 0x7fcef80cfd70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85eea272d41de185 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.148+0000 7fcefcc0a640 1 -- 172.21.15.49:0/781273192 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002cc50 con 0x7fcef80cf8e0 2023-12-19T05:41:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefcc0a640 1 -- 172.21.15.49:0/781273192 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef002cdb0 con 0x7fcef80cf8e0 2023-12-19T05:41:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefcc0a640 1 -- 172.21.15.49:0/781273192 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0034660 con 0x7fcef80cf8e0 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 -- 172.21.15.49:0/781273192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 msgr2=0x7fcef80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 --2- 172.21.15.49:0/781273192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 0x7fcef80cfd70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002bea0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 -- 172.21.15.49:0/781273192 shutdown_connections 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 --2- 172.21.15.49:0/781273192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80cf8e0 0x7fcef80cfd70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 --2- 172.21.15.49:0/781273192 >> v2:172.21.15.115:3300/0 conn(0x7fcef80b7360 0x7fcef80b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 -- 172.21.15.49:0/781273192 >> 172.21.15.49:0/781273192 conn(0x7fcef80d31b0 msgr2=0x7fcef80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.149+0000 7fcefec0e640 1 -- 172.21.15.49:0/781273192 shutdown_connections 2023-12-19T05:41:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.150+0000 7fcefec0e640 1 -- 172.21.15.49:0/781273192 wait complete. 2023-12-19T05:41:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.151+0000 7fcefec0e640 1 Processor -- start 2023-12-19T05:41:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 -- start start 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80b7360 0x7fcef80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 0x7fcef81398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef813c580 con 0x7fcef80cf8e0 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef813d3c0 con 0x7fcef8146c40 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.152+0000 7fcefec0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef813c7b0 con 0x7fcef80b7360 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43392/0 (socket says 172.21.15.49:43392) 2023-12-19T05:41:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 -- 172.21.15.49:0/3022473370 learned_addr learned my addr 172.21.15.49:0/3022473370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80b7360 0x7fcef80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefe40d640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 0x7fcef81398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 -- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80b7360 msgr2=0x7fcef80b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80b7360 0x7fcef80b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 -- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 msgr2=0x7fcef81398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 0x7fcef81398f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefd40b640 1 -- 172.21.15.49:0/3022473370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009a70 con 0x7fcef80cf8e0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.153+0000 7fcefe40d640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 0x7fcef81398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fcefd40b640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e870 tx=0x7fceec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fceea7fc640 1 -- 172.21.15.49:0/3022473370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec009510 con 0x7fcef80cf8e0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fceea7fc640 1 -- 172.21.15.49:0/3022473370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00eec0 con 0x7fcef80cf8e0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fceea7fc640 1 -- 172.21.15.49:0/3022473370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00cb80 con 0x7fcef80cf8e0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef813ca90 con 0x7fcef80cf8e0 2023-12-19T05:41:15.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.154+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef813d050 con 0x7fcef80cf8e0 2023-12-19T05:41:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.156+0000 7fceea7fc640 1 -- 172.21.15.49:0/3022473370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fceec00cd20 con 0x7fcef80cf8e0 2023-12-19T05:41:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.158+0000 7fceea7fc640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.158+0000 7fceea7fc640 1 -- 172.21.15.49:0/3022473370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceec088ae0 con 0x7fcef80cf8e0 2023-12-19T05:41:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.158+0000 7fcf029da740 1 Processor -- start 2023-12-19T05:41:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.158+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.158+0000 7fcf029da740 1 -- start start 2023-12-19T05:41:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb778f10 0x55eabb7792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000f60 tx=0x7fcef4007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb74ca90 0x55eabb7766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb6b8f80 con 0x55eabb748e90 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb6b6710 con 0x55eabb778f10 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.159+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eabb6b2000 con 0x55eabb74ca90 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43404/0 (socket says 172.21.15.49:43404) 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 -- 172.21.15.49:0/1744883369 learned_addr learned my addr 172.21.15.49:0/1744883369 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb778f10 0x55eabb7792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefe40d640 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb74ca90 0x55eabb7766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 -- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb74ca90 msgr2=0x55eabb7766c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb74ca90 0x55eabb7766c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 -- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb778f10 msgr2=0x55eabb7792f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb778f10 0x55eabb7792f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 -- 172.21.15.49:0/1744883369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eabb679690 con 0x55eabb748e90 2023-12-19T05:41:15.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.160+0000 7fcefd40b640 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fceec0541f0 tx=0x7fceec058520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d7faa201b117e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcedb7fe640 1 -- 172.21.15.49:0/1744883369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec056090 con 0x55eabb748e90 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcedb7fe640 1 -- 172.21.15.49:0/1744883369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec054400 con 0x55eabb748e90 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcedb7fe640 1 -- 172.21.15.49:0/1744883369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec054570 con 0x55eabb748e90 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 -- 172.21.15.49:0/1744883369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 msgr2=0x55eabb776180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fceec0541f0 tx=0x7fceec058520 comp rx=0 tx=0).stop 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 -- 172.21.15.49:0/1744883369 shutdown_connections 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb74ca90 0x55eabb7766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb748e90 0x55eabb776180 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 --2- 172.21.15.49:0/1744883369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb778f10 0x55eabb7792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.161+0000 7fcf029da740 1 -- 172.21.15.49:0/1744883369 >> 172.21.15.49:0/1744883369 conn(0x55eabb74b1a0 msgr2=0x55eabb793d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.162+0000 7fcf029da740 1 -- 172.21.15.49:0/1744883369 shutdown_connections 2023-12-19T05:41:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.162+0000 7fcf029da740 1 -- 172.21.15.49:0/1744883369 wait complete. 2023-12-19T05:41:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.162+0000 7fcf029da740 1 -- start start 2023-12-19T05:41:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.163+0000 7fcf029da740 1 Processor -- start 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb796710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb7722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb6537d0 con 0x55eabb772830 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb653470 con 0x55eabb74ca90 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eabb419f20 con 0x55eabb778f10 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcf029da740 10 client.0 _ll_register_callbacks cb 0x55eabb6a21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcefe40d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcefe40d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43410/0 (socket says 172.21.15.49:43410) 2023-12-19T05:41:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcefe40d640 1 -- 172.21.15.49:0/1915384096 learned_addr learned my addr 172.21.15.49:0/1915384096 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcefd40b640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb7722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.164+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb796710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 -- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 msgr2=0x55eabb7722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb7722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 -- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 msgr2=0x55eabb796710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb796710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 -- 172.21.15.49:0/1915384096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef813d050 con 0x55eabb772830 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcefe40d640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009eb0 tx=0x7fcef0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdec7d1f8a7f09f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fced8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0004240 con 0x55eabb772830 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.165+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eabb6dc550 con 0x55eabb772830 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcef00043a0 con 0x55eabb772830 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef0004560 con 0x55eabb772830 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 10 client.5688 fetch_fsmap learned FSMap version 24 2023-12-19T05:41:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55eabb6b0680 con 0x55eabb772830 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eabb6dc550 con 0x55eabb772830 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fcef003e040 con 0x55eabb772830 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 10 client.5688 fetch_fsmap finished waiting for FSMap version 24 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 10 client.5688 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 20 client.5688 populate_metadata read hostname 'smithi049' 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb770be0 0x55eabb770fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 4 client.5688 mds_command: new command op to 5541 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.166+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 --> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eabb6a4b50 con 0x55eabb770be0 2023-12-19T05:41:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.167+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb770be0 0x55eabb770fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.167+0000 7fced8ff9640 10 client.5688 ms_handle_connect on v2:172.21.15.49:6834/4133391224 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.167+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb770be0 0x55eabb770fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13d729a0d6ba7b1 server_cookie=838ccc9c13694b93 in_seq=0 out_seq=0 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fced8ff9640 1 -- 172.21.15.49:0/1915384096 <== mds.0 v2:172.21.15.49:6834/4133391224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55eabb6a4b50 con 0x55eabb770be0 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fced8ff9640 10 client.5688 handle_command_reply: tid=0 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 client.5688 shutdown 2023-12-19T05:41:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 msgr2=0x55eabb7a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009eb0 tx=0x7fcef0004ab0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 shutdown_connections 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb770be0 0x55eabb770fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb7722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb7a26c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 --2- 172.21.15.49:0/1915384096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb796710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fced8ff9640 0 client.5688 ms_handle_reset on v2:172.21.15.49:6834/4133391224 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.168+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 >> 172.21.15.49:0/1915384096 conn(0x55eabb748e90 msgr2=0x55eabb74d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.169+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 shutdown_connections 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.169+0000 7fcf029da740 1 -- 172.21.15.49:0/1915384096 wait complete. 2023-12-19T05:41:15.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.169+0000 7fcf029da740 20 client.5688 trim_cache size 0 max 16384 2023-12-19T05:41:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.185+0000 7fcf029da740 1 Processor -- start 2023-12-19T05:41:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.185+0000 7fcf029da740 1 -- start start 2023-12-19T05:41:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb774490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb74d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb74c7a0 con 0x55eabb772830 2023-12-19T05:41:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb74aa40 con 0x55eabb74ca90 2023-12-19T05:41:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.186+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eabb794c80 con 0x55eabb778f10 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43418/0 (socket says 172.21.15.49:43418) 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 -- 172.21.15.49:0/2322402094 learned_addr learned my addr 172.21.15.49:0/2322402094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb774490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefe40d640 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb74d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 -- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 msgr2=0x55eabb74d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb74d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 -- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 msgr2=0x55eabb774490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb774490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.187+0000 7fcefd40b640 1 -- 172.21.15.49:0/2322402094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eabb6529e0 con 0x55eabb772830 2023-12-19T05:41:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcefd40b640 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fceec0541f0 tx=0x7fceec059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3645873944760ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcedbfff640 1 -- 172.21.15.49:0/2322402094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec054070 con 0x55eabb772830 2023-12-19T05:41:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcedbfff640 1 -- 172.21.15.49:0/2322402094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec054570 con 0x55eabb772830 2023-12-19T05:41:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcedbfff640 1 -- 172.21.15.49:0/2322402094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec06f120 con 0x55eabb772830 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 -- 172.21.15.49:0/2322402094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 msgr2=0x55eabb74cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fceec0541f0 tx=0x7fceec059000 comp rx=0 tx=0).stop 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 -- 172.21.15.49:0/2322402094 shutdown_connections 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb778f10 0x55eabb74d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb772830 0x55eabb74cf90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 --2- 172.21.15.49:0/2322402094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb774490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.188+0000 7fcf029da740 1 -- 172.21.15.49:0/2322402094 >> 172.21.15.49:0/2322402094 conn(0x55eabb748e90 msgr2=0x55eabb7974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.189+0000 7fcf029da740 1 -- 172.21.15.49:0/2322402094 shutdown_connections 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.189+0000 7fcf029da740 1 -- 172.21.15.49:0/2322402094 wait complete. 2023-12-19T05:41:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.189+0000 7fcf029da740 1 -- start start 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.189+0000 7fcf029da740 1 Processor -- start 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.190+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb76d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.190+0000 7fcf029da740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb772830 0x55eabb7df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.190+0000 7fcf029da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.190+0000 7fcf029da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb7a6030 con 0x55eabb778f10 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.190+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eabb7df930 con 0x55eabb74ca90 2023-12-19T05:41:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcf029da740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eabb7945b0 con 0x55eabb772830 2023-12-19T05:41:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcf029da740 10 client.0 _ll_register_callbacks cb 0x7fceec057ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:41:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43420/0 (socket says 172.21.15.49:43420) 2023-12-19T05:41:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 -- 172.21.15.49:0/2655307436 learned_addr learned my addr 172.21.15.49:0/2655307436 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb76d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 -- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb772830 msgr2=0x55eabb7df3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb772830 0x55eabb7df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 -- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 msgr2=0x55eabb76d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb76d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefe40d640 1 -- 172.21.15.49:0/2655307436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eabb679690 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.191+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb76d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fcefe40d640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcef00095c0 tx=0x7fcef0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480fbaa8e111c05e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fced8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0004180 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcef00042e0 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fceec054400 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef00044a0 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fcf029da740 10 client.5694 fetch_fsmap learned FSMap version 24 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.192+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55eabb677ef0 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec054400 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fcef0059030 con 0x55eabb778f10 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 10 client.5694 fetch_fsmap finished waiting for FSMap version 24 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 10 client.5694 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 20 client.5694 populate_metadata read hostname 'smithi049' 2023-12-19T05:41:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb793700 0x55eabb793ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 4 client.5694 mds_command: new command op to 5541 tid=0[{"prefix": "status"}] 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 --> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eabb6ab080 con 0x55eabb793700 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.193+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb793700 0x55eabb793ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcefdc0c640 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb793700 0x55eabb793ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04f1f29d3d3f01f server_cookie=553f7b9a209ae68e in_seq=0 out_seq=0 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fced8ff9640 10 client.5694 ms_handle_connect on v2:172.21.15.49:6834/4133391224 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fced8ff9640 1 -- 172.21.15.49:0/2655307436 <== mds.0 v2:172.21.15.49:6834/4133391224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55eabb6ab080 con 0x55eabb793700 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fced8ff9640 10 client.5694 handle_command_reply: tid=0 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 client.5694 shutdown 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 msgr2=0x55eabb74cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcef00095c0 tx=0x7fcef0009750 comp rx=0 tx=0).stop 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 shutdown_connections 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:6834/4133391224,v1:172.21.15.49:6835/4133391224] conn(0x55eabb793700 0x55eabb793ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55eabb772830 0x55eabb7df3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eabb778f10 0x55eabb74cf60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 --2- 172.21.15.49:0/2655307436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eabb74ca90 0x55eabb76d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fced8ff9640 0 client.5694 ms_handle_reset on v2:172.21.15.49:6834/4133391224 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 >> 172.21.15.49:0/2655307436 conn(0x55eabb748e90 msgr2=0x55eabb796650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 shutdown_connections 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.194+0000 7fcf029da740 1 -- 172.21.15.49:0/2655307436 wait complete. 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcf029da740 20 client.5694 trim_cache size 0 max 16384 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5541, 2023-12-19T05:41:15.201 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 12.215812564, 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 48, 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 48, 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 17.705649898000001 2023-12-19T05:41:15.202 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 msgr2=0x7fcedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000f60 tx=0x7fcef4007b50 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 msgr2=0x7fcef813c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e870 tx=0x7fceec00ec70 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 shutdown_connections 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef8146c40 0x7fcef81398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef80cf8e0 0x7fcef813c040 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 --2- 172.21.15.49:0/3022473370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef80b7360 0x7fcef80b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 >> 172.21.15.49:0/3022473370 conn(0x7fcef80d31b0 msgr2=0x7fcef8143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 shutdown_connections 2023-12-19T05:41:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.195+0000 7fcefec0e640 1 -- 172.21.15.49:0/3022473370 wait complete. 2023-12-19T05:41:15.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:41:15.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.453+0000 7fb1302b6640 1 Processor -- start 2023-12-19T05:41:15.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.453+0000 7fb1302b6640 1 -- start start 2023-12-19T05:41:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.454+0000 7fb1302b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 0x7fb1280d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.454+0000 7fb1302b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1280d2b00 0x7fb1280b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.454+0000 7fb1302b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280cd840 con 0x7fb1280ce110 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb1302b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280d2430 con 0x7fb1280d2b00 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb1302b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280d2620 con 0x7fb128146e10 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1280d2b00 0x7fb1280b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1280d2b00 0x7fb1280b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43428/0 (socket says 172.21.15.49:43428) 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 -- 172.21.15.49:0/1232192786 learned_addr learned my addr 172.21.15.49:0/1232192786 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12e052640 1 --2- 172.21.15.49:0/1232192786 >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 0x7fb1280d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 -- 172.21.15.49:0/1232192786 >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 msgr2=0x7fb1280d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 --2- 172.21.15.49:0/1232192786 >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 0x7fb1280d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 -- 172.21.15.49:0/1232192786 >> v1:172.21.15.115:6789/0 conn(0x7fb1280ce110 legacy=0x7fb1280b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12d851640 1 -- 172.21.15.49:0/1232192786 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b41c0 con 0x7fb1280d2b00 2023-12-19T05:41:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.455+0000 7fb12e052640 1 --2- 172.21.15.49:0/1232192786 >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 0x7fb1280d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.457+0000 7fb12d851640 1 --2- 172.21.15.49:0/1232192786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1280b6780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb1280d0720 tx=0x7fb11c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7099480afee6ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.457+0000 7fb12d050640 1 -- 172.21.15.49:0/1232192786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0317e0 con 0x7fb1280d2b00 2023-12-19T05:41:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.457+0000 7fb12d050640 1 -- 172.21.15.49:0/1232192786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c031940 con 0x7fb1280d2b00 2023-12-19T05:41:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.457+0000 7fb12d050640 1 -- 172.21.15.49:0/1232192786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c031cd0 con 0x7fb1280d2b00 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 -- 172.21.15.49:0/1232192786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 msgr2=0x7fb1280b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 --2- 172.21.15.49:0/1232192786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1280b6780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb1280d0720 tx=0x7fb11c02b880 comp rx=0 tx=0).stop 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 -- 172.21.15.49:0/1232192786 shutdown_connections 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 --2- 172.21.15.49:0/1232192786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1280b6780 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 --2- 172.21.15.49:0/1232192786 >> v2:172.21.15.115:3300/0 conn(0x7fb128146e10 0x7fb1280d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 -- 172.21.15.49:0/1232192786 >> 172.21.15.49:0/1232192786 conn(0x7fb1280b29c0 msgr2=0x7fb1280b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 -- 172.21.15.49:0/1232192786 shutdown_connections 2023-12-19T05:41:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.458+0000 7fb1302b6640 1 -- 172.21.15.49:0/1232192786 wait complete. 2023-12-19T05:41:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.460+0000 7fb1302b6640 1 Processor -- start 2023-12-19T05:41:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.460+0000 7fb1302b6640 1 -- start start 2023-12-19T05:41:15.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 0x7fb1281420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb128146e10 0x7fb1281604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128143370 con 0x7fb1280d2b00 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281599e0 con 0x7fb1280ce110 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb1302b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815e3a0 con 0x7fb128146e10 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb12d851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb12d851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43444/0 (socket says 172.21.15.49:43444) 2023-12-19T05:41:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.461+0000 7fb12d851640 1 -- 172.21.15.49:0/3207161863 learned_addr learned my addr 172.21.15.49:0/3207161863 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12e052640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 0x7fb1281420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12e853640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb128146e10 0x7fb1281604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 -- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb128146e10 msgr2=0x7fb1281604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb128146e10 0x7fb1281604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 -- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 msgr2=0x7fb1281420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 0x7fb1281420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 -- 172.21.15.49:0/3207161863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0094d0 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12e052640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 0x7fb1281420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.462+0000 7fb12d851640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb11c02b8c0 tx=0x7fb11c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.463+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0329c0 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.463+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c032b40 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.463+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0453f0 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.463+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb128142760 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.463+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128142d20 con 0x7fb1280d2b00 2023-12-19T05:41:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.464+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128061910 con 0x7fb1280d2b00 2023-12-19T05:41:15.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.465+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb11c04d3f0 con 0x7fb1280d2b00 2023-12-19T05:41:15.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.466+0000 7fb126ffd640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 0x7fb11406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:15.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.466+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb11c0aa8a0 con 0x7fb1280d2b00 2023-12-19T05:41:15.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.467+0000 7fb12e052640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 0x7fb11406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.468+0000 7fb12e052640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 0x7fb11406c940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb118007f30 tx=0x7fb118007480 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:15.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.470+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb11c075f90 con 0x7fb1280d2b00 2023-12-19T05:41:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.700+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1281465c0 con 0x7fb1280d2b00 2023-12-19T05:41:15.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.701+0000 7fb126ffd640 1 -- 172.21.15.49:0/3207161863 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb11c0795b0 con 0x7fb1280d2b00 2023-12-19T05:41:15.704 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 msgr2=0x7fb11406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 0x7fb11406c940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb118007f30 tx=0x7fb118007480 comp rx=0 tx=0).stop 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 msgr2=0x7fb1281594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb11c02b8c0 tx=0x7fb11c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 shutdown_connections 2023-12-19T05:41:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb11406a480 0x7fb11406c940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb128146e10 0x7fb1281604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1280d2b00 0x7fb1281594a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 --2- 172.21.15.49:0/3207161863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1280ce110 0x7fb1281420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 >> 172.21.15.49:0/3207161863 conn(0x7fb1280b29c0 msgr2=0x7fb12815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 shutdown_connections 2023-12-19T05:41:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:15.704+0000 7fb1302b6640 1 -- 172.21.15.49:0/3207161863 wait complete. 2023-12-19T05:41:15.726 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:41:15.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:41:15.727 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:41:15.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:15.727 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:41:15.783 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:41:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42217sec preferred_lft 42217sec 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:41:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:41:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:15.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:15.787 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:41:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:41:15.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:15.894 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:41:15.955 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:41:15.955 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:41:15.955 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:41:15.955 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:41:15.955 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:41:15.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:41:15.956 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:41:16.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:16.170 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:41:16.228 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:41:16.228 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:41:16.229 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:41:16.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:16.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:41:16.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:41:16.340 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:41:16.399 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:41:16.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:41:16.400 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:41:16.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:41:16.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:16.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:16.622 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:16.622 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:41:16.655 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:16.655 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:41:16.655 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:41:16.655 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:41:16.655 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:41:16.656 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:41:16.657 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:41:16.657 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:41:16.657 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:41:16.657 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:41:16.661 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:41:16.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:16.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:41:16.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:16.755 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:41:16.828 INFO:teuthology.orchestra.run.smithi049.stdout:client4898 2023-12-19T05:41:16.828 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:16.829 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:16.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:41:17.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.120+0000 7fe5de9e9640 1 Processor -- start 2023-12-19T05:41:17.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.121+0000 7fe5de9e9640 1 -- start start 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.122+0000 7fe5de9e9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5d8146e30 0x7fe5d80b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.122+0000 7fe5de9e9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5d80b7ea0 0x7fe5d80d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.122+0000 7fe5de9e9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d80d12d0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5de9e9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d8147210 con 0x7fe5d8146e30 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5de9e9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d80b8330 con 0x7fe5d80b7ea0 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5d8146e30 0x7fe5d80b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5d8146e30 0x7fe5d80b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43456/0 (socket says 172.21.15.49:43456) 2023-12-19T05:41:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 -- 172.21.15.49:0/743339664 learned_addr learned my addr 172.21.15.49:0/743339664 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd1e6640 1 --2- 172.21.15.49:0/743339664 >> v2:172.21.15.115:3300/0 conn(0x7fe5d80b7ea0 0x7fe5d80d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 -- 172.21.15.49:0/743339664 >> v2:172.21.15.115:3300/0 conn(0x7fe5d80b7ea0 msgr2=0x7fe5d80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 --2- 172.21.15.49:0/743339664 >> v2:172.21.15.115:3300/0 conn(0x7fe5d80b7ea0 0x7fe5d80d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 -- 172.21.15.49:0/743339664 >> v1:172.21.15.115:6789/0 conn(0x7fe5d80d0a90 legacy=0x7fe5d806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.123+0000 7fe5dd9e7640 1 -- 172.21.15.49:0/743339664 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80d15b0 con 0x7fe5d8146e30 2023-12-19T05:41:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.125+0000 7fe5dd9e7640 1 --2- 172.21.15.49:0/743339664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d8146e30 0x7fe5d80b7960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80c85f0 tx=0x7fe5d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e472274c7338e2f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.125+0000 7fe5dc9e5640 1 -- 172.21.15.49:0/743339664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40317e0 con 0x7fe5d8146e30 2023-12-19T05:41:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.125+0000 7fe5dc9e5640 1 -- 172.21.15.49:0/743339664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4031940 con 0x7fe5d8146e30 2023-12-19T05:41:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.125+0000 7fe5dc9e5640 1 -- 172.21.15.49:0/743339664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4031cd0 con 0x7fe5d8146e30 2023-12-19T05:41:17.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 -- 172.21.15.49:0/743339664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d8146e30 msgr2=0x7fe5d80b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:17.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/743339664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d8146e30 0x7fe5d80b7960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80c85f0 tx=0x7fe5d402b880 comp rx=0 tx=0).stop 2023-12-19T05:41:17.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 -- 172.21.15.49:0/743339664 shutdown_connections 2023-12-19T05:41:17.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/743339664 >> v2:172.21.15.115:3300/0 conn(0x7fe5d80b7ea0 0x7fe5d80d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/743339664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d8146e30 0x7fe5d80b7960 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 -- 172.21.15.49:0/743339664 >> 172.21.15.49:0/743339664 conn(0x7fe5d80b2990 msgr2=0x7fe5d80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:17.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 -- 172.21.15.49:0/743339664 shutdown_connections 2023-12-19T05:41:17.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.126+0000 7fe5de9e9640 1 -- 172.21.15.49:0/743339664 wait complete. 2023-12-19T05:41:17.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.128+0000 7fe5de9e9640 1 Processor -- start 2023-12-19T05:41:17.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.128+0000 7fe5de9e9640 1 -- start start 2023-12-19T05:41:17.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5d80b7ea0 0x7fe5d8141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 0x7fe5d8142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c97a0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c88b0 con 0x7fe5d80b7ea0 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5de9e9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c8b90 con 0x7fe5d8146e30 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5dd1e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5dd1e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43462/0 (socket says 172.21.15.49:43462) 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5dd1e6640 1 -- 172.21.15.49:0/3208766972 learned_addr learned my addr 172.21.15.49:0/3208766972 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:17.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.129+0000 7fe5dd9e7640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5d80b7ea0 0x7fe5d8141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5de1e8640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 0x7fe5d8142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 -- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 msgr2=0x7fe5d8142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 0x7fe5d8142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 -- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5d80b7ea0 msgr2=0x7fe5d8141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5d80b7ea0 0x7fe5d8141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 -- 172.21.15.49:0/3208766972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094d0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5de1e8640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 0x7fe5d8142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:17.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5dd1e6640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800b6c0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800b820 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800bbb0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.130+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d80c8e70 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.131+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d80c9430 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.132+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d8061910 con 0x7fe5d80d0a90 2023-12-19T05:41:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.133+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5c800bd10 con 0x7fe5d80d0a90 2023-12-19T05:41:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.133+0000 7fe5ce7fc640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 0x7fe5bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.134+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5c8088ec0 con 0x7fe5d80d0a90 2023-12-19T05:41:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.134+0000 7fe5dd9e7640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 0x7fe5bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:17.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.135+0000 7fe5dd9e7640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 0x7fe5bc06c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:17.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.138+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe5c8054410 con 0x7fe5d80d0a90 2023-12-19T05:41:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.375+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe5d80d0700 con 0x7fe5d80d0a90 2023-12-19T05:41:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.376+0000 7fe5ce7fc640 1 -- 172.21.15.49:0/3208766972 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe5c8057a30 con 0x7fe5d80d0a90 2023-12-19T05:41:17.378 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:41:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 msgr2=0x7fe5bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 0x7fe5bc06c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d403d040 comp rx=0 tx=0).stop 2023-12-19T05:41:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 msgr2=0x7fe5d81d5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 shutdown_connections 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5bc06a430 0x7fe5bc06c8f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5d8146e30 0x7fe5d8142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d80d0a90 0x7fe5d81d5520 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 --2- 172.21.15.49:0/3208766972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5d80b7ea0 0x7fe5d8141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 >> 172.21.15.49:0/3208766972 conn(0x7fe5d80b2990 msgr2=0x7fe5d81451b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 shutdown_connections 2023-12-19T05:41:17.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:17.379+0000 7fe5de9e9640 1 -- 172.21.15.49:0/3208766972 wait complete. 2023-12-19T05:41:17.399 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:41:17.399 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:41:17.400 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:41:17.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.400 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:17.463 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42232sec preferred_lft 42232sec 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:41:17.464 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:41:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:41:17.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.466 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:41:17.563 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:41:17.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.568 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:41:17.626 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:41:17.626 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:41:17.626 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:41:17.626 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:41:17.626 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:41:17.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:41:17.627 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:41:17.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.812 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:41:17.860 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:41:17.860 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:41:17.860 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:41:17.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:17.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:41:17.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:41:17.947 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:41:17.997 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:41:17.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:41:17.998 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:41:18.054 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:41:18.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:18.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:18.239 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:18.239 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:41:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:41:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:41:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:41:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:41:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:41:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:41:18.274 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:41:18.274 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:41:18.274 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:41:18.274 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:41:18.277 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:41:18.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:18.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:41:18.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:18.360 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:41:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:client5242 2023-12-19T05:41:18.420 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:41:18.420 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:18.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.709+0000 7f12764e7640 1 Processor -- start 2023-12-19T05:41:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.710+0000 7f12764e7640 1 -- start start 2023-12-19T05:41:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.711+0000 7f12764e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1270146da0 0x7f12700aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.711+0000 7f12764e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1270147180 0x7f12700aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.711+0000 7f12764e7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700d1070 con 0x7f12701611f0 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.711+0000 7f12764e7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1270162020 con 0x7f1270146da0 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.711+0000 7f12764e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700aabd0 con 0x7f1270147180 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1270146da0 0x7f12700aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1270146da0 0x7f12700aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43464/0 (socket says 172.21.15.49:43464) 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 -- 172.21.15.49:0/3230109271 learned_addr learned my addr 172.21.15.49:0/3230109271 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f1274a84640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12701611f0 0x7f12700abcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36970/0 (socket says 172.21.15.49:36970) 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126f7fe640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1270147180 0x7f12700aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 -- 172.21.15.49:0/3230109271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1270147180 msgr2=0x7f12700aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1270147180 0x7f12700aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 -- 172.21.15.49:0/3230109271 >> v1:172.21.15.49:6789/0 conn(0x7f12701611f0 legacy=0x7f12700abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.712+0000 7f126ffff640 1 -- 172.21.15.49:0/3230109271 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700aaeb0 con 0x7f1270146da0 2023-12-19T05:41:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f126ffff640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1270146da0 0x7f12700aa060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e50 tx=0x7f126002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae13dd6e7c33f26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f126effd640 1 -- 172.21.15.49:0/3230109271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126002cb00 con 0x7f1270146da0 2023-12-19T05:41:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f126effd640 1 -- 172.21.15.49:0/3230109271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126002cc60 con 0x7f1270146da0 2023-12-19T05:41:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f126effd640 1 -- 172.21.15.49:0/3230109271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600343f0 con 0x7f1270146da0 2023-12-19T05:41:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f12764e7640 1 -- 172.21.15.49:0/3230109271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1270146da0 msgr2=0x7f12700aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.714+0000 7f12764e7640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1270146da0 0x7f12700aa060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e50 tx=0x7f126002bf60 comp rx=0 tx=0).stop 2023-12-19T05:41:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 -- 172.21.15.49:0/3230109271 shutdown_connections 2023-12-19T05:41:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1270147180 0x7f12700aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 --2- 172.21.15.49:0/3230109271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1270146da0 0x7f12700aa060 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 -- 172.21.15.49:0/3230109271 >> 172.21.15.49:0/3230109271 conn(0x7f1270071a50 msgr2=0x7f12700d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 -- 172.21.15.49:0/3230109271 shutdown_connections 2023-12-19T05:41:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.715+0000 7f12764e7640 1 -- 172.21.15.49:0/3230109271 wait complete. 2023-12-19T05:41:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.717+0000 7f12764e7640 1 Processor -- start 2023-12-19T05:41:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.717+0000 7f12764e7640 1 -- start start 2023-12-19T05:41:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 0x7f12700afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12701611f0 0x7f12701f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700af110 con 0x7f127015dee0 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1270142fe0 con 0x7f1270146da0 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f12764e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12701432c0 con 0x7f12701611f0 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f1274a84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f1274a84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43470/0 (socket says 172.21.15.49:43470) 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f1274a84640 1 -- 172.21.15.49:0/370017731 learned_addr learned my addr 172.21.15.49:0/370017731 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f126ffff640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 0x7f12700afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.718+0000 7f126f7fe640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12701611f0 0x7f12701f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 -- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12701611f0 msgr2=0x7f12701f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12701611f0 0x7f12701f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 -- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 msgr2=0x7f12700afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 0x7f12700afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 -- 172.21.15.49:0/370017731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009b30 con 0x7f127015dee0 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f126ffff640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 0x7f12700afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f1274a84640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1268001eb0 tx=0x7f126800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680074e0 con 0x7f127015dee0 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268007640 con 0x7f127015dee0 2023-12-19T05:41:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12701435a0 con 0x7f127015dee0 2023-12-19T05:41:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680049e0 con 0x7f127015dee0 2023-12-19T05:41:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.719+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1270143b60 con 0x7f127015dee0 2023-12-19T05:41:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.720+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1270143d20 con 0x7f127015dee0 2023-12-19T05:41:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.722+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1268004b40 con 0x7f127015dee0 2023-12-19T05:41:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.722+0000 7f126cff9640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 0x7f125006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.723+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1268088330 con 0x7f127015dee0 2023-12-19T05:41:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.723+0000 7f126ffff640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 0x7f125006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.725+0000 7f126ffff640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 0x7f125006c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1260035000 tx=0x7f1260030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.727+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1268053880 con 0x7f127015dee0 2023-12-19T05:41:18.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.959+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1270073ec0 con 0x7f127015dee0 2023-12-19T05:41:18.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.960+0000 7f126cff9640 1 -- 172.21.15.49:0/370017731 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f1268056ea0 con 0x7f127015dee0 2023-12-19T05:41:18.962 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:18.962 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 msgr2=0x7f125006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 0x7f125006c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1260035000 tx=0x7f1260030000 comp rx=0 tx=0).stop 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 msgr2=0x7f1270140a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1268001eb0 tx=0x7f126800c820 comp rx=0 tx=0).stop 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 shutdown_connections 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f125006a430 0x7f125006c8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12701611f0 0x7f12701f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f127015dee0 0x7f1270140a10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 --2- 172.21.15.49:0/370017731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1270146da0 0x7f12700afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.962+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 >> 172.21.15.49:0/370017731 conn(0x7f1270071a50 msgr2=0x7f1270145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.963+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 shutdown_connections 2023-12-19T05:41:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:18.963+0000 7f12764e7640 1 -- 172.21.15.49:0/370017731 wait complete. 2023-12-19T05:41:18.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T05:41:19.229 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":5541,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.232771846999999,"mdsmap_epoch":24,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":21.722633019} 2023-12-19T05:41:19.232 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 5541, "mdsmap_epoch": 24, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 16.232771847, "state": "up:active", "uptime": 21.722633019, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:41:19.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:41:19.479 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:41:19.480 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:41:19.480 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-19T05:41:19.480 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:19.480 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:19.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:19.537 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-19T05:41:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:265+0 records in 2023-12-19T05:41:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:265+0 records out 2023-12-19T05:41:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.93375 s, 144 MB/s 2023-12-19T05:41:21.537 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:21.538 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:21.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:21.588 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-19T05:41:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:292+0 records in 2023-12-19T05:41:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:292+0 records out 2023-12-19T05:41:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.1491 s, 142 MB/s 2023-12-19T05:41:23.842 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T05:41:23.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.042+0000 7fcbcb0e5640 1 Processor -- start 2023-12-19T05:41:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.042+0000 7fcbcb0e5640 1 -- start start 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 0x7fcbc4159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 0x7fcbc406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbc40cc990 0x7fcbc40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc415d0e0 con 0x7fcbc40cc990 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc4070350 con 0x7fcbc4159810 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbcb0e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40cd360 con 0x7fcbc406f9f0 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbca8e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbc40cc990 0x7fcbc40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbca8e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbc40cc990 0x7fcbc40cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59956/0 (socket says 172.21.15.49:59956) 2023-12-19T05:41:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.044+0000 7fcbca8e4640 1 -- 172.21.15.49:0/4137370677 learned_addr learned my addr 172.21.15.49:0/4137370677 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca8e4640 1 -- 172.21.15.49:0/4137370677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 msgr2=0x7fcbc406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca0e3640 1 --2- 172.21.15.49:0/4137370677 >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 0x7fcbc4159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbc98e2640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 0x7fcbc406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca8e4640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 0x7fcbc406fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca8e4640 1 -- 172.21.15.49:0/4137370677 >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 msgr2=0x7fcbc4159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:24.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca8e4640 1 --2- 172.21.15.49:0/4137370677 >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 0x7fcbc4159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca8e4640 1 -- 172.21.15.49:0/4137370677 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40b1590 con 0x7fcbc40cc990 2023-12-19T05:41:24.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbca0e3640 1 --2- 172.21.15.49:0/4137370677 >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 0x7fcbc4159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:24.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.045+0000 7fcbc98e2640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 0x7fcbc406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:24.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.046+0000 7fcbca8e4640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc40cc990 0x7fcbc40cce20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40678a0 tx=0x7fcbbc02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaf00e2760cfac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbc90e1640 1 -- 172.21.15.49:0/4137370677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc02ee10 con 0x7fcbc40cc990 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbc90e1640 1 -- 172.21.15.49:0/4137370677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc032070 con 0x7fcbc40cc990 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbc90e1640 1 -- 172.21.15.49:0/4137370677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc038620 con 0x7fcbc40cc990 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/4137370677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc40cc990 msgr2=0x7fcbc40cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc40cc990 0x7fcbc40cce20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40678a0 tx=0x7fcbbc02e060 comp rx=0 tx=0).stop 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/4137370677 shutdown_connections 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc40cc990 0x7fcbc40cce20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/4137370677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc406f9f0 0x7fcbc406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/4137370677 >> v2:172.21.15.115:3300/0 conn(0x7fcbc4159810 0x7fcbc4159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/4137370677 >> 172.21.15.49:0/4137370677 conn(0x7fcbc40b0100 msgr2=0x7fcbc40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:24.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.047+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/4137370677 shutdown_connections 2023-12-19T05:41:24.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.048+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/4137370677 wait complete. 2023-12-19T05:41:24.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.049+0000 7fcbcb0e5640 1 Processor -- start 2023-12-19T05:41:24.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.050+0000 7fcbcb0e5640 1 -- start start 2023-12-19T05:41:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc40cc990 0x7fcbc40ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 0x7fcbc40ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4157ff0 con 0x7fcbc406f9f0 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4158410 con 0x7fcbc4159810 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbcb0e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4157120 con 0x7fcbc40cc990 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59958/0 (socket says 172.21.15.49:59958) 2023-12-19T05:41:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 -- 172.21.15.49:0/2936906988 learned_addr learned my addr 172.21.15.49:0/2936906988 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 -- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc40cc990 msgr2=0x7fcbc40ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca8e4640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 0x7fcbc40ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc40cc990 0x7fcbc40ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 -- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 msgr2=0x7fcbc40ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.051+0000 7fcbca0e3640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 0x7fcbc40ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbca0e3640 1 -- 172.21.15.49:0/2936906988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc00bd40 con 0x7fcbc406f9f0 2023-12-19T05:41:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbca8e4640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 0x7fcbc40ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbca0e3640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c7f0 tx=0x7fcbc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0007a30 con 0x7fcbc406f9f0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0007b90 con 0x7fcbc406f9f0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc4157370 con 0x7fcbc406f9f0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000ce40 con 0x7fcbc406f9f0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.052+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc4157930 con 0x7fcbc406f9f0 2023-12-19T05:41:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.053+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4061910 con 0x7fcbc406f9f0 2023-12-19T05:41:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.054+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbc00113f0 con 0x7fcbc406f9f0 2023-12-19T05:41:24.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.055+0000 7fcbbaffd640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 0x7fcba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:24.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.055+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc0088af0 con 0x7fcbc406f9f0 2023-12-19T05:41:24.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.056+0000 7fcbc98e2640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 0x7fcba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:24.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.057+0000 7fcbc98e2640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 0x7fcba806c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006b10 tx=0x7fcbb4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:24.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.060+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbc00540d0 con 0x7fcbc406f9f0 2023-12-19T05:41:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.257+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcbc40b0a80 con 0x7fcbc406f9f0 2023-12-19T05:41:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.260+0000 7fcbbaffd640 1 -- 172.21.15.49:0/2936906988 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+33476 (secure 0 0 0) 0x7fcbc001f090 con 0x7fcbc406f9f0 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 48, 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:03.979105+0000", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:24.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:24.263 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:24.264 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:24.265 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:24.266 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "16", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:24.267 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:24.268 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:24.269 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:24.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:24.271 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:24.273 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "47", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:24.274 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:24.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:24.276 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:24.277 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:24.278 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "48", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:24.280 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:24.282 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:24.283 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:24.291 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:24.295 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.296 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.297 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.299 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:24.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.301 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.302 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.303 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:24.306 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.308 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.309 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.310 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:24.311 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.314 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.317 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.325 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:24.326 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:24.327 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.328 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.329 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.330 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:24.333 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:24.334 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:24.335 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:24.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 msgr2=0x7fcba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 0x7fcba806c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006b10 tx=0x7fcbb4008040 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 msgr2=0x7fcbc4144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c7f0 tx=0x7fcbc000cbf0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 shutdown_connections 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcba806a430 0x7fcba806c8f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbc40cc990 0x7fcbc40ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc4159810 0x7fcbc40ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 --2- 172.21.15.49:0/2936906988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbc406f9f0 0x7fcbc4144750 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 >> 172.21.15.49:0/2936906988 conn(0x7fcbc40b0100 msgr2=0x7fcbc40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 shutdown_connections 2023-12-19T05:41:24.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:24.263+0000 7fcbcb0e5640 1 -- 172.21.15.49:0/2936906988 wait complete. 2023-12-19T05:41:24.338 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:41:25.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:25.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:26.310 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:41:26.308+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-19T05:41:29.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:29.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.575+0000 7f471f810640 1 Processor -- start 2023-12-19T05:41:29.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.575+0000 7f471f810640 1 -- start start 2023-12-19T05:41:29.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.576+0000 7f471f810640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4718161660 0x7f4718166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471f810640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4718165bc0 con 0x7f4718161a40 2023-12-19T05:41:29.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471f810640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471806e520 con 0x7f47180afa50 2023-12-19T05:41:29.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471f810640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180afef0 con 0x7f4718161660 2023-12-19T05:41:29.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471ddad640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4718161a40 0x7f47180ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46156/0 (socket says 172.21.15.49:46156) 2023-12-19T05:41:29.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471ddad640 1 -- 172.21.15.49:0/4031378574 learned_addr learned my addr 172.21.15.49:0/4031378574 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:29.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f471d5ac640 1 --2- 172.21.15.49:0/4031378574 >> v2:172.21.15.115:3300/0 conn(0x7f4718161660 0x7f4718166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.577+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560558599 0 0) 0x7f4718165bc0 con 0x7f4718161a40 2023-12-19T05:41:29.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4708003520 con 0x7f4718161a40 2023-12-19T05:41:29.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3235814326 0 0) 0x7f4708003520 con 0x7f4718161a40 2023-12-19T05:41:29.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 >> v2:172.21.15.115:3300/0 conn(0x7f4718161660 msgr2=0x7f4718166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 --2- 172.21.15.49:0/4031378574 >> v2:172.21.15.115:3300/0 conn(0x7f4718161660 0x7f4718166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 >> v1:172.21.15.115:6789/0 conn(0x7f47180afa50 legacy=0x7f47180b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718165570 con 0x7f4718161a40 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f4710001670 con 0x7f4718161a40 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 >> v1:172.21.15.49:6789/0 conn(0x7f4718161a40 legacy=0x7f47180ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080039e0 0x7f4708003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 0x7f4708004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4708005180 0x7f470800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180afef0 con 0x7f47080047c0 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470800c020 con 0x7f4708005180 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.578+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470800c1e0 con 0x7f47080039e0 2023-12-19T05:41:29.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 0x7f4708004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 -- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080039e0 msgr2=0x7f4708003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471d5ac640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080039e0 0x7f4708003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080039e0 0x7f4708003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 -- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4708005180 msgr2=0x7f470800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4708005180 0x7f470800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471cdab640 1 -- 172.21.15.49:0/4031378574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708003520 con 0x7f47080047c0 2023-12-19T05:41:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.579+0000 7f471ddad640 1 -- 172.21.15.49:0/4031378574 reap_dead start 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.580+0000 7f471cdab640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 0x7f4708004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4704001780 tx=0x7f47080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8954d0c61d4c97 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.580+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040052d0 con 0x7f47080047c0 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.580+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470402e050 con 0x7f47080047c0 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.580+0000 7f4717fff640 1 -- 172.21.15.49:0/4031378574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003850 con 0x7f47080047c0 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 -- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 msgr2=0x7f4708004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 0x7f4708004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4704001780 tx=0x7f47080057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 -- 172.21.15.49:0/4031378574 shutdown_connections 2023-12-19T05:41:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 --2- 172.21.15.49:0/4031378574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47080047c0 0x7f4708004c40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 -- 172.21.15.49:0/4031378574 >> 172.21.15.49:0/4031378574 conn(0x7f47180cbb70 msgr2=0x7f47180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 -- 172.21.15.49:0/4031378574 shutdown_connections 2023-12-19T05:41:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.581+0000 7f471f810640 1 -- 172.21.15.49:0/4031378574 wait complete. 2023-12-19T05:41:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.583+0000 7f471f810640 1 Processor -- start 2023-12-19T05:41:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.583+0000 7f471f810640 1 -- start start 2023-12-19T05:41:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 0x7f4718160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f471814ab20 0x7f47180b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471806e160 con 0x7f471806c4a0 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471806c920 con 0x7f471814ab20 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.584+0000 7f471f810640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471806b770 con 0x7f47080047c0 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59972/0 (socket says 172.21.15.49:59972) 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 -- 172.21.15.49:0/446114921 learned_addr learned my addr 172.21.15.49:0/446114921 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471d5ac640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 0x7f4718160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471ddad640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f471814ab20 0x7f47180b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 -- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 msgr2=0x7f4718160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 0x7f4718160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 -- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f471814ab20 msgr2=0x7f47180b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f471814ab20 0x7f47180b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471cdab640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471806c010 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.585+0000 7f471d5ac640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 0x7f4718160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f471cdab640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4704034040 tx=0x7f47040010c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704006e50 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704007250 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47181fb4f0 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040075e0 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.586+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471806b9c0 con 0x7f471806c4a0 2023-12-19T05:41:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.587+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471806c1a0 con 0x7f471806c4a0 2023-12-19T05:41:29.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.588+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4704003610 con 0x7f471806c4a0 2023-12-19T05:41:29.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.589+0000 7f4715ffb640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 0x7f46fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:29.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.589+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47040aa220 con 0x7f471806c4a0 2023-12-19T05:41:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.590+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f46fc071f90 con 0x7f471806c4a0 2023-12-19T05:41:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.590+0000 7f471d5ac640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 0x7f46fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:29.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.591+0000 7f471d5ac640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 0x7f46fc06c920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f471804f980 tx=0x7f470c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:29.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.594+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4704075920 con 0x7f471806c4a0 2023-12-19T05:41:29.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.788+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4718061910 con 0x7f471806c4a0 2023-12-19T05:41:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.791+0000 7f4715ffb640 1 -- 172.21.15.49:0/446114921 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+33691 (secure 0 0 0) 0x7f4704078f40 con 0x7f471806c4a0 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 51, 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:29.319873+0000", 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:29.793 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:29.794 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:29.795 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:29.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:29.797 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:29.798 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:29.799 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:29.800 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:29.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:29.802 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:29.803 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:29.804 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:29.805 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:29.806 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:29.807 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:29.808 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:29.809 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:29.810 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:29.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:29.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.813 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:29.862 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.793+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 msgr2=0x7f46fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 0x7f46fc06c920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f471804f980 tx=0x7f470c00b040 comp rx=0 tx=0).stop 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 msgr2=0x7f47181fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4704034040 tx=0x7f47040010c0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 shutdown_connections 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46fc06a460 0x7f46fc06c920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f471814ab20 0x7f47180b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f471806c4a0 0x7f47181fafb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 --2- 172.21.15.49:0/446114921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47080047c0 0x7f4718160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 >> 172.21.15.49:0/446114921 conn(0x7f47180cbb70 msgr2=0x7f471815b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 shutdown_connections 2023-12-19T05:41:29.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:29.794+0000 7f471f810640 1 -- 172.21.15.49:0/446114921 wait complete. 2023-12-19T05:41:29.864 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T05:41:29.865 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:29.865 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:29.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:29.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-19T05:41:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T05:41:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:41:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:41:30.323 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.316501 s, 166 MB/s 2023-12-19T05:41:30.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:41:30.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.547+0000 7fe3f50e7640 1 Processor -- start 2023-12-19T05:41:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.547+0000 7fe3f50e7640 1 -- start start 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3f50e7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3f00b0810 0x7fe3f0164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3f50e7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00ae640 con 0x7fe3f00ae110 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3f50e7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00ae920 con 0x7fe3f0157bf0 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3f50e7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f006b8c0 con 0x7fe3f00b0810 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3e659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe3f00ae110 0x7fe3f00b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46166/0 (socket says 172.21.15.49:46166) 2023-12-19T05:41:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3e659c640 1 -- 172.21.15.49:0/3444572810 learned_addr learned my addr 172.21.15.49:0/3444572810 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:30.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3ef59e640 1 --2- 172.21.15.49:0/3444572810 >> v2:172.21.15.115:3300/0 conn(0x7fe3f00b0810 0x7fe3f0164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.549+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032843490 0 0) 0x7fe3f00ae640 con 0x7fe3f00ae110 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d0003520 con 0x7fe3f00ae110 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958054729 0 0) 0x7fe3d0003520 con 0x7fe3f00ae110 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 >> v2:172.21.15.115:3300/0 conn(0x7fe3f00b0810 msgr2=0x7fe3f0164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 --2- 172.21.15.49:0/3444572810 >> v2:172.21.15.115:3300/0 conn(0x7fe3f00b0810 0x7fe3f0164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 >> v1:172.21.15.115:6789/0 conn(0x7fe3f0157bf0 legacy=0x7fe3f015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00aec00 con 0x7fe3f00ae110 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe3d8001670 con 0x7fe3f00ae110 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 >> v1:172.21.15.49:6789/0 conn(0x7fe3f00ae110 legacy=0x7fe3f00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3d0003a30 0x7fe3d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3d00051d0 0x7fe3d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f006b8c0 con 0x7fe3d00047c0 2023-12-19T05:41:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d000c100 con 0x7fe3d0003a30 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.550+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d000c2c0 con 0x7fe3d00051d0 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3eed9d640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3d0003a30 0x7fe3d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3ef59e640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3d00051d0 0x7fe3d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 -- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3d00051d0 msgr2=0x7fe3d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3d00051d0 0x7fe3d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 -- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3d0003a30 msgr2=0x7fe3d0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3d0003a30 0x7fe3d0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3e659c640 1 -- 172.21.15.49:0/3444572810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0003520 con 0x7fe3d00047c0 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3eed9d640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3d0003a30 0x7fe3d0003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3ef59e640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3d00051d0 0x7fe3d000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.551+0000 7fe3ef59e640 1 -- 172.21.15.49:0/3444572810 reap_dead start 2023-12-19T05:41:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.552+0000 7fe3e659c640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3d0004c40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c0e0 tx=0x7fe3d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6655c2bf7a5fc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.552+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8005ad0 con 0x7fe3d00047c0 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.552+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d8005c30 con 0x7fe3d00047c0 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.552+0000 7fe3ee59c640 1 -- 172.21.15.49:0/3444572810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d80072b0 con 0x7fe3d00047c0 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 -- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 msgr2=0x7fe3d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3d0004c40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c0e0 tx=0x7fe3d00057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 -- 172.21.15.49:0/3444572810 shutdown_connections 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/3444572810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3d0004c40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 -- 172.21.15.49:0/3444572810 >> 172.21.15.49:0/3444572810 conn(0x7fe3f00cbb70 msgr2=0x7fe3f00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 -- 172.21.15.49:0/3444572810 shutdown_connections 2023-12-19T05:41:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.553+0000 7fe3f50e7640 1 -- 172.21.15.49:0/3444572810 wait complete. 2023-12-19T05:41:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.555+0000 7fe3f50e7640 1 Processor -- start 2023-12-19T05:41:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.555+0000 7fe3f50e7640 1 -- start start 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3f01f5910 0x7fe3f01e5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3f00cddb0 0x7fe3f00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00ce770 con 0x7fe3d00047c0 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01e4da0 con 0x7fe3f01f5910 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.556+0000 7fe3f50e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01e4190 con 0x7fe3f00cddb0 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59990/0 (socket says 172.21.15.49:59990) 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 -- 172.21.15.49:0/351403054 learned_addr learned my addr 172.21.15.49:0/351403054 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3e659c640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3f01f5910 0x7fe3f01e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3ef59e640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3f00cddb0 0x7fe3f00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 -- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3f00cddb0 msgr2=0x7fe3f00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3f00cddb0 0x7fe3f00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 -- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3f01f5910 msgr2=0x7fe3f01e5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3f01f5910 0x7fe3f01e5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.557+0000 7fe3eed9d640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f01e4470 con 0x7fe3d00047c0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3eed9d640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000d570 tx=0x7fe3e000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0005480 con 0x7fe3d00047c0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0003610 con 0x7fe3d00047c0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00039a0 con 0x7fe3d00047c0 2023-12-19T05:41:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f01e4750 con 0x7fe3d00047c0 2023-12-19T05:41:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.558+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f01e5990 con 0x7fe3d00047c0 2023-12-19T05:41:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.559+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f0061910 con 0x7fe3d00047c0 2023-12-19T05:41:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.560+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe3e0003b00 con 0x7fe3d00047c0 2023-12-19T05:41:30.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.562+0000 7fe3e7fff640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:30.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.563+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3e00887b0 con 0x7fe3d00047c0 2023-12-19T05:41:30.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.563+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7fe3d4071f90 con 0x7fe3d00047c0 2023-12-19T05:41:30.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.563+0000 7fe3e659c640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:30.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.564+0000 7fe3e659c640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 0x7fe3d406c920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8034000 tx=0x7fe3d8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:30.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.567+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3e0053e30 con 0x7fe3d00047c0 2023-12-19T05:41:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.762+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe3f00ceaf0 con 0x7fe3d00047c0 2023-12-19T05:41:30.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.766+0000 7fe3e7fff640 1 -- 172.21.15.49:0/351403054 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+33691 (secure 0 0 0) 0x7fe3e0001230 con 0x7fe3d00047c0 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 51, 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:29.319873+0000", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:30.768 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:30.769 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:30.770 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:30.771 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:30.772 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:30.773 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.774 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:30.775 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:30.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:30.777 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:30.778 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:30.780 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:30.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:30.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:30.783 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:30.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:30.785 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:30.786 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.787 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.788 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.789 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:30.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.792 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.793 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.794 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:30.795 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.799 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:30.800 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.802 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:30.805 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:30.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:30.812 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.813 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.817 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:30.822 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:30.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:30.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:30.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.828 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.829 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.830 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:30.832 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:30.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:30.834 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:30.835 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 msgr2=0x7fe3d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 0x7fe3d406c920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8034000 tx=0x7fe3d8009030 comp rx=0 tx=0).stop 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 msgr2=0x7fe3f01e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000d570 tx=0x7fe3e000da30 comp rx=0 tx=0).stop 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 shutdown_connections 2023-12-19T05:41:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3f00cddb0 0x7fe3f00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3f01f5910 0x7fe3f01e5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 --2- 172.21.15.49:0/351403054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3d00047c0 0x7fe3f01e3bb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.768+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 >> 172.21.15.49:0/351403054 conn(0x7fe3f00cbb70 msgr2=0x7fe3f014cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.769+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 shutdown_connections 2023-12-19T05:41:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:30.769+0000 7fe3f50e7640 1 -- 172.21.15.49:0/351403054 wait complete. 2023-12-19T05:41:30.839 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:31.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.077+0000 7f71b88ca640 1 Processor -- start 2023-12-19T05:41:31.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.077+0000 7f71b88ca640 1 -- start start 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71b88ca640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71b40b0810 0x7f71b4164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71b88ca640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40ae640 con 0x7f71b40ae110 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71b88ca640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40ae920 con 0x7f71b4157bf0 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71b88ca640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b406b8c0 con 0x7f71b40b0810 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71abfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71b40ae110 0x7f71b40b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46176/0 (socket says 172.21.15.49:46176) 2023-12-19T05:41:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.079+0000 7f71abfff640 1 -- 172.21.15.49:0/1604273636 learned_addr learned my addr 172.21.15.49:0/1604273636 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:31.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b2d9d640 1 --2- 172.21.15.49:0/1604273636 >> v2:172.21.15.115:3300/0 conn(0x7f71b40b0810 0x7f71b4164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275518943 0 0) 0x7f71b40ae640 con 0x7f71b40ae110 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a0003520 con 0x7f71b40ae110 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170402024 0 0) 0x7f71a0003520 con 0x7f71b40ae110 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 >> v2:172.21.15.115:3300/0 conn(0x7f71b40b0810 msgr2=0x7f71b4164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 --2- 172.21.15.49:0/1604273636 >> v2:172.21.15.115:3300/0 conn(0x7f71b40b0810 0x7f71b4164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 >> v1:172.21.15.115:6789/0 conn(0x7f71b4157bf0 legacy=0x7f71b415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40aec00 con 0x7f71b40ae110 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f719c001670 con 0x7f71b40ae110 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 >> v1:172.21.15.49:6789/0 conn(0x7f71b40ae110 legacy=0x7f71b40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a0003a30 0x7f71a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 0x7f71a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00051d0 0x7f71a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.080+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b406b8c0 con 0x7f71a00047c0 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a000c100 con 0x7f71a0003a30 2023-12-19T05:41:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a000c2c0 con 0x7f71a00051d0 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 0x7f71a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71b259c640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a0003a30 0x7f71a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 -- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00051d0 msgr2=0x7f71a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71b2d9d640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00051d0 0x7f71a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00051d0 0x7f71a000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 -- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a0003a30 msgr2=0x7f71a0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a0003a30 0x7f71a0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71abfff640 1 -- 172.21.15.49:0/1604273636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0003520 con 0x7f71a00047c0 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.081+0000 7f71b2d9d640 1 -- 172.21.15.49:0/1604273636 reap_dead start 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.082+0000 7f71abfff640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 0x7f71a0004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c0e0 tx=0x7f71a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d762fc25e9aa52f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c005ad0 con 0x7f71a00047c0 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c005c30 con 0x7f71a00047c0 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b1d9b640 1 -- 172.21.15.49:0/1604273636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0072b0 con 0x7f71a00047c0 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 -- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 msgr2=0x7f71a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 0x7f71a0004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c0e0 tx=0x7f71a00057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 -- 172.21.15.49:0/1604273636 shutdown_connections 2023-12-19T05:41:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1604273636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71a00047c0 0x7f71a0004c40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 -- 172.21.15.49:0/1604273636 >> 172.21.15.49:0/1604273636 conn(0x7f71b40cbb70 msgr2=0x7f71b40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:31.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.083+0000 7f71b88ca640 1 -- 172.21.15.49:0/1604273636 shutdown_connections 2023-12-19T05:41:31.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.084+0000 7f71b88ca640 1 -- 172.21.15.49:0/1604273636 wait complete. 2023-12-19T05:41:31.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.085+0000 7f71b88ca640 1 Processor -- start 2023-12-19T05:41:31.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.086+0000 7f71b88ca640 1 -- start start 2023-12-19T05:41:31.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00047c0 0x7f71b414ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 0x7f71b415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b414b140 con 0x7f71b414b460 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41585d0 con 0x7f71b415b6b0 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b88ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4158840 con 0x7f71a00047c0 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60004/0 (socket says 172.21.15.49:60004) 2023-12-19T05:41:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 -- 172.21.15.49:0/1669074913 learned_addr learned my addr 172.21.15.49:0/1669074913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b259c640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00047c0 0x7f71b414ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71b2d9d640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 0x7f71b415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 -- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00047c0 msgr2=0x7f71b414ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00047c0 0x7f71b414ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 -- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 msgr2=0x7f71b415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.087+0000 7f71abfff640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 0x7f71b415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71abfff640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4158b20 con 0x7f71b414b460 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71b2d9d640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 0x7f71b415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71abfff640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c0e0 tx=0x7f719c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c03c040 con 0x7f71b414b460 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c007560 con 0x7f71b414b460 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c02c770 con 0x7f71b414b460 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4158e00 con 0x7f71b414b460 2023-12-19T05:41:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.088+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b414e320 con 0x7f71b414b460 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.090+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4061910 con 0x7f71b414b460 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.091+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f719c032070 con 0x7f71b414b460 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.092+0000 7f71aaffd640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 0x7f719406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.092+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f719c0a9e10 con 0x7f71b414b460 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.092+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f7194071f60 con 0x7f71b414b460 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.092+0000 7f71b259c640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 0x7f719406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.093+0000 7f71b259c640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 0x7f719406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005490 tx=0x7f71a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.096+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f719c075400 con 0x7f71b414b460 2023-12-19T05:41:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.329+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b406cad0 con 0x7f71b414b460 2023-12-19T05:41:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.330+0000 7f71aaffd640 1 -- 172.21.15.49:0/1669074913 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f719c07c020 con 0x7f71b414b460 2023-12-19T05:41:31.332 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:31.332 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 msgr2=0x7f719406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 0x7f719406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005490 tx=0x7f71a4009040 comp rx=0 tx=0).stop 2023-12-19T05:41:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 msgr2=0x7f71b415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c0e0 tx=0x7f719c02e070 comp rx=0 tx=0).stop 2023-12-19T05:41:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 shutdown_connections 2023-12-19T05:41:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719406a430 0x7f719406c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b415b6b0 0x7f71b415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71b414b460 0x7f71b415b170 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 --2- 172.21.15.49:0/1669074913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71a00047c0 0x7f71b414ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.333+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 >> 172.21.15.49:0/1669074913 conn(0x7f71b40cbb70 msgr2=0x7f71b41554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.334+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 shutdown_connections 2023-12-19T05:41:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:31.334+0000 7f71b88ca640 1 -- 172.21.15.49:0/1669074913 wait complete. 2023-12-19T05:41:31.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T05:41:31.601 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":5541,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.604232645,"mdsmap_epoch":24,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":34.094073232} 2023-12-19T05:41:31.601 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 5541, "mdsmap_epoch": 24, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 28.604232645, "state": "up:active", "uptime": 34.094073232, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:41:31.601 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:41:31.601 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:31.602 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:31.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:31.662 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-19T05:41:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-19T05:41:31.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:41:31.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:31.719 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T05:41:31.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:31.780 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T05:41:31.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:32.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.176+0000 7f600759e640 1 Processor -- start 2023-12-19T05:41:32.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.177+0000 7f600759e640 1 -- start start 2023-12-19T05:41:32.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f60080b8070 0x7f60080d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60080d0a90 0x7f600815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60080d12d0 con 0x7f6008146e30 2023-12-19T05:41:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008147210 con 0x7f60080d0a90 2023-12-19T05:41:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60080d2370 con 0x7f60080b8070 2023-12-19T05:41:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6008146e30 0x7f60080b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46186/0 (socket says 172.21.15.49:46186) 2023-12-19T05:41:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.178+0000 7f600659c640 1 -- 172.21.15.49:0/1916313093 learned_addr learned my addr 172.21.15.49:0/1916313093 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1916313093 >> v2:172.21.15.49:3300/0 conn(0x7f60080d0a90 0x7f600815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f600559a640 1 -- 172.21.15.49:0/1916313093 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174640419 0 0) 0x7f60080d12d0 con 0x7f6008146e30 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6005d9b640 1 --2- 172.21.15.49:0/1916313093 >> v2:172.21.15.115:3300/0 conn(0x7f60080b8070 0x7f60080d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f600559a640 1 -- 172.21.15.49:0/1916313093 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4003520 con 0x7f6008146e30 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6006d9d640 1 -- 172.21.15.49:0/1916313093 >> v2:172.21.15.115:3300/0 conn(0x7f60080b8070 msgr2=0x7f60080d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1916313093 >> v2:172.21.15.115:3300/0 conn(0x7f60080b8070 0x7f60080d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6006d9d640 1 -- 172.21.15.49:0/1916313093 >> v1:172.21.15.49:6789/0 conn(0x7f6008146e30 legacy=0x7f60080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.179+0000 7f6006d9d640 1 -- 172.21.15.49:0/1916313093 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080d15b0 con 0x7f60080d0a90 2023-12-19T05:41:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.180+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1916313093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080d0a90 0x7f600815d870 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f60080b6450 tx=0x7f600002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116180756aeb95f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.180+0000 7f600559a640 1 -- 172.21.15.49:0/1916313093 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600002e070 con 0x7f60080d0a90 2023-12-19T05:41:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.180+0000 7f600559a640 1 -- 172.21.15.49:0/1916313093 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60000315a0 con 0x7f60080d0a90 2023-12-19T05:41:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.180+0000 7f600559a640 1 -- 172.21.15.49:0/1916313093 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000031930 con 0x7f60080d0a90 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 -- 172.21.15.49:0/1916313093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080d0a90 msgr2=0x7f600815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 --2- 172.21.15.49:0/1916313093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080d0a90 0x7f600815d870 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f60080b6450 tx=0x7f600002b840 comp rx=0 tx=0).stop 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 -- 172.21.15.49:0/1916313093 shutdown_connections 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 --2- 172.21.15.49:0/1916313093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080d0a90 0x7f600815d870 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 --2- 172.21.15.49:0/1916313093 >> v2:172.21.15.115:3300/0 conn(0x7f60080b8070 0x7f60080d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 -- 172.21.15.49:0/1916313093 >> 172.21.15.49:0/1916313093 conn(0x7f60080b2990 msgr2=0x7f60080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 -- 172.21.15.49:0/1916313093 shutdown_connections 2023-12-19T05:41:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.181+0000 7f600759e640 1 -- 172.21.15.49:0/1916313093 wait complete. 2023-12-19T05:41:32.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.183+0000 7f600759e640 1 Processor -- start 2023-12-19T05:41:32.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.183+0000 7f600759e640 1 -- start start 2023-12-19T05:41:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b8070 0x7f600813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60080d0a90 0x7f6008145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600813e170 con 0x7f6008146e30 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600813e930 con 0x7f60080d0a90 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.184+0000 7f600759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600813f4b0 con 0x7f60080b8070 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60022/0 (socket says 172.21.15.49:60022) 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 -- 172.21.15.49:0/1709417834 learned_addr learned my addr 172.21.15.49:0/1709417834 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f600659c640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b8070 0x7f600813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6005d9b640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60080d0a90 0x7f6008145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 -- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b8070 msgr2=0x7f600813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b8070 0x7f600813dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 -- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60080d0a90 msgr2=0x7f6008145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60080d0a90 0x7f6008145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.185+0000 7f6006d9d640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009400 con 0x7f6008146e30 2023-12-19T05:41:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f6006d9d640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f60000098c0 tx=0x7f60000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000032840 con 0x7f6008146e30 2023-12-19T05:41:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60000329a0 con 0x7f6008146e30 2023-12-19T05:41:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000032d50 con 0x7f6008146e30 2023-12-19T05:41:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600813eb80 con 0x7f6008146e30 2023-12-19T05:41:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.186+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600813f140 con 0x7f6008146e30 2023-12-19T05:41:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.187+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6008061910 con 0x7f6008146e30 2023-12-19T05:41:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.188+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60000453f0 con 0x7f6008146e30 2023-12-19T05:41:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.189+0000 7f5ffeffd640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.189+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60000aabe0 con 0x7f6008146e30 2023-12-19T05:41:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.190+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f5fe8071f90 con 0x7f6008146e30 2023-12-19T05:41:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.190+0000 7f600659c640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.191+0000 7f600659c640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 0x7f5fe806c920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001560 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.193+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6000076250 con 0x7f6008146e30 2023-12-19T05:41:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.396+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f600813f5f0 con 0x7f6008146e30 2023-12-19T05:41:32.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.399+0000 7f5ffeffd640 1 -- 172.21.15.49:0/1709417834 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+33691 (secure 0 0 0) 0x7f6000079870 con 0x7f6008146e30 2023-12-19T05:41:32.401 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 51, 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:29.319873+0000", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:32.402 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:32.403 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:32.404 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:32.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:32.406 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:32.407 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:32.408 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.409 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:32.410 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:32.411 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:32.412 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:32.413 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:32.414 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:32.415 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:32.416 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:32.417 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.418 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:32.419 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:32.420 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:32.421 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:32.422 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.423 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.425 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.429 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:32.430 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.431 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.434 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:32.435 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.436 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:32.440 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.441 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:32.442 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.445 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.446 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.448 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.450 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.451 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.452 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.454 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.455 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.456 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:32.457 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:32.460 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:32.461 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.462 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:32.463 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.464 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.465 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.466 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:32.467 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:32.468 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:32.469 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 msgr2=0x7f5fe806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 0x7f5fe806c920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001560 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 msgr2=0x7f6008145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f60000098c0 tx=0x7f60000046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 shutdown_connections 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6008146e30 0x7f6008145970 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60080d0a90 0x7f6008145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 --2- 172.21.15.49:0/1709417834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b8070 0x7f600813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 >> 172.21.15.49:0/1709417834 conn(0x7f60080b2990 msgr2=0x7f60081e8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.402+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 shutdown_connections 2023-12-19T05:41:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:32.403+0000 7f600759e640 1 -- 172.21.15.49:0/1709417834 wait complete. 2023-12-19T05:41:32.472 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:41:35.206 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:41:35.205+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-19T05:41:37.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:37.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.715+0000 7f4ec0a25640 1 Processor -- start 2023-12-19T05:41:37.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.716+0000 7f4ec0a25640 1 -- start start 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ec0a25640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ebc0b8070 0x7f4ebc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ec0a25640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ebc0d0a90 0x7f4ebc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ec0a25640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc0d12d0 con 0x7f4ebc146e30 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ec0a25640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc147210 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ec0a25640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0d2370 con 0x7f4ebc0b8070 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ebb59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ebc0d0a90 0x7f4ebc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ebb59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ebc0d0a90 0x7f4ebc15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52190/0 (socket says 172.21.15.49:52190) 2023-12-19T05:41:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.717+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3798718099 learned_addr learned my addr 172.21.15.49:0/3798718099 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.718+0000 7f4eba59c640 1 --2- 172.21.15.49:0/3798718099 >> v2:172.21.15.115:3300/0 conn(0x7f4ebc0b8070 0x7f4ebc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.718+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3798718099 >> v2:172.21.15.115:3300/0 conn(0x7f4ebc0b8070 msgr2=0x7f4ebc0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.718+0000 7f4ebb59e640 1 --2- 172.21.15.49:0/3798718099 >> v2:172.21.15.115:3300/0 conn(0x7f4ebc0b8070 0x7f4ebc0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.718+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3798718099 >> v1:172.21.15.115:6789/0 conn(0x7f4ebc146e30 legacy=0x7f4ebc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.718+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3798718099 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0d15b0 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.719+0000 7f4ebb59e640 1 --2- 172.21.15.49:0/3798718099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc15d870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0b6450 tx=0x7f4eb402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed73f4d8f9e9e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.719+0000 7f4eb9d9b640 1 -- 172.21.15.49:0/3798718099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40317e0 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4eb9d9b640 1 -- 172.21.15.49:0/3798718099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb4031940 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4eb9d9b640 1 -- 172.21.15.49:0/3798718099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4031cd0 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3798718099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc0d0a90 msgr2=0x7f4ebc15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3798718099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc15d870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0b6450 tx=0x7f4eb402b880 comp rx=0 tx=0).stop 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3798718099 shutdown_connections 2023-12-19T05:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3798718099 >> v2:172.21.15.115:3300/0 conn(0x7f4ebc0b8070 0x7f4ebc0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3798718099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc15d870 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3798718099 >> 172.21.15.49:0/3798718099 conn(0x7f4ebc0b2990 msgr2=0x7f4ebc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3798718099 shutdown_connections 2023-12-19T05:41:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.720+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3798718099 wait complete. 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.722+0000 7f4ec0a25640 1 Processor -- start 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.722+0000 7f4ec0a25640 1 -- start start 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ebc0b8070 0x7f4ebc1e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc1f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc13e930 con 0x7f4ebc146e30 2023-12-19T05:41:37.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc1df1b0 con 0x7f4ebc0d0a90 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.723+0000 7f4ec0a25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc1e7840 con 0x7f4ebc0b8070 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52206/0 (socket says 172.21.15.49:52206) 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3986123000 learned_addr learned my addr 172.21.15.49:0/3986123000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebad9d640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ebc0b8070 0x7f4ebc1e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4eba59c640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc1f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ebc0b8070 msgr2=0x7f4ebc1e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ebc0b8070 0x7f4ebc1e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ebc0d0a90 msgr2=0x7f4ebc1f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc1f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.724+0000 7f4ebb59e640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40094d0 con 0x7f4ebc146e30 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4ebb59e640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40097f0 tx=0x7f4eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4032880 con 0x7f4ebc146e30 2023-12-19T05:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40329e0 con 0x7f4ebc146e30 2023-12-19T05:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4032d90 con 0x7f4ebc146e30 2023-12-19T05:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc140530 con 0x7f4ebc146e30 2023-12-19T05:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.725+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc143600 con 0x7f4ebc146e30 2023-12-19T05:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.726+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc061910 con 0x7f4ebc146e30 2023-12-19T05:41:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.727+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4eb404e450 con 0x7f4ebc146e30 2023-12-19T05:41:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.728+0000 7f4eb37fe640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 0x7f4e9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.728+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4eb40aa990 con 0x7f4ebc146e30 2023-12-19T05:41:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.729+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f4e9c071f90 con 0x7f4ebc146e30 2023-12-19T05:41:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.729+0000 7f4ebad9d640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 0x7f4e9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.730+0000 7f4ebad9d640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 0x7f4e9c06c920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009f20 tx=0x7f4eac0094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.733+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4eb40760c0 con 0x7f4ebc146e30 2023-12-19T05:41:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.926+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4ebc1406c0 con 0x7f4ebc146e30 2023-12-19T05:41:37.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.930+0000 7f4eb37fe640 1 -- 172.21.15.49:0/3986123000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+33539 (secure 0 0 0) 0x7f4eb40796e0 con 0x7f4ebc146e30 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 55, 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:37.397801+0000", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:37.932 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:37.933 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:37.934 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:37.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:37.936 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:37.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:37.938 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:37.939 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:37.940 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:37.941 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:37.942 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:37.943 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:37.944 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:37.945 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:41:37.946 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:37.947 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "50", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:37.948 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:37.949 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:37.950 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:37.951 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.957 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.958 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.959 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.960 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.962 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.963 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.964 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.965 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:37.966 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:37.967 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.968 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.969 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.972 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.974 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.976 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.977 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:37.978 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.981 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:37.983 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.984 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.989 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:37.990 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.991 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.992 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:37.993 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:37.994 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.995 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.996 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.998 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:37.999 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:38.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:38.001 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:38.002 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.932+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 msgr2=0x7f4e9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.932+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 0x7f4e9c06c920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009f20 tx=0x7f4eac0094d0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.932+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 msgr2=0x7f4ebc1d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.932+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40097f0 tx=0x7f4eb40046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 shutdown_connections 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4e9c06a460 0x7f4e9c06c920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ebc146e30 0x7f4ebc1d1530 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ebc0d0a90 0x7f4ebc1f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 --2- 172.21.15.49:0/3986123000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ebc0b8070 0x7f4ebc1e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 >> 172.21.15.49:0/3986123000 conn(0x7f4ebc0b2990 msgr2=0x7f4ebc1e3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 shutdown_connections 2023-12-19T05:41:38.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:37.933+0000 7f4ec0a25640 1 -- 172.21.15.49:0/3986123000 wait complete. 2023-12-19T05:41:38.005 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:41:43.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.245+0000 7f13355c4640 1 Processor -- start 2023-12-19T05:41:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.246+0000 7f13355c4640 1 -- start start 2023-12-19T05:41:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.247+0000 7f13355c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f13300d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f13355c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13300d0a90 0x7f133015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f13355c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300d12d0 con 0x7f1330146e30 2023-12-19T05:41:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f13355c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1330147210 con 0x7f13300d0a90 2023-12-19T05:41:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f13355c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13300d2370 con 0x7f13300b8070 2023-12-19T05:41:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f132ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1330146e30 0x7f13300b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40596/0 (socket says 172.21.15.49:40596) 2023-12-19T05:41:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f132ffff640 1 -- 172.21.15.49:0/2170900336 learned_addr learned my addr 172.21.15.49:0/2170900336 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183543338 0 0) 0x7f13300d12d0 con 0x7f1330146e30 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f1327fff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f13300d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f131c003520 con 0x7f1330146e30 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.248+0000 7f1334dc3640 1 --2- 172.21.15.49:0/2170900336 >> v2:172.21.15.115:3300/0 conn(0x7f13300d0a90 0x7f133015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438639409 0 0) 0x7f131c003520 con 0x7f1330146e30 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 msgr2=0x7f13300d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f13300d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 >> v2:172.21.15.115:3300/0 conn(0x7f13300d0a90 msgr2=0x7f133015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 --2- 172.21.15.49:0/2170900336 >> v2:172.21.15.115:3300/0 conn(0x7f13300d0a90 0x7f133015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300d15b0 con 0x7f1330146e30 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1320001670 con 0x7f1330146e30 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 >> v1:172.21.15.49:6789/0 conn(0x7f1330146e30 legacy=0x7f13300b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f131c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f131c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f131c004d00 0x7f131c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330147210 con 0x7f131c0039a0 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300d2370 con 0x7f131c004d00 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c00ba30 con 0x7f13300b8070 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.249+0000 7f132ffff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f131c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f1327fff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f131c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f1334dc3640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f131c004d00 0x7f131c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f132ffff640 1 -- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 msgr2=0x7f131c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f132ffff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f131c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f132ffff640 1 -- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f131c004d00 msgr2=0x7f131c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f132ffff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f131c004d00 0x7f131c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f132ffff640 1 -- 172.21.15.49:0/2170900336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c003520 con 0x7f131c0039a0 2023-12-19T05:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f1327fff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13300b8070 0x7f131c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.250+0000 7f1334dc3640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f131c004d00 0x7f131c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.251+0000 7f132ffff640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f131c003dc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f132000c0e0 tx=0x7f131c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eae5b0016f9fdf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.251+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320005ad0 con 0x7f131c0039a0 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1320005c50 con 0x7f131c0039a0 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f132f7fe640 1 -- 172.21.15.49:0/2170900336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132002c810 con 0x7f131c0039a0 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 -- 172.21.15.49:0/2170900336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 msgr2=0x7f131c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 --2- 172.21.15.49:0/2170900336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f131c003dc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f132000c0e0 tx=0x7f131c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f1334dc3640 1 -- 172.21.15.49:0/2170900336 reap_dead start 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 -- 172.21.15.49:0/2170900336 shutdown_connections 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 -- 172.21.15.49:0/2170900336 >> 172.21.15.49:0/2170900336 conn(0x7f13300b2990 msgr2=0x7f13300b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 -- 172.21.15.49:0/2170900336 shutdown_connections 2023-12-19T05:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.252+0000 7f13355c4640 1 -- 172.21.15.49:0/2170900336 wait complete. 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.254+0000 7f13355c4640 1 Processor -- start 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.254+0000 7f13355c4640 1 -- start start 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 0x7f133013dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13301f5da0 0x7f13301f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330140de0 con 0x7f131c0039a0 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300c8f00 con 0x7f1330143040 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.255+0000 7f13355c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13300c8c20 con 0x7f13301f5da0 2023-12-19T05:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52224/0 (socket says 172.21.15.49:52224) 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 -- 172.21.15.49:0/2261149426 learned_addr learned my addr 172.21.15.49:0/2261149426 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f1334dc3640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13301f5da0 0x7f13301f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f1327fff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 0x7f133013dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 -- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13301f5da0 msgr2=0x7f13301f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13301f5da0 0x7f13301f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 -- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 msgr2=0x7f133013dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 0x7f133013dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f132ffff640 1 -- 172.21.15.49:0/2261149426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330140720 con 0x7f131c0039a0 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.256+0000 7f1327fff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 0x7f133013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f132ffff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f132000c200 tx=0x7f1320001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320039070 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132002cc20 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132003c040 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1330140a00 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.257+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13301f6790 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.258+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1330140580 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.259+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1320032070 con 0x7f131c0039a0 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.260+0000 7f132d7fa640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 0x7f131006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.260+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13200a9cf0 con 0x7f131c0039a0 2023-12-19T05:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.261+0000 7f1327fff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 0x7f131006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.262+0000 7f1327fff640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 0x7f131006c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f13301401d0 tx=0x7f1318008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.265+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1330140580 con 0x7f131c0039a0 2023-12-19T05:41:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.461+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1330140580 con 0x7f131c0039a0 2023-12-19T05:41:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.463+0000 7f132d7fa640 1 -- 172.21.15.49:0/2261149426 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+33476 (secure 0 0 0) 0x7f1330140580 con 0x7f131c0039a0 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 56, 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:38.407362+0000", 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:43.465 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:43.466 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:43.467 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:43.468 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:43.469 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:43.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:43.471 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.472 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:43.473 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:43.474 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:43.475 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:43.477 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:43.478 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:43.479 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.480 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:43.481 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:43.482 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:43.483 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:43.484 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.485 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:43.488 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.489 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.490 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.491 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.493 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.495 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.496 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.497 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.498 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:43.499 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:43.500 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.501 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:43.503 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.503 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.503 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.503 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.504 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.507 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.509 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:43.510 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.511 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.512 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:43.515 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.516 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.517 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.518 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.519 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.520 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:43.522 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.524 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.527 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.529 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:43.532 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:43.533 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:43.534 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:43.535 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:43.535 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:43.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:43.535 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 msgr2=0x7f131006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 0x7f131006c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f13301401d0 tx=0x7f1318008040 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 msgr2=0x7f133013d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f132000c200 tx=0x7f1320001930 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 shutdown_connections 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f131006a430 0x7f131006c8f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13301f5da0 0x7f13301f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1330143040 0x7f133013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 --2- 172.21.15.49:0/2261149426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f131c0039a0 0x7f133013d790 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 >> 172.21.15.49:0/2261149426 conn(0x7f13300b2990 msgr2=0x7f13300b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 shutdown_connections 2023-12-19T05:41:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.466+0000 7f13355c4640 1 -- 172.21.15.49:0/2261149426 wait complete. 2023-12-19T05:41:43.538 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T05:41:43.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:41:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.775+0000 7f5e5f48b640 1 Processor -- start 2023-12-19T05:41:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.775+0000 7f5e5f48b640 1 -- start start 2023-12-19T05:41:43.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5f48b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 0x7f5e5806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5f48b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e5815e040 0x7f5e5815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5f48b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5815e9f0 con 0x7f5e58157aa0 2023-12-19T05:41:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5f48b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580b2600 con 0x7f5e5815e040 2023-12-19T05:41:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5f48b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580b1d60 con 0x7f5e580b1710 2023-12-19T05:41:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5d227640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5e58157aa0 0x7f5e58161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40600/0 (socket says 172.21.15.49:40600) 2023-12-19T05:41:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5d227640 1 -- 172.21.15.49:0/879413992 learned_addr learned my addr 172.21.15.49:0/879413992 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.777+0000 7f5e5da28640 1 --2- 172.21.15.49:0/879413992 >> v2:172.21.15.49:3300/0 conn(0x7f5e5815e040 0x7f5e5815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5ca26640 1 --2- 172.21.15.49:0/879413992 >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 0x7f5e5806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e4ffff640 1 -- 172.21.15.49:0/879413992 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93288063 0 0) 0x7f5e5815e9f0 con 0x7f5e58157aa0 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e4ffff640 1 -- 172.21.15.49:0/879413992 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e44003520 con 0x7f5e58157aa0 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5da28640 1 -- 172.21.15.49:0/879413992 >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 msgr2=0x7f5e5806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5da28640 1 --2- 172.21.15.49:0/879413992 >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 0x7f5e5806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5da28640 1 -- 172.21.15.49:0/879413992 >> v1:172.21.15.49:6789/0 conn(0x7f5e58157aa0 legacy=0x7f5e58161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5da28640 1 -- 172.21.15.49:0/879413992 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580b2040 con 0x7f5e5815e040 2023-12-19T05:41:43.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.778+0000 7f5e5ca26640 1 --2- 172.21.15.49:0/879413992 >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 0x7f5e5806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.779+0000 7f5e5da28640 1 --2- 172.21.15.49:0/879413992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5815e040 0x7f5e5815e4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806db00 tx=0x7f5e5002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31bf6d57568554f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.779+0000 7f5e4ffff640 1 -- 172.21.15.49:0/879413992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5002cc70 con 0x7f5e5815e040 2023-12-19T05:41:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e4ffff640 1 -- 172.21.15.49:0/879413992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5002cdd0 con 0x7f5e5815e040 2023-12-19T05:41:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e4ffff640 1 -- 172.21.15.49:0/879413992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50034660 con 0x7f5e5815e040 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 -- 172.21.15.49:0/879413992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5815e040 msgr2=0x7f5e5815e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/879413992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5815e040 0x7f5e5815e4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806db00 tx=0x7f5e5002bec0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 -- 172.21.15.49:0/879413992 shutdown_connections 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/879413992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5815e040 0x7f5e5815e4b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/879413992 >> v2:172.21.15.115:3300/0 conn(0x7f5e580b1710 0x7f5e5806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 -- 172.21.15.49:0/879413992 >> 172.21.15.49:0/879413992 conn(0x7f5e580cbb70 msgr2=0x7f5e580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 -- 172.21.15.49:0/879413992 shutdown_connections 2023-12-19T05:41:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.780+0000 7f5e5f48b640 1 -- 172.21.15.49:0/879413992 wait complete. 2023-12-19T05:41:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.782+0000 7f5e5f48b640 1 Processor -- start 2023-12-19T05:41:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.782+0000 7f5e5f48b640 1 -- start start 2023-12-19T05:41:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e580b1710 0x7f5e580704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e5815e040 0x7f5e5806cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806bbf0 con 0x7f5e58157aa0 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806bed0 con 0x7f5e580b1710 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.783+0000 7f5e5f48b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806c1b0 con 0x7f5e5815e040 2023-12-19T05:41:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5d227640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e580b1710 0x7f5e580704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52230/0 (socket says 172.21.15.49:52230) 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 -- 172.21.15.49:0/990303009 learned_addr learned my addr 172.21.15.49:0/990303009 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5da28640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e5815e040 0x7f5e5806cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 -- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e5815e040 msgr2=0x7f5e5806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e5815e040 0x7f5e5806cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 -- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e580b1710 msgr2=0x7f5e580704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e580b1710 0x7f5e580704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.784+0000 7f5e5ca26640 1 -- 172.21.15.49:0/990303009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50009a70 con 0x7f5e58157aa0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e5ca26640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e7e0 tx=0x7f5e4800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48004030 con 0x7f5e58157aa0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48004190 con 0x7f5e58157aa0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48004520 con 0x7f5e58157aa0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5806c490 con 0x7f5e58157aa0 2023-12-19T05:41:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.785+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5806b810 con 0x7f5e58157aa0 2023-12-19T05:41:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.786+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e58061910 con 0x7f5e58157aa0 2023-12-19T05:41:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.788+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e4800c6d0 con 0x7f5e58157aa0 2023-12-19T05:41:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.788+0000 7f5e4dffb640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 0x7f5e3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.789+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e480885f0 con 0x7f5e58157aa0 2023-12-19T05:41:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.789+0000 7f5e5d227640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 0x7f5e3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.790+0000 7f5e5d227640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 0x7f5e3c06c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e54005880 tx=0x7f5e54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:43.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.793+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e48053bf0 con 0x7f5e58157aa0 2023-12-19T05:41:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.988+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5e580af250 con 0x7f5e58157aa0 2023-12-19T05:41:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.992+0000 7f5e4dffb640 1 -- 172.21.15.49:0/990303009 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+33476 (secure 0 0 0) 0x7f5e48057210 con 0x7f5e58157aa0 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 56, 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:41:38.407362+0000", 2023-12-19T05:41:43.994 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:41:43.995 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:41:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:41:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:41:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:41:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 7, 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:41:43.997 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:43.998 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:43.999 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:41:44.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:44.001 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:44.003 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:44.004 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:44.005 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:41:44.006 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 6, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:01.033356+0000", 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:44.007 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:41:44.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:44.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:44.010 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:44.011 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:44.012 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 7, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:41:02.017190+0000", 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:41:44.014 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:41:44.015 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "56", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:41:44.016 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:41:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:41:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:41:44.019 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.020 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:41:44.021 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.023 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:41:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.025 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.026 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:41:44.030 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.034 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:41:44.035 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:44.036 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.037 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:41:44.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.042 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.043 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.044 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.045 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.046 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.047 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:41:44.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.051 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:41:44.055 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.056 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.061 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 46, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:41:44.062 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:41:44.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:41:44.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.066 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.067 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:41:44.070 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.071 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:41:44.072 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:41:44.073 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:41:44.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:41:44.075 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:41:44.075 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:41:44.075 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:41:44.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:41:44.075 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.994+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 msgr2=0x7f5e3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.994+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 0x7f5e3c06c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e54005880 tx=0x7f5e54009040 comp rx=0 tx=0).stop 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.994+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 msgr2=0x7f5e5815a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.994+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e7e0 tx=0x7f5e4800eca0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 shutdown_connections 2023-12-19T05:41:44.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5e3c06a430 0x7f5e3c06c8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e5815e040 0x7f5e5806cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e58157aa0 0x7f5e5815a780 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 --2- 172.21.15.49:0/990303009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e580b1710 0x7f5e580704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 >> 172.21.15.49:0/990303009 conn(0x7f5e580cbb70 msgr2=0x7f5e5806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 shutdown_connections 2023-12-19T05:41:44.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:43.995+0000 7f5e5f48b640 1 -- 172.21.15.49:0/990303009 wait complete. 2023-12-19T05:41:44.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.313+0000 7fa763fff640 1 Processor -- start 2023-12-19T05:41:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.314+0000 7fa763fff640 1 -- start start 2023-12-19T05:41:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.315+0000 7fa763fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa76415e5a0 0x7fa7640b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.315+0000 7fa763fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa7640b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.315+0000 7fa763fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76415ec30 con 0x7fa7640cdbf0 2023-12-19T05:41:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.315+0000 7fa763fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640b2cc0 con 0x7fa76415e5a0 2023-12-19T05:41:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.315+0000 7fa763fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415e980 con 0x7fa76415f680 2023-12-19T05:41:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa762ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa76415e5a0 0x7fa7640b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa7637fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7640cdbf0 0x7fa76406c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53374/0 (socket says 172.21.15.49:53374) 2023-12-19T05:41:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa7637fe640 1 -- 172.21.15.49:0/2025162221 learned_addr learned my addr 172.21.15.49:0/2025162221 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa75a7fc640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa7640b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa7627fc640 1 -- 172.21.15.49:0/2025162221 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242333946 0 0) 0x7fa76415ec30 con 0x7fa7640cdbf0 2023-12-19T05:41:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa762ffd640 1 -- 172.21.15.49:0/2025162221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 msgr2=0x7fa7640b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa762ffd640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa7640b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa762ffd640 1 -- 172.21.15.49:0/2025162221 >> v1:172.21.15.49:6789/0 conn(0x7fa7640cdbf0 legacy=0x7fa76406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.316+0000 7fa762ffd640 1 -- 172.21.15.49:0/2025162221 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640b2f90 con 0x7fa76415e5a0 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.317+0000 7fa762ffd640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa7640b2030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c902732a5ee688 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa7627fc640 1 -- 172.21.15.49:0/2025162221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75402cc50 con 0x7fa76415e5a0 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa7627fc640 1 -- 172.21.15.49:0/2025162221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75402cdb0 con 0x7fa76415e5a0 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa7627fc640 1 -- 172.21.15.49:0/2025162221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754034660 con 0x7fa76415e5a0 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 -- 172.21.15.49:0/2025162221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 msgr2=0x7fa7640b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa7640b2030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402bea0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 -- 172.21.15.49:0/2025162221 shutdown_connections 2023-12-19T05:41:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa7640b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 --2- 172.21.15.49:0/2025162221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa7640b2030 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 -- 172.21.15.49:0/2025162221 >> 172.21.15.49:0/2025162221 conn(0x7fa7640b0100 msgr2=0x7fa7640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 -- 172.21.15.49:0/2025162221 shutdown_connections 2023-12-19T05:41:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.318+0000 7fa763fff640 1 -- 172.21.15.49:0/2025162221 wait complete. 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.320+0000 7fa763fff640 1 Processor -- start 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.320+0000 7fa763fff640 1 -- start start 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.321+0000 7fa763fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7640cdbf0 0x7fa7641f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.321+0000 7fa763fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.321+0000 7fa763fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa764153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa763fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641f6c90 con 0x7fa76415e5a0 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa763fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641f5d00 con 0x7fa7640cdbf0 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa763fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641544a0 con 0x7fa76415f680 2023-12-19T05:41:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41440/0 (socket says 172.21.15.49:41440) 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 -- 172.21.15.49:0/4165819486 learned_addr learned my addr 172.21.15.49:0/4165819486 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa7637fe640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa764153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa762ffd640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7640cdbf0 0x7fa7641f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 -- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 msgr2=0x7fa764153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa764153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 -- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7640cdbf0 msgr2=0x7fa7641f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7640cdbf0 0x7fa7641f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.322+0000 7fa75a7fc640 1 -- 172.21.15.49:0/4165819486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009a70 con 0x7fa76415e5a0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa75a7fc640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00d5f0 tx=0x7fa74c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0125f0 con 0x7fa76415e5a0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c012750 con 0x7fa76415e5a0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa764154780 con 0x7fa76415e5a0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c012b00 con 0x7fa76415e5a0 2023-12-19T05:41:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.323+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7641f6230 con 0x7fa76415e5a0 2023-12-19T05:41:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.324+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764061910 con 0x7fa76415e5a0 2023-12-19T05:41:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.325+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa74c012c60 con 0x7fa76415e5a0 2023-12-19T05:41:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.326+0000 7fa75bfff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.326+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa74c088cd0 con 0x7fa76415e5a0 2023-12-19T05:41:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.327+0000 7fa762ffd640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:44.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.328+0000 7fa762ffd640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 0x7fa74406c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa754030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:44.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.330+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa74c054350 con 0x7fa76415e5a0 2023-12-19T05:41:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.564+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7640ce980 con 0x7fa76415e5a0 2023-12-19T05:41:44.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.566+0000 7fa75bfff640 1 -- 172.21.15.49:0/4165819486 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fa74c057970 con 0x7fa76415e5a0 2023-12-19T05:41:44.568 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:44.568 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:44.568 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:44.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 msgr2=0x7fa74406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 0x7fa74406c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa754030000 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 msgr2=0x7fa764150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00d5f0 tx=0x7fa74c00dab0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 shutdown_connections 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa76415f680 0x7fa764153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa76415e5a0 0x7fa764150c60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 --2- 172.21.15.49:0/4165819486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7640cdbf0 0x7fa7641f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 >> 172.21.15.49:0/4165819486 conn(0x7fa7640b0100 msgr2=0x7fa7640707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 shutdown_connections 2023-12-19T05:41:44.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:44.569+0000 7fa763fff640 1 -- 172.21.15.49:0/4165819486 wait complete. 2023-12-19T05:41:44.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T05:41:44.843 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":5541,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":41.845589494999999,"mdsmap_epoch":24,"osdmap_epoch":56,"osdmap_epoch_barrier":51,"uptime":47.335438467000003} 2023-12-19T05:41:44.844 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 5541, "mdsmap_epoch": 24, "osdmap_epoch": 56, "osdmap_epoch_barrier": 51, "rank_uptime": 41.845589495, "state": "up:active", "uptime": 47.335438467, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:41:44.844 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:41:44.844 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:44.844 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:44.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:44.902 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T05:41:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:41:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:41:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.409861 s, 128 MB/s 2023-12-19T05:41:45.373 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:41:45.373 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:41:45.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:41:45.620 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:41:45.621 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:45.621 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:45.685 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:45.685 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:45.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.978+0000 7f5f05751640 1 Processor -- start 2023-12-19T05:41:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.978+0000 7f5f05751640 1 -- start start 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.979+0000 7f5f05751640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5f00157bf0 0x7f5f0015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.979+0000 7f5f05751640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0015b740 con 0x7f5f000b0810 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.979+0000 7f5f05751640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000ae640 con 0x7f5f000ae110 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.979+0000 7f5f05751640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0006b8c0 con 0x7f5f00157bf0 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.980+0000 7f5eff7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f000b0810 0x7f5f0006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53382/0 (socket says 172.21.15.49:53382) 2023-12-19T05:41:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.980+0000 7f5eff7fe640 1 -- 172.21.15.49:0/1447722556 learned_addr learned my addr 172.21.15.49:0/1447722556 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.980+0000 7f5efeffd640 1 --2- 172.21.15.49:0/1447722556 >> v2:172.21.15.115:3300/0 conn(0x7f5f00157bf0 0x7f5f0015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.980+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985905962 0 0) 0x7f5f0015b740 con 0x7f5f000b0810 2023-12-19T05:41:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.980+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003520 con 0x7f5f000b0810 2023-12-19T05:41:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10212492 0 0) 0x7f5ee8003520 con 0x7f5f000b0810 2023-12-19T05:41:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 >> v2:172.21.15.115:3300/0 conn(0x7f5f00157bf0 msgr2=0x7f5f0015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 --2- 172.21.15.49:0/1447722556 >> v2:172.21.15.115:3300/0 conn(0x7f5f00157bf0 0x7f5f0015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 >> v1:172.21.15.115:6789/0 conn(0x7f5f000ae110 legacy=0x7f5f000b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000ae920 con 0x7f5f000b0810 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5ef80019f0 con 0x7f5f000b0810 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efeffd640 1 --2- 172.21.15.49:0/1447722556 >> v2:172.21.15.115:3300/0 conn(0x7f5f00157bf0 0x7f5f0015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 >> v1:172.21.15.49:6789/0 conn(0x7f5f000b0810 legacy=0x7f5f0006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ee8003a30 0x7f5ee8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ee80047c0 0x7f5ee8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5ee800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006b8c0 con 0x7f5ee80052a0 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800c1a0 con 0x7f5ee80047c0 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800c360 con 0x7f5ee8003a30 2023-12-19T05:41:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.981+0000 7f5eff7fe640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5ee800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5efe7fc640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ee80047c0 0x7f5ee8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5efeffd640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ee8003a30 0x7f5ee8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5eff7fe640 1 -- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ee8003a30 msgr2=0x7f5ee8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5eff7fe640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ee8003a30 0x7f5ee8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5eff7fe640 1 -- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ee80047c0 msgr2=0x7f5ee8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5eff7fe640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ee80047c0 0x7f5ee8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5eff7fe640 1 -- 172.21.15.49:0/1447722556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8003520 con 0x7f5ee80052a0 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5efe7fc640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ee80047c0 0x7f5ee8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.982+0000 7f5efeffd640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ee8003a30 0x7f5ee8003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.983+0000 7f5eff7fe640 1 -- 172.21.15.49:0/1447722556 reap_dead start 2023-12-19T05:41:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.983+0000 7f5eff7fe640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5ee800b980 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8002230 tx=0x7f5ee80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8485dc6ccfefd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.983+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8034630 con 0x7f5ee80052a0 2023-12-19T05:41:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.983+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef802f070 con 0x7f5ee80052a0 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.983+0000 7f5efdffb640 1 -- 172.21.15.49:0/1447722556 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80349d0 con 0x7f5ee80052a0 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 -- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 msgr2=0x7f5ee800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5ee800b980 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8002230 tx=0x7f5ee80057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 -- 172.21.15.49:0/1447722556 shutdown_connections 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 --2- 172.21.15.49:0/1447722556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5ee800b980 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 -- 172.21.15.49:0/1447722556 >> 172.21.15.49:0/1447722556 conn(0x7f5f000cbb70 msgr2=0x7f5f000cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 -- 172.21.15.49:0/1447722556 shutdown_connections 2023-12-19T05:41:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.984+0000 7f5f05751640 1 -- 172.21.15.49:0/1447722556 wait complete. 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.986+0000 7f5f05751640 1 Processor -- start 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.986+0000 7f5f05751640 1 -- start start 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f0014dac0 0x7f5f001eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f001ef1f0 0x7f5f001f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000cee10 con 0x7f5ee80052a0 2023-12-19T05:41:45.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f001ee580 con 0x7f5f001ef1f0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5f05751640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00070e80 con 0x7f5f0014dac0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5efeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5efeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41458/0 (socket says 172.21.15.49:41458) 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5efeffd640 1 -- 172.21.15.49:0/3382177518 learned_addr learned my addr 172.21.15.49:0/3382177518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.987+0000 7f5eff7fe640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f001ef1f0 0x7f5f001f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efe7fc640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f0014dac0 0x7f5f001eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 -- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f0014dac0 msgr2=0x7f5f001eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f0014dac0 0x7f5f001eecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 -- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f001ef1f0 msgr2=0x7f5f001f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f001ef1f0 0x7f5f001f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 -- 172.21.15.49:0/3382177518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000ce850 con 0x7f5ee80052a0 2023-12-19T05:41:45.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5efeffd640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000f550 tx=0x7f5ef000fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0014890 con 0x7f5ee80052a0 2023-12-19T05:41:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000c030 con 0x7f5ee80052a0 2023-12-19T05:41:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.988+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000ceb30 con 0x7f5ee80052a0 2023-12-19T05:41:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.989+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0014bf0 con 0x7f5ee80052a0 2023-12-19T05:41:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.989+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f00070ac0 con 0x7f5ee80052a0 2023-12-19T05:41:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.990+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f00061910 con 0x7f5ee80052a0 2023-12-19T05:41:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.991+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ef0014d50 con 0x7f5ee80052a0 2023-12-19T05:41:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.992+0000 7f5ee77fe640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 0x7f5eec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.992+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ef0088ce0 con 0x7f5ee80052a0 2023-12-19T05:41:45.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.992+0000 7f5efe7fc640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 0x7f5eec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.994+0000 7f5efe7fc640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 0x7f5eec06c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f000cb630 tx=0x7f5ef4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:45.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:45.997+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ef0054230 con 0x7f5ee80052a0 2023-12-19T05:41:46.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.192+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f0006de20 con 0x7f5ee80052a0 2023-12-19T05:41:46.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.195+0000 7f5ee77fe640 1 -- 172.21.15.49:0/3382177518 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5ef0057850 con 0x7f5ee80052a0 2023-12-19T05:41:46.196 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:46.196 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:38.407362+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.197+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 msgr2=0x7f5eec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.197+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 0x7f5eec06c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f000cb630 tx=0x7f5ef4009040 comp rx=0 tx=0).stop 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.197+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 msgr2=0x7f5f000702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.197+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000f550 tx=0x7f5ef000fa10 comp rx=0 tx=0).stop 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 shutdown_connections 2023-12-19T05:41:46.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eec06a460 0x7f5eec06c920 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f0014dac0 0x7f5f001eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f001ef1f0 0x7f5f001f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 --2- 172.21.15.49:0/3382177518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ee80052a0 0x7f5f000702a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 >> 172.21.15.49:0/3382177518 conn(0x7f5f000cbb70 msgr2=0x7f5f00156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 shutdown_connections 2023-12-19T05:41:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.198+0000 7f5f05751640 1 -- 172.21.15.49:0/3382177518 wait complete. 2023-12-19T05:41:46.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:41:01.033356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:41:02.017190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:41:46.219 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:41:46.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.450+0000 7f07198b6640 1 Processor -- start 2023-12-19T05:41:46.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.451+0000 7f07198b6640 1 -- start start 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.452+0000 7f07198b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0714146ff0 0x7f07140d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.452+0000 7f07198b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f071406fc40 0x7f071415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.452+0000 7f07198b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0714161e70 con 0x7f07140b6430 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.452+0000 7f07198b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0714161080 con 0x7f071406fc40 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.452+0000 7f07198b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0714161260 con 0x7f0714146ff0 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f071406fc40 0x7f071415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f071406fc40 0x7f071415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41460/0 (socket says 172.21.15.49:41460) 2023-12-19T05:41:46.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 -- 172.21.15.49:0/4215395943 learned_addr learned my addr 172.21.15.49:0/4215395943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:46.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f0712ffd640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0714146ff0 0x7f07140d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 -- 172.21.15.49:0/4215395943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0714146ff0 msgr2=0x7f07140d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0714146ff0 0x7f07140d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 -- 172.21.15.49:0/4215395943 >> v1:172.21.15.115:6789/0 conn(0x7f07140b6430 legacy=0x7f071406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.453+0000 7f07137fe640 1 -- 172.21.15.49:0/4215395943 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714161540 con 0x7f071406fc40 2023-12-19T05:41:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f07137fe640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f071415dd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d1ada68279243c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f0711ffb640 1 -- 172.21.15.49:0/4215395943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c031640 con 0x7f071406fc40 2023-12-19T05:41:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f0711ffb640 1 -- 172.21.15.49:0/4215395943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c0317a0 con 0x7f071406fc40 2023-12-19T05:41:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f0711ffb640 1 -- 172.21.15.49:0/4215395943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c031b30 con 0x7f071406fc40 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f07198b6640 1 -- 172.21.15.49:0/4215395943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 msgr2=0x7f071415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.455+0000 7f07198b6640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f071415dd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 -- 172.21.15.49:0/4215395943 shutdown_connections 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f071415dd40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 --2- 172.21.15.49:0/4215395943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0714146ff0 0x7f07140d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 -- 172.21.15.49:0/4215395943 >> 172.21.15.49:0/4215395943 conn(0x7f07140d3520 msgr2=0x7f07140d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 -- 172.21.15.49:0/4215395943 shutdown_connections 2023-12-19T05:41:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.456+0000 7f07198b6640 1 -- 172.21.15.49:0/4215395943 wait complete. 2023-12-19T05:41:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.458+0000 7f07198b6640 1 Processor -- start 2023-12-19T05:41:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.458+0000 7f07198b6640 1 -- start start 2023-12-19T05:41:46.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 0x7f07141f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0714146ff0 0x7f07140ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140ca280 con 0x7f071406fc40 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140c9670 con 0x7f0714146ff0 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07198b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140c9950 con 0x7f07140b6430 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f0712ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f0712ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41462/0 (socket says 172.21.15.49:41462) 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f0712ffd640 1 -- 172.21.15.49:0/3056588550 learned_addr learned my addr 172.21.15.49:0/3056588550 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:46.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.459+0000 7f07127fc640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 0x7f07141f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 -- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 msgr2=0x7f07141f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 0x7f07141f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 -- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0714146ff0 msgr2=0x7f07140ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0714146ff0 0x7f07140ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 -- 172.21.15.49:0/3056588550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c0094d0 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f07127fc640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 0x7f07141f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f0712ffd640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f070400ccd0 tx=0x7f070400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704003990 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704003af0 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07140c9c30 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704004020 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.460+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140c92f0 con 0x7f071406fc40 2023-12-19T05:41:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.462+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714061910 con 0x7f071406fc40 2023-12-19T05:41:46.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.463+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0704004180 con 0x7f071406fc40 2023-12-19T05:41:46.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.464+0000 7f070bfff640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 0x7f06f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.464+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0704088d90 con 0x7f071406fc40 2023-12-19T05:41:46.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.464+0000 7f07127fc640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 0x7f06f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.466+0000 7f07127fc640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 0x7f06f406c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f07140b8b00 tx=0x7f06fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.470+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07040542e0 con 0x7f071406fc40 2023-12-19T05:41:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.662+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07140b3d40 con 0x7f071406fc40 2023-12-19T05:41:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.663+0000 7f070bfff640 1 -- 172.21.15.49:0/3056588550 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f070401d020 con 0x7f071406fc40 2023-12-19T05:41:46.664 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:41:46.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 msgr2=0x7f06f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 0x7f06f406c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f07140b8b00 tx=0x7f06fc009040 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 msgr2=0x7f07140c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f070400ccd0 tx=0x7f070400a5c0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 shutdown_connections 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f06f406a430 0x7f06f406c8f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140b6430 0x7f07141f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0714146ff0 0x7f07140ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 --2- 172.21.15.49:0/3056588550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f071406fc40 0x7f07140c8db0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 >> 172.21.15.49:0/3056588550 conn(0x7f07140d3520 msgr2=0x7f07140b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 shutdown_connections 2023-12-19T05:41:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.666+0000 7f07198b6640 1 -- 172.21.15.49:0/3056588550 wait complete. 2023-12-19T05:41:46.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:41:46.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.923+0000 7fcc23fff640 1 Processor -- start 2023-12-19T05:41:46.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.923+0000 7fcc23fff640 1 -- start start 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.924+0000 7fcc23fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc24140360 0x7fcc240b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.924+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc24161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc23fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc24140740 con 0x7fcc240b5cd0 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc23fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc24143990 con 0x7fcc24140360 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240b8610 con 0x7fcc240b6130 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc227fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc240b5cd0 0x7fcc24160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53398/0 (socket says 172.21.15.49:53398) 2023-12-19T05:41:46.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc227fc640 1 -- 172.21.15.49:0/3969254672 learned_addr learned my addr 172.21.15.49:0/3969254672 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:46.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc22ffd640 1 --2- 172.21.15.49:0/3969254672 >> v2:172.21.15.115:3300/0 conn(0x7fcc24140360 0x7fcc240b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc237fe640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc24161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.925+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769056461 0 0) 0x7fcc24140740 con 0x7fcc240b5cd0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc0c003520 con 0x7fcc240b5cd0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597537907 0 0) 0x7fcc0c003520 con 0x7fcc240b5cd0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 msgr2=0x7fcc24161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc24161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 >> v2:172.21.15.115:3300/0 conn(0x7fcc24140360 msgr2=0x7fcc240b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 --2- 172.21.15.49:0/3969254672 >> v2:172.21.15.115:3300/0 conn(0x7fcc24140360 0x7fcc240b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24142e10 con 0x7fcc240b5cd0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fcc18001670 con 0x7fcc240b5cd0 2023-12-19T05:41:46.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 >> v1:172.21.15.49:6789/0 conn(0x7fcc240b5cd0 legacy=0x7fcc24160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0c003fb0 0x7fcc0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24143990 con 0x7fcc0c004d00 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240b8610 con 0x7fcc0c003fb0 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c00ba80 con 0x7fcc240b6130 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.926+0000 7fcc237fe640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc227fc640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0c003fb0 0x7fcc0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc22ffd640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc237fe640 1 -- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 msgr2=0x7fcc0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc237fe640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc240b6130 0x7fcc0c0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc237fe640 1 -- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0c003fb0 msgr2=0x7fcc0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:46.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc237fe640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0c003fb0 0x7fcc0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc237fe640 1 -- 172.21.15.49:0/3969254672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c003520 con 0x7fcc0c004d00 2023-12-19T05:41:46.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.927+0000 7fcc227fc640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0c003fb0 0x7fcc0c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:46.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.928+0000 7fcc237fe640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc0c005180 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009ac0 tx=0x7fcc0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1689da368e835006 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.928+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c02c6b0 con 0x7fcc0c004d00 2023-12-19T05:41:46.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.928+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c02c810 con 0x7fcc0c004d00 2023-12-19T05:41:46.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.928+0000 7fcc21ffb640 1 -- 172.21.15.49:0/3969254672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c02cba0 con 0x7fcc0c004d00 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 -- 172.21.15.49:0/3969254672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 msgr2=0x7fcc0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 --2- 172.21.15.49:0/3969254672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc0c005180 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009ac0 tx=0x7fcc0c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc237fe640 1 -- 172.21.15.49:0/3969254672 reap_dead start 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 -- 172.21.15.49:0/3969254672 shutdown_connections 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 -- 172.21.15.49:0/3969254672 >> 172.21.15.49:0/3969254672 conn(0x7fcc24065dc0 msgr2=0x7fcc240b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 -- 172.21.15.49:0/3969254672 shutdown_connections 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.929+0000 7fcc23fff640 1 -- 172.21.15.49:0/3969254672 wait complete. 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.931+0000 7fcc23fff640 1 Processor -- start 2023-12-19T05:41:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.931+0000 7fcc23fff640 1 -- start start 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc24154cc0 0x7fcc24155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2415edc0 0x7fcc2415f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2413f050 con 0x7fcc0c004d00 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24155680 con 0x7fcc2415edc0 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24153af0 con 0x7fcc24154cc0 2023-12-19T05:41:46.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.932+0000 7fcc22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41472/0 (socket says 172.21.15.49:41472) 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 -- 172.21.15.49:0/2267134826 learned_addr learned my addr 172.21.15.49:0/2267134826 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc237fe640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2415edc0 0x7fcc2415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc227fc640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc24154cc0 0x7fcc24155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 -- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc24154cc0 msgr2=0x7fcc24155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc24154cc0 0x7fcc24155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 -- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2415edc0 msgr2=0x7fcc2415f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2415edc0 0x7fcc2415f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 -- 172.21.15.49:0/2267134826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2413e440 con 0x7fcc0c004d00 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.933+0000 7fcc22ffd640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400f3d0 tx=0x7fcc1400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.934+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14016620 con 0x7fcc0c004d00 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.934+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc140167a0 con 0x7fcc0c004d00 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.934+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14016b50 con 0x7fcc0c004d00 2023-12-19T05:41:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.934+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2413e720 con 0x7fcc0c004d00 2023-12-19T05:41:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.934+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2413ece0 con 0x7fcc0c004d00 2023-12-19T05:41:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.935+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2415ea50 con 0x7fcc0c004d00 2023-12-19T05:41:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.936+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcc14016cb0 con 0x7fcc0c004d00 2023-12-19T05:41:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.937+0000 7fcc0b7fe640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 0x7fcc1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.937+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc14089a70 con 0x7fcc0c004d00 2023-12-19T05:41:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.938+0000 7fcc227fc640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 0x7fcc1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.939+0000 7fcc227fc640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 0x7fcc1006c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000ff0 tx=0x7fcc18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:46.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:46.941+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcc2415ea50 con 0x7fcc0c004d00 2023-12-19T05:41:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.141+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc2415ea50 con 0x7fcc0c004d00 2023-12-19T05:41:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.142+0000 7fcc0b7fe640 1 -- 172.21.15.49:0/2267134826 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc2415ea50 con 0x7fcc0c004d00 2023-12-19T05:41:47.143 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:41:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.144+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 msgr2=0x7fcc1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.144+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 0x7fcc1006c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000ff0 tx=0x7fcc18009040 comp rx=0 tx=0).stop 2023-12-19T05:41:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 msgr2=0x7fcc241535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400f3d0 tx=0x7fcc1400f890 comp rx=0 tx=0).stop 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 shutdown_connections 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcc1006a430 0x7fcc1006c8f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc24154cc0 0x7fcc24155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2415edc0 0x7fcc2415f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 --2- 172.21.15.49:0/2267134826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc0c004d00 0x7fcc241535b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 >> 172.21.15.49:0/2267134826 conn(0x7fcc24065dc0 msgr2=0x7fcc240b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 shutdown_connections 2023-12-19T05:41:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.145+0000 7fcc23fff640 1 -- 172.21.15.49:0/2267134826 wait complete. 2023-12-19T05:41:47.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:41:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.404+0000 7f7fd3fff640 1 Processor -- start 2023-12-19T05:41:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.404+0000 7f7fd3fff640 1 -- start start 2023-12-19T05:41:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.406+0000 7f7fd3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fd415e580 0x7f7fd40afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.406+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.406+0000 7f7fd3fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40b06f0 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.406+0000 7f7fd3fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd415ea30 con 0x7f7fd415e580 2023-12-19T05:41:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.406+0000 7f7fd3fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd415dae0 con 0x7f7fd40b02a0 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.407+0000 7f7fcbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fd415e580 0x7f7fd40afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.407+0000 7f7fd2ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7fd40cd4e0 0x7f7fd415a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53414/0 (socket says 172.21.15.49:53414) 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.407+0000 7f7fd2ffd640 1 -- 172.21.15.49:0/2957571326 learned_addr learned my addr 172.21.15.49:0/2957571326 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.407+0000 7f7fd37fe640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.408+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2957571326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 msgr2=0x7f7fd40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.408+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.408+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2957571326 >> v1:172.21.15.49:6789/0 conn(0x7f7fd40cd4e0 legacy=0x7f7fd415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.408+0000 7f7fd27fc640 1 -- 172.21.15.49:0/2957571326 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642263237 0 0) 0x7f7fc4001110 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.408+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2957571326 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd415b000 con 0x7f7fd415e580 2023-12-19T05:41:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.409+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd415e580 0x7f7fd40afd60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3845e9f40e6605 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd27fc640 1 -- 172.21.15.49:0/2957571326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc031830 con 0x7f7fd415e580 2023-12-19T05:41:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd27fc640 1 -- 172.21.15.49:0/2957571326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc031990 con 0x7f7fd415e580 2023-12-19T05:41:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd27fc640 1 -- 172.21.15.49:0/2957571326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc031d20 con 0x7f7fd415e580 2023-12-19T05:41:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 -- 172.21.15.49:0/2957571326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd415e580 msgr2=0x7f7fd40afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd415e580 0x7f7fd40afd60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 -- 172.21.15.49:0/2957571326 shutdown_connections 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/2957571326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd415e580 0x7f7fd40afd60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 -- 172.21.15.49:0/2957571326 >> 172.21.15.49:0/2957571326 conn(0x7f7fd406f630 msgr2=0x7f7fd406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.410+0000 7f7fd3fff640 1 -- 172.21.15.49:0/2957571326 shutdown_connections 2023-12-19T05:41:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.411+0000 7f7fd3fff640 1 -- 172.21.15.49:0/2957571326 wait complete. 2023-12-19T05:41:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.412+0000 7f7fd3fff640 1 Processor -- start 2023-12-19T05:41:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.412+0000 7f7fd3fff640 1 -- start start 2023-12-19T05:41:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fd415e580 0x7f7fd4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40afcc0 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd413bca0 con 0x7f7fd415e580 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.413+0000 7f7fd3fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4144080 con 0x7f7fd40b02a0 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41484/0 (socket says 172.21.15.49:41484) 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 -- 172.21.15.49:0/1304245198 learned_addr learned my addr 172.21.15.49:0/1304245198 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fd2ffd640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fd37fe640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fd415e580 0x7f7fd4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 -- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 msgr2=0x7f7fd40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 -- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fd415e580 msgr2=0x7f7fd4143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fd415e580 0x7f7fd4143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 -- 172.21.15.49:0/1304245198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009400 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.414+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009890 tx=0x7f7fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.415+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc03b980 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.415+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc03bb00 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.415+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd41436b0 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.415+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc045400 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.415+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd40aeea0 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.416+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd4143840 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.417+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fbc04e430 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.418+0000 7f7fcb7fe640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 0x7f7fb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.419+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fbc0aab80 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.419+0000 7f7fd2ffd640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 0x7f7fb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.420+0000 7f7fd2ffd640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 0x7f7fb406c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.423+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7fbc076160 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.621+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fd40af1e0 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.622+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/1304245198 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fbc079780 con 0x7f7fd40cd4e0 2023-12-19T05:41:47.624 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:41:47.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.625+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 msgr2=0x7f7fb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.625+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 0x7f7fb406c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc4009040 comp rx=0 tx=0).stop 2023-12-19T05:41:47.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.625+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 msgr2=0x7f7fd413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.625+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009890 tx=0x7f7fbc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 shutdown_connections 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7fb406a460 0x7f7fb406c920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fd415e580 0x7f7fd4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd40cd4e0 0x7f7fd413b760 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 --2- 172.21.15.49:0/1304245198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fd40b02a0 0x7f7fd40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 >> 172.21.15.49:0/1304245198 conn(0x7f7fd406f630 msgr2=0x7f7fd415cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 shutdown_connections 2023-12-19T05:41:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.626+0000 7f7fd3fff640 1 -- 172.21.15.49:0/1304245198 wait complete. 2023-12-19T05:41:47.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:41:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.864+0000 7f33565fd640 1 Processor -- start 2023-12-19T05:41:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.864+0000 7f33565fd640 1 -- start start 2023-12-19T05:41:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.865+0000 7f33565fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3350146c40 0x7f3350070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33565fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f33500b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33565fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500b7d00 con 0x7f3350160ee0 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33565fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500700c0 con 0x7f3350146c40 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33565fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335006f160 con 0x7f33500b7360 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3350146c40 0x7f3350070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3350146c40 0x7f3350070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41500/0 (socket says 172.21.15.49:41500) 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 -- 172.21.15.49:0/2872188470 learned_addr learned my addr 172.21.15.49:0/2872188470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 -- 172.21.15.49:0/2872188470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 msgr2=0x7f33500b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 --2- 172.21.15.49:0/2872188470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f33500b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 -- 172.21.15.49:0/2872188470 >> v1:172.21.15.115:6789/0 conn(0x7f3350160ee0 legacy=0x7f3350161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.866+0000 7f33555fb640 1 -- 172.21.15.49:0/2872188470 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335006f440 con 0x7f3350146c40 2023-12-19T05:41:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f33555fb640 1 --2- 172.21.15.49:0/2872188470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350146c40 0x7f3350070e70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f334c009870 tx=0x7f334c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4083ab5a06e8e69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f3347fff640 1 -- 172.21.15.49:0/2872188470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c031640 con 0x7f3350146c40 2023-12-19T05:41:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f3347fff640 1 -- 172.21.15.49:0/2872188470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0317a0 con 0x7f3350146c40 2023-12-19T05:41:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f3347fff640 1 -- 172.21.15.49:0/2872188470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c031b30 con 0x7f3350146c40 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f33565fd640 1 -- 172.21.15.49:0/2872188470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350146c40 msgr2=0x7f3350070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.868+0000 7f33565fd640 1 --2- 172.21.15.49:0/2872188470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350146c40 0x7f3350070e70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f334c009870 tx=0x7f334c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 -- 172.21.15.49:0/2872188470 shutdown_connections 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 --2- 172.21.15.49:0/2872188470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f33500b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 --2- 172.21.15.49:0/2872188470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350146c40 0x7f3350070e70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 -- 172.21.15.49:0/2872188470 >> 172.21.15.49:0/2872188470 conn(0x7f33500d31b0 msgr2=0x7f33500d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 -- 172.21.15.49:0/2872188470 shutdown_connections 2023-12-19T05:41:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.869+0000 7f33565fd640 1 -- 172.21.15.49:0/2872188470 wait complete. 2023-12-19T05:41:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.870+0000 7f33565fd640 1 Processor -- start 2023-12-19T05:41:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.871+0000 7f33565fd640 1 -- start start 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.871+0000 7f33565fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f3350159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.871+0000 7f33565fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3350146c40 0x7f33500b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f33565fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f33565fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500b45d0 con 0x7f3350160ee0 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f33565fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335013d2a0 con 0x7f3350146c40 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f33565fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335013cce0 con 0x7f33500b7360 2023-12-19T05:41:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41514/0 (socket says 172.21.15.49:41514) 2023-12-19T05:41:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 -- 172.21.15.49:0/2125949278 learned_addr learned my addr 172.21.15.49:0/2125949278 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f33555fb640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f3350159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3354dfa640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3350146c40 0x7f33500b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 -- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 msgr2=0x7f3350159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f3350159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 -- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3350146c40 msgr2=0x7f33500b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3350146c40 0x7f33500b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.872+0000 7f3355dfc640 1 -- 172.21.15.49:0/2125949278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0094d0 con 0x7f3350160ee0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f3355dfc640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f334800c780 tx=0x7f334800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348003d80 con 0x7f3350160ee0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334800ce90 con 0x7f3350160ee0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335013cfc0 con 0x7f3350160ee0 2023-12-19T05:41:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480052b0 con 0x7f3350160ee0 2023-12-19T05:41:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.873+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335015a370 con 0x7f3350160ee0 2023-12-19T05:41:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.874+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350061910 con 0x7f3350160ee0 2023-12-19T05:41:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.875+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3348005410 con 0x7f3350160ee0 2023-12-19T05:41:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.876+0000 7f3345ffb640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 0x7f333406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.876+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33480880e0 con 0x7f3350160ee0 2023-12-19T05:41:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.877+0000 7f33555fb640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 0x7f333406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.878+0000 7f33555fb640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 0x7f333406c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f334c036000 tx=0x7f334c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:47.880+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3348053760 con 0x7f3350160ee0 2023-12-19T05:41:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.084+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33500b8a50 con 0x7f3350160ee0 2023-12-19T05:41:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.085+0000 7f3345ffb640 1 -- 172.21.15.49:0/2125949278 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3348056d80 con 0x7f3350160ee0 2023-12-19T05:41:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 msgr2=0x7f333406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 0x7f333406c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f334c036000 tx=0x7f334c03c040 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 msgr2=0x7f335013c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f334800c780 tx=0x7f334800cc40 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 shutdown_connections 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f333406a430 0x7f333406c8f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3350160ee0 0x7f335013c220 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3350146c40 0x7f33500b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 --2- 172.21.15.49:0/2125949278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33500b7360 0x7f3350159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 >> 172.21.15.49:0/2125949278 conn(0x7f33500d31b0 msgr2=0x7f335015fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.087+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 shutdown_connections 2023-12-19T05:41:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.088+0000 7f33565fd640 1 -- 172.21.15.49:0/2125949278 wait complete. 2023-12-19T05:41:48.105 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:41:48.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:48.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:41:48.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:41:48.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:48.245 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:41:48.291 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:41:48.292 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:48.335 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:41:48.336 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:48.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:48.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.661+0000 7fdce9b1b640 1 Processor -- start 2023-12-19T05:41:48.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.661+0000 7fdce9b1b640 1 -- start start 2023-12-19T05:41:48.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdce4159f80 0x7fdce406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdce415b1e0 0x7fdce415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 0x7fdce415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce406b520 con 0x7fdce4159f80 2023-12-19T05:41:48.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40b2b20 con 0x7fdce415b1e0 2023-12-19T05:41:48.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce9b1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40b2fb0 con 0x7fdce415a8a0 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.663+0000 7fdce8b19640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdce4159f80 0x7fdce406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdce4159f80 0x7fdce406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41518/0 (socket says 172.21.15.49:41518) 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 -- 172.21.15.49:0/2474464520 learned_addr learned my addr 172.21.15.49:0/2474464520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce931a640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 0x7fdce415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 -- 172.21.15.49:0/2474464520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 msgr2=0x7fdce415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 0x7fdce415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 -- 172.21.15.49:0/2474464520 >> v2:172.21.15.115:3300/0 conn(0x7fdce415b1e0 msgr2=0x7fdce415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2474464520 >> v2:172.21.15.115:3300/0 conn(0x7fdce415b1e0 0x7fdce415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce8b19640 1 -- 172.21.15.49:0/2474464520 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40b1f10 con 0x7fdce4159f80 2023-12-19T05:41:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.664+0000 7fdce931a640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 0x7fdce415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:48.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.665+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce4159f80 0x7fdce406f160 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdce40cff10 tx=0x7fdcd802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657a493868d28285 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.665+0000 7fdce37fe640 1 -- 172.21.15.49:0/2474464520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8030850 con 0x7fdce4159f80 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.665+0000 7fdce37fe640 1 -- 172.21.15.49:0/2474464520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd80309b0 con 0x7fdce4159f80 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.665+0000 7fdce37fe640 1 -- 172.21.15.49:0/2474464520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8030d40 con 0x7fdce4159f80 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2474464520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce4159f80 msgr2=0x7fdce406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce4159f80 0x7fdce406f160 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdce40cff10 tx=0x7fdcd802b990 comp rx=0 tx=0).stop 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2474464520 shutdown_connections 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce415a8a0 0x7fdce415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2474464520 >> v2:172.21.15.115:3300/0 conn(0x7fdce415b1e0 0x7fdce415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2474464520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce4159f80 0x7fdce406f160 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2474464520 >> 172.21.15.49:0/2474464520 conn(0x7fdce40b0100 msgr2=0x7fdce40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2474464520 shutdown_connections 2023-12-19T05:41:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.666+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2474464520 wait complete. 2023-12-19T05:41:48.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.668+0000 7fdce9b1b640 1 Processor -- start 2023-12-19T05:41:48.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.668+0000 7fdce9b1b640 1 -- start start 2023-12-19T05:41:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce4159f80 0x7fdce4142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 0x7fdce414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4155e50 con 0x7fdce415b1e0 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4156130 con 0x7fdce415a8a0 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.669+0000 7fdce9b1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4157af0 con 0x7fdce4159f80 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41524/0 (socket says 172.21.15.49:41524) 2023-12-19T05:41:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 -- 172.21.15.49:0/2826740737 learned_addr learned my addr 172.21.15.49:0/2826740737 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce3fff640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 0x7fdce414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce4159f80 0x7fdce4142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 -- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce4159f80 msgr2=0x7fdce4142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce4159f80 0x7fdce4142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 -- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 msgr2=0x7fdce414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 0x7fdce414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 -- 172.21.15.49:0/2826740737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80094d0 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce3fff640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 0x7fdce414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.670+0000 7fdce931a640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cef0 tx=0x7fdcdc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.671+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00d840 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.671+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00d9c0 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.671+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00dd70 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.671+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce4157dd0 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.671+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce413f410 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.672+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4157950 con 0x7fdce415b1e0 2023-12-19T05:41:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.673+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcdc01e3b0 con 0x7fdce415b1e0 2023-12-19T05:41:48.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.674+0000 7fdce17fa640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 0x7fdcc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:48.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.674+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcdc089350 con 0x7fdce415b1e0 2023-12-19T05:41:48.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.675+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 0x7fdcc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:48.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.676+0000 7fdce8b19640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 0x7fdcc806c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8036000 tx=0x7fdcd8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.678+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdce4157950 con 0x7fdce415b1e0 2023-12-19T05:41:48.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.874+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdce4157950 con 0x7fdce415b1e0 2023-12-19T05:41:48.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.877+0000 7fdce17fa640 1 -- 172.21.15.49:0/2826740737 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fdce4157950 con 0x7fdce415b1e0 2023-12-19T05:41:48.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:48.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:38.407362+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.879+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 msgr2=0x7fdcc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.879+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 0x7fdcc806c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8036000 tx=0x7fdcd8008030 comp rx=0 tx=0).stop 2023-12-19T05:41:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.879+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 msgr2=0x7fdce413eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.879+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cef0 tx=0x7fdcdc00a710 comp rx=0 tx=0).stop 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 shutdown_connections 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdcc806a430 0x7fdcc806c8f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce415b1e0 0x7fdce413eed0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdce415a8a0 0x7fdce414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 --2- 172.21.15.49:0/2826740737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdce4159f80 0x7fdce4142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 >> 172.21.15.49:0/2826740737 conn(0x7fdce40b0100 msgr2=0x7fdce40cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 shutdown_connections 2023-12-19T05:41:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:48.880+0000 7fdce9b1b640 1 -- 172.21.15.49:0/2826740737 wait complete. 2023-12-19T05:41:48.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:41:01.033356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:41:02.017190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:41:48.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:41:49.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.129+0000 7f1ab359e640 1 Processor -- start 2023-12-19T05:41:49.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.130+0000 7f1ab359e640 1 -- start start 2023-12-19T05:41:49.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1ab4146cd0 0x7f1ab40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ab406fba0 0x7f1ab40d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab4070260 con 0x7f1ab40b6890 2023-12-19T05:41:49.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab41470b0 con 0x7f1ab406fba0 2023-12-19T05:41:49.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40b6ea0 con 0x7f1ab4146cd0 2023-12-19T05:41:49.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.131+0000 7f1ab2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ab406fba0 0x7f1ab40d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ab406fba0 0x7f1ab40d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41528/0 (socket says 172.21.15.49:41528) 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 -- 172.21.15.49:0/910316237 learned_addr learned my addr 172.21.15.49:0/910316237 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab259c640 1 --2- 172.21.15.49:0/910316237 >> v2:172.21.15.115:3300/0 conn(0x7f1ab4146cd0 0x7f1ab40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 -- 172.21.15.49:0/910316237 >> v2:172.21.15.115:3300/0 conn(0x7f1ab4146cd0 msgr2=0x7f1ab40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 --2- 172.21.15.49:0/910316237 >> v2:172.21.15.115:3300/0 conn(0x7f1ab4146cd0 0x7f1ab40b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 -- 172.21.15.49:0/910316237 >> v1:172.21.15.115:6789/0 conn(0x7f1ab40b6890 legacy=0x7f1ab406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:49.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.132+0000 7f1ab2d9d640 1 -- 172.21.15.49:0/910316237 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40b7180 con 0x7f1ab406fba0 2023-12-19T05:41:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.133+0000 7f1ab2d9d640 1 --2- 172.21.15.49:0/910316237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab406fba0 0x7f1ab40d1670 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1ab406f0b0 tx=0x7f1aac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbdf733e46b6cf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab159a640 1 -- 172.21.15.49:0/910316237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0317e0 con 0x7f1ab406fba0 2023-12-19T05:41:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab159a640 1 -- 172.21.15.49:0/910316237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac031940 con 0x7f1ab406fba0 2023-12-19T05:41:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab159a640 1 -- 172.21.15.49:0/910316237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac031cd0 con 0x7f1ab406fba0 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 -- 172.21.15.49:0/910316237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab406fba0 msgr2=0x7f1ab40d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 --2- 172.21.15.49:0/910316237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab406fba0 0x7f1ab40d1670 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1ab406f0b0 tx=0x7f1aac02b880 comp rx=0 tx=0).stop 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 -- 172.21.15.49:0/910316237 shutdown_connections 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 --2- 172.21.15.49:0/910316237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab406fba0 0x7f1ab40d1670 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 --2- 172.21.15.49:0/910316237 >> v2:172.21.15.115:3300/0 conn(0x7f1ab4146cd0 0x7f1ab40b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 -- 172.21.15.49:0/910316237 >> 172.21.15.49:0/910316237 conn(0x7f1ab40d3200 msgr2=0x7f1ab40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 -- 172.21.15.49:0/910316237 shutdown_connections 2023-12-19T05:41:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.134+0000 7f1ab359e640 1 -- 172.21.15.49:0/910316237 wait complete. 2023-12-19T05:41:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.136+0000 7f1ab359e640 1 Processor -- start 2023-12-19T05:41:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.136+0000 7f1ab359e640 1 -- start start 2023-12-19T05:41:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ab406fba0 0x7f1ab413e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab4146cd0 0x7f1ab4160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4157da0 con 0x7f1ab40b6890 2023-12-19T05:41:49.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab413e920 con 0x7f1ab4146cd0 2023-12-19T05:41:49.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.137+0000 7f1ab359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4157020 con 0x7f1ab406fba0 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41538/0 (socket says 172.21.15.49:41538) 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 -- 172.21.15.49:0/3725639402 learned_addr learned my addr 172.21.15.49:0/3725639402 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab259c640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ab406fba0 0x7f1ab413e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab2d9d640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab4146cd0 0x7f1ab4160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 -- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ab406fba0 msgr2=0x7f1ab413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ab406fba0 0x7f1ab413e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 -- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab4146cd0 msgr2=0x7f1ab4160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab4146cd0 0x7f1ab4160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.138+0000 7f1ab1d9b640 1 -- 172.21.15.49:0/3725639402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0094d0 con 0x7f1ab40b6890 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1ab1d9b640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7c0 tx=0x7f1aa400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400aa50 con 0x7f1ab40b6890 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400abb0 con 0x7f1ab40b6890 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab413d120 con 0x7f1ab40b6890 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4012420 con 0x7f1ab40b6890 2023-12-19T05:41:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.139+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41575a0 con 0x7f1ab40b6890 2023-12-19T05:41:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.141+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4061910 con 0x7f1ab40b6890 2023-12-19T05:41:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.141+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1aa4012580 con 0x7f1ab40b6890 2023-12-19T05:41:49.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.142+0000 7f1aaaffd640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 0x7f1a9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.142+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aa4088b20 con 0x7f1ab40b6890 2023-12-19T05:41:49.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.143+0000 7f1ab259c640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 0x7f1a9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.144+0000 7f1ab259c640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 0x7f1a9406c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c006fd0 tx=0x7f1a9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.146+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1aa40541a0 con 0x7f1ab40b6890 2023-12-19T05:41:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.339+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ab4071b90 con 0x7f1ab40b6890 2023-12-19T05:41:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.340+0000 7f1aaaffd640 1 -- 172.21.15.49:0/3725639402 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1aa40160a0 con 0x7f1ab40b6890 2023-12-19T05:41:49.342 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 msgr2=0x7f1a9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 0x7f1a9406c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c006fd0 tx=0x7f1a9c008040 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 msgr2=0x7f1ab413c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7c0 tx=0x7f1aa400cc80 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 shutdown_connections 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a9406a430 0x7f1a9406c8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab4146cd0 0x7f1ab4160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40b6890 0x7f1ab413c770 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 --2- 172.21.15.49:0/3725639402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ab406fba0 0x7f1ab413e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 >> 172.21.15.49:0/3725639402 conn(0x7f1ab40d3200 msgr2=0x7f1ab415cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 shutdown_connections 2023-12-19T05:41:49.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.343+0000 7f1ab359e640 1 -- 172.21.15.49:0/3725639402 wait complete. 2023-12-19T05:41:49.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:41:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.605+0000 7f66a157a640 1 Processor -- start 2023-12-19T05:41:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.606+0000 7f66a157a640 1 -- start start 2023-12-19T05:41:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.607+0000 7f66a157a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.607+0000 7f66a157a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f669c06ca80 0x7f669c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.607+0000 7f66a157a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c15c9c0 con 0x7f669c155460 2023-12-19T05:41:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.607+0000 7f66a157a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c06d270 con 0x7f669c06ca80 2023-12-19T05:41:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.607+0000 7f66a157a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c06d550 con 0x7f669c0b0a00 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.608+0000 7f66a0d79640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f669c06ca80 0x7f669c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.608+0000 7f6693fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.608+0000 7f66a0d79640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f669c06ca80 0x7f669c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:50072/0 (socket says 172.21.15.49:50072) 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.608+0000 7f66a0d79640 1 -- 172.21.15.49:0/2293552785 learned_addr learned my addr 172.21.15.49:0/2293552785 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.609+0000 7f66a0d79640 1 -- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 msgr2=0x7f669c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.609+0000 7f66a0d79640 1 --2- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.609+0000 7f66a0d79640 1 -- 172.21.15.49:0/2293552785 >> v1:172.21.15.115:6789/0 conn(0x7f669c155460 legacy=0x7f669c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.609+0000 7f66a0d79640 1 -- 172.21.15.49:0/2293552785 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c06d830 con 0x7f669c06ca80 2023-12-19T05:41:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.610+0000 7f66a0d79640 1 --2- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c06ca80 0x7f669c0cdcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15fc7f2b10101ba2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.611+0000 7f669b7fe640 1 -- 172.21.15.49:0/2293552785 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669402cb00 con 0x7f669c06ca80 2023-12-19T05:41:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.611+0000 7f669b7fe640 1 -- 172.21.15.49:0/2293552785 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669402cc60 con 0x7f669c06ca80 2023-12-19T05:41:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.611+0000 7f669b7fe640 1 -- 172.21.15.49:0/2293552785 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940343f0 con 0x7f669c06ca80 2023-12-19T05:41:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 -- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c06ca80 msgr2=0x7f669c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 --2- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c06ca80 0x7f669c0cdcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669402bf60 comp rx=0 tx=0).stop 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 -- 172.21.15.49:0/2293552785 shutdown_connections 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 --2- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c06ca80 0x7f669c0cdcf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 --2- 172.21.15.49:0/2293552785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 -- 172.21.15.49:0/2293552785 >> 172.21.15.49:0/2293552785 conn(0x7f669c0659a0 msgr2=0x7f669c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 -- 172.21.15.49:0/2293552785 shutdown_connections 2023-12-19T05:41:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.612+0000 7f66a157a640 1 -- 172.21.15.49:0/2293552785 wait complete. 2023-12-19T05:41:49.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.614+0000 7f66a157a640 1 Processor -- start 2023-12-19T05:41:49.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.614+0000 7f66a157a640 1 -- start start 2023-12-19T05:41:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.615+0000 7f66a157a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.615+0000 7f66a157a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f66a157a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c155460 0x7f669c14ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f66a157a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14fef0 con 0x7f669c06ca80 2023-12-19T05:41:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f66a157a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14fba0 con 0x7f669c155460 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f66a157a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c150190 con 0x7f669c0b0a00 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f669bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f669bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41548/0 (socket says 172.21.15.49:41548) 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f669bfff640 1 -- 172.21.15.49:0/3848298262 learned_addr learned my addr 172.21.15.49:0/3848298262 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f66a0d79640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c155460 0x7f669c14ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f6693fff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f669bfff640 1 -- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 msgr2=0x7f669c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.616+0000 7f669bfff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f669bfff640 1 -- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c155460 msgr2=0x7f669c14ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f669bfff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c155460 0x7f669c14ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f669bfff640 1 -- 172.21.15.49:0/3848298262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009b30 con 0x7f669c06ca80 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f669bfff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c400 tx=0x7f668c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0052d0 con 0x7f669c06ca80 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c005430 con 0x7f669c06ca80 2023-12-19T05:41:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c003830 con 0x7f669c06ca80 2023-12-19T05:41:49.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c150470 con 0x7f669c06ca80 2023-12-19T05:41:49.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.617+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c14f8c0 con 0x7f669c06ca80 2023-12-19T05:41:49.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.619+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c061910 con 0x7f669c06ca80 2023-12-19T05:41:49.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.620+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f668c003990 con 0x7f669c06ca80 2023-12-19T05:41:49.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.621+0000 7f66997fa640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 0x7f667c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:49.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.621+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f668c087ef0 con 0x7f669c06ca80 2023-12-19T05:41:49.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.621+0000 7f6693fff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 0x7f667c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.622+0000 7f6693fff640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 0x7f667c06c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f669c0adb20 tx=0x7f6684008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.626+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f668c0534e0 con 0x7f669c06ca80 2023-12-19T05:41:49.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.823+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f669c0afaf0 con 0x7f669c06ca80 2023-12-19T05:41:49.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.824+0000 7f66997fa640 1 -- 172.21.15.49:0/3848298262 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f668c056b00 con 0x7f669c06ca80 2023-12-19T05:41:49.825 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:41:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 msgr2=0x7f667c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 0x7f667c06c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f669c0adb20 tx=0x7f6684008040 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 msgr2=0x7f669c14b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c400 tx=0x7f668c00c8c0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 shutdown_connections 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f667c06a430 0x7f667c06c8f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f669c0b0a00 0x7f669c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f669c155460 0x7f669c14ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 --2- 172.21.15.49:0/3848298262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f669c06ca80 0x7f669c14b590 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 >> 172.21.15.49:0/3848298262 conn(0x7f669c0659a0 msgr2=0x7f669c15a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 shutdown_connections 2023-12-19T05:41:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:49.827+0000 7f66a157a640 1 -- 172.21.15.49:0/3848298262 wait complete. 2023-12-19T05:41:49.848 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:41:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.088+0000 7fbac359e640 1 Processor -- start 2023-12-19T05:41:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.089+0000 7fbac359e640 1 -- start start 2023-12-19T05:41:50.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.090+0000 7fbac359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 0x7fbac40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.090+0000 7fbac359e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac4070260 con 0x7fbac40b6890 2023-12-19T05:41:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.090+0000 7fbac359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40b6ea0 con 0x7fbac406fba0 2023-12-19T05:41:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.090+0000 7fbac359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41470b0 con 0x7fbac4146cd0 2023-12-19T05:41:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.091+0000 7fbac1d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbac40b6890 0x7fbac406f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53430/0 (socket says 172.21.15.49:53430) 2023-12-19T05:41:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.091+0000 7fbac1d9b640 1 -- 172.21.15.49:0/1963033917 learned_addr learned my addr 172.21.15.49:0/1963033917 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.091+0000 7fbac259c640 1 --2- 172.21.15.49:0/1963033917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 0x7fbac40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.091+0000 7fbac159a640 1 -- 172.21.15.49:0/1963033917 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565368340 0 0) 0x7fbac4070260 con 0x7fbac40b6890 2023-12-19T05:41:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.091+0000 7fbac159a640 1 -- 172.21.15.49:0/1963033917 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab0003520 con 0x7fbac40b6890 2023-12-19T05:41:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.092+0000 7fbac259c640 1 -- 172.21.15.49:0/1963033917 >> v1:172.21.15.115:6789/0 conn(0x7fbac406fba0 legacy=0x7fbac40d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.092+0000 7fbac259c640 1 -- 172.21.15.49:0/1963033917 >> v1:172.21.15.49:6789/0 conn(0x7fbac40b6890 legacy=0x7fbac406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.092+0000 7fbac259c640 1 -- 172.21.15.49:0/1963033917 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40b7180 con 0x7fbac4146cd0 2023-12-19T05:41:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.093+0000 7fbac259c640 1 --2- 172.21.15.49:0/1963033917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 0x7fbac40b6350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009dc0 tx=0x7fbab402be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=361e27e713237895 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.093+0000 7fbac159a640 1 -- 172.21.15.49:0/1963033917 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab402cc30 con 0x7fbac4146cd0 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac159a640 1 -- 172.21.15.49:0/1963033917 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab402cd90 con 0x7fbac4146cd0 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac159a640 1 -- 172.21.15.49:0/1963033917 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4034660 con 0x7fbac4146cd0 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 -- 172.21.15.49:0/1963033917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 msgr2=0x7fbac40b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 --2- 172.21.15.49:0/1963033917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 0x7fbac40b6350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009dc0 tx=0x7fbab402be80 comp rx=0 tx=0).stop 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 -- 172.21.15.49:0/1963033917 shutdown_connections 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 --2- 172.21.15.49:0/1963033917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac4146cd0 0x7fbac40b6350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 -- 172.21.15.49:0/1963033917 >> 172.21.15.49:0/1963033917 conn(0x7fbac40d3200 msgr2=0x7fbac40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 -- 172.21.15.49:0/1963033917 shutdown_connections 2023-12-19T05:41:50.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.094+0000 7fbac359e640 1 -- 172.21.15.49:0/1963033917 wait complete. 2023-12-19T05:41:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.096+0000 7fbac359e640 1 Processor -- start 2023-12-19T05:41:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.096+0000 7fbac359e640 1 -- start start 2023-12-19T05:41:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406fba0 0x7fbac413db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 0x7fbac413c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41f5390 con 0x7fbac4146cd0 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac415a2c0 con 0x7fbac40b6890 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41f4710 con 0x7fbac406fba0 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.097+0000 7fbac2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41552/0 (socket says 172.21.15.49:41552) 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 -- 172.21.15.49:0/1719986619 learned_addr learned my addr 172.21.15.49:0/1719986619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac259c640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406fba0 0x7fbac413db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac1d9b640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 0x7fbac413c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 -- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406fba0 msgr2=0x7fbac413db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406fba0 0x7fbac413db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 -- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 msgr2=0x7fbac413c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 0x7fbac413c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 -- 172.21.15.49:0/1719986619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009a70 con 0x7fbac4146cd0 2023-12-19T05:41:50.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac1d9b640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 0x7fbac413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:50.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.098+0000 7fbac2d9d640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbabc001eb0 tx=0x7fbabc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.099+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0052d0 con 0x7fbac4146cd0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.099+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc005430 con 0x7fbac4146cd0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.099+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac41f49f0 con 0x7fbac4146cd0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.099+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc003810 con 0x7fbac4146cd0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.099+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac41f4fb0 con 0x7fbac4146cd0 2023-12-19T05:41:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.100+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac41f54d0 con 0x7fbac4146cd0 2023-12-19T05:41:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.101+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbabc003970 con 0x7fbac4146cd0 2023-12-19T05:41:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.102+0000 7fbabaffd640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 0x7fbaa406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.102+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbabc087e30 con 0x7fbac4146cd0 2023-12-19T05:41:50.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.103+0000 7fbac259c640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 0x7fbaa406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.104+0000 7fbac259c640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 0x7fbaa406c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbab4036000 tx=0x7fbab4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.107+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbabc0534b0 con 0x7fbac4146cd0 2023-12-19T05:41:50.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.303+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbac4061910 con 0x7fbac4146cd0 2023-12-19T05:41:50.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.303+0000 7fbabaffd640 1 -- 172.21.15.49:0/1719986619 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbabc056ad0 con 0x7fbac4146cd0 2023-12-19T05:41:50.306 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 msgr2=0x7fbaa406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 0x7fbaa406c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbab4036000 tx=0x7fbab4030000 comp rx=0 tx=0).stop 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 msgr2=0x7fbac41f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbabc001eb0 tx=0x7fbabc00c890 comp rx=0 tx=0).stop 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 shutdown_connections 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbaa406a430 0x7fbaa406c8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac4146cd0 0x7fbac41f3b40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b6890 0x7fbac413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 --2- 172.21.15.49:0/1719986619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406fba0 0x7fbac413db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.306+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 >> 172.21.15.49:0/1719986619 conn(0x7fbac40d3200 msgr2=0x7fbac415da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.307+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 shutdown_connections 2023-12-19T05:41:50.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.307+0000 7fbac359e640 1 -- 172.21.15.49:0/1719986619 wait complete. 2023-12-19T05:41:50.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:41:50.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.568+0000 7f34a42bd640 1 Processor -- start 2023-12-19T05:41:50.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.568+0000 7f34a42bd640 1 -- start start 2023-12-19T05:41:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.569+0000 7f34a42bd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.569+0000 7f34a42bd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f349c06e410 0x7f349c161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.569+0000 7f34a42bd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c06e890 con 0x7f349c161540 2023-12-19T05:41:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a42bd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c0b2600 con 0x7f349c06e410 2023-12-19T05:41:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a42bd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b1d60 con 0x7f349c157aa0 2023-12-19T05:41:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a1858640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f349c06e410 0x7f349c161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a1858640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f349c06e410 0x7f349c161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41560/0 (socket says 172.21.15.49:41560) 2023-12-19T05:41:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a1858640 1 -- 172.21.15.49:0/1978815792 learned_addr learned my addr 172.21.15.49:0/1978815792 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a2059640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.570+0000 7f34a1858640 1 -- 172.21.15.49:0/1978815792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 msgr2=0x7f349c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.571+0000 7f34a1858640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.571+0000 7f34a1858640 1 -- 172.21.15.49:0/1978815792 >> v1:172.21.15.115:6789/0 conn(0x7f349c161540 legacy=0x7f349c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.571+0000 7f34a1858640 1 -- 172.21.15.49:0/1978815792 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0b2040 con 0x7f349c06e410 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.572+0000 7f34a1858640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c06e410 0x7f349c161000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acdf7fdc5721d93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.572+0000 7f34a1057640 1 -- 172.21.15.49:0/1978815792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031640 con 0x7f349c06e410 2023-12-19T05:41:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.572+0000 7f34a1057640 1 -- 172.21.15.49:0/1978815792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c0317a0 con 0x7f349c06e410 2023-12-19T05:41:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.572+0000 7f34a1057640 1 -- 172.21.15.49:0/1978815792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031b30 con 0x7f349c06e410 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 -- 172.21.15.49:0/1978815792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c06e410 msgr2=0x7f349c161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c06e410 0x7f349c161000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 -- 172.21.15.49:0/1978815792 shutdown_connections 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c06e410 0x7f349c161000 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 --2- 172.21.15.49:0/1978815792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 -- 172.21.15.49:0/1978815792 >> 172.21.15.49:0/1978815792 conn(0x7f349c0cbb70 msgr2=0x7f349c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 -- 172.21.15.49:0/1978815792 shutdown_connections 2023-12-19T05:41:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.573+0000 7f34a42bd640 1 -- 172.21.15.49:0/1978815792 wait complete. 2023-12-19T05:41:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.575+0000 7f34a42bd640 1 Processor -- start 2023-12-19T05:41:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.575+0000 7f34a42bd640 1 -- start start 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c06e410 0x7f349c149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c14a130 con 0x7f349c161540 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c15eae0 con 0x7f349c06e410 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a42bd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c15edc0 con 0x7f349c157aa0 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a285a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a285a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41568/0 (socket says 172.21.15.49:41568) 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.576+0000 7f34a285a640 1 -- 172.21.15.49:0/3843013477 learned_addr learned my addr 172.21.15.49:0/3843013477 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a2059640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c06e410 0x7f349c149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a1858640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 -- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 msgr2=0x7f349c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 -- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c06e410 msgr2=0x7f349c149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c06e410 0x7f349c149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 -- 172.21.15.49:0/3843013477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0094d0 con 0x7f349c161540 2023-12-19T05:41:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a1858640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a285a640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f349400b9e0 tx=0x7f349400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494003b70 con 0x7f349c161540 2023-12-19T05:41:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494003cd0 con 0x7f349c161540 2023-12-19T05:41:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400cb60 con 0x7f349c161540 2023-12-19T05:41:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.577+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c15f0a0 con 0x7f349c161540 2023-12-19T05:41:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.578+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c15f660 con 0x7f349c161540 2023-12-19T05:41:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.579+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c15f850 con 0x7f349c161540 2023-12-19T05:41:50.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.580+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f349400ccc0 con 0x7f349c161540 2023-12-19T05:41:50.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.581+0000 7f3492ffd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 0x7f348006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:50.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.581+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3494088740 con 0x7f349c161540 2023-12-19T05:41:50.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.581+0000 7f34a2059640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 0x7f348006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:50.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.582+0000 7f34a2059640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 0x7f348006c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3498006fd0 tx=0x7f3498008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.585+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3494053c90 con 0x7f349c161540 2023-12-19T05:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.799+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f349c061910 con 0x7f349c161540 2023-12-19T05:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.799+0000 7f3492ffd640 1 -- 172.21.15.49:0/3843013477 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34940572b0 con 0x7f349c161540 2023-12-19T05:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 msgr2=0x7f348006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 0x7f348006c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3498006fd0 tx=0x7f3498008040 comp rx=0 tx=0).stop 2023-12-19T05:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 msgr2=0x7f349c1f33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f349400b9e0 tx=0x7f349400bea0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 shutdown_connections 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f348006a430 0x7f348006c8f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c157aa0 0x7f349c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c161540 0x7f349c1f33b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 --2- 172.21.15.49:0/3843013477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c06e410 0x7f349c149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.802+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 >> 172.21.15.49:0/3843013477 conn(0x7f349c0cbb70 msgr2=0x7f349c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.803+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 shutdown_connections 2023-12-19T05:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:50.803+0000 7f34a42bd640 1 -- 172.21.15.49:0/3843013477 wait complete. 2023-12-19T05:41:50.824 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:41:50.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:50.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:41:50.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:41:50.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:41:50.939 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:41:50.990 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:41:50.990 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:51.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:41:51.058 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:41:51.058 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:41:51.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:41:51.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:51.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.357+0000 7fdb1707d640 1 Processor -- start 2023-12-19T05:41:51.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.358+0000 7fdb1707d640 1 -- start start 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.359+0000 7fdb1707d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb100b1710 0x7fdb1006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.359+0000 7fdb1707d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb1015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.359+0000 7fdb1707d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1015e9c0 con 0x7fdb10157aa0 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.359+0000 7fdb1707d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb100b2600 con 0x7fdb100b1710 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.359+0000 7fdb1707d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b1d60 con 0x7fdb1015e040 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb14e19640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb10157aa0 0x7fdb10161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53438/0 (socket says 172.21.15.49:53438) 2023-12-19T05:41:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb14e19640 1 -- 172.21.15.49:0/3010103967 learned_addr learned my addr 172.21.15.49:0/3010103967 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:51.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb1561a640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb1015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3010103967 >> v2:172.21.15.115:3300/0 conn(0x7fdb100b1710 0x7fdb1006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4465026 0 0) 0x7fdb1015e9c0 con 0x7fdb10157aa0 2023-12-19T05:41:51.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.360+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb00003520 con 0x7fdb10157aa0 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1937362790 0 0) 0x7fdb00003520 con 0x7fdb10157aa0 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 msgr2=0x7fdb1015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb1015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 >> v2:172.21.15.115:3300/0 conn(0x7fdb100b1710 msgr2=0x7fdb1006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 --2- 172.21.15.49:0/3010103967 >> v2:172.21.15.115:3300/0 conn(0x7fdb100b1710 0x7fdb1006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100b2040 con 0x7fdb10157aa0 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fdb04001670 con 0x7fdb10157aa0 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 >> v1:172.21.15.49:6789/0 conn(0x7fdb10157aa0 legacy=0x7fdb10161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb00004d00 0x7fdb00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b2600 con 0x7fdb000039e0 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b1d60 con 0x7fdb00004d00 2023-12-19T05:41:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0000ba30 con 0x7fdb1015e040 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3010103967 >> v2:172.21.15.115:3300/0 conn(0x7fdb100b1710 0x7fdb1006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.361+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb1561a640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb00004d00 0x7fdb00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb14e19640 1 -- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 msgr2=0x7fdb000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1015e040 0x7fdb000047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb14e19640 1 -- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb00004d00 msgr2=0x7fdb00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb00004d00 0x7fdb00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.362+0000 7fdb14e19640 1 -- 172.21.15.49:0/3010103967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00003520 con 0x7fdb000039e0 2023-12-19T05:41:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.363+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb00003e00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c190 tx=0x7fdb000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ef572c50cd5db4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.363+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04005ad0 con 0x7fdb000039e0 2023-12-19T05:41:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.363+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04005c50 con 0x7fdb000039e0 2023-12-19T05:41:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.363+0000 7fdb0f7fe640 1 -- 172.21.15.49:0/3010103967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0402c850 con 0x7fdb000039e0 2023-12-19T05:41:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 -- 172.21.15.49:0/3010103967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 msgr2=0x7fdb00003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3010103967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb00003e00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c190 tx=0x7fdb000057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1561a640 1 -- 172.21.15.49:0/3010103967 reap_dead start 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 -- 172.21.15.49:0/3010103967 shutdown_connections 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 -- 172.21.15.49:0/3010103967 >> 172.21.15.49:0/3010103967 conn(0x7fdb100cbb70 msgr2=0x7fdb100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 -- 172.21.15.49:0/3010103967 shutdown_connections 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.364+0000 7fdb1707d640 1 -- 172.21.15.49:0/3010103967 wait complete. 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.366+0000 7fdb1707d640 1 Processor -- start 2023-12-19T05:41:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.366+0000 7fdb1707d640 1 -- start start 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 0x7fdb10155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb10158300 0x7fdb101587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101560d0 con 0x7fdb000039e0 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1015a4d0 con 0x7fdb10155710 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb1707d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1015a7b0 con 0x7fdb10158300 2023-12-19T05:41:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb14e19640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb14e19640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41596/0 (socket says 172.21.15.49:41596) 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.367+0000 7fdb14e19640 1 -- 172.21.15.49:0/3930953412 learned_addr learned my addr 172.21.15.49:0/3930953412 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 0x7fdb10155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb1561a640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb10158300 0x7fdb101587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 -- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb10158300 msgr2=0x7fdb101587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb10158300 0x7fdb101587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 -- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 msgr2=0x7fdb10155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 0x7fdb10155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 -- 172.21.15.49:0/3930953412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1015aa90 con 0x7fdb000039e0 2023-12-19T05:41:51.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 0x7fdb10155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.368+0000 7fdb14e19640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c190 tx=0x7fdb04001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.369+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0402cc60 con 0x7fdb000039e0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.369+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0402cdc0 con 0x7fdb000039e0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.369+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04007290 con 0x7fdb000039e0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.369+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1015ad70 con 0x7fdb000039e0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.369+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb10147100 con 0x7fdb000039e0 2023-12-19T05:41:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.370+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb10061910 con 0x7fdb000039e0 2023-12-19T05:41:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.371+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb04032070 con 0x7fdb000039e0 2023-12-19T05:41:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.372+0000 7fdb0d7fa640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 0x7fdaf406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.372+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb0403c040 con 0x7fdb000039e0 2023-12-19T05:41:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.373+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 0x7fdaf406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.374+0000 7fdb0ffff640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 0x7fdaf406c920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb100af440 tx=0x7fdafc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.376+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb04075080 con 0x7fdb000039e0 2023-12-19T05:41:51.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.614+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb10071ae0 con 0x7fdb000039e0 2023-12-19T05:41:51.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.616+0000 7fdb0d7fa640 1 -- 172.21.15.49:0/3930953412 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fdb04045020 con 0x7fdb000039e0 2023-12-19T05:41:51.618 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:51.618 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:51.619 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.618+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 msgr2=0x7fdaf406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.618+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 0x7fdaf406c920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb100af440 tx=0x7fdafc008040 comp rx=0 tx=0).stop 2023-12-19T05:41:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.618+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 msgr2=0x7fdb10146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.618+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c190 tx=0x7fdb04001930 comp rx=0 tx=0).stop 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 shutdown_connections 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdaf406a460 0x7fdaf406c920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb10158300 0x7fdb101587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb10155710 0x7fdb10155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 --2- 172.21.15.49:0/3930953412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb000039e0 0x7fdb10146bc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 >> 172.21.15.49:0/3930953412 conn(0x7fdb100cbb70 msgr2=0x7fdb100cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 shutdown_connections 2023-12-19T05:41:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.619+0000 7fdb1707d640 1 -- 172.21.15.49:0/3930953412 wait complete. 2023-12-19T05:41:51.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.875+0000 7fd3ad079640 1 Processor -- start 2023-12-19T05:41:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.876+0000 7fd3ad079640 1 -- start start 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.877+0000 7fd3ad079640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3a8146e30 0x7fd3a80b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.877+0000 7fd3ad079640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3a80b7ea0 0x7fd3a80d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.877+0000 7fd3ad079640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a80d12d0 con 0x7fd3a80d0a90 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.877+0000 7fd3ad079640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a8147210 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.877+0000 7fd3ad079640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a80b8330 con 0x7fd3a8146e30 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3a80b7ea0 0x7fd3a80d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3a80b7ea0 0x7fd3a80d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41602/0 (socket says 172.21.15.49:41602) 2023-12-19T05:41:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2535756388 learned_addr learned my addr 172.21.15.49:0/2535756388 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a7fff640 1 --2- 172.21.15.49:0/2535756388 >> v2:172.21.15.115:3300/0 conn(0x7fd3a8146e30 0x7fd3a80b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2535756388 >> v2:172.21.15.115:3300/0 conn(0x7fd3a8146e30 msgr2=0x7fd3a80b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 --2- 172.21.15.49:0/2535756388 >> v2:172.21.15.115:3300/0 conn(0x7fd3a8146e30 0x7fd3a80b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2535756388 >> v1:172.21.15.115:6789/0 conn(0x7fd3a80d0a90 legacy=0x7fd3a806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.878+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2535756388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80d15b0 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.880+0000 7fd3a77fe640 1 --2- 172.21.15.49:0/2535756388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80b7ea0 0x7fd3a80d0550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b85a0 tx=0x7fd39802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147db4433f94fcaf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.880+0000 7fd3a6ffd640 1 -- 172.21.15.49:0/2535756388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39802c9f0 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.880+0000 7fd3a6ffd640 1 -- 172.21.15.49:0/2535756388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39802cb50 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.880+0000 7fd3a6ffd640 1 -- 172.21.15.49:0/2535756388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3980343f0 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 -- 172.21.15.49:0/2535756388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80b7ea0 msgr2=0x7fd3a80d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2535756388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80b7ea0 0x7fd3a80d0550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b85a0 tx=0x7fd39802be50 comp rx=0 tx=0).stop 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 -- 172.21.15.49:0/2535756388 shutdown_connections 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2535756388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80b7ea0 0x7fd3a80d0550 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2535756388 >> v2:172.21.15.115:3300/0 conn(0x7fd3a8146e30 0x7fd3a80b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 -- 172.21.15.49:0/2535756388 >> 172.21.15.49:0/2535756388 conn(0x7fd3a80b2990 msgr2=0x7fd3a80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 -- 172.21.15.49:0/2535756388 shutdown_connections 2023-12-19T05:41:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.881+0000 7fd3ad079640 1 -- 172.21.15.49:0/2535756388 wait complete. 2023-12-19T05:41:51.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.883+0000 7fd3ad079640 1 Processor -- start 2023-12-19T05:41:51.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.883+0000 7fd3ad079640 1 -- start start 2023-12-19T05:41:51.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3a80b7ea0 0x7fd3a80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3a8146e30 0x7fd3a813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80cb2d0 con 0x7fd3a80d0a90 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80cb5b0 con 0x7fd3a8146e30 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3ad079640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80cb890 con 0x7fd3a80b7ea0 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41616/0 (socket says 172.21.15.49:41616) 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2210236893 learned_addr learned my addr 172.21.15.49:0/2210236893 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.884+0000 7fd3a7fff640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3a80b7ea0 0x7fd3a80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3ac878640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3a8146e30 0x7fd3a813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3a80b7ea0 msgr2=0x7fd3a80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3a80b7ea0 0x7fd3a80cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3a8146e30 msgr2=0x7fd3a813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3a8146e30 0x7fd3a813a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 -- 172.21.15.49:0/2210236893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398009b30 con 0x7fd3a80d0a90 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a77fe640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd398036040 tx=0x7fd398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398009510 con 0x7fd3a80d0a90 2023-12-19T05:41:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39803e450 con 0x7fd3a80d0a90 2023-12-19T05:41:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80cbb70 con 0x7fd3a80d0a90 2023-12-19T05:41:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.885+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39803e7e0 con 0x7fd3a80d0a90 2023-12-19T05:41:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.886+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a81e8b10 con 0x7fd3a80d0a90 2023-12-19T05:41:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.887+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80cc090 con 0x7fd3a80d0a90 2023-12-19T05:41:51.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.888+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd39803e940 con 0x7fd3a80d0a90 2023-12-19T05:41:51.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.889+0000 7fd3a4ff9640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 0x7fd38806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:51.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.889+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3980ab7c0 con 0x7fd3a80d0a90 2023-12-19T05:41:51.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.890+0000 7fd3a7fff640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 0x7fd38806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:51.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.891+0000 7fd3a7fff640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 0x7fd38806c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:51.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:51.894+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3a80cc090 con 0x7fd3a80d0a90 2023-12-19T05:41:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.090+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a80cc090 con 0x7fd3a80d0a90 2023-12-19T05:41:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.091+0000 7fd3a4ff9640 1 -- 172.21.15.49:0/2210236893 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fd3a80cc090 con 0x7fd3a80d0a90 2023-12-19T05:41:52.094 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:52.094 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:38.407362+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:52.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.094+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 msgr2=0x7fd38806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.094+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 0x7fd38806c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390008040 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.094+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 msgr2=0x7fd3a81e85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.094+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd398036040 tx=0x7fd398004a40 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 shutdown_connections 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd38806a430 0x7fd38806c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3a8146e30 0x7fd3a813a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3a80d0a90 0x7fd3a81e85d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 --2- 172.21.15.49:0/2210236893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3a80b7ea0 0x7fd3a80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 >> 172.21.15.49:0/2210236893 conn(0x7fd3a80b2990 msgr2=0x7fd3a81460f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 shutdown_connections 2023-12-19T05:41:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.095+0000 7fd3ad079640 1 -- 172.21.15.49:0/2210236893 wait complete. 2023-12-19T05:41:52.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:41:01.033356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:41:02.017190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:41:52.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:41:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.347+0000 7faaedcda640 1 Processor -- start 2023-12-19T05:41:52.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.347+0000 7faaedcda640 1 -- start start 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.348+0000 7faaedcda640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.348+0000 7faaedcda640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faae815d9e0 0x7faae80b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.348+0000 7faaedcda640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae80ccec0 con 0x7faae80cefd0 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.348+0000 7faaedcda640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80cc2b0 con 0x7faae815d9e0 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.348+0000 7faaedcda640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae80cc590 con 0x7faae80cebf0 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faae815d9e0 0x7faae80b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faae815d9e0 0x7faae80b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41632/0 (socket says 172.21.15.49:41632) 2023-12-19T05:41:52.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 -- 172.21.15.49:0/2395898596 learned_addr learned my addr 172.21.15.49:0/2395898596 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaeccd8640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 -- 172.21.15.49:0/2395898596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 msgr2=0x7faae80cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae80cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 -- 172.21.15.49:0/2395898596 >> v1:172.21.15.115:6789/0 conn(0x7faae80cefd0 legacy=0x7faae815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.349+0000 7faaed4d9640 1 -- 172.21.15.49:0/2395898596 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80cc870 con 0x7faae815d9e0 2023-12-19T05:41:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.350+0000 7faaed4d9640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae815d9e0 0x7faae80b12e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faae0009e50 tx=0x7faae002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c0eb6eae41659b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faae77fe640 1 -- 172.21.15.49:0/2395898596 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae002ca70 con 0x7faae815d9e0 2023-12-19T05:41:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faae77fe640 1 -- 172.21.15.49:0/2395898596 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae002cbd0 con 0x7faae815d9e0 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faae77fe640 1 -- 172.21.15.49:0/2395898596 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00343f0 con 0x7faae815d9e0 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 -- 172.21.15.49:0/2395898596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae815d9e0 msgr2=0x7faae80b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae815d9e0 0x7faae80b12e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faae0009e50 tx=0x7faae002bed0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 -- 172.21.15.49:0/2395898596 shutdown_connections 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae815d9e0 0x7faae80b12e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 --2- 172.21.15.49:0/2395898596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.351+0000 7faaedcda640 1 -- 172.21.15.49:0/2395898596 >> 172.21.15.49:0/2395898596 conn(0x7faae806f630 msgr2=0x7faae806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.352+0000 7faaedcda640 1 -- 172.21.15.49:0/2395898596 shutdown_connections 2023-12-19T05:41:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.352+0000 7faaedcda640 1 -- 172.21.15.49:0/2395898596 wait complete. 2023-12-19T05:41:52.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.353+0000 7faaedcda640 1 Processor -- start 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 -- start start 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae8140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae815d9e0 0x7faae80af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8140f90 con 0x7faae80cefd0 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8141270 con 0x7faae815d9e0 2023-12-19T05:41:52.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.354+0000 7faaedcda640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae8141550 con 0x7faae80cebf0 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41644/0 (socket says 172.21.15.49:41644) 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 -- 172.21.15.49:0/666561278 learned_addr learned my addr 172.21.15.49:0/666561278 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 -- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 msgr2=0x7faae8140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae8140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 -- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae815d9e0 msgr2=0x7faae80af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae815d9e0 0x7faae80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.355+0000 7faae7fff640 1 -- 172.21.15.49:0/666561278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0009b30 con 0x7faae80cefd0 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faae7fff640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faad400c430 tx=0x7faad400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4011790 con 0x7faae80cefd0 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40118f0 con 0x7faae80cefd0 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4011ce0 con 0x7faae80cefd0 2023-12-19T05:41:52.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae8141830 con 0x7faae80cefd0 2023-12-19T05:41:52.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.356+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae8151070 con 0x7faae80cefd0 2023-12-19T05:41:52.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.357+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae8061910 con 0x7faae80cefd0 2023-12-19T05:41:52.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.358+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faad401c460 con 0x7faae80cefd0 2023-12-19T05:41:52.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.359+0000 7faae57fa640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 0x7faacc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.359+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad4088930 con 0x7faae80cefd0 2023-12-19T05:41:52.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.360+0000 7faaeccd8640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 0x7faacc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.361+0000 7faaeccd8640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 0x7faacc06c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faadc006fd0 tx=0x7faadc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.363+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faad4053e80 con 0x7faae80cefd0 2023-12-19T05:41:52.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.565+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faae80b0730 con 0x7faae80cefd0 2023-12-19T05:41:52.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.565+0000 7faae57fa640 1 -- 172.21.15.49:0/666561278 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7faad40574a0 con 0x7faae80cefd0 2023-12-19T05:41:52.568 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:41:52.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 msgr2=0x7faacc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 0x7faacc06c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faadc006fd0 tx=0x7faadc008040 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 msgr2=0x7faae8154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faad400c430 tx=0x7faad400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 shutdown_connections 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faacc06a430 0x7faacc06c8f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae815d9e0 0x7faae80af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faae80cefd0 0x7faae8154370 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 --2- 172.21.15.49:0/666561278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faae80cebf0 0x7faae8140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 >> 172.21.15.49:0/666561278 conn(0x7faae806f630 msgr2=0x7faae80cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 shutdown_connections 2023-12-19T05:41:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.568+0000 7faaedcda640 1 -- 172.21.15.49:0/666561278 wait complete. 2023-12-19T05:41:52.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:41:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.822+0000 7f0e5d39f640 1 Processor -- start 2023-12-19T05:41:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.822+0000 7f0e5d39f640 1 -- start start 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e5d39f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e581449e0 0x7f0e580af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e5d39f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5806c6b0 0x7f0e580b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e5d39f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580afb10 con 0x7f0e580b0b50 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e5d39f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5806bb30 con 0x7f0e5806c6b0 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e5d39f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b0070 con 0x7f0e581449e0 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e567fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e580b0b50 0x7f0e5806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53446/0 (socket says 172.21.15.49:53446) 2023-12-19T05:41:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e567fc640 1 -- 172.21.15.49:0/439286080 learned_addr learned my addr 172.21.15.49:0/439286080 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:52.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e577fe640 1 --2- 172.21.15.49:0/439286080 >> v2:172.21.15.49:3300/0 conn(0x7f0e5806c6b0 0x7f0e580b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.824+0000 7f0e56ffd640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e581449e0 0x7f0e580af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e55ffb640 1 -- 172.21.15.49:0/439286080 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574861435 0 0) 0x7f0e580afb10 con 0x7f0e580b0b50 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e55ffb640 1 -- 172.21.15.49:0/439286080 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003520 con 0x7f0e580b0b50 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e577fe640 1 -- 172.21.15.49:0/439286080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e581449e0 msgr2=0x7f0e580af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e577fe640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e581449e0 0x7f0e580af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e577fe640 1 -- 172.21.15.49:0/439286080 >> v1:172.21.15.49:6789/0 conn(0x7f0e580b0b50 legacy=0x7f0e5806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.825+0000 7f0e577fe640 1 -- 172.21.15.49:0/439286080 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580b0350 con 0x7f0e5806c6b0 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.826+0000 7f0e577fe640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5806c6b0 0x7f0e580b1710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b35681f31c4610 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.826+0000 7f0e55ffb640 1 -- 172.21.15.49:0/439286080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5002d040 con 0x7f0e5806c6b0 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.826+0000 7f0e55ffb640 1 -- 172.21.15.49:0/439286080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50031810 con 0x7f0e5806c6b0 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.826+0000 7f0e55ffb640 1 -- 172.21.15.49:0/439286080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50031ba0 con 0x7f0e5806c6b0 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 -- 172.21.15.49:0/439286080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5806c6b0 msgr2=0x7f0e580b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5806c6b0 0x7f0e580b1710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002b8b0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 -- 172.21.15.49:0/439286080 shutdown_connections 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5806c6b0 0x7f0e580b1710 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/439286080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e581449e0 0x7f0e580af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 -- 172.21.15.49:0/439286080 >> 172.21.15.49:0/439286080 conn(0x7f0e580cbb70 msgr2=0x7f0e580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 -- 172.21.15.49:0/439286080 shutdown_connections 2023-12-19T05:41:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.827+0000 7f0e5d39f640 1 -- 172.21.15.49:0/439286080 wait complete. 2023-12-19T05:41:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.829+0000 7f0e5d39f640 1 Processor -- start 2023-12-19T05:41:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.829+0000 7f0e5d39f640 1 -- start start 2023-12-19T05:41:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5806c6b0 0x7f0e5813dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e581449e0 0x7f0e581f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5813e000 con 0x7f0e580b0b50 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5813f0a0 con 0x7f0e581449e0 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e5d39f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581f6ae0 con 0x7f0e5806c6b0 2023-12-19T05:41:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.830+0000 7f0e567fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41662/0 (socket says 172.21.15.49:41662) 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 -- 172.21.15.49:0/3179480988 learned_addr learned my addr 172.21.15.49:0/3179480988 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e577fe640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e581449e0 0x7f0e581f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e56ffd640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5806c6b0 0x7f0e5813dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 -- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5806c6b0 msgr2=0x7f0e5813dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5806c6b0 0x7f0e5813dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 -- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e581449e0 msgr2=0x7f0e581f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e581449e0 0x7f0e581f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 -- 172.21.15.49:0/3179480988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009400 con 0x7f0e580b0b50 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.831+0000 7f0e567fc640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c500 tx=0x7f0e4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.832+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40005ce0 con 0x7f0e580b0b50 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.832+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40005e40 con 0x7f0e580b0b50 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.832+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40007330 con 0x7f0e580b0b50 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.832+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e581f6dc0 con 0x7f0e580b0b50 2023-12-19T05:41:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.832+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5813ed30 con 0x7f0e580b0b50 2023-12-19T05:41:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.833+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58061910 con 0x7f0e580b0b50 2023-12-19T05:41:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.834+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e40007550 con 0x7f0e580b0b50 2023-12-19T05:41:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.835+0000 7f0e4f7fe640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.835+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0e400880a0 con 0x7f0e580b0b50 2023-12-19T05:41:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.836+0000 7f0e56ffd640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.837+0000 7f0e56ffd640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 0x7f0e3806c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e480073f0 tx=0x7f0e4800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:52.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:52.839+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0e400536b0 con 0x7f0e580b0b50 2023-12-19T05:41:53.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.036+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e580ae560 con 0x7f0e580b0b50 2023-12-19T05:41:53.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.037+0000 7f0e4f7fe640 1 -- 172.21.15.49:0/3179480988 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e40056cd0 con 0x7f0e580b0b50 2023-12-19T05:41:53.039 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:41:53.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 msgr2=0x7f0e3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 0x7f0e3806c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e480073f0 tx=0x7f0e4800b040 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 msgr2=0x7f0e5813f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c500 tx=0x7f0e4000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 shutdown_connections 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e581449e0 0x7f0e581f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e580b0b50 0x7f0e5813f530 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 --2- 172.21.15.49:0/3179480988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5806c6b0 0x7f0e5813dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 >> 172.21.15.49:0/3179480988 conn(0x7f0e580cbb70 msgr2=0x7f0e58070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 shutdown_connections 2023-12-19T05:41:53.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.040+0000 7f0e5d39f640 1 -- 172.21.15.49:0/3179480988 wait complete. 2023-12-19T05:41:53.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:41:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.283+0000 7fdd03c26640 1 Processor -- start 2023-12-19T05:41:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.283+0000 7fdd03c26640 1 -- start start 2023-12-19T05:41:53.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd03c26640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdcfc157c30 0x7fdcfc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd03c26640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc0b0e90 con 0x7fdcfc0cde40 2023-12-19T05:41:53.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd03c26640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc15da00 con 0x7fdcfc0ad300 2023-12-19T05:41:53.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd03c26640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc15e940 con 0x7fdcfc157c30 2023-12-19T05:41:53.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd019c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdcfc157c30 0x7fdcfc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd019c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdcfc157c30 0x7fdcfc0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41666/0 (socket says 172.21.15.49:41666) 2023-12-19T05:41:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.284+0000 7fdd019c2640 1 -- 172.21.15.49:0/757231478 learned_addr learned my addr 172.21.15.49:0/757231478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.285+0000 7fdd019c2640 1 -- 172.21.15.49:0/757231478 >> v1:172.21.15.115:6789/0 conn(0x7fdcfc0ad300 legacy=0x7fdcfc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.285+0000 7fdd019c2640 1 -- 172.21.15.49:0/757231478 >> v1:172.21.15.49:6789/0 conn(0x7fdcfc0cde40 legacy=0x7fdcfc0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.285+0000 7fdd019c2640 1 -- 172.21.15.49:0/757231478 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0cf860 con 0x7fdcfc157c30 2023-12-19T05:41:53.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.286+0000 7fdd019c2640 1 --2- 172.21.15.49:0/757231478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc157c30 0x7fdcfc0cf320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009870 tx=0x7fdcf802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794d5f0027fc7c51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.286+0000 7fdd009c0640 1 -- 172.21.15.49:0/757231478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8030850 con 0x7fdcfc157c30 2023-12-19T05:41:53.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.286+0000 7fdd009c0640 1 -- 172.21.15.49:0/757231478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf80309b0 con 0x7fdcfc157c30 2023-12-19T05:41:53.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.286+0000 7fdd009c0640 1 -- 172.21.15.49:0/757231478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8030d40 con 0x7fdcfc157c30 2023-12-19T05:41:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 -- 172.21.15.49:0/757231478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc157c30 msgr2=0x7fdcfc0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 --2- 172.21.15.49:0/757231478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc157c30 0x7fdcfc0cf320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009870 tx=0x7fdcf802b990 comp rx=0 tx=0).stop 2023-12-19T05:41:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 -- 172.21.15.49:0/757231478 shutdown_connections 2023-12-19T05:41:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 --2- 172.21.15.49:0/757231478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc157c30 0x7fdcfc0cf320 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 -- 172.21.15.49:0/757231478 >> 172.21.15.49:0/757231478 conn(0x7fdcfc073150 msgr2=0x7fdcfc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:53.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 -- 172.21.15.49:0/757231478 shutdown_connections 2023-12-19T05:41:53.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.287+0000 7fdd03c26640 1 -- 172.21.15.49:0/757231478 wait complete. 2023-12-19T05:41:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.289+0000 7fdd03c26640 1 Processor -- start 2023-12-19T05:41:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.289+0000 7fdd03c26640 1 -- start start 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdcfc0ad300 0x7fdcfc14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcfc157c30 0x7fdcfc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc14dff0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc153e50 con 0x7fdcfc157c30 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd03c26640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc154130 con 0x7fdcfc0ad300 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd011c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd011c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41672/0 (socket says 172.21.15.49:41672) 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.290+0000 7fdd011c1640 1 -- 172.21.15.49:0/2956611000 learned_addr learned my addr 172.21.15.49:0/2956611000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd019c2640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdcfc0ad300 0x7fdcfc14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd021c3640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcfc157c30 0x7fdcfc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 -- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdcfc0ad300 msgr2=0x7fdcfc14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdcfc0ad300 0x7fdcfc14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 -- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcfc157c30 msgr2=0x7fdcfc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcfc157c30 0x7fdcfc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 -- 172.21.15.49:0/2956611000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80094d0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.291+0000 7fdd011c1640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c430 tx=0x7fdcec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.292+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011790 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.292+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec0118f0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.292+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011ce0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.292+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc1f3ae0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.292+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc1ea890 con 0x7fdcfc0cde40 2023-12-19T05:41:53.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.293+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc061910 con 0x7fdcfc0cde40 2023-12-19T05:41:53.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.294+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcec01c460 con 0x7fdcfc0cde40 2023-12-19T05:41:53.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.295+0000 7fdcf27fc640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 0x7fdce006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.295+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fdcec0889c0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.296+0000 7fdd019c2640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 0x7fdce006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.297+0000 7fdd019c2640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 0x7fdce006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8036000 tx=0x7fdcf803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.299+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdcec053e80 con 0x7fdcfc0cde40 2023-12-19T05:41:53.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.493+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcfc155a80 con 0x7fdcfc0cde40 2023-12-19T05:41:53.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.497+0000 7fdcf27fc640 1 -- 172.21.15.49:0/2956611000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcec0574a0 con 0x7fdcfc0cde40 2023-12-19T05:41:53.499 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 msgr2=0x7fdce006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 0x7fdce006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8036000 tx=0x7fdcf803b040 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 msgr2=0x7fdcfc1f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c430 tx=0x7fdcec00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 shutdown_connections 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdce006a430 0x7fdce006c8f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcfc157c30 0x7fdcfc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcfc0cde40 0x7fdcfc1f35a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 --2- 172.21.15.49:0/2956611000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdcfc0ad300 0x7fdcfc14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.499+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 >> 172.21.15.49:0/2956611000 conn(0x7fdcfc073150 msgr2=0x7fdcfc160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.501+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 shutdown_connections 2023-12-19T05:41:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.501+0000 7fdd03c26640 1 -- 172.21.15.49:0/2956611000 wait complete. 2023-12-19T05:41:53.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.745+0000 7f7105def640 1 Processor -- start 2023-12-19T05:41:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.746+0000 7f7105def640 1 -- start start 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.747+0000 7f7105def640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7100159f80 0x7f710006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.747+0000 7f7105def640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710006b520 con 0x7f710015b1e0 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.747+0000 7f7105def640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000b2b20 con 0x7f710015aa70 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.747+0000 7f7105def640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000b2fb0 con 0x7f7100159f80 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.748+0000 7f70fffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f710015b1e0 0x7f710015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53466/0 (socket says 172.21.15.49:53466) 2023-12-19T05:41:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.748+0000 7f70fffff640 1 -- 172.21.15.49:0/1693414375 learned_addr learned my addr 172.21.15.49:0/1693414375 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.748+0000 7f7104ded640 1 --2- 172.21.15.49:0/1693414375 >> v2:172.21.15.115:3300/0 conn(0x7f7100159f80 0x7f710006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.748+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234163816 0 0) 0x7f710006b520 con 0x7f710015b1e0 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.748+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f0003520 con 0x7f710015b1e0 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3558202394 0 0) 0x7f70f0003520 con 0x7f710015b1e0 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 >> v2:172.21.15.115:3300/0 conn(0x7f7100159f80 msgr2=0x7f710006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 --2- 172.21.15.49:0/1693414375 >> v2:172.21.15.115:3300/0 conn(0x7f7100159f80 0x7f710006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 >> v1:172.21.15.115:6789/0 conn(0x7f710015aa70 legacy=0x7f710015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000b1f10 con 0x7f710015b1e0 2023-12-19T05:41:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f70ec001670 con 0x7f710015b1e0 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 >> v1:172.21.15.49:6789/0 conn(0x7f710015b1e0 legacy=0x7f710015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 0x7f70f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f00047c0 0x7f70f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f0005180 0x7f70f000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b2fb0 con 0x7f70f0003970 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f000e240 con 0x7f70f0005180 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f000e400 con 0x7f70f00047c0 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.749+0000 7f7104ded640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 0x7f70f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f70fffff640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f00047c0 0x7f70f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f71055ee640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f0005180 0x7f70f000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f7104ded640 1 -- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f00047c0 msgr2=0x7f70f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f7104ded640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f00047c0 0x7f70f0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f7104ded640 1 -- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f0005180 msgr2=0x7f70f000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f7104ded640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f0005180 0x7f70f000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f7104ded640 1 -- 172.21.15.49:0/1693414375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0003520 con 0x7f70f0003970 2023-12-19T05:41:53.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.750+0000 7f71055ee640 1 -- 172.21.15.49:0/1693414375 reap_dead start 2023-12-19T05:41:53.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.751+0000 7f7104ded640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 0x7f70f0003d90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009ac0 tx=0x7f70f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd6d191f957af01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.751+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f402c6b0 con 0x7f70f0003970 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.751+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f402c810 con 0x7f70f0003970 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.751+0000 7f70ff7fe640 1 -- 172.21.15.49:0/1693414375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f402cba0 con 0x7f70f0003970 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 -- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 msgr2=0x7f70f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 0x7f70f0003d90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009ac0 tx=0x7f70f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 -- 172.21.15.49:0/1693414375 shutdown_connections 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 --2- 172.21.15.49:0/1693414375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f0003970 0x7f70f0003d90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 -- 172.21.15.49:0/1693414375 >> 172.21.15.49:0/1693414375 conn(0x7f71000b0100 msgr2=0x7f71000b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 -- 172.21.15.49:0/1693414375 shutdown_connections 2023-12-19T05:41:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.752+0000 7f7105def640 1 -- 172.21.15.49:0/1693414375 wait complete. 2023-12-19T05:41:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.754+0000 7f7105def640 1 Processor -- start 2023-12-19T05:41:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.754+0000 7f7105def640 1 -- start start 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f0003970 0x7f710014ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71001f1e60 0x7f7100149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100159860 con 0x7f710014d2c0 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710014bf80 con 0x7f71001f1e60 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f7105def640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710014c220 con 0x7f70f0003970 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f70fffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f70fffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41692/0 (socket says 172.21.15.49:41692) 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.755+0000 7f70fffff640 1 -- 172.21.15.49:0/1976469167 learned_addr learned my addr 172.21.15.49:0/1976469167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f71055ee640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71001f1e60 0x7f7100149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f7104ded640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f0003970 0x7f710014ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 -- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f0003970 msgr2=0x7f710014ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f0003970 0x7f710014ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 -- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71001f1e60 msgr2=0x7f7100149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71001f1e60 0x7f7100149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 -- 172.21.15.49:0/1976469167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710014c500 con 0x7f710014d2c0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.756+0000 7f70fffff640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f70ec000fb0 tx=0x7f70ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.757+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0074e0 con 0x7f710014d2c0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.757+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec007640 con 0x7f710014d2c0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.757+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec004a00 con 0x7f710014d2c0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.757+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710014c7e0 con 0x7f710014d2c0 2023-12-19T05:41:53.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.757+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710014cda0 con 0x7f710014d2c0 2023-12-19T05:41:53.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.758+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710014cf90 con 0x7f710014d2c0 2023-12-19T05:41:53.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.759+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70ec004b60 con 0x7f710014d2c0 2023-12-19T05:41:53.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.760+0000 7f70fd7fa640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:53.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.760+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f70ec0884d0 con 0x7f710014d2c0 2023-12-19T05:41:53.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.760+0000 7f7104ded640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:53.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.761+0000 7f7104ded640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 0x7f70e406c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70f4036000 tx=0x7f70f4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:53.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.764+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70ec053ae0 con 0x7f710014d2c0 2023-12-19T05:41:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:53.999+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7100061910 con 0x7f710014d2c0 2023-12-19T05:41:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.001+0000 7f70fd7fa640 1 -- 172.21.15.49:0/1976469167 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f70ec057100 con 0x7f710014d2c0 2023-12-19T05:41:54.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:54.002 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:54.003 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.003+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 msgr2=0x7f70e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.003+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 0x7f70e406c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70f4036000 tx=0x7f70f4030000 comp rx=0 tx=0).stop 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.003+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 msgr2=0x7f7100154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.003+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f70ec000fb0 tx=0x7f70ec00dc00 comp rx=0 tx=0).stop 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 shutdown_connections 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71001f1e60 0x7f7100149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f710014d2c0 0x7f7100154720 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 --2- 172.21.15.49:0/1976469167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f0003970 0x7f710014ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 >> 172.21.15.49:0/1976469167 conn(0x7f71000b0100 msgr2=0x7f71000cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 shutdown_connections 2023-12-19T05:41:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.004+0000 7f7105def640 1 -- 172.21.15.49:0/1976469167 wait complete. 2023-12-19T05:41:54.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:54.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.258+0000 7f8e91dae640 1 Processor -- start 2023-12-19T05:41:54.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.258+0000 7f8e91dae640 1 -- start start 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.260+0000 7f8e91dae640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e8c157aa0 0x7f8e8c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.260+0000 7f8e91dae640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 0x7f8e8c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.260+0000 7f8e91dae640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c06e8c0 con 0x7f8e8c06e410 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.260+0000 7f8e91dae640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c15e9f0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.260+0000 7f8e91dae640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b2600 con 0x7f8e8c15e040 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8e8c06e410 0x7f8e8c161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53452/0 (socket says 172.21.15.49:53452) 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8affd640 1 -- 172.21.15.49:0/2223377633 learned_addr learned my addr 172.21.15.49:0/2223377633 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:54.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e8c157aa0 0x7f8e8c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8bfff640 1 --2- 172.21.15.49:0/2223377633 >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 0x7f8e8c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8a7fc640 1 -- 172.21.15.49:0/2223377633 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721070917 0 0) 0x7f8e8c06e8c0 con 0x7f8e8c06e410 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8a7fc640 1 -- 172.21.15.49:0/2223377633 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e74003520 con 0x7f8e8c06e410 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8b7fe640 1 -- 172.21.15.49:0/2223377633 >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 msgr2=0x7f8e8c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8b7fe640 1 --2- 172.21.15.49:0/2223377633 >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 0x7f8e8c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8b7fe640 1 -- 172.21.15.49:0/2223377633 >> v1:172.21.15.49:6789/0 conn(0x7f8e8c06e410 legacy=0x7f8e8c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8b7fe640 1 -- 172.21.15.49:0/2223377633 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0b1d60 con 0x7f8e8c157aa0 2023-12-19T05:41:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.261+0000 7f8e8bfff640 1 --2- 172.21.15.49:0/2223377633 >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 0x7f8e8c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:54.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.263+0000 7f8e8b7fe640 1 --2- 172.21.15.49:0/2223377633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c0b1710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0b1c50 tx=0x7f8e7c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ebf1ca312977f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.263+0000 7f8e8a7fc640 1 -- 172.21.15.49:0/2223377633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c031830 con 0x7f8e8c157aa0 2023-12-19T05:41:54.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.263+0000 7f8e8a7fc640 1 -- 172.21.15.49:0/2223377633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c031990 con 0x7f8e8c157aa0 2023-12-19T05:41:54.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.263+0000 7f8e8a7fc640 1 -- 172.21.15.49:0/2223377633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c031d20 con 0x7f8e8c157aa0 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 -- 172.21.15.49:0/2223377633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 msgr2=0x7f8e8c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 --2- 172.21.15.49:0/2223377633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c0b1710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0b1c50 tx=0x7f8e7c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 -- 172.21.15.49:0/2223377633 shutdown_connections 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 --2- 172.21.15.49:0/2223377633 >> v2:172.21.15.115:3300/0 conn(0x7f8e8c15e040 0x7f8e8c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 --2- 172.21.15.49:0/2223377633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c0b1710 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 -- 172.21.15.49:0/2223377633 >> 172.21.15.49:0/2223377633 conn(0x7f8e8c0cbb70 msgr2=0x7f8e8c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:54.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 -- 172.21.15.49:0/2223377633 shutdown_connections 2023-12-19T05:41:54.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.264+0000 7f8e91dae640 1 -- 172.21.15.49:0/2223377633 wait complete. 2023-12-19T05:41:54.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.266+0000 7f8e91dae640 1 Processor -- start 2023-12-19T05:41:54.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.266+0000 7f8e91dae640 1 -- start start 2023-12-19T05:41:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c06e410 0x7f8e8c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e8c15e040 0x7f8e8c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0af140 con 0x7f8e8c157aa0 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c155600 con 0x7f8e8c06e410 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e91dae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1558e0 con 0x7f8e8c15e040 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42644/0 (socket says 172.21.15.49:42644) 2023-12-19T05:41:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.267+0000 7f8e8affd640 1 -- 172.21.15.49:0/3281456345 learned_addr learned my addr 172.21.15.49:0/3281456345 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8bfff640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e8c15e040 0x7f8e8c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8b7fe640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c06e410 0x7f8e8c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 -- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e8c15e040 msgr2=0x7f8e8c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e8c15e040 0x7f8e8c06c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 -- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c06e410 msgr2=0x7f8e8c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c06e410 0x7f8e8c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 -- 172.21.15.49:0/3281456345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009400 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.268+0000 7f8e8affd640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c410 tx=0x7f8e8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.269+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80005ce0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.269+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80005e40 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.269+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c155bc0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.269+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800072f0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.269+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c156180 con 0x7f8e8c157aa0 2023-12-19T05:41:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.270+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c061910 con 0x7f8e8c157aa0 2023-12-19T05:41:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.271+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e80007510 con 0x7f8e8c157aa0 2023-12-19T05:41:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.272+0000 7f8e73fff640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 0x7f8e7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.272+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8e800880b0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.273+0000 7f8e8b7fe640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 0x7f8e7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.274+0000 7f8e8b7fe640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 0x7f8e7806c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c036000 tx=0x7f8e7c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.276+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e80053630 con 0x7f8e8c157aa0 2023-12-19T05:41:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.471+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e8c071ae0 con 0x7f8e8c157aa0 2023-12-19T05:41:54.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.473+0000 7f8e73fff640 1 -- 172.21.15.49:0/3281456345 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f8e8005be60 con 0x7f8e8c157aa0 2023-12-19T05:41:54.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:54.475 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:53.492511+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.1b","mappings":[{"from":5,"to":7}]},{"pgid":"7.2b","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:54.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.476+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 msgr2=0x7f8e7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.476+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 0x7f8e7806c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c036000 tx=0x7f8e7c03c040 comp rx=0 tx=0).stop 2023-12-19T05:41:54.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 msgr2=0x7f8e8c06c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c410 tx=0x7f8e8000c8d0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 shutdown_connections 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8e7806a430 0x7f8e7806c8f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e8c15e040 0x7f8e8c06c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e8c157aa0 0x7f8e8c06c1b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 --2- 172.21.15.49:0/3281456345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c06e410 0x7f8e8c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 >> 172.21.15.49:0/3281456345 conn(0x7f8e8c0cbb70 msgr2=0x7f8e8c0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 shutdown_connections 2023-12-19T05:41:54.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.477+0000 7f8e91dae640 1 -- 172.21.15.49:0/3281456345 wait complete. 2023-12-19T05:41:54.497 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:41:54.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.728+0000 7f8ffb101640 1 Processor -- start 2023-12-19T05:41:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.728+0000 7f8ffb101640 1 -- start start 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.729+0000 7f8ffb101640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ff40b8070 0x7f8ff40d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ffb101640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff40d12d0 con 0x7f8ff40d0a90 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ffb101640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff40d15b0 con 0x7f8ff4146e30 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ffb101640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff4147210 con 0x7f8ff40b8070 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ffa900640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ff40d0a90 0x7f8ff415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53468/0 (socket says 172.21.15.49:53468) 2023-12-19T05:41:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ffa900640 1 -- 172.21.15.49:0/3913641402 learned_addr learned my addr 172.21.15.49:0/3913641402 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ff98fe640 1 --2- 172.21.15.49:0/3913641402 >> v2:172.21.15.115:3300/0 conn(0x7f8ff40b8070 0x7f8ff40d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213081280 0 0) 0x7f8ff40d12d0 con 0x7f8ff40d0a90 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.730+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fdc003520 con 0x7f8ff40d0a90 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 664660963 0 0) 0x7f8fdc003520 con 0x7f8ff40d0a90 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 >> v2:172.21.15.115:3300/0 conn(0x7f8ff40b8070 msgr2=0x7f8ff40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 --2- 172.21.15.49:0/3913641402 >> v2:172.21.15.115:3300/0 conn(0x7f8ff40b8070 0x7f8ff40d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 >> v1:172.21.15.115:6789/0 conn(0x7f8ff4146e30 legacy=0x7f8ff40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40d1890 con 0x7f8ff40d0a90 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8fec001670 con 0x7f8ff40d0a90 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 >> v1:172.21.15.49:6789/0 conn(0x7f8ff40d0a90 legacy=0x7f8ff415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fdc0047c0 0x7f8fdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 0x7f8fdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4147210 con 0x7f8fdc0051d0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc00c120 con 0x7f8fdc0039c0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc00c2e0 con 0x7f8fdc0047c0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.731+0000 7f8ffa900640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 0x7f8fdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa0ff640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ff98fe640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fdc0047c0 0x7f8fdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa900640 1 -- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fdc0047c0 msgr2=0x7f8fdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa900640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fdc0047c0 0x7f8fdc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa900640 1 -- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0039c0 msgr2=0x7f8fdc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa900640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ffa900640 1 -- 172.21.15.49:0/3913641402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc003520 con 0x7f8fdc0051d0 2023-12-19T05:41:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.732+0000 7f8ff98fe640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fdc0047c0 0x7f8fdc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.733+0000 7f8ffa900640 1 -- 172.21.15.49:0/3913641402 reap_dead start 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.733+0000 7f8ffa900640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 0x7f8fdc00b980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001eb0 tx=0x7f8fdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733edb177a4a19c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.733+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005ad0 con 0x7f8fdc0051d0 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.733+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec005c30 con 0x7f8fdc0051d0 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.733+0000 7f8ff90fd640 1 -- 172.21.15.49:0/3913641402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec02c7c0 con 0x7f8fdc0051d0 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 -- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 msgr2=0x7f8fdc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 0x7f8fdc00b980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001eb0 tx=0x7f8fdc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 -- 172.21.15.49:0/3913641402 shutdown_connections 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 --2- 172.21.15.49:0/3913641402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fdc0051d0 0x7f8fdc00b980 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 -- 172.21.15.49:0/3913641402 >> 172.21.15.49:0/3913641402 conn(0x7f8ff40b2990 msgr2=0x7f8ff40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 -- 172.21.15.49:0/3913641402 shutdown_connections 2023-12-19T05:41:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.734+0000 7f8ffb101640 1 -- 172.21.15.49:0/3913641402 wait complete. 2023-12-19T05:41:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.736+0000 7f8ffb101640 1 Processor -- start 2023-12-19T05:41:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.736+0000 7f8ffb101640 1 -- start start 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0051d0 0x7f8ff413d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ff413da10 0x7f8ff41e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41e20c0 con 0x7f8ff41e5da0 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41f2340 con 0x7f8fdc0051d0 2023-12-19T05:41:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.737+0000 7f8ffb101640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41e1de0 con 0x7f8ff413da10 2023-12-19T05:41:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42664/0 (socket says 172.21.15.49:42664) 2023-12-19T05:41:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 -- 172.21.15.49:0/2678375099 learned_addr learned my addr 172.21.15.49:0/2678375099 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa0ff640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0051d0 0x7f8ff413d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ff98fe640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ff413da10 0x7f8ff41e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 -- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ff413da10 msgr2=0x7f8ff41e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ff413da10 0x7f8ff41e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 -- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0051d0 msgr2=0x7f8ff413d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0051d0 0x7f8ff413d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 -- 172.21.15.49:0/2678375099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff41df280 con 0x7f8ff41e5da0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.738+0000 7f8ffa900640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001eb0 tx=0x7f8fec001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.739+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec02c7c0 con 0x7f8ff41e5da0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.739+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec02c920 con 0x7f8ff41e5da0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.739+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec02ccd0 con 0x7f8ff41e5da0 2023-12-19T05:41:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.739+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff41df560 con 0x7f8ff41e5da0 2023-12-19T05:41:54.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.739+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff41e1a90 con 0x7f8ff41e5da0 2023-12-19T05:41:54.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.740+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff4061910 con 0x7f8ff41e5da0 2023-12-19T05:41:54.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.741+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8fec032070 con 0x7f8ff41e5da0 2023-12-19T05:41:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.742+0000 7f8ff2ffd640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 0x7f8fe006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.742+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8fec03c070 con 0x7f8ff41e5da0 2023-12-19T05:41:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.743+0000 7f8ffa0ff640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 0x7f8fe006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:54.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.744+0000 7f8ffa0ff640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 0x7f8fe006c940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4003fd0 tx=0x7f8fe4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:54.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.746+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8fec075200 con 0x7f8ff41e5da0 2023-12-19T05:41:54.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.979+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ff40b5c50 con 0x7f8ff41e5da0 2023-12-19T05:41:54.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.980+0000 7f8ff2ffd640 1 -- 172.21.15.49:0/2678375099 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f8fec078820 con 0x7f8ff41e5da0 2023-12-19T05:41:54.981 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:54.982 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 msgr2=0x7f8fe006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 0x7f8fe006c940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4003fd0 tx=0x7f8fe4009040 comp rx=0 tx=0).stop 2023-12-19T05:41:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 msgr2=0x7f8ff41e6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001eb0 tx=0x7f8fec001930 comp rx=0 tx=0).stop 2023-12-19T05:41:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 shutdown_connections 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8fe006a480 0x7f8fe006c940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ff413da10 0x7f8ff41e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff41e5da0 0x7f8ff41e6220 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 --2- 172.21.15.49:0/2678375099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fdc0051d0 0x7f8ff413d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 >> 172.21.15.49:0/2678375099 conn(0x7f8ff40b2990 msgr2=0x7f8ff40b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 shutdown_connections 2023-12-19T05:41:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:54.983+0000 7f8ffb101640 1 -- 172.21.15.49:0/2678375099 wait complete. 2023-12-19T05:41:55.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:41:55.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.240+0000 7fee5c71b640 1 Processor -- start 2023-12-19T05:41:55.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.240+0000 7fee5c71b640 1 -- start start 2023-12-19T05:41:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5c71b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee541449e0 0x7fee540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5c71b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee5406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5c71b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540afb10 con 0x7fee5406b590 2023-12-19T05:41:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5c71b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5406bb30 con 0x7fee541449e0 2023-12-19T05:41:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5c71b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b0070 con 0x7fee540b0b50 2023-12-19T05:41:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5a4b7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee541449e0 0x7fee540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5a4b7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee541449e0 0x7fee540af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42674/0 (socket says 172.21.15.49:42674) 2023-12-19T05:41:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee5a4b7640 1 -- 172.21.15.49:0/2098838745 learned_addr learned my addr 172.21.15.49:0/2098838745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.242+0000 7fee59cb6640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee5406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.243+0000 7fee5a4b7640 1 -- 172.21.15.49:0/2098838745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 msgr2=0x7fee5406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.243+0000 7fee5a4b7640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee5406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.243+0000 7fee5a4b7640 1 -- 172.21.15.49:0/2098838745 >> v1:172.21.15.115:6789/0 conn(0x7fee5406b590 legacy=0x7fee5415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.243+0000 7fee5a4b7640 1 -- 172.21.15.49:0/2098838745 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540b0350 con 0x7fee541449e0 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.243+0000 7fee59cb6640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee5406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.244+0000 7fee5a4b7640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee540af5d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fee50009870 tx=0x7fee5002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a7aef8e503c1f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.244+0000 7fee594b5640 1 -- 172.21.15.49:0/2098838745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031640 con 0x7fee541449e0 2023-12-19T05:41:55.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.244+0000 7fee594b5640 1 -- 172.21.15.49:0/2098838745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500317a0 con 0x7fee541449e0 2023-12-19T05:41:55.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.244+0000 7fee594b5640 1 -- 172.21.15.49:0/2098838745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031b30 con 0x7fee541449e0 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 -- 172.21.15.49:0/2098838745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 msgr2=0x7fee540af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee540af5d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fee50009870 tx=0x7fee5002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 -- 172.21.15.49:0/2098838745 shutdown_connections 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee5406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 --2- 172.21.15.49:0/2098838745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee540af5d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 -- 172.21.15.49:0/2098838745 >> 172.21.15.49:0/2098838745 conn(0x7fee540cbb70 msgr2=0x7fee540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 -- 172.21.15.49:0/2098838745 shutdown_connections 2023-12-19T05:41:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.245+0000 7fee5c71b640 1 -- 172.21.15.49:0/2098838745 wait complete. 2023-12-19T05:41:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.247+0000 7fee5c71b640 1 Processor -- start 2023-12-19T05:41:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.247+0000 7fee5c71b640 1 -- start start 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5406b590 0x7fee540ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee541f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541f4a10 con 0x7fee541449e0 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540ab4f0 con 0x7fee5406b590 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5c71b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee54157d50 con 0x7fee540b0b50 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5acb8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5acb8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42678/0 (socket says 172.21.15.49:42678) 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.248+0000 7fee5acb8640 1 -- 172.21.15.49:0/4046564044 learned_addr learned my addr 172.21.15.49:0/4046564044 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5a4b7640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5406b590 0x7fee540ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee59cb6640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee541f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 -- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 msgr2=0x7fee541f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee541f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 -- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5406b590 msgr2=0x7fee540ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5406b590 0x7fee540ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 -- 172.21.15.49:0/4046564044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500094d0 con 0x7fee541449e0 2023-12-19T05:41:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5acb8640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00b970 tx=0x7fee4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00cb40 con 0x7fee541449e0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00cca0 con 0x7fee541449e0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c014680 con 0x7fee541449e0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.249+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540ada20 con 0x7fee541449e0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.250+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540adfe0 con 0x7fee541449e0 2023-12-19T05:41:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.251+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee54061910 con 0x7fee541449e0 2023-12-19T05:41:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.252+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee4c01d3b0 con 0x7fee541449e0 2023-12-19T05:41:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.253+0000 7fee46ffd640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 0x7fee3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.253+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fee4c088850 con 0x7fee541449e0 2023-12-19T05:41:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.253+0000 7fee5a4b7640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 0x7fee3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.254+0000 7fee5a4b7640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 0x7fee3806c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee50036000 tx=0x7fee5003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.258+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee4c053db0 con 0x7fee541449e0 2023-12-19T05:41:55.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.488+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee540ae560 con 0x7fee541449e0 2023-12-19T05:41:55.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.489+0000 7fee46ffd640 1 -- 172.21.15.49:0/4046564044 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fee4c0573d0 con 0x7fee541449e0 2023-12-19T05:41:55.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:55.490 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:41:02.974860+0000","modified":"2023-12-19T05:41:06.199018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5541":{"gid":5541,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4133391224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4133391224},{"type":"v1","addr":"172.21.15.49:6835","nonce":4133391224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T05:41:55.491 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-12-19T05:41:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.491+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 msgr2=0x7fee3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.491+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 0x7fee3806c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee50036000 tx=0x7fee5003c040 comp rx=0 tx=0).stop 2023-12-19T05:41:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.491+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 msgr2=0x7fee54157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.491+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00b970 tx=0x7fee4c00be30 comp rx=0 tx=0).stop 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 shutdown_connections 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee3806a430 0x7fee3806c8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee540b0b50 0x7fee541f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee541449e0 0x7fee54157810 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 --2- 172.21.15.49:0/4046564044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5406b590 0x7fee540ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 >> 172.21.15.49:0/4046564044 conn(0x7fee540cbb70 msgr2=0x7fee5415b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 shutdown_connections 2023-12-19T05:41:55.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.492+0000 7fee5c71b640 1 -- 172.21.15.49:0/4046564044 wait complete. 2023-12-19T05:41:55.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:41:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.748+0000 7f998e20b640 1 Processor -- start 2023-12-19T05:41:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.748+0000 7f998e20b640 1 -- start start 2023-12-19T05:41:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f998e20b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f9988166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f998e20b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998806bb30 con 0x7f99880b0b50 2023-12-19T05:41:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f998e20b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880b0070 con 0x7f99881449e0 2023-12-19T05:41:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f998e20b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b0350 con 0x7f998806c6b0 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f9986ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f99880b0b50 0x7f998806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53480/0 (socket says 172.21.15.49:53480) 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.750+0000 7f9986ffd640 1 -- 172.21.15.49:0/907899571 learned_addr learned my addr 172.21.15.49:0/907899571 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f9987fff640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f9988166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872664626 0 0) 0x7f998806bb30 con 0x7f99880b0b50 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9974003520 con 0x7f99880b0b50 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445420668 0 0) 0x7f9974003520 con 0x7f99880b0b50 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 msgr2=0x7f9988166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f9988166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 >> v1:172.21.15.115:6789/0 conn(0x7f99881449e0 legacy=0x7f99880af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880b0630 con 0x7f99880b0b50 2023-12-19T05:41:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9970001670 con 0x7f99880b0b50 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 >> v1:172.21.15.49:6789/0 conn(0x7f99880b0b50 legacy=0x7f998806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974003a10 0x7f9974003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f99740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9974004d00 0x7f9974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b0350 con 0x7f9974003a10 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997400bb10 con 0x7f9974004d00 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.751+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997400bcd0 con 0x7f998806c6b0 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974003a10 0x7f9974003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f9986ffd640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f99740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f9987fff640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9974004d00 0x7f9974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 -- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 msgr2=0x7f99740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f998806c6b0 0x7f99740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 -- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9974004d00 msgr2=0x7f9974005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9974004d00 0x7f9974005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f99877fe640 1 -- 172.21.15.49:0/907899571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974003520 con 0x7f9974003a10 2023-12-19T05:41:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.752+0000 7f9987fff640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9974004d00 0x7f9974005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.753+0000 7f99877fe640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974003a10 0x7f9974003e30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9978001e20 tx=0x7f99740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d2a01de4d35ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978003b70 con 0x7f9974003a10 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9978003cd0 con 0x7f9974003a10 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f99867fc640 1 -- 172.21.15.49:0/907899571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978005310 con 0x7f9974003a10 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 -- 172.21.15.49:0/907899571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974003a10 msgr2=0x7f9974003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 --2- 172.21.15.49:0/907899571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974003a10 0x7f9974003e30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9978001e20 tx=0x7f99740057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f9987fff640 1 -- 172.21.15.49:0/907899571 reap_dead start 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 -- 172.21.15.49:0/907899571 shutdown_connections 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 -- 172.21.15.49:0/907899571 >> 172.21.15.49:0/907899571 conn(0x7f99880cbb70 msgr2=0x7f99880cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 -- 172.21.15.49:0/907899571 shutdown_connections 2023-12-19T05:41:55.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.754+0000 7f998e20b640 1 -- 172.21.15.49:0/907899571 wait complete. 2023-12-19T05:41:55.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.756+0000 7f998e20b640 1 Processor -- start 2023-12-19T05:41:55.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.756+0000 7f998e20b640 1 -- start start 2023-12-19T05:41:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974003a10 0x7f998815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998815a8f0 0x7f998815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988142eb0 con 0x7f99881f2de0 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881f3b10 con 0x7f998815a8f0 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.757+0000 7f998e20b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998815b2b0 con 0x7f9974003a10 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42700/0 (socket says 172.21.15.49:42700) 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 -- 172.21.15.49:0/3386474749 learned_addr learned my addr 172.21.15.49:0/3386474749 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f99877fe640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974003a10 0x7f998815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9986ffd640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998815a8f0 0x7f998815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 -- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974003a10 msgr2=0x7f998815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974003a10 0x7f998815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 -- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998815a8f0 msgr2=0x7f998815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998815a8f0 0x7f998815ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.758+0000 7f9987fff640 1 -- 172.21.15.49:0/3386474749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99881432d0 con 0x7f99881f2de0 2023-12-19T05:41:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f9987fff640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f99880b2960 tx=0x7f9980010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000e8d0 con 0x7f99881f2de0 2023-12-19T05:41:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998000ea50 con 0x7f99881f2de0 2023-12-19T05:41:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000ee00 con 0x7f99881f2de0 2023-12-19T05:41:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988142510 con 0x7f99881f2de0 2023-12-19T05:41:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.759+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988142ad0 con 0x7f99881f2de0 2023-12-19T05:41:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.760+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9988142ff0 con 0x7f99881f2de0 2023-12-19T05:41:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.761+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9980020410 con 0x7f99881f2de0 2023-12-19T05:41:55.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.762+0000 7f997ffff640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 0x7f996806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.762+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9980088150 con 0x7f99881f2de0 2023-12-19T05:41:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.763+0000 7f99877fe640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 0x7f996806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:55.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.764+0000 7f99877fe640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 0x7f996806c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9978001e20 tx=0x7f9978009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:55.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.766+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9988142ff0 con 0x7f99881f2de0 2023-12-19T05:41:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.962+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9988142ff0 con 0x7f99881f2de0 2023-12-19T05:41:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.964+0000 7f997ffff640 1 -- 172.21.15.49:0/3386474749 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f9988142ff0 con 0x7f99881f2de0 2023-12-19T05:41:55.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:41:55.966 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:53.492511+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:41:01.033356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T05:41:02.017190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.1b","mappings":[{"from":5,"to":7}]},{"pgid":"7.2b","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:41:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 msgr2=0x7f996806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 0x7f996806c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9978001e20 tx=0x7f9978009030 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 msgr2=0x7f99881f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f99880b2960 tx=0x7f9980010c20 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 shutdown_connections 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f996806a430 0x7f996806c8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99881f2de0 0x7f99881f3260 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998815a8f0 0x7f998815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 --2- 172.21.15.49:0/3386474749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974003a10 0x7f998815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 >> 172.21.15.49:0/3386474749 conn(0x7f99880cbb70 msgr2=0x7f998806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 shutdown_connections 2023-12-19T05:41:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:55.967+0000 7f998e20b640 1 -- 172.21.15.49:0/3386474749 wait complete. 2023-12-19T05:41:55.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:41:56.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:56.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:56.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.217+0000 7fef55d0a640 1 Processor -- start 2023-12-19T05:41:56.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.217+0000 7fef55d0a640 1 -- start start 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.218+0000 7fef55d0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef50146e10 0x7fef500d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.218+0000 7fef55d0a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef500ce110 0x7fef500ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.218+0000 7fef55d0a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500cd840 con 0x7fef500d2b00 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.218+0000 7fef55d0a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500d2430 con 0x7fef500ce110 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.218+0000 7fef55d0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500ceae0 con 0x7fef50146e10 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.219+0000 7fef4effd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef500d2b00 0x7fef500b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53484/0 (socket says 172.21.15.49:53484) 2023-12-19T05:41:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.219+0000 7fef4effd640 1 -- 172.21.15.49:0/2257821322 learned_addr learned my addr 172.21.15.49:0/2257821322 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.219+0000 7fef4ffff640 1 --2- 172.21.15.49:0/2257821322 >> v2:172.21.15.49:3300/0 conn(0x7fef500ce110 0x7fef500ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.219+0000 7fef4f7fe640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef50146e10 0x7fef500d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.220+0000 7fef4ffff640 1 -- 172.21.15.49:0/2257821322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef50146e10 msgr2=0x7fef500d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.220+0000 7fef4ffff640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef50146e10 0x7fef500d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.220+0000 7fef4ffff640 1 -- 172.21.15.49:0/2257821322 >> v1:172.21.15.49:6789/0 conn(0x7fef500d2b00 legacy=0x7fef500b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.220+0000 7fef4ffff640 1 -- 172.21.15.49:0/2257821322 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500b6e90 con 0x7fef500ce110 2023-12-19T05:41:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.220+0000 7fef4e7fc640 1 -- 172.21.15.49:0/2257821322 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590916832 0 0) 0x7fef500cd840 con 0x7fef500d2b00 2023-12-19T05:41:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.221+0000 7fef4ffff640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500ce110 0x7fef500ce5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fef48009dc0 tx=0x7fef4802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0fafe3ed8ae35e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.221+0000 7fef4e7fc640 1 -- 172.21.15.49:0/2257821322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4802cc40 con 0x7fef500ce110 2023-12-19T05:41:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.221+0000 7fef4e7fc640 1 -- 172.21.15.49:0/2257821322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4802cda0 con 0x7fef500ce110 2023-12-19T05:41:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.221+0000 7fef4e7fc640 1 -- 172.21.15.49:0/2257821322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48034660 con 0x7fef500ce110 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 -- 172.21.15.49:0/2257821322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500ce110 msgr2=0x7fef500ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500ce110 0x7fef500ce5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fef48009dc0 tx=0x7fef4802be90 comp rx=0 tx=0).stop 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 -- 172.21.15.49:0/2257821322 shutdown_connections 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500ce110 0x7fef500ce5a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2257821322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef50146e10 0x7fef500d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 -- 172.21.15.49:0/2257821322 >> 172.21.15.49:0/2257821322 conn(0x7fef500b29c0 msgr2=0x7fef500b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 -- 172.21.15.49:0/2257821322 shutdown_connections 2023-12-19T05:41:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.222+0000 7fef55d0a640 1 -- 172.21.15.49:0/2257821322 wait complete. 2023-12-19T05:41:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.224+0000 7fef55d0a640 1 Processor -- start 2023-12-19T05:41:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.224+0000 7fef55d0a640 1 -- start start 2023-12-19T05:41:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef500ce110 0x7fef5015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 0x7fef5015f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500b1ad0 con 0x7fef500d2b00 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015e740 con 0x7fef50146e10 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef55d0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015b7a0 con 0x7fef500ce110 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.225+0000 7fef4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42722/0 (socket says 172.21.15.49:42722) 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 -- 172.21.15.49:0/2580867109 learned_addr learned my addr 172.21.15.49:0/2580867109 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4f7fe640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef500ce110 0x7fef5015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4ffff640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 0x7fef5015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 -- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef500ce110 msgr2=0x7fef5015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef500ce110 0x7fef5015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 -- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 msgr2=0x7fef5015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 0x7fef5015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 -- 172.21.15.49:0/2580867109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009a70 con 0x7fef500d2b00 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4ffff640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 0x7fef5015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.226+0000 7fef4effd640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c500 tx=0x7fef4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.227+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007560 con 0x7fef500d2b00 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.227+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440047e0 con 0x7fef500d2b00 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.227+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef500b1d20 con 0x7fef500d2b00 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.227+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44004b90 con 0x7fef500d2b00 2023-12-19T05:41:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.227+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5015c0b0 con 0x7fef500d2b00 2023-12-19T05:41:56.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.228+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef500b2240 con 0x7fef500d2b00 2023-12-19T05:41:56.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.229+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef44004cf0 con 0x7fef500d2b00 2023-12-19T05:41:56.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.230+0000 7fef37fff640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 0x7fef3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.230+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fef44087e90 con 0x7fef500d2b00 2023-12-19T05:41:56.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.231+0000 7fef4f7fe640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 0x7fef3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.232+0000 7fef4f7fe640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 0x7fef3c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fef40006fd0 tx=0x7fef40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.234+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef500b2240 con 0x7fef500d2b00 2023-12-19T05:41:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.474+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef5015e510 con 0x7fef500d2b00 2023-12-19T05:41:56.477 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:41:56.476+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:41:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.491+0000 7fef37fff640 1 -- 172.21.15.49:0/2580867109 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef5015e510 con 0x7fef500d2b00 2023-12-19T05:41:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:41:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 msgr2=0x7fef3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 0x7fef3c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fef40006fd0 tx=0x7fef40008040 comp rx=0 tx=0).stop 2023-12-19T05:41:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 msgr2=0x7fef5015ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c500 tx=0x7fef4400c9c0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 shutdown_connections 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef3c06a430 0x7fef3c06c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50146e10 0x7fef5015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef500d2b00 0x7fef5015ebd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 --2- 172.21.15.49:0/2580867109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef500ce110 0x7fef5015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 >> 172.21.15.49:0/2580867109 conn(0x7fef500b29c0 msgr2=0x7fef500b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 shutdown_connections 2023-12-19T05:41:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.494+0000 7fef55d0a640 1 -- 172.21.15.49:0/2580867109 wait complete. 2023-12-19T05:41:56.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:41:56.598 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:41:56.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.732+0000 7f1c5dd8f640 1 Processor -- start 2023-12-19T05:41:56.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.732+0000 7f1c5dd8f640 1 -- start start 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.733+0000 7f1c5dd8f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c580b0a00 0x7f1c5806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.733+0000 7f1c5dd8f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5815c9c0 con 0x7f1c58155460 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.733+0000 7f1c5dd8f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5806d270 con 0x7f1c5806ca80 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.733+0000 7f1c5dd8f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5806d550 con 0x7f1c580b0a00 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c5cd8d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1c58155460 0x7f1c580b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53488/0 (socket says 172.21.15.49:53488) 2023-12-19T05:41:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c5cd8d640 1 -- 172.21.15.49:0/351561595 learned_addr learned my addr 172.21.15.49:0/351561595 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699109629 0 0) 0x7f1c5815c9c0 con 0x7f1c58155460 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c57fff640 1 --2- 172.21.15.49:0/351561595 >> v2:172.21.15.115:3300/0 conn(0x7f1c580b0a00 0x7f1c5806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c48003520 con 0x7f1c58155460 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1579798680 0 0) 0x7f1c48003520 con 0x7f1c58155460 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 >> v2:172.21.15.115:3300/0 conn(0x7f1c580b0a00 msgr2=0x7f1c5806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 --2- 172.21.15.49:0/351561595 >> v2:172.21.15.115:3300/0 conn(0x7f1c580b0a00 0x7f1c5806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.734+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 >> v1:172.21.15.115:6789/0 conn(0x7f1c5806ca80 legacy=0x7f1c580cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5806d830 con 0x7f1c58155460 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1c4c001670 con 0x7f1c58155460 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 >> v1:172.21.15.49:6789/0 conn(0x7f1c58155460 legacy=0x7f1c580b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c480039e0 0x7f1c48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c480047c0 0x7f1c48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5806d550 con 0x7f1c480051d0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4800c120 con 0x7f1c480047c0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4800c2e0 con 0x7f1c480039e0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c5d58e640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c5cd8d640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c480039e0 0x7f1c48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c57fff640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c480047c0 0x7f1c48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c5d58e640 1 -- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c480039e0 msgr2=0x7f1c48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.735+0000 7f1c5d58e640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c480039e0 0x7f1c48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.736+0000 7f1c5d58e640 1 -- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c480047c0 msgr2=0x7f1c48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.736+0000 7f1c5d58e640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c480047c0 0x7f1c48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.736+0000 7f1c5d58e640 1 -- 172.21.15.49:0/351561595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48003520 con 0x7f1c480051d0 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.736+0000 7f1c5d58e640 1 -- 172.21.15.49:0/351561595 reap_dead start 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c5d58e640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c4800b980 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1c500044b0 tx=0x7f1c480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4003b0aa66c100 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50006d50 con 0x7f1c480051d0 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50007020 con 0x7f1c480051d0 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c577fe640 1 -- 172.21.15.49:0/351561595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c500073d0 con 0x7f1c480051d0 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 msgr2=0x7f1c4800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.737+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c4800b980 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1c500044b0 tx=0x7f1c480057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.738+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/351561595 shutdown_connections 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.738+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/351561595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c4800b980 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.738+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/351561595 >> 172.21.15.49:0/351561595 conn(0x7f1c580659a0 msgr2=0x7f1c58065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.738+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/351561595 shutdown_connections 2023-12-19T05:41:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.738+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/351561595 wait complete. 2023-12-19T05:41:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.739+0000 7f1c5dd8f640 1 Processor -- start 2023-12-19T05:41:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.740+0000 7f1c5dd8f640 1 -- start start 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580b2380 0x7f1c580b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c581f5d00 0x7f1c581f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c581f6a70 con 0x7f1c480051d0 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580b2d40 con 0x7f1c580b2380 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5dd8f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580cde90 con 0x7f1c581f5d00 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42754/0 (socket says 172.21.15.49:42754) 2023-12-19T05:41:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 -- 172.21.15.49:0/989832950 learned_addr learned my addr 172.21.15.49:0/989832950 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 -- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c581f5d00 msgr2=0x7f1c581f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c581f5d00 0x7f1c581f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c57fff640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580b2380 0x7f1c580b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 -- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580b2380 msgr2=0x7f1c580b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580b2380 0x7f1c580b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.741+0000 7f1c5cd8d640 1 -- 172.21.15.49:0/989832950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c580cbe70 con 0x7f1c480051d0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c5cd8d640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001200 tx=0x7f1c4c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00ee00 con 0x7f1c480051d0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00c8d0 con 0x7f1c480051d0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00cc80 con 0x7f1c480051d0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c580cc150 con 0x7f1c480051d0 2023-12-19T05:41:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.742+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c580cc710 con 0x7f1c480051d0 2023-12-19T05:41:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.743+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c58061910 con 0x7f1c480051d0 2023-12-19T05:41:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.744+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c4c01d460 con 0x7f1c480051d0 2023-12-19T05:41:56.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.745+0000 7f1c557fa640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 0x7f1c3c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:56.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.745+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f1c4c0888c0 con 0x7f1c480051d0 2023-12-19T05:41:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.746+0000 7f1c57fff640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 0x7f1c3c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.747+0000 7f1c57fff640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 0x7f1c3c06c970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1c58154620 tx=0x7f1c44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.750+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c4c053ea0 con 0x7f1c480051d0 2023-12-19T05:41:56.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:56.979+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c58152ef0 con 0x7f1c480051d0 2023-12-19T05:41:57.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.542+0000 7f1c557fa640 1 -- 172.21.15.49:0/989832950 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c4c0574c0 con 0x7f1c480051d0 2023-12-19T05:41:57.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.546+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 msgr2=0x7f1c3c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.546+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 0x7f1c3c06c970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1c58154620 tx=0x7f1c44008040 comp rx=0 tx=0).stop 2023-12-19T05:41:57.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.546+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 msgr2=0x7f1c580cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.546+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001200 tx=0x7f1c4c00ec10 comp rx=0 tx=0).stop 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 shutdown_connections 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c3c06a4b0 0x7f1c3c06c970 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c581f5d00 0x7f1c581f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580b2380 0x7f1c580b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 --2- 172.21.15.49:0/989832950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c480051d0 0x7f1c580cd950 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 >> 172.21.15.49:0/989832950 conn(0x7f1c580659a0 msgr2=0x7f1c5806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 shutdown_connections 2023-12-19T05:41:57.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.547+0000 7f1c5dd8f640 1 -- 172.21.15.49:0/989832950 wait complete. 2023-12-19T05:41:57.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:41:57.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.803+0000 7fb22e147640 1 Processor -- start 2023-12-19T05:41:57.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.803+0000 7fb22e147640 1 -- start start 2023-12-19T05:41:57.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.805+0000 7fb22e147640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2280ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.805+0000 7fb22e147640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22815f920 con 0x7fb2280b04c0 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.805+0000 7fb22e147640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22815ed10 con 0x7fb22806d070 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.805+0000 7fb22e147640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280adc40 con 0x7fb22815afd0 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb22d946640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb2280b04c0 0x7fb22806b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53490/0 (socket says 172.21.15.49:53490) 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb22d946640 1 -- 172.21.15.49:0/1465181537 learned_addr learned my addr 172.21.15.49:0/1465181537 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb22d145640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2280ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499287436 0 0) 0x7fb22815f920 con 0x7fb2280b04c0 2023-12-19T05:41:57.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb214003520 con 0x7fb2280b04c0 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.806+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 156099811 0 0) 0x7fb214003520 con 0x7fb2280b04c0 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 msgr2=0x7fb2280ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2280ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 >> v1:172.21.15.115:6789/0 conn(0x7fb22806d070 legacy=0x7fb2280afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22815eff0 con 0x7fb2280b04c0 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb2200019f0 con 0x7fb2280b04c0 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb22d145640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2280ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 >> v1:172.21.15.49:6789/0 conn(0x7fb2280b04c0 legacy=0x7fb22806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2140039a0 0x7fb214003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb214004d00 0x7fb214005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400ba30 con 0x7fb214004d00 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400bb70 con 0x7fb2140039a0 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400bd30 con 0x7fb22815afd0 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb22d946640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb214004d00 0x7fb214005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb22c944640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.807+0000 7fb22d145640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2140039a0 0x7fb214003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d946640 1 -- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 msgr2=0x7fb2140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d946640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb22815afd0 0x7fb2140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d946640 1 -- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2140039a0 msgr2=0x7fb214003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d946640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2140039a0 0x7fb214003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d946640 1 -- 172.21.15.49:0/1465181537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009400 con 0x7fb214004d00 2023-12-19T05:41:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.808+0000 7fb22d145640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2140039a0 0x7fb214003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:57.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.809+0000 7fb22d946640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb214004d00 0x7fb214005180 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb2280b5100 tx=0x7fb2140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724643867cdf15d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:57.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.809+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220034630 con 0x7fb214004d00 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.809+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22002f070 con 0x7fb214004d00 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.809+0000 7fb21ffff640 1 -- 172.21.15.49:0/1465181537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200349d0 con 0x7fb214004d00 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 -- 172.21.15.49:0/1465181537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb214004d00 msgr2=0x7fb214005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 --2- 172.21.15.49:0/1465181537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb214004d00 0x7fb214005180 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb2280b5100 tx=0x7fb2140057f0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22d946640 1 -- 172.21.15.49:0/1465181537 reap_dead start 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 -- 172.21.15.49:0/1465181537 shutdown_connections 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 -- 172.21.15.49:0/1465181537 >> 172.21.15.49:0/1465181537 conn(0x7fb2280b4750 msgr2=0x7fb2280659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 -- 172.21.15.49:0/1465181537 shutdown_connections 2023-12-19T05:41:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.810+0000 7fb22e147640 1 -- 172.21.15.49:0/1465181537 wait complete. 2023-12-19T05:41:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.812+0000 7fb22e147640 1 Processor -- start 2023-12-19T05:41:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.813+0000 7fb22e147640 1 -- start start 2023-12-19T05:41:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 0x7fb22814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb228156cf0 0x7fb2281571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228158630 con 0x7fb228158ed0 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228157a20 con 0x7fb228156cf0 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22e147640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228157d00 con 0x7fb2281592b0 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22d145640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22d145640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42776/0 (socket says 172.21.15.49:42776) 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22d145640 1 -- 172.21.15.49:0/1740424272 learned_addr learned my addr 172.21.15.49:0/1740424272 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.814+0000 7fb22d145640 1 -- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 msgr2=0x7fb22814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22c944640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 0x7fb22814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d946640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb228156cf0 0x7fb2281571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d145640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 0x7fb22814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d145640 1 -- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb228156cf0 msgr2=0x7fb2281571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d145640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb228156cf0 0x7fb2281571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d145640 1 -- 172.21.15.49:0/1740424272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228157fe0 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22c944640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 0x7fb22814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22d145640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb2240109a0 tx=0x7fb224010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22400ec20 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22400eda0 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2281582c0 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22401c640 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.815+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22815c400 con 0x7fb228158ed0 2023-12-19T05:41:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.816+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228061910 con 0x7fb228158ed0 2023-12-19T05:41:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.818+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb22401c7a0 con 0x7fb228158ed0 2023-12-19T05:41:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.819+0000 7fb21dffb640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 0x7fb20c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.819+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fb224089050 con 0x7fb228158ed0 2023-12-19T05:41:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.820+0000 7fb22c944640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 0x7fb20c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.821+0000 7fb22c944640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 0x7fb20c06c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:57.823+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb224054550 con 0x7fb228158ed0 2023-12-19T05:41:58.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.020+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb228066710 con 0x7fb228158ed0 2023-12-19T05:41:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.564+0000 7fb21dffb640 1 -- 172.21.15.49:0/1740424272 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb224057b70 con 0x7fb228158ed0 2023-12-19T05:41:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:41:58.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.571+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 msgr2=0x7fb20c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.571+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 0x7fb20c06c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb218009040 comp rx=0 tx=0).stop 2023-12-19T05:41:58.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 msgr2=0x7fb22814ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb2240109a0 tx=0x7fb224010e60 comp rx=0 tx=0).stop 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 shutdown_connections 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb20c06a460 0x7fb20c06c920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2281592b0 0x7fb22814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb228156cf0 0x7fb2281571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 --2- 172.21.15.49:0/1740424272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb228158ed0 0x7fb22814ca40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 >> 172.21.15.49:0/1740424272 conn(0x7fb2280b4750 msgr2=0x7fb2280b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:58.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.572+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 shutdown_connections 2023-12-19T05:41:58.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.573+0000 7fb22e147640 1 -- 172.21.15.49:0/1740424272 wait complete. 2023-12-19T05:41:58.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:41:58.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.827+0000 7fa600066640 1 Processor -- start 2023-12-19T05:41:58.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.827+0000 7fa600066640 1 -- start start 2023-12-19T05:41:58.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.829+0000 7fa600066640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806b8b0 0x7fa5f8161f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.829+0000 7fa600066640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5f80b0cb0 0x7fa5f815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.829+0000 7fa600066640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f8162570 con 0x7fa5f806bc90 2023-12-19T05:41:58.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.829+0000 7fa600066640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f8165610 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.829+0000 7fa600066640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80ce920 con 0x7fa5f806b8b0 2023-12-19T05:41:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.830+0000 7fa5fe603640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5f80b0cb0 0x7fa5f815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.830+0000 7fa5fde02640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806b8b0 0x7fa5f8161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.830+0000 7fa5fe603640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5f80b0cb0 0x7fa5f815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42894/0 (socket says 172.21.15.49:42894) 2023-12-19T05:41:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.830+0000 7fa5fe603640 1 -- 172.21.15.49:0/1295575102 learned_addr learned my addr 172.21.15.49:0/1295575102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.831+0000 7fa5fe603640 1 -- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806b8b0 msgr2=0x7fa5f8161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.831+0000 7fa5fe603640 1 --2- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806b8b0 0x7fa5f8161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.831+0000 7fa5fe603640 1 -- 172.21.15.49:0/1295575102 >> v1:172.21.15.115:6789/0 conn(0x7fa5f806bc90 legacy=0x7fa5f80ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.831+0000 7fa5fe603640 1 -- 172.21.15.49:0/1295575102 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8162850 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.834+0000 7fa5fe603640 1 --2- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f815baf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009e50 tx=0x7fa5f002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d2835ca8150585 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:58.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.834+0000 7fa5fce00640 1 -- 172.21.15.49:0/1295575102 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f002cb00 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.834+0000 7fa5fce00640 1 -- 172.21.15.49:0/1295575102 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f002cc60 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.834+0000 7fa5fce00640 1 -- 172.21.15.49:0/1295575102 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00343f0 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 -- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 msgr2=0x7fa5f815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 --2- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f815baf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009e50 tx=0x7fa5f002bf60 comp rx=0 tx=0).stop 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 -- 172.21.15.49:0/1295575102 shutdown_connections 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 --2- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f815baf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 --2- 172.21.15.49:0/1295575102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806b8b0 0x7fa5f8161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 -- 172.21.15.49:0/1295575102 >> 172.21.15.49:0/1295575102 conn(0x7fa5f80cf2f0 msgr2=0x7fa5f80cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 -- 172.21.15.49:0/1295575102 shutdown_connections 2023-12-19T05:41:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.835+0000 7fa600066640 1 -- 172.21.15.49:0/1295575102 wait complete. 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.837+0000 7fa600066640 1 Processor -- start 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.837+0000 7fa600066640 1 -- start start 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806bc90 0x7fa5f81f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81f8440 con 0x7fa5f806b8b0 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806f120 con 0x7fa5f80b0cb0 2023-12-19T05:41:58.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.838+0000 7fa600066640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806f400 con 0x7fa5f806bc90 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42784/0 (socket says 172.21.15.49:42784) 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 -- 172.21.15.49:0/135107846 learned_addr learned my addr 172.21.15.49:0/135107846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fd601640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806bc90 0x7fa5f81f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fe603640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 -- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806bc90 msgr2=0x7fa5f81f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806bc90 0x7fa5f81f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 -- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 msgr2=0x7fa5f80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.839+0000 7fa5fde02640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5fde02640 1 -- 172.21.15.49:0/135107846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009b30 con 0x7fa5f806b8b0 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5fe603640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5fde02640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400e8a0 tx=0x7fa5f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40094f0 con 0x7fa5f806b8b0 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f400c940 con 0x7fa5f806b8b0 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400ccf0 con 0x7fa5f806b8b0 2023-12-19T05:41:58.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f80708a0 con 0x7fa5f806b8b0 2023-12-19T05:41:58.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.840+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f8070e60 con 0x7fa5f806b8b0 2023-12-19T05:41:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.842+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f8074770 con 0x7fa5f806b8b0 2023-12-19T05:41:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.843+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5f4013470 con 0x7fa5f806b8b0 2023-12-19T05:41:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.844+0000 7fa5ee7fc640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 0x7fa5dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.844+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fa5f4088760 con 0x7fa5f806b8b0 2023-12-19T05:41:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.844+0000 7fa5fd601640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 0x7fa5dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:58.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.846+0000 7fa5fd601640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 0x7fa5dc06c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80aed70 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:58.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:58.848+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5f4053f60 con 0x7fa5f806b8b0 2023-12-19T05:41:59.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.047+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5f8061910 con 0x7fa5f806b8b0 2023-12-19T05:41:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.579+0000 7fa5ee7fc640 1 -- 172.21.15.49:0/135107846 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5f4057580 con 0x7fa5f806b8b0 2023-12-19T05:41:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:41:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.584+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 msgr2=0x7fa5dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.584+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 0x7fa5dc06c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80aed70 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2023-12-19T05:41:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.584+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 msgr2=0x7fa5f80ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.584+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400e8a0 tx=0x7fa5f400ed60 comp rx=0 tx=0).stop 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.586+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 shutdown_connections 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa5dc06a430 0x7fa5dc06c8f0 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80aed70 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5f806bc90 0x7fa5f81f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5f80b0cb0 0x7fa5f80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 --2- 172.21.15.49:0/135107846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f806b8b0 0x7fa5f80ccf60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 >> 172.21.15.49:0/135107846 conn(0x7fa5f80cf2f0 msgr2=0x7fa5f8156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.587+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 shutdown_connections 2023-12-19T05:41:59.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.588+0000 7fa600066640 1 -- 172.21.15.49:0/135107846 wait complete. 2023-12-19T05:41:59.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:41:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.828+0000 7fe6168c5640 1 Processor -- start 2023-12-19T05:41:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.828+0000 7fe6168c5640 1 -- start start 2023-12-19T05:41:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.830+0000 7fe6168c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.830+0000 7fe6168c5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.830+0000 7fe6168c5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100b7d00 con 0x7fe610160ee0 2023-12-19T05:41:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.830+0000 7fe6168c5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100700c0 con 0x7fe6100b7360 2023-12-19T05:41:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.830+0000 7fe6168c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61006f160 con 0x7fe610146c40 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6158c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6150c2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6158c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47414/0 (socket says 172.21.15.49:47414) 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6158c3640 1 -- 172.21.15.49:0/3984613615 learned_addr learned my addr 172.21.15.49:0/3984613615 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6150c2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42914/0 (socket says 172.21.15.49:42914) 2023-12-19T05:41:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.831+0000 7fe6160c4640 1 --1- 172.21.15.49:0/3984613615 >> v1:172.21.15.115:6789/0 conn(0x7fe610160ee0 0x7fe610161370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:35114/0 (socket says 172.21.15.49:35114) 2023-12-19T05:41:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.832+0000 7fe6158c3640 1 -- 172.21.15.49:0/3984613615 >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 msgr2=0x7fe6100b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:41:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.832+0000 7fe6158c3640 1 --2- 172.21.15.49:0/3984613615 >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.832+0000 7fe6158c3640 1 -- 172.21.15.49:0/3984613615 >> v1:172.21.15.115:6789/0 conn(0x7fe610160ee0 legacy=0x7fe610161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.832+0000 7fe6158c3640 1 -- 172.21.15.49:0/3984613615 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61006f440 con 0x7fe610146c40 2023-12-19T05:41:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.832+0000 7fe6150c2640 1 --2- 172.21.15.49:0/3984613615 >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:41:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.833+0000 7fe6158c3640 1 --2- 172.21.15.49:0/3984613615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f481c15f9379910b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:59.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.834+0000 7fe6148c1640 1 -- 172.21.15.49:0/3984613615 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c030840 con 0x7fe610146c40 2023-12-19T05:41:59.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.834+0000 7fe6148c1640 1 -- 172.21.15.49:0/3984613615 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0309a0 con 0x7fe610146c40 2023-12-19T05:41:59.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.834+0000 7fe6148c1640 1 -- 172.21.15.49:0/3984613615 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c030d30 con 0x7fe610146c40 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.834+0000 7fe6168c5640 1 -- 172.21.15.49:0/3984613615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 msgr2=0x7fe610070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.834+0000 7fe6168c5640 1 --2- 172.21.15.49:0/3984613615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b980 comp rx=0 tx=0).stop 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 -- 172.21.15.49:0/3984613615 shutdown_connections 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 --2- 172.21.15.49:0/3984613615 >> v2:172.21.15.115:3300/0 conn(0x7fe6100b7360 0x7fe6100b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 --2- 172.21.15.49:0/3984613615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe610070e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 -- 172.21.15.49:0/3984613615 >> 172.21.15.49:0/3984613615 conn(0x7fe6100d31b0 msgr2=0x7fe6100d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 -- 172.21.15.49:0/3984613615 shutdown_connections 2023-12-19T05:41:59.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.835+0000 7fe6168c5640 1 -- 172.21.15.49:0/3984613615 wait complete. 2023-12-19T05:41:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.836+0000 7fe6168c5640 1 Processor -- start 2023-12-19T05:41:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.837+0000 7fe6168c5640 1 -- start start 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6100b7360 0x7fe6101f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe61015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c81f0 con 0x7fe610160ee0 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c84d0 con 0x7fe6100b7360 2023-12-19T05:41:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6168c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c87b0 con 0x7fe610146c40 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6160c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6160c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42792/0 (socket says 172.21.15.49:42792) 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6160c4640 1 -- 172.21.15.49:0/1875999707 learned_addr learned my addr 172.21.15.49:0/1875999707 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.838+0000 7fe6158c3640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6100b7360 0x7fe6101f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6150c2640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe61015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6160c4640 1 -- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 msgr2=0x7fe61015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6160c4640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe61015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6160c4640 1 -- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6100b7360 msgr2=0x7fe6101f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6160c4640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6100b7360 0x7fe6101f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6160c4640 1 -- 172.21.15.49:0/1875999707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009400 con 0x7fe610160ee0 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.839+0000 7fe6150c2640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe61015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:41:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.840+0000 7fe6160c4640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c780 tx=0x7fe60800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.840+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800ce90 con 0x7fe610160ee0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.840+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800a640 con 0x7fe610160ee0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.840+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c0094d0 con 0x7fe610160ee0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.840+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800a9b0 con 0x7fe610160ee0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.841+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6100c8d70 con 0x7fe610160ee0 2023-12-19T05:41:59.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.842+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f8005250 con 0x7fe610160ee0 2023-12-19T05:41:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.843+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe60800ab10 con 0x7fe610160ee0 2023-12-19T05:41:59.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.845+0000 7fe6067fc640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:41:59.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.845+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe608087da0 con 0x7fe610160ee0 2023-12-19T05:41:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.846+0000 7fe6158c3640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:41:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.850+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6080536a0 con 0x7fe610160ee0 2023-12-19T05:41:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:41:59.850+0000 7fe6158c3640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe60c036000 tx=0x7fe60c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:00.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.045+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe5f8005a80 con 0x7fe610160ee0 2023-12-19T05:42:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.053+0000 7fe6067fc640 1 -- 172.21.15.49:0/1875999707 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe608056cc0 con 0x7fe610160ee0 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 msgr2=0x7fe5f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe60c036000 tx=0x7fe60c008030 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 msgr2=0x7fe610141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c780 tx=0x7fe60800cc40 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 shutdown_connections 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe610146c40 0x7fe61015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe610160ee0 0x7fe610141670 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 --2- 172.21.15.49:0/1875999707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6100b7360 0x7fe6101f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.056+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 >> 172.21.15.49:0/1875999707 conn(0x7fe6100d31b0 msgr2=0x7fe61015f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.057+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 shutdown_connections 2023-12-19T05:42:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.057+0000 7fe6168c5640 1 -- 172.21.15.49:0/1875999707 wait complete. 2023-12-19T05:42:00.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-19T05:42:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.306+0000 7efda759e640 1 Processor -- start 2023-12-19T05:42:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.306+0000 7efda759e640 1 -- start start 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efda80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80b6640 con 0x7efda80b58c0 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80b5da0 con 0x7efda80b2a80 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b6080 con 0x7efda8144c20 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda6d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efda80b58c0 0x7efda815bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53504/0 (socket says 172.21.15.49:53504) 2023-12-19T05:42:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.308+0000 7efda6d9d640 1 -- 172.21.15.49:0/798949357 learned_addr learned my addr 172.21.15.49:0/798949357 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda659c640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efda80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725265624 0 0) 0x7efda80b6640 con 0x7efda80b58c0 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd94003520 con 0x7efda80b58c0 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650227406 0 0) 0x7efd94003520 con 0x7efda80b58c0 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 msgr2=0x7efda80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efda80b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 >> v1:172.21.15.115:6789/0 conn(0x7efda80b2a80 legacy=0x7efda80cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80b6360 con 0x7efda80b58c0 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7efda0001670 con 0x7efda80b58c0 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 >> v1:172.21.15.49:6789/0 conn(0x7efda80b58c0 legacy=0x7efda815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd940039a0 0x7efd94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efd940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd94004d00 0x7efd94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b6080 con 0x7efd940039a0 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400ba60 con 0x7efd94004d00 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.309+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400bc20 con 0x7efda8144c20 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd940039a0 0x7efd94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda5d9b640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efd940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 -- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 msgr2=0x7efd940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda8144c20 0x7efd940047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 -- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd94004d00 msgr2=0x7efd94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:00.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd94004d00 0x7efd94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.310+0000 7efda659c640 1 -- 172.21.15.49:0/798949357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94003520 con 0x7efd940039a0 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.311+0000 7efda659c640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd940039a0 0x7efd94003dc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd90009a90 tx=0x7efd940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa877e3ca0d6570 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.311+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9002c680 con 0x7efd940039a0 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.311+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9002c7e0 con 0x7efd940039a0 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.311+0000 7efda559a640 1 -- 172.21.15.49:0/798949357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9002cb70 con 0x7efd940039a0 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 -- 172.21.15.49:0/798949357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd940039a0 msgr2=0x7efd94003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 --2- 172.21.15.49:0/798949357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd940039a0 0x7efd94003dc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd90009a90 tx=0x7efd940057f0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda6d9d640 1 -- 172.21.15.49:0/798949357 reap_dead start 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 -- 172.21.15.49:0/798949357 shutdown_connections 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 -- 172.21.15.49:0/798949357 >> 172.21.15.49:0/798949357 conn(0x7efda806b8f0 msgr2=0x7efda806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 -- 172.21.15.49:0/798949357 shutdown_connections 2023-12-19T05:42:00.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.312+0000 7efda759e640 1 -- 172.21.15.49:0/798949357 wait complete. 2023-12-19T05:42:00.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.314+0000 7efda759e640 1 Processor -- start 2023-12-19T05:42:00.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.314+0000 7efda759e640 1 -- start start 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd940039a0 0x7efda8071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda806ddc0 0x7efda806e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda806e780 con 0x7efda813f2c0 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8072300 con 0x7efd940039a0 2023-12-19T05:42:00.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cd090 con 0x7efda806ddc0 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.315+0000 7efda5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42814/0 (socket says 172.21.15.49:42814) 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 -- 172.21.15.49:0/1626603779 learned_addr learned my addr 172.21.15.49:0/1626603779 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda659c640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd940039a0 0x7efda8071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda6d9d640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda806ddc0 0x7efda806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 -- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda806ddc0 msgr2=0x7efda806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda806ddc0 0x7efda806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 -- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd940039a0 msgr2=0x7efda8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd940039a0 0x7efda8071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:00.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 -- 172.21.15.49:0/1626603779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80ce200 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.316+0000 7efda5d9b640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efd9800d8e0 tx=0x7efd9800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.317+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98003da0 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.317+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800b6b0 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.317+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800ba20 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.317+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81f2540 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.317+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda8071780 con 0x7efda813f2c0 2023-12-19T05:42:00.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.318+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda80700e0 con 0x7efda813f2c0 2023-12-19T05:42:00.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.319+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd9800bb80 con 0x7efda813f2c0 2023-12-19T05:42:00.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.320+0000 7efd9effd640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 0x7efd8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:00.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.320+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd98088a20 con 0x7efda813f2c0 2023-12-19T05:42:00.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.321+0000 7efda659c640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 0x7efd8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:00.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.322+0000 7efda659c640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 0x7efd8806c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd90036000 tx=0x7efd90030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:00.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.325+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd98054270 con 0x7efda813f2c0 2023-12-19T05:42:00.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:00.592+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7efda8061910 con 0x7efda813f2c0 2023-12-19T05:42:01.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.579+0000 7efd9effd640 1 -- 172.21.15.49:0/1626603779 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v175) v1 ==== 142+0+0 (secure 0 0 0) 0x7efd98057890 con 0x7efda813f2c0 2023-12-19T05:42:01.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 msgr2=0x7efd8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 0x7efd8806c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd90036000 tx=0x7efd90030000 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 msgr2=0x7efda8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efd9800d8e0 tx=0x7efd9800dda0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 shutdown_connections 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd8806a430 0x7efd8806c8f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efda806ddc0 0x7efda806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efda813f2c0 0x7efda8070880 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 --2- 172.21.15.49:0/1626603779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd940039a0 0x7efda8071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 >> 172.21.15.49:0/1626603779 conn(0x7efda806b8f0 msgr2=0x7efda80b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 shutdown_connections 2023-12-19T05:42:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.583+0000 7efda759e640 1 -- 172.21.15.49:0/1626603779 wait complete. 2023-12-19T05:42:01.607 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T05:42:01.608 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T05:42:01.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:42:01.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.838+0000 7f6d23fff640 1 Processor -- start 2023-12-19T05:42:01.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.838+0000 7f6d23fff640 1 -- start start 2023-12-19T05:42:01.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.840+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d240cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.840+0000 7f6d23fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d240ce660 0x7f6d2406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.840+0000 7f6d23fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d240b22b0 con 0x7f6d240cc8a0 2023-12-19T05:42:01.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.840+0000 7f6d23fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d24161bf0 con 0x7f6d240ce660 2023-12-19T05:42:01.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.840+0000 7f6d23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240b2830 con 0x7f6d24161810 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d240ce660 0x7f6d2406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d240ce660 0x7f6d2406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42830/0 (socket says 172.21.15.49:42830) 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 -- 172.21.15.49:0/2376217177 learned_addr learned my addr 172.21.15.49:0/2376217177 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d22ffd640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d240cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 -- 172.21.15.49:0/2376217177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 msgr2=0x7f6d240cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d240cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 -- 172.21.15.49:0/2376217177 >> v1:172.21.15.115:6789/0 conn(0x7f6d240cc8a0 legacy=0x7f6d240cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.841+0000 7f6d237fe640 1 -- 172.21.15.49:0/2376217177 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240b2550 con 0x7f6d240ce660 2023-12-19T05:42:01.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.842+0000 7f6d237fe640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2406f160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009e50 tx=0x7f6d1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1d3474884c9ae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:01.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.843+0000 7f6d227fc640 1 -- 172.21.15.49:0/2376217177 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c02ca70 con 0x7f6d240ce660 2023-12-19T05:42:01.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.843+0000 7f6d227fc640 1 -- 172.21.15.49:0/2376217177 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c02cbd0 con 0x7f6d240ce660 2023-12-19T05:42:01.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.843+0000 7f6d227fc640 1 -- 172.21.15.49:0/2376217177 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0343f0 con 0x7f6d240ce660 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.843+0000 7f6d23fff640 1 -- 172.21.15.49:0/2376217177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 msgr2=0x7f6d2406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.843+0000 7f6d23fff640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2406f160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009e50 tx=0x7f6d1c02bed0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 -- 172.21.15.49:0/2376217177 shutdown_connections 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2406f160 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 --2- 172.21.15.49:0/2376217177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d240cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 -- 172.21.15.49:0/2376217177 >> 172.21.15.49:0/2376217177 conn(0x7f6d240b0100 msgr2=0x7f6d240b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:01.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 -- 172.21.15.49:0/2376217177 shutdown_connections 2023-12-19T05:42:01.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.844+0000 7f6d23fff640 1 -- 172.21.15.49:0/2376217177 wait complete. 2023-12-19T05:42:01.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.846+0000 7f6d23fff640 1 Processor -- start 2023-12-19T05:42:01.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.846+0000 7f6d23fff640 1 -- start start 2023-12-19T05:42:01.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d240cc8a0 0x7f6d24161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d2406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2406b6b0 con 0x7f6d240ce660 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2406cb90 con 0x7f6d240cc8a0 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d23fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24162270 con 0x7f6d24161810 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42848/0 (socket says 172.21.15.49:42848) 2023-12-19T05:42:01.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.847+0000 7f6d1bfff640 1 -- 172.21.15.49:0/212225866 learned_addr learned my addr 172.21.15.49:0/212225866 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:01.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d237fe640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d2406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 -- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 msgr2=0x7f6d2406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d2406f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 -- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d240cc8a0 msgr2=0x7f6d24161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d22ffd640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d240cc8a0 0x7f6d24161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d240cc8a0 0x7f6d24161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 -- 172.21.15.49:0/212225866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009b30 con 0x7f6d240ce660 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d1bfff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00c3c0 tx=0x7f6d0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0052d0 con 0x7f6d240ce660 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c005450 con 0x7f6d240ce660 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c003830 con 0x7f6d240ce660 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.848+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d24160ff0 con 0x7f6d240ce660 2023-12-19T05:42:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.849+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2406ce20 con 0x7f6d240ce660 2023-12-19T05:42:01.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.850+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d24061910 con 0x7f6d240ce660 2023-12-19T05:42:01.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.851+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d0c003990 con 0x7f6d240ce660 2023-12-19T05:42:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.851+0000 7f6d20ff9640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 0x7f6d0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.852+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d0c0879a0 con 0x7f6d240ce660 2023-12-19T05:42:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.852+0000 7f6d22ffd640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 0x7f6d0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.853+0000 7f6d22ffd640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 0x7f6d0406c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:01.856+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d0c0531f0 con 0x7f6d240ce660 2023-12-19T05:42:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.049+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d240b0f70 con 0x7f6d240ce660 2023-12-19T05:42:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.051+0000 7f6d20ff9640 1 -- 172.21.15.49:0/212225866 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12518 (secure 0 0 0) 0x7f6d0c017090 con 0x7f6d240ce660 2023-12-19T05:42:02.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:02.053 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:41:59.560583+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/4133391224":"2023-12-20T05:41:56.476093+0000","172.21.15.49:6834/4133391224":"2023-12-20T05:41:56.476093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:42:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 msgr2=0x7f6d0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 0x7f6d0406c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 msgr2=0x7f6d2414f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00c3c0 tx=0x7f6d0c00c880 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 shutdown_connections 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6d0406a430 0x7f6d0406c8f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d24161810 0x7f6d2406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d240ce660 0x7f6d2414f180 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 --2- 172.21.15.49:0/212225866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d240cc8a0 0x7f6d24161d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 >> 172.21.15.49:0/212225866 conn(0x7f6d240b0100 msgr2=0x7f6d24070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 shutdown_connections 2023-12-19T05:42:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.054+0000 7f6d23fff640 1 -- 172.21.15.49:0/212225866 wait complete. 2023-12-19T05:42:02.074 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:42:02.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:42:02.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.305+0000 7f226bfff640 1 Processor -- start 2023-12-19T05:42:02.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.306+0000 7f226bfff640 1 -- start start 2023-12-19T05:42:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.308+0000 7f226bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.308+0000 7f226bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.308+0000 7f226bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c06e220 con 0x7f226c06da30 2023-12-19T05:42:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.308+0000 7f226bfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0cbea0 con 0x7f226c0b02a0 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.308+0000 7f226bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0cc180 con 0x7f226c141900 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f2263fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f226affd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f226affd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47478/0 (socket says 172.21.15.49:47478) 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f226affd640 1 -- 172.21.15.49:0/2544994792 learned_addr learned my addr 172.21.15.49:0/2544994792 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f2263fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42956/0 (socket says 172.21.15.49:42956) 2023-12-19T05:42:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.309+0000 7f226affd640 1 -- 172.21.15.49:0/2544994792 >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 msgr2=0x7f226c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.310+0000 7f226affd640 1 --2- 172.21.15.49:0/2544994792 >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.310+0000 7f226affd640 1 -- 172.21.15.49:0/2544994792 >> v1:172.21.15.115:6789/0 conn(0x7f226c06da30 legacy=0x7f226c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.310+0000 7f226affd640 1 -- 172.21.15.49:0/2544994792 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0b0700 con 0x7f226c141900 2023-12-19T05:42:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.310+0000 7f2263fff640 1 --2- 172.21.15.49:0/2544994792 >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:42:02.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.311+0000 7f226affd640 1 --2- 172.21.15.49:0/2544994792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47aa1fc2456ec42f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.311+0000 7f226a7fc640 1 -- 172.21.15.49:0/2544994792 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c030840 con 0x7f226c141900 2023-12-19T05:42:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.311+0000 7f226a7fc640 1 -- 172.21.15.49:0/2544994792 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0309a0 con 0x7f226c141900 2023-12-19T05:42:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.311+0000 7f226a7fc640 1 -- 172.21.15.49:0/2544994792 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c030d30 con 0x7f226c141900 2023-12-19T05:42:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 -- 172.21.15.49:0/2544994792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 msgr2=0x7f226c0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 --2- 172.21.15.49:0/2544994792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c02b980 comp rx=0 tx=0).stop 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 -- 172.21.15.49:0/2544994792 shutdown_connections 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 --2- 172.21.15.49:0/2544994792 >> v2:172.21.15.115:3300/0 conn(0x7f226c0b02a0 0x7f226c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 --2- 172.21.15.49:0/2544994792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c141900 0x7f226c0afd60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 -- 172.21.15.49:0/2544994792 >> 172.21.15.49:0/2544994792 conn(0x7f226c06f630 msgr2=0x7f226c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 -- 172.21.15.49:0/2544994792 shutdown_connections 2023-12-19T05:42:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.312+0000 7f226bfff640 1 -- 172.21.15.49:0/2544994792 wait complete. 2023-12-19T05:42:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.314+0000 7f226bfff640 1 Processor -- start 2023-12-19T05:42:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.314+0000 7f226bfff640 1 -- start start 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 0x7f226c1f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f226c141900 0x7f226c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0cadb0 con 0x7f226c0b02a0 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1f3a50 con 0x7f226c141900 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.315+0000 7f226bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1f42f0 con 0x7f226c06da30 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42856/0 (socket says 172.21.15.49:42856) 2023-12-19T05:42:02.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 -- 172.21.15.49:0/3755946745 learned_addr learned my addr 172.21.15.49:0/3755946745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f226affd640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 0x7f226c1f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 -- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 msgr2=0x7f226c1f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 0x7f226c1f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 -- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f226c141900 msgr2=0x7f226c0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f226c141900 0x7f226c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f2263fff640 1 -- 172.21.15.49:0/3755946745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254009400 con 0x7f226c0b02a0 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.316+0000 7f226affd640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 0x7f226c1f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f2263fff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f225400ec10 tx=0x7f225400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254009760 con 0x7f226c0b02a0 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400cc30 con 0x7f226c0b02a0 2023-12-19T05:42:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254013470 con 0x7f226c0b02a0 2023-12-19T05:42:02.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c0094d0 con 0x7f226c0b02a0 2023-12-19T05:42:02.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.317+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0b30d0 con 0x7f226c0b02a0 2023-12-19T05:42:02.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.318+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c061910 con 0x7f226c0b02a0 2023-12-19T05:42:02.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.319+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22540135d0 con 0x7f226c0b02a0 2023-12-19T05:42:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.320+0000 7f22637fe640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 0x7f224c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.320+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2254088830 con 0x7f226c0b02a0 2023-12-19T05:42:02.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.321+0000 7f226affd640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 0x7f224c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.322+0000 7f226affd640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 0x7f224c06c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f225c036000 tx=0x7f225c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.324+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22540541b0 con 0x7f226c0b02a0 2023-12-19T05:42:02.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.522+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f226c1f4430 con 0x7f226c0b02a0 2023-12-19T05:42:02.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.523+0000 7f22637fe640 1 -- 172.21.15.49:0/3755946745 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22540577d0 con 0x7f226c0b02a0 2023-12-19T05:42:02.524 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:42:02.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 msgr2=0x7f224c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 0x7f224c06c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f225c036000 tx=0x7f225c03b040 comp rx=0 tx=0).stop 2023-12-19T05:42:02.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 msgr2=0x7f226c15a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f225400ec10 tx=0x7f225400c520 comp rx=0 tx=0).stop 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 shutdown_connections 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f224c06a460 0x7f224c06c920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f226c141900 0x7f226c0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f226c0b02a0 0x7f226c15a6a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 --2- 172.21.15.49:0/3755946745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f226c06da30 0x7f226c1f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 >> 172.21.15.49:0/3755946745 conn(0x7f226c06f630 msgr2=0x7f226c140a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.526+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 shutdown_connections 2023-12-19T05:42:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.527+0000 7f226bfff640 1 -- 172.21.15.49:0/3755946745 wait complete. 2023-12-19T05:42:02.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.770+0000 7f0bc67d6640 1 Processor -- start 2023-12-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.771+0000 7f0bc67d6640 1 -- start start 2023-12-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.772+0000 7f0bc67d6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bc00cf670 0x7f0bc00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.772+0000 7f0bc67d6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00b4120 con 0x7f0bc015da00 2023-12-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.772+0000 7f0bc67d6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00b5b80 con 0x7f0bc015d620 2023-12-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.772+0000 7f0bc67d6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00b6ee0 con 0x7f0bc00cf670 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.773+0000 7f0bc5fd5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0bc015da00 0x7f0bc00b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53514/0 (socket says 172.21.15.49:53514) 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.773+0000 7f0bc5fd5640 1 -- 172.21.15.49:0/315969675 learned_addr learned my addr 172.21.15.49:0/315969675 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.773+0000 7f0bc4fd3640 1 --2- 172.21.15.49:0/315969675 >> v2:172.21.15.49:3300/0 conn(0x7f0bc00cf670 0x7f0bc00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.773+0000 7f0bb7fff640 1 -- 172.21.15.49:0/315969675 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365773051 0 0) 0x7f0bc00b4120 con 0x7f0bc015da00 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.774+0000 7f0bb7fff640 1 -- 172.21.15.49:0/315969675 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac003520 con 0x7f0bc015da00 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.774+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/315969675 >> v1:172.21.15.115:6789/0 conn(0x7f0bc015d620 legacy=0x7f0bc00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.774+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/315969675 >> v1:172.21.15.49:6789/0 conn(0x7f0bc015da00 legacy=0x7f0bc00b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.774+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/315969675 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00b71c0 con 0x7f0bc00cf670 2023-12-19T05:42:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.775+0000 7f0bc4fd3640 1 --2- 172.21.15.49:0/315969675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc00cf670 0x7f0bc00b6160 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097a0 tx=0x7f0bb002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772b8a7dba7644e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.775+0000 7f0bb7fff640 1 -- 172.21.15.49:0/315969675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0030610 con 0x7f0bc00cf670 2023-12-19T05:42:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.775+0000 7f0bb7fff640 1 -- 172.21.15.49:0/315969675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0030770 con 0x7f0bc00cf670 2023-12-19T05:42:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.775+0000 7f0bb7fff640 1 -- 172.21.15.49:0/315969675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0030ae0 con 0x7f0bc00cf670 2023-12-19T05:42:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 -- 172.21.15.49:0/315969675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc00cf670 msgr2=0x7f0bc00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/315969675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc00cf670 0x7f0bc00b6160 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097a0 tx=0x7f0bb002b960 comp rx=0 tx=0).stop 2023-12-19T05:42:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 -- 172.21.15.49:0/315969675 shutdown_connections 2023-12-19T05:42:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/315969675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc00cf670 0x7f0bc00b6160 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 -- 172.21.15.49:0/315969675 >> 172.21.15.49:0/315969675 conn(0x7f0bc00cfb90 msgr2=0x7f0bc00cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 -- 172.21.15.49:0/315969675 shutdown_connections 2023-12-19T05:42:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.776+0000 7f0bc67d6640 1 -- 172.21.15.49:0/315969675 wait complete. 2023-12-19T05:42:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.778+0000 7f0bc67d6640 1 Processor -- start 2023-12-19T05:42:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.778+0000 7f0bc67d6640 1 -- start start 2023-12-19T05:42:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc00cf670 0x7f0bc0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 0x7f0bc014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0151dc0 con 0x7f0bc015d620 2023-12-19T05:42:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0146b00 con 0x7f0bc015da00 2023-12-19T05:42:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc67d6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0151fd0 con 0x7f0bc00cf670 2023-12-19T05:42:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc4fd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc4fd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42882/0 (socket says 172.21.15.49:42882) 2023-12-19T05:42:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/1129966631 learned_addr learned my addr 172.21.15.49:0/1129966631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc57d4640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc00cf670 0x7f0bc0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.779+0000 7f0bc5fd5640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 0x7f0bc014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc00cf670 msgr2=0x7f0bc0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc00cf670 0x7f0bc0153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 msgr2=0x7f0bc014f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 0x7f0bc014f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 -- 172.21.15.49:0/1129966631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009400 con 0x7f0bc015d620 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc5fd5640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 0x7f0bc014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:02.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc4fd3640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000c00 tx=0x7f0bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0039c90 con 0x7f0bc015d620 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb003f040 con 0x7f0bc015d620 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01522b0 con 0x7f0bc015d620 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0006e10 con 0x7f0bc015d620 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.780+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0152870 con 0x7f0bc015d620 2023-12-19T05:42:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.782+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0168080 con 0x7f0bc015d620 2023-12-19T05:42:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.782+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bb0004030 con 0x7f0bc015d620 2023-12-19T05:42:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.783+0000 7f0bb5ffb640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 0x7f0ba406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.784+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0bb00aa670 con 0x7f0bc015d620 2023-12-19T05:42:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.784+0000 7f0bc57d4640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 0x7f0ba406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.785+0000 7f0bc57d4640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 0x7f0ba406c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0015a0 tx=0x7f0bbc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:02.787+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bc0168080 con 0x7f0bc015d620 2023-12-19T05:42:03.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.050+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f0bc0168080 con 0x7f0bc015d620 2023-12-19T05:42:03.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.591+0000 7f0bb5ffb640 1 -- 172.21.15.49:0/1129966631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v177) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0bc0168080 con 0x7f0bc015d620 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.594+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 msgr2=0x7f0ba406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.594+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 0x7f0ba406c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0015a0 tx=0x7f0bbc009040 comp rx=0 tx=0).stop 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.594+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 msgr2=0x7f0bc0146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.594+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000c00 tx=0x7f0bb00046c0 comp rx=0 tx=0).stop 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 shutdown_connections 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ba406a430 0x7f0ba406c8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bc015da00 0x7f0bc014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bc015d620 0x7f0bc0146020 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 --2- 172.21.15.49:0/1129966631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bc00cf670 0x7f0bc0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 >> 172.21.15.49:0/1129966631 conn(0x7f0bc00cfb90 msgr2=0x7f0bc0157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 shutdown_connections 2023-12-19T05:42:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:03.595+0000 7f0bc67d6640 1 -- 172.21.15.49:0/1129966631 wait complete. 2023-12-19T05:42:03.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T05:42:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_objectstore":"memstore"} 2023-12-19T05:42:03.869 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T05:42:03.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:42:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.104+0000 7fb55850a640 1 Processor -- start 2023-12-19T05:42:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.105+0000 7fb55850a640 1 -- start start 2023-12-19T05:42:04.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.106+0000 7fb55850a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5500b2f60 0x7fb5500af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.106+0000 7fb55850a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5500b2ad0 con 0x7fb550157bc0 2023-12-19T05:42:04.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb55850a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5500b24c0 con 0x7fb5500afc60 2023-12-19T05:42:04.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb55850a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500b00f0 con 0x7fb5500b2f60 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb5562a6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb550157bc0 0x7fb5500cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45204/0 (socket says 172.21.15.49:45204) 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb5562a6640 1 -- 172.21.15.49:0/145269444 learned_addr learned my addr 172.21.15.49:0/145269444 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325876785 0 0) 0x7fb5500b2ad0 con 0x7fb550157bc0 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb53c003520 con 0x7fb550157bc0 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.107+0000 7fb555aa5640 1 --2- 172.21.15.49:0/145269444 >> v2:172.21.15.115:3300/0 conn(0x7fb5500b2f60 0x7fb5500af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738341801 0 0) 0x7fb53c003520 con 0x7fb550157bc0 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 >> v2:172.21.15.115:3300/0 conn(0x7fb5500b2f60 msgr2=0x7fb5500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 --2- 172.21.15.49:0/145269444 >> v2:172.21.15.115:3300/0 conn(0x7fb5500b2f60 0x7fb5500af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 >> v1:172.21.15.115:6789/0 conn(0x7fb5500afc60 legacy=0x7fb55015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5500cfdf0 con 0x7fb550157bc0 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb54c001670 con 0x7fb550157bc0 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 >> v1:172.21.15.49:6789/0 conn(0x7fb550157bc0 legacy=0x7fb5500cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003a30 0x7fb53c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 0x7fb53c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb53c005380 0x7fb53c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500b00f0 con 0x7fb53c0047c0 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c00c210 con 0x7fb53c003a30 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c00c3d0 con 0x7fb53c005380 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb555aa5640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 0x7fb53c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb5562a6640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003a30 0x7fb53c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.108+0000 7fb556aa7640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb53c005380 0x7fb53c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb555aa5640 1 -- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb53c005380 msgr2=0x7fb53c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb555aa5640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb53c005380 0x7fb53c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb555aa5640 1 -- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003a30 msgr2=0x7fb53c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb555aa5640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003a30 0x7fb53c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb555aa5640 1 -- 172.21.15.49:0/145269444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c003520 con 0x7fb53c0047c0 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb556aa7640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb53c005380 0x7fb53c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.109+0000 7fb556aa7640 1 -- 172.21.15.49:0/145269444 reap_dead start 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.110+0000 7fb555aa5640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 0x7fb53c004c40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ba10 tx=0x7fb53c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901ca518d0c5e398 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.110+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544032630 con 0x7fb53c0047c0 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.110+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544032790 con 0x7fb53c0047c0 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.110+0000 7fb5552a4640 1 -- 172.21.15.49:0/145269444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544032b20 con 0x7fb53c0047c0 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 -- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 msgr2=0x7fb53c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 0x7fb53c004c40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ba10 tx=0x7fb53c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 -- 172.21.15.49:0/145269444 shutdown_connections 2023-12-19T05:42:04.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 --2- 172.21.15.49:0/145269444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb53c0047c0 0x7fb53c004c40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 -- 172.21.15.49:0/145269444 >> 172.21.15.49:0/145269444 conn(0x7fb55006b950 msgr2=0x7fb55006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 -- 172.21.15.49:0/145269444 shutdown_connections 2023-12-19T05:42:04.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.111+0000 7fb55850a640 1 -- 172.21.15.49:0/145269444 wait complete. 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.113+0000 7fb55850a640 1 Processor -- start 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.113+0000 7fb55850a640 1 -- start start 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c0047c0 0x7fb55015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 0x7fb5501614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550161010 con 0x7fb550153b80 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501f3b90 con 0x7fb53c0047c0 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb55850a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550160400 con 0x7fb5501f3710 2023-12-19T05:42:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb556aa7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb556aa7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50574/0 (socket says 172.21.15.49:50574) 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.114+0000 7fb556aa7640 1 -- 172.21.15.49:0/511671143 learned_addr learned my addr 172.21.15.49:0/511671143 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb5562a6640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c0047c0 0x7fb55015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb555aa5640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 0x7fb5501614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 -- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 msgr2=0x7fb5501614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 0x7fb5501614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 -- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c0047c0 msgr2=0x7fb55015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c0047c0 0x7fb55015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 -- 172.21.15.49:0/511671143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5501606e0 con 0x7fb550153b80 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb555aa5640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 0x7fb5501614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.115+0000 7fb556aa7640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb5500d1e90 tx=0x7fb54800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.116+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548018070 con 0x7fb550153b80 2023-12-19T05:42:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.116+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548006b50 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.116+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548012600 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.116+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501609c0 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.116+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5501619e0 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.117+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5501611c0 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.118+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb548012760 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.119+0000 7fb542ffd640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 0x7fb53406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.119+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb548087d40 con 0x7fb550153b80 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.120+0000 7fb5562a6640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 0x7fb53406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.121+0000 7fb5562a6640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 0x7fb53406c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001050 tx=0x7fb54c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.123+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5501611c0 con 0x7fb550153b80 2023-12-19T05:42:04.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.325+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb5501611c0 con 0x7fb550153b80 2023-12-19T05:42:04.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.333+0000 7fb542ffd640 1 -- 172.21.15.49:0/511671143 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb5501611c0 con 0x7fb550153b80 2023-12-19T05:42:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 msgr2=0x7fb53406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 0x7fb53406c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001050 tx=0x7fb54c009040 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 msgr2=0x7fb55006da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb5500d1e90 tx=0x7fb54800d9d0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 shutdown_connections 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53406a430 0x7fb53406c8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501f3710 0x7fb5501614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550153b80 0x7fb55006da40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 --2- 172.21.15.49:0/511671143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c0047c0 0x7fb55015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 >> 172.21.15.49:0/511671143 conn(0x7fb55006b950 msgr2=0x7fb5500b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 shutdown_connections 2023-12-19T05:42:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:04.336+0000 7fb55850a640 1 -- 172.21.15.49:0/511671143 wait complete. 2023-12-19T05:42:04.358 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:42:04.359 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:42:04.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:42:04.602 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:42:04.602 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:42:04.602 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:04.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:42:04.667 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:42:04.667 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:04.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:42:04.726 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:42:04.726 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:04.788 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:42:04.789 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:42:04.789 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:04.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:42:04.847 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:42:04.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:42:05.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.090+0000 7fa7df696640 1 Processor -- start 2023-12-19T05:42:05.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.090+0000 7fa7df696640 1 -- start start 2023-12-19T05:42:05.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.092+0000 7fa7df696640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7d8157aa0 0x7fa7d80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.092+0000 7fa7df696640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d815e040 0x7fa7d815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.092+0000 7fa7df696640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d806e8c0 con 0x7fa7d806e410 2023-12-19T05:42:05.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.092+0000 7fa7df696640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d815e9f0 con 0x7fa7d815e040 2023-12-19T05:42:05.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.092+0000 7fa7df696640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d80b2600 con 0x7fa7d8157aa0 2023-12-19T05:42:05.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d815e040 0x7fa7d815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d815e040 0x7fa7d815e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50582/0 (socket says 172.21.15.49:50582) 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 -- 172.21.15.49:0/473256552 learned_addr learned my addr 172.21.15.49:0/473256552 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7dd432640 1 --2- 172.21.15.49:0/473256552 >> v2:172.21.15.115:3300/0 conn(0x7fa7d8157aa0 0x7fa7d80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 -- 172.21.15.49:0/473256552 >> v2:172.21.15.115:3300/0 conn(0x7fa7d8157aa0 msgr2=0x7fa7d80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 --2- 172.21.15.49:0/473256552 >> v2:172.21.15.115:3300/0 conn(0x7fa7d8157aa0 0x7fa7d80b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 -- 172.21.15.49:0/473256552 >> v1:172.21.15.115:6789/0 conn(0x7fa7d806e410 legacy=0x7fa7d8161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.093+0000 7fa7ddc33640 1 -- 172.21.15.49:0/473256552 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80b1d60 con 0x7fa7d815e040 2023-12-19T05:42:05.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.095+0000 7fa7ddc33640 1 --2- 172.21.15.49:0/473256552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d815e040 0x7fa7d815e4b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80cc8c0 tx=0x7fa7d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac26dec2273c67da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.095+0000 7fa7cffff640 1 -- 172.21.15.49:0/473256552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0030860 con 0x7fa7d815e040 2023-12-19T05:42:05.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.095+0000 7fa7cffff640 1 -- 172.21.15.49:0/473256552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d00309c0 con 0x7fa7d815e040 2023-12-19T05:42:05.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.095+0000 7fa7cffff640 1 -- 172.21.15.49:0/473256552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0030d50 con 0x7fa7d815e040 2023-12-19T05:42:05.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 -- 172.21.15.49:0/473256552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d815e040 msgr2=0x7fa7d815e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 --2- 172.21.15.49:0/473256552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d815e040 0x7fa7d815e4b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80cc8c0 tx=0x7fa7d002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 -- 172.21.15.49:0/473256552 shutdown_connections 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 --2- 172.21.15.49:0/473256552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d815e040 0x7fa7d815e4b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 --2- 172.21.15.49:0/473256552 >> v2:172.21.15.115:3300/0 conn(0x7fa7d8157aa0 0x7fa7d80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 -- 172.21.15.49:0/473256552 >> 172.21.15.49:0/473256552 conn(0x7fa7d80cbb70 msgr2=0x7fa7d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 -- 172.21.15.49:0/473256552 shutdown_connections 2023-12-19T05:42:05.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.096+0000 7fa7df696640 1 -- 172.21.15.49:0/473256552 wait complete. 2023-12-19T05:42:05.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.098+0000 7fa7df696640 1 Processor -- start 2023-12-19T05:42:05.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.098+0000 7fa7df696640 1 -- start start 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d806e410 0x7fa7d806b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d815e040 0x7fa7d8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d806bcc0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d806bfa0 con 0x7fa7d815e040 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7df696640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d806c280 con 0x7fa7d806e410 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.099+0000 7fa7dcc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50584/0 (socket says 172.21.15.49:50584) 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 -- 172.21.15.49:0/1978344757 learned_addr learned my addr 172.21.15.49:0/1978344757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:05.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dd432640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d806e410 0x7fa7d806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7ddc33640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d815e040 0x7fa7d8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 -- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d806e410 msgr2=0x7fa7d806b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d806e410 0x7fa7d806b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 -- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d815e040 msgr2=0x7fa7d8159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d815e040 0x7fa7d8159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.100+0000 7fa7dcc31640 1 -- 172.21.15.49:0/1978344757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00094d0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7dcc31640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c3c0 tx=0x7fa7c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80052d0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8005450 con 0x7fa7d8157aa0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8007260 con 0x7fa7d8157aa0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d815ed10 con 0x7fa7d8157aa0 2023-12-19T05:42:05.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.101+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d814e740 con 0x7fa7d8157aa0 2023-12-19T05:42:05.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.102+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d815ef00 con 0x7fa7d8157aa0 2023-12-19T05:42:05.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.103+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7c80073c0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.104+0000 7fa7cdffb640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 0x7fa7bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.104+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa7c8087920 con 0x7fa7d8157aa0 2023-12-19T05:42:05.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.105+0000 7fa7dd432640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 0x7fa7bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.106+0000 7fa7dd432640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 0x7fa7bc06c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80cc0a0 tx=0x7fa7d40039b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.108+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7c80532a0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.343+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d8061910 con 0x7fa7d8157aa0 2023-12-19T05:42:05.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.344+0000 7fa7cdffb640 1 -- 172.21.15.49:0/1978344757 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa7c80568c0 con 0x7fa7d8157aa0 2023-12-19T05:42:05.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:05.346 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2069140918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2069140918},{"type":"v1","addr":"172.21.15.115:6837","nonce":2069140918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/996600204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":996600204},{"type":"v1","addr":"172.21.15.115:6836","nonce":996600204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3245949642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3245949642},{"type":"v1","addr":"172.21.15.49:6833","nonce":3245949642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1237789600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1237789600},{"type":"v1","addr":"172.21.15.49:6835","nonce":1237789600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-12-19T05:42:05.347 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 msgr2=0x7fa7bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 0x7fa7bc06c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80cc0a0 tx=0x7fa7d40039b0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 msgr2=0x7fa7d814e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c3c0 tx=0x7fa7c800c880 comp rx=0 tx=0).stop 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 shutdown_connections 2023-12-19T05:42:05.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7bc06a430 0x7fa7bc06c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d815e040 0x7fa7d8159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d8157aa0 0x7fa7d814e200 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 --2- 172.21.15.49:0/1978344757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d806e410 0x7fa7d806b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.347+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 >> 172.21.15.49:0/1978344757 conn(0x7fa7d80cbb70 msgr2=0x7fa7d80ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.348+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 shutdown_connections 2023-12-19T05:42:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.348+0000 7fa7df696640 1 -- 172.21.15.49:0/1978344757 wait complete. 2023-12-19T05:42:05.368 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:42:05.368 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:42:05.369 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:42:05.369 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:42:05.369 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:42:05.369 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:42:05.369 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:42:05.369 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:42:05.369 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:42:05.370 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:42:05.370 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:42:05.370 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:42:05.370 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:42:05.370 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:42:05.370 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:42:05.370 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:42:05.385 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:42:05.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:42:05.387 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:42:05.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:42:05.389 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:42:05.389 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:42:05.399 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:42:05.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:42:05.436 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:42:05.436 DEBUG:teuthology.parallel:result is None 2023-12-19T05:42:05.444 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:42:05.445 DEBUG:teuthology.parallel:result is None 2023-12-19T05:42:05.447 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:42:05.447 DEBUG:teuthology.parallel:result is None 2023-12-19T05:42:05.454 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:42:05.454 DEBUG:teuthology.parallel:result is None 2023-12-19T05:42:05.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:42:05.609 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:42:05.611 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:42:05.613 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:42:05.613 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:42:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.657+0000 7f75a6a5b640 1 Processor -- start 2023-12-19T05:42:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.657+0000 7f75a6a5b640 1 -- start start 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.658+0000 7f75a6a5b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75a0146c40 0x7f75a0070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.658+0000 7f75a6a5b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a0161d00 con 0x7f75a00d08f0 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.658+0000 7f75a6a5b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a006f160 con 0x7f75a00b7360 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.658+0000 7f75a6a5b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00700c0 con 0x7f75a0146c40 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75a0146c40 0x7f75a0070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75a0146c40 0x7f75a0070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50610/0 (socket says 172.21.15.49:50610) 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 -- 172.21.15.49:0/2934316351 learned_addr learned my addr 172.21.15.49:0/2934316351 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a625a640 1 --1- 172.21.15.49:0/2934316351 >> v1:172.21.15.49:6789/0 conn(0x7f75a00d08f0 0x7f75a01615f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45218/0 (socket says 172.21.15.49:45218) 2023-12-19T05:42:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 -- 172.21.15.49:0/2934316351 >> v1:172.21.15.115:6789/0 conn(0x7f75a00b7360 legacy=0x7f75a0160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 -- 172.21.15.49:0/2934316351 >> v1:172.21.15.49:6789/0 conn(0x7f75a00d08f0 legacy=0x7f75a01615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a5a59640 1 -- 172.21.15.49:0/2934316351 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a006f440 con 0x7f75a0146c40 2023-12-19T05:42:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.659+0000 7f75a4a57640 1 -- 172.21.15.49:0/2934316351 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726011523 0 0) 0x7f75a0161d00 con 0x7f75a00d08f0 2023-12-19T05:42:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.660+0000 7f75a5a59640 1 --2- 172.21.15.49:0/2934316351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a0070e70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f759c009870 tx=0x7f759c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54773d7deef09da9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a4a57640 1 -- 172.21.15.49:0/2934316351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c02f840 con 0x7f75a0146c40 2023-12-19T05:42:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a4a57640 1 -- 172.21.15.49:0/2934316351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c02f9a0 con 0x7f75a0146c40 2023-12-19T05:42:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a4a57640 1 -- 172.21.15.49:0/2934316351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c02fd30 con 0x7f75a0146c40 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a6a5b640 1 -- 172.21.15.49:0/2934316351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 msgr2=0x7f75a0070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/2934316351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a0070e70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f759c009870 tx=0x7f759c02ba20 comp rx=0 tx=0).stop 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a6a5b640 1 -- 172.21.15.49:0/2934316351 shutdown_connections 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/2934316351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a0070e70 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.661+0000 7f75a6a5b640 1 -- 172.21.15.49:0/2934316351 >> 172.21.15.49:0/2934316351 conn(0x7f75a00d31b0 msgr2=0x7f75a00d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.662+0000 7f75a6a5b640 1 -- 172.21.15.49:0/2934316351 shutdown_connections 2023-12-19T05:42:05.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.662+0000 7f75a6a5b640 1 -- 172.21.15.49:0/2934316351 wait complete. 2023-12-19T05:42:05.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.663+0000 7f75a6a5b640 1 Processor -- start 2023-12-19T05:42:05.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.663+0000 7f75a6a5b640 1 -- start start 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 0x7f75a013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a00d08f0 0x7f75a013f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a01f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a013fae0 con 0x7f75a0146c40 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a013fdc0 con 0x7f75a00d08f0 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.664+0000 7f75a6a5b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01400a0 con 0x7f75a00b7360 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a5a59640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 0x7f75a013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a01f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a5a59640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 0x7f75a013ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60796/0 (socket says 172.21.15.49:60796) 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a5a59640 1 -- 172.21.15.49:0/1042451653 learned_addr learned my addr 172.21.15.49:0/1042451653 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a5258640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a00d08f0 0x7f75a013f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 -- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 msgr2=0x7f75a013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 0x7f75a013ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 -- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a00d08f0 msgr2=0x7f75a013f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a00d08f0 0x7f75a013f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.665+0000 7f75a625a640 1 -- 172.21.15.49:0/1042451653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0094d0 con 0x7f75a0146c40 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75a625a640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a01f2880 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f75a00d0d40 tx=0x7f759800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598004d60 con 0x7f75a0146c40 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800a640 con 0x7f75a0146c40 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800a9f0 con 0x7f75a0146c40 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a0140380 con 0x7f75a0146c40 2023-12-19T05:42:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.666+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a013f7c0 con 0x7f75a0146c40 2023-12-19T05:42:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.667+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00b4860 con 0x7f75a0146c40 2023-12-19T05:42:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.668+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f759800ab50 con 0x7f75a0146c40 2023-12-19T05:42:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.669+0000 7f75967fc640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 0x7f758406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.669+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7598087a40 con 0x7f75a0146c40 2023-12-19T05:42:05.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.670+0000 7f75a5a59640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 0x7f758406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:05.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.671+0000 7f75a5a59640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 0x7f758406c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f759c02ba60 tx=0x7f759c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.674+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f75980533d0 con 0x7f75a0146c40 2023-12-19T05:42:05.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:05.885+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f75a0061910 con 0x7f75a0146c40 2023-12-19T05:42:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.646+0000 7f75967fc640 1 -- 172.21.15.49:0/1042451653 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7598018070 con 0x7f75a0146c40 2023-12-19T05:42:06.648 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.649+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 msgr2=0x7f758406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.649+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 0x7f758406c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f759c02ba60 tx=0x7f759c008030 comp rx=0 tx=0).stop 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.649+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 msgr2=0x7f75a01f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.649+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a01f2880 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f75a00d0d40 tx=0x7f759800cb60 comp rx=0 tx=0).stop 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 shutdown_connections 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f758406a430 0x7f758406c8f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0146c40 0x7f75a01f2880 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a00d08f0 0x7f75a013f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 --2- 172.21.15.49:0/1042451653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75a00b7360 0x7f75a013ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 >> 172.21.15.49:0/1042451653 conn(0x7f75a00d31b0 msgr2=0x7f75a00d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 shutdown_connections 2023-12-19T05:42:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.650+0000 7f75a6a5b640 1 -- 172.21.15.49:0/1042451653 wait complete. 2023-12-19T05:42:06.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:42:06.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.900+0000 7ffb45215640 1 Processor -- start 2023-12-19T05:42:06.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.900+0000 7ffb45215640 1 -- start start 2023-12-19T05:42:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb45215640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb4015e5a0 0x7ffb400b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb45215640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 0x7ffb400b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb45215640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4015ec30 con 0x7ffb400cdbf0 2023-12-19T05:42:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb45215640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb400b2cc0 con 0x7ffb4015e5a0 2023-12-19T05:42:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb45215640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4015e980 con 0x7ffb4015f680 2023-12-19T05:42:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb3ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb4015e5a0 0x7ffb400b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb3ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb4015e5a0 0x7ffb400b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50624/0 (socket says 172.21.15.49:50624) 2023-12-19T05:42:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.902+0000 7ffb3ffff640 1 -- 172.21.15.49:0/839075979 learned_addr learned my addr 172.21.15.49:0/839075979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb3ffff640 1 -- 172.21.15.49:0/839075979 >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 msgr2=0x7ffb400b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb37fff640 1 --2- 172.21.15.49:0/839075979 >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 0x7ffb400b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb3ffff640 1 --2- 172.21.15.49:0/839075979 >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 0x7ffb400b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb3ffff640 1 -- 172.21.15.49:0/839075979 >> v1:172.21.15.115:6789/0 conn(0x7ffb400cdbf0 legacy=0x7ffb4006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb3ffff640 1 -- 172.21.15.49:0/839075979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb400b2f90 con 0x7ffb4015e5a0 2023-12-19T05:42:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.903+0000 7ffb37fff640 1 --2- 172.21.15.49:0/839075979 >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 0x7ffb400b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.904+0000 7ffb3ffff640 1 --2- 172.21.15.49:0/839075979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015e5a0 0x7ffb400b2030 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009870 tx=0x7ffb3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7163330209c88121 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.904+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/839075979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30031870 con 0x7ffb4015e5a0 2023-12-19T05:42:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.904+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/839075979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb300319d0 con 0x7ffb4015e5a0 2023-12-19T05:42:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.904+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/839075979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30031d60 con 0x7ffb4015e5a0 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 -- 172.21.15.49:0/839075979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015e5a0 msgr2=0x7ffb400b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 --2- 172.21.15.49:0/839075979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015e5a0 0x7ffb400b2030 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009870 tx=0x7ffb3002b910 comp rx=0 tx=0).stop 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 -- 172.21.15.49:0/839075979 shutdown_connections 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 --2- 172.21.15.49:0/839075979 >> v2:172.21.15.115:3300/0 conn(0x7ffb4015f680 0x7ffb400b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 --2- 172.21.15.49:0/839075979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015e5a0 0x7ffb400b2030 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 -- 172.21.15.49:0/839075979 >> 172.21.15.49:0/839075979 conn(0x7ffb400b0100 msgr2=0x7ffb400b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.905+0000 7ffb45215640 1 -- 172.21.15.49:0/839075979 shutdown_connections 2023-12-19T05:42:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.906+0000 7ffb45215640 1 -- 172.21.15.49:0/839075979 wait complete. 2023-12-19T05:42:06.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.907+0000 7ffb45215640 1 Processor -- start 2023-12-19T05:42:06.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.908+0000 7ffb45215640 1 -- start start 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.908+0000 7ffb45215640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb400cdbf0 0x7ffb400c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.908+0000 7ffb45215640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb4015e5a0 0x7ffb401f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb45215640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb45215640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40154ea0 con 0x7ffb4015f680 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb45215640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40156fb0 con 0x7ffb400cdbf0 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb45215640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40157290 con 0x7ffb4015e5a0 2023-12-19T05:42:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:06.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50640/0 (socket says 172.21.15.49:50640) 2023-12-19T05:42:06.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 -- 172.21.15.49:0/3512292721 learned_addr learned my addr 172.21.15.49:0/3512292721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb3ffff640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb400cdbf0 0x7ffb400c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 -- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb4015e5a0 msgr2=0x7ffb401f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb4015e5a0 0x7ffb401f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 -- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb400cdbf0 msgr2=0x7ffb400c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb400cdbf0 0x7ffb400c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.909+0000 7ffb44a14640 1 -- 172.21.15.49:0/3512292721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300094d0 con 0x7ffb4015f680 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb44a14640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c780 tx=0x7ffb3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38004b60 con 0x7ffb4015f680 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3800ce90 con 0x7ffb4015f680 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb40157570 con 0x7ffb4015f680 2023-12-19T05:42:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800a850 con 0x7ffb4015f680 2023-12-19T05:42:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.910+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb400c8850 con 0x7ffb4015f680 2023-12-19T05:42:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.911+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40061910 con 0x7ffb4015f680 2023-12-19T05:42:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.912+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb3800a9b0 con 0x7ffb4015f680 2023-12-19T05:42:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.913+0000 7ffb3d7fa640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 0x7ffb2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.913+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb38088780 con 0x7ffb4015f680 2023-12-19T05:42:06.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.914+0000 7ffb3ffff640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 0x7ffb2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:06.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.915+0000 7ffb3ffff640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 0x7ffb2006c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb30036000 tx=0x7ffb3003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:06.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:06.918+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb380540b0 con 0x7ffb4015f680 2023-12-19T05:42:07.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.181+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffb400ce980 con 0x7ffb4015f680 2023-12-19T05:42:07.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.182+0000 7ffb3d7fa640 1 -- 172.21.15.49:0/3512292721 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffb380576d0 con 0x7ffb4015f680 2023-12-19T05:42:07.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:42:07.183 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.185 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.186 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.187 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.190 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:42:07.191 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.192 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:42:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:42:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:07.196 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:42:07.196 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 msgr2=0x7ffb2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 0x7ffb2006c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb30036000 tx=0x7ffb3003c040 comp rx=0 tx=0).stop 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 msgr2=0x7ffb401f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c780 tx=0x7ffb3800cc40 comp rx=0 tx=0).stop 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 shutdown_connections 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffb2006a430 0x7ffb2006c8f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb4015e5a0 0x7ffb401f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb4015f680 0x7ffb401f6410 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 --2- 172.21.15.49:0/3512292721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb400cdbf0 0x7ffb400c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.184+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 >> 172.21.15.49:0/3512292721 conn(0x7ffb400b0100 msgr2=0x7ffb400b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.185+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 shutdown_connections 2023-12-19T05:42:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.185+0000 7ffb45215640 1 -- 172.21.15.49:0/3512292721 wait complete. 2023-12-19T05:42:07.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:42:07.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.432+0000 7fbbb0e8a640 1 Processor -- start 2023-12-19T05:42:07.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.432+0000 7fbbb0e8a640 1 -- start start 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbbac15e3f0 0x7fbbac0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbac0b2460 0x7fbbac0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac0acdf0 0x7fbbac160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0ad280 con 0x7fbbac0b2460 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0b2fa0 con 0x7fbbac15e3f0 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbb0e8a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac06f600 con 0x7fbbac0acdf0 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbaaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbac0b2460 0x7fbbac0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbaaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbac0b2460 0x7fbbac0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50656/0 (socket says 172.21.15.49:50656) 2023-12-19T05:42:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.434+0000 7fbbaaffd640 1 -- 172.21.15.49:0/3718560289 learned_addr learned my addr 172.21.15.49:0/3718560289 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbabfff640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac0acdf0 0x7fbbac160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbaaffd640 1 -- 172.21.15.49:0/3718560289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac0acdf0 msgr2=0x7fbbac160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac0acdf0 0x7fbbac160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbaaffd640 1 -- 172.21.15.49:0/3718560289 >> v2:172.21.15.115:3300/0 conn(0x7fbbac15e3f0 msgr2=0x7fbbac0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/3718560289 >> v2:172.21.15.115:3300/0 conn(0x7fbbac15e3f0 0x7fbbac0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.435+0000 7fbbaaffd640 1 -- 172.21.15.49:0/3718560289 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac15e7d0 con 0x7fbbac0b2460 2023-12-19T05:42:07.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.436+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac0ac8b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b5200 tx=0x7fbba002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3fb716911ecff3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.436+0000 7fbbaa7fc640 1 -- 172.21.15.49:0/3718560289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00317d0 con 0x7fbbac0b2460 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.436+0000 7fbbaa7fc640 1 -- 172.21.15.49:0/3718560289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0031930 con 0x7fbbac0b2460 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.436+0000 7fbbaa7fc640 1 -- 172.21.15.49:0/3718560289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0031cc0 con 0x7fbbac0b2460 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/3718560289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 msgr2=0x7fbbac0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac0ac8b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b5200 tx=0x7fbba002b870 comp rx=0 tx=0).stop 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/3718560289 shutdown_connections 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac0acdf0 0x7fbbac160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/3718560289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac0ac8b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/3718560289 >> v2:172.21.15.115:3300/0 conn(0x7fbbac15e3f0 0x7fbbac0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/3718560289 >> 172.21.15.49:0/3718560289 conn(0x7fbbac0b0100 msgr2=0x7fbbac0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/3718560289 shutdown_connections 2023-12-19T05:42:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.437+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/3718560289 wait complete. 2023-12-19T05:42:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.439+0000 7fbbb0e8a640 1 Processor -- start 2023-12-19T05:42:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.439+0000 7fbbb0e8a640 1 -- start start 2023-12-19T05:42:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbac0acdf0 0x7fbbac13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 0x7fbbac151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac140100 con 0x7fbbac0b2460 2023-12-19T05:42:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1545d0 con 0x7fbbac0acdf0 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbb0e8a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac06bf90 con 0x7fbbac15e3f0 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbaaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbaaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50658/0 (socket says 172.21.15.49:50658) 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.440+0000 7fbbaaffd640 1 -- 172.21.15.49:0/438595640 learned_addr learned my addr 172.21.15.49:0/438595640 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbab7fe640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbac0acdf0 0x7fbbac13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbabfff640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 0x7fbbac151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 -- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 msgr2=0x7fbbac151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 0x7fbbac151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 -- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbac0acdf0 msgr2=0x7fbbac13fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbac0acdf0 0x7fbbac13fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 -- 172.21.15.49:0/438595640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00094d0 con 0x7fbbac0b2460 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbabfff640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 0x7fbbac151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.441+0000 7fbbaaffd640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.442+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0032870 con 0x7fbbac0b2460 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.442+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0032a10 con 0x7fbbac0b2460 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.442+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0032dc0 con 0x7fbbac0b2460 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.442+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac1539c0 con 0x7fbbac0b2460 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.442+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac153f80 con 0x7fbbac0b2460 2023-12-19T05:42:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.443+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac154740 con 0x7fbbac0b2460 2023-12-19T05:42:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.444+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbba0030070 con 0x7fbbac0b2460 2023-12-19T05:42:07.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.445+0000 7fbb93fff640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 0x7fbb9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.445+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbba00aa460 con 0x7fbbac0b2460 2023-12-19T05:42:07.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.445+0000 7fbbab7fe640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 0x7fbb9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.447+0000 7fbbab7fe640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 0x7fbb9806c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009f20 tx=0x7fbb9c0094f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.449+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbba0075d90 con 0x7fbbac0b2460 2023-12-19T05:42:07.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.642+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbac061910 con 0x7fbbac0b2460 2023-12-19T05:42:07.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.644+0000 7fbb93fff640 1 -- 172.21.15.49:0/438595640 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+12389 (secure 0 0 0) 0x7fbba00793b0 con 0x7fbbac0b2460 2023-12-19T05:42:07.646 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:07.646 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":66,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:06.638836+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:42:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 msgr2=0x7fbb9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 0x7fbb9806c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009f20 tx=0x7fbb9c0094f0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 msgr2=0x7fbbac06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba00046c0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 shutdown_connections 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbb9806a430 0x7fbb9806c8f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbac15e3f0 0x7fbbac151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbac0b2460 0x7fbbac06ba50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 --2- 172.21.15.49:0/438595640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbac0acdf0 0x7fbbac13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 >> 172.21.15.49:0/438595640 conn(0x7fbbac0b0100 msgr2=0x7fbbac157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 shutdown_connections 2023-12-19T05:42:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.647+0000 7fbbb0e8a640 1 -- 172.21.15.49:0/438595640 wait complete. 2023-12-19T05:42:07.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:42:07.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:42:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.905+0000 7f514113e640 1 Processor -- start 2023-12-19T05:42:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.905+0000 7f514113e640 1 -- start start 2023-12-19T05:42:07.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f514113e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f514113e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f513c0ceea0 0x7f513c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f514113e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c15fde0 con 0x7f513c15b1d0 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f514113e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0b2400 con 0x7f513c0ceea0 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f514113e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0cf870 con 0x7f513c0b2760 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f513ad9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f513c15b1d0 0x7f513c15f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45222/0 (socket says 172.21.15.49:45222) 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f513ad9d640 1 -- 172.21.15.49:0/17389651 learned_addr learned my addr 172.21.15.49:0/17389651 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.907+0000 7f513b59e640 1 --2- 172.21.15.49:0/17389651 >> v2:172.21.15.49:3300/0 conn(0x7f513c0ceea0 0x7f513c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f513a59c640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f5139d9b640 1 -- 172.21.15.49:0/17389651 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718173800 0 0) 0x7f513c15fde0 con 0x7f513c15b1d0 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f5139d9b640 1 -- 172.21.15.49:0/17389651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5124003520 con 0x7f513c15b1d0 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f513b59e640 1 -- 172.21.15.49:0/17389651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 msgr2=0x7f513c0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f513b59e640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f513b59e640 1 -- 172.21.15.49:0/17389651 >> v1:172.21.15.49:6789/0 conn(0x7f513c15b1d0 legacy=0x7f513c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.908+0000 7f513b59e640 1 -- 172.21.15.49:0/17389651 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0b2bc0 con 0x7f513c0ceea0 2023-12-19T05:42:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.909+0000 7f513b59e640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0cf330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5134009d90 tx=0x7f513402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e86242b5787db8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.909+0000 7f5139d9b640 1 -- 172.21.15.49:0/17389651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513402cc50 con 0x7f513c0ceea0 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.909+0000 7f5139d9b640 1 -- 172.21.15.49:0/17389651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513402cdb0 con 0x7f513c0ceea0 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.909+0000 7f5139d9b640 1 -- 172.21.15.49:0/17389651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134034660 con 0x7f513c0ceea0 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 -- 172.21.15.49:0/17389651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 msgr2=0x7f513c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0cf330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5134009d90 tx=0x7f513402bea0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 -- 172.21.15.49:0/17389651 shutdown_connections 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0cf330 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 --2- 172.21.15.49:0/17389651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 -- 172.21.15.49:0/17389651 >> 172.21.15.49:0/17389651 conn(0x7f513c073150 msgr2=0x7f513c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 -- 172.21.15.49:0/17389651 shutdown_connections 2023-12-19T05:42:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.910+0000 7f514113e640 1 -- 172.21.15.49:0/17389651 wait complete. 2023-12-19T05:42:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.912+0000 7f514113e640 1 Processor -- start 2023-12-19T05:42:07.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.912+0000 7f514113e640 1 -- start start 2023-12-19T05:42:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.913+0000 7f514113e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.913+0000 7f514113e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.913+0000 7f514113e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c15b1d0 0x7f513c06c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f514113e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c1f3b10 con 0x7f513c0ceea0 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f514113e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c147b30 con 0x7f513c15b1d0 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f514113e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c1f3830 con 0x7f513c0b2760 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50676/0 (socket says 172.21.15.49:50676) 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 -- 172.21.15.49:0/672339014 learned_addr learned my addr 172.21.15.49:0/672339014 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 -- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 msgr2=0x7f513c0b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 -- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c15b1d0 msgr2=0x7f513c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c15b1d0 0x7f513c06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.914+0000 7f513a59c640 1 -- 172.21.15.49:0/672339014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134009a70 con 0x7f513c0ceea0 2023-12-19T05:42:07.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f513a59c640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f513000d800 tx=0x7f513000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513000b6c0 con 0x7f513c0ceea0 2023-12-19T05:42:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513000b820 con 0x7f513c0ceea0 2023-12-19T05:42:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513000bbb0 con 0x7f513c0ceea0 2023-12-19T05:42:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c147470 con 0x7f513c0ceea0 2023-12-19T05:42:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.915+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c147f50 con 0x7f513c0ceea0 2023-12-19T05:42:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.916+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c147da0 con 0x7f513c0ceea0 2023-12-19T05:42:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.917+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f513000bd10 con 0x7f513c0ceea0 2023-12-19T05:42:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.919+0000 7f51237fe640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 0x7f512806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.919+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5130088b10 con 0x7f513c0ceea0 2023-12-19T05:42:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.919+0000 7f513ad9d640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 0x7f512806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:07.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.921+0000 7f513ad9d640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 0x7f512806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f512c001570 tx=0x7f512c007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:07.923+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5130054450 con 0x7f513c0ceea0 2023-12-19T05:42:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.117+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f513c1472d0 con 0x7f513c0ceea0 2023-12-19T05:42:08.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.118+0000 7f51237fe640 1 -- 172.21.15.49:0/672339014 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f513c1472d0 con 0x7f513c0ceea0 2023-12-19T05:42:08.119 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.120+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 msgr2=0x7f512806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.120+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 0x7f512806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f512c001570 tx=0x7f512c007930 comp rx=0 tx=0).stop 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 msgr2=0x7f513c0b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f513000d800 tx=0x7f513000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 shutdown_connections 2023-12-19T05:42:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f512806a430 0x7f512806c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c15b1d0 0x7f513c06c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513c0ceea0 0x7f513c0b38a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 --2- 172.21.15.49:0/672339014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f513c0b2760 0x7f513c0b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 >> 172.21.15.49:0/672339014 conn(0x7f513c073150 msgr2=0x7f513c0cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 shutdown_connections 2023-12-19T05:42:08.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.121+0000 7f514113e640 1 -- 172.21.15.49:0/672339014 wait complete. 2023-12-19T05:42:08.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:42:08.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.377+0000 7f607aa8f640 1 Processor -- start 2023-12-19T05:42:08.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.377+0000 7f607aa8f640 1 -- start start 2023-12-19T05:42:08.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607aa8f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f607415d490 0x7f60740ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607aa8f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 0x7f60740acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607aa8f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607406b850 con 0x7f60740caf40 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607aa8f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607406c6b0 con 0x7f607415d490 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607aa8f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607406f160 con 0x7f607415d870 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607882b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f607415d490 0x7f60740ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607882b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f607415d490 0x7f60740ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50684/0 (socket says 172.21.15.49:50684) 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f607882b640 1 -- 172.21.15.49:0/2078878724 learned_addr learned my addr 172.21.15.49:0/2078878724 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.379+0000 7f6073fff640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 0x7f60740acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.380+0000 7f607882b640 1 -- 172.21.15.49:0/2078878724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 msgr2=0x7f60740acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.380+0000 7f607882b640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 0x7f60740acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.380+0000 7f607882b640 1 -- 172.21.15.49:0/2078878724 >> v1:172.21.15.115:6789/0 conn(0x7f60740caf40 legacy=0x7f6074161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.380+0000 7f607882b640 1 -- 172.21.15.49:0/2078878724 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607406bb30 con 0x7f607415d490 2023-12-19T05:42:08.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.380+0000 7f6073fff640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 0x7f60740acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.381+0000 7f607882b640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f60740ac8b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b758e23b7bedd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.381+0000 7f60737fe640 1 -- 172.21.15.49:0/2078878724 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068031640 con 0x7f607415d490 2023-12-19T05:42:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.381+0000 7f60737fe640 1 -- 172.21.15.49:0/2078878724 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680317a0 con 0x7f607415d490 2023-12-19T05:42:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.381+0000 7f60737fe640 1 -- 172.21.15.49:0/2078878724 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068031b30 con 0x7f607415d490 2023-12-19T05:42:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 -- 172.21.15.49:0/2078878724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 msgr2=0x7f60740ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f60740ac8b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 -- 172.21.15.49:0/2078878724 shutdown_connections 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f607415d870 0x7f60740acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 --2- 172.21.15.49:0/2078878724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f60740ac8b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 -- 172.21.15.49:0/2078878724 >> 172.21.15.49:0/2078878724 conn(0x7f60740cf0b0 msgr2=0x7f60740cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 -- 172.21.15.49:0/2078878724 shutdown_connections 2023-12-19T05:42:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.382+0000 7f607aa8f640 1 -- 172.21.15.49:0/2078878724 wait complete. 2023-12-19T05:42:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.384+0000 7f607aa8f640 1 Processor -- start 2023-12-19T05:42:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.384+0000 7f607aa8f640 1 -- start start 2023-12-19T05:42:08.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60740caf40 0x7f60741f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f607415d870 0x7f607415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074152e80 con 0x7f607415d490 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074156da0 con 0x7f607415d870 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.385+0000 7f607aa8f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074153060 con 0x7f60740caf40 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50692/0 (socket says 172.21.15.49:50692) 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 -- 172.21.15.49:0/3690106463 learned_addr learned my addr 172.21.15.49:0/3690106463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f607882b640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60740caf40 0x7f60741f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f607902c640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f607415d870 0x7f607415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 -- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60740caf40 msgr2=0x7f60741f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60740caf40 0x7f60741f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 -- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f607415d870 msgr2=0x7f607415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f607415d870 0x7f607415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 -- 172.21.15.49:0/3690106463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680094d0 con 0x7f607415d490 2023-12-19T05:42:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.386+0000 7f6073fff640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f606000c7f0 tx=0x7f606000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.387+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060007820 con 0x7f607415d490 2023-12-19T05:42:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.387+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6060007980 con 0x7f607415d490 2023-12-19T05:42:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.387+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074153340 con 0x7f607415d490 2023-12-19T05:42:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.387+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060007cf0 con 0x7f607415d490 2023-12-19T05:42:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.387+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6074156aa0 con 0x7f607415d490 2023-12-19T05:42:08.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.388+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074074770 con 0x7f607415d490 2023-12-19T05:42:08.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.389+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60600113f0 con 0x7f607415d490 2023-12-19T05:42:08.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.390+0000 7f60717fa640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 0x7f605806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.390+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6060088990 con 0x7f607415d490 2023-12-19T05:42:08.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.391+0000 7f607882b640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 0x7f605806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.392+0000 7f607882b640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 0x7f605806c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6068036000 tx=0x7f606803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.394+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6060054230 con 0x7f607415d490 2023-12-19T05:42:08.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.589+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6074061910 con 0x7f607415d490 2023-12-19T05:42:08.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.590+0000 7f60717fa640 1 -- 172.21.15.49:0/3690106463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) v1 ==== 84+0+65 (secure 0 0 0) 0x7f606001f090 con 0x7f607415d490 2023-12-19T05:42:08.591 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:08.591 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:42:08.591 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:42:08.592 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:42:08.592 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:42:08.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:42:08.592 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:42:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.592+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 msgr2=0x7f605806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.592+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 0x7f605806c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6068036000 tx=0x7f606803c040 comp rx=0 tx=0).stop 2023-12-19T05:42:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.592+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 msgr2=0x7f6074156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.592+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f606000c7f0 tx=0x7f606000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 shutdown_connections 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f605806a460 0x7f605806c920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f607415d870 0x7f607415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f607415d490 0x7f6074156560 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 --2- 172.21.15.49:0/3690106463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60740caf40 0x7f60741f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 >> 172.21.15.49:0/3690106463 conn(0x7f60740cf0b0 msgr2=0x7f607406f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 shutdown_connections 2023-12-19T05:42:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.593+0000 7f607aa8f640 1 -- 172.21.15.49:0/3690106463 wait complete. 2023-12-19T05:42:08.615 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:42:08.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:42:08.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.850+0000 7f89bc915640 1 Processor -- start 2023-12-19T05:42:08.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.850+0000 7f89bc915640 1 -- start start 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.851+0000 7f89bc915640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 0x7f89b80b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89bc915640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89b80d3820 0x7f89b80d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89bc915640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80d07c0 con 0x7f89b80b1d90 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89bc915640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80ce7b0 con 0x7f89b80d3820 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89bc915640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b815d8c0 con 0x7f89b815d4e0 2023-12-19T05:42:08.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89affff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f89b80b1d90 0x7f89b80d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45238/0 (socket says 172.21.15.49:45238) 2023-12-19T05:42:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89affff640 1 -- 172.21.15.49:0/2843481501 learned_addr learned my addr 172.21.15.49:0/2843481501 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89b7fff640 1 --2- 172.21.15.49:0/2843481501 >> v2:172.21.15.49:3300/0 conn(0x7f89b80d3820 0x7f89b80d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.852+0000 7f89b77fe640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 0x7f89b80b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b6ffd640 1 -- 172.21.15.49:0/2843481501 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869034524 0 0) 0x7f89b80d07c0 con 0x7f89b80b1d90 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b6ffd640 1 -- 172.21.15.49:0/2843481501 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a4003520 con 0x7f89b80b1d90 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b7fff640 1 -- 172.21.15.49:0/2843481501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 msgr2=0x7f89b80b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b7fff640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 0x7f89b80b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b7fff640 1 -- 172.21.15.49:0/2843481501 >> v1:172.21.15.49:6789/0 conn(0x7f89b80b1d90 legacy=0x7f89b80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b7fff640 1 -- 172.21.15.49:0/2843481501 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80cfbb0 con 0x7f89b80d3820 2023-12-19T05:42:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.853+0000 7f89b77fe640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 0x7f89b80b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:42:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.854+0000 7f89b7fff640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80d3820 0x7f89b80d15b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009d90 tx=0x7f89b002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1746564c387e7124 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.854+0000 7f89b6ffd640 1 -- 172.21.15.49:0/2843481501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b002cc60 con 0x7f89b80d3820 2023-12-19T05:42:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.854+0000 7f89b6ffd640 1 -- 172.21.15.49:0/2843481501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b002cdc0 con 0x7f89b80d3820 2023-12-19T05:42:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.854+0000 7f89b6ffd640 1 -- 172.21.15.49:0/2843481501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0034640 con 0x7f89b80d3820 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 -- 172.21.15.49:0/2843481501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80d3820 msgr2=0x7f89b80d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80d3820 0x7f89b80d15b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009d90 tx=0x7f89b002beb0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 -- 172.21.15.49:0/2843481501 shutdown_connections 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80d3820 0x7f89b80d15b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 --2- 172.21.15.49:0/2843481501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b815d4e0 0x7f89b80b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 -- 172.21.15.49:0/2843481501 >> 172.21.15.49:0/2843481501 conn(0x7f89b8072f40 msgr2=0x7f89b8073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 -- 172.21.15.49:0/2843481501 shutdown_connections 2023-12-19T05:42:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.855+0000 7f89bc915640 1 -- 172.21.15.49:0/2843481501 wait complete. 2023-12-19T05:42:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.857+0000 7f89bc915640 1 Processor -- start 2023-12-19T05:42:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.857+0000 7f89bc915640 1 -- start start 2023-12-19T05:42:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 0x7f89b80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 0x7f89b80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80a9960 con 0x7f89b80b1d90 2023-12-19T05:42:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b815dd70 con 0x7f89b815d4e0 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89bc915640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80a90c0 con 0x7f89b80d3820 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50708/0 (socket says 172.21.15.49:50708) 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.858+0000 7f89b77fe640 1 -- 172.21.15.49:0/922310821 learned_addr learned my addr 172.21.15.49:0/922310821 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b7fff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 0x7f89b80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89affff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 0x7f89b80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 -- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 msgr2=0x7f89b80cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 0x7f89b80cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 -- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 msgr2=0x7f89b80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 0x7f89b80cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 -- 172.21.15.49:0/922310821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0009a70 con 0x7f89b80b1d90 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89affff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 0x7f89b80cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b7fff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 0x7f89b80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b77fe640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f89a800d7d0 tx=0x7f89a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004030 con 0x7f89b80b1d90 2023-12-19T05:42:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8004190 con 0x7f89b80b1d90 2023-12-19T05:42:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.859+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004520 con 0x7f89b80b1d90 2023-12-19T05:42:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.860+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b80a93a0 con 0x7f89b80b1d90 2023-12-19T05:42:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.860+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b815dfa0 con 0x7f89b80b1d90 2023-12-19T05:42:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.861+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b8061910 con 0x7f89b80b1d90 2023-12-19T05:42:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.862+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89a80096a0 con 0x7f89b80b1d90 2023-12-19T05:42:08.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.863+0000 7f89b4ff9640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 0x7f899806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:08.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.863+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89a8088760 con 0x7f89b80b1d90 2023-12-19T05:42:08.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.863+0000 7f89affff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 0x7f899806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:08.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.865+0000 7f89affff640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 0x7f899806c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89b815ffa0 tx=0x7f89a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:08.867+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89a80540a0 con 0x7f89b80b1d90 2023-12-19T05:42:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.064+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89b80d3e50 con 0x7f89b80b1d90 2023-12-19T05:42:09.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.379+0000 7f89b4ff9640 1 -- 172.21.15.49:0/922310821 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89a80576c0 con 0x7f89b80b1d90 2023-12-19T05:42:09.381 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:42:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 msgr2=0x7f899806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 0x7f899806c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89b815ffa0 tx=0x7f89a0009040 comp rx=0 tx=0).stop 2023-12-19T05:42:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 msgr2=0x7f89b814f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f89a800d7d0 tx=0x7f89a800dc90 comp rx=0 tx=0).stop 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 shutdown_connections 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f899806a430 0x7f899806c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89b80d3820 0x7f89b80cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b815d4e0 0x7f89b80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 --2- 172.21.15.49:0/922310821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b80b1d90 0x7f89b814f1b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.385+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 >> 172.21.15.49:0/922310821 conn(0x7f89b8072f40 msgr2=0x7f89b80d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.386+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 shutdown_connections 2023-12-19T05:42:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.386+0000 7f89bc915640 1 -- 172.21.15.49:0/922310821 wait complete. 2023-12-19T05:42:09.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:42:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.646+0000 7f62b12bd640 1 Processor -- start 2023-12-19T05:42:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.646+0000 7f62b12bd640 1 -- start start 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62b12bd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62ac158df0 0x7f62ac15c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62b12bd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 0x7f62ac06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62b12bd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac070130 con 0x7f62ac06f160 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62b12bd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06f610 con 0x7f62ac158df0 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62b12bd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06e170 con 0x7f62ac06d850 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.648+0000 7f62aaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62ac158df0 0x7f62ac15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62ac158df0 0x7f62ac15c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50712/0 (socket says 172.21.15.49:50712) 2023-12-19T05:42:09.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 -- 172.21.15.49:0/1270191370 learned_addr learned my addr 172.21.15.49:0/1270191370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 -- 172.21.15.49:0/1270191370 >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 msgr2=0x7f62ac06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62ab7fe640 1 --2- 172.21.15.49:0/1270191370 >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 0x7f62ac06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 --2- 172.21.15.49:0/1270191370 >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 0x7f62ac06dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 -- 172.21.15.49:0/1270191370 >> v1:172.21.15.115:6789/0 conn(0x7f62ac06f160 legacy=0x7f62ac0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62aaffd640 1 -- 172.21.15.49:0/1270191370 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac06f890 con 0x7f62ac158df0 2023-12-19T05:42:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.649+0000 7f62ab7fe640 1 --2- 172.21.15.49:0/1270191370 >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 0x7f62ac06dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.650+0000 7f62aaffd640 1 --2- 172.21.15.49:0/1270191370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac158df0 0x7f62ac15c460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0d00c0 tx=0x7f629c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d376ca4eeb55b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62a9ffb640 1 -- 172.21.15.49:0/1270191370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0317e0 con 0x7f62ac158df0 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62a9ffb640 1 -- 172.21.15.49:0/1270191370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c031940 con 0x7f62ac158df0 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62a9ffb640 1 -- 172.21.15.49:0/1270191370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c031cd0 con 0x7f62ac158df0 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 -- 172.21.15.49:0/1270191370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac158df0 msgr2=0x7f62ac15c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 --2- 172.21.15.49:0/1270191370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac158df0 0x7f62ac15c460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0d00c0 tx=0x7f629c02b880 comp rx=0 tx=0).stop 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 -- 172.21.15.49:0/1270191370 shutdown_connections 2023-12-19T05:42:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 --2- 172.21.15.49:0/1270191370 >> v2:172.21.15.115:3300/0 conn(0x7f62ac06d850 0x7f62ac06dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 --2- 172.21.15.49:0/1270191370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac158df0 0x7f62ac15c460 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 -- 172.21.15.49:0/1270191370 >> 172.21.15.49:0/1270191370 conn(0x7f62ac0cf0b0 msgr2=0x7f62ac0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.651+0000 7f62b12bd640 1 -- 172.21.15.49:0/1270191370 shutdown_connections 2023-12-19T05:42:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.652+0000 7f62b12bd640 1 -- 172.21.15.49:0/1270191370 wait complete. 2023-12-19T05:42:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.653+0000 7f62b12bd640 1 Processor -- start 2023-12-19T05:42:09.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.654+0000 7f62b12bd640 1 -- start start 2023-12-19T05:42:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.654+0000 7f62b12bd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac06d850 0x7f62ac13dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.654+0000 7f62b12bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62b12bd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 0x7f62ac158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62b12bd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac150660 con 0x7f62ac06f160 2023-12-19T05:42:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62b12bd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac14fa50 con 0x7f62ac06d850 2023-12-19T05:42:09.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62b12bd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac14fd30 con 0x7f62ac158df0 2023-12-19T05:42:09.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50724/0 (socket says 172.21.15.49:50724) 2023-12-19T05:42:09.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 -- 172.21.15.49:0/94748761 learned_addr learned my addr 172.21.15.49:0/94748761 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:09.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aaffd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac06d850 0x7f62ac13dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 -- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 msgr2=0x7f62ac158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62ab7fe640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 0x7f62ac158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 0x7f62ac158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 -- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac06d850 msgr2=0x7f62ac13dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac06d850 0x7f62ac13dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62aa7fc640 1 -- 172.21.15.49:0/94748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0094d0 con 0x7f62ac06f160 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.655+0000 7f62ab7fe640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 0x7f62ac158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62aa7fc640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f62a000c430 tx=0x7f62a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0011790 con 0x7f62ac06f160 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a00118f0 con 0x7f62ac06f160 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0011ce0 con 0x7f62ac06f160 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac150010 con 0x7f62ac06f160 2023-12-19T05:42:09.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.656+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac13e190 con 0x7f62ac06f160 2023-12-19T05:42:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.657+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac074770 con 0x7f62ac06f160 2023-12-19T05:42:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.659+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62a001c460 con 0x7f62ac06f160 2023-12-19T05:42:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.660+0000 7f62937fe640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 0x7f629806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.660+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f62a00891b0 con 0x7f62ac06f160 2023-12-19T05:42:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.660+0000 7f62aaffd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 0x7f629806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.661+0000 7f62aaffd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 0x7f629806c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f629c036000 tx=0x7f629c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.663+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62a0054960 con 0x7f62ac06f160 2023-12-19T05:42:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:09.857+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f62ac0b0140 con 0x7f62ac06f160 2023-12-19T05:42:10.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.392+0000 7f62937fe640 1 -- 172.21.15.49:0/94748761 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) v1 ==== 170+0+0 (secure 0 0 0) 0x7f62a0057f80 con 0x7f62ac06f160 2023-12-19T05:42:10.394 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:42:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.397+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 msgr2=0x7f629806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.397+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 0x7f629806c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f629c036000 tx=0x7f629c03d040 comp rx=0 tx=0).stop 2023-12-19T05:42:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.397+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 msgr2=0x7f62ac157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.397+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f62a000c430 tx=0x7f62a000c8f0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 shutdown_connections 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f629806a430 0x7f629806c8f0 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f629c036000 tx=0x7f629c03d040 comp rx=0 tx=0).stop 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac158df0 0x7f62ac158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62ac06f160 0x7f62ac157cd0 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f62a000c430 tx=0x7f62a000c8f0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 --2- 172.21.15.49:0/94748761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac06d850 0x7f62ac13dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.399+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 >> 172.21.15.49:0/94748761 conn(0x7f62ac0cf0b0 msgr2=0x7f62ac0ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.407+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 shutdown_connections 2023-12-19T05:42:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.408+0000 7f62b12bd640 1 -- 172.21.15.49:0/94748761 wait complete. 2023-12-19T05:42:10.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:42:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.652+0000 7f8867d88640 1 Processor -- start 2023-12-19T05:42:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.652+0000 7f8867d88640 1 -- start start 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.653+0000 7f8867d88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8860146ff0 0x7f88600d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8867d88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886006f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8867d88640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 0x7f886015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8867d88640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8860161080 con 0x7f8860146ff0 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8867d88640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886006fef0 con 0x7f886006fa70 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8867d88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8860161e70 con 0x7f88600b6430 2023-12-19T05:42:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865b24640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8860146ff0 0x7f88600d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865b24640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8860146ff0 0x7f88600d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50736/0 (socket says 172.21.15.49:50736) 2023-12-19T05:42:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865b24640 1 -- 172.21.15.49:0/1801699511 learned_addr learned my addr 172.21.15.49:0/1801699511 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865323640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8866325640 1 --2- 172.21.15.49:0/1801699511 >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 0x7f886015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865b24640 1 -- 172.21.15.49:0/1801699511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 msgr2=0x7f886006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.654+0000 7f8865b24640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886006f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.655+0000 7f8865b24640 1 -- 172.21.15.49:0/1801699511 >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 msgr2=0x7f886015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.655+0000 7f8865b24640 1 --2- 172.21.15.49:0/1801699511 >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 0x7f886015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.655+0000 7f8865b24640 1 -- 172.21.15.49:0/1801699511 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860161260 con 0x7f8860146ff0 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.655+0000 7f8866325640 1 --2- 172.21.15.49:0/1801699511 >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 0x7f886015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.655+0000 7f8865323640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886006f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.656+0000 7f8865b24640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8860146ff0 0x7f88600d10f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f88600709b0 tx=0x7f885c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ef9d96bee82bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.656+0000 7f8864b22640 1 -- 172.21.15.49:0/1801699511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c02ca80 con 0x7f8860146ff0 2023-12-19T05:42:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.656+0000 7f8864b22640 1 -- 172.21.15.49:0/1801699511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c02cbe0 con 0x7f8860146ff0 2023-12-19T05:42:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.656+0000 7f8864b22640 1 -- 172.21.15.49:0/1801699511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0343f0 con 0x7f8860146ff0 2023-12-19T05:42:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 -- 172.21.15.49:0/1801699511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8860146ff0 msgr2=0x7f88600d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8860146ff0 0x7f88600d10f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f88600709b0 tx=0x7f885c02bee0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 -- 172.21.15.49:0/1801699511 shutdown_connections 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 --2- 172.21.15.49:0/1801699511 >> v2:172.21.15.115:3300/0 conn(0x7f886006fa70 0x7f886015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886006f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 --2- 172.21.15.49:0/1801699511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8860146ff0 0x7f88600d10f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 -- 172.21.15.49:0/1801699511 >> 172.21.15.49:0/1801699511 conn(0x7f88600d3520 msgr2=0x7f88600d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 -- 172.21.15.49:0/1801699511 shutdown_connections 2023-12-19T05:42:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.657+0000 7f8867d88640 1 -- 172.21.15.49:0/1801699511 wait complete. 2023-12-19T05:42:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.659+0000 7f8867d88640 1 Processor -- start 2023-12-19T05:42:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.659+0000 7f8867d88640 1 -- start start 2023-12-19T05:42:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8860146ff0 0x7f886015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600cec60 con 0x7f886006fa70 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600ceee0 con 0x7f8860146ff0 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8867d88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600cf1c0 con 0x7f88600b6430 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8865b24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8865b24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50742/0 (socket says 172.21.15.49:50742) 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.660+0000 7f8865b24640 1 -- 172.21.15.49:0/4143170924 learned_addr learned my addr 172.21.15.49:0/4143170924 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865323640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8866325640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8860146ff0 0x7f886015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 -- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 msgr2=0x7f886015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 -- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8860146ff0 msgr2=0x7f886015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8860146ff0 0x7f886015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 -- 172.21.15.49:0/4143170924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009b30 con 0x7f886006fa70 2023-12-19T05:42:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.661+0000 7f8865b24640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f885c000f80 tx=0x7f885c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.662+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c03e450 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.662+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c03e5f0 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.662+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c03e9a0 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.662+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600cf4a0 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.662+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88600cfa60 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.663+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886015f380 con 0x7f886006fa70 2023-12-19T05:42:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.664+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f885c02cd50 con 0x7f886006fa70 2023-12-19T05:42:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.665+0000 7f88567fc640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.665+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f885c0ab4d0 con 0x7f886006fa70 2023-12-19T05:42:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.666+0000 7f8865323640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.667+0000 7f8865323640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8860144210 tx=0x7f8850008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:10.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.670+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f885c076b10 con 0x7f886006fa70 2023-12-19T05:42:10.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.903+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8860061910 con 0x7f886006fa70 2023-12-19T05:42:10.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.917+0000 7f88567fc640 1 -- 172.21.15.49:0/4143170924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f885c07a130 con 0x7f886006fa70 2023-12-19T05:42:10.921 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 8 and data pool 9 2023-12-19T05:42:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.921+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 msgr2=0x7f884406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.921+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8860144210 tx=0x7f8850008040 comp rx=0 tx=0).stop 2023-12-19T05:42:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.922+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 msgr2=0x7f88601434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.922+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f885c000f80 tx=0x7f885c004a40 comp rx=0 tx=0).stop 2023-12-19T05:42:10.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 shutdown_connections 2023-12-19T05:42:10.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88600b6430 0x7f886015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8860146ff0 0x7f886015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 --2- 172.21.15.49:0/4143170924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886006fa70 0x7f88601434e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:10.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.924+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 >> 172.21.15.49:0/4143170924 conn(0x7f88600d3520 msgr2=0x7f88600b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:10.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.925+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 shutdown_connections 2023-12-19T05:42:10.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:10.926+0000 7f8867d88640 1 -- 172.21.15.49:0/4143170924 wait complete. 2023-12-19T05:42:10.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:42:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.147+0000 7f69c359e640 1 Processor -- start 2023-12-19T05:42:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.147+0000 7f69c359e640 1 -- start start 2023-12-19T05:42:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69c415e5a0 0x7f69c40b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69c415f680 0x7f69c40b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c415ec30 con 0x7f69c40cdbf0 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40b2cc0 con 0x7f69c415e5a0 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c415e980 con 0x7f69c415f680 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69c415e5a0 0x7f69c40b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69c415e5a0 0x7f69c40b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50746/0 (socket says 172.21.15.49:50746) 2023-12-19T05:42:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.149+0000 7f69c259c640 1 -- 172.21.15.49:0/2688600183 learned_addr learned my addr 172.21.15.49:0/2688600183 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.150+0000 7f69bbfff640 1 --2- 172.21.15.49:0/2688600183 >> v2:172.21.15.115:3300/0 conn(0x7f69c415f680 0x7f69c40b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.150+0000 7f69c259c640 1 -- 172.21.15.49:0/2688600183 >> v2:172.21.15.115:3300/0 conn(0x7f69c415f680 msgr2=0x7f69c40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.150+0000 7f69c259c640 1 --2- 172.21.15.49:0/2688600183 >> v2:172.21.15.115:3300/0 conn(0x7f69c415f680 0x7f69c40b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.150+0000 7f69c259c640 1 -- 172.21.15.49:0/2688600183 >> v1:172.21.15.115:6789/0 conn(0x7f69c40cdbf0 legacy=0x7f69c406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.150+0000 7f69c259c640 1 -- 172.21.15.49:0/2688600183 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40b2f90 con 0x7f69c415e5a0 2023-12-19T05:42:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.151+0000 7f69c259c640 1 --2- 172.21.15.49:0/2688600183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415e5a0 0x7f69c40b2030 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8365598edbcec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.151+0000 7f69c1d9b640 1 -- 172.21.15.49:0/2688600183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031870 con 0x7f69c415e5a0 2023-12-19T05:42:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c1d9b640 1 -- 172.21.15.49:0/2688600183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40319d0 con 0x7f69c415e5a0 2023-12-19T05:42:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c1d9b640 1 -- 172.21.15.49:0/2688600183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031d60 con 0x7f69c415e5a0 2023-12-19T05:42:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 -- 172.21.15.49:0/2688600183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415e5a0 msgr2=0x7f69c40b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 --2- 172.21.15.49:0/2688600183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415e5a0 0x7f69c40b2030 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b402b910 comp rx=0 tx=0).stop 2023-12-19T05:42:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 -- 172.21.15.49:0/2688600183 shutdown_connections 2023-12-19T05:42:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 --2- 172.21.15.49:0/2688600183 >> v2:172.21.15.115:3300/0 conn(0x7f69c415f680 0x7f69c40b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 --2- 172.21.15.49:0/2688600183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415e5a0 0x7f69c40b2030 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 -- 172.21.15.49:0/2688600183 >> 172.21.15.49:0/2688600183 conn(0x7f69c40b0100 msgr2=0x7f69c40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 -- 172.21.15.49:0/2688600183 shutdown_connections 2023-12-19T05:42:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.152+0000 7f69c359e640 1 -- 172.21.15.49:0/2688600183 wait complete. 2023-12-19T05:42:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.154+0000 7f69c359e640 1 Processor -- start 2023-12-19T05:42:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.154+0000 7f69c359e640 1 -- start start 2023-12-19T05:42:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69c40cdbf0 0x7f69c4150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69c415e5a0 0x7f69c4157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4154620 con 0x7f69c415f680 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4154900 con 0x7f69c415e5a0 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.155+0000 7f69c359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4155210 con 0x7f69c40cdbf0 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50758/0 (socket says 172.21.15.49:50758) 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 -- 172.21.15.49:0/4189452383 learned_addr learned my addr 172.21.15.49:0/4189452383 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c259c640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69c40cdbf0 0x7f69c4150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 -- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69c40cdbf0 msgr2=0x7f69c4150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69c40cdbf0 0x7f69c4150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 -- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69c415e5a0 msgr2=0x7f69c4157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69c415e5a0 0x7f69c4157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 -- 172.21.15.49:0/4189452383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40094d0 con 0x7f69c415f680 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.156+0000 7f69c2d9d640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c780 tx=0x7f69bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.157+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc004b60 con 0x7f69c415f680 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.157+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc00ce90 con 0x7f69c415f680 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.157+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00a850 con 0x7f69c415f680 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.157+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c41554f0 con 0x7f69c415f680 2023-12-19T05:42:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.157+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c4151110 con 0x7f69c415f680 2023-12-19T05:42:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.158+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4155a10 con 0x7f69c415f680 2023-12-19T05:42:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.159+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69bc00a9b0 con 0x7f69c415f680 2023-12-19T05:42:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.160+0000 7f69baffd640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 0x7f69a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.160+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69bc088bb0 con 0x7f69c415f680 2023-12-19T05:42:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.161+0000 7f69c259c640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 0x7f69a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.162+0000 7f69c259c640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 0x7f69a406c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69b4036000 tx=0x7f69b403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.164+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f69bc054100 con 0x7f69c415f680 2023-12-19T05:42:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.361+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69c4061910 con 0x7f69c415f680 2023-12-19T05:42:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.364+0000 7f69baffd640 1 -- 172.21.15.49:0/4189452383 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16110 (secure 0 0 0) 0x7f69bc057720 con 0x7f69c415f680 2023-12-19T05:42:11.366 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:11.366 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:10.905141+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 msgr2=0x7f69a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 0x7f69a406c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69b4036000 tx=0x7f69b403c040 comp rx=0 tx=0).stop 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 msgr2=0x7f69c4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c780 tx=0x7f69bc00cc40 comp rx=0 tx=0).stop 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 shutdown_connections 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f69a406a430 0x7f69a406c8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.366+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69c415f680 0x7f69c4157a70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.367+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69c415e5a0 0x7f69c4157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.367+0000 7f69c359e640 1 --2- 172.21.15.49:0/4189452383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69c40cdbf0 0x7f69c4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.367+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 >> 172.21.15.49:0/4189452383 conn(0x7f69c40b0100 msgr2=0x7f69c406f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.367+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 shutdown_connections 2023-12-19T05:42:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.367+0000 7f69c359e640 1 -- 172.21.15.49:0/4189452383 wait complete. 2023-12-19T05:42:11.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:42:11.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.610+0000 7efde8f67640 1 Processor -- start 2023-12-19T05:42:11.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.611+0000 7efde8f67640 1 -- start start 2023-12-19T05:42:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.612+0000 7efde8f67640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 0x7efde40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde8f67640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efde40d0c60 0x7efde415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde8f67640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40d1070 con 0x7efde40b7ea0 2023-12-19T05:42:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde8f67640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde4147210 con 0x7efde40d0c60 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde8f67640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40b8330 con 0x7efde4146e30 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efde40d0c60 0x7efde415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efddaffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efde40b7ea0 0x7efde40d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45240/0 (socket says 172.21.15.49:45240) 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efddaffd640 1 -- 172.21.15.49:0/3039684082 learned_addr learned my addr 172.21.15.49:0/3039684082 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.613+0000 7efde37fe640 1 --2- 172.21.15.49:0/3039684082 >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 0x7efde40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.614+0000 7efde3fff640 1 -- 172.21.15.49:0/3039684082 >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 msgr2=0x7efde40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.614+0000 7efde3fff640 1 --2- 172.21.15.49:0/3039684082 >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 0x7efde40b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.614+0000 7efde3fff640 1 -- 172.21.15.49:0/3039684082 >> v1:172.21.15.49:6789/0 conn(0x7efde40b7ea0 legacy=0x7efde40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.614+0000 7efde3fff640 1 -- 172.21.15.49:0/3039684082 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40d12d0 con 0x7efde40d0c60 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.614+0000 7efde37fe640 1 --2- 172.21.15.49:0/3039684082 >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 0x7efde40b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.615+0000 7efde3fff640 1 --2- 172.21.15.49:0/3039684082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde40d0c60 0x7efde415d870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efde40b85a0 tx=0x7efddc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7bc6ca0884a87c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.615+0000 7efde2ffd640 1 -- 172.21.15.49:0/3039684082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc02e070 con 0x7efde40d0c60 2023-12-19T05:42:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.615+0000 7efde2ffd640 1 -- 172.21.15.49:0/3039684082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc0315a0 con 0x7efde40d0c60 2023-12-19T05:42:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.615+0000 7efde2ffd640 1 -- 172.21.15.49:0/3039684082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc031930 con 0x7efde40d0c60 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 -- 172.21.15.49:0/3039684082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde40d0c60 msgr2=0x7efde415d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 --2- 172.21.15.49:0/3039684082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde40d0c60 0x7efde415d870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efde40b85a0 tx=0x7efddc02b840 comp rx=0 tx=0).stop 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 -- 172.21.15.49:0/3039684082 shutdown_connections 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 --2- 172.21.15.49:0/3039684082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde40d0c60 0x7efde415d870 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 --2- 172.21.15.49:0/3039684082 >> v2:172.21.15.115:3300/0 conn(0x7efde4146e30 0x7efde40b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.616+0000 7efde8f67640 1 -- 172.21.15.49:0/3039684082 >> 172.21.15.49:0/3039684082 conn(0x7efde40b2990 msgr2=0x7efde40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.617+0000 7efde8f67640 1 -- 172.21.15.49:0/3039684082 shutdown_connections 2023-12-19T05:42:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.617+0000 7efde8f67640 1 -- 172.21.15.49:0/3039684082 wait complete. 2023-12-19T05:42:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.619+0000 7efde8f67640 1 Processor -- start 2023-12-19T05:42:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.619+0000 7efde8f67640 1 -- start start 2023-12-19T05:42:11.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 0x7efde41d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 0x7efde413ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde413d710 con 0x7efde4146e30 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde413d9f0 con 0x7efde40b7ea0 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde8f67640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde413dcd0 con 0x7efde40d0c60 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50776/0 (socket says 172.21.15.49:50776) 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.620+0000 7efde3fff640 1 -- 172.21.15.49:0/2388959684 learned_addr learned my addr 172.21.15.49:0/2388959684 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efddaffd640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 0x7efde413ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 -- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 msgr2=0x7efde413ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde37fe640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 0x7efde41d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 0x7efde413ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 -- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 msgr2=0x7efde41d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 0x7efde41d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 -- 172.21.15.49:0/2388959684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc009400 con 0x7efde4146e30 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde37fe640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 0x7efde41d21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efddaffd640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 0x7efde413ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde3fff640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efddc009890 tx=0x7efddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc032840 con 0x7efde4146e30 2023-12-19T05:42:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc0329a0 con 0x7efde4146e30 2023-12-19T05:42:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.621+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc032d30 con 0x7efde4146e30 2023-12-19T05:42:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.622+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde413dfb0 con 0x7efde4146e30 2023-12-19T05:42:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.622+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde41d2700 con 0x7efde4146e30 2023-12-19T05:42:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.623+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde413e4d0 con 0x7efde4146e30 2023-12-19T05:42:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.624+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efddc04e430 con 0x7efde4146e30 2023-12-19T05:42:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.626+0000 7efde0ff9640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.626+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efddc0aaa30 con 0x7efde4146e30 2023-12-19T05:42:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.626+0000 7efde37fe640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:11.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.628+0000 7efde37fe640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 0x7efdc406c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006fd0 tx=0x7efdd4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.630+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efddc075f80 con 0x7efde4146e30 2023-12-19T05:42:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.823+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde4061910 con 0x7efde4146e30 2023-12-19T05:42:11.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.824+0000 7efde0ff9640 1 -- 172.21.15.49:0/2388959684 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16110 (secure 0 0 0) 0x7efddc0795a0 con 0x7efde4146e30 2023-12-19T05:42:11.826 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:11.826 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:10.905141+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 msgr2=0x7efdc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 0x7efdc406c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006fd0 tx=0x7efdd4008040 comp rx=0 tx=0).stop 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 msgr2=0x7efde41e82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efddc009890 tx=0x7efddc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 shutdown_connections 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efde40d0c60 0x7efde413ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efde4146e30 0x7efde41e82b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 --2- 172.21.15.49:0/2388959684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde40b7ea0 0x7efde41d21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:11.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.827+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 >> 172.21.15.49:0/2388959684 conn(0x7efde40b2990 msgr2=0x7efde4145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:11.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.828+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 shutdown_connections 2023-12-19T05:42:11.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:11.828+0000 7efde8f67640 1 -- 172.21.15.49:0/2388959684 wait complete. 2023-12-19T05:42:11.848 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:42:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.078+0000 7fb1e0631640 1 Processor -- start 2023-12-19T05:42:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.078+0000 7fb1e0631640 1 -- start start 2023-12-19T05:42:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1e0631640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1d81449e0 0x7fb1d80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1e0631640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1d806c6b0 0x7fb1d80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1e0631640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80afb10 con 0x7fb1d80b0b50 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1e0631640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d806bb30 con 0x7fb1d806c6b0 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1e0631640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b0070 con 0x7fb1d81449e0 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1debce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1d806c6b0 0x7fb1d80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1debce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1d806c6b0 0x7fb1d80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50778/0 (socket says 172.21.15.49:50778) 2023-12-19T05:42:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.080+0000 7fb1debce640 1 -- 172.21.15.49:0/3347394851 learned_addr learned my addr 172.21.15.49:0/3347394851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.081+0000 7fb1de3cd640 1 --2- 172.21.15.49:0/3347394851 >> v2:172.21.15.115:3300/0 conn(0x7fb1d81449e0 0x7fb1d80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.081+0000 7fb1debce640 1 -- 172.21.15.49:0/3347394851 >> v2:172.21.15.115:3300/0 conn(0x7fb1d81449e0 msgr2=0x7fb1d80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.081+0000 7fb1debce640 1 --2- 172.21.15.49:0/3347394851 >> v2:172.21.15.115:3300/0 conn(0x7fb1d81449e0 0x7fb1d80af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.081+0000 7fb1debce640 1 -- 172.21.15.49:0/3347394851 >> v1:172.21.15.115:6789/0 conn(0x7fb1d80b0b50 legacy=0x7fb1d806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.081+0000 7fb1debce640 1 -- 172.21.15.49:0/3347394851 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80b0350 con 0x7fb1d806c6b0 2023-12-19T05:42:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.082+0000 7fb1debce640 1 --2- 172.21.15.49:0/3347394851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d806c6b0 0x7fb1d80b1710 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8071cd0 tx=0x7fb1d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2379c415908a5667 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:12.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.083+0000 7fb1dd3cb640 1 -- 172.21.15.49:0/3347394851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d002ca80 con 0x7fb1d806c6b0 2023-12-19T05:42:12.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.083+0000 7fb1dd3cb640 1 -- 172.21.15.49:0/3347394851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d002cbe0 con 0x7fb1d806c6b0 2023-12-19T05:42:12.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.083+0000 7fb1dd3cb640 1 -- 172.21.15.49:0/3347394851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00343f0 con 0x7fb1d806c6b0 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.083+0000 7fb1e0631640 1 -- 172.21.15.49:0/3347394851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d806c6b0 msgr2=0x7fb1d80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.083+0000 7fb1e0631640 1 --2- 172.21.15.49:0/3347394851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d806c6b0 0x7fb1d80b1710 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8071cd0 tx=0x7fb1d002bee0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 -- 172.21.15.49:0/3347394851 shutdown_connections 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 --2- 172.21.15.49:0/3347394851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d806c6b0 0x7fb1d80b1710 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 --2- 172.21.15.49:0/3347394851 >> v2:172.21.15.115:3300/0 conn(0x7fb1d81449e0 0x7fb1d80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 -- 172.21.15.49:0/3347394851 >> 172.21.15.49:0/3347394851 conn(0x7fb1d80cbb70 msgr2=0x7fb1d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 -- 172.21.15.49:0/3347394851 shutdown_connections 2023-12-19T05:42:12.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.084+0000 7fb1e0631640 1 -- 172.21.15.49:0/3347394851 wait complete. 2023-12-19T05:42:12.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.086+0000 7fb1e0631640 1 Processor -- start 2023-12-19T05:42:12.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.086+0000 7fb1e0631640 1 -- start start 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d806c6b0 0x7fb1d815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 0x7fb1d806f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815ca90 con 0x7fb1d81449e0 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815be80 con 0x7fb1d806c6b0 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1e0631640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815c160 con 0x7fb1d80b0b50 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1debce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1debce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50794/0 (socket says 172.21.15.49:50794) 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1debce640 1 -- 172.21.15.49:0/843187126 learned_addr learned my addr 172.21.15.49:0/843187126 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.087+0000 7fb1de3cd640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d806c6b0 0x7fb1d815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1ddbcc640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 0x7fb1d806f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 -- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 msgr2=0x7fb1d806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:12.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 0x7fb1d806f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 -- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d806c6b0 msgr2=0x7fb1d815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:12.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d806c6b0 0x7fb1d815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 -- 172.21.15.49:0/843187126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0009b30 con 0x7fb1d81449e0 2023-12-19T05:42:12.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1ddbcc640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 0x7fb1d806f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1debce640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036040 tx=0x7fb1d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d003e450 con 0x7fb1d81449e0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d003e5d0 con 0x7fb1d81449e0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.088+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d815c440 con 0x7fb1d81449e0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.089+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d003e980 con 0x7fb1d81449e0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.089+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d81558c0 con 0x7fb1d81449e0 2023-12-19T05:42:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.090+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d813ea50 con 0x7fb1d81449e0 2023-12-19T05:42:12.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.091+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb1d002cd50 con 0x7fb1d81449e0 2023-12-19T05:42:12.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.092+0000 7fb1ceffd640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 0x7fb1bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:12.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.092+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d00ab500 con 0x7fb1d81449e0 2023-12-19T05:42:12.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.093+0000 7fb1de3cd640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 0x7fb1bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.094+0000 7fb1de3cd640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 0x7fb1bc06c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4006fd0 tx=0x7fb1d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:12.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.096+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1d813ea50 con 0x7fb1d81449e0 2023-12-19T05:42:12.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.328+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb1d813ea50 con 0x7fb1d81449e0 2023-12-19T05:42:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.935+0000 7fb1ceffd640 1 -- 172.21.15.49:0/843187126 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1d813ea50 con 0x7fb1d81449e0 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 msgr2=0x7fb1bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 0x7fb1bc06c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4006fd0 tx=0x7fb1d4008040 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 msgr2=0x7fb1d806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036040 tx=0x7fb1d0004a40 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 shutdown_connections 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb1bc06a430 0x7fb1bc06c8f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1d80b0b50 0x7fb1d806f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d81449e0 0x7fb1d806fef0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 --2- 172.21.15.49:0/843187126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d806c6b0 0x7fb1d815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 >> 172.21.15.49:0/843187126 conn(0x7fb1d80cbb70 msgr2=0x7fb1d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 shutdown_connections 2023-12-19T05:42:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:12.939+0000 7fb1e0631640 1 -- 172.21.15.49:0/843187126 wait complete. 2023-12-19T05:42:12.961 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:42:12.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:42:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.194+0000 7f4273fff640 1 Processor -- start 2023-12-19T05:42:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.194+0000 7f4273fff640 1 -- start start 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.195+0000 7f4273fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4274155460 0x7f42740b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.195+0000 7f4273fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42740b0830 0x7f427406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.195+0000 7f4273fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427406ca80 0x7f42740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.195+0000 7f4273fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740b0ce0 con 0x7f4274155460 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4273fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427415c9c0 con 0x7f42740b0830 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4273fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427406d270 con 0x7f427406ca80 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4272ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4274155460 0x7f42740b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4272ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4274155460 0x7f42740b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50800/0 (socket says 172.21.15.49:50800) 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4272ffd640 1 -- 172.21.15.49:0/148345374 learned_addr learned my addr 172.21.15.49:0/148345374 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f42727fc640 1 --2- 172.21.15.49:0/148345374 >> v2:172.21.15.115:3300/0 conn(0x7f42740b0830 0x7f427406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f42737fe640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427406ca80 0x7f42740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4272ffd640 1 -- 172.21.15.49:0/148345374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427406ca80 msgr2=0x7f42740cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.196+0000 7f4272ffd640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427406ca80 0x7f42740cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.197+0000 7f4272ffd640 1 -- 172.21.15.49:0/148345374 >> v2:172.21.15.115:3300/0 conn(0x7f42740b0830 msgr2=0x7f427406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.197+0000 7f4272ffd640 1 --2- 172.21.15.49:0/148345374 >> v2:172.21.15.115:3300/0 conn(0x7f42740b0830 0x7f427406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.197+0000 7f4272ffd640 1 -- 172.21.15.49:0/148345374 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427406d550 con 0x7f4274155460 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.198+0000 7f4272ffd640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42740b02f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f42740afea0 tx=0x7f426402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd9cb37a7f5dc4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.198+0000 7f4271ffb640 1 -- 172.21.15.49:0/148345374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426402ca70 con 0x7f4274155460 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.198+0000 7f4271ffb640 1 -- 172.21.15.49:0/148345374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426402cbd0 con 0x7f4274155460 2023-12-19T05:42:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.198+0000 7f4271ffb640 1 -- 172.21.15.49:0/148345374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640343f0 con 0x7f4274155460 2023-12-19T05:42:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 -- 172.21.15.49:0/148345374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 msgr2=0x7f42740b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42740b02f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f42740afea0 tx=0x7f426402bed0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 -- 172.21.15.49:0/148345374 shutdown_connections 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427406ca80 0x7f42740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 --2- 172.21.15.49:0/148345374 >> v2:172.21.15.115:3300/0 conn(0x7f42740b0830 0x7f427406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 --2- 172.21.15.49:0/148345374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42740b02f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 -- 172.21.15.49:0/148345374 >> 172.21.15.49:0/148345374 conn(0x7f42740659a0 msgr2=0x7f4274065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 -- 172.21.15.49:0/148345374 shutdown_connections 2023-12-19T05:42:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.199+0000 7f4273fff640 1 -- 172.21.15.49:0/148345374 wait complete. 2023-12-19T05:42:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.201+0000 7f4273fff640 1 Processor -- start 2023-12-19T05:42:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.201+0000 7f4273fff640 1 -- start start 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427406ca80 0x7f427415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 0x7f427414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42741558b0 con 0x7f4274155460 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274155b00 con 0x7f427406ca80 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4273fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4274155de0 con 0x7f42740b0830 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f42737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f42737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50804/0 (socket says 172.21.15.49:50804) 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f42737fe640 1 -- 172.21.15.49:0/3352993967 learned_addr learned my addr 172.21.15.49:0/3352993967 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f42727fc640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 0x7f427414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.202+0000 7f4272ffd640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427406ca80 0x7f427415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 -- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 msgr2=0x7f427414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 0x7f427414e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 -- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427406ca80 msgr2=0x7f427415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427406ca80 0x7f427415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 -- 172.21.15.49:0/3352993967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009b30 con 0x7f4274155460 2023-12-19T05:42:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42727fc640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 0x7f427414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f42737fe640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d5d0 tx=0x7f426c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0125f0 con 0x7f4274155460 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c012770 con 0x7f4274155460 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c012b20 con 0x7f4274155460 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.203+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42741560c0 con 0x7f4274155460 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.204+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427415edc0 con 0x7f4274155460 2023-12-19T05:42:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.205+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42741565e0 con 0x7f4274155460 2023-12-19T05:42:13.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.206+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f426c012c80 con 0x7f4274155460 2023-12-19T05:42:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.207+0000 7f426b7fe640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 0x7f425406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.207+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f426c088df0 con 0x7f4274155460 2023-12-19T05:42:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.207+0000 7f4272ffd640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 0x7f425406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:13.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.209+0000 7f4272ffd640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 0x7f425406c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4264035000 tx=0x7f4264030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:13.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.211+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42741565e0 con 0x7f4274155460 2023-12-19T05:42:13.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:13.445+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42741565e0 con 0x7f4274155460 2023-12-19T05:42:14.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.409+0000 7f426b7fe640 1 -- 172.21.15.49:0/3352993967 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42741565e0 con 0x7f4274155460 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 msgr2=0x7f425406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 0x7f425406c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4264035000 tx=0x7f4264030000 comp rx=0 tx=0).stop 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 msgr2=0x7f42741504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d5d0 tx=0x7f426c00da90 comp rx=0 tx=0).stop 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 shutdown_connections 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f425406a430 0x7f425406c8f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42740b0830 0x7f427414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4274155460 0x7f42741504a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 --2- 172.21.15.49:0/3352993967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427406ca80 0x7f427415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 >> 172.21.15.49:0/3352993967 conn(0x7f42740659a0 msgr2=0x7f42740adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:14.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 shutdown_connections 2023-12-19T05:42:14.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.413+0000 7f4273fff640 1 -- 172.21.15.49:0/3352993967 wait complete. 2023-12-19T05:42:14.436 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:42:14.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:42:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.668+0000 7f7379b3c640 1 Processor -- start 2023-12-19T05:42:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.668+0000 7f7379b3c640 1 -- start start 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.670+0000 7f7379b3c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7374146e10 0x7f73740d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.670+0000 7f7379b3c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 0x7f73740b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.670+0000 7f7379b3c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740cd840 con 0x7f73740ce110 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.670+0000 7f7379b3c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73740d2430 con 0x7f7374146e10 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.670+0000 7f7379b3c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73740d2620 con 0x7f73740d2b00 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f7373fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f73740ce110 0x7f73740b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49394/0 (socket says 172.21.15.49:49394) 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f7373fff640 1 -- 172.21.15.49:0/2346750588 learned_addr learned my addr 172.21.15.49:0/2346750588 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73737fe640 1 --2- 172.21.15.49:0/2346750588 >> v2:172.21.15.49:3300/0 conn(0x7f7374146e10 0x7f73740d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f7372ffd640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 0x7f73740b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73737fe640 1 -- 172.21.15.49:0/2346750588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 msgr2=0x7f73740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73737fe640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 0x7f73740b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73737fe640 1 -- 172.21.15.49:0/2346750588 >> v1:172.21.15.49:6789/0 conn(0x7f73740ce110 legacy=0x7f73740b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73737fe640 1 -- 172.21.15.49:0/2346750588 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740b41c0 con 0x7f7374146e10 2023-12-19T05:42:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f73727fc640 1 -- 172.21.15.49:0/2346750588 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269958848 0 0) 0x7f73740cd840 con 0x7f73740ce110 2023-12-19T05:42:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.671+0000 7f7372ffd640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 0x7f73740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f73737fe640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7374146e10 0x7f73740d1ef0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f73640097a0 tx=0x7f736402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad4dba0adee507f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f73727fc640 1 -- 172.21.15.49:0/2346750588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736402d040 con 0x7f7374146e10 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f73727fc640 1 -- 172.21.15.49:0/2346750588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364031810 con 0x7f7374146e10 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f73727fc640 1 -- 172.21.15.49:0/2346750588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364031ba0 con 0x7f7374146e10 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 -- 172.21.15.49:0/2346750588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7374146e10 msgr2=0x7f73740d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7374146e10 0x7f73740d1ef0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f73640097a0 tx=0x7f736402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 -- 172.21.15.49:0/2346750588 shutdown_connections 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740d2b00 0x7f73740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 --2- 172.21.15.49:0/2346750588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7374146e10 0x7f73740d1ef0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.673+0000 7f7379b3c640 1 -- 172.21.15.49:0/2346750588 >> 172.21.15.49:0/2346750588 conn(0x7f73740b29c0 msgr2=0x7f73740b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.674+0000 7f7379b3c640 1 -- 172.21.15.49:0/2346750588 shutdown_connections 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.674+0000 7f7379b3c640 1 -- 172.21.15.49:0/2346750588 wait complete. 2023-12-19T05:42:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.675+0000 7f7379b3c640 1 Processor -- start 2023-12-19T05:42:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.676+0000 7f7379b3c640 1 -- start start 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740ce110 0x7f737413d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 0x7f7374157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374146710 con 0x7f73740d2b00 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741565b0 con 0x7f7374146e10 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7379b3c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73741584a0 con 0x7f73740ce110 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48298/0 (socket says 172.21.15.49:48298) 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 -- 172.21.15.49:0/3390123280 learned_addr learned my addr 172.21.15.49:0/3390123280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f73737fe640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740ce110 0x7f737413d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7373fff640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 0x7f7374157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 -- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740ce110 msgr2=0x7f737413d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740ce110 0x7f737413d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 -- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 msgr2=0x7f7374157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 0x7f7374157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.677+0000 7f7372ffd640 1 -- 172.21.15.49:0/3390123280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364009400 con 0x7f73740d2b00 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f7373fff640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 0x7f7374157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f7372ffd640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f736800c7f0 tx=0x7f736800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368007a30 con 0x7f73740d2b00 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368007b90 con 0x7f73740d2b00 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800ce40 con 0x7f73740d2b00 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7374158780 con 0x7f73740d2b00 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.678+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73741561d0 con 0x7f73740d2b00 2023-12-19T05:42:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.679+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374155d50 con 0x7f73740d2b00 2023-12-19T05:42:14.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.680+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73680113f0 con 0x7f73740d2b00 2023-12-19T05:42:14.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.681+0000 7f735bfff640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 0x7f736006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.682+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7368088a10 con 0x7f73740d2b00 2023-12-19T05:42:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.682+0000 7f73737fe640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 0x7f736006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.683+0000 7f73737fe640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 0x7f736006c940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7364036000 tx=0x7f736403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.686+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7374155d50 con 0x7f73740d2b00 2023-12-19T05:42:14.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.922+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73741566f0 con 0x7f73740d2b00 2023-12-19T05:42:14.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.923+0000 7f735bfff640 1 -- 172.21.15.49:0/3390123280 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f73741566f0 con 0x7f73740d2b00 2023-12-19T05:42:14.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:14.925 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:42:14.925 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:42:14.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 msgr2=0x7f736006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 0x7f736006c940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7364036000 tx=0x7f736403c040 comp rx=0 tx=0).stop 2023-12-19T05:42:14.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 msgr2=0x7f737413c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:14.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f736800c7f0 tx=0x7f736800cbf0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 shutdown_connections 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f736006a480 0x7f736006c940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7374146e10 0x7f7374157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73740d2b00 0x7f737413c9b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 --2- 172.21.15.49:0/3390123280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73740ce110 0x7f737413d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 >> 172.21.15.49:0/3390123280 conn(0x7f73740b29c0 msgr2=0x7f73740b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 shutdown_connections 2023-12-19T05:42:14.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:14.926+0000 7f7379b3c640 1 -- 172.21.15.49:0/3390123280 wait complete. 2023-12-19T05:42:14.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:42:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.180+0000 7fa46b4c4640 1 Processor -- start 2023-12-19T05:42:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.181+0000 7fa46b4c4640 1 -- start start 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.182+0000 7fa46b4c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa4641444b0 0x7fa464144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa46b4c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4640cf280 con 0x7fa464144f60 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa46b4c4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4640d21b0 con 0x7fa4640d1d20 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa46b4c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46415f9e0 con 0x7fa4641444b0 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa469a61640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa464144f60 0x7fa46406d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49404/0 (socket says 172.21.15.49:49404) 2023-12-19T05:42:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa469a61640 1 -- 172.21.15.49:0/2522499524 learned_addr learned my addr 172.21.15.49:0/2522499524 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa469260640 1 --2- 172.21.15.49:0/2522499524 >> v2:172.21.15.115:3300/0 conn(0x7fa4641444b0 0x7fa464144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.183+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548588560 0 0) 0x7fa4640cf280 con 0x7fa464144f60 2023-12-19T05:42:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa450003520 con 0x7fa464144f60 2023-12-19T05:42:15.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338170321 0 0) 0x7fa4640d21b0 con 0x7fa4640d1d20 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4640cf280 con 0x7fa4640d1d20 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203666972 0 0) 0x7fa450003520 con 0x7fa464144f60 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 >> v2:172.21.15.115:3300/0 conn(0x7fa4641444b0 msgr2=0x7fa464144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 --2- 172.21.15.49:0/2522499524 >> v2:172.21.15.115:3300/0 conn(0x7fa4641444b0 0x7fa464144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 >> v1:172.21.15.115:6789/0 conn(0x7fa4640d1d20 legacy=0x7fa4640cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46415fe70 con 0x7fa464144f60 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa45c0019f0 con 0x7fa464144f60 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 >> v1:172.21.15.49:6789/0 conn(0x7fa464144f60 legacy=0x7fa46406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa450003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4500047c0 0x7fa450004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa450005240 0x7fa45000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46415f9e0 con 0x7fa450003bc0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45000c150 con 0x7fa450005240 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45000c310 con 0x7fa4500047c0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.184+0000 7fa469260640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa450003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469a61640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa450005240 0x7fa45000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa468a5f640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4500047c0 0x7fa450004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469260640 1 -- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4500047c0 msgr2=0x7fa450004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469260640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4500047c0 0x7fa450004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469260640 1 -- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa450005240 msgr2=0x7fa45000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469260640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa450005240 0x7fa45000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469260640 1 -- 172.21.15.49:0/2522499524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450003520 con 0x7fa450003bc0 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa468a5f640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4500047c0 0x7fa450004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469a61640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa450005240 0x7fa45000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.185+0000 7fa469a61640 1 -- 172.21.15.49:0/2522499524 reap_dead start 2023-12-19T05:42:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.186+0000 7fa469260640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa450003fc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa460009ac0 tx=0x7fa4500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f575db40467bcc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.186+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46002c6b0 con 0x7fa450003bc0 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46002c810 con 0x7fa450003bc0 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa457fff640 1 -- 172.21.15.49:0/2522499524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46002cba0 con 0x7fa450003bc0 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 -- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 msgr2=0x7fa450003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa450003fc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa460009ac0 tx=0x7fa4500057f0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 -- 172.21.15.49:0/2522499524 shutdown_connections 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/2522499524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa450003fc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 -- 172.21.15.49:0/2522499524 >> 172.21.15.49:0/2522499524 conn(0x7fa46406a2e0 msgr2=0x7fa46406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 -- 172.21.15.49:0/2522499524 shutdown_connections 2023-12-19T05:42:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.187+0000 7fa46b4c4640 1 -- 172.21.15.49:0/2522499524 wait complete. 2023-12-19T05:42:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.189+0000 7fa46b4c4640 1 Processor -- start 2023-12-19T05:42:15.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.189+0000 7fa46b4c4640 1 -- start start 2023-12-19T05:42:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 0x7fa46415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 0x7fa46415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46413a8a0 con 0x7fa450003bc0 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46413f430 con 0x7fa46413efd0 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa46b4c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464141860 con 0x7fa46415aa00 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa469260640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa469260640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48324/0 (socket says 172.21.15.49:48324) 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.190+0000 7fa469260640 1 -- 172.21.15.49:0/552288580 learned_addr learned my addr 172.21.15.49:0/552288580 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa468a5f640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 0x7fa46415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 -- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 msgr2=0x7fa46415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469a61640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 0x7fa46415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 0x7fa46415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 -- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 msgr2=0x7fa46415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 0x7fa46415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 -- 172.21.15.49:0/552288580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464141b40 con 0x7fa450003bc0 2023-12-19T05:42:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa468a5f640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 0x7fa46415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469a61640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 0x7fa46415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.191+0000 7fa469260640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa46002c250 tx=0x7fa460004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.192+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460003810 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.192+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa460003970 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.192+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460003d00 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.192+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464141e20 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.192+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4641f21a0 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.193+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4641419a0 con 0x7fa450003bc0 2023-12-19T05:42:15.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.194+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa460047450 con 0x7fa450003bc0 2023-12-19T05:42:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.195+0000 7fa455ffb640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 0x7fa44806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.195+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4600aac20 con 0x7fa450003bc0 2023-12-19T05:42:15.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.196+0000 7fa468a5f640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 0x7fa44806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.197+0000 7fa468a5f640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 0x7fa44806c920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa46413a300 tx=0x7fa458009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.200+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4641419a0 con 0x7fa450003bc0 2023-12-19T05:42:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.395+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4641419a0 con 0x7fa450003bc0 2023-12-19T05:42:15.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.397+0000 7fa455ffb640 1 -- 172.21.15.49:0/552288580 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fa4641419a0 con 0x7fa450003bc0 2023-12-19T05:42:15.399 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:15.399 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":70,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:11.909531+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.399+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 msgr2=0x7fa44806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.399+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 0x7fa44806c920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa46413a300 tx=0x7fa458009040 comp rx=0 tx=0).stop 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.399+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 msgr2=0x7fa46413ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.399+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa46002c250 tx=0x7fa460004730 comp rx=0 tx=0).stop 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 shutdown_connections 2023-12-19T05:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa44806a460 0x7fa44806c920 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa46415aa00 0x7fa46415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46413efd0 0x7fa46415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 --2- 172.21.15.49:0/552288580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa450003bc0 0x7fa46413ea90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 >> 172.21.15.49:0/552288580 conn(0x7fa46406a2e0 msgr2=0x7fa4640cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 shutdown_connections 2023-12-19T05:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.400+0000 7fa46b4c4640 1 -- 172.21.15.49:0/552288580 wait complete. 2023-12-19T05:42:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:42:15.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:42:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.638+0000 7f6e917c4640 1 Processor -- start 2023-12-19T05:42:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.639+0000 7f6e917c4640 1 -- start start 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.640+0000 7f6e917c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e8c0d2b00 0x7f6e8c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.640+0000 7f6e917c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0cd840 con 0x7f6e8c0ce110 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.640+0000 7f6e917c4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0b6e90 con 0x7f6e8c146e10 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.640+0000 7f6e917c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0d2430 con 0x7f6e8c0d2b00 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.641+0000 7f6e8b7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6e8c0ce110 0x7f6e8c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49416/0 (socket says 172.21.15.49:49416) 2023-12-19T05:42:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.641+0000 7f6e8b7fe640 1 -- 172.21.15.49:0/1715917724 learned_addr learned my addr 172.21.15.49:0/1715917724 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.641+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/1715917724 >> v2:172.21.15.115:3300/0 conn(0x7f6e8c0d2b00 0x7f6e8c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.641+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807761229 0 0) 0x7f6e8c0cd840 con 0x7f6e8c0ce110 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.641+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e78003520 con 0x7f6e8c0ce110 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929757033 0 0) 0x7f6e78003520 con 0x7f6e8c0ce110 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 >> v2:172.21.15.115:3300/0 conn(0x7f6e8c0d2b00 msgr2=0x7f6e8c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 --2- 172.21.15.49:0/1715917724 >> v2:172.21.15.115:3300/0 conn(0x7f6e8c0d2b00 0x7f6e8c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 >> v1:172.21.15.115:6789/0 conn(0x7f6e8c146e10 legacy=0x7f6e8c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0d2620 con 0x7f6e8c0ce110 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f6e840019f0 con 0x7f6e8c0ce110 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 >> v1:172.21.15.49:6789/0 conn(0x7f6e8c0ce110 legacy=0x7f6e8c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780039e0 0x7f6e78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 0x7f6e78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e780051f0 0x7f6e7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800c120 con 0x7f6e780047c0 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800c290 con 0x7f6e780051f0 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800c450 con 0x7f6e780039e0 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.642+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 0x7f6e78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8b7fe640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e780051f0 0x7f6e7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780039e0 msgr2=0x7f6e78003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780039e0 0x7f6e78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e780051f0 msgr2=0x7f6e7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e780051f0 0x7f6e7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/1715917724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78003520 con 0x7f6e780047c0 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8b7fe640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e780051f0 0x7f6e7800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.643+0000 7f6e8b7fe640 1 -- 172.21.15.49:0/1715917724 reap_dead start 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.644+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 0x7f6e78004c40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009ac0 tx=0x7f6e780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4d0b77d9261739 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.644+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7402c6b0 con 0x7f6e780047c0 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.644+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7402c810 con 0x7f6e780047c0 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.644+0000 7f6e89ffb640 1 -- 172.21.15.49:0/1715917724 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7402cba0 con 0x7f6e780047c0 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 -- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 msgr2=0x7f6e78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 0x7f6e78004c40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009ac0 tx=0x7f6e780057f0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 -- 172.21.15.49:0/1715917724 shutdown_connections 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 --2- 172.21.15.49:0/1715917724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e780047c0 0x7f6e78004c40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 -- 172.21.15.49:0/1715917724 >> 172.21.15.49:0/1715917724 conn(0x7f6e8c0b29c0 msgr2=0x7f6e8c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 -- 172.21.15.49:0/1715917724 shutdown_connections 2023-12-19T05:42:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.645+0000 7f6e917c4640 1 -- 172.21.15.49:0/1715917724 wait complete. 2023-12-19T05:42:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.647+0000 7f6e917c4640 1 Processor -- start 2023-12-19T05:42:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.647+0000 7f6e917c4640 1 -- start start 2023-12-19T05:42:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780047c0 0x7f6e8c13ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 0x7f6e8c1f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0d3fd0 con 0x7f6e8c0d3610 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c9990 con 0x7f6e8c1f5d70 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e917c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c1f6ad0 con 0x7f6e780047c0 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e8a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e8a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48352/0 (socket says 172.21.15.49:48352) 2023-12-19T05:42:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.648+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/2988286980 learned_addr learned my addr 172.21.15.49:0/2988286980 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8affd640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780047c0 0x7f6e8c13ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8b7fe640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 0x7f6e8c1f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780047c0 msgr2=0x7f6e8c13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780047c0 0x7f6e8c13ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 msgr2=0x7f6e8c1f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 0x7f6e8c1f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 -- 172.21.15.49:0/2988286980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0c9060 con 0x7f6e8c0d3610 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8b7fe640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 0x7f6e8c1f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.649+0000 7f6e8a7fc640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6e74037040 tx=0x7f6e74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.650+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74003810 con 0x7f6e8c0d3610 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.650+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74003970 con 0x7f6e8c0d3610 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.650+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74003d20 con 0x7f6e8c0d3610 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.650+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0c9340 con 0x7f6e8c0d3610 2023-12-19T05:42:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.650+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c1f6730 con 0x7f6e8c0d3610 2023-12-19T05:42:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.651+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c061910 con 0x7f6e8c0d3610 2023-12-19T05:42:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.652+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e74034440 con 0x7f6e8c0d3610 2023-12-19T05:42:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.653+0000 7f6e837fe640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 0x7f6e6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.653+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e740aa8e0 con 0x7f6e8c0d3610 2023-12-19T05:42:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.654+0000 7f6e8affd640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 0x7f6e6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.655+0000 7f6e8affd640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 0x7f6e6c06c920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c007fd0 tx=0x7f6e7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.658+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e74075ee0 con 0x7f6e8c0d3610 2023-12-19T05:42:15.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.856+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e8c0d3fd0 con 0x7f6e6c06a460 2023-12-19T05:42:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.881+0000 7f6e837fe640 1 -- 172.21.15.49:0/2988286980 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282876 (secure 0 0 0) 0x7f6e8c0d3fd0 con 0x7f6e6c06a460 2023-12-19T05:42:15.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:42:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 msgr2=0x7f6e6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 0x7f6e6c06c920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c007fd0 tx=0x7f6e7c009040 comp rx=0 tx=0).stop 2023-12-19T05:42:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 msgr2=0x7f6e8c0d3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6e74037040 tx=0x7f6e74004730 comp rx=0 tx=0).stop 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 shutdown_connections 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6e6c06a460 0x7f6e6c06c920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e8c1f5d70 0x7f6e8c1f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e8c0d3610 0x7f6e8c0d3a90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 --2- 172.21.15.49:0/2988286980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e780047c0 0x7f6e8c13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 >> 172.21.15.49:0/2988286980 conn(0x7f6e8c0b29c0 msgr2=0x7f6e8c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 shutdown_connections 2023-12-19T05:42:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:15.886+0000 7f6e917c4640 1 -- 172.21.15.49:0/2988286980 wait complete. 2023-12-19T05:42:15.907 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-12-19T05:42:14.565666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3955,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558544,"statfs":{"total":1600000000,"available":1595949384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.187412"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026931+0000","last_change":"2023-12-19T05:42:10.943219+0000","last_active":"2023-12-19T05:42:12.026931+0000","last_peered":"2023-12-19T05:42:12.026931+0000","last_clean":"2023-12-19T05:42:12.026931+0000","last_became_active":"2023-12-19T05:42:10.941150+0000","last_became_peered":"2023-12-19T05:42:10.941150+0000","last_unstale":"2023-12-19T05:42:12.026931+0000","last_undegraded":"2023-12-19T05:42:12.026931+0000","last_fullsized":"2023-12-19T05:42:12.026931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028280+0000","last_change":"2023-12-19T05:42:10.949394+0000","last_active":"2023-12-19T05:42:12.028280+0000","last_peered":"2023-12-19T05:42:12.028280+0000","last_clean":"2023-12-19T05:42:12.028280+0000","last_became_active":"2023-12-19T05:42:10.947830+0000","last_became_peered":"2023-12-19T05:42:10.947830+0000","last_unstale":"2023-12-19T05:42:12.028280+0000","last_undegraded":"2023-12-19T05:42:12.028280+0000","last_fullsized":"2023-12-19T05:42:12.028280+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:53.244333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025270+0000","last_change":"2023-12-19T05:42:10.924088+0000","last_active":"2023-12-19T05:42:12.025270+0000","last_peered":"2023-12-19T05:42:12.025270+0000","last_clean":"2023-12-19T05:42:12.025270+0000","last_became_active":"2023-12-19T05:42:10.923880+0000","last_became_peered":"2023-12-19T05:42:10.923880+0000","last_unstale":"2023-12-19T05:42:12.025270+0000","last_undegraded":"2023-12-19T05:42:12.025270+0000","last_fullsized":"2023-12-19T05:42:12.025270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:08.354253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915042+0000","last_change":"2023-12-19T05:42:10.948050+0000","last_active":"2023-12-19T05:42:11.915042+0000","last_peered":"2023-12-19T05:42:11.915042+0000","last_clean":"2023-12-19T05:42:11.915042+0000","last_became_active":"2023-12-19T05:42:10.947736+0000","last_became_peered":"2023-12-19T05:42:10.947736+0000","last_unstale":"2023-12-19T05:42:11.915042+0000","last_undegraded":"2023-12-19T05:42:11.915042+0000","last_fullsized":"2023-12-19T05:42:11.915042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:44:47.749572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027460+0000","last_change":"2023-12-19T05:42:10.942956+0000","last_active":"2023-12-19T05:42:12.027460+0000","last_peered":"2023-12-19T05:42:12.027460+0000","last_clean":"2023-12-19T05:42:12.027460+0000","last_became_active":"2023-12-19T05:42:10.940259+0000","last_became_peered":"2023-12-19T05:42:10.940259+0000","last_unstale":"2023-12-19T05:42:12.027460+0000","last_undegraded":"2023-12-19T05:42:12.027460+0000","last_fullsized":"2023-12-19T05:42:12.027460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027143+0000","last_change":"2023-12-19T05:42:10.948090+0000","last_active":"2023-12-19T05:42:12.027143+0000","last_peered":"2023-12-19T05:42:12.027143+0000","last_clean":"2023-12-19T05:42:12.027143+0000","last_became_active":"2023-12-19T05:42:10.946965+0000","last_became_peered":"2023-12-19T05:42:10.946965+0000","last_unstale":"2023-12-19T05:42:12.027143+0000","last_undegraded":"2023-12-19T05:42:12.027143+0000","last_fullsized":"2023-12-19T05:42:12.027143+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:10.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915278+0000","last_change":"2023-12-19T05:42:10.917511+0000","last_active":"2023-12-19T05:42:11.915278+0000","last_peered":"2023-12-19T05:42:11.915278+0000","last_clean":"2023-12-19T05:42:11.915278+0000","last_became_active":"2023-12-19T05:42:10.917215+0000","last_became_peered":"2023-12-19T05:42:10.917215+0000","last_unstale":"2023-12-19T05:42:11.915278+0000","last_undegraded":"2023-12-19T05:42:11.915278+0000","last_fullsized":"2023-12-19T05:42:11.915278+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:11.075549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918319+0000","last_change":"2023-12-19T05:42:10.930625+0000","last_active":"2023-12-19T05:42:11.918319+0000","last_peered":"2023-12-19T05:42:11.918319+0000","last_clean":"2023-12-19T05:42:11.918319+0000","last_became_active":"2023-12-19T05:42:10.928376+0000","last_became_peered":"2023-12-19T05:42:10.928376+0000","last_unstale":"2023-12-19T05:42:11.918319+0000","last_undegraded":"2023-12-19T05:42:11.918319+0000","last_fullsized":"2023-12-19T05:42:11.918319+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:17.167835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028489+0000","last_change":"2023-12-19T05:42:10.947478+0000","last_active":"2023-12-19T05:42:12.028489+0000","last_peered":"2023-12-19T05:42:12.028489+0000","last_clean":"2023-12-19T05:42:12.028489+0000","last_became_active":"2023-12-19T05:42:10.946985+0000","last_became_peered":"2023-12-19T05:42:10.946985+0000","last_unstale":"2023-12-19T05:42:12.028489+0000","last_undegraded":"2023-12-19T05:42:12.028489+0000","last_fullsized":"2023-12-19T05:42:12.028489+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:59.368096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027718+0000","last_change":"2023-12-19T05:42:10.941279+0000","last_active":"2023-12-19T05:42:12.027718+0000","last_peered":"2023-12-19T05:42:12.027718+0000","last_clean":"2023-12-19T05:42:12.027718+0000","last_became_active":"2023-12-19T05:42:10.939458+0000","last_became_peered":"2023-12-19T05:42:10.939458+0000","last_unstale":"2023-12-19T05:42:12.027718+0000","last_undegraded":"2023-12-19T05:42:12.027718+0000","last_fullsized":"2023-12-19T05:42:12.027718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:15:39.558421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918689+0000","last_change":"2023-12-19T05:42:10.947262+0000","last_active":"2023-12-19T05:42:11.918689+0000","last_peered":"2023-12-19T05:42:11.918689+0000","last_clean":"2023-12-19T05:42:11.918689+0000","last_became_active":"2023-12-19T05:42:10.945948+0000","last_became_peered":"2023-12-19T05:42:10.945948+0000","last_unstale":"2023-12-19T05:42:11.918689+0000","last_undegraded":"2023-12-19T05:42:11.918689+0000","last_fullsized":"2023-12-19T05:42:11.918689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:13.264122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027836+0000","last_change":"2023-12-19T05:42:10.926725+0000","last_active":"2023-12-19T05:42:12.027836+0000","last_peered":"2023-12-19T05:42:12.027836+0000","last_clean":"2023-12-19T05:42:12.027836+0000","last_became_active":"2023-12-19T05:42:10.926506+0000","last_became_peered":"2023-12-19T05:42:10.926506+0000","last_unstale":"2023-12-19T05:42:12.027836+0000","last_undegraded":"2023-12-19T05:42:12.027836+0000","last_fullsized":"2023-12-19T05:42:12.027836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:00:58.500050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026872+0000","last_change":"2023-12-19T05:42:10.944677+0000","last_active":"2023-12-19T05:42:12.026872+0000","last_peered":"2023-12-19T05:42:12.026872+0000","last_clean":"2023-12-19T05:42:12.026872+0000","last_became_active":"2023-12-19T05:42:10.944399+0000","last_became_peered":"2023-12-19T05:42:10.944399+0000","last_unstale":"2023-12-19T05:42:12.026872+0000","last_undegraded":"2023-12-19T05:42:12.026872+0000","last_fullsized":"2023-12-19T05:42:12.026872+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:26.033654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025183+0000","last_change":"2023-12-19T05:42:10.931446+0000","last_active":"2023-12-19T05:42:12.025183+0000","last_peered":"2023-12-19T05:42:12.025183+0000","last_clean":"2023-12-19T05:42:12.025183+0000","last_became_active":"2023-12-19T05:42:10.931012+0000","last_became_peered":"2023-12-19T05:42:10.931012+0000","last_unstale":"2023-12-19T05:42:12.025183+0000","last_undegraded":"2023-12-19T05:42:12.025183+0000","last_fullsized":"2023-12-19T05:42:12.025183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:34.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027571+0000","last_change":"2023-12-19T05:42:10.941297+0000","last_active":"2023-12-19T05:42:12.027571+0000","last_peered":"2023-12-19T05:42:12.027571+0000","last_clean":"2023-12-19T05:42:12.027571+0000","last_became_active":"2023-12-19T05:42:10.941100+0000","last_became_peered":"2023-12-19T05:42:10.941100+0000","last_unstale":"2023-12-19T05:42:12.027571+0000","last_undegraded":"2023-12-19T05:42:12.027571+0000","last_fullsized":"2023-12-19T05:42:12.027571+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027362+0000","last_change":"2023-12-19T05:42:10.942818+0000","last_active":"2023-12-19T05:42:12.027362+0000","last_peered":"2023-12-19T05:42:12.027362+0000","last_clean":"2023-12-19T05:42:12.027362+0000","last_became_active":"2023-12-19T05:42:10.940704+0000","last_became_peered":"2023-12-19T05:42:10.940704+0000","last_unstale":"2023-12-19T05:42:12.027362+0000","last_undegraded":"2023-12-19T05:42:12.027362+0000","last_fullsized":"2023-12-19T05:42:12.027362+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026328+0000","last_change":"2023-12-19T05:42:10.939388+0000","last_active":"2023-12-19T05:42:12.026328+0000","last_peered":"2023-12-19T05:42:12.026328+0000","last_clean":"2023-12-19T05:42:12.026328+0000","last_became_active":"2023-12-19T05:42:10.939151+0000","last_became_peered":"2023-12-19T05:42:10.939151+0000","last_unstale":"2023-12-19T05:42:12.026328+0000","last_undegraded":"2023-12-19T05:42:12.026328+0000","last_fullsized":"2023-12-19T05:42:12.026328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:26.495325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025546+0000","last_change":"2023-12-19T05:42:10.942363+0000","last_active":"2023-12-19T05:42:12.025546+0000","last_peered":"2023-12-19T05:42:12.025546+0000","last_clean":"2023-12-19T05:42:12.025546+0000","last_became_active":"2023-12-19T05:42:10.942085+0000","last_became_peered":"2023-12-19T05:42:10.942085+0000","last_unstale":"2023-12-19T05:42:12.025546+0000","last_undegraded":"2023-12-19T05:42:12.025546+0000","last_fullsized":"2023-12-19T05:42:12.025546+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026210+0000","last_change":"2023-12-19T05:42:10.939726+0000","last_active":"2023-12-19T05:42:12.026210+0000","last_peered":"2023-12-19T05:42:12.026210+0000","last_clean":"2023-12-19T05:42:12.026210+0000","last_became_active":"2023-12-19T05:42:10.939457+0000","last_became_peered":"2023-12-19T05:42:10.939457+0000","last_unstale":"2023-12-19T05:42:12.026210+0000","last_undegraded":"2023-12-19T05:42:12.026210+0000","last_fullsized":"2023-12-19T05:42:12.026210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:21:28.061074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918006+0000","last_change":"2023-12-19T05:42:10.947505+0000","last_active":"2023-12-19T05:42:11.918006+0000","last_peered":"2023-12-19T05:42:11.918006+0000","last_clean":"2023-12-19T05:42:11.918006+0000","last_became_active":"2023-12-19T05:42:10.945886+0000","last_became_peered":"2023-12-19T05:42:10.945886+0000","last_unstale":"2023-12-19T05:42:11.918006+0000","last_undegraded":"2023-12-19T05:42:11.918006+0000","last_fullsized":"2023-12-19T05:42:11.918006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:53.403055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026645+0000","last_change":"2023-12-19T05:42:10.926522+0000","last_active":"2023-12-19T05:42:12.026645+0000","last_peered":"2023-12-19T05:42:12.026645+0000","last_clean":"2023-12-19T05:42:12.026645+0000","last_became_active":"2023-12-19T05:42:10.926314+0000","last_became_peered":"2023-12-19T05:42:10.926314+0000","last_unstale":"2023-12-19T05:42:12.026645+0000","last_undegraded":"2023-12-19T05:42:12.026645+0000","last_fullsized":"2023-12-19T05:42:12.026645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919369+0000","last_change":"2023-12-19T05:42:10.951933+0000","last_active":"2023-12-19T05:42:11.919369+0000","last_peered":"2023-12-19T05:42:11.919369+0000","last_clean":"2023-12-19T05:42:11.919369+0000","last_became_active":"2023-12-19T05:42:10.951209+0000","last_became_peered":"2023-12-19T05:42:10.951209+0000","last_unstale":"2023-12-19T05:42:11.919369+0000","last_undegraded":"2023-12-19T05:42:11.919369+0000","last_fullsized":"2023-12-19T05:42:11.919369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:29.609872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915071+0000","last_change":"2023-12-19T05:42:10.939896+0000","last_active":"2023-12-19T05:42:11.915071+0000","last_peered":"2023-12-19T05:42:11.915071+0000","last_clean":"2023-12-19T05:42:11.915071+0000","last_became_active":"2023-12-19T05:42:10.939668+0000","last_became_peered":"2023-12-19T05:42:10.939668+0000","last_unstale":"2023-12-19T05:42:11.915071+0000","last_undegraded":"2023-12-19T05:42:11.915071+0000","last_fullsized":"2023-12-19T05:42:11.915071+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:34.871331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027535+0000","last_change":"2023-12-19T05:42:10.947612+0000","last_active":"2023-12-19T05:42:12.027535+0000","last_peered":"2023-12-19T05:42:12.027535+0000","last_clean":"2023-12-19T05:42:12.027535+0000","last_became_active":"2023-12-19T05:42:10.947285+0000","last_became_peered":"2023-12-19T05:42:10.947285+0000","last_unstale":"2023-12-19T05:42:12.027535+0000","last_undegraded":"2023-12-19T05:42:12.027535+0000","last_fullsized":"2023-12-19T05:42:12.027535+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:09:11.913410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027420+0000","last_change":"2023-12-19T05:42:10.944865+0000","last_active":"2023-12-19T05:42:12.027420+0000","last_peered":"2023-12-19T05:42:12.027420+0000","last_clean":"2023-12-19T05:42:12.027420+0000","last_became_active":"2023-12-19T05:42:10.944443+0000","last_became_peered":"2023-12-19T05:42:10.944443+0000","last_unstale":"2023-12-19T05:42:12.027420+0000","last_undegraded":"2023-12-19T05:42:12.027420+0000","last_fullsized":"2023-12-19T05:42:12.027420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:00.145468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027272+0000","last_change":"2023-12-19T05:42:10.930127+0000","last_active":"2023-12-19T05:42:12.027272+0000","last_peered":"2023-12-19T05:42:12.027272+0000","last_clean":"2023-12-19T05:42:12.027272+0000","last_became_active":"2023-12-19T05:42:10.929895+0000","last_became_peered":"2023-12-19T05:42:10.929895+0000","last_unstale":"2023-12-19T05:42:12.027272+0000","last_undegraded":"2023-12-19T05:42:12.027272+0000","last_fullsized":"2023-12-19T05:42:12.027272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:08.354253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028686+0000","last_change":"2023-12-19T05:42:10.948145+0000","last_active":"2023-12-19T05:42:12.028686+0000","last_peered":"2023-12-19T05:42:12.028686+0000","last_clean":"2023-12-19T05:42:12.028686+0000","last_became_active":"2023-12-19T05:42:10.946128+0000","last_became_peered":"2023-12-19T05:42:10.946128+0000","last_unstale":"2023-12-19T05:42:12.028686+0000","last_undegraded":"2023-12-19T05:42:12.028686+0000","last_fullsized":"2023-12-19T05:42:12.028686+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:40.490434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918580+0000","last_change":"2023-12-19T05:42:10.937896+0000","last_active":"2023-12-19T05:42:11.918580+0000","last_peered":"2023-12-19T05:42:11.918580+0000","last_clean":"2023-12-19T05:42:11.918580+0000","last_became_active":"2023-12-19T05:42:10.936850+0000","last_became_peered":"2023-12-19T05:42:10.936850+0000","last_unstale":"2023-12-19T05:42:11.918580+0000","last_undegraded":"2023-12-19T05:42:11.918580+0000","last_fullsized":"2023-12-19T05:42:11.918580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:10.022246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917225+0000","last_change":"2023-12-19T05:42:10.929657+0000","last_active":"2023-12-19T05:42:11.917225+0000","last_peered":"2023-12-19T05:42:11.917225+0000","last_clean":"2023-12-19T05:42:11.917225+0000","last_became_active":"2023-12-19T05:42:10.928076+0000","last_became_peered":"2023-12-19T05:42:10.928076+0000","last_unstale":"2023-12-19T05:42:11.917225+0000","last_undegraded":"2023-12-19T05:42:11.917225+0000","last_fullsized":"2023-12-19T05:42:11.917225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:00:59.002998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.916510+0000","last_change":"2023-12-19T05:42:10.927202+0000","last_active":"2023-12-19T05:42:11.916510+0000","last_peered":"2023-12-19T05:42:11.916510+0000","last_clean":"2023-12-19T05:42:11.916510+0000","last_became_active":"2023-12-19T05:42:10.926936+0000","last_became_peered":"2023-12-19T05:42:10.926936+0000","last_unstale":"2023-12-19T05:42:11.916510+0000","last_undegraded":"2023-12-19T05:42:11.916510+0000","last_fullsized":"2023-12-19T05:42:11.916510+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:40.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027846+0000","last_change":"2023-12-19T05:42:10.942635+0000","last_active":"2023-12-19T05:42:12.027846+0000","last_peered":"2023-12-19T05:42:12.027846+0000","last_clean":"2023-12-19T05:42:12.027846+0000","last_became_active":"2023-12-19T05:42:10.942129+0000","last_became_peered":"2023-12-19T05:42:10.942129+0000","last_unstale":"2023-12-19T05:42:12.027846+0000","last_undegraded":"2023-12-19T05:42:12.027846+0000","last_fullsized":"2023-12-19T05:42:12.027846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:43.385666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919637+0000","last_change":"2023-12-19T05:42:10.951795+0000","last_active":"2023-12-19T05:42:11.919637+0000","last_peered":"2023-12-19T05:42:11.919637+0000","last_clean":"2023-12-19T05:42:11.919637+0000","last_became_active":"2023-12-19T05:42:10.950810+0000","last_became_peered":"2023-12-19T05:42:10.950810+0000","last_unstale":"2023-12-19T05:42:11.919637+0000","last_undegraded":"2023-12-19T05:42:11.919637+0000","last_fullsized":"2023-12-19T05:42:11.919637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:40.254303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026925+0000","last_change":"2023-12-19T05:42:10.946945+0000","last_active":"2023-12-19T05:42:12.026925+0000","last_peered":"2023-12-19T05:42:12.026925+0000","last_clean":"2023-12-19T05:42:12.026925+0000","last_became_active":"2023-12-19T05:42:10.944480+0000","last_became_peered":"2023-12-19T05:42:10.944480+0000","last_unstale":"2023-12-19T05:42:12.026925+0000","last_undegraded":"2023-12-19T05:42:12.026925+0000","last_fullsized":"2023-12-19T05:42:12.026925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:38.694511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917655+0000","last_change":"2023-12-19T05:42:10.411844+0000","last_active":"2023-12-19T05:42:11.917655+0000","last_peered":"2023-12-19T05:42:11.917655+0000","last_clean":"2023-12-19T05:42:11.917655+0000","last_became_active":"2023-12-19T05:42:10.411597+0000","last_became_peered":"2023-12-19T05:42:10.411597+0000","last_unstale":"2023-12-19T05:42:11.917655+0000","last_undegraded":"2023-12-19T05:42:11.917655+0000","last_fullsized":"2023-12-19T05:42:11.917655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:25.017638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026517+0000","last_change":"2023-12-19T05:42:10.947610+0000","last_active":"2023-12-19T05:42:12.026517+0000","last_peered":"2023-12-19T05:42:12.026517+0000","last_clean":"2023-12-19T05:42:12.026517+0000","last_became_active":"2023-12-19T05:42:10.947377+0000","last_became_peered":"2023-12-19T05:42:10.947377+0000","last_unstale":"2023-12-19T05:42:12.026517+0000","last_undegraded":"2023-12-19T05:42:12.026517+0000","last_fullsized":"2023-12-19T05:42:12.026517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:19:11.924625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026462+0000","last_change":"2023-12-19T05:42:10.414466+0000","last_active":"2023-12-19T05:42:12.026462+0000","last_peered":"2023-12-19T05:42:12.026462+0000","last_clean":"2023-12-19T05:42:12.026462+0000","last_became_active":"2023-12-19T05:42:10.413900+0000","last_became_peered":"2023-12-19T05:42:10.413900+0000","last_unstale":"2023-12-19T05:42:12.026462+0000","last_undegraded":"2023-12-19T05:42:12.026462+0000","last_fullsized":"2023-12-19T05:42:12.026462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:32:28.568994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917778+0000","last_change":"2023-12-19T05:42:10.943065+0000","last_active":"2023-12-19T05:42:11.917778+0000","last_peered":"2023-12-19T05:42:11.917778+0000","last_clean":"2023-12-19T05:42:11.917778+0000","last_became_active":"2023-12-19T05:42:10.942631+0000","last_became_peered":"2023-12-19T05:42:10.942631+0000","last_unstale":"2023-12-19T05:42:11.917778+0000","last_undegraded":"2023-12-19T05:42:11.917778+0000","last_fullsized":"2023-12-19T05:42:11.917778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:28.905709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028253+0000","last_change":"2023-12-19T05:42:10.414950+0000","last_active":"2023-12-19T05:42:12.028253+0000","last_peered":"2023-12-19T05:42:12.028253+0000","last_clean":"2023-12-19T05:42:12.028253+0000","last_became_active":"2023-12-19T05:42:10.412665+0000","last_became_peered":"2023-12-19T05:42:10.412665+0000","last_unstale":"2023-12-19T05:42:12.028253+0000","last_undegraded":"2023-12-19T05:42:12.028253+0000","last_fullsized":"2023-12-19T05:42:12.028253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:25.284181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028113+0000","last_change":"2023-12-19T05:42:10.943183+0000","last_active":"2023-12-19T05:42:12.028113+0000","last_peered":"2023-12-19T05:42:12.028113+0000","last_clean":"2023-12-19T05:42:12.028113+0000","last_became_active":"2023-12-19T05:42:10.940981+0000","last_became_peered":"2023-12-19T05:42:10.940981+0000","last_unstale":"2023-12-19T05:42:12.028113+0000","last_undegraded":"2023-12-19T05:42:12.028113+0000","last_fullsized":"2023-12-19T05:42:12.028113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:13:13.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915617+0000","last_change":"2023-12-19T05:42:10.409734+0000","last_active":"2023-12-19T05:42:11.915617+0000","last_peered":"2023-12-19T05:42:11.915617+0000","last_clean":"2023-12-19T05:42:11.915617+0000","last_became_active":"2023-12-19T05:42:10.409424+0000","last_became_peered":"2023-12-19T05:42:10.409424+0000","last_unstale":"2023-12-19T05:42:11.915617+0000","last_undegraded":"2023-12-19T05:42:11.915617+0000","last_fullsized":"2023-12-19T05:42:11.915617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:09.006231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918818+0000","last_change":"2023-12-19T05:42:10.938093+0000","last_active":"2023-12-19T05:42:11.918818+0000","last_peered":"2023-12-19T05:42:11.918818+0000","last_clean":"2023-12-19T05:42:11.918818+0000","last_became_active":"2023-12-19T05:42:10.937514+0000","last_became_peered":"2023-12-19T05:42:10.937514+0000","last_unstale":"2023-12-19T05:42:11.918818+0000","last_undegraded":"2023-12-19T05:42:11.918818+0000","last_fullsized":"2023-12-19T05:42:11.918818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:10:21.493570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026324+0000","last_change":"2023-12-19T05:42:10.414350+0000","last_active":"2023-12-19T05:42:12.026324+0000","last_peered":"2023-12-19T05:42:12.026324+0000","last_clean":"2023-12-19T05:42:12.026324+0000","last_became_active":"2023-12-19T05:42:10.414093+0000","last_became_peered":"2023-12-19T05:42:10.414093+0000","last_unstale":"2023-12-19T05:42:12.026324+0000","last_undegraded":"2023-12-19T05:42:12.026324+0000","last_fullsized":"2023-12-19T05:42:12.026324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.369651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.920037+0000","last_change":"2023-12-19T05:42:10.951642+0000","last_active":"2023-12-19T05:42:11.920037+0000","last_peered":"2023-12-19T05:42:11.920037+0000","last_clean":"2023-12-19T05:42:11.920037+0000","last_became_active":"2023-12-19T05:42:10.950459+0000","last_became_peered":"2023-12-19T05:42:10.950459+0000","last_unstale":"2023-12-19T05:42:11.920037+0000","last_undegraded":"2023-12-19T05:42:11.920037+0000","last_fullsized":"2023-12-19T05:42:11.920037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:15:39.558421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025975+0000","last_change":"2023-12-19T05:42:10.409932+0000","last_active":"2023-12-19T05:42:12.025975+0000","last_peered":"2023-12-19T05:42:12.025975+0000","last_clean":"2023-12-19T05:42:12.025975+0000","last_became_active":"2023-12-19T05:42:10.408193+0000","last_became_peered":"2023-12-19T05:42:10.408193+0000","last_unstale":"2023-12-19T05:42:12.025975+0000","last_undegraded":"2023-12-19T05:42:12.025975+0000","last_fullsized":"2023-12-19T05:42:12.025975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:59.129453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025814+0000","last_change":"2023-12-19T05:42:10.918687+0000","last_active":"2023-12-19T05:42:12.025814+0000","last_peered":"2023-12-19T05:42:12.025814+0000","last_clean":"2023-12-19T05:42:12.025814+0000","last_became_active":"2023-12-19T05:42:10.918469+0000","last_became_peered":"2023-12-19T05:42:10.918469+0000","last_unstale":"2023-12-19T05:42:12.025814+0000","last_undegraded":"2023-12-19T05:42:12.025814+0000","last_fullsized":"2023-12-19T05:42:12.025814+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:10.333850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028712+0000","last_change":"2023-12-19T05:42:10.413102+0000","last_active":"2023-12-19T05:42:12.028712+0000","last_peered":"2023-12-19T05:42:12.028712+0000","last_clean":"2023-12-19T05:42:12.028712+0000","last_became_active":"2023-12-19T05:42:10.412792+0000","last_became_peered":"2023-12-19T05:42:10.412792+0000","last_unstale":"2023-12-19T05:42:12.028712+0000","last_undegraded":"2023-12-19T05:42:12.028712+0000","last_fullsized":"2023-12-19T05:42:12.028712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:47:41.179015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027465+0000","last_change":"2023-12-19T05:42:10.946637+0000","last_active":"2023-12-19T05:42:12.027465+0000","last_peered":"2023-12-19T05:42:12.027465+0000","last_clean":"2023-12-19T05:42:12.027465+0000","last_became_active":"2023-12-19T05:42:10.942592+0000","last_became_peered":"2023-12-19T05:42:10.942592+0000","last_unstale":"2023-12-19T05:42:12.027465+0000","last_undegraded":"2023-12-19T05:42:12.027465+0000","last_fullsized":"2023-12-19T05:42:12.027465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:32.908378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027784+0000","last_change":"2023-12-19T05:42:10.415841+0000","last_active":"2023-12-19T05:42:12.027784+0000","last_peered":"2023-12-19T05:42:12.027784+0000","last_clean":"2023-12-19T05:42:12.027784+0000","last_became_active":"2023-12-19T05:42:10.415111+0000","last_became_peered":"2023-12-19T05:42:10.415111+0000","last_unstale":"2023-12-19T05:42:12.027784+0000","last_undegraded":"2023-12-19T05:42:12.027784+0000","last_fullsized":"2023-12-19T05:42:12.027784+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:59.129453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027020+0000","last_change":"2023-12-19T05:42:10.946748+0000","last_active":"2023-12-19T05:42:12.027020+0000","last_peered":"2023-12-19T05:42:12.027020+0000","last_clean":"2023-12-19T05:42:12.027020+0000","last_became_active":"2023-12-19T05:42:10.946533+0000","last_became_peered":"2023-12-19T05:42:10.946533+0000","last_unstale":"2023-12-19T05:42:12.027020+0000","last_undegraded":"2023-12-19T05:42:12.027020+0000","last_fullsized":"2023-12-19T05:42:12.027020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028560+0000","last_change":"2023-12-19T05:42:10.414051+0000","last_active":"2023-12-19T05:42:12.028560+0000","last_peered":"2023-12-19T05:42:12.028560+0000","last_clean":"2023-12-19T05:42:12.028560+0000","last_became_active":"2023-12-19T05:42:10.413677+0000","last_became_peered":"2023-12-19T05:42:10.413677+0000","last_unstale":"2023-12-19T05:42:12.028560+0000","last_undegraded":"2023-12-19T05:42:12.028560+0000","last_fullsized":"2023-12-19T05:42:12.028560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:40:00.009959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025563+0000","last_change":"2023-12-19T05:42:10.921818+0000","last_active":"2023-12-19T05:42:12.025563+0000","last_peered":"2023-12-19T05:42:12.025563+0000","last_clean":"2023-12-19T05:42:12.025563+0000","last_became_active":"2023-12-19T05:42:10.921257+0000","last_became_peered":"2023-12-19T05:42:10.921257+0000","last_unstale":"2023-12-19T05:42:12.025563+0000","last_undegraded":"2023-12-19T05:42:12.025563+0000","last_fullsized":"2023-12-19T05:42:12.025563+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:26.033654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917528+0000","last_change":"2023-12-19T05:42:10.414166+0000","last_active":"2023-12-19T05:42:11.917528+0000","last_peered":"2023-12-19T05:42:11.917528+0000","last_clean":"2023-12-19T05:42:11.917528+0000","last_became_active":"2023-12-19T05:42:10.411147+0000","last_became_peered":"2023-12-19T05:42:10.411147+0000","last_unstale":"2023-12-19T05:42:11.917528+0000","last_undegraded":"2023-12-19T05:42:11.917528+0000","last_fullsized":"2023-12-19T05:42:11.917528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:13.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917465+0000","last_change":"2023-12-19T05:42:10.944281+0000","last_active":"2023-12-19T05:42:11.917465+0000","last_peered":"2023-12-19T05:42:11.917465+0000","last_clean":"2023-12-19T05:42:11.917465+0000","last_became_active":"2023-12-19T05:42:10.944031+0000","last_became_peered":"2023-12-19T05:42:10.944031+0000","last_unstale":"2023-12-19T05:42:11.917465+0000","last_undegraded":"2023-12-19T05:42:11.917465+0000","last_fullsized":"2023-12-19T05:42:11.917465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:56.132627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"69'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915473+0000","last_change":"2023-12-19T05:42:10.410737+0000","last_active":"2023-12-19T05:42:11.915473+0000","last_peered":"2023-12-19T05:42:11.915473+0000","last_clean":"2023-12-19T05:42:11.915473+0000","last_became_active":"2023-12-19T05:42:10.410441+0000","last_became_peered":"2023-12-19T05:42:10.410441+0000","last_unstale":"2023-12-19T05:42:11.915473+0000","last_undegraded":"2023-12-19T05:42:11.915473+0000","last_fullsized":"2023-12-19T05:42:11.915473+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:36:24.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915336+0000","last_change":"2023-12-19T05:42:10.926319+0000","last_active":"2023-12-19T05:42:11.915336+0000","last_peered":"2023-12-19T05:42:11.915336+0000","last_clean":"2023-12-19T05:42:11.915336+0000","last_became_active":"2023-12-19T05:42:10.926164+0000","last_became_peered":"2023-12-19T05:42:10.926164+0000","last_unstale":"2023-12-19T05:42:11.915336+0000","last_undegraded":"2023-12-19T05:42:11.915336+0000","last_fullsized":"2023-12-19T05:42:11.915336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:17:31.725856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"69'6","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026681+0000","last_change":"2023-12-19T05:42:10.411086+0000","last_active":"2023-12-19T05:42:12.026681+0000","last_peered":"2023-12-19T05:42:12.026681+0000","last_clean":"2023-12-19T05:42:12.026681+0000","last_became_active":"2023-12-19T05:42:10.409118+0000","last_became_peered":"2023-12-19T05:42:10.409118+0000","last_unstale":"2023-12-19T05:42:12.026681+0000","last_undegraded":"2023-12-19T05:42:12.026681+0000","last_fullsized":"2023-12-19T05:42:12.026681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.395041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028434+0000","last_change":"2023-12-19T05:42:10.941481+0000","last_active":"2023-12-19T05:42:12.028434+0000","last_peered":"2023-12-19T05:42:12.028434+0000","last_clean":"2023-12-19T05:42:12.028434+0000","last_became_active":"2023-12-19T05:42:10.941237+0000","last_became_peered":"2023-12-19T05:42:10.941237+0000","last_unstale":"2023-12-19T05:42:12.028434+0000","last_undegraded":"2023-12-19T05:42:12.028434+0000","last_fullsized":"2023-12-19T05:42:12.028434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:20:09.549204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919027+0000","last_change":"2023-12-19T05:42:10.412799+0000","last_active":"2023-12-19T05:42:11.919027+0000","last_peered":"2023-12-19T05:42:11.919027+0000","last_clean":"2023-12-19T05:42:11.919027+0000","last_became_active":"2023-12-19T05:42:10.412409+0000","last_became_peered":"2023-12-19T05:42:10.412409+0000","last_unstale":"2023-12-19T05:42:11.919027+0000","last_undegraded":"2023-12-19T05:42:11.919027+0000","last_fullsized":"2023-12-19T05:42:11.919027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:48.686227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026102+0000","last_change":"2023-12-19T05:42:10.923730+0000","last_active":"2023-12-19T05:42:12.026102+0000","last_peered":"2023-12-19T05:42:12.026102+0000","last_clean":"2023-12-19T05:42:12.026102+0000","last_became_active":"2023-12-19T05:42:10.923445+0000","last_became_peered":"2023-12-19T05:42:10.923445+0000","last_unstale":"2023-12-19T05:42:12.026102+0000","last_undegraded":"2023-12-19T05:42:12.026102+0000","last_fullsized":"2023-12-19T05:42:12.026102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:38.694511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915707+0000","last_change":"2023-12-19T05:42:10.411288+0000","last_active":"2023-12-19T05:42:11.915707+0000","last_peered":"2023-12-19T05:42:11.915707+0000","last_clean":"2023-12-19T05:42:11.915707+0000","last_became_active":"2023-12-19T05:42:10.410745+0000","last_became_peered":"2023-12-19T05:42:10.410745+0000","last_unstale":"2023-12-19T05:42:11.915707+0000","last_undegraded":"2023-12-19T05:42:11.915707+0000","last_fullsized":"2023-12-19T05:42:11.915707+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:27.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028243+0000","last_change":"2023-12-19T05:42:10.930644+0000","last_active":"2023-12-19T05:42:12.028243+0000","last_peered":"2023-12-19T05:42:12.028243+0000","last_clean":"2023-12-19T05:42:12.028243+0000","last_became_active":"2023-12-19T05:42:10.929083+0000","last_became_peered":"2023-12-19T05:42:10.929083+0000","last_unstale":"2023-12-19T05:42:12.028243+0000","last_undegraded":"2023-12-19T05:42:12.028243+0000","last_fullsized":"2023-12-19T05:42:12.028243+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:06:26.979337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915524+0000","last_change":"2023-12-19T05:42:10.406248+0000","last_active":"2023-12-19T05:42:11.915524+0000","last_peered":"2023-12-19T05:42:11.915524+0000","last_clean":"2023-12-19T05:42:11.915524+0000","last_became_active":"2023-12-19T05:42:10.405484+0000","last_became_peered":"2023-12-19T05:42:10.405484+0000","last_unstale":"2023-12-19T05:42:11.915524+0000","last_undegraded":"2023-12-19T05:42:11.915524+0000","last_fullsized":"2023-12-19T05:42:11.915524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:00:57.986983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915410+0000","last_change":"2023-12-19T05:42:10.946848+0000","last_active":"2023-12-19T05:42:11.915410+0000","last_peered":"2023-12-19T05:42:11.915410+0000","last_clean":"2023-12-19T05:42:11.915410+0000","last_became_active":"2023-12-19T05:42:10.946609+0000","last_became_peered":"2023-12-19T05:42:10.946609+0000","last_unstale":"2023-12-19T05:42:11.915410+0000","last_undegraded":"2023-12-19T05:42:11.915410+0000","last_fullsized":"2023-12-19T05:42:11.915410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:21:49.298369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915650+0000","last_change":"2023-12-19T05:42:10.406946+0000","last_active":"2023-12-19T05:42:11.915650+0000","last_peered":"2023-12-19T05:42:11.915650+0000","last_clean":"2023-12-19T05:42:11.915650+0000","last_became_active":"2023-12-19T05:42:10.406697+0000","last_became_peered":"2023-12-19T05:42:10.406697+0000","last_unstale":"2023-12-19T05:42:11.915650+0000","last_undegraded":"2023-12-19T05:42:11.915650+0000","last_fullsized":"2023-12-19T05:42:11.915650+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:02:20.519533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026386+0000","last_change":"2023-12-19T05:42:10.937030+0000","last_active":"2023-12-19T05:42:12.026386+0000","last_peered":"2023-12-19T05:42:12.026386+0000","last_clean":"2023-12-19T05:42:12.026386+0000","last_became_active":"2023-12-19T05:42:10.936761+0000","last_became_peered":"2023-12-19T05:42:10.936761+0000","last_unstale":"2023-12-19T05:42:12.026386+0000","last_undegraded":"2023-12-19T05:42:12.026386+0000","last_fullsized":"2023-12-19T05:42:12.026386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:26.495325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026745+0000","last_change":"2023-12-19T05:42:10.414648+0000","last_active":"2023-12-19T05:42:12.026745+0000","last_peered":"2023-12-19T05:42:12.026745+0000","last_clean":"2023-12-19T05:42:12.026745+0000","last_became_active":"2023-12-19T05:42:10.414223+0000","last_became_peered":"2023-12-19T05:42:10.414223+0000","last_unstale":"2023-12-19T05:42:12.026745+0000","last_undegraded":"2023-12-19T05:42:12.026745+0000","last_fullsized":"2023-12-19T05:42:12.026745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:35:07.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025289+0000","last_change":"2023-12-19T05:42:10.931589+0000","last_active":"2023-12-19T05:42:12.025289+0000","last_peered":"2023-12-19T05:42:12.025289+0000","last_clean":"2023-12-19T05:42:12.025289+0000","last_became_active":"2023-12-19T05:42:10.931279+0000","last_became_peered":"2023-12-19T05:42:10.931279+0000","last_unstale":"2023-12-19T05:42:12.025289+0000","last_undegraded":"2023-12-19T05:42:12.025289+0000","last_fullsized":"2023-12-19T05:42:12.025289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:26:06.824452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919234+0000","last_change":"2023-12-19T05:42:10.412649+0000","last_active":"2023-12-19T05:42:11.919234+0000","last_peered":"2023-12-19T05:42:11.919234+0000","last_clean":"2023-12-19T05:42:11.919234+0000","last_became_active":"2023-12-19T05:42:10.411570+0000","last_became_peered":"2023-12-19T05:42:10.411570+0000","last_unstale":"2023-12-19T05:42:11.919234+0000","last_undegraded":"2023-12-19T05:42:11.919234+0000","last_fullsized":"2023-12-19T05:42:11.919234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:25.017638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028907+0000","last_change":"2023-12-19T05:42:10.949185+0000","last_active":"2023-12-19T05:42:12.028907+0000","last_peered":"2023-12-19T05:42:12.028907+0000","last_clean":"2023-12-19T05:42:12.028907+0000","last_became_active":"2023-12-19T05:42:10.947470+0000","last_became_peered":"2023-12-19T05:42:10.947470+0000","last_unstale":"2023-12-19T05:42:12.028907+0000","last_undegraded":"2023-12-19T05:42:12.028907+0000","last_fullsized":"2023-12-19T05:42:12.028907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:24.220462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025738+0000","last_change":"2023-12-19T05:42:10.413991+0000","last_active":"2023-12-19T05:42:12.025738+0000","last_peered":"2023-12-19T05:42:12.025738+0000","last_clean":"2023-12-19T05:42:12.025738+0000","last_became_active":"2023-12-19T05:42:10.413544+0000","last_became_peered":"2023-12-19T05:42:10.413544+0000","last_unstale":"2023-12-19T05:42:12.025738+0000","last_undegraded":"2023-12-19T05:42:12.025738+0000","last_fullsized":"2023-12-19T05:42:12.025738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:17.100935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915483+0000","last_change":"2023-12-19T05:42:10.941963+0000","last_active":"2023-12-19T05:42:11.915483+0000","last_peered":"2023-12-19T05:42:11.915483+0000","last_clean":"2023-12-19T05:42:11.915483+0000","last_became_active":"2023-12-19T05:42:10.941731+0000","last_became_peered":"2023-12-19T05:42:10.941731+0000","last_unstale":"2023-12-19T05:42:11.915483+0000","last_undegraded":"2023-12-19T05:42:11.915483+0000","last_fullsized":"2023-12-19T05:42:11.915483+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:35.107441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917763+0000","last_change":"2023-12-19T05:42:10.406649+0000","last_active":"2023-12-19T05:42:11.917763+0000","last_peered":"2023-12-19T05:42:11.917763+0000","last_clean":"2023-12-19T05:42:11.917763+0000","last_became_active":"2023-12-19T05:42:10.404131+0000","last_became_peered":"2023-12-19T05:42:10.404131+0000","last_unstale":"2023-12-19T05:42:11.917763+0000","last_undegraded":"2023-12-19T05:42:11.917763+0000","last_fullsized":"2023-12-19T05:42:11.917763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:08.875821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028039+0000","last_change":"2023-12-19T05:42:10.944171+0000","last_active":"2023-12-19T05:42:12.028039+0000","last_peered":"2023-12-19T05:42:12.028039+0000","last_clean":"2023-12-19T05:42:12.028039+0000","last_became_active":"2023-12-19T05:42:10.943927+0000","last_became_peered":"2023-12-19T05:42:10.943927+0000","last_unstale":"2023-12-19T05:42:12.028039+0000","last_undegraded":"2023-12-19T05:42:12.028039+0000","last_fullsized":"2023-12-19T05:42:12.028039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:25.280684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917894+0000","last_change":"2023-12-19T05:42:10.412768+0000","last_active":"2023-12-19T05:42:11.917894+0000","last_peered":"2023-12-19T05:42:11.917894+0000","last_clean":"2023-12-19T05:42:11.917894+0000","last_became_active":"2023-12-19T05:42:10.412094+0000","last_became_peered":"2023-12-19T05:42:10.412094+0000","last_unstale":"2023-12-19T05:42:11.917894+0000","last_undegraded":"2023-12-19T05:42:11.917894+0000","last_fullsized":"2023-12-19T05:42:11.917894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:48.686227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919212+0000","last_change":"2023-12-19T05:42:10.937208+0000","last_active":"2023-12-19T05:42:11.919212+0000","last_peered":"2023-12-19T05:42:11.919212+0000","last_clean":"2023-12-19T05:42:11.919212+0000","last_became_active":"2023-12-19T05:42:10.934380+0000","last_became_peered":"2023-12-19T05:42:10.934380+0000","last_unstale":"2023-12-19T05:42:11.919212+0000","last_undegraded":"2023-12-19T05:42:11.919212+0000","last_fullsized":"2023-12-19T05:42:11.919212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.120594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918142+0000","last_change":"2023-12-19T05:42:10.414336+0000","last_active":"2023-12-19T05:42:11.918142+0000","last_peered":"2023-12-19T05:42:11.918142+0000","last_clean":"2023-12-19T05:42:11.918142+0000","last_became_active":"2023-12-19T05:42:10.414042+0000","last_became_peered":"2023-12-19T05:42:10.414042+0000","last_unstale":"2023-12-19T05:42:11.918142+0000","last_undegraded":"2023-12-19T05:42:11.918142+0000","last_fullsized":"2023-12-19T05:42:11.918142+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:07.338238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918813+0000","last_change":"2023-12-19T05:42:10.932119+0000","last_active":"2023-12-19T05:42:11.918813+0000","last_peered":"2023-12-19T05:42:11.918813+0000","last_clean":"2023-12-19T05:42:11.918813+0000","last_became_active":"2023-12-19T05:42:10.931648+0000","last_became_peered":"2023-12-19T05:42:10.931648+0000","last_unstale":"2023-12-19T05:42:11.918813+0000","last_undegraded":"2023-12-19T05:42:11.918813+0000","last_fullsized":"2023-12-19T05:42:11.918813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:59.659219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028663+0000","last_change":"2023-12-19T05:42:10.411494+0000","last_active":"2023-12-19T05:42:12.028663+0000","last_peered":"2023-12-19T05:42:12.028663+0000","last_clean":"2023-12-19T05:42:12.028663+0000","last_became_active":"2023-12-19T05:42:10.410205+0000","last_became_peered":"2023-12-19T05:42:10.410205+0000","last_unstale":"2023-12-19T05:42:12.028663+0000","last_undegraded":"2023-12-19T05:42:12.028663+0000","last_fullsized":"2023-12-19T05:42:12.028663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:05:59.468815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025817+0000","last_change":"2023-12-19T05:42:10.939437+0000","last_active":"2023-12-19T05:42:12.025817+0000","last_peered":"2023-12-19T05:42:12.025817+0000","last_clean":"2023-12-19T05:42:12.025817+0000","last_became_active":"2023-12-19T05:42:10.939187+0000","last_became_peered":"2023-12-19T05:42:10.939187+0000","last_unstale":"2023-12-19T05:42:12.025817+0000","last_undegraded":"2023-12-19T05:42:12.025817+0000","last_fullsized":"2023-12-19T05:42:12.025817+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.029320+0000","last_change":"2023-12-19T05:42:10.411819+0000","last_active":"2023-12-19T05:42:12.029320+0000","last_peered":"2023-12-19T05:42:12.029320+0000","last_clean":"2023-12-19T05:42:12.029320+0000","last_became_active":"2023-12-19T05:42:10.411515+0000","last_became_peered":"2023-12-19T05:42:10.411515+0000","last_unstale":"2023-12-19T05:42:12.029320+0000","last_undegraded":"2023-12-19T05:42:12.029320+0000","last_fullsized":"2023-12-19T05:42:12.029320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:24.264669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026078+0000","last_change":"2023-12-19T05:42:10.918596+0000","last_active":"2023-12-19T05:42:12.026078+0000","last_peered":"2023-12-19T05:42:12.026078+0000","last_clean":"2023-12-19T05:42:12.026078+0000","last_became_active":"2023-12-19T05:42:10.918028+0000","last_became_peered":"2023-12-19T05:42:10.918028+0000","last_unstale":"2023-12-19T05:42:12.026078+0000","last_undegraded":"2023-12-19T05:42:12.026078+0000","last_fullsized":"2023-12-19T05:42:12.026078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026249+0000","last_change":"2023-12-19T05:42:10.408647+0000","last_active":"2023-12-19T05:42:12.026249+0000","last_peered":"2023-12-19T05:42:12.026249+0000","last_clean":"2023-12-19T05:42:12.026249+0000","last_became_active":"2023-12-19T05:42:10.407590+0000","last_became_peered":"2023-12-19T05:42:10.407590+0000","last_unstale":"2023-12-19T05:42:12.026249+0000","last_undegraded":"2023-12-19T05:42:12.026249+0000","last_fullsized":"2023-12-19T05:42:12.026249+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:52.228317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027677+0000","last_change":"2023-12-19T05:42:10.941337+0000","last_active":"2023-12-19T05:42:12.027677+0000","last_peered":"2023-12-19T05:42:12.027677+0000","last_clean":"2023-12-19T05:42:12.027677+0000","last_became_active":"2023-12-19T05:42:10.941092+0000","last_became_peered":"2023-12-19T05:42:10.941092+0000","last_unstale":"2023-12-19T05:42:12.027677+0000","last_undegraded":"2023-12-19T05:42:12.027677+0000","last_fullsized":"2023-12-19T05:42:12.027677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:18.116950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028926+0000","last_change":"2023-12-19T05:42:10.407335+0000","last_active":"2023-12-19T05:42:12.028926+0000","last_peered":"2023-12-19T05:42:12.028926+0000","last_clean":"2023-12-19T05:42:12.028926+0000","last_became_active":"2023-12-19T05:42:10.407021+0000","last_became_peered":"2023-12-19T05:42:10.407021+0000","last_unstale":"2023-12-19T05:42:12.028926+0000","last_undegraded":"2023-12-19T05:42:12.028926+0000","last_fullsized":"2023-12-19T05:42:12.028926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:51.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917713+0000","last_change":"2023-12-19T05:42:10.934160+0000","last_active":"2023-12-19T05:42:11.917713+0000","last_peered":"2023-12-19T05:42:11.917713+0000","last_clean":"2023-12-19T05:42:11.917713+0000","last_became_active":"2023-12-19T05:42:10.928941+0000","last_became_peered":"2023-12-19T05:42:10.928941+0000","last_unstale":"2023-12-19T05:42:11.917713+0000","last_undegraded":"2023-12-19T05:42:11.917713+0000","last_fullsized":"2023-12-19T05:42:11.917713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:36:25.444855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026618+0000","last_change":"2023-12-19T05:42:10.413301+0000","last_active":"2023-12-19T05:42:12.026618+0000","last_peered":"2023-12-19T05:42:12.026618+0000","last_clean":"2023-12-19T05:42:12.026618+0000","last_became_active":"2023-12-19T05:42:10.408323+0000","last_became_peered":"2023-12-19T05:42:10.408323+0000","last_unstale":"2023-12-19T05:42:12.026618+0000","last_undegraded":"2023-12-19T05:42:12.026618+0000","last_fullsized":"2023-12-19T05:42:12.026618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:21:27.045059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026666+0000","last_change":"2023-12-19T05:42:10.950132+0000","last_active":"2023-12-19T05:42:12.026666+0000","last_peered":"2023-12-19T05:42:12.026666+0000","last_clean":"2023-12-19T05:42:12.026666+0000","last_became_active":"2023-12-19T05:42:10.949843+0000","last_became_peered":"2023-12-19T05:42:10.949843+0000","last_unstale":"2023-12-19T05:42:12.026666+0000","last_undegraded":"2023-12-19T05:42:12.026666+0000","last_fullsized":"2023-12-19T05:42:12.026666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:16:49.725520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028061+0000","last_change":"2023-12-19T05:42:10.417466+0000","last_active":"2023-12-19T05:42:12.028061+0000","last_peered":"2023-12-19T05:42:12.028061+0000","last_clean":"2023-12-19T05:42:12.028061+0000","last_became_active":"2023-12-19T05:42:10.417237+0000","last_became_peered":"2023-12-19T05:42:10.417237+0000","last_unstale":"2023-12-19T05:42:12.028061+0000","last_undegraded":"2023-12-19T05:42:12.028061+0000","last_fullsized":"2023-12-19T05:42:12.028061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:44.144397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027362+0000","last_change":"2023-12-19T05:42:10.928467+0000","last_active":"2023-12-19T05:42:12.027362+0000","last_peered":"2023-12-19T05:42:12.027362+0000","last_clean":"2023-12-19T05:42:12.027362+0000","last_became_active":"2023-12-19T05:42:10.928253+0000","last_became_peered":"2023-12-19T05:42:10.928253+0000","last_unstale":"2023-12-19T05:42:12.027362+0000","last_undegraded":"2023-12-19T05:42:12.027362+0000","last_fullsized":"2023-12-19T05:42:12.027362+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:34.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026552+0000","last_change":"2023-12-19T05:42:10.413452+0000","last_active":"2023-12-19T05:42:12.026552+0000","last_peered":"2023-12-19T05:42:12.026552+0000","last_clean":"2023-12-19T05:42:12.026552+0000","last_became_active":"2023-12-19T05:42:10.413016+0000","last_became_peered":"2023-12-19T05:42:10.413016+0000","last_unstale":"2023-12-19T05:42:12.026552+0000","last_undegraded":"2023-12-19T05:42:12.026552+0000","last_fullsized":"2023-12-19T05:42:12.026552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:23.204447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917942+0000","last_change":"2023-12-19T05:42:10.936376+0000","last_active":"2023-12-19T05:42:11.917942+0000","last_peered":"2023-12-19T05:42:11.917942+0000","last_clean":"2023-12-19T05:42:11.917942+0000","last_became_active":"2023-12-19T05:42:10.934596+0000","last_became_peered":"2023-12-19T05:42:10.934596+0000","last_unstale":"2023-12-19T05:42:11.917942+0000","last_undegraded":"2023-12-19T05:42:11.917942+0000","last_fullsized":"2023-12-19T05:42:11.917942+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:02:21.535548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026786+0000","last_change":"2023-12-19T05:42:10.413807+0000","last_active":"2023-12-19T05:42:12.026786+0000","last_peered":"2023-12-19T05:42:12.026786+0000","last_clean":"2023-12-19T05:42:12.026786+0000","last_became_active":"2023-12-19T05:42:10.413483+0000","last_became_peered":"2023-12-19T05:42:10.413483+0000","last_unstale":"2023-12-19T05:42:12.026786+0000","last_undegraded":"2023-12-19T05:42:12.026786+0000","last_fullsized":"2023-12-19T05:42:12.026786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:17.100935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027204+0000","last_change":"2023-12-19T05:42:10.944932+0000","last_active":"2023-12-19T05:42:12.027204+0000","last_peered":"2023-12-19T05:42:12.027204+0000","last_clean":"2023-12-19T05:42:12.027204+0000","last_became_active":"2023-12-19T05:42:10.944690+0000","last_became_peered":"2023-12-19T05:42:10.944690+0000","last_unstale":"2023-12-19T05:42:12.027204+0000","last_undegraded":"2023-12-19T05:42:12.027204+0000","last_fullsized":"2023-12-19T05:42:12.027204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:26.300196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918329+0000","last_change":"2023-12-19T05:42:10.403590+0000","last_active":"2023-12-19T05:42:11.918329+0000","last_peered":"2023-12-19T05:42:11.918329+0000","last_clean":"2023-12-19T05:42:11.918329+0000","last_became_active":"2023-12-19T05:42:10.403129+0000","last_became_peered":"2023-12-19T05:42:10.403129+0000","last_unstale":"2023-12-19T05:42:11.918329+0000","last_undegraded":"2023-12-19T05:42:11.918329+0000","last_fullsized":"2023-12-19T05:42:11.918329+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:33.781371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918010+0000","last_change":"2023-12-19T05:42:10.942909+0000","last_active":"2023-12-19T05:42:11.918010+0000","last_peered":"2023-12-19T05:42:11.918010+0000","last_clean":"2023-12-19T05:42:11.918010+0000","last_became_active":"2023-12-19T05:42:10.942263+0000","last_became_peered":"2023-12-19T05:42:10.942263+0000","last_unstale":"2023-12-19T05:42:11.918010+0000","last_undegraded":"2023-12-19T05:42:11.918010+0000","last_fullsized":"2023-12-19T05:42:11.918010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:36:22.331638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028053+0000","last_change":"2023-12-19T05:42:10.416029+0000","last_active":"2023-12-19T05:42:12.028053+0000","last_peered":"2023-12-19T05:42:12.028053+0000","last_clean":"2023-12-19T05:42:12.028053+0000","last_became_active":"2023-12-19T05:42:10.415567+0000","last_became_peered":"2023-12-19T05:42:10.415567+0000","last_unstale":"2023-12-19T05:42:12.028053+0000","last_undegraded":"2023-12-19T05:42:12.028053+0000","last_fullsized":"2023-12-19T05:42:12.028053+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:18:22.364047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T05:42:10.923545+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:42:10.923545+0000","last_peered":"2023-12-19T05:42:10.923545+0000","last_clean":"2023-12-19T05:42:10.923545+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:42:10.923545+0000","last_undegraded":"2023-12-19T05:42:10.923545+0000","last_fullsized":"2023-12-19T05:42:10.923545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0329999999999999,"15min":1.018},"min":{"1min":0.74099999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0469999999999999,"15min":1.0429999999999999},"min":{"1min":0.71399999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.155}]},{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1060000000000001,"15min":1.056},"min":{"1min":0.79500000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.135,"15min":1.1519999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.351}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.2050000000000001,"15min":1.2310000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4099999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.325,"5min":1.655,"15min":1.655},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.1639999999999999,"15min":1.129},"min":{"1min":0.93600000000000005,"5min":0.622,"15min":0.622},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.087},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.2989999999999999,"15min":1.298},"min":{"1min":1,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6850000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.534}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0549999999999999,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4490000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.29},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.266,"15min":1.2390000000000001},"min":{"1min":0.83299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.1120000000000001,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.304},"min":{"1min":0.96499999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.23,"15min":1.2170000000000001},"min":{"1min":1.0589999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7629999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.486}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3440000000000001,"15min":1.304},"min":{"1min":1.22,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.569},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":1.171,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.1909999999999998,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.429}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642621,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.1819999999999999,"15min":1.266},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.581,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.026},"min":{"1min":0.67200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1559999999999999,"15min":1.135},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2889999999999999,"15min":1.333},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6850000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.089}]},{"osd":2,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1970000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.617,"5min":2,"15min":2},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2869999999999999,"15min":1.3260000000000001},"min":{"1min":0.749,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.9490000000000001,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":0.97299999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.3160000000000001,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.659,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.042},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.357,"15min":1.389},"min":{"1min":0.90400000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.847,"5min":4.452,"15min":4.452},"last":1.1120000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.3660000000000001},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0720000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.27},{"interface":"front","average":{"1min":1.214,"5min":1.4099999999999999,"15min":1.492},"min":{"1min":0.61499999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.702,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.2969999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5409999999999999,"15min":1.611},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.1480000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.6879999999999999,"15min":1.788},"min":{"1min":0.70699999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.21,"5min":3.681,"15min":3.681},"last":1.1830000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5009999999999999,"15min":1.5509999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.972,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.54},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.619,"15min":1.6359999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.02,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.7749999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194386,"statfs":{"total":200000000,"available":199052241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1379999999999999,"15min":1.123},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0620000000000001,"15min":1.099},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.595,"5min":2.641,"15min":2.641},"last":0.88100000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2270000000000001,"15min":1.2430000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6539999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":6.8700000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":1.4299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1919999999999999,"15min":1.242},"min":{"1min":0.77900000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.421,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2010000000000001,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.536,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.222}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4530000000000001,"15min":1.4850000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.234,"5min":1.3839999999999999,"15min":1.448},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.883,"5min":2.754,"15min":2.754},"last":1.1659999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4870000000000001,"15min":1.5389999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.581,"15min":1.643},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":7.0469999999999997,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.2869999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4630000000000001,"15min":1.53},"min":{"1min":0.70499999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7210000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.609,"15min":1.706},"min":{"1min":0.67600000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1739999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.333}]},{"osd":7,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.7030000000000001,"15min":1.7569999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.581,"15min":1.6299999999999999},"min":{"1min":0.77600000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.264}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194956,"statfs":{"total":200000000,"available":199635727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.67700000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.498,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.0529999999999999},"min":{"1min":0.78700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.01}]},{"osd":1,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.0549999999999999,"15min":1.052},"min":{"1min":0.78800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.0589999999999999,"15min":1.022},"min":{"1min":0.755,"5min":0.627,"15min":0.627},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.038}]},{"osd":2,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.79500000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.21,"15min":1.2050000000000001},"min":{"1min":0.91200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7390000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2849999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0780000000000001,"15min":1.046},"min":{"1min":0.86599999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.385,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.268,"15min":1.2789999999999999},"min":{"1min":1.022,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.609,"5min":1.758,"15min":1.758},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.647,"5min":1.792,"15min":1.792},"last":1.391},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2889999999999999,"15min":1.2629999999999999},"min":{"1min":0.94099999999999995,"5min":0.75,"15min":0.75},"max":{"1min":1.5569999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.365}]},{"osd":6,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.3580000000000001,"15min":1.3640000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.74,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.393,"15min":1.393},"min":{"1min":1.143,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.796,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.353,"15min":1.331},"min":{"1min":1.1870000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7629999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.236},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.456,"15min":1.452},"min":{"1min":1.071,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642553,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3879999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3280000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91000000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.702,"15min":2.702},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93000000000000005,"15min":0.92400000000000004},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4830000000000001,"5min":1.619,"15min":1.619},"last":1.0640000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.93400000000000005,"15min":0.89600000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4359999999999999,"5min":1.492,"15min":1.492},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0700000000000001,"15min":1.0449999999999999},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5680000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.95499999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.147,"15min":1.1479999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4910000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2929999999999999,"15min":1.29},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.708,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3049999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.776,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.351},{"interface":"front","average":{"1min":1.321,"5min":1.331,"15min":1.3360000000000001},"min":{"1min":0.77400000000000002,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9390000000000001,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.3779999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.825,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.3200000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.615,"5min":2.02,"15min":2.02},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3819999999999999,"15min":1.377},"min":{"1min":0.94199999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.665,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4179999999999999,"15min":1.4219999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8320000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.244}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194961,"statfs":{"total":200000000,"available":199640919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.42599999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.097,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.381},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.92100000000000004,"15min":0.89400000000000002},"min":{"1min":0.67500000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.9450000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.69799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3819999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.746,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.204}]},{"osd":3,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5660000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.335},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0660000000000001,"15min":1.0529999999999999},"min":{"1min":0.58999999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5289999999999999,"5min":1.704,"15min":1.704},"last":1.516}]},{"osd":4,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.256,"15min":1.24},"min":{"1min":1.008,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.873,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.645},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.232,"15min":1.2150000000000001},"min":{"1min":0.95299999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.5760000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":1.006,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.8160000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.272,"15min":1.284},"min":{"1min":0.91300000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.282,"15min":1.276},"min":{"1min":0.97699999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.3149999999999999,"15min":1.2969999999999999},"min":{"1min":1.0509999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7889999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.7549999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.399,"15min":1.389},"min":{"1min":1.006,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":2.0640000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":1.0269999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.8400000000000001,"5min":2.714,"15min":2.714},"last":1.994}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":926,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194386,"statfs":{"total":200000000,"available":199051693,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92100000000000004,"15min":0.94299999999999995},"min":{"1min":0.56499999999999995,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.1110000000000002,"5min":2.992,"15min":2.992},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.016,"15min":1.0389999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.742,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":4.7960000000000003,"5min":1.8109999999999999,"15min":1.327},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":70.206000000000003,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.71599999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.748},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.222,"15min":1.2290000000000001},"min":{"1min":0.57899999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":0.93000000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":5.3860000000000001,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.365,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3480000000000001,"15min":1.3360000000000001},"min":{"1min":0.93100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3799999999999999,"15min":1.347},"min":{"1min":0.96799999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.0629999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.4279999999999999,"15min":1.4059999999999999},"min":{"1min":1.0780000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":5.1429999999999998,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.4279999999999999,"15min":1.4099999999999999},"min":{"1min":1.03,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.75,"5min":3.75,"15min":3.75},"last":0.997}]},{"osd":7,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":1.5600000000000001,"15min":1.5189999999999999},"min":{"1min":1.256,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":8.4039999999999999,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.613,"15min":1.597},"min":{"1min":0.97799999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":8.2390000000000008,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194961,"statfs":{"total":200000000,"available":199641079,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80000000000000004,"15min":0.77700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3069999999999999,"5min":1.427,"15min":1.427},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.141},"min":{"1min":0.627,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.3}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4590000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.038,"15min":1.0409999999999999},"min":{"1min":0.56899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5569999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.464}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.143},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.804,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5549999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.298,"15min":1.298},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.2689999999999999,"15min":1.2609999999999999},"min":{"1min":0.86299999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.248}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3520000000000001,"15min":1.375},"min":{"1min":0.85299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.657},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.27,"15min":1.256},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.998}]},{"osd":7,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3959999999999999,"15min":1.399},"min":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.351,"15min":1.351},"min":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7470000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.345}]}]}],"pool_statfs":[]}} 2023-12-19T05:42:15.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:42:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.183+0000 7f12cd7dc640 1 Processor -- start 2023-12-19T05:42:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.183+0000 7f12cd7dc640 1 -- start start 2023-12-19T05:42:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12cd7dc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12c815e5a0 0x7f12c80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12cd7dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815f680 0x7f12c80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12cd7dc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c815ec30 con 0x7f12c80cdbf0 2023-12-19T05:42:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12cd7dc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80b2cc0 con 0x7f12c815e5a0 2023-12-19T05:42:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12cd7dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c815e980 con 0x7f12c815f680 2023-12-19T05:42:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12ccfdb640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12c80cdbf0 0x7f12c806c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49432/0 (socket says 172.21.15.49:49432) 2023-12-19T05:42:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12ccfdb640 1 -- 172.21.15.49:0/69310870 learned_addr learned my addr 172.21.15.49:0/69310870 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.185+0000 7f12c7fff640 1 --2- 172.21.15.49:0/69310870 >> v2:172.21.15.115:3300/0 conn(0x7f12c815e5a0 0x7f12c80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c77fe640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815f680 0x7f12c80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c6ffd640 1 -- 172.21.15.49:0/69310870 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690880982 0 0) 0x7f12c815ec30 con 0x7f12c80cdbf0 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c6ffd640 1 -- 172.21.15.49:0/69310870 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b0003520 con 0x7f12c80cdbf0 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c7fff640 1 -- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815f680 msgr2=0x7f12c80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c7fff640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815f680 0x7f12c80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c7fff640 1 -- 172.21.15.49:0/69310870 >> v1:172.21.15.49:6789/0 conn(0x7f12c80cdbf0 legacy=0x7f12c806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.186+0000 7f12c7fff640 1 -- 172.21.15.49:0/69310870 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80b2f90 con 0x7f12c815e5a0 2023-12-19T05:42:16.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.188+0000 7f12c7fff640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815e5a0 0x7f12c80b2030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12b80097a0 tx=0x7f12b802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8337ea578b16d5ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.188+0000 7f12c6ffd640 1 -- 172.21.15.49:0/69310870 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b802d040 con 0x7f12c815e5a0 2023-12-19T05:42:16.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.188+0000 7f12c6ffd640 1 -- 172.21.15.49:0/69310870 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8031810 con 0x7f12c815e5a0 2023-12-19T05:42:16.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.188+0000 7f12c6ffd640 1 -- 172.21.15.49:0/69310870 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8031ba0 con 0x7f12c815e5a0 2023-12-19T05:42:16.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 -- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815e5a0 msgr2=0x7f12c80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815e5a0 0x7f12c80b2030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12b80097a0 tx=0x7f12b802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 -- 172.21.15.49:0/69310870 shutdown_connections 2023-12-19T05:42:16.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815f680 0x7f12c80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/69310870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815e5a0 0x7f12c80b2030 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 -- 172.21.15.49:0/69310870 >> 172.21.15.49:0/69310870 conn(0x7f12c80b0100 msgr2=0x7f12c80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:16.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 -- 172.21.15.49:0/69310870 shutdown_connections 2023-12-19T05:42:16.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.189+0000 7f12cd7dc640 1 -- 172.21.15.49:0/69310870 wait complete. 2023-12-19T05:42:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.191+0000 7f12cd7dc640 1 Processor -- start 2023-12-19T05:42:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.191+0000 7f12cd7dc640 1 -- start start 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815e5a0 0x7f12c81439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815f680 0x7f12c81514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81f7020 con 0x7f12c80cdbf0 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80cba80 con 0x7f12c815f680 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.192+0000 7f12cd7dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c814f950 con 0x7f12c815e5a0 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48364/0 (socket says 172.21.15.49:48364) 2023-12-19T05:42:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 -- 172.21.15.49:0/3606684945 learned_addr learned my addr 172.21.15.49:0/3606684945 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12ccfdb640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815f680 0x7f12c81514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 -- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815e5a0 msgr2=0x7f12c81439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815e5a0 0x7f12c81439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 -- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815f680 msgr2=0x7f12c81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815f680 0x7f12c81514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.193+0000 7f12c7fff640 1 -- 172.21.15.49:0/3606684945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009400 con 0x7f12c80cdbf0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12c7fff640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f12b8000c00 tx=0x7f12b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b803ad60 con 0x7f12c80cdbf0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b80443f0 con 0x7f12c80cdbf0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b80445a0 con 0x7f12c80cdbf0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c814fc30 con 0x7f12c80cdbf0 2023-12-19T05:42:16.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.194+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c814ff10 con 0x7f12c80cdbf0 2023-12-19T05:42:16.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.195+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c8061910 con 0x7f12c80cdbf0 2023-12-19T05:42:16.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.196+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12b804d450 con 0x7f12c80cdbf0 2023-12-19T05:42:16.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.198+0000 7f12c4ff9640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.198+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12b80aac70 con 0x7f12c80cdbf0 2023-12-19T05:42:16.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.198+0000 7f12c77fe640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.199+0000 7f12c77fe640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12bc006e80 tx=0x7f12bc006dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.202+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12b80761c0 con 0x7f12c80cdbf0 2023-12-19T05:42:16.368 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-12-19T05:42:16.366+0000 7fe1db1a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:42:16.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.392+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12c80cda80 con 0x7f12b406a430 2023-12-19T05:42:16.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.414+0000 7f12c4ff9640 1 -- 172.21.15.49:0/3606684945 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282876 (secure 0 0 0) 0x7f12c80cda80 con 0x7f12b406a430 2023-12-19T05:42:16.421 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:16.422 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 msgr2=0x7f12b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12bc006e80 tx=0x7f12bc006dd0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 msgr2=0x7f12c81f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f12b8000c00 tx=0x7f12b80046c0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 shutdown_connections 2023-12-19T05:42:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c815e5a0 0x7f12c81439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c815f680 0x7f12c81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 --2- 172.21.15.49:0/3606684945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c80cdbf0 0x7f12c81f6ae0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.419+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 >> 172.21.15.49:0/3606684945 conn(0x7f12c80b0100 msgr2=0x7f12c80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.420+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 shutdown_connections 2023-12-19T05:42:16.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.420+0000 7f12cd7dc640 1 -- 172.21.15.49:0/3606684945 wait complete. 2023-12-19T05:42:16.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-12-19T05:42:14.565666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3955,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558544,"statfs":{"total":1600000000,"available":1595949384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.187412"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026931+0000","last_change":"2023-12-19T05:42:10.943219+0000","last_active":"2023-12-19T05:42:12.026931+0000","last_peered":"2023-12-19T05:42:12.026931+0000","last_clean":"2023-12-19T05:42:12.026931+0000","last_became_active":"2023-12-19T05:42:10.941150+0000","last_became_peered":"2023-12-19T05:42:10.941150+0000","last_unstale":"2023-12-19T05:42:12.026931+0000","last_undegraded":"2023-12-19T05:42:12.026931+0000","last_fullsized":"2023-12-19T05:42:12.026931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028280+0000","last_change":"2023-12-19T05:42:10.949394+0000","last_active":"2023-12-19T05:42:12.028280+0000","last_peered":"2023-12-19T05:42:12.028280+0000","last_clean":"2023-12-19T05:42:12.028280+0000","last_became_active":"2023-12-19T05:42:10.947830+0000","last_became_peered":"2023-12-19T05:42:10.947830+0000","last_unstale":"2023-12-19T05:42:12.028280+0000","last_undegraded":"2023-12-19T05:42:12.028280+0000","last_fullsized":"2023-12-19T05:42:12.028280+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:53.244333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025270+0000","last_change":"2023-12-19T05:42:10.924088+0000","last_active":"2023-12-19T05:42:12.025270+0000","last_peered":"2023-12-19T05:42:12.025270+0000","last_clean":"2023-12-19T05:42:12.025270+0000","last_became_active":"2023-12-19T05:42:10.923880+0000","last_became_peered":"2023-12-19T05:42:10.923880+0000","last_unstale":"2023-12-19T05:42:12.025270+0000","last_undegraded":"2023-12-19T05:42:12.025270+0000","last_fullsized":"2023-12-19T05:42:12.025270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:08.354253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915042+0000","last_change":"2023-12-19T05:42:10.948050+0000","last_active":"2023-12-19T05:42:11.915042+0000","last_peered":"2023-12-19T05:42:11.915042+0000","last_clean":"2023-12-19T05:42:11.915042+0000","last_became_active":"2023-12-19T05:42:10.947736+0000","last_became_peered":"2023-12-19T05:42:10.947736+0000","last_unstale":"2023-12-19T05:42:11.915042+0000","last_undegraded":"2023-12-19T05:42:11.915042+0000","last_fullsized":"2023-12-19T05:42:11.915042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:44:47.749572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027460+0000","last_change":"2023-12-19T05:42:10.942956+0000","last_active":"2023-12-19T05:42:12.027460+0000","last_peered":"2023-12-19T05:42:12.027460+0000","last_clean":"2023-12-19T05:42:12.027460+0000","last_became_active":"2023-12-19T05:42:10.940259+0000","last_became_peered":"2023-12-19T05:42:10.940259+0000","last_unstale":"2023-12-19T05:42:12.027460+0000","last_undegraded":"2023-12-19T05:42:12.027460+0000","last_fullsized":"2023-12-19T05:42:12.027460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027143+0000","last_change":"2023-12-19T05:42:10.948090+0000","last_active":"2023-12-19T05:42:12.027143+0000","last_peered":"2023-12-19T05:42:12.027143+0000","last_clean":"2023-12-19T05:42:12.027143+0000","last_became_active":"2023-12-19T05:42:10.946965+0000","last_became_peered":"2023-12-19T05:42:10.946965+0000","last_unstale":"2023-12-19T05:42:12.027143+0000","last_undegraded":"2023-12-19T05:42:12.027143+0000","last_fullsized":"2023-12-19T05:42:12.027143+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:10.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915278+0000","last_change":"2023-12-19T05:42:10.917511+0000","last_active":"2023-12-19T05:42:11.915278+0000","last_peered":"2023-12-19T05:42:11.915278+0000","last_clean":"2023-12-19T05:42:11.915278+0000","last_became_active":"2023-12-19T05:42:10.917215+0000","last_became_peered":"2023-12-19T05:42:10.917215+0000","last_unstale":"2023-12-19T05:42:11.915278+0000","last_undegraded":"2023-12-19T05:42:11.915278+0000","last_fullsized":"2023-12-19T05:42:11.915278+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:11.075549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918319+0000","last_change":"2023-12-19T05:42:10.930625+0000","last_active":"2023-12-19T05:42:11.918319+0000","last_peered":"2023-12-19T05:42:11.918319+0000","last_clean":"2023-12-19T05:42:11.918319+0000","last_became_active":"2023-12-19T05:42:10.928376+0000","last_became_peered":"2023-12-19T05:42:10.928376+0000","last_unstale":"2023-12-19T05:42:11.918319+0000","last_undegraded":"2023-12-19T05:42:11.918319+0000","last_fullsized":"2023-12-19T05:42:11.918319+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:17.167835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028489+0000","last_change":"2023-12-19T05:42:10.947478+0000","last_active":"2023-12-19T05:42:12.028489+0000","last_peered":"2023-12-19T05:42:12.028489+0000","last_clean":"2023-12-19T05:42:12.028489+0000","last_became_active":"2023-12-19T05:42:10.946985+0000","last_became_peered":"2023-12-19T05:42:10.946985+0000","last_unstale":"2023-12-19T05:42:12.028489+0000","last_undegraded":"2023-12-19T05:42:12.028489+0000","last_fullsized":"2023-12-19T05:42:12.028489+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:59.368096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027718+0000","last_change":"2023-12-19T05:42:10.941279+0000","last_active":"2023-12-19T05:42:12.027718+0000","last_peered":"2023-12-19T05:42:12.027718+0000","last_clean":"2023-12-19T05:42:12.027718+0000","last_became_active":"2023-12-19T05:42:10.939458+0000","last_became_peered":"2023-12-19T05:42:10.939458+0000","last_unstale":"2023-12-19T05:42:12.027718+0000","last_undegraded":"2023-12-19T05:42:12.027718+0000","last_fullsized":"2023-12-19T05:42:12.027718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:15:39.558421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918689+0000","last_change":"2023-12-19T05:42:10.947262+0000","last_active":"2023-12-19T05:42:11.918689+0000","last_peered":"2023-12-19T05:42:11.918689+0000","last_clean":"2023-12-19T05:42:11.918689+0000","last_became_active":"2023-12-19T05:42:10.945948+0000","last_became_peered":"2023-12-19T05:42:10.945948+0000","last_unstale":"2023-12-19T05:42:11.918689+0000","last_undegraded":"2023-12-19T05:42:11.918689+0000","last_fullsized":"2023-12-19T05:42:11.918689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:13.264122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027836+0000","last_change":"2023-12-19T05:42:10.926725+0000","last_active":"2023-12-19T05:42:12.027836+0000","last_peered":"2023-12-19T05:42:12.027836+0000","last_clean":"2023-12-19T05:42:12.027836+0000","last_became_active":"2023-12-19T05:42:10.926506+0000","last_became_peered":"2023-12-19T05:42:10.926506+0000","last_unstale":"2023-12-19T05:42:12.027836+0000","last_undegraded":"2023-12-19T05:42:12.027836+0000","last_fullsized":"2023-12-19T05:42:12.027836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:00:58.500050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026872+0000","last_change":"2023-12-19T05:42:10.944677+0000","last_active":"2023-12-19T05:42:12.026872+0000","last_peered":"2023-12-19T05:42:12.026872+0000","last_clean":"2023-12-19T05:42:12.026872+0000","last_became_active":"2023-12-19T05:42:10.944399+0000","last_became_peered":"2023-12-19T05:42:10.944399+0000","last_unstale":"2023-12-19T05:42:12.026872+0000","last_undegraded":"2023-12-19T05:42:12.026872+0000","last_fullsized":"2023-12-19T05:42:12.026872+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:26.033654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025183+0000","last_change":"2023-12-19T05:42:10.931446+0000","last_active":"2023-12-19T05:42:12.025183+0000","last_peered":"2023-12-19T05:42:12.025183+0000","last_clean":"2023-12-19T05:42:12.025183+0000","last_became_active":"2023-12-19T05:42:10.931012+0000","last_became_peered":"2023-12-19T05:42:10.931012+0000","last_unstale":"2023-12-19T05:42:12.025183+0000","last_undegraded":"2023-12-19T05:42:12.025183+0000","last_fullsized":"2023-12-19T05:42:12.025183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:34.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027571+0000","last_change":"2023-12-19T05:42:10.941297+0000","last_active":"2023-12-19T05:42:12.027571+0000","last_peered":"2023-12-19T05:42:12.027571+0000","last_clean":"2023-12-19T05:42:12.027571+0000","last_became_active":"2023-12-19T05:42:10.941100+0000","last_became_peered":"2023-12-19T05:42:10.941100+0000","last_unstale":"2023-12-19T05:42:12.027571+0000","last_undegraded":"2023-12-19T05:42:12.027571+0000","last_fullsized":"2023-12-19T05:42:12.027571+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027362+0000","last_change":"2023-12-19T05:42:10.942818+0000","last_active":"2023-12-19T05:42:12.027362+0000","last_peered":"2023-12-19T05:42:12.027362+0000","last_clean":"2023-12-19T05:42:12.027362+0000","last_became_active":"2023-12-19T05:42:10.940704+0000","last_became_peered":"2023-12-19T05:42:10.940704+0000","last_unstale":"2023-12-19T05:42:12.027362+0000","last_undegraded":"2023-12-19T05:42:12.027362+0000","last_fullsized":"2023-12-19T05:42:12.027362+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026328+0000","last_change":"2023-12-19T05:42:10.939388+0000","last_active":"2023-12-19T05:42:12.026328+0000","last_peered":"2023-12-19T05:42:12.026328+0000","last_clean":"2023-12-19T05:42:12.026328+0000","last_became_active":"2023-12-19T05:42:10.939151+0000","last_became_peered":"2023-12-19T05:42:10.939151+0000","last_unstale":"2023-12-19T05:42:12.026328+0000","last_undegraded":"2023-12-19T05:42:12.026328+0000","last_fullsized":"2023-12-19T05:42:12.026328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:26.495325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025546+0000","last_change":"2023-12-19T05:42:10.942363+0000","last_active":"2023-12-19T05:42:12.025546+0000","last_peered":"2023-12-19T05:42:12.025546+0000","last_clean":"2023-12-19T05:42:12.025546+0000","last_became_active":"2023-12-19T05:42:10.942085+0000","last_became_peered":"2023-12-19T05:42:10.942085+0000","last_unstale":"2023-12-19T05:42:12.025546+0000","last_undegraded":"2023-12-19T05:42:12.025546+0000","last_fullsized":"2023-12-19T05:42:12.025546+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:14.157856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026210+0000","last_change":"2023-12-19T05:42:10.939726+0000","last_active":"2023-12-19T05:42:12.026210+0000","last_peered":"2023-12-19T05:42:12.026210+0000","last_clean":"2023-12-19T05:42:12.026210+0000","last_became_active":"2023-12-19T05:42:10.939457+0000","last_became_peered":"2023-12-19T05:42:10.939457+0000","last_unstale":"2023-12-19T05:42:12.026210+0000","last_undegraded":"2023-12-19T05:42:12.026210+0000","last_fullsized":"2023-12-19T05:42:12.026210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:21:28.061074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918006+0000","last_change":"2023-12-19T05:42:10.947505+0000","last_active":"2023-12-19T05:42:11.918006+0000","last_peered":"2023-12-19T05:42:11.918006+0000","last_clean":"2023-12-19T05:42:11.918006+0000","last_became_active":"2023-12-19T05:42:10.945886+0000","last_became_peered":"2023-12-19T05:42:10.945886+0000","last_unstale":"2023-12-19T05:42:11.918006+0000","last_undegraded":"2023-12-19T05:42:11.918006+0000","last_fullsized":"2023-12-19T05:42:11.918006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:53.403055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026645+0000","last_change":"2023-12-19T05:42:10.926522+0000","last_active":"2023-12-19T05:42:12.026645+0000","last_peered":"2023-12-19T05:42:12.026645+0000","last_clean":"2023-12-19T05:42:12.026645+0000","last_became_active":"2023-12-19T05:42:10.926314+0000","last_became_peered":"2023-12-19T05:42:10.926314+0000","last_unstale":"2023-12-19T05:42:12.026645+0000","last_undegraded":"2023-12-19T05:42:12.026645+0000","last_fullsized":"2023-12-19T05:42:12.026645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919369+0000","last_change":"2023-12-19T05:42:10.951933+0000","last_active":"2023-12-19T05:42:11.919369+0000","last_peered":"2023-12-19T05:42:11.919369+0000","last_clean":"2023-12-19T05:42:11.919369+0000","last_became_active":"2023-12-19T05:42:10.951209+0000","last_became_peered":"2023-12-19T05:42:10.951209+0000","last_unstale":"2023-12-19T05:42:11.919369+0000","last_undegraded":"2023-12-19T05:42:11.919369+0000","last_fullsized":"2023-12-19T05:42:11.919369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:29.609872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915071+0000","last_change":"2023-12-19T05:42:10.939896+0000","last_active":"2023-12-19T05:42:11.915071+0000","last_peered":"2023-12-19T05:42:11.915071+0000","last_clean":"2023-12-19T05:42:11.915071+0000","last_became_active":"2023-12-19T05:42:10.939668+0000","last_became_peered":"2023-12-19T05:42:10.939668+0000","last_unstale":"2023-12-19T05:42:11.915071+0000","last_undegraded":"2023-12-19T05:42:11.915071+0000","last_fullsized":"2023-12-19T05:42:11.915071+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:34.871331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027535+0000","last_change":"2023-12-19T05:42:10.947612+0000","last_active":"2023-12-19T05:42:12.027535+0000","last_peered":"2023-12-19T05:42:12.027535+0000","last_clean":"2023-12-19T05:42:12.027535+0000","last_became_active":"2023-12-19T05:42:10.947285+0000","last_became_peered":"2023-12-19T05:42:10.947285+0000","last_unstale":"2023-12-19T05:42:12.027535+0000","last_undegraded":"2023-12-19T05:42:12.027535+0000","last_fullsized":"2023-12-19T05:42:12.027535+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:09:11.913410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027420+0000","last_change":"2023-12-19T05:42:10.944865+0000","last_active":"2023-12-19T05:42:12.027420+0000","last_peered":"2023-12-19T05:42:12.027420+0000","last_clean":"2023-12-19T05:42:12.027420+0000","last_became_active":"2023-12-19T05:42:10.944443+0000","last_became_peered":"2023-12-19T05:42:10.944443+0000","last_unstale":"2023-12-19T05:42:12.027420+0000","last_undegraded":"2023-12-19T05:42:12.027420+0000","last_fullsized":"2023-12-19T05:42:12.027420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:02:00.145468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027272+0000","last_change":"2023-12-19T05:42:10.930127+0000","last_active":"2023-12-19T05:42:12.027272+0000","last_peered":"2023-12-19T05:42:12.027272+0000","last_clean":"2023-12-19T05:42:12.027272+0000","last_became_active":"2023-12-19T05:42:10.929895+0000","last_became_peered":"2023-12-19T05:42:10.929895+0000","last_unstale":"2023-12-19T05:42:12.027272+0000","last_undegraded":"2023-12-19T05:42:12.027272+0000","last_fullsized":"2023-12-19T05:42:12.027272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:08.354253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028686+0000","last_change":"2023-12-19T05:42:10.948145+0000","last_active":"2023-12-19T05:42:12.028686+0000","last_peered":"2023-12-19T05:42:12.028686+0000","last_clean":"2023-12-19T05:42:12.028686+0000","last_became_active":"2023-12-19T05:42:10.946128+0000","last_became_peered":"2023-12-19T05:42:10.946128+0000","last_unstale":"2023-12-19T05:42:12.028686+0000","last_undegraded":"2023-12-19T05:42:12.028686+0000","last_fullsized":"2023-12-19T05:42:12.028686+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:45:40.490434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918580+0000","last_change":"2023-12-19T05:42:10.937896+0000","last_active":"2023-12-19T05:42:11.918580+0000","last_peered":"2023-12-19T05:42:11.918580+0000","last_clean":"2023-12-19T05:42:11.918580+0000","last_became_active":"2023-12-19T05:42:10.936850+0000","last_became_peered":"2023-12-19T05:42:10.936850+0000","last_unstale":"2023-12-19T05:42:11.918580+0000","last_undegraded":"2023-12-19T05:42:11.918580+0000","last_fullsized":"2023-12-19T05:42:11.918580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:10.022246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917225+0000","last_change":"2023-12-19T05:42:10.929657+0000","last_active":"2023-12-19T05:42:11.917225+0000","last_peered":"2023-12-19T05:42:11.917225+0000","last_clean":"2023-12-19T05:42:11.917225+0000","last_became_active":"2023-12-19T05:42:10.928076+0000","last_became_peered":"2023-12-19T05:42:10.928076+0000","last_unstale":"2023-12-19T05:42:11.917225+0000","last_undegraded":"2023-12-19T05:42:11.917225+0000","last_fullsized":"2023-12-19T05:42:11.917225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:00:59.002998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.916510+0000","last_change":"2023-12-19T05:42:10.927202+0000","last_active":"2023-12-19T05:42:11.916510+0000","last_peered":"2023-12-19T05:42:11.916510+0000","last_clean":"2023-12-19T05:42:11.916510+0000","last_became_active":"2023-12-19T05:42:10.926936+0000","last_became_peered":"2023-12-19T05:42:10.926936+0000","last_unstale":"2023-12-19T05:42:11.916510+0000","last_undegraded":"2023-12-19T05:42:11.916510+0000","last_fullsized":"2023-12-19T05:42:11.916510+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:40.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027846+0000","last_change":"2023-12-19T05:42:10.942635+0000","last_active":"2023-12-19T05:42:12.027846+0000","last_peered":"2023-12-19T05:42:12.027846+0000","last_clean":"2023-12-19T05:42:12.027846+0000","last_became_active":"2023-12-19T05:42:10.942129+0000","last_became_peered":"2023-12-19T05:42:10.942129+0000","last_unstale":"2023-12-19T05:42:12.027846+0000","last_undegraded":"2023-12-19T05:42:12.027846+0000","last_fullsized":"2023-12-19T05:42:12.027846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:43.385666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919637+0000","last_change":"2023-12-19T05:42:10.951795+0000","last_active":"2023-12-19T05:42:11.919637+0000","last_peered":"2023-12-19T05:42:11.919637+0000","last_clean":"2023-12-19T05:42:11.919637+0000","last_became_active":"2023-12-19T05:42:10.950810+0000","last_became_peered":"2023-12-19T05:42:10.950810+0000","last_unstale":"2023-12-19T05:42:11.919637+0000","last_undegraded":"2023-12-19T05:42:11.919637+0000","last_fullsized":"2023-12-19T05:42:11.919637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:40.254303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026925+0000","last_change":"2023-12-19T05:42:10.946945+0000","last_active":"2023-12-19T05:42:12.026925+0000","last_peered":"2023-12-19T05:42:12.026925+0000","last_clean":"2023-12-19T05:42:12.026925+0000","last_became_active":"2023-12-19T05:42:10.944480+0000","last_became_peered":"2023-12-19T05:42:10.944480+0000","last_unstale":"2023-12-19T05:42:12.026925+0000","last_undegraded":"2023-12-19T05:42:12.026925+0000","last_fullsized":"2023-12-19T05:42:12.026925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:38.694511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917655+0000","last_change":"2023-12-19T05:42:10.411844+0000","last_active":"2023-12-19T05:42:11.917655+0000","last_peered":"2023-12-19T05:42:11.917655+0000","last_clean":"2023-12-19T05:42:11.917655+0000","last_became_active":"2023-12-19T05:42:10.411597+0000","last_became_peered":"2023-12-19T05:42:10.411597+0000","last_unstale":"2023-12-19T05:42:11.917655+0000","last_undegraded":"2023-12-19T05:42:11.917655+0000","last_fullsized":"2023-12-19T05:42:11.917655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:25.017638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026517+0000","last_change":"2023-12-19T05:42:10.947610+0000","last_active":"2023-12-19T05:42:12.026517+0000","last_peered":"2023-12-19T05:42:12.026517+0000","last_clean":"2023-12-19T05:42:12.026517+0000","last_became_active":"2023-12-19T05:42:10.947377+0000","last_became_peered":"2023-12-19T05:42:10.947377+0000","last_unstale":"2023-12-19T05:42:12.026517+0000","last_undegraded":"2023-12-19T05:42:12.026517+0000","last_fullsized":"2023-12-19T05:42:12.026517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:19:11.924625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026462+0000","last_change":"2023-12-19T05:42:10.414466+0000","last_active":"2023-12-19T05:42:12.026462+0000","last_peered":"2023-12-19T05:42:12.026462+0000","last_clean":"2023-12-19T05:42:12.026462+0000","last_became_active":"2023-12-19T05:42:10.413900+0000","last_became_peered":"2023-12-19T05:42:10.413900+0000","last_unstale":"2023-12-19T05:42:12.026462+0000","last_undegraded":"2023-12-19T05:42:12.026462+0000","last_fullsized":"2023-12-19T05:42:12.026462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:32:28.568994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917778+0000","last_change":"2023-12-19T05:42:10.943065+0000","last_active":"2023-12-19T05:42:11.917778+0000","last_peered":"2023-12-19T05:42:11.917778+0000","last_clean":"2023-12-19T05:42:11.917778+0000","last_became_active":"2023-12-19T05:42:10.942631+0000","last_became_peered":"2023-12-19T05:42:10.942631+0000","last_unstale":"2023-12-19T05:42:11.917778+0000","last_undegraded":"2023-12-19T05:42:11.917778+0000","last_fullsized":"2023-12-19T05:42:11.917778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:28.905709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028253+0000","last_change":"2023-12-19T05:42:10.414950+0000","last_active":"2023-12-19T05:42:12.028253+0000","last_peered":"2023-12-19T05:42:12.028253+0000","last_clean":"2023-12-19T05:42:12.028253+0000","last_became_active":"2023-12-19T05:42:10.412665+0000","last_became_peered":"2023-12-19T05:42:10.412665+0000","last_unstale":"2023-12-19T05:42:12.028253+0000","last_undegraded":"2023-12-19T05:42:12.028253+0000","last_fullsized":"2023-12-19T05:42:12.028253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:25.284181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028113+0000","last_change":"2023-12-19T05:42:10.943183+0000","last_active":"2023-12-19T05:42:12.028113+0000","last_peered":"2023-12-19T05:42:12.028113+0000","last_clean":"2023-12-19T05:42:12.028113+0000","last_became_active":"2023-12-19T05:42:10.940981+0000","last_became_peered":"2023-12-19T05:42:10.940981+0000","last_unstale":"2023-12-19T05:42:12.028113+0000","last_undegraded":"2023-12-19T05:42:12.028113+0000","last_fullsized":"2023-12-19T05:42:12.028113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:13:13.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915617+0000","last_change":"2023-12-19T05:42:10.409734+0000","last_active":"2023-12-19T05:42:11.915617+0000","last_peered":"2023-12-19T05:42:11.915617+0000","last_clean":"2023-12-19T05:42:11.915617+0000","last_became_active":"2023-12-19T05:42:10.409424+0000","last_became_peered":"2023-12-19T05:42:10.409424+0000","last_unstale":"2023-12-19T05:42:11.915617+0000","last_undegraded":"2023-12-19T05:42:11.915617+0000","last_fullsized":"2023-12-19T05:42:11.915617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:09.006231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918818+0000","last_change":"2023-12-19T05:42:10.938093+0000","last_active":"2023-12-19T05:42:11.918818+0000","last_peered":"2023-12-19T05:42:11.918818+0000","last_clean":"2023-12-19T05:42:11.918818+0000","last_became_active":"2023-12-19T05:42:10.937514+0000","last_became_peered":"2023-12-19T05:42:10.937514+0000","last_unstale":"2023-12-19T05:42:11.918818+0000","last_undegraded":"2023-12-19T05:42:11.918818+0000","last_fullsized":"2023-12-19T05:42:11.918818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:10:21.493570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026324+0000","last_change":"2023-12-19T05:42:10.414350+0000","last_active":"2023-12-19T05:42:12.026324+0000","last_peered":"2023-12-19T05:42:12.026324+0000","last_clean":"2023-12-19T05:42:12.026324+0000","last_became_active":"2023-12-19T05:42:10.414093+0000","last_became_peered":"2023-12-19T05:42:10.414093+0000","last_unstale":"2023-12-19T05:42:12.026324+0000","last_undegraded":"2023-12-19T05:42:12.026324+0000","last_fullsized":"2023-12-19T05:42:12.026324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:42.369651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.920037+0000","last_change":"2023-12-19T05:42:10.951642+0000","last_active":"2023-12-19T05:42:11.920037+0000","last_peered":"2023-12-19T05:42:11.920037+0000","last_clean":"2023-12-19T05:42:11.920037+0000","last_became_active":"2023-12-19T05:42:10.950459+0000","last_became_peered":"2023-12-19T05:42:10.950459+0000","last_unstale":"2023-12-19T05:42:11.920037+0000","last_undegraded":"2023-12-19T05:42:11.920037+0000","last_fullsized":"2023-12-19T05:42:11.920037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:15:39.558421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025975+0000","last_change":"2023-12-19T05:42:10.409932+0000","last_active":"2023-12-19T05:42:12.025975+0000","last_peered":"2023-12-19T05:42:12.025975+0000","last_clean":"2023-12-19T05:42:12.025975+0000","last_became_active":"2023-12-19T05:42:10.408193+0000","last_became_peered":"2023-12-19T05:42:10.408193+0000","last_unstale":"2023-12-19T05:42:12.025975+0000","last_undegraded":"2023-12-19T05:42:12.025975+0000","last_fullsized":"2023-12-19T05:42:12.025975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:59.129453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025814+0000","last_change":"2023-12-19T05:42:10.918687+0000","last_active":"2023-12-19T05:42:12.025814+0000","last_peered":"2023-12-19T05:42:12.025814+0000","last_clean":"2023-12-19T05:42:12.025814+0000","last_became_active":"2023-12-19T05:42:10.918469+0000","last_became_peered":"2023-12-19T05:42:10.918469+0000","last_unstale":"2023-12-19T05:42:12.025814+0000","last_undegraded":"2023-12-19T05:42:12.025814+0000","last_fullsized":"2023-12-19T05:42:12.025814+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:10.333850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028712+0000","last_change":"2023-12-19T05:42:10.413102+0000","last_active":"2023-12-19T05:42:12.028712+0000","last_peered":"2023-12-19T05:42:12.028712+0000","last_clean":"2023-12-19T05:42:12.028712+0000","last_became_active":"2023-12-19T05:42:10.412792+0000","last_became_peered":"2023-12-19T05:42:10.412792+0000","last_unstale":"2023-12-19T05:42:12.028712+0000","last_undegraded":"2023-12-19T05:42:12.028712+0000","last_fullsized":"2023-12-19T05:42:12.028712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:47:41.179015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027465+0000","last_change":"2023-12-19T05:42:10.946637+0000","last_active":"2023-12-19T05:42:12.027465+0000","last_peered":"2023-12-19T05:42:12.027465+0000","last_clean":"2023-12-19T05:42:12.027465+0000","last_became_active":"2023-12-19T05:42:10.942592+0000","last_became_peered":"2023-12-19T05:42:10.942592+0000","last_unstale":"2023-12-19T05:42:12.027465+0000","last_undegraded":"2023-12-19T05:42:12.027465+0000","last_fullsized":"2023-12-19T05:42:12.027465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:32.908378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027784+0000","last_change":"2023-12-19T05:42:10.415841+0000","last_active":"2023-12-19T05:42:12.027784+0000","last_peered":"2023-12-19T05:42:12.027784+0000","last_clean":"2023-12-19T05:42:12.027784+0000","last_became_active":"2023-12-19T05:42:10.415111+0000","last_became_peered":"2023-12-19T05:42:10.415111+0000","last_unstale":"2023-12-19T05:42:12.027784+0000","last_undegraded":"2023-12-19T05:42:12.027784+0000","last_fullsized":"2023-12-19T05:42:12.027784+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:59.129453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027020+0000","last_change":"2023-12-19T05:42:10.946748+0000","last_active":"2023-12-19T05:42:12.027020+0000","last_peered":"2023-12-19T05:42:12.027020+0000","last_clean":"2023-12-19T05:42:12.027020+0000","last_became_active":"2023-12-19T05:42:10.946533+0000","last_became_peered":"2023-12-19T05:42:10.946533+0000","last_unstale":"2023-12-19T05:42:12.027020+0000","last_undegraded":"2023-12-19T05:42:12.027020+0000","last_fullsized":"2023-12-19T05:42:12.027020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028560+0000","last_change":"2023-12-19T05:42:10.414051+0000","last_active":"2023-12-19T05:42:12.028560+0000","last_peered":"2023-12-19T05:42:12.028560+0000","last_clean":"2023-12-19T05:42:12.028560+0000","last_became_active":"2023-12-19T05:42:10.413677+0000","last_became_peered":"2023-12-19T05:42:10.413677+0000","last_unstale":"2023-12-19T05:42:12.028560+0000","last_undegraded":"2023-12-19T05:42:12.028560+0000","last_fullsized":"2023-12-19T05:42:12.028560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:40:00.009959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025563+0000","last_change":"2023-12-19T05:42:10.921818+0000","last_active":"2023-12-19T05:42:12.025563+0000","last_peered":"2023-12-19T05:42:12.025563+0000","last_clean":"2023-12-19T05:42:12.025563+0000","last_became_active":"2023-12-19T05:42:10.921257+0000","last_became_peered":"2023-12-19T05:42:10.921257+0000","last_unstale":"2023-12-19T05:42:12.025563+0000","last_undegraded":"2023-12-19T05:42:12.025563+0000","last_fullsized":"2023-12-19T05:42:12.025563+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:26.033654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917528+0000","last_change":"2023-12-19T05:42:10.414166+0000","last_active":"2023-12-19T05:42:11.917528+0000","last_peered":"2023-12-19T05:42:11.917528+0000","last_clean":"2023-12-19T05:42:11.917528+0000","last_became_active":"2023-12-19T05:42:10.411147+0000","last_became_peered":"2023-12-19T05:42:10.411147+0000","last_unstale":"2023-12-19T05:42:11.917528+0000","last_undegraded":"2023-12-19T05:42:11.917528+0000","last_fullsized":"2023-12-19T05:42:11.917528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:35:13.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917465+0000","last_change":"2023-12-19T05:42:10.944281+0000","last_active":"2023-12-19T05:42:11.917465+0000","last_peered":"2023-12-19T05:42:11.917465+0000","last_clean":"2023-12-19T05:42:11.917465+0000","last_became_active":"2023-12-19T05:42:10.944031+0000","last_became_peered":"2023-12-19T05:42:10.944031+0000","last_unstale":"2023-12-19T05:42:11.917465+0000","last_undegraded":"2023-12-19T05:42:11.917465+0000","last_fullsized":"2023-12-19T05:42:11.917465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:56.132627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"69'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915473+0000","last_change":"2023-12-19T05:42:10.410737+0000","last_active":"2023-12-19T05:42:11.915473+0000","last_peered":"2023-12-19T05:42:11.915473+0000","last_clean":"2023-12-19T05:42:11.915473+0000","last_became_active":"2023-12-19T05:42:10.410441+0000","last_became_peered":"2023-12-19T05:42:10.410441+0000","last_unstale":"2023-12-19T05:42:11.915473+0000","last_undegraded":"2023-12-19T05:42:11.915473+0000","last_fullsized":"2023-12-19T05:42:11.915473+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:36:24.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915336+0000","last_change":"2023-12-19T05:42:10.926319+0000","last_active":"2023-12-19T05:42:11.915336+0000","last_peered":"2023-12-19T05:42:11.915336+0000","last_clean":"2023-12-19T05:42:11.915336+0000","last_became_active":"2023-12-19T05:42:10.926164+0000","last_became_peered":"2023-12-19T05:42:10.926164+0000","last_unstale":"2023-12-19T05:42:11.915336+0000","last_undegraded":"2023-12-19T05:42:11.915336+0000","last_fullsized":"2023-12-19T05:42:11.915336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:17:31.725856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"69'6","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026681+0000","last_change":"2023-12-19T05:42:10.411086+0000","last_active":"2023-12-19T05:42:12.026681+0000","last_peered":"2023-12-19T05:42:12.026681+0000","last_clean":"2023-12-19T05:42:12.026681+0000","last_became_active":"2023-12-19T05:42:10.409118+0000","last_became_peered":"2023-12-19T05:42:10.409118+0000","last_unstale":"2023-12-19T05:42:12.026681+0000","last_undegraded":"2023-12-19T05:42:12.026681+0000","last_fullsized":"2023-12-19T05:42:12.026681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:30.395041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028434+0000","last_change":"2023-12-19T05:42:10.941481+0000","last_active":"2023-12-19T05:42:12.028434+0000","last_peered":"2023-12-19T05:42:12.028434+0000","last_clean":"2023-12-19T05:42:12.028434+0000","last_became_active":"2023-12-19T05:42:10.941237+0000","last_became_peered":"2023-12-19T05:42:10.941237+0000","last_unstale":"2023-12-19T05:42:12.028434+0000","last_undegraded":"2023-12-19T05:42:12.028434+0000","last_fullsized":"2023-12-19T05:42:12.028434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:20:09.549204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919027+0000","last_change":"2023-12-19T05:42:10.412799+0000","last_active":"2023-12-19T05:42:11.919027+0000","last_peered":"2023-12-19T05:42:11.919027+0000","last_clean":"2023-12-19T05:42:11.919027+0000","last_became_active":"2023-12-19T05:42:10.412409+0000","last_became_peered":"2023-12-19T05:42:10.412409+0000","last_unstale":"2023-12-19T05:42:11.919027+0000","last_undegraded":"2023-12-19T05:42:11.919027+0000","last_fullsized":"2023-12-19T05:42:11.919027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:48.686227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026102+0000","last_change":"2023-12-19T05:42:10.923730+0000","last_active":"2023-12-19T05:42:12.026102+0000","last_peered":"2023-12-19T05:42:12.026102+0000","last_clean":"2023-12-19T05:42:12.026102+0000","last_became_active":"2023-12-19T05:42:10.923445+0000","last_became_peered":"2023-12-19T05:42:10.923445+0000","last_unstale":"2023-12-19T05:42:12.026102+0000","last_undegraded":"2023-12-19T05:42:12.026102+0000","last_fullsized":"2023-12-19T05:42:12.026102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:38.694511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915707+0000","last_change":"2023-12-19T05:42:10.411288+0000","last_active":"2023-12-19T05:42:11.915707+0000","last_peered":"2023-12-19T05:42:11.915707+0000","last_clean":"2023-12-19T05:42:11.915707+0000","last_became_active":"2023-12-19T05:42:10.410745+0000","last_became_peered":"2023-12-19T05:42:10.410745+0000","last_unstale":"2023-12-19T05:42:11.915707+0000","last_undegraded":"2023-12-19T05:42:11.915707+0000","last_fullsized":"2023-12-19T05:42:11.915707+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:27.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028243+0000","last_change":"2023-12-19T05:42:10.930644+0000","last_active":"2023-12-19T05:42:12.028243+0000","last_peered":"2023-12-19T05:42:12.028243+0000","last_clean":"2023-12-19T05:42:12.028243+0000","last_became_active":"2023-12-19T05:42:10.929083+0000","last_became_peered":"2023-12-19T05:42:10.929083+0000","last_unstale":"2023-12-19T05:42:12.028243+0000","last_undegraded":"2023-12-19T05:42:12.028243+0000","last_fullsized":"2023-12-19T05:42:12.028243+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:06:26.979337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915524+0000","last_change":"2023-12-19T05:42:10.406248+0000","last_active":"2023-12-19T05:42:11.915524+0000","last_peered":"2023-12-19T05:42:11.915524+0000","last_clean":"2023-12-19T05:42:11.915524+0000","last_became_active":"2023-12-19T05:42:10.405484+0000","last_became_peered":"2023-12-19T05:42:10.405484+0000","last_unstale":"2023-12-19T05:42:11.915524+0000","last_undegraded":"2023-12-19T05:42:11.915524+0000","last_fullsized":"2023-12-19T05:42:11.915524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:00:57.986983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915410+0000","last_change":"2023-12-19T05:42:10.946848+0000","last_active":"2023-12-19T05:42:11.915410+0000","last_peered":"2023-12-19T05:42:11.915410+0000","last_clean":"2023-12-19T05:42:11.915410+0000","last_became_active":"2023-12-19T05:42:10.946609+0000","last_became_peered":"2023-12-19T05:42:10.946609+0000","last_unstale":"2023-12-19T05:42:11.915410+0000","last_undegraded":"2023-12-19T05:42:11.915410+0000","last_fullsized":"2023-12-19T05:42:11.915410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:21:49.298369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915650+0000","last_change":"2023-12-19T05:42:10.406946+0000","last_active":"2023-12-19T05:42:11.915650+0000","last_peered":"2023-12-19T05:42:11.915650+0000","last_clean":"2023-12-19T05:42:11.915650+0000","last_became_active":"2023-12-19T05:42:10.406697+0000","last_became_peered":"2023-12-19T05:42:10.406697+0000","last_unstale":"2023-12-19T05:42:11.915650+0000","last_undegraded":"2023-12-19T05:42:11.915650+0000","last_fullsized":"2023-12-19T05:42:11.915650+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:02:20.519533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026386+0000","last_change":"2023-12-19T05:42:10.937030+0000","last_active":"2023-12-19T05:42:12.026386+0000","last_peered":"2023-12-19T05:42:12.026386+0000","last_clean":"2023-12-19T05:42:12.026386+0000","last_became_active":"2023-12-19T05:42:10.936761+0000","last_became_peered":"2023-12-19T05:42:10.936761+0000","last_unstale":"2023-12-19T05:42:12.026386+0000","last_undegraded":"2023-12-19T05:42:12.026386+0000","last_fullsized":"2023-12-19T05:42:12.026386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:34:26.495325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026745+0000","last_change":"2023-12-19T05:42:10.414648+0000","last_active":"2023-12-19T05:42:12.026745+0000","last_peered":"2023-12-19T05:42:12.026745+0000","last_clean":"2023-12-19T05:42:12.026745+0000","last_became_active":"2023-12-19T05:42:10.414223+0000","last_became_peered":"2023-12-19T05:42:10.414223+0000","last_unstale":"2023-12-19T05:42:12.026745+0000","last_undegraded":"2023-12-19T05:42:12.026745+0000","last_fullsized":"2023-12-19T05:42:12.026745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:35:07.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025289+0000","last_change":"2023-12-19T05:42:10.931589+0000","last_active":"2023-12-19T05:42:12.025289+0000","last_peered":"2023-12-19T05:42:12.025289+0000","last_clean":"2023-12-19T05:42:12.025289+0000","last_became_active":"2023-12-19T05:42:10.931279+0000","last_became_peered":"2023-12-19T05:42:10.931279+0000","last_unstale":"2023-12-19T05:42:12.025289+0000","last_undegraded":"2023-12-19T05:42:12.025289+0000","last_fullsized":"2023-12-19T05:42:12.025289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:26:06.824452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919234+0000","last_change":"2023-12-19T05:42:10.412649+0000","last_active":"2023-12-19T05:42:11.919234+0000","last_peered":"2023-12-19T05:42:11.919234+0000","last_clean":"2023-12-19T05:42:11.919234+0000","last_became_active":"2023-12-19T05:42:10.411570+0000","last_became_peered":"2023-12-19T05:42:10.411570+0000","last_unstale":"2023-12-19T05:42:11.919234+0000","last_undegraded":"2023-12-19T05:42:11.919234+0000","last_fullsized":"2023-12-19T05:42:11.919234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:25.017638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028907+0000","last_change":"2023-12-19T05:42:10.949185+0000","last_active":"2023-12-19T05:42:12.028907+0000","last_peered":"2023-12-19T05:42:12.028907+0000","last_clean":"2023-12-19T05:42:12.028907+0000","last_became_active":"2023-12-19T05:42:10.947470+0000","last_became_peered":"2023-12-19T05:42:10.947470+0000","last_unstale":"2023-12-19T05:42:12.028907+0000","last_undegraded":"2023-12-19T05:42:12.028907+0000","last_fullsized":"2023-12-19T05:42:12.028907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:24.220462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025738+0000","last_change":"2023-12-19T05:42:10.413991+0000","last_active":"2023-12-19T05:42:12.025738+0000","last_peered":"2023-12-19T05:42:12.025738+0000","last_clean":"2023-12-19T05:42:12.025738+0000","last_became_active":"2023-12-19T05:42:10.413544+0000","last_became_peered":"2023-12-19T05:42:10.413544+0000","last_unstale":"2023-12-19T05:42:12.025738+0000","last_undegraded":"2023-12-19T05:42:12.025738+0000","last_fullsized":"2023-12-19T05:42:12.025738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:17.100935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.915483+0000","last_change":"2023-12-19T05:42:10.941963+0000","last_active":"2023-12-19T05:42:11.915483+0000","last_peered":"2023-12-19T05:42:11.915483+0000","last_clean":"2023-12-19T05:42:11.915483+0000","last_became_active":"2023-12-19T05:42:10.941731+0000","last_became_peered":"2023-12-19T05:42:10.941731+0000","last_unstale":"2023-12-19T05:42:11.915483+0000","last_undegraded":"2023-12-19T05:42:11.915483+0000","last_fullsized":"2023-12-19T05:42:11.915483+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:35.107441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917763+0000","last_change":"2023-12-19T05:42:10.406649+0000","last_active":"2023-12-19T05:42:11.917763+0000","last_peered":"2023-12-19T05:42:11.917763+0000","last_clean":"2023-12-19T05:42:11.917763+0000","last_became_active":"2023-12-19T05:42:10.404131+0000","last_became_peered":"2023-12-19T05:42:10.404131+0000","last_unstale":"2023-12-19T05:42:11.917763+0000","last_undegraded":"2023-12-19T05:42:11.917763+0000","last_fullsized":"2023-12-19T05:42:11.917763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:08.875821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028039+0000","last_change":"2023-12-19T05:42:10.944171+0000","last_active":"2023-12-19T05:42:12.028039+0000","last_peered":"2023-12-19T05:42:12.028039+0000","last_clean":"2023-12-19T05:42:12.028039+0000","last_became_active":"2023-12-19T05:42:10.943927+0000","last_became_peered":"2023-12-19T05:42:10.943927+0000","last_unstale":"2023-12-19T05:42:12.028039+0000","last_undegraded":"2023-12-19T05:42:12.028039+0000","last_fullsized":"2023-12-19T05:42:12.028039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:25.280684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917894+0000","last_change":"2023-12-19T05:42:10.412768+0000","last_active":"2023-12-19T05:42:11.917894+0000","last_peered":"2023-12-19T05:42:11.917894+0000","last_clean":"2023-12-19T05:42:11.917894+0000","last_became_active":"2023-12-19T05:42:10.412094+0000","last_became_peered":"2023-12-19T05:42:10.412094+0000","last_unstale":"2023-12-19T05:42:11.917894+0000","last_undegraded":"2023-12-19T05:42:11.917894+0000","last_fullsized":"2023-12-19T05:42:11.917894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:48.686227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.919212+0000","last_change":"2023-12-19T05:42:10.937208+0000","last_active":"2023-12-19T05:42:11.919212+0000","last_peered":"2023-12-19T05:42:11.919212+0000","last_clean":"2023-12-19T05:42:11.919212+0000","last_became_active":"2023-12-19T05:42:10.934380+0000","last_became_peered":"2023-12-19T05:42:10.934380+0000","last_unstale":"2023-12-19T05:42:11.919212+0000","last_undegraded":"2023-12-19T05:42:11.919212+0000","last_fullsized":"2023-12-19T05:42:11.919212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:57:27.120594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918142+0000","last_change":"2023-12-19T05:42:10.414336+0000","last_active":"2023-12-19T05:42:11.918142+0000","last_peered":"2023-12-19T05:42:11.918142+0000","last_clean":"2023-12-19T05:42:11.918142+0000","last_became_active":"2023-12-19T05:42:10.414042+0000","last_became_peered":"2023-12-19T05:42:10.414042+0000","last_unstale":"2023-12-19T05:42:11.918142+0000","last_undegraded":"2023-12-19T05:42:11.918142+0000","last_fullsized":"2023-12-19T05:42:11.918142+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:07.338238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918813+0000","last_change":"2023-12-19T05:42:10.932119+0000","last_active":"2023-12-19T05:42:11.918813+0000","last_peered":"2023-12-19T05:42:11.918813+0000","last_clean":"2023-12-19T05:42:11.918813+0000","last_became_active":"2023-12-19T05:42:10.931648+0000","last_became_peered":"2023-12-19T05:42:10.931648+0000","last_unstale":"2023-12-19T05:42:11.918813+0000","last_undegraded":"2023-12-19T05:42:11.918813+0000","last_fullsized":"2023-12-19T05:42:11.918813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:59.659219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028663+0000","last_change":"2023-12-19T05:42:10.411494+0000","last_active":"2023-12-19T05:42:12.028663+0000","last_peered":"2023-12-19T05:42:12.028663+0000","last_clean":"2023-12-19T05:42:12.028663+0000","last_became_active":"2023-12-19T05:42:10.410205+0000","last_became_peered":"2023-12-19T05:42:10.410205+0000","last_unstale":"2023-12-19T05:42:12.028663+0000","last_undegraded":"2023-12-19T05:42:12.028663+0000","last_fullsized":"2023-12-19T05:42:12.028663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:05:59.468815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.025817+0000","last_change":"2023-12-19T05:42:10.939437+0000","last_active":"2023-12-19T05:42:12.025817+0000","last_peered":"2023-12-19T05:42:12.025817+0000","last_clean":"2023-12-19T05:42:12.025817+0000","last_became_active":"2023-12-19T05:42:10.939187+0000","last_became_peered":"2023-12-19T05:42:10.939187+0000","last_unstale":"2023-12-19T05:42:12.025817+0000","last_undegraded":"2023-12-19T05:42:12.025817+0000","last_fullsized":"2023-12-19T05:42:12.025817+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:49.702242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.029320+0000","last_change":"2023-12-19T05:42:10.411819+0000","last_active":"2023-12-19T05:42:12.029320+0000","last_peered":"2023-12-19T05:42:12.029320+0000","last_clean":"2023-12-19T05:42:12.029320+0000","last_became_active":"2023-12-19T05:42:10.411515+0000","last_became_peered":"2023-12-19T05:42:10.411515+0000","last_unstale":"2023-12-19T05:42:12.029320+0000","last_undegraded":"2023-12-19T05:42:12.029320+0000","last_fullsized":"2023-12-19T05:42:12.029320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:24.264669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026078+0000","last_change":"2023-12-19T05:42:10.918596+0000","last_active":"2023-12-19T05:42:12.026078+0000","last_peered":"2023-12-19T05:42:12.026078+0000","last_clean":"2023-12-19T05:42:12.026078+0000","last_became_active":"2023-12-19T05:42:10.918028+0000","last_became_peered":"2023-12-19T05:42:10.918028+0000","last_unstale":"2023-12-19T05:42:12.026078+0000","last_undegraded":"2023-12-19T05:42:12.026078+0000","last_fullsized":"2023-12-19T05:42:12.026078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:09.891836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026249+0000","last_change":"2023-12-19T05:42:10.408647+0000","last_active":"2023-12-19T05:42:12.026249+0000","last_peered":"2023-12-19T05:42:12.026249+0000","last_clean":"2023-12-19T05:42:12.026249+0000","last_became_active":"2023-12-19T05:42:10.407590+0000","last_became_peered":"2023-12-19T05:42:10.407590+0000","last_unstale":"2023-12-19T05:42:12.026249+0000","last_undegraded":"2023-12-19T05:42:12.026249+0000","last_fullsized":"2023-12-19T05:42:12.026249+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:40:52.228317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027677+0000","last_change":"2023-12-19T05:42:10.941337+0000","last_active":"2023-12-19T05:42:12.027677+0000","last_peered":"2023-12-19T05:42:12.027677+0000","last_clean":"2023-12-19T05:42:12.027677+0000","last_became_active":"2023-12-19T05:42:10.941092+0000","last_became_peered":"2023-12-19T05:42:10.941092+0000","last_unstale":"2023-12-19T05:42:12.027677+0000","last_undegraded":"2023-12-19T05:42:12.027677+0000","last_fullsized":"2023-12-19T05:42:12.027677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:18.116950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028926+0000","last_change":"2023-12-19T05:42:10.407335+0000","last_active":"2023-12-19T05:42:12.028926+0000","last_peered":"2023-12-19T05:42:12.028926+0000","last_clean":"2023-12-19T05:42:12.028926+0000","last_became_active":"2023-12-19T05:42:10.407021+0000","last_became_peered":"2023-12-19T05:42:10.407021+0000","last_unstale":"2023-12-19T05:42:12.028926+0000","last_undegraded":"2023-12-19T05:42:12.028926+0000","last_fullsized":"2023-12-19T05:42:12.028926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:51.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917713+0000","last_change":"2023-12-19T05:42:10.934160+0000","last_active":"2023-12-19T05:42:11.917713+0000","last_peered":"2023-12-19T05:42:11.917713+0000","last_clean":"2023-12-19T05:42:11.917713+0000","last_became_active":"2023-12-19T05:42:10.928941+0000","last_became_peered":"2023-12-19T05:42:10.928941+0000","last_unstale":"2023-12-19T05:42:11.917713+0000","last_undegraded":"2023-12-19T05:42:11.917713+0000","last_fullsized":"2023-12-19T05:42:11.917713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:36:25.444855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026618+0000","last_change":"2023-12-19T05:42:10.413301+0000","last_active":"2023-12-19T05:42:12.026618+0000","last_peered":"2023-12-19T05:42:12.026618+0000","last_clean":"2023-12-19T05:42:12.026618+0000","last_became_active":"2023-12-19T05:42:10.408323+0000","last_became_peered":"2023-12-19T05:42:10.408323+0000","last_unstale":"2023-12-19T05:42:12.026618+0000","last_undegraded":"2023-12-19T05:42:12.026618+0000","last_fullsized":"2023-12-19T05:42:12.026618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:21:27.045059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026666+0000","last_change":"2023-12-19T05:42:10.950132+0000","last_active":"2023-12-19T05:42:12.026666+0000","last_peered":"2023-12-19T05:42:12.026666+0000","last_clean":"2023-12-19T05:42:12.026666+0000","last_became_active":"2023-12-19T05:42:10.949843+0000","last_became_peered":"2023-12-19T05:42:10.949843+0000","last_unstale":"2023-12-19T05:42:12.026666+0000","last_undegraded":"2023-12-19T05:42:12.026666+0000","last_fullsized":"2023-12-19T05:42:12.026666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:16:49.725520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028061+0000","last_change":"2023-12-19T05:42:10.417466+0000","last_active":"2023-12-19T05:42:12.028061+0000","last_peered":"2023-12-19T05:42:12.028061+0000","last_clean":"2023-12-19T05:42:12.028061+0000","last_became_active":"2023-12-19T05:42:10.417237+0000","last_became_peered":"2023-12-19T05:42:10.417237+0000","last_unstale":"2023-12-19T05:42:12.028061+0000","last_undegraded":"2023-12-19T05:42:12.028061+0000","last_fullsized":"2023-12-19T05:42:12.028061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:44.144397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027362+0000","last_change":"2023-12-19T05:42:10.928467+0000","last_active":"2023-12-19T05:42:12.027362+0000","last_peered":"2023-12-19T05:42:12.027362+0000","last_clean":"2023-12-19T05:42:12.027362+0000","last_became_active":"2023-12-19T05:42:10.928253+0000","last_became_peered":"2023-12-19T05:42:10.928253+0000","last_unstale":"2023-12-19T05:42:12.027362+0000","last_undegraded":"2023-12-19T05:42:12.027362+0000","last_fullsized":"2023-12-19T05:42:12.027362+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:34.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026552+0000","last_change":"2023-12-19T05:42:10.413452+0000","last_active":"2023-12-19T05:42:12.026552+0000","last_peered":"2023-12-19T05:42:12.026552+0000","last_clean":"2023-12-19T05:42:12.026552+0000","last_became_active":"2023-12-19T05:42:10.413016+0000","last_became_peered":"2023-12-19T05:42:10.413016+0000","last_unstale":"2023-12-19T05:42:12.026552+0000","last_undegraded":"2023-12-19T05:42:12.026552+0000","last_fullsized":"2023-12-19T05:42:12.026552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:23.204447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.917942+0000","last_change":"2023-12-19T05:42:10.936376+0000","last_active":"2023-12-19T05:42:11.917942+0000","last_peered":"2023-12-19T05:42:11.917942+0000","last_clean":"2023-12-19T05:42:11.917942+0000","last_became_active":"2023-12-19T05:42:10.934596+0000","last_became_peered":"2023-12-19T05:42:10.934596+0000","last_unstale":"2023-12-19T05:42:11.917942+0000","last_undegraded":"2023-12-19T05:42:11.917942+0000","last_fullsized":"2023-12-19T05:42:11.917942+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:02:21.535548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.026786+0000","last_change":"2023-12-19T05:42:10.413807+0000","last_active":"2023-12-19T05:42:12.026786+0000","last_peered":"2023-12-19T05:42:12.026786+0000","last_clean":"2023-12-19T05:42:12.026786+0000","last_became_active":"2023-12-19T05:42:10.413483+0000","last_became_peered":"2023-12-19T05:42:10.413483+0000","last_unstale":"2023-12-19T05:42:12.026786+0000","last_undegraded":"2023-12-19T05:42:12.026786+0000","last_fullsized":"2023-12-19T05:42:12.026786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:17.100935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.027204+0000","last_change":"2023-12-19T05:42:10.944932+0000","last_active":"2023-12-19T05:42:12.027204+0000","last_peered":"2023-12-19T05:42:12.027204+0000","last_clean":"2023-12-19T05:42:12.027204+0000","last_became_active":"2023-12-19T05:42:10.944690+0000","last_became_peered":"2023-12-19T05:42:10.944690+0000","last_unstale":"2023-12-19T05:42:12.027204+0000","last_undegraded":"2023-12-19T05:42:12.027204+0000","last_fullsized":"2023-12-19T05:42:12.027204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:26.300196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918329+0000","last_change":"2023-12-19T05:42:10.403590+0000","last_active":"2023-12-19T05:42:11.918329+0000","last_peered":"2023-12-19T05:42:11.918329+0000","last_clean":"2023-12-19T05:42:11.918329+0000","last_became_active":"2023-12-19T05:42:10.403129+0000","last_became_peered":"2023-12-19T05:42:10.403129+0000","last_unstale":"2023-12-19T05:42:11.918329+0000","last_undegraded":"2023-12-19T05:42:11.918329+0000","last_fullsized":"2023-12-19T05:42:11.918329+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:50:33.781371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:11.918010+0000","last_change":"2023-12-19T05:42:10.942909+0000","last_active":"2023-12-19T05:42:11.918010+0000","last_peered":"2023-12-19T05:42:11.918010+0000","last_clean":"2023-12-19T05:42:11.918010+0000","last_became_active":"2023-12-19T05:42:10.942263+0000","last_became_peered":"2023-12-19T05:42:10.942263+0000","last_unstale":"2023-12-19T05:42:11.918010+0000","last_undegraded":"2023-12-19T05:42:11.918010+0000","last_fullsized":"2023-12-19T05:42:11.918010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:10.375828+0000","last_clean_scrub_stamp":"2023-12-19T05:42:10.375828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:36:22.331638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-19T05:42:12.028053+0000","last_change":"2023-12-19T05:42:10.416029+0000","last_active":"2023-12-19T05:42:12.028053+0000","last_peered":"2023-12-19T05:42:12.028053+0000","last_clean":"2023-12-19T05:42:12.028053+0000","last_became_active":"2023-12-19T05:42:10.415567+0000","last_became_peered":"2023-12-19T05:42:10.415567+0000","last_unstale":"2023-12-19T05:42:12.028053+0000","last_undegraded":"2023-12-19T05:42:12.028053+0000","last_fullsized":"2023-12-19T05:42:12.028053+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:42:09.359812+0000","last_clean_scrub_stamp":"2023-12-19T05:42:09.359812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:18:22.364047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T05:42:10.923545+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:42:10.923545+0000","last_peered":"2023-12-19T05:42:10.923545+0000","last_clean":"2023-12-19T05:42:10.923545+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:42:10.923545+0000","last_undegraded":"2023-12-19T05:42:10.923545+0000","last_fullsized":"2023-12-19T05:42:10.923545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0329999999999999,"15min":1.018},"min":{"1min":0.74099999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0469999999999999,"15min":1.0429999999999999},"min":{"1min":0.71399999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.155}]},{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1060000000000001,"15min":1.056},"min":{"1min":0.79500000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.135,"15min":1.1519999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.351}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.2050000000000001,"15min":1.2310000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4099999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.325,"5min":1.655,"15min":1.655},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.1639999999999999,"15min":1.129},"min":{"1min":0.93600000000000005,"5min":0.622,"15min":0.622},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.087},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.2989999999999999,"15min":1.298},"min":{"1min":1,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6850000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.534}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0549999999999999,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4490000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.29},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.266,"15min":1.2390000000000001},"min":{"1min":0.83299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.1120000000000001,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.304},"min":{"1min":0.96499999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.23,"15min":1.2170000000000001},"min":{"1min":1.0589999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7629999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.486}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3440000000000001,"15min":1.304},"min":{"1min":1.22,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.569},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":1.171,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.1909999999999998,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.429}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642621,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.1819999999999999,"15min":1.266},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.581,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.026},"min":{"1min":0.67200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1559999999999999,"15min":1.135},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2889999999999999,"15min":1.333},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6850000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.089}]},{"osd":2,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1970000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.617,"5min":2,"15min":2},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2869999999999999,"15min":1.3260000000000001},"min":{"1min":0.749,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.9490000000000001,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":0.97299999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.3160000000000001,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.659,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.042},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.357,"15min":1.389},"min":{"1min":0.90400000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.847,"5min":4.452,"15min":4.452},"last":1.1120000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3400000000000001,"15min":1.3660000000000001},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.0720000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.27},{"interface":"front","average":{"1min":1.214,"5min":1.4099999999999999,"15min":1.492},"min":{"1min":0.61499999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.702,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.2969999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5409999999999999,"15min":1.611},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.1480000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.6879999999999999,"15min":1.788},"min":{"1min":0.70699999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.21,"5min":3.681,"15min":3.681},"last":1.1830000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5009999999999999,"15min":1.5509999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.972,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.54},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.619,"15min":1.6359999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.02,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.7749999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194386,"statfs":{"total":200000000,"available":199052241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1379999999999999,"15min":1.123},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0620000000000001,"15min":1.099},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.595,"5min":2.641,"15min":2.641},"last":0.88100000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2270000000000001,"15min":1.2430000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6539999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":6.8700000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":1.4299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1919999999999999,"15min":1.242},"min":{"1min":0.77900000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.421,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2010000000000001,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.536,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.222}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4530000000000001,"15min":1.4850000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.234,"5min":1.3839999999999999,"15min":1.448},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.883,"5min":2.754,"15min":2.754},"last":1.1659999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4870000000000001,"15min":1.5389999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.581,"15min":1.643},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":7.0469999999999997,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.2869999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4630000000000001,"15min":1.53},"min":{"1min":0.70499999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7210000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.609,"15min":1.706},"min":{"1min":0.67600000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1739999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.333}]},{"osd":7,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.7030000000000001,"15min":1.7569999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.581,"15min":1.6299999999999999},"min":{"1min":0.77600000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.264}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194956,"statfs":{"total":200000000,"available":199635727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.67700000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.498,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.0529999999999999},"min":{"1min":0.78700000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.01}]},{"osd":1,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.0549999999999999,"15min":1.052},"min":{"1min":0.78800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.0589999999999999,"15min":1.022},"min":{"1min":0.755,"5min":0.627,"15min":0.627},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.038}]},{"osd":2,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.79500000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.21,"15min":1.2050000000000001},"min":{"1min":0.91200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7390000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2849999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0780000000000001,"15min":1.046},"min":{"1min":0.86599999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.385,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.268,"15min":1.2789999999999999},"min":{"1min":1.022,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.609,"5min":1.758,"15min":1.758},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.647,"5min":1.792,"15min":1.792},"last":1.391},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2889999999999999,"15min":1.2629999999999999},"min":{"1min":0.94099999999999995,"5min":0.75,"15min":0.75},"max":{"1min":1.5569999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.365}]},{"osd":6,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.3580000000000001,"15min":1.3640000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.74,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.393,"15min":1.393},"min":{"1min":1.143,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.796,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Dec 19 05:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.353,"15min":1.331},"min":{"1min":1.1870000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7629999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.236},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.456,"15min":1.452},"min":{"1min":1.071,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642553,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3879999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3280000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91000000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.702,"15min":2.702},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93000000000000005,"15min":0.92400000000000004},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4830000000000001,"5min":1.619,"15min":1.619},"last":1.0640000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.93400000000000005,"15min":0.89600000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4359999999999999,"5min":1.492,"15min":1.492},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0700000000000001,"15min":1.0449999999999999},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5680000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.95499999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.147,"15min":1.1479999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4910000000000001,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2929999999999999,"15min":1.29},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.708,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3049999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.776,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.351},{"interface":"front","average":{"1min":1.321,"5min":1.331,"15min":1.3360000000000001},"min":{"1min":0.77400000000000002,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9390000000000001,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.3779999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.825,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.3200000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.615,"5min":2.02,"15min":2.02},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:41:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3819999999999999,"15min":1.377},"min":{"1min":0.94199999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.665,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4179999999999999,"15min":1.4219999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8320000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.244}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194961,"statfs":{"total":200000000,"available":199640919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.42599999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.097,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.381},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.92100000000000004,"15min":0.89400000000000002},"min":{"1min":0.67500000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.9450000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.69799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3819999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.746,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.204}]},{"osd":3,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5660000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.335},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0660000000000001,"15min":1.0529999999999999},"min":{"1min":0.58999999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5289999999999999,"5min":1.704,"15min":1.704},"last":1.516}]},{"osd":4,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.256,"15min":1.24},"min":{"1min":1.008,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.873,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.645},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.232,"15min":1.2150000000000001},"min":{"1min":0.95299999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.5760000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":1.006,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.8160000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.272,"15min":1.284},"min":{"1min":0.91300000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.282,"15min":1.276},"min":{"1min":0.97699999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.3149999999999999,"15min":1.2969999999999999},"min":{"1min":1.0509999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7889999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.7549999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.399,"15min":1.389},"min":{"1min":1.006,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":2.0640000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":1.0269999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.8400000000000001,"5min":2.714,"15min":2.714},"last":1.994}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":926,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194386,"statfs":{"total":200000000,"available":199051693,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92100000000000004,"15min":0.94299999999999995},"min":{"1min":0.56499999999999995,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.1110000000000002,"5min":2.992,"15min":2.992},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.016,"15min":1.0389999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.742,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":4.7960000000000003,"5min":1.8109999999999999,"15min":1.327},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":70.206000000000003,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.71599999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.748},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.222,"15min":1.2290000000000001},"min":{"1min":0.57899999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":0.93000000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":5.3860000000000001,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.365,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3480000000000001,"15min":1.3360000000000001},"min":{"1min":0.93100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3799999999999999,"15min":1.347},"min":{"1min":0.96799999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.0629999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.4279999999999999,"15min":1.4059999999999999},"min":{"1min":1.0780000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":5.1429999999999998,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.4279999999999999,"15min":1.4099999999999999},"min":{"1min":1.03,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.75,"5min":3.75,"15min":3.75},"last":0.997}]},{"osd":7,"last update":"Tue Dec 19 05:41:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":1.5600000000000001,"15min":1.5189999999999999},"min":{"1min":1.256,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":8.4039999999999999,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.613,"15min":1.597},"min":{"1min":0.97799999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":8.2390000000000008,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194961,"statfs":{"total":200000000,"available":199641079,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80000000000000004,"15min":0.77700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3069999999999999,"5min":1.427,"15min":1.427},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.141},"min":{"1min":0.627,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.3}]},{"osd":3,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4590000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.038,"15min":1.0409999999999999},"min":{"1min":0.56899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5569999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.464}]},{"osd":4,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.143},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.804,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5549999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.298,"15min":1.298},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.2689999999999999,"15min":1.2609999999999999},"min":{"1min":0.86299999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.248}]},{"osd":6,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3520000000000001,"15min":1.375},"min":{"1min":0.85299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.657},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.27,"15min":1.256},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.998}]},{"osd":7,"last update":"Tue Dec 19 05:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3959999999999999,"15min":1.399},"min":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.351,"15min":1.351},"min":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7470000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.345}]}]}],"pool_statfs":[]}} 2023-12-19T05:42:16.443 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:42:16.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:42:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.728+0000 7f9b988a0640 1 Processor -- start 2023-12-19T05:42:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.728+0000 7f9b988a0640 1 -- start start 2023-12-19T05:42:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b988a0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 0x7f9b940b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b988a0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9b9415a2f0 0x7f9b940b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b988a0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b940d00f0 con 0x7f9b940b5dc0 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b988a0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9415aec0 con 0x7f9b9415a2f0 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b988a0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940aef90 con 0x7f9b94159f10 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b9359e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9b940b5dc0 0x7f9b940b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49448/0 (socket says 172.21.15.49:49448) 2023-12-19T05:42:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.730+0000 7f9b9359e640 1 -- 172.21.15.49:0/2799639365 learned_addr learned my addr 172.21.15.49:0/2799639365 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b8a59c640 1 --2- 172.21.15.49:0/2799639365 >> v2:172.21.15.115:3300/0 conn(0x7f9b9415a2f0 0x7f9b940b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 0x7f9b940b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387672567 0 0) 0x7f9b940d00f0 con 0x7f9b940b5dc0 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b80003520 con 0x7f9b940b5dc0 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033407440 0 0) 0x7f9b80003520 con 0x7f9b940b5dc0 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 msgr2=0x7f9b940b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 0x7f9b940b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 >> v2:172.21.15.115:3300/0 conn(0x7f9b9415a2f0 msgr2=0x7f9b940b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:16.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 --2- 172.21.15.49:0/2799639365 >> v2:172.21.15.115:3300/0 conn(0x7f9b9415a2f0 0x7f9b940b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940b1e90 con 0x7f9b940b5dc0 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.731+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9b8c0019f0 con 0x7f9b940b5dc0 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 >> v1:172.21.15.49:6789/0 conn(0x7f9b940b5dc0 legacy=0x7f9b940b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b80003970 0x7f9b80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 0x7f9b800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80004d00 0x7f9b80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9415aec0 con 0x7f9b80003970 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940aef90 con 0x7f9b80004d00 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8000db90 con 0x7f9b94159f10 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b80003970 0x7f9b80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 -- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 msgr2=0x7f9b800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b94159f10 0x7f9b800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 -- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80004d00 msgr2=0x7f9b80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:16.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80004d00 0x7f9b80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.732+0000 7f9b92d9d640 1 -- 172.21.15.49:0/2799639365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80003520 con 0x7f9b80003970 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.733+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b80003970 0x7f9b80003d90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009ac0 tx=0x7f9b800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee98ec70b935b0e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8402c710 con 0x7f9b80003970 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8402c870 con 0x7f9b80003970 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b9259c640 1 -- 172.21.15.49:0/2799639365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8402cc00 con 0x7f9b80003970 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b988a0640 1 -- 172.21.15.49:0/2799639365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b80003970 msgr2=0x7f9b80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2799639365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b80003970 0x7f9b80003d90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009ac0 tx=0x7f9b800057f0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b9359e640 1 -- 172.21.15.49:0/2799639365 reap_dead start 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b988a0640 1 -- 172.21.15.49:0/2799639365 shutdown_connections 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.734+0000 7f9b988a0640 1 -- 172.21.15.49:0/2799639365 >> 172.21.15.49:0/2799639365 conn(0x7f9b940b2c10 msgr2=0x7f9b940cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:16.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.735+0000 7f9b988a0640 1 -- 172.21.15.49:0/2799639365 shutdown_connections 2023-12-19T05:42:16.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.735+0000 7f9b988a0640 1 -- 172.21.15.49:0/2799639365 wait complete. 2023-12-19T05:42:16.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.736+0000 7f9b988a0640 1 Processor -- start 2023-12-19T05:42:16.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.737+0000 7f9b988a0640 1 -- start start 2023-12-19T05:42:16.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.737+0000 7f9b988a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 0x7f9b9414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.737+0000 7f9b988a0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 0x7f9b94150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.737+0000 7f9b988a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b988a0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9414dfe0 con 0x7f9b94150940 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b988a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9406ce30 con 0x7f9b80003970 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b988a0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9406d110 con 0x7f9b940ae7f0 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48390/0 (socket says 172.21.15.49:48390) 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 -- 172.21.15.49:0/2429847639 learned_addr learned my addr 172.21.15.49:0/2429847639 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b8a59c640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 0x7f9b94150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 0x7f9b9414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 -- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 msgr2=0x7f9b94150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 0x7f9b94150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 -- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 msgr2=0x7f9b9414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 0x7f9b9414daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b9359e640 1 -- 172.21.15.49:0/2429847639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9406d3f0 con 0x7f9b94150940 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 0x7f9b9414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.738+0000 7f9b8a59c640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 0x7f9b94150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b9359e640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9b94070d40 tx=0x7f9b8c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00a610 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00a770 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00ab20 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b940ac9c0 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.739+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b940acf80 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.740+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b940ad1a0 con 0x7f9b94150940 2023-12-19T05:42:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.741+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b8c00ac80 con 0x7f9b94150940 2023-12-19T05:42:16.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.742+0000 7f9b8bfff640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 0x7f9b7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:16.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.742+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b8c088260 con 0x7f9b94150940 2023-12-19T05:42:16.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.743+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 0x7f9b7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.744+0000 7f9b92d9d640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 0x7f9b7406c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b84036000 tx=0x7f9b84030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:16.746+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b8c053840 con 0x7f9b94150940 2023-12-19T05:42:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.014+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9b94061910 con 0x7f9b94150940 2023-12-19T05:42:17.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.022+0000 7f9b8bfff640 1 -- 172.21.15.49:0/2429847639 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9b8c01a0e0 con 0x7f9b94150940 2023-12-19T05:42:17.024 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:42:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 msgr2=0x7f9b7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 0x7f9b7406c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b84036000 tx=0x7f9b84030000 comp rx=0 tx=0).stop 2023-12-19T05:42:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 msgr2=0x7f9b94156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9b94070d40 tx=0x7f9b8c00ce80 comp rx=0 tx=0).stop 2023-12-19T05:42:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 shutdown_connections 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9b7406a430 0x7f9b7406c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b940ae7f0 0x7f9b94150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b94150940 0x7f9b94156480 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 --2- 172.21.15.49:0/2429847639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b80003970 0x7f9b9414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 >> 172.21.15.49:0/2429847639 conn(0x7f9b940b2c10 msgr2=0x7f9b9415cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 shutdown_connections 2023-12-19T05:42:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.025+0000 7f9b988a0640 1 -- 172.21.15.49:0/2429847639 wait complete. 2023-12-19T05:42:17.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:42:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.271+0000 7f20d25bf640 1 Processor -- start 2023-12-19T05:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.271+0000 7f20d25bf640 1 -- start start 2023-12-19T05:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d25bf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20cc0ce300 0x7f20cc15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d25bf640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc15ec30 con 0x7f20cc0b2030 2023-12-19T05:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d25bf640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc15fbc0 con 0x7f20cc15e5a0 2023-12-19T05:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d25bf640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc15e980 con 0x7f20cc0ce300 2023-12-19T05:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d1dbe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20cc0ce300 0x7f20cc15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d0dbc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20cc0b2030 0x7f20cc0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49464/0 (socket says 172.21.15.49:49464) 2023-12-19T05:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.273+0000 7f20d0dbc640 1 -- 172.21.15.49:0/1053001396 learned_addr learned my addr 172.21.15.49:0/1053001396 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.274+0000 7f20d1dbe640 1 -- 172.21.15.49:0/1053001396 >> v1:172.21.15.115:6789/0 conn(0x7f20cc15e5a0 legacy=0x7f20cc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.274+0000 7f20d1dbe640 1 -- 172.21.15.49:0/1053001396 >> v1:172.21.15.49:6789/0 conn(0x7f20cc0b2030 legacy=0x7f20cc0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.274+0000 7f20c3fff640 1 -- 172.21.15.49:0/1053001396 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505844038 0 0) 0x7f20cc15ec30 con 0x7f20cc0b2030 2023-12-19T05:42:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.274+0000 7f20d1dbe640 1 -- 172.21.15.49:0/1053001396 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0b2f90 con 0x7f20cc0ce300 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.275+0000 7f20d1dbe640 1 --2- 172.21.15.49:0/1053001396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0ce300 0x7f20cc15f680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009dc0 tx=0x7f20c402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fd829e7d20a2b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.275+0000 7f20c3fff640 1 -- 172.21.15.49:0/1053001396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c402cc40 con 0x7f20cc0ce300 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.275+0000 7f20c3fff640 1 -- 172.21.15.49:0/1053001396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c402cda0 con 0x7f20cc0ce300 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.275+0000 7f20c3fff640 1 -- 172.21.15.49:0/1053001396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4034660 con 0x7f20cc0ce300 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 -- 172.21.15.49:0/1053001396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0ce300 msgr2=0x7f20cc15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 --2- 172.21.15.49:0/1053001396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0ce300 0x7f20cc15f680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009dc0 tx=0x7f20c402be90 comp rx=0 tx=0).stop 2023-12-19T05:42:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 -- 172.21.15.49:0/1053001396 shutdown_connections 2023-12-19T05:42:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 --2- 172.21.15.49:0/1053001396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0ce300 0x7f20cc15f680 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 -- 172.21.15.49:0/1053001396 >> 172.21.15.49:0/1053001396 conn(0x7f20cc0b0100 msgr2=0x7f20cc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 -- 172.21.15.49:0/1053001396 shutdown_connections 2023-12-19T05:42:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.276+0000 7f20d25bf640 1 -- 172.21.15.49:0/1053001396 wait complete. 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.277+0000 7f20d25bf640 1 Processor -- start 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.278+0000 7f20d25bf640 1 -- start start 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20cc0ce300 0x7f20cc152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 0x7f20cc1f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1593a0 con 0x7f20cc0b2030 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc159680 con 0x7f20cc15e5a0 2023-12-19T05:42:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d25bf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc159960 con 0x7f20cc0ce300 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48418/0 (socket says 172.21.15.49:48418) 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 -- 172.21.15.49:0/2831184812 learned_addr learned my addr 172.21.15.49:0/2831184812 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 -- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20cc0ce300 msgr2=0x7f20cc152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d1dbe640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 0x7f20cc1f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d0dbc640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20cc0ce300 0x7f20cc152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20cc0ce300 0x7f20cc152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 -- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 msgr2=0x7f20cc1f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 0x7f20cc1f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d15bd640 1 -- 172.21.15.49:0/2831184812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4009a70 con 0x7f20cc0b2030 2023-12-19T05:42:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.279+0000 7f20d1dbe640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 0x7f20cc1f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20d15bd640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f20c800b3f0 tx=0x7f20c800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011830 con 0x7f20cc0b2030 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8011990 con 0x7f20cc0b2030 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011d40 con 0x7f20cc0b2030 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc159c40 con 0x7f20cc0b2030 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.280+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc153010 con 0x7f20cc0b2030 2023-12-19T05:42:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.281+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc15a160 con 0x7f20cc0b2030 2023-12-19T05:42:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.282+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20c801a400 con 0x7f20cc0b2030 2023-12-19T05:42:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.283+0000 7f20c1ffb640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 0x7f20b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.283+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20c8088830 con 0x7f20cc0b2030 2023-12-19T05:42:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.284+0000 7f20d0dbc640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 0x7f20b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.285+0000 7f20d0dbc640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 0x7f20b006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.288+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f20cc15a160 con 0x7f20cc0b2030 2023-12-19T05:42:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.524+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20cc15a160 con 0x7f20cc0b2030 2023-12-19T05:42:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.525+0000 7f20c1ffb640 1 -- 172.21.15.49:0/2831184812 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f20c8053e10 con 0x7f20cc0b2030 2023-12-19T05:42:17.527 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:17.527 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:42:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:42:17.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 msgr2=0x7f20b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 0x7f20b006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2023-12-19T05:42:17.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 msgr2=0x7f20cc06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:17.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f20c800b3f0 tx=0x7f20c800b8b0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 shutdown_connections 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f20b006a430 0x7f20b006c8f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20cc0ce300 0x7f20cc152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20cc15e5a0 0x7f20cc1f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 --2- 172.21.15.49:0/2831184812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20cc0b2030 0x7f20cc06d7a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 >> 172.21.15.49:0/2831184812 conn(0x7f20cc0b0100 msgr2=0x7f20cc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 shutdown_connections 2023-12-19T05:42:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:17.529+0000 7f20d25bf640 1 -- 172.21.15.49:0/2831184812 wait complete. 2023-12-19T05:42:17.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:42:10.905609+0000', 'modified': '2023-12-19T05:42:14.403210+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5431': {'gid': 5431, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/3371552330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 3371552330}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 3371552330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:42:17.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:42:17.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T05:42:18.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.193+0000 7f55d359e640 1 Processor -- start 2023-12-19T05:42:18.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.193+0000 7f55d359e640 1 -- start start 2023-12-19T05:42:18.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d4157710 0x7f55d40b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d40b0a00 0x7f55d4160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d359e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d415d7d0 con 0x7f55d40b2990 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d40b2ea0 con 0x7f55d40b0a00 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d415da90 con 0x7f55d4157710 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d40b0a00 0x7f55d4160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d40b0a00 0x7f55d4160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48432/0 (socket says 172.21.15.49:48432) 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.195+0000 7f55d2d9d640 1 -- 172.21.15.49:0/3952667034 learned_addr learned my addr 172.21.15.49:0/3952667034 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.196+0000 7f55d259c640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d4157710 0x7f55d40b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.196+0000 7f55d2d9d640 1 -- 172.21.15.49:0/3952667034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d4157710 msgr2=0x7f55d40b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.196+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d4157710 0x7f55d40b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.196+0000 7f55d2d9d640 1 -- 172.21.15.49:0/3952667034 >> v1:172.21.15.49:6789/0 conn(0x7f55d40b2990 legacy=0x7f55d40b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.196+0000 7f55d2d9d640 1 -- 172.21.15.49:0/3952667034 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d415dd70 con 0x7f55d40b0a00 2023-12-19T05:42:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.197+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d4160dc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009e50 tx=0x7f55cc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f577191c664aa5a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.197+0000 7f55d1d9b640 1 -- 172.21.15.49:0/3952667034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc02c9f0 con 0x7f55d40b0a00 2023-12-19T05:42:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.197+0000 7f55d1d9b640 1 -- 172.21.15.49:0/3952667034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc02cb50 con 0x7f55d40b0a00 2023-12-19T05:42:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.197+0000 7f55d1d9b640 1 -- 172.21.15.49:0/3952667034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0343f0 con 0x7f55d40b0a00 2023-12-19T05:42:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 -- 172.21.15.49:0/3952667034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 msgr2=0x7f55d4160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d4160dc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009e50 tx=0x7f55cc02be50 comp rx=0 tx=0).stop 2023-12-19T05:42:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 -- 172.21.15.49:0/3952667034 shutdown_connections 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d4160dc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 --2- 172.21.15.49:0/3952667034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d4157710 0x7f55d40b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 -- 172.21.15.49:0/3952667034 >> 172.21.15.49:0/3952667034 conn(0x7f55d40659a0 msgr2=0x7f55d4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 -- 172.21.15.49:0/3952667034 shutdown_connections 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.198+0000 7f55d359e640 1 -- 172.21.15.49:0/3952667034 wait complete. 2023-12-19T05:42:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.200+0000 7f55d359e640 1 Processor -- start 2023-12-19T05:42:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.200+0000 7f55d359e640 1 -- start start 2023-12-19T05:42:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d40b2990 0x7f55d4145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 0x7f55d41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4158350 con 0x7f55d40b0a00 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41f6f80 con 0x7f55d4157710 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4145d60 con 0x7f55d40b2990 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48446/0 (socket says 172.21.15.49:48446) 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.201+0000 7f55d259c640 1 -- 172.21.15.49:0/3100102704 learned_addr learned my addr 172.21.15.49:0/3100102704 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 0x7f55d41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d40b2990 0x7f55d4145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 -- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d40b2990 msgr2=0x7f55d4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d40b2990 0x7f55d4145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 -- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 msgr2=0x7f55d41544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 0x7f55d41544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 -- 172.21.15.49:0/3100102704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009b30 con 0x7f55d40b0a00 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 0x7f55d41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d259c640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f55c400d5f0 tx=0x7f55c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55caffd640 1 -- 172.21.15.49:0/3100102704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40125f0 con 0x7f55d40b0a00 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55caffd640 1 -- 172.21.15.49:0/3100102704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4012750 con 0x7f55d40b0a00 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55caffd640 1 -- 172.21.15.49:0/3100102704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4012b00 con 0x7f55d40b0a00 2023-12-19T05:42:18.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.202+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d406e3d0 con 0x7f55d40b0a00 2023-12-19T05:42:18.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.203+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d4157f70 con 0x7f55d40b0a00 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.205+0000 7f55caffd640 1 -- 172.21.15.49:0/3100102704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55c4012c60 con 0x7f55d40b0a00 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.206+0000 7f55caffd640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 0x7f55b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.206+0000 7f55caffd640 1 -- 172.21.15.49:0/3100102704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55c4088cd0 con 0x7f55d40b0a00 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.206+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 0x7f55b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.207+0000 7f55db9cc740 1 Processor -- start 2023-12-19T05:42:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.207+0000 7f55db9cc740 1 -- start start 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 0x7f55b406c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55bc000f60 tx=0x7f55bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e76f10 0x5606f9e772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e46e90 0x5606f9e74180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9db6f80 con 0x5606f9e4aa90 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9db4710 con 0x5606f9e76f10 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f9db0000 con 0x5606f9e46e90 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48450/0 (socket says 172.21.15.49:48450) 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55d2d9d640 1 -- 172.21.15.49:0/1316390873 learned_addr learned my addr 172.21.15.49:0/1316390873 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d259c640 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e76f10 0x5606f9e772f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.208+0000 7f55cbfff640 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e46e90 0x5606f9e74180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 -- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e46e90 msgr2=0x5606f9e74180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e46e90 0x5606f9e74180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 -- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e76f10 msgr2=0x5606f9e772f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e76f10 0x5606f9e772f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 -- 172.21.15.49:0/1316390873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f9d77690 con 0x5606f9e4aa90 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f55cc036040 tx=0x7f55cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fdc92daf517824 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55b3fff640 1 -- 172.21.15.49:0/1316390873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc040670 con 0x5606f9e4aa90 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55b3fff640 1 -- 172.21.15.49:0/1316390873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc0407d0 con 0x5606f9e4aa90 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.209+0000 7f55b3fff640 1 -- 172.21.15.49:0/1316390873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc040b40 con 0x5606f9e4aa90 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 -- 172.21.15.49:0/1316390873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 msgr2=0x5606f9e746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f55cc036040 tx=0x7f55cc02e000 comp rx=0 tx=0).stop 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 -- 172.21.15.49:0/1316390873 shutdown_connections 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e46e90 0x5606f9e74180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e746c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 --2- 172.21.15.49:0/1316390873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e76f10 0x5606f9e772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 -- 172.21.15.49:0/1316390873 >> 172.21.15.49:0/1316390873 conn(0x5606f9e491a0 msgr2=0x5606f9e91d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 -- 172.21.15.49:0/1316390873 shutdown_connections 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.210+0000 7f55db9cc740 1 -- 172.21.15.49:0/1316390873 wait complete. 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.211+0000 7f55db9cc740 1 -- start start 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.211+0000 7f55db9cc740 1 Processor -- start 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 0x5606f9e665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e90dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9d517d0 con 0x5606f9e77d00 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9d51470 con 0x5606f9e4aa90 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f9b17f20 con 0x5606f9e76f10 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55db9cc740 10 client.0 _ll_register_callbacks cb 0x5606f9da01b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.212+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48460/0 (socket says 172.21.15.49:48460) 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 -- 172.21.15.49:0/2800452637 learned_addr learned my addr 172.21.15.49:0/2800452637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d259c640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 0x5606f9e665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55cbfff640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e90dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 -- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 msgr2=0x5606f9e90dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e90dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 -- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 msgr2=0x5606f9e665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 0x5606f9e665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 -- 172.21.15.49:0/2800452637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d415dd70 con 0x5606f9e77d00 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d259c640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 0x5606f9e665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009f70 tx=0x7f55cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8078c0f16da567fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.213+0000 7f55b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc040d50 con 0x5606f9e77d00 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55cc02c970 con 0x5606f9e77d00 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606f9dda550 con 0x5606f9e77d00 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55cc03e420 con 0x5606f9e77d00 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 10 client.6141 fetch_fsmap learned FSMap version 32 2023-12-19T05:42:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5606f9dae680 con 0x5606f9e77d00 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606f9dda550 con 0x5606f9e77d00 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f55cc047070 con 0x5606f9e77d00 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 10 client.6141 fetch_fsmap finished waiting for FSMap version 32 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 10 client.6141 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 20 client.6141 populate_metadata read hostname 'smithi049' 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e79220 0x5606f9e91970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 4 client.6141 mds_command: new command op to 5431 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.214+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 --> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606f9da2b50 con 0x5606f9e79220 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.215+0000 7f55d259c640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e79220 0x5606f9e91970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.215+0000 7f55d259c640 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e79220 0x5606f9e91970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9ef26b90006cd1 server_cookie=67417192560a3c5c in_seq=0 out_seq=0 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.215+0000 7f55b17fa640 10 client.6141 ms_handle_connect on v2:172.21.15.49:6833/3371552330 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55b17fa640 1 -- 172.21.15.49:0/2800452637 <== mds.0 v2:172.21.15.49:6833/3371552330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5606f9da2b50 con 0x5606f9e79220 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55b17fa640 10 client.6141 handle_command_reply: tid=0 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 client.6141 shutdown 2023-12-19T05:42:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 msgr2=0x5606f9ea14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009f70 tx=0x7f55cc004ab0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 shutdown_connections 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e79220 0x5606f9e91970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e90dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e77d00 0x5606f9ea14a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2800452637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e4aa90 0x5606f9e665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55b17fa640 0 client.6141 ms_handle_reset on v2:172.21.15.49:6833/3371552330 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 >> 172.21.15.49:0/2800452637 conn(0x5606f9e46e90 msgr2=0x5606f9e7abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.216+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 shutdown_connections 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.217+0000 7f55db9cc740 1 -- 172.21.15.49:0/2800452637 wait complete. 2023-12-19T05:42:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.217+0000 7f55db9cc740 20 client.6141 trim_cache size 0 max 16384 2023-12-19T05:42:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.233+0000 7f55db9cc740 1 Processor -- start 2023-12-19T05:42:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.233+0000 7f55db9cc740 1 -- start start 2023-12-19T05:42:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 0x5606f9e4db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e4af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e73920 con 0x5606f9e76f10 2023-12-19T05:42:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e90e80 con 0x5606f9e77d00 2023-12-19T05:42:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.234+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e8ef40 con 0x5606f9e4aa90 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48466/0 (socket says 172.21.15.49:48466) 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 -- 172.21.15.49:0/3829131223 learned_addr learned my addr 172.21.15.49:0/3829131223 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55d2d9d640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e4af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55d259c640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 0x5606f9e4db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 -- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 msgr2=0x5606f9e4db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 0x5606f9e4db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 -- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 msgr2=0x5606f9e4af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e4af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 -- 172.21.15.49:0/3829131223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f9d509e0 con 0x5606f9e76f10 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55d259c640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 0x5606f9e4db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.235+0000 7f55cbfff640 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001eb0 tx=0x7f55bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4506f0c30136aec5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55c8ff9640 1 -- 172.21.15.49:0/3829131223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003810 con 0x5606f9e76f10 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55c8ff9640 1 -- 172.21.15.49:0/3829131223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc003970 con 0x5606f9e76f10 2023-12-19T05:42:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55c8ff9640 1 -- 172.21.15.49:0/3829131223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003d40 con 0x5606f9e76f10 2023-12-19T05:42:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 -- 172.21.15.49:0/3829131223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 msgr2=0x5606f9e45e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001eb0 tx=0x7f55bc013000 comp rx=0 tx=0).stop 2023-12-19T05:42:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 -- 172.21.15.49:0/3829131223 shutdown_connections 2023-12-19T05:42:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e4af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e76f10 0x5606f9e45e30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 --2- 172.21.15.49:0/3829131223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e4aa90 0x5606f9e4db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.236+0000 7f55db9cc740 1 -- 172.21.15.49:0/3829131223 >> 172.21.15.49:0/3829131223 conn(0x5606f9e46e90 msgr2=0x5606f9e47320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.237+0000 7f55db9cc740 1 -- 172.21.15.49:0/3829131223 shutdown_connections 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.237+0000 7f55db9cc740 1 -- 172.21.15.49:0/3829131223 wait complete. 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.237+0000 7f55db9cc740 1 -- start start 2023-12-19T05:42:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.238+0000 7f55db9cc740 1 Processor -- start 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.238+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e65940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e72420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e91450 con 0x5606f9e4aa90 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e731b0 con 0x5606f9e77d00 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f9e71060 con 0x5606f9e76f10 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55db9cc740 10 client.0 _ll_register_callbacks cb 0x7f55cc009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48472/0 (socket says 172.21.15.49:48472) 2023-12-19T05:42:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 -- 172.21.15.49:0/2609537651 learned_addr learned my addr 172.21.15.49:0/2609537651 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 -- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 msgr2=0x5606f9e65940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e65940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 -- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 msgr2=0x5606f9e72420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e72420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 -- 172.21.15.49:0/2609537651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d415d7d0 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55d259c640 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f55c4087230 tx=0x7f55c4058100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0669f62a13ccfd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.239+0000 7f55b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4054720 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55c4054880 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55cc0407d0 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55c4057500 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 10 client.6147 fetch_fsmap learned FSMap version 32 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5606f9d75ef0 con 0x5606f9e4aa90 2023-12-19T05:42:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4074020 con 0x5606f9e4aa90 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f55c405fb60 con 0x5606f9e4aa90 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 10 client.6147 fetch_fsmap finished waiting for FSMap version 32 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 10 client.6147 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 20 client.6147 populate_metadata read hostname 'smithi049' 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e4afd0 0x5606f9e4b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 4 client.6147 mds_command: new command op to 5431 tid=0[{"prefix": "status"}] 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.240+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 --> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606f9da9080 con 0x5606f9e4afd0 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.241+0000 7f55cbfff640 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e4afd0 0x5606f9e4b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.241+0000 7f55cbfff640 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e4afd0 0x5606f9e4b3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda1b4acd03634d6 server_cookie=6df5cd0c90fc6426 in_seq=0 out_seq=0 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.241+0000 7f55b17fa640 10 client.6147 ms_handle_connect on v2:172.21.15.49:6833/3371552330 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55b17fa640 1 -- 172.21.15.49:0/2609537651 <== mds.0 v2:172.21.15.49:6833/3371552330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5606f9da9080 con 0x5606f9e4afd0 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55b17fa640 10 client.6147 handle_command_reply: tid=0 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 client.6147 shutdown 2023-12-19T05:42:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 msgr2=0x5606f9e880c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f55c4087230 tx=0x7f55c4058100 comp rx=0 tx=0).stop 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 shutdown_connections 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:6833/3371552330,v1:172.21.15.49:6835/3371552330] conn(0x5606f9e4afd0 0x5606f9e4b3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606f9e76f10 0x5606f9e65940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606f9e77d00 0x5606f9e72420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 --2- 172.21.15.49:0/2609537651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606f9e4aa90 0x5606f9e880c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55b17fa640 0 client.6147 ms_handle_reset on v2:172.21.15.49:6833/3371552330 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 >> 172.21.15.49:0/2609537651 conn(0x5606f9e46e90 msgr2=0x5606f9e77410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 shutdown_connections 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 1 -- 172.21.15.49:0/2609537651 wait complete. 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.242+0000 7f55db9cc740 20 client.6147 trim_cache size 0 max 16384 2023-12-19T05:42:18.247 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5431, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.3297329360000001, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 32, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 70, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 70, 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.62337181 2023-12-19T05:42:18.248 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:42:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 msgr2=0x7f55b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 0x7f55b406c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55bc000f60 tx=0x7f55bc009040 comp rx=0 tx=0).stop 2023-12-19T05:42:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 msgr2=0x7f55d41f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f55c400d5f0 tx=0x7f55c400dab0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 shutdown_connections 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55b406a430 0x7f55b406c8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d40b2990 0x7f55d4145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d4157710 0x7f55d41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 --2- 172.21.15.49:0/3100102704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d40b0a00 0x7f55d41f6a40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 >> 172.21.15.49:0/3100102704 conn(0x7f55d40659a0 msgr2=0x7f55d406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 shutdown_connections 2023-12-19T05:42:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.243+0000 7f55d359e640 1 -- 172.21.15.49:0/3100102704 wait complete. 2023-12-19T05:42:18.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:42:18.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.480+0000 7f1ee8527640 1 Processor -- start 2023-12-19T05:42:18.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.480+0000 7f1ee8527640 1 -- start start 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee8527640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ee0161660 0x7f1ee0166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee8527640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 0x7f1ee00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee8527640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee0165bc0 con 0x7f1ee00afa50 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee8527640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee006e520 con 0x7f1ee0161660 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee8527640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00afef0 con 0x7f1ee0161a40 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee62c3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ee0161660 0x7f1ee0166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee62c3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ee0161660 0x7f1ee0166050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48474/0 (socket says 172.21.15.49:48474) 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee62c3640 1 -- 172.21.15.49:0/3134812022 learned_addr learned my addr 172.21.15.49:0/3134812022 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.482+0000 7f1ee5ac2640 1 --1- 172.21.15.49:0/3134812022 >> v1:172.21.15.49:6789/0 conn(0x7f1ee00afa50 0x7f1ee00b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49482/0 (socket says 172.21.15.49:49482) 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee6ac4640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 0x7f1ee00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee62c3640 1 -- 172.21.15.49:0/3134812022 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 msgr2=0x7f1ee00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 0x7f1ee00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee62c3640 1 -- 172.21.15.49:0/3134812022 >> v1:172.21.15.49:6789/0 conn(0x7f1ee00afa50 legacy=0x7f1ee00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee62c3640 1 -- 172.21.15.49:0/3134812022 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0165570 con 0x7f1ee0161660 2023-12-19T05:42:18.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.483+0000 7f1ee6ac4640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 0x7f1ee00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.484+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161660 0x7f1ee0166050 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009e50 tx=0x7f1ed002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada710abafd55363 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.484+0000 7f1ee52c1640 1 -- 172.21.15.49:0/3134812022 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed002cb00 con 0x7f1ee0161660 2023-12-19T05:42:18.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.484+0000 7f1ee52c1640 1 -- 172.21.15.49:0/3134812022 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed002cc60 con 0x7f1ee0161660 2023-12-19T05:42:18.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.484+0000 7f1ee52c1640 1 -- 172.21.15.49:0/3134812022 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00343f0 con 0x7f1ee0161660 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 -- 172.21.15.49:0/3134812022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161660 msgr2=0x7f1ee0166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161660 0x7f1ee0166050 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009e50 tx=0x7f1ed002bf60 comp rx=0 tx=0).stop 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 -- 172.21.15.49:0/3134812022 shutdown_connections 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161a40 0x7f1ee00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 --2- 172.21.15.49:0/3134812022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161660 0x7f1ee0166050 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 -- 172.21.15.49:0/3134812022 >> 172.21.15.49:0/3134812022 conn(0x7f1ee00cbb70 msgr2=0x7f1ee00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 -- 172.21.15.49:0/3134812022 shutdown_connections 2023-12-19T05:42:18.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.485+0000 7f1ee8527640 1 -- 172.21.15.49:0/3134812022 wait complete. 2023-12-19T05:42:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.487+0000 7f1ee8527640 1 Processor -- start 2023-12-19T05:42:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.488+0000 7f1ee8527640 1 -- start start 2023-12-19T05:42:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 0x7f1ee01645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 0x7f1ee014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0158220 con 0x7f1ee0161a40 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee01573b0 con 0x7f1ee00afa50 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee8527640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee01575a0 con 0x7f1ee0161660 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee6ac4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee6ac4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48488/0 (socket says 172.21.15.49:48488) 2023-12-19T05:42:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.489+0000 7f1ee6ac4640 1 -- 172.21.15.49:0/1845399310 learned_addr learned my addr 172.21.15.49:0/1845399310 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee5ac2640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 0x7f1ee014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 0x7f1ee01645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 -- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 msgr2=0x7f1ee014b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 0x7f1ee014b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 -- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 msgr2=0x7f1ee01645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 0x7f1ee01645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 -- 172.21.15.49:0/1845399310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0009b30 con 0x7f1ee0161a40 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 0x7f1ee01645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee5ac2640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 0x7f1ee014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1ee6ac4640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c5c0 tx=0x7f1ed800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.490+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011800 con 0x7f1ee0161a40 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.491+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8011980 con 0x7f1ee0161a40 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.491+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011d30 con 0x7f1ee0161a40 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.491+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee0157880 con 0x7f1ee0161a40 2023-12-19T05:42:18.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.491+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee0157e40 con 0x7f1ee0161a40 2023-12-19T05:42:18.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.492+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee0061910 con 0x7f1ee0161a40 2023-12-19T05:42:18.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.493+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1ed8022350 con 0x7f1ee0161a40 2023-12-19T05:42:18.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.494+0000 7f1edeffd640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 0x7f1ecc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:18.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.494+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed8088a40 con 0x7f1ee0161a40 2023-12-19T05:42:18.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.495+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 0x7f1ecc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:18.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.496+0000 7f1ee62c3640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 0x7f1ecc06c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0035000 tx=0x7f1ed0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:18.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.498+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1ed8053fa0 con 0x7f1ee0161a40 2023-12-19T05:42:18.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.731+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ee00cb720 con 0x7f1ee0161a40 2023-12-19T05:42:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.732+0000 7f1edeffd640 1 -- 172.21.15.49:0/1845399310 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ed80575c0 con 0x7f1ee0161a40 2023-12-19T05:42:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.734+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 msgr2=0x7f1ecc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 0x7f1ecc06c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0035000 tx=0x7f1ed0030000 comp rx=0 tx=0).stop 2023-12-19T05:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 msgr2=0x7f1ee0156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c5c0 tx=0x7f1ed800ca80 comp rx=0 tx=0).stop 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 shutdown_connections 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ecc06a430 0x7f1ecc06c8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ee0161660 0x7f1ee014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ee0161a40 0x7f1ee0156e70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 --2- 172.21.15.49:0/1845399310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ee00afa50 0x7f1ee01645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 >> 172.21.15.49:0/1845399310 conn(0x7f1ee00cbb70 msgr2=0x7f1ee006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 shutdown_connections 2023-12-19T05:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:18.735+0000 7f1ee8527640 1 -- 172.21.15.49:0/1845399310 wait complete. 2023-12-19T05:42:18.754 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:42:18.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:42:18.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:42:18.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:42:18.755 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:42:18.755 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:42:18.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:42:18.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:42:18.755 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:42:18.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:18.755 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42154sec preferred_lft 42154sec 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:42:18.813 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:42:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:18.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:18.815 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:42:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:42:18.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:18.920 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:42:18.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:42:18.979 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:42:19.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:19.188 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:42:19.246 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:42:19.246 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:42:19.246 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:42:19.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:19.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:42:19.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:42:19.356 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:42:19.415 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:42:19.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:42:19.416 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:42:19.475 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:42:19.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:19.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:19.627 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:19.627 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:42:19.662 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:19.662 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:42:19.662 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:42:19.662 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:42:19.662 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:42:19.663 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:42:19.664 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:42:19.664 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:42:19.664 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:42:19.664 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:42:19.668 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:42:19.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:19.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:42:19.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:19.765 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:42:19.838 INFO:teuthology.orchestra.run.smithi049.stdout:client5093 2023-12-19T05:42:19.838 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:42:19.839 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:19.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:42:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.130+0000 7f3ce0cf6640 1 Processor -- start 2023-12-19T05:42:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.130+0000 7f3ce0cf6640 1 -- start start 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0b7ea0 0x7f3cdc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc147210 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc0d2370 con 0x7f3cdc146e30 2023-12-19T05:42:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.132+0000 7f3ce0cf6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b8300 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cdc0d0a90 0x7f3cdc06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48490/0 (socket says 172.21.15.49:48490) 2023-12-19T05:42:20.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 -- 172.21.15.49:0/68476102 learned_addr learned my addr 172.21.15.49:0/68476102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:20.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdb7fe640 1 --2- 172.21.15.49:0/68476102 >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdaffd640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0b7ea0 0x7f3cdc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 -- 172.21.15.49:0/68476102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0b7ea0 msgr2=0x7f3cdc0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0b7ea0 0x7f3cdc0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 -- 172.21.15.49:0/68476102 >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 msgr2=0x7f3cdc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 --2- 172.21.15.49:0/68476102 >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdbfff640 1 -- 172.21.15.49:0/68476102 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0d12d0 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.133+0000 7f3cdb7fe640 1 --2- 172.21.15.49:0/68476102 >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:42:20.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.135+0000 7f3cdbfff640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0d0a90 0x7f3cdc06f160 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0b85a0 tx=0x7f3cd402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c0e2817dc3792 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.135+0000 7f3cda7fc640 1 -- 172.21.15.49:0/68476102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd402c9f0 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.135+0000 7f3cda7fc640 1 -- 172.21.15.49:0/68476102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd402cb50 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.135+0000 7f3cda7fc640 1 -- 172.21.15.49:0/68476102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40343f0 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/68476102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0d0a90 msgr2=0x7f3cdc06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0d0a90 0x7f3cdc06f160 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0b85a0 tx=0x7f3cd402be50 comp rx=0 tx=0).stop 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/68476102 shutdown_connections 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0d0a90 0x7f3cdc06f160 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/68476102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0b7ea0 0x7f3cdc0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/68476102 >> v2:172.21.15.115:3300/0 conn(0x7f3cdc146e30 0x7f3cdc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/68476102 >> 172.21.15.49:0/68476102 conn(0x7f3cdc0b2990 msgr2=0x7f3cdc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/68476102 shutdown_connections 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.136+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/68476102 wait complete. 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.138+0000 7f3ce0cf6640 1 Processor -- start 2023-12-19T05:42:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.138+0000 7f3ce0cf6640 1 -- start start 2023-12-19T05:42:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 0x7f3cdc0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cced0 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cbe30 con 0x7f3cdc146e30 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.139+0000 7f3ce0cf6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cc110 con 0x7f3cdc0d0a90 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48502/0 (socket says 172.21.15.49:48502) 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 -- 172.21.15.49:0/2869775503 learned_addr learned my addr 172.21.15.49:0/2869775503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdbfff640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 0x7f3cdc0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdaffd640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 -- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0d0a90 msgr2=0x7f3cdc0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 -- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 msgr2=0x7f3cdc0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 0x7f3cdc0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 -- 172.21.15.49:0/2869775503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009b30 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdbfff640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 0x7f3cdc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:42:20.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.140+0000 7f3cdb7fe640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00e7e0 tx=0x7f3ccc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:20.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.141+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc004030 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.141+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc004190 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.141+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc004520 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.141+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0cc3f0 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.141+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0cc9b0 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.142+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc061910 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.143+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ccc00c6d0 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.144+0000 7f3cc3fff640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 0x7f3cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:20.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.144+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ccc088670 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.145+0000 7f3cdaffd640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 0x7f3cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:20.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.146+0000 7f3cdaffd640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 0x7f3cc806c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:20.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.148+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ccc053c50 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.384+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3cdc0b7960 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.385+0000 7f3cc3fff640 1 -- 172.21.15.49:0/2869775503 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ccc057270 con 0x7f3cdc0b7ea0 2023-12-19T05:42:20.387 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:42:20.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 msgr2=0x7f3cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:20.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 0x7f3cc806c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).stop 2023-12-19T05:42:20.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 msgr2=0x7f3cdc142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:20.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00e7e0 tx=0x7f3ccc00eca0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 shutdown_connections 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cc806a430 0x7f3cc806c8f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3cdc0d0a90 0x7f3cdc0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cdc146e30 0x7f3cdc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 --2- 172.21.15.49:0/2869775503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc0b7ea0 0x7f3cdc142d60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 >> 172.21.15.49:0/2869775503 conn(0x7f3cdc0b2990 msgr2=0x7f3cdc0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:20.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 shutdown_connections 2023-12-19T05:42:20.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:20.388+0000 7f3ce0cf6640 1 -- 172.21.15.49:0/2869775503 wait complete. 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:42:20.408 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:42:20.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.409 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:42:20.467 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42169sec preferred_lft 42169sec 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.468 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:42:20.469 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:42:20.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.470 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:42:20.556 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:42:20.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.560 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:42:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:42:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:42:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:42:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:42:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:42:20.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:42:20.613 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:42:20.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.786 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:42:20.836 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:42:20.836 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:42:20.836 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:42:20.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:20.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:42:20.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:42:20.921 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:42:20.971 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:42:20.971 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:42:20.971 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:42:21.020 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:42:21.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:21.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:21.159 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:21.159 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:42:21.192 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:42:21.193 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:42:21.193 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:42:21.193 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:42:21.193 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:42:21.194 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:42:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:42:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:42:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:42:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:42:21.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:42:21.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:21.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:42:21.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:42:21.274 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:42:21.328 INFO:teuthology.orchestra.run.smithi115.stdout:client5488 2023-12-19T05:42:21.328 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:42:21.328 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:42:21.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:42:21.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.622+0000 7f55d708f640 1 Processor -- start 2023-12-19T05:42:21.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.622+0000 7f55d708f640 1 -- start start 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d708f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d015b3c0 0x7f55d015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d708f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d006c6b0 0x7f55d006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d708f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d0161510 con 0x7f55d00cc540 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d708f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d006d080 con 0x7f55d006c6b0 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d708f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d015ed70 con 0x7f55d015b3c0 2023-12-19T05:42:21.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d562c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d006c6b0 0x7f55d006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d562c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55d006c6b0 0x7f55d006cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48510/0 (socket says 172.21.15.49:48510) 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55d562c640 1 -- 172.21.15.49:0/3012766996 learned_addr learned my addr 172.21.15.49:0/3012766996 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.624+0000 7f55cffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f55d00cc540 0x7f55d006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49494/0 (socket says 172.21.15.49:49494) 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.625+0000 7f55d4e2b640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d015b3c0 0x7f55d015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.625+0000 7f55d562c640 1 -- 172.21.15.49:0/3012766996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d015b3c0 msgr2=0x7f55d015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.625+0000 7f55d562c640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d015b3c0 0x7f55d015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.625+0000 7f55d562c640 1 -- 172.21.15.49:0/3012766996 >> v1:172.21.15.49:6789/0 conn(0x7f55d00cc540 legacy=0x7f55d006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.625+0000 7f55d562c640 1 -- 172.21.15.49:0/3012766996 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d015e4d0 con 0x7f55d006c6b0 2023-12-19T05:42:21.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.626+0000 7f55d562c640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d006c6b0 0x7f55d006cb40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009870 tx=0x7f55c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc73d27bfe33be76 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.626+0000 7f55cf7fe640 1 -- 172.21.15.49:0/3012766996 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8030840 con 0x7f55d006c6b0 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.626+0000 7f55cf7fe640 1 -- 172.21.15.49:0/3012766996 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c80309a0 con 0x7f55d006c6b0 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.626+0000 7f55cf7fe640 1 -- 172.21.15.49:0/3012766996 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8030d30 con 0x7f55d006c6b0 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 -- 172.21.15.49:0/3012766996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d006c6b0 msgr2=0x7f55d006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d006c6b0 0x7f55d006cb40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009870 tx=0x7f55c802b980 comp rx=0 tx=0).stop 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 -- 172.21.15.49:0/3012766996 shutdown_connections 2023-12-19T05:42:21.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d006c6b0 0x7f55d006cb40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 --2- 172.21.15.49:0/3012766996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d015b3c0 0x7f55d015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 -- 172.21.15.49:0/3012766996 >> 172.21.15.49:0/3012766996 conn(0x7f55d00d01a0 msgr2=0x7f55d00d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:21.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 -- 172.21.15.49:0/3012766996 shutdown_connections 2023-12-19T05:42:21.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.627+0000 7f55d708f640 1 -- 172.21.15.49:0/3012766996 wait complete. 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.629+0000 7f55d708f640 1 Processor -- start 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.629+0000 7f55d708f640 1 -- start start 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d006c6b0 0x7f55d00cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d00cc540 0x7f55d0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0147200 con 0x7f55d015b3c0 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00cfae0 con 0x7f55d006c6b0 2023-12-19T05:42:21.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d708f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00cf800 con 0x7f55d00cc540 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.630+0000 7f55d562c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48524/0 (socket says 172.21.15.49:48524) 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 -- 172.21.15.49:0/381200799 learned_addr learned my addr 172.21.15.49:0/381200799 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d4e2b640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d006c6b0 0x7f55d00cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55cffff640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d00cc540 0x7f55d0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 -- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d00cc540 msgr2=0x7f55d0146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d00cc540 0x7f55d0146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 -- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d006c6b0 msgr2=0x7f55d00cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d006c6b0 0x7f55d00cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.631+0000 7f55d562c640 1 -- 172.21.15.49:0/381200799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80094d0 con 0x7f55d015b3c0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55d562c640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f55c802b9c0 tx=0x7f55c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8039a90 con 0x7f55d015b3c0 2023-12-19T05:42:21.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8039bf0 con 0x7f55d015b3c0 2023-12-19T05:42:21.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d00ca9e0 con 0x7f55d015b3c0 2023-12-19T05:42:21.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80433f0 con 0x7f55d015b3c0 2023-12-19T05:42:21.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.632+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00cafa0 con 0x7f55d015b3c0 2023-12-19T05:42:21.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.633+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d00cb190 con 0x7f55d015b3c0 2023-12-19T05:42:21.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.634+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55c804c3b0 con 0x7f55d015b3c0 2023-12-19T05:42:21.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.636+0000 7f55cd7fa640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:42:21.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.636+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55c80aaeb0 con 0x7f55d015b3c0 2023-12-19T05:42:21.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.636+0000 7f55d4e2b640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:42:21.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.637+0000 7f55d4e2b640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 0x7f55bc06c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009a60 tx=0x7f55c0003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:42:21.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.640+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f55c8076400 con 0x7f55d015b3c0 2023-12-19T05:42:21.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.873+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55d0061910 con 0x7f55d015b3c0 2023-12-19T05:42:21.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.875+0000 7f55cd7fa640 1 -- 172.21.15.49:0/381200799 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f55c8079a20 con 0x7f55d015b3c0 2023-12-19T05:42:21.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:42:21.876 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:42:21.876 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 msgr2=0x7f55bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 0x7f55bc06c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009a60 tx=0x7f55c0003990 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 msgr2=0x7f55d015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f55c802b9c0 tx=0x7f55c8004730 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 shutdown_connections 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55d00cc540 0x7f55d0146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55d015b3c0 0x7f55d015b7a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 --2- 172.21.15.49:0/381200799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55d006c6b0 0x7f55d00cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:42:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.877+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 >> 172.21.15.49:0/381200799 conn(0x7f55d00d01a0 msgr2=0x7f55d0160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:42:21.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.878+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 shutdown_connections 2023-12-19T05:42:21.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:42:21.878+0000 7f55d708f640 1 -- 172.21.15.49:0/381200799 wait complete. 2023-12-19T05:42:21.897 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-19T05:42:22.138 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":5431,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.208130601000001,"mdsmap_epoch":32,"osdmap_epoch":70,"osdmap_epoch_barrier":70,"uptime":16.501783481} 2023-12-19T05:42:22.139 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 5431, "mdsmap_epoch": 32, "osdmap_epoch": 70, "osdmap_epoch_barrier": 70, "rank_uptime": 11.208130601, "state": "up:active", "uptime": 16.501783481, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:42:22.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:42:22.379 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:42:22.379 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:42:22.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T05:42:22.615 INFO:teuthology.orchestra.run.smithi049.stdout:{"mon_tick_interval":"5"} 2023-12-19T05:42:22.615 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T05:42:22.615 INFO:tasks.cephfs.test_full:pool capacity 557028928, 531MB should be enough to fill it 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> import time 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> import datetime 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> # Write some buffered data through before going full, all should be well 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> print("writing some data through which we expect to succeed") 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> bytes = 0 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-19T05:42:22.616 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # from write 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> full = False 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(531 * 0.9)): 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> print("done writing {0} bytes".format(bytes)) 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # OK, now we should sneak in under the full condition 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # due to the time it takes the OSDs to report to the 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> # mons, and get a successful fsync on our full-making data 2023-12-19T05:42:22.617 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> # buffered write, add more dirty data to the buffer 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> print("starting buffered write") 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(531 * 0.2)): 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(15.0) 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> except OSError: 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> pass; 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> # Wait long enough for a background flush that should fail 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(30) 2023-12-19T05:42:22.618 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> # ...and check that the failed background flush is reflected in fclose 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> except OSError: 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> print("close() returned an error as expected") 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("close() failed to raise error") 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> # The kernel cephfs client does not raise errors on fclose 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:42:22.619 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:42:22.620 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T05:42:22.620 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:writing some data through which we expect to succeed 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-19T05:42:25.850 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-19T05:42:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-12-19T05:42:25.852 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-12-19T05:42:25.853 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-12-19T05:42:25.854 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-12-19T05:42:25.855 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-12-19T05:42:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-12-19T05:42:25.857 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-12-19T05:42:25.858 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-12-19T05:42:25.859 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-12-19T05:42:25.860 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-12-19T05:42:25.861 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-12-19T05:42:25.861 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-12-19T05:42:25.861 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-12-19T05:42:25.861 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-12-19T05:42:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-12-19T05:42:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-12-19T05:42:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-12-19T05:42:26.034 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-12-19T05:42:26.035 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-12-19T05:42:26.036 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-12-19T05:42:26.037 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-12-19T05:42:26.038 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-12-19T05:42:26.039 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-12-19T05:42:26.040 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-12-19T05:42:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-12-19T05:42:26.211 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-12-19T05:42:26.212 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-12-19T05:42:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-12-19T05:42:26.214 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-12-19T05:42:26.215 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-12-19T05:42:26.216 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-12-19T05:42:26.217 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-12-19T05:42:26.218 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-12-19T05:42:26.219 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-12-19T05:42:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-12-19T05:42:26.221 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-12-19T05:42:26.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:26.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:30.475 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:42:30.474+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-19T05:42:40.233 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:42:40.231+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-19T05:42:56.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:56.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:26.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:26.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:27.379 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-12-19T05:43:27.379 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-12-19T05:43:27.379 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-12-19T05:43:27.379 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:done writing 500695040 bytes 2023-12-19T05:43:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:successfully fsync'ed prior to getting full state reported 2023-12-19T05:43:27.381 INFO:teuthology.orchestra.run.smithi049.stdout:starting buffered write 2023-12-19T05:43:27.381 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:43:27.381 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:43:27.381 INFO:teuthology.orchestra.run.smithi049.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-19T05:43:27.452 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:43:27.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:43:27.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:43:27.714 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:43:27.715 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:43:27.715 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:27.779 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:43:27.779 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:27.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.071+0000 7fb62e133640 1 Processor -- start 2023-12-19T05:43:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.071+0000 7fb62e133640 1 -- start start 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.073+0000 7fb62e133640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb628159f80 0x7fb62806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.073+0000 7fb62e133640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb62815b1e0 0x7fb62815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.073+0000 7fb62e133640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62806b520 con 0x7fb62815a8a0 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.073+0000 7fb62e133640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280b2b20 con 0x7fb628159f80 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.073+0000 7fb62e133640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280b2fb0 con 0x7fb62815b1e0 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d131640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb628159f80 0x7fb62806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d932640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb62815a8a0 0x7fb62815dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56412/0 (socket says 172.21.15.49:56412) 2023-12-19T05:43:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d932640 1 -- 172.21.15.49:0/3422789497 learned_addr learned my addr 172.21.15.49:0/3422789497 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62c930640 1 --2- 172.21.15.49:0/3422789497 >> v2:172.21.15.115:3300/0 conn(0x7fb62815b1e0 0x7fb62815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d131640 1 -- 172.21.15.49:0/3422789497 >> v2:172.21.15.115:3300/0 conn(0x7fb62815b1e0 msgr2=0x7fb62815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d131640 1 --2- 172.21.15.49:0/3422789497 >> v2:172.21.15.115:3300/0 conn(0x7fb62815b1e0 0x7fb62815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d131640 1 -- 172.21.15.49:0/3422789497 >> v1:172.21.15.49:6789/0 conn(0x7fb62815a8a0 legacy=0x7fb62815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.074+0000 7fb62d131640 1 -- 172.21.15.49:0/3422789497 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280b1f10 con 0x7fb628159f80 2023-12-19T05:43:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.075+0000 7fb62d131640 1 --2- 172.21.15.49:0/3422789497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628159f80 0x7fb62806f160 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb6280cff10 tx=0x7fb62402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eb9e333c12df3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb61ffff640 1 -- 172.21.15.49:0/3422789497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624030610 con 0x7fb628159f80 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb61ffff640 1 -- 172.21.15.49:0/3422789497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624030770 con 0x7fb628159f80 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb61ffff640 1 -- 172.21.15.49:0/3422789497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624030b00 con 0x7fb628159f80 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb62e133640 1 -- 172.21.15.49:0/3422789497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628159f80 msgr2=0x7fb62806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb62e133640 1 --2- 172.21.15.49:0/3422789497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628159f80 0x7fb62806f160 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb6280cff10 tx=0x7fb62402b960 comp rx=0 tx=0).stop 2023-12-19T05:43:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.076+0000 7fb62e133640 1 -- 172.21.15.49:0/3422789497 shutdown_connections 2023-12-19T05:43:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.077+0000 7fb62e133640 1 --2- 172.21.15.49:0/3422789497 >> v2:172.21.15.115:3300/0 conn(0x7fb62815b1e0 0x7fb62815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.077+0000 7fb62e133640 1 --2- 172.21.15.49:0/3422789497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628159f80 0x7fb62806f160 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.077+0000 7fb62e133640 1 -- 172.21.15.49:0/3422789497 >> 172.21.15.49:0/3422789497 conn(0x7fb6280b0100 msgr2=0x7fb6280b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.077+0000 7fb62e133640 1 -- 172.21.15.49:0/3422789497 shutdown_connections 2023-12-19T05:43:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.077+0000 7fb62e133640 1 -- 172.21.15.49:0/3422789497 wait complete. 2023-12-19T05:43:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.079+0000 7fb62e133640 1 Processor -- start 2023-12-19T05:43:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.079+0000 7fb62e133640 1 -- start start 2023-12-19T05:43:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb628159f80 0x7fb628157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 0x7fb628151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628144ff0 con 0x7fb62815b1e0 2023-12-19T05:43:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628151660 con 0x7fb628159f80 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.080+0000 7fb62e133640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb628150080 con 0x7fb62815a8a0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47494/0 (socket says 172.21.15.49:47494) 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 -- 172.21.15.49:0/853030899 learned_addr learned my addr 172.21.15.49:0/853030899 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d131640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb628159f80 0x7fb628157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62c930640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 0x7fb628151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 -- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 msgr2=0x7fb628151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 0x7fb628151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 -- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb628159f80 msgr2=0x7fb628157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb628159f80 0x7fb628157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62d932640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009400 con 0x7fb62815b1e0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.081+0000 7fb62c930640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 0x7fb628151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb62d932640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb62000cbc0 tx=0x7fb62000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000ad40 con 0x7fb62815b1e0 2023-12-19T05:43:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620012400 con 0x7fb62815b1e0 2023-12-19T05:43:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000aea0 con 0x7fb62815b1e0 2023-12-19T05:43:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628150d30 con 0x7fb62815b1e0 2023-12-19T05:43:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.082+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6281512f0 con 0x7fb62815b1e0 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.083+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6281514b0 con 0x7fb62815b1e0 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.084+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb620007070 con 0x7fb62815b1e0 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.085+0000 7fb61dffb640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 0x7fb60c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.085+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb620088740 con 0x7fb62815b1e0 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.086+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fb60c0720a0 con 0x7fb62815b1e0 2023-12-19T05:43:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.086+0000 7fb62d131640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 0x7fb60c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.087+0000 7fb62d131640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 0x7fb60c06c970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb624036000 tx=0x7fb624008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.091+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb620017060 con 0x7fb62815b1e0 2023-12-19T05:43:28.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.284+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6281517d0 con 0x7fb62815b1e0 2023-12-19T05:43:28.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.286+0000 7fb61dffb640 1 -- 172.21.15.49:0/853030899 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16244 (secure 0 0 0) 0x7fb620017020 con 0x7fb62815b1e0 2023-12-19T05:43:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:28.288 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":75,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:54.285806+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.28","mappings":[{"from":6,"to":4}]},{"pgid":"9.3c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.288+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 msgr2=0x7fb60c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.288+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 0x7fb60c06c970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb624036000 tx=0x7fb624008030 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.288+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 msgr2=0x7fb628152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.288+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb62000cbc0 tx=0x7fb62000a430 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 shutdown_connections 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb60c06a4b0 0x7fb60c06c970 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb62815a8a0 0x7fb628151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb62815b1e0 0x7fb628152030 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 --2- 172.21.15.49:0/853030899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb628159f80 0x7fb628157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 >> 172.21.15.49:0/853030899 conn(0x7fb6280b0100 msgr2=0x7fb6280af950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:28.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 shutdown_connections 2023-12-19T05:43:28.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.289+0000 7fb62e133640 1 -- 172.21.15.49:0/853030899 wait complete. 2023-12-19T05:43:28.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:42:09.134540+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:42:09.927610+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:43:28.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:43:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.544+0000 7f0c7728f640 1 Processor -- start 2023-12-19T05:43:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.544+0000 7f0c7728f640 1 -- start start 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7728f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c700d0c30 0x7f0c700b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7728f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c700b2a50 0x7f0c7015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7728f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7015c260 con 0x7f0c7015f4e0 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7728f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700b2ee0 con 0x7f0c700b2a50 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7728f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700ced20 con 0x7f0c700d0c30 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c700b2a50 0x7f0c7015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c700b2a50 0x7f0c7015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47504/0 (socket says 172.21.15.49:47504) 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 -- 172.21.15.49:0/23656552 learned_addr learned my addr 172.21.15.49:0/23656552 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7502b640 1 --2- 172.21.15.49:0/23656552 >> v2:172.21.15.115:3300/0 conn(0x7f0c700d0c30 0x7f0c700b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 -- 172.21.15.49:0/23656552 >> v2:172.21.15.115:3300/0 conn(0x7f0c700d0c30 msgr2=0x7f0c700b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 --2- 172.21.15.49:0/23656552 >> v2:172.21.15.115:3300/0 conn(0x7f0c700d0c30 0x7f0c700b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.546+0000 7f0c7482a640 1 -- 172.21.15.49:0/23656552 >> v1:172.21.15.115:6789/0 conn(0x7f0c7015f4e0 legacy=0x7f0c7006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.547+0000 7f0c7482a640 1 -- 172.21.15.49:0/23656552 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7015b9a0 con 0x7f0c700b2a50 2023-12-19T05:43:28.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.548+0000 7f0c7482a640 1 --2- 172.21.15.49:0/23656552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700b2a50 0x7f0c7015efa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c7006e990 tx=0x7f0c6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b840cbc26b0237e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.548+0000 7f0c67fff640 1 -- 172.21.15.49:0/23656552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60031870 con 0x7f0c700b2a50 2023-12-19T05:43:28.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.548+0000 7f0c67fff640 1 -- 172.21.15.49:0/23656552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600319d0 con 0x7f0c700b2a50 2023-12-19T05:43:28.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.548+0000 7f0c67fff640 1 -- 172.21.15.49:0/23656552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60031d60 con 0x7f0c700b2a50 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 -- 172.21.15.49:0/23656552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700b2a50 msgr2=0x7f0c7015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 --2- 172.21.15.49:0/23656552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700b2a50 0x7f0c7015efa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c7006e990 tx=0x7f0c6002b910 comp rx=0 tx=0).stop 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 -- 172.21.15.49:0/23656552 shutdown_connections 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 --2- 172.21.15.49:0/23656552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700b2a50 0x7f0c7015efa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 --2- 172.21.15.49:0/23656552 >> v2:172.21.15.115:3300/0 conn(0x7f0c700d0c30 0x7f0c700b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 -- 172.21.15.49:0/23656552 >> 172.21.15.49:0/23656552 conn(0x7f0c7006ba40 msgr2=0x7f0c7006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 -- 172.21.15.49:0/23656552 shutdown_connections 2023-12-19T05:43:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.549+0000 7f0c7728f640 1 -- 172.21.15.49:0/23656552 wait complete. 2023-12-19T05:43:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.551+0000 7f0c7728f640 1 Processor -- start 2023-12-19T05:43:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.551+0000 7f0c7728f640 1 -- start start 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 0x7f0c70150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c700d0c30 0x7f0c700ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7006f160 con 0x7f0c7015f4e0 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7006f420 con 0x7f0c700d0c30 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7728f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7006f700 con 0x7f0c700b2a50 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7582c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7582c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47508/0 (socket says 172.21.15.49:47508) 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7582c640 1 -- 172.21.15.49:0/693572994 learned_addr learned my addr 172.21.15.49:0/693572994 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7482a640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c700d0c30 0x7f0c700ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.552+0000 7f0c7502b640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 0x7f0c70150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 -- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 msgr2=0x7f0c70150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 0x7f0c70150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 -- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c700d0c30 msgr2=0x7f0c700ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c700d0c30 0x7f0c700ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600094d0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7502b640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 0x7f0c70150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7582c640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800b990 tx=0x7f0c6800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800cba0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800cd00 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68014680 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7006f9e0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.553+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c701507c0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.555+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7006ff00 con 0x7f0c7015f4e0 2023-12-19T05:43:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.556+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c6801d3b0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.557+0000 7f0c65ffb640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 0x7f0c5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.557+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0c68088950 con 0x7f0c7015f4e0 2023-12-19T05:43:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.557+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f0c54072050 con 0x7f0c7015f4e0 2023-12-19T05:43:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.557+0000 7f0c7502b640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 0x7f0c5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.558+0000 7f0c7502b640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 0x7f0c5406c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c008890 tx=0x7f0c6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:28.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.561+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c68019020 con 0x7f0c7015f4e0 2023-12-19T05:43:28.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.757+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c7015bec0 con 0x7f0c7015f4e0 2023-12-19T05:43:28.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.758+0000 7f0c65ffb640 1 -- 172.21.15.49:0/693572994 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c7006ff00 con 0x7f0c7015f4e0 2023-12-19T05:43:28.759 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:43:28.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 msgr2=0x7f0c5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 0x7f0c5406c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c008890 tx=0x7f0c6c008040 comp rx=0 tx=0).stop 2023-12-19T05:43:28.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 msgr2=0x7f0c70154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800b990 tx=0x7f0c6800be50 comp rx=0 tx=0).stop 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 shutdown_connections 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c5406a460 0x7f0c5406c920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c7015f4e0 0x7f0c70154b50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c700d0c30 0x7f0c700ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 --2- 172.21.15.49:0/693572994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c700b2a50 0x7f0c70150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 >> 172.21.15.49:0/693572994 conn(0x7f0c7006ba40 msgr2=0x7f0c70151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 shutdown_connections 2023-12-19T05:43:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:28.761+0000 7f0c7728f640 1 -- 172.21.15.49:0/693572994 wait complete. 2023-12-19T05:43:28.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:43:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.011+0000 7fa61d30c640 1 Processor -- start 2023-12-19T05:43:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.011+0000 7fa61d30c640 1 -- start start 2023-12-19T05:43:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.013+0000 7fa61d30c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa618140360 0x7fa6180b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.013+0000 7fa61d30c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 0x7fa618161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.013+0000 7fa61d30c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa618140740 con 0x7fa6180b5cd0 2023-12-19T05:43:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.013+0000 7fa61d30c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618143990 con 0x7fa618140360 2023-12-19T05:43:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.013+0000 7fa61d30c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180b8610 con 0x7fa6180b6130 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa61cb0b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 0x7fa618161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa618140360 0x7fa6180b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa618140360 0x7fa6180b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:57912/0 (socket says 172.21.15.49:57912) 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 -- 172.21.15.49:0/1691615982 learned_addr learned my addr 172.21.15.49:0/1691615982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa61cb0b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 0x7fa618161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:40048/0 (socket says 172.21.15.49:40048) 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 -- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 msgr2=0x7fa618161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 --2- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 0x7fa618161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 -- 172.21.15.49:0/1691615982 >> v1:172.21.15.115:6789/0 conn(0x7fa6180b5cd0 legacy=0x7fa618160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.014+0000 7fa617fff640 1 -- 172.21.15.49:0/1691615982 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618142e10 con 0x7fa618140360 2023-12-19T05:43:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.016+0000 7fa617fff640 1 --2- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa618140360 0x7fa6180b80d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa608009870 tx=0x7fa60802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1260e652e5df617f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.016+0000 7fa616ffd640 1 -- 172.21.15.49:0/1691615982 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608031640 con 0x7fa618140360 2023-12-19T05:43:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.016+0000 7fa616ffd640 1 -- 172.21.15.49:0/1691615982 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6080317a0 con 0x7fa618140360 2023-12-19T05:43:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.016+0000 7fa616ffd640 1 -- 172.21.15.49:0/1691615982 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608031b30 con 0x7fa618140360 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 -- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa618140360 msgr2=0x7fa6180b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa618140360 0x7fa6180b80d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa608009870 tx=0x7fa60802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 -- 172.21.15.49:0/1691615982 shutdown_connections 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6180b6130 0x7fa618161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1691615982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa618140360 0x7fa6180b80d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 -- 172.21.15.49:0/1691615982 >> 172.21.15.49:0/1691615982 conn(0x7fa618065dc0 msgr2=0x7fa6180b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.017+0000 7fa61d30c640 1 -- 172.21.15.49:0/1691615982 shutdown_connections 2023-12-19T05:43:29.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.018+0000 7fa61d30c640 1 -- 172.21.15.49:0/1691615982 wait complete. 2023-12-19T05:43:29.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.020+0000 7fa61d30c640 1 Processor -- start 2023-12-19T05:43:29.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.020+0000 7fa61d30c640 1 -- start start 2023-12-19T05:43:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6180b5cd0 0x7fa6180cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 0x7fa6180cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d0290 con 0x7fa6180b6130 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180ccfc0 con 0x7fa6180b5cd0 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61d30c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180cd2a0 con 0x7fa618140360 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa6177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa6177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47520/0 (socket says 172.21.15.49:47520) 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa6177fe640 1 -- 172.21.15.49:0/1638622609 learned_addr learned my addr 172.21.15.49:0/1638622609 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa617fff640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6180b5cd0 0x7fa6180cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.022+0000 7fa61cb0b640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 0x7fa6180cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 -- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 msgr2=0x7fa6180cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 0x7fa6180cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 -- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6180b5cd0 msgr2=0x7fa6180cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6180b5cd0 0x7fa6180cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080094d0 con 0x7fa6180b6130 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa61cb0b640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 0x7fa6180cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.023+0000 7fa6177fe640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c400 tx=0x7fa60c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.024+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0052d0 con 0x7fa6180b6130 2023-12-19T05:43:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.024+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c005430 con 0x7fa6180b6130 2023-12-19T05:43:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.024+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c003830 con 0x7fa6180b6130 2023-12-19T05:43:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.024+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6180cd580 con 0x7fa6180b6130 2023-12-19T05:43:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.024+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6180cdb40 con 0x7fa6180b6130 2023-12-19T05:43:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.025+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618061910 con 0x7fa6180b6130 2023-12-19T05:43:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.026+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa60c003990 con 0x7fa6180b6130 2023-12-19T05:43:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.027+0000 7fa614ff9640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 0x7fa60406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.027+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa60c087ef0 con 0x7fa6180b6130 2023-12-19T05:43:29.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.027+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fa604072020 con 0x7fa6180b6130 2023-12-19T05:43:29.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.028+0000 7fa617fff640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 0x7fa60406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.029+0000 7fa617fff640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 0x7fa60406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.032+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa60c0534b0 con 0x7fa6180b6130 2023-12-19T05:43:29.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.227+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6181426b0 con 0x7fa6180b6130 2023-12-19T05:43:29.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.228+0000 7fa614ff9640 1 -- 172.21.15.49:0/1638622609 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa60c017030 con 0x7fa6180b6130 2023-12-19T05:43:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 msgr2=0x7fa60406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 0x7fa60406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803c040 comp rx=0 tx=0).stop 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 msgr2=0x7fa61813ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c400 tx=0x7fa60c00c8c0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 shutdown_connections 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa60406a430 0x7fa60406c8f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa618140360 0x7fa6180cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6180b6130 0x7fa61813ebe0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 --2- 172.21.15.49:0/1638622609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6180b5cd0 0x7fa6180cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 >> 172.21.15.49:0/1638622609 conn(0x7fa618065dc0 msgr2=0x7fa6180b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 shutdown_connections 2023-12-19T05:43:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.231+0000 7fa61d30c640 1 -- 172.21.15.49:0/1638622609 wait complete. 2023-12-19T05:43:29.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:43:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.472+0000 7f1030bf0640 1 Processor -- start 2023-12-19T05:43:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.473+0000 7f1030bf0640 1 -- start start 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.474+0000 7f1030bf0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f102c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.474+0000 7f1030bf0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f102c0b6430 0x7f102c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.474+0000 7f1030bf0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c161e70 con 0x7f102c146ff0 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.474+0000 7f1030bf0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c161080 con 0x7f102c0b6430 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.474+0000 7f1030bf0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c161260 con 0x7f102c06fc40 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f102a59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f102c146ff0 0x7f102c06f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56414/0 (socket says 172.21.15.49:56414) 2023-12-19T05:43:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f102a59c640 1 -- 172.21.15.49:0/3313948049 learned_addr learned my addr 172.21.15.49:0/3313948049 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f102ad9d640 1 --2- 172.21.15.49:0/3313948049 >> v2:172.21.15.115:3300/0 conn(0x7f102c0b6430 0x7f102c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f102c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511440621 0 0) 0x7f102c161e70 con 0x7f102c146ff0 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.475+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1018003520 con 0x7f102c146ff0 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507669065 0 0) 0x7f1018003520 con 0x7f102c146ff0 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 msgr2=0x7f102c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f102c0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 >> v2:172.21.15.115:3300/0 conn(0x7f102c0b6430 msgr2=0x7f102c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 --2- 172.21.15.49:0/3313948049 >> v2:172.21.15.115:3300/0 conn(0x7f102c0b6430 0x7f102c15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c161540 con 0x7f102c146ff0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f101c0019f0 con 0x7f102c146ff0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 >> v1:172.21.15.49:6789/0 conn(0x7f102c146ff0 legacy=0x7f102c06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10180039e0 0x7f1018003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180047c0 0x7f1018004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f1018005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c161080 con 0x7f10180047c0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c161260 con 0x7f10180039e0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101800ba00 con 0x7f102c06fc40 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180047c0 0x7f1018004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102a59c640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10180039e0 0x7f1018003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.476+0000 7f102ad9d640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f1018005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.477+0000 7f1029d9b640 1 -- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 msgr2=0x7f1018005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.477+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f102c06fc40 0x7f1018005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.477+0000 7f1029d9b640 1 -- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10180039e0 msgr2=0x7f1018003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.477+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10180039e0 0x7f1018003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.477+0000 7f1029d9b640 1 -- 172.21.15.49:0/3313948049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018003520 con 0x7f10180047c0 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.478+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180047c0 0x7f1018004c40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1014009a90 tx=0x7f10180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2595336636a0773 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.478+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101402c680 con 0x7f10180047c0 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.478+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101402c7e0 con 0x7f10180047c0 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.478+0000 7f102959a640 1 -- 172.21.15.49:0/3313948049 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101402cb90 con 0x7f10180047c0 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 -- 172.21.15.49:0/3313948049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180047c0 msgr2=0x7f1018004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3313948049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180047c0 0x7f1018004c40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1014009a90 tx=0x7f10180057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f102ad9d640 1 -- 172.21.15.49:0/3313948049 reap_dead start 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 -- 172.21.15.49:0/3313948049 shutdown_connections 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 -- 172.21.15.49:0/3313948049 >> 172.21.15.49:0/3313948049 conn(0x7f102c0d3520 msgr2=0x7f102c0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 -- 172.21.15.49:0/3313948049 shutdown_connections 2023-12-19T05:43:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.479+0000 7f1030bf0640 1 -- 172.21.15.49:0/3313948049 wait complete. 2023-12-19T05:43:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.481+0000 7f1030bf0640 1 Processor -- start 2023-12-19T05:43:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.481+0000 7f1030bf0640 1 -- start start 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10180047c0 0x7f102c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 0x7f102c0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0cf390 con 0x7f102c145e80 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c146820 con 0x7f102c0cddc0 2023-12-19T05:43:29.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1030bf0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0ceaf0 con 0x7f10180047c0 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1029d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1029d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47546/0 (socket says 172.21.15.49:47546) 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.482+0000 7f1029d9b640 1 -- 172.21.15.49:0/3744337751 learned_addr learned my addr 172.21.15.49:0/3744337751 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f102a59c640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10180047c0 0x7f102c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f102ad9d640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 0x7f102c0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 -- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10180047c0 msgr2=0x7f102c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10180047c0 0x7f102c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 -- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 msgr2=0x7f102c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 0x7f102c0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0cedd0 con 0x7f102c145e80 2023-12-19T05:43:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f102ad9d640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 0x7f102c0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.483+0000 7f1029d9b640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1014037040 tx=0x7f1014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.484+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014040920 con 0x7f102c145e80 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.484+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1014040a80 con 0x7f102c145e80 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.484+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014040e10 con 0x7f102c145e80 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.484+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c0cf0b0 con 0x7f102c145e80 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.484+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c0ce780 con 0x7f102c145e80 2023-12-19T05:43:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.485+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c0c90d0 con 0x7f102c145e80 2023-12-19T05:43:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.486+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1014034440 con 0x7f102c145e80 2023-12-19T05:43:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.487+0000 7f1022ffd640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 0x7f100c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.487+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f10140aab30 con 0x7f102c145e80 2023-12-19T05:43:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.487+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f100c072050 con 0x7f102c145e80 2023-12-19T05:43:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.487+0000 7f102a59c640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 0x7f100c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.489+0000 7f102a59c640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 0x7f100c06c920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f101c0013d0 tx=0x7f101c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.491+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f102c0c90d0 con 0x7f102c145e80 2023-12-19T05:43:29.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.685+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f102c0c90d0 con 0x7f102c145e80 2023-12-19T05:43:29.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.686+0000 7f1022ffd640 1 -- 172.21.15.49:0/3744337751 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f102c0c90d0 con 0x7f102c145e80 2023-12-19T05:43:29.688 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:43:29.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 msgr2=0x7f100c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 0x7f100c06c920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f101c0013d0 tx=0x7f101c009040 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 msgr2=0x7f102c1462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1014037040 tx=0x7f1014004730 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 shutdown_connections 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100c06a460 0x7f100c06c920 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102c0cddc0 0x7f102c0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c145e80 0x7f102c1462e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 --2- 172.21.15.49:0/3744337751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10180047c0 0x7f102c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 >> 172.21.15.49:0/3744337751 conn(0x7f102c0d3520 msgr2=0x7f102c144000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 shutdown_connections 2023-12-19T05:43:29.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.689+0000 7f1030bf0640 1 -- 172.21.15.49:0/3744337751 wait complete. 2023-12-19T05:43:29.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:43:29.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.945+0000 7f8f5657e640 1 Processor -- start 2023-12-19T05:43:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.945+0000 7f8f5657e640 1 -- start start 2023-12-19T05:43:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f5657e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f50155460 0x7f8f500b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f5657e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f500b0830 0x7f8f5006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f5657e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5015c9c0 con 0x7f8f5006ca80 2023-12-19T05:43:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f5657e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f500b0ce0 con 0x7f8f500b0830 2023-12-19T05:43:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f5657e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5006d270 con 0x7f8f50155460 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.947+0000 7f8f54d7b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f500b0830 0x7f8f5006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f500b0830 0x7f8f5006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47554/0 (socket says 172.21.15.49:47554) 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 -- 172.21.15.49:0/71480545 learned_addr learned my addr 172.21.15.49:0/71480545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f5557c640 1 --2- 172.21.15.49:0/71480545 >> v2:172.21.15.115:3300/0 conn(0x7f8f50155460 0x7f8f500b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 -- 172.21.15.49:0/71480545 >> v2:172.21.15.115:3300/0 conn(0x7f8f50155460 msgr2=0x7f8f500b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 --2- 172.21.15.49:0/71480545 >> v2:172.21.15.115:3300/0 conn(0x7f8f50155460 0x7f8f500b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 -- 172.21.15.49:0/71480545 >> v1:172.21.15.49:6789/0 conn(0x7f8f5006ca80 legacy=0x7f8f500cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.948+0000 7f8f54d7b640 1 -- 172.21.15.49:0/71480545 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5006d550 con 0x7f8f500b0830 2023-12-19T05:43:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.949+0000 7f8f54d7b640 1 --2- 172.21.15.49:0/71480545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f500b0830 0x7f8f5006c540 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8f500717b0 tx=0x7f8f4002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33556ca78d4bd6df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f47fff640 1 -- 172.21.15.49:0/71480545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40030860 con 0x7f8f500b0830 2023-12-19T05:43:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f47fff640 1 -- 172.21.15.49:0/71480545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f400309c0 con 0x7f8f500b0830 2023-12-19T05:43:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f47fff640 1 -- 172.21.15.49:0/71480545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40030d50 con 0x7f8f500b0830 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 -- 172.21.15.49:0/71480545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f500b0830 msgr2=0x7f8f5006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 --2- 172.21.15.49:0/71480545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f500b0830 0x7f8f5006c540 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8f500717b0 tx=0x7f8f4002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 -- 172.21.15.49:0/71480545 shutdown_connections 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 --2- 172.21.15.49:0/71480545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f500b0830 0x7f8f5006c540 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 --2- 172.21.15.49:0/71480545 >> v2:172.21.15.115:3300/0 conn(0x7f8f50155460 0x7f8f500b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.950+0000 7f8f5657e640 1 -- 172.21.15.49:0/71480545 >> 172.21.15.49:0/71480545 conn(0x7f8f500659a0 msgr2=0x7f8f50065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.951+0000 7f8f5657e640 1 -- 172.21.15.49:0/71480545 shutdown_connections 2023-12-19T05:43:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.951+0000 7f8f5657e640 1 -- 172.21.15.49:0/71480545 wait complete. 2023-12-19T05:43:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.952+0000 7f8f5657e640 1 Processor -- start 2023-12-19T05:43:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.953+0000 7f8f5657e640 1 -- start start 2023-12-19T05:43:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5006ca80 0x7f8f50145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f500b0830 0x7f8f500ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015f290 con 0x7f8f50155460 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015ecd0 con 0x7f8f5006ca80 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5657e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015efb0 con 0x7f8f500b0830 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47562/0 (socket says 172.21.15.49:47562) 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 -- 172.21.15.49:0/3558223779 learned_addr learned my addr 172.21.15.49:0/3558223779 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f5557c640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5006ca80 0x7f8f50145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 -- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f500b0830 msgr2=0x7f8f500ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f500b0830 0x7f8f500ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 -- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5006ca80 msgr2=0x7f8f50145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5006ca80 0x7f8f50145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.954+0000 7f8f55d7d640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400094d0 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f55d7d640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800c7a0 tx=0x7f8f4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48003b70 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48003cf0 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48003ea0 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f501558e0 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.955+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50146220 con 0x7f8f50155460 2023-12-19T05:43:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.956+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f501463b0 con 0x7f8f50155460 2023-12-19T05:43:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.958+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f4800aa90 con 0x7f8f50155460 2023-12-19T05:43:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.958+0000 7f8f45ffb640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.959+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8f480887a0 con 0x7f8f50155460 2023-12-19T05:43:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.959+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f8f34072020 con 0x7f8f50155460 2023-12-19T05:43:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.959+0000 7f8f5557c640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.961+0000 7f8f5557c640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c006fd0 tx=0x7f8f4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:29.963+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f501463b0 con 0x7f8f50155460 2023-12-19T05:43:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.172+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f50155e00 con 0x7f8f50155460 2023-12-19T05:43:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.173+0000 7f8f45ffb640 1 -- 172.21.15.49:0/3558223779 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f50155e00 con 0x7f8f50155460 2023-12-19T05:43:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:43:30.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.175+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 msgr2=0x7f8f3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c006fd0 tx=0x7f8f4c008040 comp rx=0 tx=0).stop 2023-12-19T05:43:30.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 msgr2=0x7f8f500cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800c7a0 tx=0x7f8f4800cc60 comp rx=0 tx=0).stop 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 shutdown_connections 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f500b0830 0x7f8f500ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50155460 0x7f8f500cd260 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 --2- 172.21.15.49:0/3558223779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5006ca80 0x7f8f50145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 >> 172.21.15.49:0/3558223779 conn(0x7f8f500659a0 msgr2=0x7f8f5006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 shutdown_connections 2023-12-19T05:43:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.176+0000 7f8f5657e640 1 -- 172.21.15.49:0/3558223779 wait complete. 2023-12-19T05:43:30.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:43:30.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:43:30.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:43:30.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:43:30.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:43:30.315 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:43:30.368 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:43:30.368 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:30.430 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:43:30.430 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:30.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.725+0000 7f25832dc640 1 Processor -- start 2023-12-19T05:43:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.726+0000 7f25832dc640 1 -- start start 2023-12-19T05:43:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.727+0000 7f25832dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 0x7f257c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.727+0000 7f25832dc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.727+0000 7f25832dc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0b4120 con 0x7f257c15da00 2023-12-19T05:43:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.727+0000 7f25832dc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c0b5b80 con 0x7f257c0b6870 2023-12-19T05:43:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.727+0000 7f25832dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b6ee0 con 0x7f257c15d620 2023-12-19T05:43:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.728+0000 7f2582adb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.728+0000 7f25822da640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 0x7f257c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.728+0000 7f2582adb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:57978/0 (socket says 172.21.15.49:57978) 2023-12-19T05:43:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.728+0000 7f2582adb640 1 -- 172.21.15.49:0/1260680185 learned_addr learned my addr 172.21.15.49:0/1260680185 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.729+0000 7f25822da640 1 -- 172.21.15.49:0/1260680185 >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 msgr2=0x7f257c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.729+0000 7f25822da640 1 --2- 172.21.15.49:0/1260680185 >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.729+0000 7f25822da640 1 -- 172.21.15.49:0/1260680185 >> v1:172.21.15.115:6789/0 conn(0x7f257c15da00 legacy=0x7f257c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.729+0000 7f25822da640 1 -- 172.21.15.49:0/1260680185 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0b71c0 con 0x7f257c15d620 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.729+0000 7f2582adb640 1 --2- 172.21.15.49:0/1260680185 >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:43:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.730+0000 7f25822da640 1 --2- 172.21.15.49:0/1260680185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 0x7f257c0cef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25780097a0 tx=0x7f257802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbbb334dcf61306d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.731+0000 7f25812d8640 1 -- 172.21.15.49:0/1260680185 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578030800 con 0x7f257c15d620 2023-12-19T05:43:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.731+0000 7f25812d8640 1 -- 172.21.15.49:0/1260680185 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578030960 con 0x7f257c15d620 2023-12-19T05:43:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.731+0000 7f25812d8640 1 -- 172.21.15.49:0/1260680185 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578030cf0 con 0x7f257c15d620 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 -- 172.21.15.49:0/1260680185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 msgr2=0x7f257c0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 --2- 172.21.15.49:0/1260680185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 0x7f257c0cef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25780097a0 tx=0x7f257802b940 comp rx=0 tx=0).stop 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 -- 172.21.15.49:0/1260680185 shutdown_connections 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 --2- 172.21.15.49:0/1260680185 >> v2:172.21.15.115:3300/0 conn(0x7f257c0b6870 0x7f257c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 --2- 172.21.15.49:0/1260680185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15d620 0x7f257c0cef60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 -- 172.21.15.49:0/1260680185 >> 172.21.15.49:0/1260680185 conn(0x7f257c0cfb90 msgr2=0x7f257c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 -- 172.21.15.49:0/1260680185 shutdown_connections 2023-12-19T05:43:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.732+0000 7f25832dc640 1 -- 172.21.15.49:0/1260680185 wait complete. 2023-12-19T05:43:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.734+0000 7f25832dc640 1 Processor -- start 2023-12-19T05:43:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.735+0000 7f25832dc640 1 -- start start 2023-12-19T05:43:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0b6870 0x7f257c14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15da00 0x7f257c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14fb30 con 0x7f257c15d620 2023-12-19T05:43:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c1f2b20 con 0x7f257c0b6870 2023-12-19T05:43:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f25832dc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14ff50 con 0x7f257c15da00 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f2581ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f2581ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47576/0 (socket says 172.21.15.49:47576) 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.736+0000 7f2581ad9640 1 -- 172.21.15.49:0/3995626233 learned_addr learned my addr 172.21.15.49:0/3995626233 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f25822da640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0b6870 0x7f257c14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2582adb640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15da00 0x7f257c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 -- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15da00 msgr2=0x7f257c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15da00 0x7f257c15f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 -- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0b6870 msgr2=0x7f257c14d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0b6870 0x7f257c14d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009b30 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.737+0000 7f2581ad9640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c420 tx=0x7f256c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.738+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0052d0 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.738+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c005450 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.738+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578009400 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.738+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c007260 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.738+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c14f190 con 0x7f257c15d620 2023-12-19T05:43:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.739+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c14fc70 con 0x7f257c15d620 2023-12-19T05:43:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.740+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f256c0073c0 con 0x7f257c15d620 2023-12-19T05:43:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.741+0000 7f2572ffd640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.741+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f256c087d00 con 0x7f257c15d620 2023-12-19T05:43:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.741+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f2560072020 con 0x7f257c15d620 2023-12-19T05:43:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.741+0000 7f25822da640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.743+0000 7f25822da640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 0x7f256006c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2578036000 tx=0x7f2578008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.746+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f257c14fc70 con 0x7f257c15d620 2023-12-19T05:43:30.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.942+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f257c14fc70 con 0x7f257c15d620 2023-12-19T05:43:30.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.947+0000 7f2572ffd640 1 -- 172.21.15.49:0/3995626233 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16244 (secure 0 0 0) 0x7f257c14fc70 con 0x7f257c15d620 2023-12-19T05:43:30.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:30.949 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":75,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:42:54.285806+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.28","mappings":[{"from":6,"to":4}]},{"pgid":"9.3c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.949+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 msgr2=0x7f256006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.949+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 0x7f256006c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2578036000 tx=0x7f2578008030 comp rx=0 tx=0).stop 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.949+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 msgr2=0x7f257c15f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.949+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c420 tx=0x7f256c00c8e0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 shutdown_connections 2023-12-19T05:43:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f257c15da00 0x7f257c15f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c15d620 0x7f257c15f090 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 --2- 172.21.15.49:0/3995626233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0b6870 0x7f257c14d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 >> 172.21.15.49:0/3995626233 conn(0x7f257c0cfb90 msgr2=0x7f257c0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 shutdown_connections 2023-12-19T05:43:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:30.950+0000 7f25832dc640 1 -- 172.21.15.49:0/3995626233 wait complete. 2023-12-19T05:43:30.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:42:09.134540+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:42:09.927610+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:43:30.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:43:31.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.269+0000 7f8f0c2c7640 1 Processor -- start 2023-12-19T05:43:31.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.269+0000 7f8f0c2c7640 1 -- start start 2023-12-19T05:43:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0c2c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f040d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0c2c7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f040b6430 0x7f8f0415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0c2c7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f04161e70 con 0x7f8f04146ff0 2023-12-19T05:43:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0c2c7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f04161080 con 0x7f8f040b6430 2023-12-19T05:43:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0c2c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04161260 con 0x7f8f0406fc40 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0a864640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f040b6430 0x7f8f0415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0a864640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f040b6430 0x7f8f0415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47582/0 (socket says 172.21.15.49:47582) 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f0a864640 1 -- 172.21.15.49:0/4079168193 learned_addr learned my addr 172.21.15.49:0/4079168193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.271+0000 7f8f09862640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f040d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.272+0000 7f8f0a864640 1 -- 172.21.15.49:0/4079168193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 msgr2=0x7f8f040d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:31.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.272+0000 7f8f0a864640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f040d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.272+0000 7f8f0a864640 1 -- 172.21.15.49:0/4079168193 >> v1:172.21.15.115:6789/0 conn(0x7f8f04146ff0 legacy=0x7f8f0406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.272+0000 7f8f0a864640 1 -- 172.21.15.49:0/4079168193 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04161540 con 0x7f8f040b6430 2023-12-19T05:43:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.273+0000 7f8f0a864640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0415dd40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009e50 tx=0x7f8efc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b0ab6640c7dc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.273+0000 7f8f09061640 1 -- 172.21.15.49:0/4079168193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc02ca80 con 0x7f8f040b6430 2023-12-19T05:43:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.273+0000 7f8f09061640 1 -- 172.21.15.49:0/4079168193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc02cbe0 con 0x7f8f040b6430 2023-12-19T05:43:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.273+0000 7f8f09061640 1 -- 172.21.15.49:0/4079168193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0343f0 con 0x7f8f040b6430 2023-12-19T05:43:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/4079168193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 msgr2=0x7f8f0415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0415dd40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009e50 tx=0x7f8efc02bee0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/4079168193 shutdown_connections 2023-12-19T05:43:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f040d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/4079168193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0415dd40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/4079168193 >> 172.21.15.49:0/4079168193 conn(0x7f8f040d3520 msgr2=0x7f8f040d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:31.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/4079168193 shutdown_connections 2023-12-19T05:43:31.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.274+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/4079168193 wait complete. 2023-12-19T05:43:31.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.276+0000 7f8f0c2c7640 1 Processor -- start 2023-12-19T05:43:31.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.276+0000 7f8f0c2c7640 1 -- start start 2023-12-19T05:43:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f0415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 0x7f8f040b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04140050 con 0x7f8f040b6430 2023-12-19T05:43:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0413bfe0 con 0x7f8f04146ff0 2023-12-19T05:43:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0c2c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041f6030 con 0x7f8f0406fc40 2023-12-19T05:43:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f09862640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f09862640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47598/0 (socket says 172.21.15.49:47598) 2023-12-19T05:43:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f09862640 1 -- 172.21.15.49:0/1534707581 learned_addr learned my addr 172.21.15.49:0/1534707581 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:31.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f09862640 1 -- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 msgr2=0x7f8f0415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0a063640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f0415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.277+0000 7f8f0a864640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 0x7f8f040b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f09862640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f0415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f09862640 1 -- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 msgr2=0x7f8f040b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f09862640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 0x7f8f040b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f09862640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009b30 con 0x7f8f040b6430 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f0a063640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f0415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f0a864640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 0x7f8f040b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f09862640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400d5d0 tx=0x7f8ef400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4004240 con 0x7f8f040b6430 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef40043a0 con 0x7f8f040b6430 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4003830 con 0x7f8f040b6430 2023-12-19T05:43:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f041f6310 con 0x7f8f040b6430 2023-12-19T05:43:31.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.278+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f041f68d0 con 0x7f8f040b6430 2023-12-19T05:43:31.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.279+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0413c200 con 0x7f8f040b6430 2023-12-19T05:43:31.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.280+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ef4003990 con 0x7f8f040b6430 2023-12-19T05:43:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.281+0000 7f8efaffd640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.281+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ef4088bd0 con 0x7f8f040b6430 2023-12-19T05:43:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.282+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f8ee8072020 con 0x7f8f040b6430 2023-12-19T05:43:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.282+0000 7f8f0a063640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.283+0000 7f8f0a063640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 0x7f8ee806c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f00000f60 tx=0x7f8f00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.285+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f0413c200 con 0x7f8f040b6430 2023-12-19T05:43:31.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.480+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f0413c200 con 0x7f8f040b6430 2023-12-19T05:43:31.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.480+0000 7f8efaffd640 1 -- 172.21.15.49:0/1534707581 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f0413c200 con 0x7f8f040b6430 2023-12-19T05:43:31.482 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:43:31.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 msgr2=0x7f8ee806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 0x7f8ee806c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f00000f60 tx=0x7f8f00009040 comp rx=0 tx=0).stop 2023-12-19T05:43:31.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 msgr2=0x7f8f0413b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400d5d0 tx=0x7f8ef400da90 comp rx=0 tx=0).stop 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 shutdown_connections 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f04146ff0 0x7f8f040b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f040b6430 0x7f8f0413b380 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 --2- 172.21.15.49:0/1534707581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0406fc40 0x7f8f0415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.483+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 >> 172.21.15.49:0/1534707581 conn(0x7f8f040d3520 msgr2=0x7f8f04160200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.484+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 shutdown_connections 2023-12-19T05:43:31.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.484+0000 7f8f0c2c7640 1 -- 172.21.15.49:0/1534707581 wait complete. 2023-12-19T05:43:31.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:43:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.738+0000 7fcfcf0f3640 1 Processor -- start 2023-12-19T05:43:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.738+0000 7fcfcf0f3640 1 -- start start 2023-12-19T05:43:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcf0f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 0x7fcfc80b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcf0f3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc80b0830 0x7fcfc806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcf0f3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc815c9c0 con 0x7fcfc806ca80 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcf0f3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc80b0cb0 con 0x7fcfc80b0830 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcf0f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc806d270 con 0x7fcfc8155460 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcd8f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc80b0830 0x7fcfc806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfce8f2640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcfc806ca80 0x7fcfc80cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56432/0 (socket says 172.21.15.49:56432) 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfce8f2640 1 -- 172.21.15.49:0/4011116279 learned_addr learned my addr 172.21.15.49:0/4011116279 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfcd8f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc80b0830 0x7fcfc806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47604/0 (socket says 172.21.15.49:47604) 2023-12-19T05:43:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.740+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 0x7fcfc80b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.741+0000 7fcfcd8f0640 1 -- 172.21.15.49:0/4011116279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 msgr2=0x7fcfc80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.741+0000 7fcfcd8f0640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 0x7fcfc80b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.741+0000 7fcfcd8f0640 1 -- 172.21.15.49:0/4011116279 >> v1:172.21.15.49:6789/0 conn(0x7fcfc806ca80 legacy=0x7fcfc80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.741+0000 7fcfcd8f0640 1 -- 172.21.15.49:0/4011116279 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc806d550 con 0x7fcfc80b0830 2023-12-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.741+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 0x7fcfc80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:31.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.742+0000 7fcfcd8f0640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc80b0830 0x7fcfc806c540 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0097a0 tx=0x7fcfbc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448cd01cdf340aa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.742+0000 7fcfcd0ef640 1 -- 172.21.15.49:0/4011116279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc02d040 con 0x7fcfc80b0830 2023-12-19T05:43:31.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.742+0000 7fcfcd0ef640 1 -- 172.21.15.49:0/4011116279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc031810 con 0x7fcfc80b0830 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.742+0000 7fcfcd0ef640 1 -- 172.21.15.49:0/4011116279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc031ba0 con 0x7fcfc80b0830 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/4011116279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc80b0830 msgr2=0x7fcfc806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc80b0830 0x7fcfc806c540 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0097a0 tx=0x7fcfbc02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/4011116279 shutdown_connections 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc80b0830 0x7fcfc806c540 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/4011116279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc8155460 0x7fcfc80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/4011116279 >> 172.21.15.49:0/4011116279 conn(0x7fcfc80659a0 msgr2=0x7fcfc8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/4011116279 shutdown_connections 2023-12-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.743+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/4011116279 wait complete. 2023-12-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.745+0000 7fcfcf0f3640 1 Processor -- start 2023-12-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.745+0000 7fcfcf0f3640 1 -- start start 2023-12-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 0x7fcfc80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc80b0830 0x7fcfc81f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc81f38a0 con 0x7fcfc8155460 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80acf70 con 0x7fcfc80b0830 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.746+0000 7fcfcf0f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80ad250 con 0x7fcfc806ca80 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47614/0 (socket says 172.21.15.49:47614) 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 -- 172.21.15.49:0/46080627 learned_addr learned my addr 172.21.15.49:0/46080627 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 0x7fcfc80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfcd8f0640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc80b0830 0x7fcfc81f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 -- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 msgr2=0x7fcfc80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 0x7fcfc80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 -- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc80b0830 msgr2=0x7fcfc81f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc80b0830 0x7fcfc81f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce8f2640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009400 con 0x7fcfc8155460 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.747+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 0x7fcfc80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfce8f2640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c420 tx=0x7fcfc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0005ce0 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0005e40 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00072d0 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc80ad530 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.748+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc80adaf0 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.749+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc8061910 con 0x7fcfc8155460 2023-12-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.750+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfc00074f0 con 0x7fcfc8155460 2023-12-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.751+0000 7fcfc6ffd640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 0x7fcfb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.751+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfc0087e70 con 0x7fcfc8155460 2023-12-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.752+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fcfb4072020 con 0x7fcfc8155460 2023-12-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.752+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 0x7fcfb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.753+0000 7fcfce0f1640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 0x7fcfb406c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800e3d0 tx=0x7fcfb8007a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.755+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfc0017060 con 0x7fcfc8155460 2023-12-19T05:43:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.955+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfc80afaf0 con 0x7fcfc8155460 2023-12-19T05:43:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.955+0000 7fcfc6ffd640 1 -- 172.21.15.49:0/46080627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfc0053430 con 0x7fcfc8155460 2023-12-19T05:43:31.957 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 msgr2=0x7fcfb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 0x7fcfb406c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800e3d0 tx=0x7fcfb8007a10 comp rx=0 tx=0).stop 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 msgr2=0x7fcfc8151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c420 tx=0x7fcfc000c8e0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 shutdown_connections 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcfb406a430 0x7fcfb406c8f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc8155460 0x7fcfc8151e40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc80b0830 0x7fcfc81f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 --2- 172.21.15.49:0/46080627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc806ca80 0x7fcfc80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.958+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 >> 172.21.15.49:0/46080627 conn(0x7fcfc80659a0 msgr2=0x7fcfc8159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.959+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 shutdown_connections 2023-12-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:31.959+0000 7fcfcf0f3640 1 -- 172.21.15.49:0/46080627 wait complete. 2023-12-19T05:43:31.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:43:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.215+0000 7f8ef98b2640 1 Processor -- start 2023-12-19T05:43:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.215+0000 7f8ef98b2640 1 -- start start 2023-12-19T05:43:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef98b2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ef40ad780 0x7f8ef40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef98b2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef415da00 con 0x7f8ef40ad300 2023-12-19T05:43:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef98b2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef415dcc0 con 0x7f8ef4157c30 2023-12-19T05:43:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef98b2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef415e940 con 0x7f8ef40ad780 2023-12-19T05:43:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef27fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ef40ad300 0x7f8ef40cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56436/0 (socket says 172.21.15.49:56436) 2023-12-19T05:43:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.217+0000 7f8ef27fc640 1 -- 172.21.15.49:0/2333193713 learned_addr learned my addr 172.21.15.49:0/2333193713 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/2333193713 >> v2:172.21.15.115:3300/0 conn(0x7f8ef40ad780 0x7f8ef40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043342146 0 0) 0x7f8ef415da00 con 0x7f8ef40ad300 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8edc003520 con 0x7f8ef40ad300 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250694142 0 0) 0x7f8edc003520 con 0x7f8ef40ad300 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 >> v2:172.21.15.115:3300/0 conn(0x7f8ef40ad780 msgr2=0x7f8ef40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 --2- 172.21.15.49:0/2333193713 >> v2:172.21.15.115:3300/0 conn(0x7f8ef40ad780 0x7f8ef40cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 >> v1:172.21.15.115:6789/0 conn(0x7f8ef4157c30 legacy=0x7f8ef40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef415dfa0 con 0x7f8ef40ad300 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8ee8001670 con 0x7f8ef40ad300 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 >> v1:172.21.15.49:6789/0 conn(0x7f8ef40ad300 legacy=0x7f8ef40cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 0x7f8edc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.218+0000 7f8ef1ffb640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc0047c0 0x7f8edc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef1ffb640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005180 0x7f8edc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef415e940 con 0x7f8edc0039e0 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc00c0b0 con 0x7f8edc005180 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc00c270 con 0x7f8edc0047c0 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 0x7f8edc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005180 0x7f8edc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 -- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc0047c0 msgr2=0x7f8edc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc0047c0 0x7f8edc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 -- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005180 msgr2=0x7f8edc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005180 0x7f8edc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef2ffd640 1 -- 172.21.15.49:0/2333193713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc003520 con 0x7f8edc0039e0 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005180 0x7f8edc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.219+0000 7f8ef37fe640 1 -- 172.21.15.49:0/2333193713 reap_dead start 2023-12-19T05:43:32.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 0x7f8edc003e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4001720 tx=0x7f8edc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69e1e31f32bbd16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40052d0 con 0x7f8edc0039e0 2023-12-19T05:43:32.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee402e050 con 0x7f8edc0039e0 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef1ffb640 1 -- 172.21.15.49:0/2333193713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4003830 con 0x7f8edc0039e0 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef98b2640 1 -- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 msgr2=0x7f8edc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 0x7f8edc003e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4001720 tx=0x7f8edc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef98b2640 1 -- 172.21.15.49:0/2333193713 shutdown_connections 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/2333193713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8edc0039e0 0x7f8edc003e20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.221+0000 7f8ef98b2640 1 -- 172.21.15.49:0/2333193713 >> 172.21.15.49:0/2333193713 conn(0x7f8ef4073150 msgr2=0x7f8ef40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.222+0000 7f8ef98b2640 1 -- 172.21.15.49:0/2333193713 shutdown_connections 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.222+0000 7f8ef98b2640 1 -- 172.21.15.49:0/2333193713 wait complete. 2023-12-19T05:43:32.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.223+0000 7f8ef98b2640 1 Processor -- start 2023-12-19T05:43:32.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.224+0000 7f8ef98b2640 1 -- start start 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.224+0000 7f8ef98b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc0039e0 0x7f8ef41489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.224+0000 7f8ef98b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef4152400 0x7f8ef41555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef98b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef98b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41551b0 con 0x7f8ef4155b10 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef98b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4148f10 con 0x7f8edc0039e0 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef98b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4154530 con 0x7f8ef4152400 2023-12-19T05:43:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47634/0 (socket says 172.21.15.49:47634) 2023-12-19T05:43:32.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 -- 172.21.15.49:0/481358256 learned_addr learned my addr 172.21.15.49:0/481358256 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef27fc640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef4152400 0x7f8ef41555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 -- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef4152400 msgr2=0x7f8ef41555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc0039e0 0x7f8ef41489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef4152400 0x7f8ef41555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 -- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc0039e0 msgr2=0x7f8ef41489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc0039e0 0x7f8ef41489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.225+0000 7f8ef37fe640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4154810 con 0x7f8ef4155b10 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8ef37fe640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40b1180 tx=0x7f8eec00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec016620 con 0x7f8ef4155b10 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec016780 con 0x7f8ef4155b10 2023-12-19T05:43:32.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef4154af0 con 0x7f8ef4155b10 2023-12-19T05:43:32.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec016af0 con 0x7f8ef4155b10 2023-12-19T05:43:32.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.226+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef4152b70 con 0x7f8ef4155b10 2023-12-19T05:43:32.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.227+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef41552f0 con 0x7f8ef4155b10 2023-12-19T05:43:32.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.228+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8eec016c50 con 0x7f8ef4155b10 2023-12-19T05:43:32.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.230+0000 7f8edbfff640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 0x7f8ee006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.230+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8eec089820 con 0x7f8ef4155b10 2023-12-19T05:43:32.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.230+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f8ee0072020 con 0x7f8ef4155b10 2023-12-19T05:43:32.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.230+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 0x7f8ee006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.232+0000 7f8ef2ffd640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 0x7f8ee006c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4033000 tx=0x7f8ee4009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.234+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ef41552f0 con 0x7f8ef4155b10 2023-12-19T05:43:32.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.427+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ef41552f0 con 0x7f8ef4155b10 2023-12-19T05:43:32.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.428+0000 7f8edbfff640 1 -- 172.21.15.49:0/481358256 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ef41552f0 con 0x7f8ef4155b10 2023-12-19T05:43:32.429 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 msgr2=0x7f8ee006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 0x7f8ee006c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4033000 tx=0x7f8ee4009030 comp rx=0 tx=0).stop 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 msgr2=0x7f8ef41565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40b1180 tx=0x7f8eec00f520 comp rx=0 tx=0).stop 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 shutdown_connections 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ee006a430 0x7f8ee006c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef4152400 0x7f8ef41555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef4155b10 0x7f8ef41565b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 --2- 172.21.15.49:0/481358256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc0039e0 0x7f8ef41489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.430+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 >> 172.21.15.49:0/481358256 conn(0x7f8ef4073150 msgr2=0x7f8ef40cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:32.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.431+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 shutdown_connections 2023-12-19T05:43:32.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.431+0000 7f8ef98b2640 1 -- 172.21.15.49:0/481358256 wait complete. 2023-12-19T05:43:32.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:43:32.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.683+0000 7f9f20d1c640 1 Processor -- start 2023-12-19T05:43:32.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.683+0000 7f9f20d1c640 1 -- start start 2023-12-19T05:43:32.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f20d1c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f1c0cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f20d1c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c06f160 con 0x7f9f1c146c40 2023-12-19T05:43:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f20d1c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c06f440 con 0x7f9f1c0b7360 2023-12-19T05:43:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f20d1c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0700c0 con 0x7f9f1c0b77c0 2023-12-19T05:43:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f1b7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9f1c146c40 0x7f9f1c070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56450/0 (socket says 172.21.15.49:56450) 2023-12-19T05:43:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.685+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/521285613 learned_addr learned my addr 172.21.15.49:0/521285613 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f1c0cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821815283 0 0) 0x7f9f1c06f160 con 0x7f9f1c146c40 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f08003520 con 0x7f9f1c146c40 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227876811 0 0) 0x7f9f08003520 con 0x7f9f1c146c40 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 msgr2=0x7f9f1c0cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f1c0cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 >> v1:172.21.15.115:6789/0 conn(0x7f9f1c0b7360 legacy=0x7f9f1c0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c06f720 con 0x7f9f1c146c40 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9f0c001670 con 0x7f9f1c146c40 2023-12-19T05:43:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 >> v1:172.21.15.49:6789/0 conn(0x7f9f1c146c40 legacy=0x7f9f1c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f08003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08003fe0 0x7f9f080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f08004d00 0x7f9f08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.686+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0700c0 con 0x7f9f08004d00 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0800bb40 con 0x7f9f08003fe0 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0800bd00 con 0x7f9f1c0b77c0 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f08004d00 0x7f9f08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f08003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f13fff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08003fe0 0x7f9f080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 -- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 msgr2=0x7f9f08003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0b77c0 0x7f9f08003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 -- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08003fe0 msgr2=0x7f9f080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08003fe0 0x7f9f080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f1bfff640 1 -- 172.21.15.49:0/521285613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08003520 con 0x7f9f08004d00 2023-12-19T05:43:32.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.687+0000 7f9f13fff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08003fe0 0x7f9f080047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.688+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f08004d00 0x7f9f08005180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009fc0 tx=0x7f9f080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847cf8663f3e52ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1402cc20 con 0x7f9f08004d00 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1400f040 con 0x7f9f08004d00 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f1affd640 1 -- 172.21.15.49:0/521285613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14034440 con 0x7f9f08004d00 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f20d1c640 1 -- 172.21.15.49:0/521285613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f08004d00 msgr2=0x7f9f08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/521285613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f08004d00 0x7f9f08005180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009fc0 tx=0x7f9f080057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f1bfff640 1 -- 172.21.15.49:0/521285613 reap_dead start 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f20d1c640 1 -- 172.21.15.49:0/521285613 shutdown_connections 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f20d1c640 1 -- 172.21.15.49:0/521285613 >> 172.21.15.49:0/521285613 conn(0x7f9f1c0d31b0 msgr2=0x7f9f1c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.689+0000 7f9f20d1c640 1 -- 172.21.15.49:0/521285613 shutdown_connections 2023-12-19T05:43:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.690+0000 7f9f20d1c640 1 -- 172.21.15.49:0/521285613 wait complete. 2023-12-19T05:43:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.691+0000 7f9f20d1c640 1 Processor -- start 2023-12-19T05:43:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.691+0000 7f9f20d1c640 1 -- start start 2023-12-19T05:43:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 0x7f9f1c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0ce160 0x7f9f1c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c14fb40 con 0x7f9f1c151310 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c13b9d0 con 0x7f9f08004d00 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.692+0000 7f9f20d1c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c152080 con 0x7f9f1c0ce160 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47652/0 (socket says 172.21.15.49:47652) 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 -- 172.21.15.49:0/2169918809 learned_addr learned my addr 172.21.15.49:0/2169918809 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 0x7f9f1c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f13fff640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0ce160 0x7f9f1c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 -- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0ce160 msgr2=0x7f9f1c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0ce160 0x7f9f1c0ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 -- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 msgr2=0x7f9f1c0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 0x7f9f1c0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1bfff640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c14f1a0 con 0x7f9f1c151310 2023-12-19T05:43:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.693+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 0x7f9f1c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f1bfff640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9f14037040 tx=0x7f9f14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14034ad0 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14034c30 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14003990 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c14f480 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.694+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c152690 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.695+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c14fc80 con 0x7f9f1c151310 2023-12-19T05:43:32.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.696+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f14047460 con 0x7f9f1c151310 2023-12-19T05:43:32.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.697+0000 7f9f18ff9640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 0x7f9efc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:32.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.697+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9f140aa6b0 con 0x7f9f1c151310 2023-12-19T05:43:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.697+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f9efc072020 con 0x7f9f1c151310 2023-12-19T05:43:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.698+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 0x7f9efc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:32.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.699+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 0x7f9efc06c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c001eb0 tx=0x7f9f0c001520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:32.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.701+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f1c14fc80 con 0x7f9f1c151310 2023-12-19T05:43:32.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.911+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f1c14fc80 con 0x7f9f1c151310 2023-12-19T05:43:32.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.912+0000 7f9f18ff9640 1 -- 172.21.15.49:0/2169918809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f1c14fc80 con 0x7f9f1c151310 2023-12-19T05:43:32.913 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:43:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 msgr2=0x7f9efc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 0x7f9efc06c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c001eb0 tx=0x7f9f0c001520 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 msgr2=0x7f9f1c151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9f14037040 tx=0x7f9f14009750 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 shutdown_connections 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9efc06a430 0x7f9efc06c8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f1c0ce160 0x7f9f1c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f1c151310 0x7f9f1c151790 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 --2- 172.21.15.49:0/2169918809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f08004d00 0x7f9f1c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 >> 172.21.15.49:0/2169918809 conn(0x7f9f1c0d31b0 msgr2=0x7f9f1c0d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 shutdown_connections 2023-12-19T05:43:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:32.915+0000 7f9f20d1c640 1 -- 172.21.15.49:0/2169918809 wait complete. 2023-12-19T05:43:32.937 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:43:32.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:43:32.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:43:33.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:43:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:43:33.049 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:43:33.100 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:43:33.100 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:33.163 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:43:33.163 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:43:33.163 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:33.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:43:33.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:33.443 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:43:33.441+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-12-19T05:43:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.461+0000 7f3283b5c640 1 Processor -- start 2023-12-19T05:43:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.461+0000 7f3283b5c640 1 -- start start 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f3283b5c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f327c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f3283b5c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c15b740 con 0x7f327c0b0810 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f3283b5c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c0ae640 con 0x7f327c0ae110 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f3283b5c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06b8c0 con 0x7f327c157bf0 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f32820f9640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f327c0b0810 0x7f327c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56452/0 (socket says 172.21.15.49:56452) 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.463+0000 7f32820f9640 1 -- 172.21.15.49:0/3168748014 learned_addr learned my addr 172.21.15.49:0/3168748014 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32818f8640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f327c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493725856 0 0) 0x7f327c15b740 con 0x7f327c0b0810 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3268003520 con 0x7f327c0b0810 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287286268 0 0) 0x7f3268003520 con 0x7f327c0b0810 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 msgr2=0x7f327c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f327c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 >> v1:172.21.15.115:6789/0 conn(0x7f327c0ae110 legacy=0x7f327c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c0ae920 con 0x7f327c0b0810 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f32740019f0 con 0x7f327c0b0810 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 >> v1:172.21.15.49:6789/0 conn(0x7f327c0b0810 legacy=0x7f327c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3268003a10 0x7f3268003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.464+0000 7f32808f6640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32680047c0 0x7f3268004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32808f6640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f3268005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06b8c0 con 0x7f32680047c0 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326800ba30 con 0x7f3268003a10 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326800bbf0 con 0x7f327c157bf0 2023-12-19T05:43:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32680047c0 0x7f3268004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32818f8640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3268003a10 0x7f3268003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32820f9640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f3268005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 -- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 msgr2=0x7f3268005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c157bf0 0x7f3268005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 -- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3268003a10 msgr2=0x7f3268003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3268003a10 0x7f3268003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.465+0000 7f32810f7640 1 -- 172.21.15.49:0/3168748014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268003520 con 0x7f32680047c0 2023-12-19T05:43:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.466+0000 7f32810f7640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32680047c0 0x7f3268004c40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f326c0013f0 tx=0x7f32680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a0428d6a65151f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c032660 con 0x7f32680047c0 2023-12-19T05:43:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c0327e0 con 0x7f32680047c0 2023-12-19T05:43:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f32808f6640 1 -- 172.21.15.49:0/3168748014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c032b90 con 0x7f32680047c0 2023-12-19T05:43:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f3283b5c640 1 -- 172.21.15.49:0/3168748014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32680047c0 msgr2=0x7f3268004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f3283b5c640 1 --2- 172.21.15.49:0/3168748014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32680047c0 0x7f3268004c40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f326c0013f0 tx=0x7f32680057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f32820f9640 1 -- 172.21.15.49:0/3168748014 reap_dead start 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f3283b5c640 1 -- 172.21.15.49:0/3168748014 shutdown_connections 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f3283b5c640 1 -- 172.21.15.49:0/3168748014 >> 172.21.15.49:0/3168748014 conn(0x7f327c0cbb70 msgr2=0x7f327c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.467+0000 7f3283b5c640 1 -- 172.21.15.49:0/3168748014 shutdown_connections 2023-12-19T05:43:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.468+0000 7f3283b5c640 1 -- 172.21.15.49:0/3168748014 wait complete. 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.469+0000 7f3283b5c640 1 Processor -- start 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.469+0000 7f3283b5c640 1 -- start start 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 0x7f327c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c15b9a0 0x7f327c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1512a0 con 0x7f327c15be20 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c158720 con 0x7f32680047c0 2023-12-19T05:43:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.470+0000 7f3283b5c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c158a00 con 0x7f327c15b9a0 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47670/0 (socket says 172.21.15.49:47670) 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 -- 172.21.15.49:0/109350668 learned_addr learned my addr 172.21.15.49:0/109350668 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32810f7640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c15b9a0 0x7f327c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32818f8640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 0x7f327c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 -- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c15b9a0 msgr2=0x7f327c15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c15b9a0 0x7f327c15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 -- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 msgr2=0x7f327c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 0x7f327c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c158ce0 con 0x7f327c15be20 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32818f8640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 0x7f327c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.471+0000 7f32820f9640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f327c0cf010 tx=0x7f3274007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.472+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ea40 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.472+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400ebc0 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.472+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274013420 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.472+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c158fc0 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.472+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c151740 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.473+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c1594e0 con 0x7f327c15be20 2023-12-19T05:43:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.474+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3274013580 con 0x7f327c15be20 2023-12-19T05:43:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.475+0000 7f32727fc640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 0x7f326006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.475+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3274088cf0 con 0x7f327c15be20 2023-12-19T05:43:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.475+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f3260072020 con 0x7f327c15be20 2023-12-19T05:43:33.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.475+0000 7f32818f8640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 0x7f326006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.476+0000 7f32818f8640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 0x7f326006c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3278009a00 tx=0x7f3278008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.479+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f327c1594e0 con 0x7f327c15be20 2023-12-19T05:43:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.715+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f327c1594e0 con 0x7f327c15be20 2023-12-19T05:43:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.716+0000 7f32727fc640 1 -- 172.21.15.49:0/109350668 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f327c1594e0 con 0x7f327c15be20 2023-12-19T05:43:33.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:33.718 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:43:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.718+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 msgr2=0x7f326006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.718+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 0x7f326006c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3278009a00 tx=0x7f3278008040 comp rx=0 tx=0).stop 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 msgr2=0x7f327c15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f327c0cf010 tx=0x7f3274007b10 comp rx=0 tx=0).stop 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 shutdown_connections 2023-12-19T05:43:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f326006a430 0x7f326006c8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f327c15b9a0 0x7f327c15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f327c15be20 0x7f327c15e240 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 --2- 172.21.15.49:0/109350668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32680047c0 0x7f327c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 >> 172.21.15.49:0/109350668 conn(0x7f327c0cbb70 msgr2=0x7f327c15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 shutdown_connections 2023-12-19T05:43:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.719+0000 7f3283b5c640 1 -- 172.21.15.49:0/109350668 wait complete. 2023-12-19T05:43:33.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:33.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.968+0000 7f8fb2311640 1 Processor -- start 2023-12-19T05:43:33.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.969+0000 7f8fb2311640 1 -- start start 2023-12-19T05:43:33.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb2311640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fac0b2030 0x7f8fac15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb2311640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac15ec30 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb2311640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac15fbc0 con 0x7f8fac15e5a0 2023-12-19T05:43:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb2311640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac15e980 con 0x7f8fac0b2030 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb1b10640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8fac0cdbf0 0x7f8fac06c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56466/0 (socket says 172.21.15.49:56466) 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.971+0000 7f8fb1b10640 1 -- 172.21.15.49:0/2535487434 learned_addr learned my addr 172.21.15.49:0/2535487434 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.972+0000 7f8fb0b0e640 1 --2- 172.21.15.49:0/2535487434 >> v2:172.21.15.115:3300/0 conn(0x7f8fac0b2030 0x7f8fac15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.972+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567461477 0 0) 0x7f8fac15ec30 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.972+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f98003520 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.972+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3577956338 0 0) 0x7f8f98003520 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.973+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/2535487434 >> v1:172.21.15.115:6789/0 conn(0x7f8fac15e5a0 legacy=0x7f8fac0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.973+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/2535487434 >> v1:172.21.15.49:6789/0 conn(0x7f8fac0cdbf0 legacy=0x7f8fac06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.973+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/2535487434 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0b2f90 con 0x7f8fac0b2030 2023-12-19T05:43:33.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.974+0000 7f8fb0b0e640 1 --2- 172.21.15.49:0/2535487434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac0b2030 0x7f8fac15f680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097d0 tx=0x7f8f9c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47da211764293e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.974+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c02f050 con 0x7f8fac0b2030 2023-12-19T05:43:33.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.974+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c031500 con 0x7f8fac0b2030 2023-12-19T05:43:33.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.974+0000 7f8fa3fff640 1 -- 172.21.15.49:0/2535487434 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40019f0 con 0x7f8fac0b2030 2023-12-19T05:43:33.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 -- 172.21.15.49:0/2535487434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac0b2030 msgr2=0x7f8fac15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 --2- 172.21.15.49:0/2535487434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac0b2030 0x7f8fac15f680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097d0 tx=0x7f8f9c02b820 comp rx=0 tx=0).stop 2023-12-19T05:43:33.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 -- 172.21.15.49:0/2535487434 shutdown_connections 2023-12-19T05:43:33.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 --2- 172.21.15.49:0/2535487434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac0b2030 0x7f8fac15f680 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 -- 172.21.15.49:0/2535487434 >> 172.21.15.49:0/2535487434 conn(0x7f8fac0b0100 msgr2=0x7f8fac0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:33.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 -- 172.21.15.49:0/2535487434 shutdown_connections 2023-12-19T05:43:33.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.975+0000 7f8fb2311640 1 -- 172.21.15.49:0/2535487434 wait complete. 2023-12-19T05:43:33.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.977+0000 7f8fb2311640 1 Processor -- start 2023-12-19T05:43:33.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.977+0000 7f8fb2311640 1 -- start start 2023-12-19T05:43:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fac0b2030 0x7f8fac0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac15e5a0 0x7f8fac0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac14c130 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac157220 con 0x7f8fac15e5a0 2023-12-19T05:43:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb2311640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0cd010 con 0x7f8fac0b2030 2023-12-19T05:43:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb0b0e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.978+0000 7f8fb0b0e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47676/0 (socket says 172.21.15.49:47676) 2023-12-19T05:43:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/857582339 learned_addr learned my addr 172.21.15.49:0/857582339 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb130f640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fac0b2030 0x7f8fac0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb1b10640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac15e5a0 0x7f8fac0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fac0b2030 msgr2=0x7f8fac0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fac0b2030 0x7f8fac0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac15e5a0 msgr2=0x7f8fac0a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac15e5a0 0x7f8fac0a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:33.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009400 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.979+0000 7f8fb0b0e640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c036040 tx=0x7f8f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.980+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c004220 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.980+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c004380 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.980+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c03d960 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.980+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0cc400 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.980+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac0cc9c0 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.981+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac0cd180 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.982+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f9c03a040 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.983+0000 7f8fa1ffb640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 0x7f8f9006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:33.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.983+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8f9c0a9f20 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.983+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f8f90072050 con 0x7f8fac0cdbf0 2023-12-19T05:43:33.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.984+0000 7f8fb130f640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 0x7f8f9006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:33.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.985+0000 7f8fb130f640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 0x7f8f9006c920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8fac1576c0 tx=0x7f8fa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:33.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:33.987+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f9c038060 con 0x7f8fac0cdbf0 2023-12-19T05:43:34.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.183+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fac061910 con 0x7f8fac0cdbf0 2023-12-19T05:43:34.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.186+0000 7f8fa1ffb640 1 -- 172.21.15.49:0/857582339 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16230 (secure 0 0 0) 0x7f8f9c044020 con 0x7f8fac0cdbf0 2023-12-19T05:43:34.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:34.188 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:33.442143+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.28","mappings":[{"from":6,"to":4}]},{"pgid":"9.3c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 msgr2=0x7f8f9006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 0x7f8f9006c920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8fac1576c0 tx=0x7f8fa8009040 comp rx=0 tx=0).stop 2023-12-19T05:43:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 msgr2=0x7f8fac14bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c036040 tx=0x7f8f9c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 shutdown_connections 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f9006a460 0x7f8f9006c920 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fac15e5a0 0x7f8fac0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac0cdbf0 0x7f8fac14bbf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 --2- 172.21.15.49:0/857582339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fac0b2030 0x7f8fac0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.189+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 >> 172.21.15.49:0/857582339 conn(0x7f8fac0b0100 msgr2=0x7f8fac06c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.190+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 shutdown_connections 2023-12-19T05:43:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.190+0000 7f8fb2311640 1 -- 172.21.15.49:0/857582339 wait complete. 2023-12-19T05:43:34.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:42:09.134540+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:42:09.927610+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:43:34.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:43:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.441+0000 7fd17e254640 1 Processor -- start 2023-12-19T05:43:34.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.441+0000 7fd17e254640 1 -- start start 2023-12-19T05:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.442+0000 7fd17e254640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd178146cd0 0x7fd1780b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.442+0000 7fd17e254640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd17806fba0 0x7fd1780d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.442+0000 7fd17e254640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd178070260 con 0x7fd1780b6890 2023-12-19T05:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.442+0000 7fd17e254640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1781470b0 con 0x7fd178146cd0 2023-12-19T05:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.442+0000 7fd17e254640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1780b6ea0 con 0x7fd17806fba0 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.443+0000 7fd17d252640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd178146cd0 0x7fd1780b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.443+0000 7fd17d252640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd178146cd0 0x7fd1780b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32880/0 (socket says 172.21.15.49:32880) 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.443+0000 7fd17d252640 1 -- 172.21.15.49:0/1496593870 learned_addr learned my addr 172.21.15.49:0/1496593870 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.443+0000 7fd17ca51640 1 --1- 172.21.15.49:0/1496593870 >> v1:172.21.15.115:6789/0 conn(0x7fd1780b6890 0x7fd17806f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:34068/0 (socket says 172.21.15.49:34068) 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.443+0000 7fd17da53640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd17806fba0 0x7fd1780d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.444+0000 7fd17d252640 1 -- 172.21.15.49:0/1496593870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd17806fba0 msgr2=0x7fd1780d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.444+0000 7fd17d252640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd17806fba0 0x7fd1780d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.444+0000 7fd17d252640 1 -- 172.21.15.49:0/1496593870 >> v1:172.21.15.115:6789/0 conn(0x7fd1780b6890 legacy=0x7fd17806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.444+0000 7fd17d252640 1 -- 172.21.15.49:0/1496593870 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1780b7180 con 0x7fd178146cd0 2023-12-19T05:43:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.445+0000 7fd17d252640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd178146cd0 0x7fd1780b6350 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd174009870 tx=0x7fd17402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15abbdcd25f7a0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.448+0000 7fd16ffff640 1 -- 172.21.15.49:0/1496593870 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174031640 con 0x7fd178146cd0 2023-12-19T05:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.448+0000 7fd16ffff640 1 -- 172.21.15.49:0/1496593870 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1740317a0 con 0x7fd178146cd0 2023-12-19T05:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.448+0000 7fd16ffff640 1 -- 172.21.15.49:0/1496593870 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174031b30 con 0x7fd178146cd0 2023-12-19T05:43:34.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 -- 172.21.15.49:0/1496593870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd178146cd0 msgr2=0x7fd1780b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd178146cd0 0x7fd1780b6350 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd174009870 tx=0x7fd17402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 -- 172.21.15.49:0/1496593870 shutdown_connections 2023-12-19T05:43:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd17806fba0 0x7fd1780d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 --2- 172.21.15.49:0/1496593870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd178146cd0 0x7fd1780b6350 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 -- 172.21.15.49:0/1496593870 >> 172.21.15.49:0/1496593870 conn(0x7fd1780d3200 msgr2=0x7fd1780d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 -- 172.21.15.49:0/1496593870 shutdown_connections 2023-12-19T05:43:34.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.449+0000 7fd17e254640 1 -- 172.21.15.49:0/1496593870 wait complete. 2023-12-19T05:43:34.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.451+0000 7fd17e254640 1 Processor -- start 2023-12-19T05:43:34.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.451+0000 7fd17e254640 1 -- start start 2023-12-19T05:43:34.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1780b6890 0x7fd178142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd178146cd0 0x7fd178155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178143460 con 0x7fd17806fba0 2023-12-19T05:43:34.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178155fc0 con 0x7fd1780b6890 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17e254640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd178159720 con 0x7fd178146cd0 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17d252640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17d252640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32888/0 (socket says 172.21.15.49:32888) 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.452+0000 7fd17d252640 1 -- 172.21.15.49:0/2248897317 learned_addr learned my addr 172.21.15.49:0/2248897317 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17da53640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd178146cd0 0x7fd178155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17ca51640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1780b6890 0x7fd178142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 -- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd178146cd0 msgr2=0x7fd178155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd178146cd0 0x7fd178155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 -- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1780b6890 msgr2=0x7fd178142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1780b6890 0x7fd178142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740094d0 con 0x7fd17806fba0 2023-12-19T05:43:34.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.453+0000 7fd17d252640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.456+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17403a930 con 0x7fd17806fba0 2023-12-19T05:43:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.456+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17403aa90 con 0x7fd17806fba0 2023-12-19T05:43:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.456+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178159a00 con 0x7fd17806fba0 2023-12-19T05:43:34.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.456+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17403ae40 con 0x7fd17806fba0 2023-12-19T05:43:34.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.456+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd178143e20 con 0x7fd17806fba0 2023-12-19T05:43:34.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.457+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17815a330 con 0x7fd17806fba0 2023-12-19T05:43:34.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.458+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd17402f050 con 0x7fd17806fba0 2023-12-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.460+0000 7fd16dffb640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 0x7fd15c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.460+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd1740aa9c0 con 0x7fd17806fba0 2023-12-19T05:43:34.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.460+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fd15c072020 con 0x7fd17806fba0 2023-12-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.462+0000 7fd17ca51640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 0x7fd15c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.464+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd174035060 con 0x7fd17806fba0 2023-12-19T05:43:34.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.465+0000 7fd17ca51640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 0x7fd15c06c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd168007fd0 tx=0x7fd168009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.665+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd178061910 con 0x7fd17806fba0 2023-12-19T05:43:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.666+0000 7fd16dffb640 1 -- 172.21.15.49:0/2248897317 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd174035030 con 0x7fd17806fba0 2023-12-19T05:43:34.667 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 msgr2=0x7fd15c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 0x7fd15c06c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd168007fd0 tx=0x7fd168009040 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 msgr2=0x7fd178143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd1740046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 shutdown_connections 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd15c06a430 0x7fd15c06c8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd178146cd0 0x7fd178155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1780b6890 0x7fd178142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 --2- 172.21.15.49:0/2248897317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd17806fba0 0x7fd178143790 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 >> 172.21.15.49:0/2248897317 conn(0x7fd1780d3200 msgr2=0x7fd17815dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 shutdown_connections 2023-12-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.668+0000 7fd17e254640 1 -- 172.21.15.49:0/2248897317 wait complete. 2023-12-19T05:43:34.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:43:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.929+0000 7f4d1a2c5640 1 Processor -- start 2023-12-19T05:43:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.930+0000 7f4d1a2c5640 1 -- start start 2023-12-19T05:43:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d141615b0 0x7f4d1406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d1406dec0 0x7f4d14165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d140b02f0 0x7f4d140b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d140b0cc0 con 0x7f4d1406dec0 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d141656d0 con 0x7f4d141615b0 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d1a2c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140b1870 con 0x7f4d140b02f0 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d18ac2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d1406dec0 0x7f4d14165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d18ac2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d1406dec0 0x7f4d14165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32892/0 (socket says 172.21.15.49:32892) 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d18ac2640 1 -- 172.21.15.49:0/3019975840 learned_addr learned my addr 172.21.15.49:0/3019975840 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d18ac2640 1 -- 172.21.15.49:0/3019975840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d140b02f0 msgr2=0x7f4d140b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.932+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/3019975840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d140b02f0 0x7f4d140b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.933+0000 7f4d18ac2640 1 -- 172.21.15.49:0/3019975840 >> v2:172.21.15.115:3300/0 conn(0x7f4d141615b0 msgr2=0x7f4d1406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.933+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/3019975840 >> v2:172.21.15.115:3300/0 conn(0x7f4d141615b0 0x7f4d1406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.933+0000 7f4d18ac2640 1 -- 172.21.15.49:0/3019975840 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d140cc760 con 0x7f4d1406dec0 2023-12-19T05:43:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.934+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/3019975840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1406dec0 0x7f4d14165190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d140af910 tx=0x7f4d0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61dbb8f5b967492 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.934+0000 7f4d0bfff640 1 -- 172.21.15.49:0/3019975840 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04031870 con 0x7f4d1406dec0 2023-12-19T05:43:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.934+0000 7f4d0bfff640 1 -- 172.21.15.49:0/3019975840 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d040319d0 con 0x7f4d1406dec0 2023-12-19T05:43:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.934+0000 7f4d0bfff640 1 -- 172.21.15.49:0/3019975840 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04031d60 con 0x7f4d1406dec0 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/3019975840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1406dec0 msgr2=0x7f4d14165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/3019975840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1406dec0 0x7f4d14165190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d140af910 tx=0x7f4d0402b910 comp rx=0 tx=0).stop 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/3019975840 shutdown_connections 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/3019975840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d140b02f0 0x7f4d140b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/3019975840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1406dec0 0x7f4d14165190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/3019975840 >> v2:172.21.15.115:3300/0 conn(0x7f4d141615b0 0x7f4d1406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/3019975840 >> 172.21.15.49:0/3019975840 conn(0x7f4d140659a0 msgr2=0x7f4d14065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:34.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/3019975840 shutdown_connections 2023-12-19T05:43:34.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.935+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/3019975840 wait complete. 2023-12-19T05:43:34.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.937+0000 7f4d1a2c5640 1 Processor -- start 2023-12-19T05:43:34.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.937+0000 7f4d1a2c5640 1 -- start start 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 0x7f4d141f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 0x7f4d14158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14160dc0 con 0x7f4d140b02f0 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14162b80 con 0x7f4d1406dec0 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d1a2c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14162e60 con 0x7f4d141615b0 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32898/0 (socket says 172.21.15.49:32898) 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 -- 172.21.15.49:0/2824325107 learned_addr learned my addr 172.21.15.49:0/2824325107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 -- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 msgr2=0x7f4d14158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d19ac4640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 0x7f4d14158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 0x7f4d14158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d18ac2640 1 -- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 msgr2=0x7f4d141f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.938+0000 7f4d192c3640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 0x7f4d141f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 0x7f4d141f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d18ac2640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040094d0 con 0x7f4d140b02f0 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d19ac4640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 0x7f4d14158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:34.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d192c3640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 0x7f4d141f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d18ac2640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000c00 tx=0x7f4d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0403ad10 con 0x7f4d140b02f0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0403ae70 con 0x7f4d140b02f0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14163140 con 0x7f4d140b02f0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04044610 con 0x7f4d140b02f0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.939+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d14163700 con 0x7f4d140b02f0 2023-12-19T05:43:34.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.941+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d141638f0 con 0x7f4d140b02f0 2023-12-19T05:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.942+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d0404d450 con 0x7f4d140b02f0 2023-12-19T05:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.943+0000 7f4d09ffb640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 0x7f4cf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.943+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4d0402d040 con 0x7f4d140b02f0 2023-12-19T05:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.943+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f4cf8072010 con 0x7f4d140b02f0 2023-12-19T05:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.943+0000 7f4d192c3640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 0x7f4cf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.944+0000 7f4d192c3640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 0x7f4cf806c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000a870 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:34.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:34.947+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d04076680 con 0x7f4d140b02f0 2023-12-19T05:43:35.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.148+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d14061910 con 0x7f4d140b02f0 2023-12-19T05:43:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.149+0000 7f4d09ffb640 1 -- 172.21.15.49:0/2824325107 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d04079ca0 con 0x7f4d140b02f0 2023-12-19T05:43:35.151 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 msgr2=0x7f4cf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 0x7f4cf806c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000a870 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 msgr2=0x7f4d14163c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000c00 tx=0x7f4d040046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 shutdown_connections 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4cf806a430 0x7f4cf806c8f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d141615b0 0x7f4d14158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d140b02f0 0x7f4d14163c20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 --2- 172.21.15.49:0/2824325107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d1406dec0 0x7f4d141f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 >> 172.21.15.49:0/2824325107 conn(0x7f4d140659a0 msgr2=0x7f4d1415c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 shutdown_connections 2023-12-19T05:43:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.152+0000 7f4d1a2c5640 1 -- 172.21.15.49:0/2824325107 wait complete. 2023-12-19T05:43:35.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:43:35.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.406+0000 7f4b234e5640 1 Processor -- start 2023-12-19T05:43:35.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.406+0000 7f4b234e5640 1 -- start start 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.408+0000 7f4b234e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4b1c141900 0x7f4b1c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.408+0000 7f4b234e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 0x7f4b1c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.408+0000 7f4b234e5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c06e220 con 0x7f4b1c06da30 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.408+0000 7f4b234e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0cbea0 con 0x7f4b1c141900 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.408+0000 7f4b234e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0cc180 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b22ce4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4b1c06da30 0x7f4b1c0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41156/0 (socket says 172.21.15.49:41156) 2023-12-19T05:43:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b22ce4640 1 -- 172.21.15.49:0/712704614 learned_addr learned my addr 172.21.15.49:0/712704614 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/712704614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 0x7f4b1c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b224e3640 1 --2- 172.21.15.49:0/712704614 >> v2:172.21.15.115:3300/0 conn(0x7f4b1c141900 0x7f4b1c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b214e1640 1 -- 172.21.15.49:0/712704614 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624514635 0 0) 0x7f4b1c06e220 con 0x7f4b1c06da30 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.409+0000 7f4b214e1640 1 -- 172.21.15.49:0/712704614 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b08003520 con 0x7f4b1c06da30 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.410+0000 7f4b21ce2640 1 -- 172.21.15.49:0/712704614 >> v2:172.21.15.115:3300/0 conn(0x7f4b1c141900 msgr2=0x7f4b1c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.410+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/712704614 >> v2:172.21.15.115:3300/0 conn(0x7f4b1c141900 0x7f4b1c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.410+0000 7f4b21ce2640 1 -- 172.21.15.49:0/712704614 >> v1:172.21.15.49:6789/0 conn(0x7f4b1c06da30 legacy=0x7f4b1c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.410+0000 7f4b21ce2640 1 -- 172.21.15.49:0/712704614 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0b0700 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.411+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/712704614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 0x7f4b1c06d4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097a0 tx=0x7f4b0c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779924a5f0074ce8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.411+0000 7f4b214e1640 1 -- 172.21.15.49:0/712704614 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c02d040 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b214e1640 1 -- 172.21.15.49:0/712704614 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c031810 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b214e1640 1 -- 172.21.15.49:0/712704614 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c031b80 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 -- 172.21.15.49:0/712704614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 msgr2=0x7f4b1c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 --2- 172.21.15.49:0/712704614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 0x7f4b1c06d4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097a0 tx=0x7f4b0c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 -- 172.21.15.49:0/712704614 shutdown_connections 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 --2- 172.21.15.49:0/712704614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c0b02a0 0x7f4b1c06d4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 --2- 172.21.15.49:0/712704614 >> v2:172.21.15.115:3300/0 conn(0x7f4b1c141900 0x7f4b1c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 -- 172.21.15.49:0/712704614 >> 172.21.15.49:0/712704614 conn(0x7f4b1c06f630 msgr2=0x7f4b1c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 -- 172.21.15.49:0/712704614 shutdown_connections 2023-12-19T05:43:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.412+0000 7f4b234e5640 1 -- 172.21.15.49:0/712704614 wait complete. 2023-12-19T05:43:35.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.414+0000 7f4b234e5640 1 Processor -- start 2023-12-19T05:43:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.414+0000 7f4b234e5640 1 -- start start 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c06da30 0x7f4b1c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b1c141900 0x7f4b1c1e6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b2590 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b1980 con 0x7f4b1c141900 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.415+0000 7f4b234e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b1c60 con 0x7f4b1c06da30 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32914/0 (socket says 172.21.15.49:32914) 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 -- 172.21.15.49:0/4156032765 learned_addr learned my addr 172.21.15.49:0/4156032765 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b224e3640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c06da30 0x7f4b1c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b22ce4640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b1c141900 0x7f4b1c1e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 -- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c06da30 msgr2=0x7f4b1c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c06da30 0x7f4b1c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 -- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b1c141900 msgr2=0x7f4b1c1e6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b1c141900 0x7f4b1c1e6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.416+0000 7f4b21ce2640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009400 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b21ce2640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c000c00 tx=0x7f4b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003820 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c03f070 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c0b1f40 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003bc0 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.417+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c1e55b0 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.418+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c061910 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.419+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b0c003d20 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.420+0000 7f4b12ffd640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 0x7f4b0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.420+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4b0c041070 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.421+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f4b00072020 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.421+0000 7f4b224e3640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 0x7f4b0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.422+0000 7f4b224e3640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 0x7f4b0006c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009a30 tx=0x7f4b18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.425+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b0c04b020 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.620+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b1c06fe20 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.621+0000 7f4b12ffd640 1 -- 172.21.15.49:0/4156032765 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b0c035070 con 0x7f4b1c0b02a0 2023-12-19T05:43:35.622 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:43:35.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.623+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 msgr2=0x7f4b0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.623+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 0x7f4b0006c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009a30 tx=0x7f4b18008040 comp rx=0 tx=0).stop 2023-12-19T05:43:35.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 msgr2=0x7f4b1c0b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c000c00 tx=0x7f4b0c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 shutdown_connections 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4b0006a430 0x7f4b0006c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b1c141900 0x7f4b1c1e6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b1c0b02a0 0x7f4b1c0b0ee0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 --2- 172.21.15.49:0/4156032765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1c06da30 0x7f4b1c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 >> 172.21.15.49:0/4156032765 conn(0x7f4b1c06f630 msgr2=0x7f4b1c15c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 shutdown_connections 2023-12-19T05:43:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.624+0000 7f4b234e5640 1 -- 172.21.15.49:0/4156032765 wait complete. 2023-12-19T05:43:35.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.864+0000 7efe0b59e640 1 Processor -- start 2023-12-19T05:43:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.864+0000 7efe0b59e640 1 -- start start 2023-12-19T05:43:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe0c15f680 0x7efe0c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efe0c0cdbf0 0x7efe0c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0ce5c0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c15ec30 con 0x7efe0c15f680 2023-12-19T05:43:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.866+0000 7efe0b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b2cc0 con 0x7efe0c15e5a0 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efe0c0cdbf0 0x7efe0c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efe0c0cdbf0 0x7efe0c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32916/0 (socket says 172.21.15.49:32916) 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 -- 172.21.15.49:0/3753944224 learned_addr learned my addr 172.21.15.49:0/3753944224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0a59c640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe01d9b640 1 --2- 172.21.15.49:0/3753944224 >> v2:172.21.15.115:3300/0 conn(0x7efe0c15f680 0x7efe0c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 -- 172.21.15.49:0/3753944224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 msgr2=0x7efe0c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 -- 172.21.15.49:0/3753944224 >> v2:172.21.15.115:3300/0 conn(0x7efe0c15f680 msgr2=0x7efe0c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 --2- 172.21.15.49:0/3753944224 >> v2:172.21.15.115:3300/0 conn(0x7efe0c15f680 0x7efe0c0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.867+0000 7efe0ad9d640 1 -- 172.21.15.49:0/3753944224 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c15e980 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.868+0000 7efe0ad9d640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c0ce080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0cfe20 tx=0x7efe0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313df418efd21009 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.869+0000 7efe09d9b640 1 -- 172.21.15.49:0/3753944224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0402ca70 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.869+0000 7efe09d9b640 1 -- 172.21.15.49:0/3753944224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0402cbd0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.869+0000 7efe09d9b640 1 -- 172.21.15.49:0/3753944224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040343f0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 -- 172.21.15.49:0/3753944224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 msgr2=0x7efe0c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c0ce080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0cfe20 tx=0x7efe0402bed0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 -- 172.21.15.49:0/3753944224 shutdown_connections 2023-12-19T05:43:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c0ce080 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3753944224 >> v2:172.21.15.115:3300/0 conn(0x7efe0c15f680 0x7efe0c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3753944224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 -- 172.21.15.49:0/3753944224 >> 172.21.15.49:0/3753944224 conn(0x7efe0c0b0100 msgr2=0x7efe0c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 -- 172.21.15.49:0/3753944224 shutdown_connections 2023-12-19T05:43:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.870+0000 7efe0b59e640 1 -- 172.21.15.49:0/3753944224 wait complete. 2023-12-19T05:43:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.872+0000 7efe0b59e640 1 Processor -- start 2023-12-19T05:43:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.872+0000 7efe0b59e640 1 -- start start 2023-12-19T05:43:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 0x7efe0c1f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c146900 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c149630 con 0x7efe0c15f680 2023-12-19T05:43:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c149910 con 0x7efe0c15e5a0 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.873+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32918/0 (socket says 172.21.15.49:32918) 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 -- 172.21.15.49:0/3411206333 learned_addr learned my addr 172.21.15.49:0/3411206333 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe01d9b640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 -- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 msgr2=0x7efe0c1f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0ad9d640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 0x7efe0c1f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c1f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 -- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 msgr2=0x7efe0c1f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 0x7efe0c1f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009b30 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0ad9d640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 0x7efe0c1f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.874+0000 7efe0a59c640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d800 tx=0x7efdfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.875+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00b6c0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.875+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc00b820 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.875+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00bbb0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.875+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c149bf0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.875+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c14a1b0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.876+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c061910 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.877+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efdfc00bd10 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.878+0000 7efe037fe640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:35.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.878+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efdfc088ea0 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.878+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7efdec072020 con 0x7efe0c0cdbf0 2023-12-19T05:43:35.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.879+0000 7efe01d9b640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.880+0000 7efe01d9b640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 0x7efdec06c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006fd0 tx=0x7efdf4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:35.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:35.883+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efdfc054450 con 0x7efe0c0cdbf0 2023-12-19T05:43:36.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.116+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe0c0ce980 con 0x7efe0c0cdbf0 2023-12-19T05:43:36.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.117+0000 7efe037fe640 1 -- 172.21.15.49:0/3411206333 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7efdfc057a70 con 0x7efe0c0cdbf0 2023-12-19T05:43:36.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:36.119 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:43:36.119 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:43:36.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 msgr2=0x7efdec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 0x7efdec06c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006fd0 tx=0x7efdf4008040 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 msgr2=0x7efe0c145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d800 tx=0x7efdfc00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 shutdown_connections 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdec06a430 0x7efdec06c8f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe0c15e5a0 0x7efe0c1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe0c15f680 0x7efe0c1f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 --2- 172.21.15.49:0/3411206333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0cdbf0 0x7efe0c145380 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 >> 172.21.15.49:0/3411206333 conn(0x7efe0c0b0100 msgr2=0x7efe0c0ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 shutdown_connections 2023-12-19T05:43:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.120+0000 7efe0b59e640 1 -- 172.21.15.49:0/3411206333 wait complete. 2023-12-19T05:43:36.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:36.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.367+0000 7fd3dcb00640 1 Processor -- start 2023-12-19T05:43:36.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.368+0000 7fd3dcb00640 1 -- start start 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3dcb00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3d8166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3dcb00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d806bb30 con 0x7fd3d81449e0 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3dcb00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d80b0070 con 0x7fd3d80b0b50 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3dcb00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80b0350 con 0x7fd3d806c6b0 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3d659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd3d81449e0 0x7fd3d80af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41158/0 (socket says 172.21.15.49:41158) 2023-12-19T05:43:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3d659c640 1 -- 172.21.15.49:0/1025842420 learned_addr learned my addr 172.21.15.49:0/1025842420 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3d6d9d640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3d8166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765011751 0 0) 0x7fd3d806bb30 con 0x7fd3d81449e0 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.370+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4003520 con 0x7fd3d81449e0 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412573528 0 0) 0x7fd3c4003520 con 0x7fd3d81449e0 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 msgr2=0x7fd3d8166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3d8166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 >> v1:172.21.15.115:6789/0 conn(0x7fd3d80b0b50 legacy=0x7fd3d806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80b0630 con 0x7fd3d81449e0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd3c8001670 con 0x7fd3d81449e0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 >> v1:172.21.15.49:6789/0 conn(0x7fd3d81449e0 legacy=0x7fd3d80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c4003a10 0x7fd3c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c4004d00 0x7fd3c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80b0350 con 0x7fd3c4003a10 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c400bb10 con 0x7fd3c4004d00 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c400bcd0 con 0x7fd3d806c6b0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.371+0000 7fd3d659c640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c4003a10 0x7fd3c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3cffff640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d6d9d640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c4004d00 0x7fd3c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d659c640 1 -- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 msgr2=0x7fd3c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d659c640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3d806c6b0 0x7fd3c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d659c640 1 -- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c4004d00 msgr2=0x7fd3c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d659c640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c4004d00 0x7fd3c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d659c640 1 -- 172.21.15.49:0/1025842420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4003520 con 0x7fd3c4003a10 2023-12-19T05:43:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.372+0000 7fd3d6d9d640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c4004d00 0x7fd3c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.373+0000 7fd3d659c640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c4003a10 0x7fd3c4003e30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001eb0 tx=0x7fd3c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d50152234369b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.373+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8005ad0 con 0x7fd3c4003a10 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.373+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8005c30 con 0x7fd3c4003a10 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.373+0000 7fd3d5d9b640 1 -- 172.21.15.49:0/1025842420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c802c7c0 con 0x7fd3c4003a10 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 -- 172.21.15.49:0/1025842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c4003a10 msgr2=0x7fd3c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/1025842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c4003a10 0x7fd3c4003e30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001eb0 tx=0x7fd3c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3d6d9d640 1 -- 172.21.15.49:0/1025842420 reap_dead start 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 -- 172.21.15.49:0/1025842420 shutdown_connections 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 -- 172.21.15.49:0/1025842420 >> 172.21.15.49:0/1025842420 conn(0x7fd3d80cbb70 msgr2=0x7fd3d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:36.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 -- 172.21.15.49:0/1025842420 shutdown_connections 2023-12-19T05:43:36.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.374+0000 7fd3dcb00640 1 -- 172.21.15.49:0/1025842420 wait complete. 2023-12-19T05:43:36.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.376+0000 7fd3dcb00640 1 Processor -- start 2023-12-19T05:43:36.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.376+0000 7fd3dcb00640 1 -- start start 2023-12-19T05:43:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c4003a10 0x7fd3d81f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d815b7f0 0x7fd3d815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d815c1b0 con 0x7fd3d814e1b0 2023-12-19T05:43:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d81f2720 con 0x7fd3d815b7f0 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3dcb00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d814afd0 con 0x7fd3c4003a10 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.377+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32934/0 (socket says 172.21.15.49:32934) 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 -- 172.21.15.49:0/3761963292 learned_addr learned my addr 172.21.15.49:0/3761963292 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3d659c640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c4003a10 0x7fd3d81f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 -- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c4003a10 msgr2=0x7fd3d81f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c4003a10 0x7fd3d81f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 -- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d815b7f0 msgr2=0x7fd3d815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d815b7f0 0x7fd3d815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d814b250 con 0x7fd3d814e1b0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.378+0000 7fd3cffff640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e5b0 tx=0x7fd3c000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.379+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00052e0 con 0x7fd3d814e1b0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.379+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0005440 con 0x7fd3d814e1b0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.379+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0003810 con 0x7fd3d814e1b0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.379+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d81f1e30 con 0x7fd3d814e1b0 2023-12-19T05:43:36.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.379+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d81f23b0 con 0x7fd3d814e1b0 2023-12-19T05:43:36.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.380+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d815e020 con 0x7fd3d814e1b0 2023-12-19T05:43:36.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.381+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3c0003970 con 0x7fd3d814e1b0 2023-12-19T05:43:36.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.382+0000 7fd3ceffd640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 0x7fd3b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.382+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd3c00886e0 con 0x7fd3d814e1b0 2023-12-19T05:43:36.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.382+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fd3b8072050 con 0x7fd3d814e1b0 2023-12-19T05:43:36.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.383+0000 7fd3d659c640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 0x7fd3b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.384+0000 7fd3d659c640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 0x7fd3b806c920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001eb0 tx=0x7fd3c8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.386+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3c0053bf0 con 0x7fd3d814e1b0 2023-12-19T05:43:36.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.583+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3d8061910 con 0x7fd3d814e1b0 2023-12-19T05:43:36.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.586+0000 7fd3ceffd640 1 -- 172.21.15.49:0/3761963292 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16215 (secure 0 0 0) 0x7fd3c0057210 con 0x7fd3d814e1b0 2023-12-19T05:43:36.587 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:36.588 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:34.452690+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.28","mappings":[{"from":6,"to":4}]},{"pgid":"9.3c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:36.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 msgr2=0x7fd3b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 0x7fd3b806c920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001eb0 tx=0x7fd3c8009030 comp rx=0 tx=0).stop 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 msgr2=0x7fd3d814aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e5b0 tx=0x7fd3c000ea70 comp rx=0 tx=0).stop 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 shutdown_connections 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3b806a460 0x7fd3b806c920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d815b7f0 0x7fd3d815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d814e1b0 0x7fd3d814aa90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 --2- 172.21.15.49:0/3761963292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c4003a10 0x7fd3d81f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 >> 172.21.15.49:0/3761963292 conn(0x7fd3d80cbb70 msgr2=0x7fd3d80cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 shutdown_connections 2023-12-19T05:43:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.588+0000 7fd3dcb00640 1 -- 172.21.15.49:0/3761963292 wait complete. 2023-12-19T05:43:36.611 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:43:36.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.833+0000 7f218359e640 1 Processor -- start 2023-12-19T05:43:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.833+0000 7f218359e640 1 -- start start 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.835+0000 7f218359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2184146e30 0x7f21840b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.835+0000 7f218359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 0x7f218415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.835+0000 7f218359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840d12d0 con 0x7f21840b7ea0 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.835+0000 7f218359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2184147210 con 0x7f2184146e30 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.835+0000 7f218359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840b8330 con 0x7f21840d0c60 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2184146e30 0x7f21840b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2184146e30 0x7f21840b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32936/0 (socket says 172.21.15.49:32936) 2023-12-19T05:43:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 -- 172.21.15.49:0/561077172 learned_addr learned my addr 172.21.15.49:0/561077172 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f2182d9d640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 0x7f218415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 -- 172.21.15.49:0/561077172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 msgr2=0x7f218415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 0x7f218415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 -- 172.21.15.49:0/561077172 >> v1:172.21.15.115:6789/0 conn(0x7f21840b7ea0 legacy=0x7f21840d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f218259c640 1 -- 172.21.15.49:0/561077172 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840d15b0 con 0x7f2184146e30 2023-12-19T05:43:36.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.836+0000 7f2182d9d640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 0x7f218415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.837+0000 7f218259c640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2184146e30 0x7f21840b7960 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2174009870 tx=0x7f217402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ca86c7198419bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.838+0000 7f218159a640 1 -- 172.21.15.49:0/561077172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740317c0 con 0x7f2184146e30 2023-12-19T05:43:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.838+0000 7f218159a640 1 -- 172.21.15.49:0/561077172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174031920 con 0x7f2184146e30 2023-12-19T05:43:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.838+0000 7f218159a640 1 -- 172.21.15.49:0/561077172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174031cb0 con 0x7f2184146e30 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.838+0000 7f218359e640 1 -- 172.21.15.49:0/561077172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2184146e30 msgr2=0x7f21840b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.838+0000 7f218359e640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2184146e30 0x7f21840b7960 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2174009870 tx=0x7f217402b860 comp rx=0 tx=0).stop 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 -- 172.21.15.49:0/561077172 shutdown_connections 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840d0c60 0x7f218415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 --2- 172.21.15.49:0/561077172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2184146e30 0x7f21840b7960 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 -- 172.21.15.49:0/561077172 >> 172.21.15.49:0/561077172 conn(0x7f21840b2990 msgr2=0x7f21840b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 -- 172.21.15.49:0/561077172 shutdown_connections 2023-12-19T05:43:36.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.839+0000 7f218359e640 1 -- 172.21.15.49:0/561077172 wait complete. 2023-12-19T05:43:36.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.841+0000 7f218359e640 1 Processor -- start 2023-12-19T05:43:36.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.841+0000 7f218359e640 1 -- start start 2023-12-19T05:43:36.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 0x7f21841e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2184146e30 0x7f2184140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841e6430 con 0x7f21840d0c60 2023-12-19T05:43:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841e50c0 con 0x7f2184146e30 2023-12-19T05:43:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21841e5390 con 0x7f21840b7ea0 2023-12-19T05:43:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f2181d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f2181d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32946/0 (socket says 172.21.15.49:32946) 2023-12-19T05:43:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f2181d9b640 1 -- 172.21.15.49:0/1700176004 learned_addr learned my addr 172.21.15.49:0/1700176004 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.842+0000 7f218259c640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 0x7f21841e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2182d9d640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2184146e30 0x7f2184140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 -- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 msgr2=0x7f21841e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 0x7f21841e4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 -- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2184146e30 msgr2=0x7f2184140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2184146e30 0x7f2184140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740094d0 con 0x7f21840d0c60 2023-12-19T05:43:36.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f218259c640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 0x7f21841e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2181d9b640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f217800b3f0 tx=0x7f217800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178011830 con 0x7f21840d0c60 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178011990 con 0x7f21840d0c60 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21841e5670 con 0x7f21840d0c60 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.843+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178011d40 con 0x7f21840d0c60 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.844+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21841e5c30 con 0x7f21840d0c60 2023-12-19T05:43:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.845+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184061910 con 0x7f21840d0c60 2023-12-19T05:43:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.846+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f217801a400 con 0x7f21840d0c60 2023-12-19T05:43:36.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.847+0000 7f2172ffd640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 0x7f216406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:36.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.847+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2178088870 con 0x7f21840d0c60 2023-12-19T05:43:36.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.848+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f2164072020 con 0x7f21840d0c60 2023-12-19T05:43:36.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.848+0000 7f218259c640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 0x7f216406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:36.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.849+0000 7f218259c640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 0x7f216406c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2174036000 tx=0x7f217403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:36.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:36.851+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2178015060 con 0x7f21840d0c60 2023-12-19T05:43:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.082+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21840b5490 con 0x7f21840d0c60 2023-12-19T05:43:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.083+0000 7f2172ffd640 1 -- 172.21.15.49:0/1700176004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f2178053e10 con 0x7f21840d0c60 2023-12-19T05:43:37.085 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:37.085 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:43:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 msgr2=0x7f216406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 0x7f216406c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2174036000 tx=0x7f217403d040 comp rx=0 tx=0).stop 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 msgr2=0x7f2184142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f217800b3f0 tx=0x7f217800b8b0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 shutdown_connections 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.085+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f216406a430 0x7f216406c8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2184146e30 0x7f2184140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21840d0c60 0x7f2184142ef0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 --2- 172.21.15.49:0/1700176004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21840b7ea0 0x7f21841e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 >> 172.21.15.49:0/1700176004 conn(0x7f21840b2990 msgr2=0x7f21840b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:37.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 shutdown_connections 2023-12-19T05:43:37.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.086+0000 7f218359e640 1 -- 172.21.15.49:0/1700176004 wait complete. 2023-12-19T05:43:37.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.336+0000 7f627518b640 1 Processor -- start 2023-12-19T05:43:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.336+0000 7f627518b640 1 -- start start 2023-12-19T05:43:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f627518b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f627006c6b0 0x7f6270166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f627518b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627006bb30 con 0x7f62700b0b50 2023-12-19T05:43:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f627518b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700b0070 con 0x7f62701449e0 2023-12-19T05:43:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f627518b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700b0350 con 0x7f627006c6b0 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f626e59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f62700b0b50 0x7f627006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41166/0 (socket says 172.21.15.49:41166) 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f626e59c640 1 -- 172.21.15.49:0/3612079252 learned_addr learned my addr 172.21.15.49:0/3612079252 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.338+0000 7f626f59e640 1 --2- 172.21.15.49:0/3612079252 >> v2:172.21.15.49:3300/0 conn(0x7f627006c6b0 0x7f6270166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.339+0000 7f626dd9b640 1 -- 172.21.15.49:0/3612079252 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226612511 0 0) 0x7f627006bb30 con 0x7f62700b0b50 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.339+0000 7f626dd9b640 1 -- 172.21.15.49:0/3612079252 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003520 con 0x7f62700b0b50 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.339+0000 7f626f59e640 1 -- 172.21.15.49:0/3612079252 >> v1:172.21.15.115:6789/0 conn(0x7f62701449e0 legacy=0x7f62700af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.339+0000 7f626f59e640 1 -- 172.21.15.49:0/3612079252 >> v1:172.21.15.49:6789/0 conn(0x7f62700b0b50 legacy=0x7f627006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.339+0000 7f626f59e640 1 -- 172.21.15.49:0/3612079252 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700b0630 con 0x7f627006c6b0 2023-12-19T05:43:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.340+0000 7f626f59e640 1 --2- 172.21.15.49:0/3612079252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f627006c6b0 0x7f6270166200 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6268009d90 tx=0x7f626802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824305e1f36468d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.340+0000 7f626dd9b640 1 -- 172.21.15.49:0/3612079252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626802cd00 con 0x7f627006c6b0 2023-12-19T05:43:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.340+0000 7f626dd9b640 1 -- 172.21.15.49:0/3612079252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626802ce60 con 0x7f627006c6b0 2023-12-19T05:43:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f626dd9b640 1 -- 172.21.15.49:0/3612079252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268034640 con 0x7f627006c6b0 2023-12-19T05:43:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 -- 172.21.15.49:0/3612079252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f627006c6b0 msgr2=0x7f6270166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 --2- 172.21.15.49:0/3612079252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f627006c6b0 0x7f6270166200 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6268009d90 tx=0x7f626802bf50 comp rx=0 tx=0).stop 2023-12-19T05:43:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 -- 172.21.15.49:0/3612079252 shutdown_connections 2023-12-19T05:43:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 --2- 172.21.15.49:0/3612079252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f627006c6b0 0x7f6270166200 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 -- 172.21.15.49:0/3612079252 >> 172.21.15.49:0/3612079252 conn(0x7f62700cbb70 msgr2=0x7f62700cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 -- 172.21.15.49:0/3612079252 shutdown_connections 2023-12-19T05:43:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.341+0000 7f627518b640 1 -- 172.21.15.49:0/3612079252 wait complete. 2023-12-19T05:43:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.344+0000 7f627518b640 1 Processor -- start 2023-12-19T05:43:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.344+0000 7f627518b640 1 -- start start 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627006c6b0 0x7f627015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62701449e0 0x7f627013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627013baf0 con 0x7f62700b0b50 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701f2a60 con 0x7f627006c6b0 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.345+0000 7f627518b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627013dd00 con 0x7f62701449e0 2023-12-19T05:43:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32960/0 (socket says 172.21.15.49:32960) 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 -- 172.21.15.49:0/3676958788 learned_addr learned my addr 172.21.15.49:0/3676958788 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 -- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62701449e0 msgr2=0x7f627013b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62701449e0 0x7f627013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 -- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627006c6b0 msgr2=0x7f627015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627006c6b0 0x7f627015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009a70 con 0x7f62700b0b50 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.346+0000 7f626e59c640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f626400c500 tx=0x7f626400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.347+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264005ce0 con 0x7f62700b0b50 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.347+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264005e40 con 0x7f62700b0b50 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.347+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627013dfe0 con 0x7f62700b0b50 2023-12-19T05:43:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.347+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264007330 con 0x7f62700b0b50 2023-12-19T05:43:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.347+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627013e5a0 con 0x7f62700b0b50 2023-12-19T05:43:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.349+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627013e7c0 con 0x7f62700b0b50 2023-12-19T05:43:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.349+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6264007550 con 0x7f62700b0b50 2023-12-19T05:43:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.351+0000 7f62577fe640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 0x7f625c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.351+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6264087f70 con 0x7f62700b0b50 2023-12-19T05:43:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.351+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f625c072020 con 0x7f62700b0b50 2023-12-19T05:43:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.351+0000 7f626ed9d640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 0x7f625c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.352+0000 7f626ed9d640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 0x7f625c06c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6260000f60 tx=0x7f62600079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.355+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62640bac80 con 0x7f62700b0b50 2023-12-19T05:43:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.594+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6270061910 con 0x7f62700b0b50 2023-12-19T05:43:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.596+0000 7f62577fe640 1 -- 172.21.15.49:0/3676958788 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f6264017060 con 0x7f62700b0b50 2023-12-19T05:43:37.597 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:42:10.905609+0000","modified":"2023-12-19T05:42:14.403210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5431":{"gid":5431,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3371552330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3371552330},{"type":"v1","addr":"172.21.15.49:6835","nonce":3371552330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T05:43:37.598 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 msgr2=0x7f625c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 0x7f625c06c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6260000f60 tx=0x7f62600079d0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 msgr2=0x7f627015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f626400c500 tx=0x7f626400c9c0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 shutdown_connections 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f625c06a430 0x7f625c06c8f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62701449e0 0x7f627013b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62700b0b50 0x7f627015e2e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.598+0000 7f627518b640 1 --2- 172.21.15.49:0/3676958788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627006c6b0 0x7f627015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.599+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 >> 172.21.15.49:0/3676958788 conn(0x7f62700cbb70 msgr2=0x7f62700709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.599+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 shutdown_connections 2023-12-19T05:43:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.599+0000 7f627518b640 1 -- 172.21.15.49:0/3676958788 wait complete. 2023-12-19T05:43:37.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:37.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.853+0000 7f030301b640 1 Processor -- start 2023-12-19T05:43:37.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.853+0000 7f030301b640 1 -- start start 2023-12-19T05:43:37.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.855+0000 7f030301b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02fc159f80 0x7f02fc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.855+0000 7f030301b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.855+0000 7f030301b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc06b520 con 0x7f02fc15a8a0 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.855+0000 7f030301b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc0b2b20 con 0x7f02fc159f80 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.855+0000 7f030301b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b2fb0 con 0x7f02fc15b1e0 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.856+0000 7f0301818640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.856+0000 7f0301818640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47852/0 (socket says 172.21.15.49:47852) 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.856+0000 7f0301818640 1 -- 172.21.15.49:0/1543196308 learned_addr learned my addr 172.21.15.49:0/1543196308 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.856+0000 7f0302019640 1 --2- 172.21.15.49:0/1543196308 >> v2:172.21.15.115:3300/0 conn(0x7f02fc159f80 0x7f02fc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.857+0000 7f0301818640 1 -- 172.21.15.49:0/1543196308 >> v2:172.21.15.115:3300/0 conn(0x7f02fc159f80 msgr2=0x7f02fc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.857+0000 7f0301818640 1 --2- 172.21.15.49:0/1543196308 >> v2:172.21.15.115:3300/0 conn(0x7f02fc159f80 0x7f02fc06f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.857+0000 7f0301818640 1 -- 172.21.15.49:0/1543196308 >> v1:172.21.15.115:6789/0 conn(0x7f02fc15a8a0 legacy=0x7f02fc15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.857+0000 7f0301818640 1 -- 172.21.15.49:0/1543196308 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0b1f10 con 0x7f02fc15b1e0 2023-12-19T05:43:37.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.857+0000 7f0301017640 1 -- 172.21.15.49:0/1543196308 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578766560 0 0) 0x7f02fc06b520 con 0x7f02fc15a8a0 2023-12-19T05:43:37.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.858+0000 7f0301818640 1 --2- 172.21.15.49:0/1543196308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009870 tx=0x7f02ec02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5776087eaea363b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.858+0000 7f0301017640 1 -- 172.21.15.49:0/1543196308 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec02f830 con 0x7f02fc15b1e0 2023-12-19T05:43:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f0301017640 1 -- 172.21.15.49:0/1543196308 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec02f990 con 0x7f02fc15b1e0 2023-12-19T05:43:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f0301017640 1 -- 172.21.15.49:0/1543196308 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec02fd20 con 0x7f02fc15b1e0 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 -- 172.21.15.49:0/1543196308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 msgr2=0x7f02fc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 --2- 172.21.15.49:0/1543196308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009870 tx=0x7f02ec02ba10 comp rx=0 tx=0).stop 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 -- 172.21.15.49:0/1543196308 shutdown_connections 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 --2- 172.21.15.49:0/1543196308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc15a360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 --2- 172.21.15.49:0/1543196308 >> v2:172.21.15.115:3300/0 conn(0x7f02fc159f80 0x7f02fc06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 -- 172.21.15.49:0/1543196308 >> 172.21.15.49:0/1543196308 conn(0x7f02fc0b0100 msgr2=0x7f02fc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 -- 172.21.15.49:0/1543196308 shutdown_connections 2023-12-19T05:43:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.859+0000 7f030301b640 1 -- 172.21.15.49:0/1543196308 wait complete. 2023-12-19T05:43:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.861+0000 7f030301b640 1 Processor -- start 2023-12-19T05:43:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.861+0000 7f030301b640 1 -- start start 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02fc15a8a0 0x7f02fc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1f3fb0 con 0x7f02fc159f80 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc14e080 con 0x7f02fc15a8a0 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.862+0000 7f030301b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc14d750 con 0x7f02fc15b1e0 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32964/0 (socket says 172.21.15.49:32964) 2023-12-19T05:43:37.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 -- 172.21.15.49:0/2110748362 learned_addr learned my addr 172.21.15.49:0/2110748362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f030281a640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 -- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 msgr2=0x7f02fc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0301818640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02fc15a8a0 0x7f02fc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 -- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02fc15a8a0 msgr2=0x7f02fc06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02fc15a8a0 0x7f02fc06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:37.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0094d0 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f030281a640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.863+0000 7f0302019640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f02f800e9b0 tx=0x7f02f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.864+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8009670 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.864+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800c9a0 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.864+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc14da30 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.864+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800cd50 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.864+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc14cfb0 con 0x7f02fc159f80 2023-12-19T05:43:37.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.865+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc061910 con 0x7f02fc159f80 2023-12-19T05:43:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.866+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02f8013470 con 0x7f02fc159f80 2023-12-19T05:43:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.867+0000 7f02f2ffd640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 0x7f02e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.867+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f02f8088c80 con 0x7f02fc159f80 2023-12-19T05:43:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.867+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f02e0072020 con 0x7f02fc159f80 2023-12-19T05:43:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.868+0000 7f0301818640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 0x7f02e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:37.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.869+0000 7f0301818640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 0x7f02e006c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02ec036000 tx=0x7f02ec008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:37.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:37.871+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02f8017060 con 0x7f02fc159f80 2023-12-19T05:43:38.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.069+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02fc0b0f70 con 0x7f02fc159f80 2023-12-19T05:43:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.071+0000 7f02f2ffd640 1 -- 172.21.15.49:0/2110748362 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16215 (secure 0 0 0) 0x7f02f8021070 con 0x7f02fc159f80 2023-12-19T05:43:38.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:38.073 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:34.452690+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:42:09.134540+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T05:42:09.927610+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.28","mappings":[{"from":6,"to":4}]},{"pgid":"9.3c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 msgr2=0x7f02e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 0x7f02e006c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02ec036000 tx=0x7f02ec008030 comp rx=0 tx=0).stop 2023-12-19T05:43:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 msgr2=0x7f02fc1f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f02f800e9b0 tx=0x7f02f800ee70 comp rx=0 tx=0).stop 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 shutdown_connections 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02e006a430 0x7f02e006c8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02fc15b1e0 0x7f02fc06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02fc15a8a0 0x7f02fc06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 --2- 172.21.15.49:0/2110748362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc159f80 0x7f02fc1f3a70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 >> 172.21.15.49:0/2110748362 conn(0x7f02fc0b0100 msgr2=0x7f02fc0cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 shutdown_connections 2023-12-19T05:43:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.074+0000 7f030301b640 1 -- 172.21.15.49:0/2110748362 wait complete. 2023-12-19T05:43:38.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:43:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.320+0000 7f5f288db640 1 Processor -- start 2023-12-19T05:43:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.320+0000 7f5f288db640 1 -- start start 2023-12-19T05:43:38.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f288db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f240af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f288db640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f241620d0 con 0x7f5f2415e7f0 2023-12-19T05:43:38.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f288db640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f241611e0 con 0x7f5f2415d400 2023-12-19T05:43:38.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f288db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240b74d0 con 0x7f5f2406a2e0 2023-12-19T05:43:38.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f21d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f2415e7f0 0x7f5f241619c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41176/0 (socket says 172.21.15.49:41176) 2023-12-19T05:43:38.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f21d9b640 1 -- 172.21.15.49:0/1667007946 learned_addr learned my addr 172.21.15.49:0/1667007946 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:38.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f22d9d640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f240af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.322+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944251703 0 0) 0x7f5f241620d0 con 0x7f5f2415e7f0 2023-12-19T05:43:38.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f10003520 con 0x7f5f2415e7f0 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165084709 0 0) 0x7f5f10003520 con 0x7f5f2415e7f0 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 msgr2=0x7f5f240af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f240af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 >> v1:172.21.15.115:6789/0 conn(0x7f5f2415d400 legacy=0x7f5f240b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2406a850 con 0x7f5f2415e7f0 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5f0c001670 con 0x7f5f2415e7f0 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 >> v1:172.21.15.49:6789/0 conn(0x7f5f2415e7f0 legacy=0x7f5f241619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1000ba90 con 0x7f5f10003f70 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1000bc00 con 0x7f5f10004d00 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1000bdc0 con 0x7f5f2406a2e0 2023-12-19T05:43:38.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.323+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f2259c640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f22d9d640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f21d9b640 1 -- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 msgr2=0x7f5f100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f2406a2e0 0x7f5f100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f21d9b640 1 -- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f10004d00 msgr2=0x7f5f10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.324+0000 7f5f21d9b640 1 -- 172.21.15.49:0/1667007946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10003520 con 0x7f5f10003f70 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.325+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f100047c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c0e0 tx=0x7f5f100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc0ca2b37328879 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c005ad0 con 0x7f5f10003f70 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c005c30 con 0x7f5f10003f70 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f2159a640 1 -- 172.21.15.49:0/1667007946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0072b0 con 0x7f5f10003f70 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 -- 172.21.15.49:0/1667007946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 msgr2=0x7f5f100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 --2- 172.21.15.49:0/1667007946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f100047c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c0e0 tx=0x7f5f100057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f22d9d640 1 -- 172.21.15.49:0/1667007946 reap_dead start 2023-12-19T05:43:38.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 -- 172.21.15.49:0/1667007946 shutdown_connections 2023-12-19T05:43:38.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 -- 172.21.15.49:0/1667007946 >> 172.21.15.49:0/1667007946 conn(0x7f5f240d1280 msgr2=0x7f5f240d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:38.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 -- 172.21.15.49:0/1667007946 shutdown_connections 2023-12-19T05:43:38.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.326+0000 7f5f288db640 1 -- 172.21.15.49:0/1667007946 wait complete. 2023-12-19T05:43:38.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.328+0000 7f5f288db640 1 Processor -- start 2023-12-19T05:43:38.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.328+0000 7f5f288db640 1 -- start start 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.329+0000 7f5f288db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.329+0000 7f5f288db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f24152400 0x7f5f24070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.329+0000 7f5f288db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f24152880 0x7f5f24070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f288db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241429a0 con 0x7f5f10003f70 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f288db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24142c80 con 0x7f5f24152400 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f288db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24142f60 con 0x7f5f24152880 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32984/0 (socket says 172.21.15.49:32984) 2023-12-19T05:43:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 -- 172.21.15.49:0/1348190044 learned_addr learned my addr 172.21.15.49:0/1348190044 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 -- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f24152880 msgr2=0x7f5f24070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f24152880 0x7f5f24070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 -- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f24152400 msgr2=0x7f5f24070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f24152400 0x7f5f24070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.330+0000 7f5f2259c640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24143240 con 0x7f5f10003f70 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f2259c640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400fb90 tx=0x7f5f1400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400fe90 con 0x7f5f10003f70 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1400dbb0 con 0x7f5f10003f70 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f24143520 con 0x7f5f10003f70 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14003970 con 0x7f5f10003f70 2023-12-19T05:43:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.331+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f24154be0 con 0x7f5f10003f70 2023-12-19T05:43:38.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.332+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f24073ec0 con 0x7f5f10003f70 2023-12-19T05:43:38.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.333+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f14003ad0 con 0x7f5f10003f70 2023-12-19T05:43:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.334+0000 7f5f1affd640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 0x7f5f0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.334+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5f14088c90 con 0x7f5f10003f70 2023-12-19T05:43:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.335+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f5f04072050 con 0x7f5f10003f70 2023-12-19T05:43:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.335+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 0x7f5f0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.336+0000 7f5f21d9b640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 0x7f5f0406c920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c034000 tx=0x7f5f0c007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.338+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f140541a0 con 0x7f5f10003f70 2023-12-19T05:43:38.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.486+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(78..78 src has 1..78) v4 ==== 1468+0+0 (secure 0 0 0) 0x7f5f14058560 con 0x7f5f10003f70 2023-12-19T05:43:38.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.486+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f5f040732c0 con 0x7f5f10003f70 2023-12-19T05:43:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.575+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5f24061910 con 0x7f5f10003f70 2023-12-19T05:43:38.579 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:43:38.577+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:43:38.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.580+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 8 ==== osd_map(79..79 src has 1..79) v4 ==== 374+0+0 (secure 0 0 0) 0x7f5f1405bc90 con 0x7f5f10003f70 2023-12-19T05:43:38.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.595+0000 7f5f1affd640 1 -- 172.21.15.49:0/1348190044 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5f140577c0 con 0x7f5f10003f70 2023-12-19T05:43:38.597 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:43:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.598+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 msgr2=0x7f5f0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.598+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 0x7f5f0406c920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c034000 tx=0x7f5f0c007000 comp rx=0 tx=0).stop 2023-12-19T05:43:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.598+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 msgr2=0x7f5f241546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.598+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400fb90 tx=0x7f5f1400d520 comp rx=0 tx=0).stop 2023-12-19T05:43:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 shutdown_connections 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f0406a460 0x7f5f0406c920 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f24152880 0x7f5f24070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f24152400 0x7f5f24070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 --2- 172.21.15.49:0/1348190044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f10003f70 0x7f5f241546a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 >> 172.21.15.49:0/1348190044 conn(0x7f5f240d1280 msgr2=0x7f5f24160370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 shutdown_connections 2023-12-19T05:43:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.599+0000 7f5f288db640 1 -- 172.21.15.49:0/1348190044 wait complete. 2023-12-19T05:43:38.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:43:38.722 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:43:38.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.831+0000 7f4258518640 1 Processor -- start 2023-12-19T05:43:38.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.832+0000 7f4258518640 1 -- start start 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4258518640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425015a190 0x7f42500aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4258518640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42500b09c0 0x7f42500ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4258518640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500ad960 con 0x7f42500aef40 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4258518640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500adc40 con 0x7f42500b09c0 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4258518640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500adf20 con 0x7f425015a190 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4256ab5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42500b09c0 0x7f42500ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.833+0000 7f4255ab3640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f42500aef40 0x7f42500b02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41196/0 (socket says 172.21.15.49:41196) 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f4255ab3640 1 -- 172.21.15.49:0/379916070 learned_addr learned my addr 172.21.15.49:0/379916070 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f42562b4640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425015a190 0x7f42500aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f4256ab5640 1 -- 172.21.15.49:0/379916070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425015a190 msgr2=0x7f42500aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f4256ab5640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425015a190 0x7f42500aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f4256ab5640 1 -- 172.21.15.49:0/379916070 >> v1:172.21.15.49:6789/0 conn(0x7f42500aef40 legacy=0x7f42500b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f4256ab5640 1 -- 172.21.15.49:0/379916070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500ae200 con 0x7f42500b09c0 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.834+0000 7f42552b2640 1 -- 172.21.15.49:0/379916070 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093814008 0 0) 0x7f42500ad960 con 0x7f42500aef40 2023-12-19T05:43:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.835+0000 7f4256ab5640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42500b09c0 0x7f42500ce420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4248009d90 tx=0x7f424802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16eee178deaa314 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.835+0000 7f42552b2640 1 -- 172.21.15.49:0/379916070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424802cbd0 con 0x7f42500b09c0 2023-12-19T05:43:38.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.835+0000 7f42552b2640 1 -- 172.21.15.49:0/379916070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424802cd30 con 0x7f42500b09c0 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.835+0000 7f42552b2640 1 -- 172.21.15.49:0/379916070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424802cea0 con 0x7f42500b09c0 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 -- 172.21.15.49:0/379916070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42500b09c0 msgr2=0x7f42500ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42500b09c0 0x7f42500ce420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4248009d90 tx=0x7f424802be20 comp rx=0 tx=0).stop 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 -- 172.21.15.49:0/379916070 shutdown_connections 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42500b09c0 0x7f42500ce420 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 --2- 172.21.15.49:0/379916070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425015a190 0x7f42500aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 -- 172.21.15.49:0/379916070 >> 172.21.15.49:0/379916070 conn(0x7f4250066160 msgr2=0x7f42500cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 -- 172.21.15.49:0/379916070 shutdown_connections 2023-12-19T05:43:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.836+0000 7f4258518640 1 -- 172.21.15.49:0/379916070 wait complete. 2023-12-19T05:43:38.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.838+0000 7f4258518640 1 Processor -- start 2023-12-19T05:43:38.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.838+0000 7f4258518640 1 -- start start 2023-12-19T05:43:38.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 0x7f425015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4250155270 0x7f425006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425015a570 con 0x7f425015a190 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425015b3d0 con 0x7f42500b09c0 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4258518640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425015d490 con 0x7f4250155270 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4255ab3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4255ab3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33014/0 (socket says 172.21.15.49:33014) 2023-12-19T05:43:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.839+0000 7f4255ab3640 1 -- 172.21.15.49:0/2555899699 learned_addr learned my addr 172.21.15.49:0/2555899699 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:38.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f42562b4640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 0x7f425015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4256ab5640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4250155270 0x7f425006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 -- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4250155270 msgr2=0x7f425006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4250155270 0x7f425006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 -- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 msgr2=0x7f425015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 0x7f425015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 -- 172.21.15.49:0/2555899699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248009a70 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f42562b4640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 0x7f425015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4255ab3640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f424000c500 tx=0x7f424000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240007560 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42400047e0 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240004b90 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.840+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425015a7c0 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.841+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425015ad80 con 0x7f425015a190 2023-12-19T05:43:38.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.841+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425015b540 con 0x7f425015a190 2023-12-19T05:43:38.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.842+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4240004cf0 con 0x7f425015a190 2023-12-19T05:43:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.844+0000 7f4246ffd640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 0x7f423406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.844+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4240087b40 con 0x7f425015a190 2023-12-19T05:43:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.845+0000 7f42562b4640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 0x7f423406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:38.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.846+0000 7f42562b4640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 0x7f423406c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f424c006fd0 tx=0x7f424c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:38.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:38.848+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4240053090 con 0x7f425015a190 2023-12-19T05:43:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.074+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4250061910 con 0x7f425015a190 2023-12-19T05:43:39.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.608+0000 7f4246ffd640 1 -- 172.21.15.49:0/2555899699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42400180a0 con 0x7f425015a190 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 msgr2=0x7f423406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 0x7f423406c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f424c006fd0 tx=0x7f424c008040 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 msgr2=0x7f425015b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f424000c500 tx=0x7f424000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 shutdown_connections 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f423406a430 0x7f423406c8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4250155270 0x7f425006d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425015a190 0x7f425015b860 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 --2- 172.21.15.49:0/2555899699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42500b09c0 0x7f425015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 >> 172.21.15.49:0/2555899699 conn(0x7f4250066160 msgr2=0x7f42500af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 shutdown_connections 2023-12-19T05:43:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.612+0000 7f4258518640 1 -- 172.21.15.49:0/2555899699 wait complete. 2023-12-19T05:43:39.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:43:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.874+0000 7fd0dd1c4640 1 Processor -- start 2023-12-19T05:43:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.874+0000 7fd0dd1c4640 1 -- start start 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0dd1c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0d80cd7e0 0x7fd0d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0dd1c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0dd1c4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d806fd90 con 0x7fd0d80b6bc0 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0dd1c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d80b6fa0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0dd1c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815d8c0 con 0x7fd0d80c6af0 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.876+0000 7fd0cffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0d80cd7e0 0x7fd0d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0d80cd7e0 0x7fd0d806d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33018/0 (socket says 172.21.15.49:33018) 2023-12-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 -- 172.21.15.49:0/953483505 learned_addr learned my addr 172.21.15.49:0/953483505 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0dc9c3640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 -- 172.21.15.49:0/953483505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 msgr2=0x7fd0d80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d80c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 -- 172.21.15.49:0/953483505 >> v1:172.21.15.115:6789/0 conn(0x7fd0d80b6bc0 legacy=0x7fd0d80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.877+0000 7fd0cffff640 1 -- 172.21.15.49:0/953483505 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d80cdd30 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.878+0000 7fd0cffff640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d806d360 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90d0cf90b6cec2a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:39.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.879+0000 7fd0d77fe640 1 -- 172.21.15.49:0/953483505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0030840 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.879+0000 7fd0d77fe640 1 -- 172.21.15.49:0/953483505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00309a0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.879+0000 7fd0d77fe640 1 -- 172.21.15.49:0/953483505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0030d30 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.879+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/953483505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 msgr2=0x7fd0d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.879+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d806d360 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c002b980 comp rx=0 tx=0).stop 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/953483505 shutdown_connections 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d80c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/953483505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d806d360 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/953483505 >> 172.21.15.49:0/953483505 conn(0x7fd0d8071370 msgr2=0x7fd0d8071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/953483505 shutdown_connections 2023-12-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.880+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/953483505 wait complete. 2023-12-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.881+0000 7fd0dd1c4640 1 Processor -- start 2023-12-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.882+0000 7fd0dd1c4640 1 -- start start 2023-12-19T05:43:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.882+0000 7fd0dd1c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0d80b6bc0 0x7fd0d80d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dd1c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dd1c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dd1c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c9aa0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dd1c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80d0330 con 0x7fd0d80b6bc0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dd1c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80d0610 con 0x7fd0d80c6af0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33028/0 (socket says 172.21.15.49:33028) 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 -- 172.21.15.49:0/3680652377 learned_addr learned my addr 172.21.15.49:0/3680652377 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0cffff640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 -- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 msgr2=0x7fd0d81541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0d7fff640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0d80b6bc0 0x7fd0d80d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d81541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 -- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0d80b6bc0 msgr2=0x7fd0d80d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0d80b6bc0 0x7fd0d80d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.883+0000 7fd0dc9c3640 1 -- 172.21.15.49:0/3680652377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00094d0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0dc9c3640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0007e40 tx=0x7fd0d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0014620 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d000ee90 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00149e0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d80d08f0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.884+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d80d0eb0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.885+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d80d20b0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.886+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0d0014b40 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.887+0000 7fd0d57fa640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 0x7fd0b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.887+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd0d00893f0 con 0x7fd0d80cd7e0 2023-12-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.888+0000 7fd0d7fff640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 0x7fd0b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.889+0000 7fd0d7fff640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 0x7fd0b806c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8155490 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:39.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:39.892+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0d00548b0 con 0x7fd0d80cd7e0 2023-12-19T05:43:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.085+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0d806e310 con 0x7fd0d80cd7e0 2023-12-19T05:43:40.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.616+0000 7fd0d57fa640 1 -- 172.21.15.49:0/3680652377 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0d0057ed0 con 0x7fd0d80cd7e0 2023-12-19T05:43:40.619 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 msgr2=0x7fd0b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 0x7fd0b806c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8155490 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 msgr2=0x7fd0d8154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0007e40 tx=0x7fd0d000e4b0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 shutdown_connections 2023-12-19T05:43:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0b806a430 0x7fd0b806c8f0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8155490 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d80c6af0 0x7fd0d81541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d80cd7e0 0x7fd0d8154a40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 --2- 172.21.15.49:0/3680652377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0d80b6bc0 0x7fd0d80d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.621+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 >> 172.21.15.49:0/3680652377 conn(0x7fd0d8071370 msgr2=0x7fd0d8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.622+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 shutdown_connections 2023-12-19T05:43:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.622+0000 7fd0dd1c4640 1 -- 172.21.15.49:0/3680652377 wait complete. 2023-12-19T05:43:40.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:43:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.874+0000 7fa70705e640 1 Processor -- start 2023-12-19T05:43:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.874+0000 7fa70705e640 1 -- start start 2023-12-19T05:43:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.876+0000 7fa70705e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa70015b000 0x7fa7000cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.876+0000 7fa70705e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 0x7fa7000b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.876+0000 7fa70705e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70015b460 con 0x7fa700157970 2023-12-19T05:43:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.876+0000 7fa70705e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7000b0d30 con 0x7fa70015b000 2023-12-19T05:43:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.876+0000 7fa70705e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000cdab0 con 0x7fa7000b0360 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.877+0000 7fa70585b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa70015b000 0x7fa7000cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.877+0000 7fa70685d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 0x7fa7000b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.877+0000 7fa70585b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa70015b000 0x7fa7000cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:37726/0 (socket says 172.21.15.49:37726) 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.877+0000 7fa70585b640 1 -- 172.21.15.49:0/2865989819 learned_addr learned my addr 172.21.15.49:0/2865989819 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.878+0000 7fa70585b640 1 -- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 msgr2=0x7fa7000b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:40.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.878+0000 7fa70585b640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 0x7fa7000b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.878+0000 7fa70585b640 1 -- 172.21.15.49:0/2865989819 >> v1:172.21.15.115:6789/0 conn(0x7fa700157970 legacy=0x7fa7000ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.878+0000 7fa70585b640 1 -- 172.21.15.49:0/2865989819 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000cc700 con 0x7fa70015b000 2023-12-19T05:43:40.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.878+0000 7fa70685d640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 0x7fa7000b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:43:40.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.879+0000 7fa70585b640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa70015b000 0x7fa7000cc1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009850 tx=0x7fa6f002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee39c0826a8523 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:40.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70505a640 1 -- 172.21.15.49:0/2865989819 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0004230 con 0x7fa70015b000 2023-12-19T05:43:40.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70505a640 1 -- 172.21.15.49:0/2865989819 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0004390 con 0x7fa70015b000 2023-12-19T05:43:40.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70505a640 1 -- 172.21.15.49:0/2865989819 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003810 con 0x7fa70015b000 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 -- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa70015b000 msgr2=0x7fa7000cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa70015b000 0x7fa7000cc1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009850 tx=0x7fa6f002b960 comp rx=0 tx=0).stop 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 -- 172.21.15.49:0/2865989819 shutdown_connections 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7000b0360 0x7fa7000b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 --2- 172.21.15.49:0/2865989819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa70015b000 0x7fa7000cc1c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.880+0000 7fa70705e640 1 -- 172.21.15.49:0/2865989819 >> 172.21.15.49:0/2865989819 conn(0x7fa7000659a0 msgr2=0x7fa700065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:40.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.881+0000 7fa70705e640 1 -- 172.21.15.49:0/2865989819 shutdown_connections 2023-12-19T05:43:40.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.881+0000 7fa70705e640 1 -- 172.21.15.49:0/2865989819 wait complete. 2023-12-19T05:43:40.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.883+0000 7fa70705e640 1 Processor -- start 2023-12-19T05:43:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.883+0000 7fa70705e640 1 -- start start 2023-12-19T05:43:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa700157970 0x7fa700152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 0x7fa700159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa700157ee0 con 0x7fa7000b0360 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70006b5b0 con 0x7fa700157970 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.884+0000 7fa70705e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7001525d0 con 0x7fa70015b000 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33032/0 (socket says 172.21.15.49:33032) 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 -- 172.21.15.49:0/3325029228 learned_addr learned my addr 172.21.15.49:0/3325029228 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70585b640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa700157970 0x7fa700152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70685d640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 0x7fa700159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 -- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 msgr2=0x7fa700159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 0x7fa700159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 -- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa700157970 msgr2=0x7fa700152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:40.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa700157970 0x7fa700152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70605c640 1 -- 172.21.15.49:0/3325029228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009a70 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.885+0000 7fa70685d640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 0x7fa700159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa70605c640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c450 tx=0x7fa6fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0052d0 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc005430 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc012870 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f0009460 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.886+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa700152b10 con 0x7fa7000b0360 2023-12-19T05:43:40.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.887+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70006b740 con 0x7fa7000b0360 2023-12-19T05:43:40.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.889+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6fc0129d0 con 0x7fa7000b0360 2023-12-19T05:43:40.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.889+0000 7fa6f6ffd640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 0x7fa6e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:40.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.890+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fa6fc0880e0 con 0x7fa7000b0360 2023-12-19T05:43:40.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.890+0000 7fa70585b640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 0x7fa6e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:40.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.891+0000 7fa70585b640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 0x7fa6e406c920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0035000 tx=0x7fa6f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:40.894+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa6fc0537e0 con 0x7fa7000b0360 2023-12-19T05:43:41.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.089+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa70015b460 con 0x7fa7000b0360 2023-12-19T05:43:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.626+0000 7fa6f6ffd640 1 -- 172.21.15.49:0/3325029228 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa70015b460 con 0x7fa7000b0360 2023-12-19T05:43:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:43:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.631+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 msgr2=0x7fa6e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.631+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 0x7fa6e406c920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0035000 tx=0x7fa6f0008030 comp rx=0 tx=0).stop 2023-12-19T05:43:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.631+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 msgr2=0x7fa7001f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.631+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c450 tx=0x7fa6fc00c910 comp rx=0 tx=0).stop 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 shutdown_connections 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa6e406a460 0x7fa6e406c920 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa70015b000 0x7fa700159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa700157970 0x7fa700152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 --2- 172.21.15.49:0/3325029228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7000b0360 0x7fa7001f2470 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 >> 172.21.15.49:0/3325029228 conn(0x7fa7000659a0 msgr2=0x7fa70006f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 shutdown_connections 2023-12-19T05:43:41.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.632+0000 7fa70705e640 1 -- 172.21.15.49:0/3325029228 wait complete. 2023-12-19T05:43:41.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:43:41.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.887+0000 7f8495eec640 1 Processor -- start 2023-12-19T05:43:41.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.887+0000 7f8495eec640 1 -- start start 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8495eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f84900d1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8495eec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f849015db10 0x7f84900ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8495eec640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8490070480 con 0x7f849006d540 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8495eec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900ceba0 con 0x7f849015db10 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8495eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84901611a0 con 0x7f84900d0f80 2023-12-19T05:43:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f84956eb640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f849006d540 0x7f8490161650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41208/0 (socket says 172.21.15.49:41208) 2023-12-19T05:43:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f84956eb640 1 -- 172.21.15.49:0/3836818252 learned_addr learned my addr 172.21.15.49:0/3836818252 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:41.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f848ffff640 1 --2- 172.21.15.49:0/3836818252 >> v2:172.21.15.115:3300/0 conn(0x7f849015db10 0x7f84900ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.889+0000 7f8494eea640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f84900d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958535551 0 0) 0x7f8490070480 con 0x7f849006d540 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c003520 con 0x7f849006d540 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58120902 0 0) 0x7f847c003520 con 0x7f849006d540 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 msgr2=0x7f84900d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f84900d1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 >> v2:172.21.15.115:3300/0 conn(0x7f849015db10 msgr2=0x7f84900ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 --2- 172.21.15.49:0/3836818252 >> v2:172.21.15.115:3300/0 conn(0x7f849015db10 0x7f84900ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849015e160 con 0x7f849006d540 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8488001670 con 0x7f849006d540 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 >> v1:172.21.15.49:6789/0 conn(0x7f849006d540 legacy=0x7f8490161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f847c0039e0 0x7f847c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f847c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f847c004d00 0x7f847c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900ceba0 con 0x7f847c0039e0 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901611a0 con 0x7f847c004d00 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.890+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c00ba00 con 0x7f84900d0f80 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f847c0039e0 0x7f847c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f84956eb640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f847c004d00 0x7f847c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f848ffff640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f847c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 -- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 msgr2=0x7f847c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f847c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 -- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f847c004d00 msgr2=0x7f847c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f847c004d00 0x7f847c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f8494eea640 1 -- 172.21.15.49:0/3836818252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c003520 con 0x7f847c0039e0 2023-12-19T05:43:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f848ffff640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84900d0f80 0x7f847c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.891+0000 7f84956eb640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f847c004d00 0x7f847c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.892+0000 7f8494eea640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f847c0039e0 0x7f847c003e00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fc0 tx=0x7f847c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4692afdd769e234 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848002cbf0 con 0x7f847c0039e0 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000f040 con 0x7f847c0039e0 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f848f7fe640 1 -- 172.21.15.49:0/3836818252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480034440 con 0x7f847c0039e0 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 -- 172.21.15.49:0/3836818252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f847c0039e0 msgr2=0x7f847c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 --2- 172.21.15.49:0/3836818252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f847c0039e0 0x7f847c003e00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8480009fc0 tx=0x7f847c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f84956eb640 1 -- 172.21.15.49:0/3836818252 reap_dead start 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 -- 172.21.15.49:0/3836818252 shutdown_connections 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 -- 172.21.15.49:0/3836818252 >> 172.21.15.49:0/3836818252 conn(0x7f849006f160 msgr2=0x7f849006f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 -- 172.21.15.49:0/3836818252 shutdown_connections 2023-12-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.893+0000 7f8495eec640 1 -- 172.21.15.49:0/3836818252 wait complete. 2023-12-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.895+0000 7f8495eec640 1 Processor -- start 2023-12-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.895+0000 7f8495eec640 1 -- start start 2023-12-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 0x7f8490159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f849014a740 0x7f849014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901e87a0 con 0x7f84901e6f60 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901e7920 con 0x7f849014a740 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.896+0000 7f8495eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84901e7b90 con 0x7f847c0039e0 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33048/0 (socket says 172.21.15.49:33048) 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 -- 172.21.15.49:0/3138336070 learned_addr learned my addr 172.21.15.49:0/3138336070 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f8494eea640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 0x7f8490159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f84956eb640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f849014a740 0x7f849014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 -- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 msgr2=0x7f8490159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 0x7f8490159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 -- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f849014a740 msgr2=0x7f849014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f849014a740 0x7f849014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f848ffff640 1 -- 172.21.15.49:0/3138336070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84901e7e70 con 0x7f84901e6f60 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.897+0000 7f8494eea640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 0x7f8490159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f848ffff640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f84780109d0 tx=0x7f8478010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800ec20 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847800ed80 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847801c620 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84901e8150 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.898+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849015a420 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.899+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8490066a60 con 0x7f84901e6f60 2023-12-19T05:43:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.900+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f847801c780 con 0x7f84901e6f60 2023-12-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.902+0000 7f848d7fa640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 0x7f847006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.902+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8478088c30 con 0x7f84901e6f60 2023-12-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.903+0000 7f8494eea640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 0x7f847006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.904+0000 7f8494eea640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 0x7f847006c920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8480036000 tx=0x7f848002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:41.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:41.906+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8478054530 con 0x7f84901e6f60 2023-12-19T05:43:42.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.103+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8490061910 con 0x7f84901e6f60 2023-12-19T05:43:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.109+0000 7f848d7fa640 1 -- 172.21.15.49:0/3138336070 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8478057b50 con 0x7f84901e6f60 2023-12-19T05:43:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.111+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 msgr2=0x7f847006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.111+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 0x7f847006c920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8480036000 tx=0x7f848002e000 comp rx=0 tx=0).stop 2023-12-19T05:43:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.111+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 msgr2=0x7f84901e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.111+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f84780109d0 tx=0x7f8478010e90 comp rx=0 tx=0).stop 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 shutdown_connections 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f847006a460 0x7f847006c920 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f849014a740 0x7f849014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84901e6f60 0x7f84901e73e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 --2- 172.21.15.49:0/3138336070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f847c0039e0 0x7f8490159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 >> 172.21.15.49:0/3138336070 conn(0x7f849006f160 msgr2=0x7f849006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 shutdown_connections 2023-12-19T05:43:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.112+0000 7f8495eec640 1 -- 172.21.15.49:0/3138336070 wait complete. 2023-12-19T05:43:42.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-19T05:43:42.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.365+0000 7ff25759e640 1 Processor -- start 2023-12-19T05:43:42.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.366+0000 7ff25759e640 1 -- start start 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 0x7ff2580b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2580d0c60 0x7ff25815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580d1070 con 0x7ff2580b7ea0 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff258147210 con 0x7ff2580d0c60 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580b8330 con 0x7ff258146e30 2023-12-19T05:43:42.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff256d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2580d0c60 0x7ff25815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:42.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff255d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff2580b7ea0 0x7ff2580d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41214/0 (socket says 172.21.15.49:41214) 2023-12-19T05:43:42.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff255d9b640 1 -- 172.21.15.49:0/1713143627 learned_addr learned my addr 172.21.15.49:0/1713143627 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:42.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25659c640 1 --2- 172.21.15.49:0/1713143627 >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 0x7ff2580b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:42.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.368+0000 7ff25559a640 1 -- 172.21.15.49:0/1713143627 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438237767 0 0) 0x7ff2580d1070 con 0x7ff2580b7ea0 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff25559a640 1 -- 172.21.15.49:0/1713143627 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff244003520 con 0x7ff2580b7ea0 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff256d9d640 1 -- 172.21.15.49:0/1713143627 >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 msgr2=0x7ff2580b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff256d9d640 1 --2- 172.21.15.49:0/1713143627 >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 0x7ff2580b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff256d9d640 1 -- 172.21.15.49:0/1713143627 >> v1:172.21.15.49:6789/0 conn(0x7ff2580b7ea0 legacy=0x7ff2580d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff256d9d640 1 -- 172.21.15.49:0/1713143627 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580d12d0 con 0x7ff2580d0c60 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.369+0000 7ff25659c640 1 --2- 172.21.15.49:0/1713143627 >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 0x7ff2580b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:42.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.370+0000 7ff256d9d640 1 --2- 172.21.15.49:0/1713143627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580d0c60 0x7ff25815d870 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff2580b85a0 tx=0x7ff25002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c3ffd05492c08c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:42.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.370+0000 7ff25559a640 1 -- 172.21.15.49:0/1713143627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25002e070 con 0x7ff2580d0c60 2023-12-19T05:43:42.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.370+0000 7ff25559a640 1 -- 172.21.15.49:0/1713143627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2500315a0 con 0x7ff2580d0c60 2023-12-19T05:43:42.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.370+0000 7ff25559a640 1 -- 172.21.15.49:0/1713143627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250031930 con 0x7ff2580d0c60 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 -- 172.21.15.49:0/1713143627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580d0c60 msgr2=0x7ff25815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 --2- 172.21.15.49:0/1713143627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580d0c60 0x7ff25815d870 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff2580b85a0 tx=0x7ff25002b840 comp rx=0 tx=0).stop 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 -- 172.21.15.49:0/1713143627 shutdown_connections 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 --2- 172.21.15.49:0/1713143627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580d0c60 0x7ff25815d870 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 --2- 172.21.15.49:0/1713143627 >> v2:172.21.15.115:3300/0 conn(0x7ff258146e30 0x7ff2580b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 -- 172.21.15.49:0/1713143627 >> 172.21.15.49:0/1713143627 conn(0x7ff2580b2990 msgr2=0x7ff2580b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 -- 172.21.15.49:0/1713143627 shutdown_connections 2023-12-19T05:43:42.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.371+0000 7ff25759e640 1 -- 172.21.15.49:0/1713143627 wait complete. 2023-12-19T05:43:42.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.373+0000 7ff25759e640 1 Processor -- start 2023-12-19T05:43:42.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.373+0000 7ff25759e640 1 -- start start 2023-12-19T05:43:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 0x7ff2580b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff258146e30 0x7ff25813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff258140610 con 0x7ff2580b7ea0 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581408f0 con 0x7ff2580d0c60 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff258140bd0 con 0x7ff258146e30 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.374+0000 7ff25659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33060/0 (socket says 172.21.15.49:33060) 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 -- 172.21.15.49:0/4201477829 learned_addr learned my addr 172.21.15.49:0/4201477829 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff255d9b640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 0x7ff2580b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 -- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff258146e30 msgr2=0x7ff25813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff258146e30 0x7ff25813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 -- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 msgr2=0x7ff2580b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 0x7ff2580b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 -- 172.21.15.49:0/4201477829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250009400 con 0x7ff2580b7ea0 2023-12-19T05:43:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff255d9b640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 0x7ff2580b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.375+0000 7ff25659c640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff24000d7d0 tx=0x7ff24000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.376+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240004030 con 0x7ff2580b7ea0 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.376+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff240004190 con 0x7ff2580b7ea0 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.376+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240004520 con 0x7ff2580b7ea0 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.376+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff258140eb0 con 0x7ff2580b7ea0 2023-12-19T05:43:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.376+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580ca250 con 0x7ff2580b7ea0 2023-12-19T05:43:42.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.378+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c005250 con 0x7ff2580b7ea0 2023-12-19T05:43:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.380+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2400096a0 con 0x7ff2580b7ea0 2023-12-19T05:43:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.381+0000 7ff24effd640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 0x7ff23806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.381+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2400886d0 con 0x7ff2580b7ea0 2023-12-19T05:43:42.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.381+0000 7ff255d9b640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 0x7ff23806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:42.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.383+0000 7ff255d9b640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 0x7ff23806c940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff2581f5c30 tx=0x7ff248009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.385+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2400540a0 con 0x7ff2580b7ea0 2023-12-19T05:43:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:42.653+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7ff23c0057d0 con 0x7ff2580b7ea0 2023-12-19T05:43:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.632+0000 7ff24effd640 1 -- 172.21.15.49:0/4201477829 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v246) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff2400576c0 con 0x7ff2580b7ea0 2023-12-19T05:43:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 msgr2=0x7ff23806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 0x7ff23806c940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff2581f5c30 tx=0x7ff248009040 comp rx=0 tx=0).stop 2023-12-19T05:43:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 msgr2=0x7ff2580c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff24000d7d0 tx=0x7ff24000dc90 comp rx=0 tx=0).stop 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 shutdown_connections 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff23806a480 0x7ff23806c940 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.636+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff258146e30 0x7ff25813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.637+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2580d0c60 0x7ff2580b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.637+0000 7ff25759e640 1 --2- 172.21.15.49:0/4201477829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2580b7ea0 0x7ff2580c9d10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.637+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 >> 172.21.15.49:0/4201477829 conn(0x7ff2580b2990 msgr2=0x7ff258142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.637+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 shutdown_connections 2023-12-19T05:43:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.637+0000 7ff25759e640 1 -- 172.21.15.49:0/4201477829 wait complete. 2023-12-19T05:43:43.664 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T05:43:43.664 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-12-19T05:43:43.664 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T05:43:43.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:43.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.897+0000 7f3e79a3f640 1 Processor -- start 2023-12-19T05:43:43.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.898+0000 7f3e79a3f640 1 -- start start 2023-12-19T05:43:43.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e74159f80 0x7f3e7406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e7415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3e7415a8a0 0x7f3e7415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7406b520 con 0x7f3e74159f80 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740b2b20 con 0x7f3e7415a8a0 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e79a3f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740b2fb0 con 0x7f3e7415b1e0 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e78a3d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e74159f80 0x7f3e7406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e78a3d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e74159f80 0x7f3e7406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33062/0 (socket says 172.21.15.49:33062) 2023-12-19T05:43:43.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.899+0000 7f3e78a3d640 1 -- 172.21.15.49:0/687006865 learned_addr learned my addr 172.21.15.49:0/687006865 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.900+0000 7f3e78a3d640 1 -- 172.21.15.49:0/687006865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 msgr2=0x7f3e7415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.900+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/687006865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e7415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.900+0000 7f3e78a3d640 1 -- 172.21.15.49:0/687006865 >> v2:172.21.15.115:3300/0 conn(0x7f3e7415a8a0 msgr2=0x7f3e7415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.900+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/687006865 >> v2:172.21.15.115:3300/0 conn(0x7f3e7415a8a0 0x7f3e7415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.900+0000 7f3e78a3d640 1 -- 172.21.15.49:0/687006865 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740b1f10 con 0x7f3e74159f80 2023-12-19T05:43:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.901+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/687006865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e7406f160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3e740adf00 tx=0x7f3e6802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d405599c0a2189 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.901+0000 7f3e737fe640 1 -- 172.21.15.49:0/687006865 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68030860 con 0x7f3e74159f80 2023-12-19T05:43:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.901+0000 7f3e737fe640 1 -- 172.21.15.49:0/687006865 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e680309c0 con 0x7f3e74159f80 2023-12-19T05:43:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.901+0000 7f3e737fe640 1 -- 172.21.15.49:0/687006865 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68030d50 con 0x7f3e74159f80 2023-12-19T05:43:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 -- 172.21.15.49:0/687006865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 msgr2=0x7f3e7406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/687006865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e7406f160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3e740adf00 tx=0x7f3e6802b9a0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 -- 172.21.15.49:0/687006865 shutdown_connections 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/687006865 >> v2:172.21.15.115:3300/0 conn(0x7f3e7415a8a0 0x7f3e7415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/687006865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e7415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/687006865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e7406f160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 -- 172.21.15.49:0/687006865 >> 172.21.15.49:0/687006865 conn(0x7f3e740b0100 msgr2=0x7f3e740b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 -- 172.21.15.49:0/687006865 shutdown_connections 2023-12-19T05:43:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.902+0000 7f3e79a3f640 1 -- 172.21.15.49:0/687006865 wait complete. 2023-12-19T05:43:43.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.904+0000 7f3e79a3f640 1 Processor -- start 2023-12-19T05:43:43.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.904+0000 7f3e79a3f640 1 -- start start 2023-12-19T05:43:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e7415a8a0 0x7f3e74150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e74150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741513c0 con 0x7f3e74159f80 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740c3f00 con 0x7f3e7415a8a0 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e79a3f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74153260 con 0x7f3e7415b1e0 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e78a3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e78a3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33076/0 (socket says 172.21.15.49:33076) 2023-12-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.905+0000 7f3e78a3d640 1 -- 172.21.15.49:0/96406487 learned_addr learned my addr 172.21.15.49:0/96406487 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 -- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 msgr2=0x7f3e74150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e7923e640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e74150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e73fff640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e7415a8a0 0x7f3e74150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e74150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 -- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e7415a8a0 msgr2=0x7f3e74150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e7415a8a0 0x7f3e74150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 -- 172.21.15.49:0/96406487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680094d0 con 0x7f3e74159f80 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e78a3d640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3e68000c00 tx=0x7f3e68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.906+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68030830 con 0x7f3e74159f80 2023-12-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.907+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68043400 con 0x7f3e74159f80 2023-12-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.907+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680437b0 con 0x7f3e74159f80 2023-12-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.907+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e74153540 con 0x7f3e74159f80 2023-12-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.907+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7415bfe0 con 0x7f3e74159f80 2023-12-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.908+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e74061910 con 0x7f3e74159f80 2023-12-19T05:43:43.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.909+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e68043910 con 0x7f3e74159f80 2023-12-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.910+0000 7f3e717fa640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.910+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e6803e070 con 0x7f3e74159f80 2023-12-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.910+0000 7f3e73fff640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.912+0000 7f3e73fff640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 0x7f3e5806c920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3e74154a70 tx=0x7f3e60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:43.914+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e68077340 con 0x7f3e74159f80 2023-12-19T05:43:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.109+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e740b0f70 con 0x7f3e74159f80 2023-12-19T05:43:44.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.112+0000 7f3e717fa640 1 -- 172.21.15.49:0/96406487 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12518 (secure 0 0 0) 0x7f3e68034020 con 0x7f3e74159f80 2023-12-19T05:43:44.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:44.114 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:41.609381+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/3371552330":"2023-12-20T05:43:38.577424+0000","172.21.15.49:6833/3371552330":"2023-12-20T05:43:38.577424+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 msgr2=0x7f3e5806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 0x7f3e5806c920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3e74154a70 tx=0x7f3e60008040 comp rx=0 tx=0).stop 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 msgr2=0x7f3e74153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3e68000c00 tx=0x7f3e68004730 comp rx=0 tx=0).stop 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 shutdown_connections 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7415b1e0 0x7f3e74150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e7415a8a0 0x7f3e74150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 --2- 172.21.15.49:0/96406487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e74159f80 0x7f3e74153f60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.114+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 >> 172.21.15.49:0/96406487 conn(0x7f3e740b0100 msgr2=0x7f3e740af930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.115+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 shutdown_connections 2023-12-19T05:43:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.115+0000 7f3e79a3f640 1 -- 172.21.15.49:0/96406487 wait complete. 2023-12-19T05:43:44.136 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:43:44.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:43:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.377+0000 7f728883d640 1 Processor -- start 2023-12-19T05:43:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.377+0000 7f728883d640 1 -- start start 2023-12-19T05:43:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.379+0000 7f728883d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 0x7f728415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.379+0000 7f728883d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72840660e0 0x7f72840cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.379+0000 7f728883d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728415c610 con 0x7f72840cee30 2023-12-19T05:43:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.379+0000 7f728883d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72840cf910 con 0x7f72840660e0 2023-12-19T05:43:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.379+0000 7f728883d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72840cfbf0 con 0x7f7284155530 2023-12-19T05:43:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f728259c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f72840cee30 0x7f72840659d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:57462/0 (socket says 172.21.15.49:57462) 2023-12-19T05:43:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f728259c640 1 -- 172.21.15.49:0/1842535364 learned_addr learned my addr 172.21.15.49:0/1842535364 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f7282d9d640 1 --2- 172.21.15.49:0/1842535364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 0x7f728415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f728359e640 1 --2- 172.21.15.49:0/1842535364 >> v2:172.21.15.115:3300/0 conn(0x7f72840660e0 0x7f72840cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f7282d9d640 1 -- 172.21.15.49:0/1842535364 >> v2:172.21.15.115:3300/0 conn(0x7f72840660e0 msgr2=0x7f72840cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f7282d9d640 1 --2- 172.21.15.49:0/1842535364 >> v2:172.21.15.115:3300/0 conn(0x7f72840660e0 0x7f72840cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f7282d9d640 1 -- 172.21.15.49:0/1842535364 >> v1:172.21.15.115:6789/0 conn(0x7f72840cee30 legacy=0x7f72840659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.380+0000 7f7282d9d640 1 -- 172.21.15.49:0/1842535364 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728415b8d0 con 0x7f7284155530 2023-12-19T05:43:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.382+0000 7f7282d9d640 1 --2- 172.21.15.49:0/1842535364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 0x7f728415c0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7274009d90 tx=0x7f727402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f40bcbed14c705f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.382+0000 7f7281d9b640 1 -- 172.21.15.49:0/1842535364 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727402cbc0 con 0x7f7284155530 2023-12-19T05:43:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.382+0000 7f7281d9b640 1 -- 172.21.15.49:0/1842535364 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727402cd20 con 0x7f7284155530 2023-12-19T05:43:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.382+0000 7f7281d9b640 1 -- 172.21.15.49:0/1842535364 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274034660 con 0x7f7284155530 2023-12-19T05:43:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 -- 172.21.15.49:0/1842535364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 msgr2=0x7f728415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 --2- 172.21.15.49:0/1842535364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 0x7f728415c0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7274009d90 tx=0x7f727402be10 comp rx=0 tx=0).stop 2023-12-19T05:43:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 -- 172.21.15.49:0/1842535364 shutdown_connections 2023-12-19T05:43:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 --2- 172.21.15.49:0/1842535364 >> v2:172.21.15.115:3300/0 conn(0x7f72840660e0 0x7f72840cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 --2- 172.21.15.49:0/1842535364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7284155530 0x7f728415c0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 -- 172.21.15.49:0/1842535364 >> 172.21.15.49:0/1842535364 conn(0x7f72840735a0 msgr2=0x7f72840b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 -- 172.21.15.49:0/1842535364 shutdown_connections 2023-12-19T05:43:44.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.383+0000 7f728883d640 1 -- 172.21.15.49:0/1842535364 wait complete. 2023-12-19T05:43:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.385+0000 7f728883d640 1 Processor -- start 2023-12-19T05:43:44.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.385+0000 7f728883d640 1 -- start start 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 0x7f7284142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72840cee30 0x7f72841510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7284152780 con 0x7f7284155530 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7284151b70 con 0x7f72840cee30 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.386+0000 7f728883d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7284151e50 con 0x7f72840660e0 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49234/0 (socket says 172.21.15.49:49234) 2023-12-19T05:43:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 -- 172.21.15.49:0/3945638059 learned_addr learned my addr 172.21.15.49:0/3945638059 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728259c640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72840cee30 0x7f72841510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f7282d9d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 0x7f7284142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 -- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 msgr2=0x7f7284142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 0x7f7284142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 -- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72840cee30 msgr2=0x7f72841510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72840cee30 0x7f72841510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 -- 172.21.15.49:0/3945638059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274009a70 con 0x7f7284155530 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f7282d9d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 0x7f7284142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.387+0000 7f728359e640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e7f0 tx=0x7f727c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.388+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0094b0 con 0x7f7284155530 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.388+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c00c730 con 0x7f7284155530 2023-12-19T05:43:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.388+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7284152130 con 0x7f7284155530 2023-12-19T05:43:44.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.388+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00cae0 con 0x7f7284155530 2023-12-19T05:43:44.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.388+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7284142d40 con 0x7f7284155530 2023-12-19T05:43:44.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.389+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72840674e0 con 0x7f7284155530 2023-12-19T05:43:44.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.390+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f727c00cc40 con 0x7f7284155530 2023-12-19T05:43:44.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.392+0000 7f726b7fe640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 0x7f727006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.392+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f727c088760 con 0x7f7284155530 2023-12-19T05:43:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.393+0000 7f7282d9d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 0x7f727006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.394+0000 7f7282d9d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 0x7f727006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7274036000 tx=0x7f7274030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.397+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f727c053fb0 con 0x7f7284155530 2023-12-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.591+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7284061910 con 0x7f7284155530 2023-12-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.593+0000 7f726b7fe640 1 -- 172.21.15.49:0/3945638059 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f727c021020 con 0x7f7284155530 2023-12-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.595+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 msgr2=0x7f727006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.595+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 0x7f727006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7274036000 tx=0x7f7274030000 comp rx=0 tx=0).stop 2023-12-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.595+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 msgr2=0x7f728415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.595+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e7f0 tx=0x7f727c00ecb0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 shutdown_connections 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f727006a430 0x7f727006c8f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7284155530 0x7f728415ea20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72840cee30 0x7f72841510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 --2- 172.21.15.49:0/3945638059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72840660e0 0x7f7284142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 >> 172.21.15.49:0/3945638059 conn(0x7f72840735a0 msgr2=0x7f72840ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 shutdown_connections 2023-12-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.596+0000 7f728883d640 1 -- 172.21.15.49:0/3945638059 wait complete. 2023-12-19T05:43:44.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-19T05:43:44.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.842+0000 7f38a12b6640 1 Processor -- start 2023-12-19T05:43:44.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.842+0000 7f38a12b6640 1 -- start start 2023-12-19T05:43:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.843+0000 7f38a12b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f389c159810 0x7f389c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f38a12b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389c0cc990 0x7f389c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f38a12b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c15d0e0 con 0x7f389c06f9f0 2023-12-19T05:43:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f38a12b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0b1590 con 0x7f389c159810 2023-12-19T05:43:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f38a12b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0b1870 con 0x7f389c0cc990 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f389c159810 0x7f389c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f389c159810 0x7f389c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49238/0 (socket says 172.21.15.49:49238) 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 -- 172.21.15.49:0/1874672688 learned_addr learned my addr 172.21.15.49:0/1874672688 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 -- 172.21.15.49:0/1874672688 >> v2:172.21.15.115:3300/0 conn(0x7f389c0cc990 msgr2=0x7f389c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 --2- 172.21.15.49:0/1874672688 >> v2:172.21.15.115:3300/0 conn(0x7f389c0cc990 0x7f389c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 -- 172.21.15.49:0/1874672688 >> v1:172.21.15.115:6789/0 conn(0x7f389c06f9f0 legacy=0x7f389c06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.844+0000 7f389bfff640 1 -- 172.21.15.49:0/1874672688 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0b1b50 con 0x7f389c159810 2023-12-19T05:43:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.846+0000 7f389bfff640 1 --2- 172.21.15.49:0/1874672688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c159810 0x7f389c159bf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f389c06b310 tx=0x7f388c02de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0d66cdab7b9270 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.846+0000 7f389affd640 1 -- 172.21.15.49:0/1874672688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c02ebd0 con 0x7f389c159810 2023-12-19T05:43:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.846+0000 7f389affd640 1 -- 172.21.15.49:0/1874672688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c032070 con 0x7f389c159810 2023-12-19T05:43:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.846+0000 7f389affd640 1 -- 172.21.15.49:0/1874672688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c038400 con 0x7f389c159810 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 -- 172.21.15.49:0/1874672688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c159810 msgr2=0x7f389c159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 --2- 172.21.15.49:0/1874672688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c159810 0x7f389c159bf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f389c06b310 tx=0x7f388c02de20 comp rx=0 tx=0).stop 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 -- 172.21.15.49:0/1874672688 shutdown_connections 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 --2- 172.21.15.49:0/1874672688 >> v2:172.21.15.115:3300/0 conn(0x7f389c0cc990 0x7f389c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 --2- 172.21.15.49:0/1874672688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c159810 0x7f389c159bf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 -- 172.21.15.49:0/1874672688 >> 172.21.15.49:0/1874672688 conn(0x7f389c0b0100 msgr2=0x7f389c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:44.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 -- 172.21.15.49:0/1874672688 shutdown_connections 2023-12-19T05:43:44.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.847+0000 7f38a12b6640 1 -- 172.21.15.49:0/1874672688 wait complete. 2023-12-19T05:43:44.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.849+0000 7f38a12b6640 1 Processor -- start 2023-12-19T05:43:44.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.849+0000 7f38a12b6640 1 -- start start 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f389c0cc990 0x7f389c1e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 0x7f389c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c1e80a0 con 0x7f389c06f9f0 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c14bcc0 con 0x7f389c159810 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f38a12b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c146820 con 0x7f389c0cc990 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f389bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f389bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49250/0 (socket says 172.21.15.49:49250) 2023-12-19T05:43:44.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.850+0000 7f389bfff640 1 -- 172.21.15.49:0/2442186579 learned_addr learned my addr 172.21.15.49:0/2442186579 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:44.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 -- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f389c0cc990 msgr2=0x7f389c1e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f38a0ab5640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 0x7f389c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389b7fe640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f389c0cc990 0x7f389c1e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f389c0cc990 0x7f389c1e7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 -- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 msgr2=0x7f389c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 0x7f389c14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 -- 172.21.15.49:0/2442186579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c00b760 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f38a0ab5640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 0x7f389c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.851+0000 7f389bfff640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f388c000c00 tx=0x7f388c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.852+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c038d40 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.852+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0423f0 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.852+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c146b00 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.852+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c038ea0 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.852+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c1470c0 con 0x7f389c06f9f0 2023-12-19T05:43:44.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.853+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c15a0b0 con 0x7f389c06f9f0 2023-12-19T05:43:44.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.854+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f388c0427a0 con 0x7f389c06f9f0 2023-12-19T05:43:44.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.855+0000 7f3898ff9640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 0x7f387c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:44.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.855+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f388c0aaae0 con 0x7f389c06f9f0 2023-12-19T05:43:44.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.856+0000 7f389b7fe640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 0x7f387c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:44.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.857+0000 7f389b7fe640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 0x7f387c06c8f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f389c0cb8e0 tx=0x7f3884009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:44.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:44.859+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f388c076480 con 0x7f389c06f9f0 2023-12-19T05:43:45.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.127+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f389c15d0c0 con 0x7f389c06f9f0 2023-12-19T05:43:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.642+0000 7f3898ff9640 1 -- 172.21.15.49:0/2442186579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v248) v1 ==== 136+0+0 (secure 0 0 0) 0x7f388c079aa0 con 0x7f389c06f9f0 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 msgr2=0x7f387c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 0x7f387c06c8f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f389c0cb8e0 tx=0x7f3884009040 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 msgr2=0x7f389c1461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f388c000c00 tx=0x7f388c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 shutdown_connections 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f387c06a430 0x7f387c06c8f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f389c0cc990 0x7f389c1e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c159810 0x7f389c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 --2- 172.21.15.49:0/2442186579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f389c06f9f0 0x7f389c1461b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 >> 172.21.15.49:0/2442186579 conn(0x7f389c0b0100 msgr2=0x7f389c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 shutdown_connections 2023-12-19T05:43:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:45.647+0000 7f38a12b6640 1 -- 172.21.15.49:0/2442186579 wait complete. 2023-12-19T05:43:45.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T05:43:45.926 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_objectstore":"memstore"} 2023-12-19T05:43:45.926 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T05:43:45.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:43:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.164+0000 7f81d5e41640 1 Processor -- start 2023-12-19T05:43:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.165+0000 7f81d5e41640 1 -- start start 2023-12-19T05:43:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.166+0000 7f81d5e41640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f81d0157c30 0x7f81d00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81d5e41640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81d00cde40 0x7f81d00ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81d5e41640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d015da00 con 0x7f81d00ad300 2023-12-19T05:43:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81d5e41640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d015e940 con 0x7f81d00cde40 2023-12-19T05:43:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81d5e41640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d00adcc0 con 0x7f81d0157c30 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81cffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81d00cde40 0x7f81d00ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81c7fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f81d00ad300 0x7f81d00b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48784/0 (socket says 172.21.15.49:48784) 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81c7fff640 1 -- 172.21.15.49:0/2542368824 learned_addr learned my addr 172.21.15.49:0/2542368824 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.167+0000 7f81cf7fe640 1 --2- 172.21.15.49:0/2542368824 >> v2:172.21.15.115:3300/0 conn(0x7f81d0157c30 0x7f81d00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.168+0000 7f81cffff640 1 -- 172.21.15.49:0/2542368824 >> v2:172.21.15.115:3300/0 conn(0x7f81d0157c30 msgr2=0x7f81d00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.168+0000 7f81cffff640 1 --2- 172.21.15.49:0/2542368824 >> v2:172.21.15.115:3300/0 conn(0x7f81d0157c30 0x7f81d00cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.168+0000 7f81cffff640 1 -- 172.21.15.49:0/2542368824 >> v1:172.21.15.49:6789/0 conn(0x7f81d00ad300 legacy=0x7f81d00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.168+0000 7f81cffff640 1 -- 172.21.15.49:0/2542368824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00cf860 con 0x7f81d00cde40 2023-12-19T05:43:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.169+0000 7f81cffff640 1 --2- 172.21.15.49:0/2542368824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00cde40 0x7f81d00ad780 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073a40 tx=0x7f81c802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363a38fbf7fe27c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.169+0000 7f81ceffd640 1 -- 172.21.15.49:0/2542368824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c802cc70 con 0x7f81d00cde40 2023-12-19T05:43:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.169+0000 7f81ceffd640 1 -- 172.21.15.49:0/2542368824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c802cdd0 con 0x7f81d00cde40 2023-12-19T05:43:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.169+0000 7f81ceffd640 1 -- 172.21.15.49:0/2542368824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8034660 con 0x7f81d00cde40 2023-12-19T05:43:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 -- 172.21.15.49:0/2542368824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00cde40 msgr2=0x7f81d00ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 --2- 172.21.15.49:0/2542368824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00cde40 0x7f81d00ad780 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073a40 tx=0x7f81c802bec0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 -- 172.21.15.49:0/2542368824 shutdown_connections 2023-12-19T05:43:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 --2- 172.21.15.49:0/2542368824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00cde40 0x7f81d00ad780 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 --2- 172.21.15.49:0/2542368824 >> v2:172.21.15.115:3300/0 conn(0x7f81d0157c30 0x7f81d00cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 -- 172.21.15.49:0/2542368824 >> 172.21.15.49:0/2542368824 conn(0x7f81d0073150 msgr2=0x7f81d00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 -- 172.21.15.49:0/2542368824 shutdown_connections 2023-12-19T05:43:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.170+0000 7f81d5e41640 1 -- 172.21.15.49:0/2542368824 wait complete. 2023-12-19T05:43:46.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.172+0000 7f81d5e41640 1 Processor -- start 2023-12-19T05:43:46.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.172+0000 7f81d5e41640 1 -- start start 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81d00cde40 0x7f81d006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d0157c30 0x7f81d013e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d006d9a0 con 0x7f81d00ad300 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0160ef0 con 0x7f81d0157c30 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81d5e41640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d006ca60 con 0x7f81d00cde40 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49274/0 (socket says 172.21.15.49:49274) 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.173+0000 7f81cf7fe640 1 -- 172.21.15.49:0/1806193745 learned_addr learned my addr 172.21.15.49:0/1806193745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cffff640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d0157c30 0x7f81d013e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81c7fff640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81d00cde40 0x7f81d006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 -- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81d00cde40 msgr2=0x7f81d006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81d00cde40 0x7f81d006c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 -- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d0157c30 msgr2=0x7f81d013e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d0157c30 0x7f81d013e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 -- 172.21.15.49:0/1806193745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009a70 con 0x7f81d00ad300 2023-12-19T05:43:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81cf7fe640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f81c000d5f0 tx=0x7f81c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00125f0 con 0x7f81d00ad300 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0012750 con 0x7f81d00ad300 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0012b00 con 0x7f81d00ad300 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.174+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d006cd20 con 0x7f81d00ad300 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.175+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d006d2e0 con 0x7f81d00ad300 2023-12-19T05:43:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.176+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0061910 con 0x7f81d00ad300 2023-12-19T05:43:46.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.177+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81c0012c60 con 0x7f81d00ad300 2023-12-19T05:43:46.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.178+0000 7f81ccff9640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 0x7f81b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:46.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.178+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81c0088a70 con 0x7f81d00ad300 2023-12-19T05:43:46.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.178+0000 7f81c7fff640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 0x7f81b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:46.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.180+0000 7f81c7fff640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 0x7f81b006c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f81d0161b80 tx=0x7f81b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:46.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.183+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81c0054350 con 0x7f81d00ad300 2023-12-19T05:43:46.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.381+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f81d006dc10 con 0x7f81d00ad300 2023-12-19T05:43:46.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.389+0000 7f81ccff9640 1 -- 172.21.15.49:0/1806193745 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f81d006dc10 con 0x7f81d00ad300 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 msgr2=0x7f81b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 0x7f81b006c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f81d0161b80 tx=0x7f81b8009040 comp rx=0 tx=0).stop 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 msgr2=0x7f81d01609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f81c000d5f0 tx=0x7f81c000dab0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 shutdown_connections 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81b006a430 0x7f81b006c8f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81d00cde40 0x7f81d006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d0157c30 0x7f81d013e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 --2- 172.21.15.49:0/1806193745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d00ad300 0x7f81d01609b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:46.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.392+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 >> 172.21.15.49:0/1806193745 conn(0x7f81d0073150 msgr2=0x7f81d00ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:46.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.393+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 shutdown_connections 2023-12-19T05:43:46.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:46.393+0000 7f81d5e41640 1 -- 172.21.15.49:0/1806193745 wait complete. 2023-12-19T05:43:46.415 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:43:46.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:43:46.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:43:46.658 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:43:46.658 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:43:46.658 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:46.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:43:46.723 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:43:46.723 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:46.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:43:46.784 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:43:46.784 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:46.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:43:46.849 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:43:46.849 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:43:46.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:43:46.909 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:43:46.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:47.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.137+0000 7f5c1953a640 1 Processor -- start 2023-12-19T05:43:47.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.137+0000 7f5c1953a640 1 -- start start 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c1953a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c140b2030 0x7f5c1415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c1953a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5c140cdbf0 0x7f5c140ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c1953a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1415ec30 con 0x7f5c1415e5a0 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c1953a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c140ce5c0 con 0x7f5c140cdbf0 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c1953a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415fbc0 con 0x7f5c140b2030 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c13fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5c1415e5a0 0x7f5c140b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48798/0 (socket says 172.21.15.49:48798) 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c13fff640 1 -- 172.21.15.49:0/4272106368 learned_addr learned my addr 172.21.15.49:0/4272106368 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.139+0000 7f5c18d39640 1 --2- 172.21.15.49:0/4272106368 >> v2:172.21.15.49:3300/0 conn(0x7f5c140cdbf0 0x7f5c140ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c0bfff640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c140b2030 0x7f5c1415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c137fe640 1 -- 172.21.15.49:0/4272106368 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727512706 0 0) 0x7f5c1415ec30 con 0x7f5c1415e5a0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c137fe640 1 -- 172.21.15.49:0/4272106368 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c00003520 con 0x7f5c1415e5a0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c18d39640 1 -- 172.21.15.49:0/4272106368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c140b2030 msgr2=0x7f5c1415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c18d39640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c140b2030 0x7f5c1415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c18d39640 1 -- 172.21.15.49:0/4272106368 >> v1:172.21.15.49:6789/0 conn(0x7f5c1415e5a0 legacy=0x7f5c140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.140+0000 7f5c18d39640 1 -- 172.21.15.49:0/4272106368 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1415e980 con 0x7f5c140cdbf0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.141+0000 7f5c18d39640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140cdbf0 0x7f5c140ce080 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009d90 tx=0x7f5c0c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afb78049b1bae30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.141+0000 7f5c137fe640 1 -- 172.21.15.49:0/4272106368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c02cc50 con 0x7f5c140cdbf0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.141+0000 7f5c137fe640 1 -- 172.21.15.49:0/4272106368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c02cdb0 con 0x7f5c140cdbf0 2023-12-19T05:43:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.141+0000 7f5c137fe640 1 -- 172.21.15.49:0/4272106368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c034660 con 0x7f5c140cdbf0 2023-12-19T05:43:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 -- 172.21.15.49:0/4272106368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140cdbf0 msgr2=0x7f5c140ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140cdbf0 0x7f5c140ce080 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009d90 tx=0x7f5c0c02bea0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 -- 172.21.15.49:0/4272106368 shutdown_connections 2023-12-19T05:43:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140cdbf0 0x7f5c140ce080 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 --2- 172.21.15.49:0/4272106368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c140b2030 0x7f5c1415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 -- 172.21.15.49:0/4272106368 >> 172.21.15.49:0/4272106368 conn(0x7f5c140b0100 msgr2=0x7f5c140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 -- 172.21.15.49:0/4272106368 shutdown_connections 2023-12-19T05:43:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.142+0000 7f5c1953a640 1 -- 172.21.15.49:0/4272106368 wait complete. 2023-12-19T05:43:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.144+0000 7f5c1953a640 1 Processor -- start 2023-12-19T05:43:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.144+0000 7f5c1953a640 1 -- start start 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c140cdbf0 0x7f5c1406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c1415e5a0 0x7f5c1406d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140cae80 con 0x7f5c140b2030 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140ac8b0 con 0x7f5c140cdbf0 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c1953a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140ad3a0 con 0x7f5c1415e5a0 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.145+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49292/0 (socket says 172.21.15.49:49292) 2023-12-19T05:43:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 -- 172.21.15.49:0/665748620 learned_addr learned my addr 172.21.15.49:0/665748620 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:47.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 -- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c1415e5a0 msgr2=0x7f5c1406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c1415e5a0 0x7f5c1406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 -- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c140cdbf0 msgr2=0x7f5c1406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c140cdbf0 0x7f5c1406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 -- 172.21.15.49:0/665748620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009a70 con 0x7f5c140b2030 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.146+0000 7f5c13fff640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c410 tx=0x7f5c0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.147+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04005ce0 con 0x7f5c140b2030 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.147+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c04005e40 con 0x7f5c140b2030 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.147+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040072f0 con 0x7f5c140b2030 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.147+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c140acb00 con 0x7f5c140b2030 2023-12-19T05:43:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.147+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c140ad0c0 con 0x7f5c140b2030 2023-12-19T05:43:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.148+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1415c070 con 0x7f5c140b2030 2023-12-19T05:43:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.149+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c04007510 con 0x7f5c140b2030 2023-12-19T05:43:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.150+0000 7f5c117fa640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 0x7f5bf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.151+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c04087c90 con 0x7f5c140b2030 2023-12-19T05:43:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.151+0000 7f5c0bfff640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 0x7f5bf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.152+0000 7f5c0bfff640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 0x7f5bf406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c14159270 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.155+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c1415c070 con 0x7f5c140b2030 2023-12-19T05:43:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.386+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c1415c070 con 0x7f5c140b2030 2023-12-19T05:43:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.387+0000 7f5c117fa640 1 -- 172.21.15.49:0/665748620 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f5c04017de0 con 0x7f5c140b2030 2023-12-19T05:43:47.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:47.389 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2281688184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2281688184},{"type":"v1","addr":"172.21.15.115:6835","nonce":2281688184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/960218600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":960218600},{"type":"v1","addr":"172.21.15.115:6837","nonce":960218600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3417509646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3417509646},{"type":"v1","addr":"172.21.15.49:6834","nonce":3417509646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3503798008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3503798008},{"type":"v1","addr":"172.21.15.49:6835","nonce":3503798008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-12-19T05:43:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2023-12-19T05:43:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 msgr2=0x7f5bf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 0x7f5bf406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c14159270 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2023-12-19T05:43:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 msgr2=0x7f5c14154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c410 tx=0x7f5c0400c8d0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 shutdown_connections 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5bf406a430 0x7f5bf406c8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c1415e5a0 0x7f5c1406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c140cdbf0 0x7f5c1406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 --2- 172.21.15.49:0/665748620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c140b2030 0x7f5c14154fa0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 >> 172.21.15.49:0/665748620 conn(0x7f5c140b0100 msgr2=0x7f5c140ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 shutdown_connections 2023-12-19T05:43:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.390+0000 7f5c1953a640 1 -- 172.21.15.49:0/665748620 wait complete. 2023-12-19T05:43:47.411 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:43:47.411 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:43:47.411 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:43:47.411 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:43:47.412 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:43:47.412 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:43:47.412 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:43:47.412 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:43:47.412 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:43:47.412 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:43:47.413 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:43:47.413 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:43:47.413 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:43:47.413 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:43:47.413 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:43:47.413 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:43:47.430 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:43:47.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:43:47.432 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:43:47.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:43:47.435 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:43:47.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:43:47.436 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:43:47.436 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:43:47.481 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:43:47.481 DEBUG:teuthology.parallel:result is None 2023-12-19T05:43:47.485 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:43:47.485 DEBUG:teuthology.parallel:result is None 2023-12-19T05:43:47.488 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:43:47.488 DEBUG:teuthology.parallel:result is None 2023-12-19T05:43:47.492 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:43:47.492 DEBUG:teuthology.parallel:result is None 2023-12-19T05:43:47.492 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:43:47.648 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:43:47.648 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:43:47.649 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:43:47.649 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:43:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.684+0000 7fab5f59e640 1 Processor -- start 2023-12-19T05:43:47.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.684+0000 7fab5f59e640 1 -- start start 2023-12-19T05:43:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.685+0000 7fab5f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 0x7fab60070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.685+0000 7fab5f59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab600d08f0 0x7fab600b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.685+0000 7fab5f59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab600b7d00 con 0x7fab600b7360 2023-12-19T05:43:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.685+0000 7fab5f59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600700c0 con 0x7fab600d08f0 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.685+0000 7fab5f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6006f160 con 0x7fab60146c40 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5dd9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fab600b7360 0x7fab60160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48822/0 (socket says 172.21.15.49:48822) 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5dd9b640 1 -- 172.21.15.49:0/2333481728 learned_addr learned my addr 172.21.15.49:0/2333481728 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5e59c640 1 --2- 172.21.15.49:0/2333481728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 0x7fab60070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5ed9d640 1 --2- 172.21.15.49:0/2333481728 >> v2:172.21.15.115:3300/0 conn(0x7fab600d08f0 0x7fab600b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5d59a640 1 -- 172.21.15.49:0/2333481728 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989021212 0 0) 0x7fab600b7d00 con 0x7fab600b7360 2023-12-19T05:43:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5e59c640 1 -- 172.21.15.49:0/2333481728 >> v2:172.21.15.115:3300/0 conn(0x7fab600d08f0 msgr2=0x7fab600b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5e59c640 1 --2- 172.21.15.49:0/2333481728 >> v2:172.21.15.115:3300/0 conn(0x7fab600d08f0 0x7fab600b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5e59c640 1 -- 172.21.15.49:0/2333481728 >> v1:172.21.15.49:6789/0 conn(0x7fab600b7360 legacy=0x7fab60160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.686+0000 7fab5e59c640 1 -- 172.21.15.49:0/2333481728 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6006f440 con 0x7fab60146c40 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.688+0000 7fab5e59c640 1 --2- 172.21.15.49:0/2333481728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 0x7fab60070e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab500097a0 tx=0x7fab5002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6fd7b371b6eef0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.689+0000 7fab5d59a640 1 -- 172.21.15.49:0/2333481728 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50031830 con 0x7fab60146c40 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.689+0000 7fab5d59a640 1 -- 172.21.15.49:0/2333481728 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50031990 con 0x7fab60146c40 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.689+0000 7fab5d59a640 1 -- 172.21.15.49:0/2333481728 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50031d20 con 0x7fab60146c40 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.689+0000 7fab5f59e640 1 -- 172.21.15.49:0/2333481728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 msgr2=0x7fab60070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.689+0000 7fab5f59e640 1 --2- 172.21.15.49:0/2333481728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 0x7fab60070e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab500097a0 tx=0x7fab5002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 -- 172.21.15.49:0/2333481728 shutdown_connections 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 --2- 172.21.15.49:0/2333481728 >> v2:172.21.15.115:3300/0 conn(0x7fab600d08f0 0x7fab600b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 --2- 172.21.15.49:0/2333481728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab60146c40 0x7fab60070e70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 -- 172.21.15.49:0/2333481728 >> 172.21.15.49:0/2333481728 conn(0x7fab600d31b0 msgr2=0x7fab600d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 -- 172.21.15.49:0/2333481728 shutdown_connections 2023-12-19T05:43:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.690+0000 7fab5f59e640 1 -- 172.21.15.49:0/2333481728 wait complete. 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.691+0000 7fab5f59e640 1 Processor -- start 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 -- start start 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab600b7360 0x7fab6015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 0x7fab6013b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6013c840 con 0x7fab60146c40 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6013c560 con 0x7fab600b7360 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.692+0000 7fab5f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600b4c00 con 0x7fab600d08f0 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49342/0 (socket says 172.21.15.49:49342) 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 -- 172.21.15.49:0/881439492 learned_addr learned my addr 172.21.15.49:0/881439492 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5e59c640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab600b7360 0x7fab6015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5dd9b640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 0x7fab6013b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 -- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 msgr2=0x7fab6013b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 0x7fab6013b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 -- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab600b7360 msgr2=0x7fab6015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab600b7360 0x7fab6015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5ed9d640 1 -- 172.21.15.49:0/881439492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009400 con 0x7fab60146c40 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.693+0000 7fab5dd9b640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 0x7fab6013b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab5ed9d640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab5800efc0 tx=0x7fab5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58009ca0 con 0x7fab60146c40 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5800f040 con 0x7fab60146c40 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600b4ee0 con 0x7fab60146c40 2023-12-19T05:43:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580146c0 con 0x7fab60146c40 2023-12-19T05:43:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.694+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6015bd40 con 0x7fab60146c40 2023-12-19T05:43:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.695+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab600b5400 con 0x7fab60146c40 2023-12-19T05:43:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.696+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab58014820 con 0x7fab60146c40 2023-12-19T05:43:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.697+0000 7fab4effd640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 0x7fab4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.697+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fab58089470 con 0x7fab60146c40 2023-12-19T05:43:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.697+0000 7fab5e59c640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 0x7fab4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.698+0000 7fab5e59c640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 0x7fab4006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab50036000 tx=0x7fab5003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:47.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.701+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fab600b5400 con 0x7fab60146c40 2023-12-19T05:43:47.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:47.909+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fab600b5400 con 0x7fab60146c40 2023-12-19T05:43:48.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.702+0000 7fab4effd640 1 -- 172.21.15.49:0/881439492 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab600b5400 con 0x7fab60146c40 2023-12-19T05:43:48.704 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:43:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 msgr2=0x7fab4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 0x7fab4006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab50036000 tx=0x7fab5003c040 comp rx=0 tx=0).stop 2023-12-19T05:43:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 msgr2=0x7fab6013ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab5800efc0 tx=0x7fab5800c490 comp rx=0 tx=0).stop 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 shutdown_connections 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab4006a430 0x7fab4006c8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab600d08f0 0x7fab6013b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab60146c40 0x7fab6013ba20 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 --2- 172.21.15.49:0/881439492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab600b7360 0x7fab6015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 >> 172.21.15.49:0/881439492 conn(0x7fab600d31b0 msgr2=0x7fab60144cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 shutdown_connections 2023-12-19T05:43:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.706+0000 7fab5f59e640 1 -- 172.21.15.49:0/881439492 wait complete. 2023-12-19T05:43:48.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:43:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.961+0000 7f7c89eb2640 1 Processor -- start 2023-12-19T05:43:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.961+0000 7f7c89eb2640 1 -- start start 2023-12-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c89eb2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c840af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c89eb2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c840b0b50 0x7f7c8406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c89eb2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840afb10 con 0x7f7c8406b590 2023-12-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c89eb2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8406bb30 con 0x7f7c840b0b50 2023-12-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c89eb2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840b0070 con 0x7f7c841449e0 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c82ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c840b0b50 0x7f7c8406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c82ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c840b0b50 0x7f7c8406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49344/0 (socket says 172.21.15.49:49344) 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c82ffd640 1 -- 172.21.15.49:0/431807967 learned_addr learned my addr 172.21.15.49:0/431807967 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.963+0000 7f7c837fe640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c840af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.964+0000 7f7c82ffd640 1 -- 172.21.15.49:0/431807967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 msgr2=0x7f7c840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.964+0000 7f7c82ffd640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c840af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.964+0000 7f7c82ffd640 1 -- 172.21.15.49:0/431807967 >> v1:172.21.15.115:6789/0 conn(0x7f7c8406b590 legacy=0x7f7c8415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.964+0000 7f7c82ffd640 1 -- 172.21.15.49:0/431807967 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840b0350 con 0x7f7c840b0b50 2023-12-19T05:43:48.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.965+0000 7f7c82ffd640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c8406bfa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009870 tx=0x7f7c7802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd33802f0b7f3217 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c827fc640 1 -- 172.21.15.49:0/431807967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78031640 con 0x7f7c840b0b50 2023-12-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c827fc640 1 -- 172.21.15.49:0/431807967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c780317a0 con 0x7f7c840b0b50 2023-12-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c827fc640 1 -- 172.21.15.49:0/431807967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78031b30 con 0x7f7c840b0b50 2023-12-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 -- 172.21.15.49:0/431807967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 msgr2=0x7f7c8406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c8406bfa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009870 tx=0x7f7c7802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 -- 172.21.15.49:0/431807967 shutdown_connections 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c8406bfa0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/431807967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c840af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.966+0000 7f7c89eb2640 1 -- 172.21.15.49:0/431807967 >> 172.21.15.49:0/431807967 conn(0x7f7c840cbb70 msgr2=0x7f7c840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.967+0000 7f7c89eb2640 1 -- 172.21.15.49:0/431807967 shutdown_connections 2023-12-19T05:43:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.967+0000 7f7c89eb2640 1 -- 172.21.15.49:0/431807967 wait complete. 2023-12-19T05:43:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.968+0000 7f7c89eb2640 1 Processor -- start 2023-12-19T05:43:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.969+0000 7f7c89eb2640 1 -- start start 2023-12-19T05:43:48.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.969+0000 7f7c89eb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c8406b590 0x7f7c8415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.969+0000 7f7c89eb2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c89eb2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c8413faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c89eb2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415ca70 con 0x7f7c840b0b50 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c89eb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415c1d0 con 0x7f7c8406b590 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c89eb2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415c4b0 con 0x7f7c841449e0 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49348/0 (socket says 172.21.15.49:49348) 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 -- 172.21.15.49:0/3448044116 learned_addr learned my addr 172.21.15.49:0/3448044116 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c837fe640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c8406b590 0x7f7c8415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 -- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 msgr2=0x7f7c8413faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c83fff640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c8413faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c8413faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 -- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c8406b590 msgr2=0x7f7c8415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c8406b590 0x7f7c8415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c82ffd640 1 -- 172.21.15.49:0/3448044116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780094d0 con 0x7f7c840b0b50 2023-12-19T05:43:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.970+0000 7f7c83fff640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c8413faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c82ffd640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009870 tx=0x7f7c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7803ac60 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7803adc0 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78044610 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8415c790 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.971+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8415bec0 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.972+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84141fd0 con 0x7f7c840b0b50 2023-12-19T05:43:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.973+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c7802f050 con 0x7f7c840b0b50 2023-12-19T05:43:48.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.974+0000 7f7c6bfff640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 0x7f7c7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:48.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.974+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c780aa4f0 con 0x7f7c840b0b50 2023-12-19T05:43:48.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.975+0000 7f7c837fe640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 0x7f7c7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:48.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.976+0000 7f7c837fe640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 0x7f7c7006c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006fd0 tx=0x7f7c74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:48.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:48.979+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c84141fd0 con 0x7f7c840b0b50 2023-12-19T05:43:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.247+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c841423b0 con 0x7f7c840b0b50 2023-12-19T05:43:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.248+0000 7f7c6bfff640 1 -- 172.21.15.49:0/3448044116 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7c841423b0 con 0x7f7c840b0b50 2023-12-19T05:43:49.250 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:49.250 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:43:49.250 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:43:49.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:43:49.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:43:49.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:43:49.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:43:49.263 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:43:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 msgr2=0x7f7c7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 0x7f7c7006c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006fd0 tx=0x7f7c74008040 comp rx=0 tx=0).stop 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 msgr2=0x7f7c841f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009870 tx=0x7f7c780046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 shutdown_connections 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c7006a430 0x7f7c7006c8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c841449e0 0x7f7c8413faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c840b0b50 0x7f7c841f3f90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 --2- 172.21.15.49:0/3448044116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c8406b590 0x7f7c8415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 >> 172.21.15.49:0/3448044116 conn(0x7f7c840cbb70 msgr2=0x7f7c840ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 shutdown_connections 2023-12-19T05:43:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.251+0000 7f7c89eb2640 1 -- 172.21.15.49:0/3448044116 wait complete. 2023-12-19T05:43:49.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:49.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.488+0000 7f22f29d0640 1 Processor -- start 2023-12-19T05:43:49.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.488+0000 7f22f29d0640 1 -- start start 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22f29d0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22ec06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22f29d0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22ec06b590 0x7f22ec06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22f29d0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec06bb30 con 0x7f22ec1449e0 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22f29d0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0070 con 0x7f22ec06b590 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22f29d0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0350 con 0x7f22ec0b0b50 2023-12-19T05:43:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22ebfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22ec1449e0 0x7f22ec0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48834/0 (socket says 172.21.15.49:48834) 2023-12-19T05:43:49.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22ebfff640 1 -- 172.21.15.49:0/1676073360 learned_addr learned my addr 172.21.15.49:0/1676073360 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.490+0000 7f22e37fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22ec06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22f0f6d640 1 --2- 172.21.15.49:0/1676073360 >> v2:172.21.15.115:3300/0 conn(0x7f22ec06b590 0x7f22ec06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711680623 0 0) 0x7f22ec06bb30 con 0x7f22ec1449e0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d8003520 con 0x7f22ec1449e0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153522810 0 0) 0x7f22d8003520 con 0x7f22ec1449e0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 msgr2=0x7f22ec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22ec06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 >> v2:172.21.15.115:3300/0 conn(0x7f22ec06b590 msgr2=0x7f22ec06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 --2- 172.21.15.49:0/1676073360 >> v2:172.21.15.115:3300/0 conn(0x7f22ec06b590 0x7f22ec06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0b0630 con 0x7f22ec1449e0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f22dc001690 con 0x7f22ec1449e0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 >> v1:172.21.15.49:6789/0 conn(0x7f22ec1449e0 legacy=0x7f22ec0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d80039e0 0x7f22d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0070 con 0x7f22d80047c0 2023-12-19T05:43:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0350 con 0x7f22d80039e0 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.491+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800b9d0 con 0x7f22ec0b0b50 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22f0f6d640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22ebfff640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d80039e0 0x7f22d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 -- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 msgr2=0x7f22d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec0b0b50 0x7f22d8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 -- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d80039e0 msgr2=0x7f22d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d80039e0 0x7f22d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22e37fe640 1 -- 172.21.15.49:0/1676073360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8003520 con 0x7f22d80047c0 2023-12-19T05:43:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.492+0000 7f22ebfff640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d80039e0 0x7f22d8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.493+0000 7f22e37fe640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009af0 tx=0x7f22d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59874a341c4cd59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d402c6b0 con 0x7f22d80047c0 2023-12-19T05:43:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d402c810 con 0x7f22d80047c0 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22eb7fe640 1 -- 172.21.15.49:0/1676073360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d402cba0 con 0x7f22d80047c0 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 -- 172.21.15.49:0/1676073360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 msgr2=0x7f22d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 --2- 172.21.15.49:0/1676073360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009af0 tx=0x7f22d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f0f6d640 1 -- 172.21.15.49:0/1676073360 reap_dead start 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 -- 172.21.15.49:0/1676073360 shutdown_connections 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 -- 172.21.15.49:0/1676073360 >> 172.21.15.49:0/1676073360 conn(0x7f22ec0cbb70 msgr2=0x7f22ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 -- 172.21.15.49:0/1676073360 shutdown_connections 2023-12-19T05:43:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.494+0000 7f22f29d0640 1 -- 172.21.15.49:0/1676073360 wait complete. 2023-12-19T05:43:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.496+0000 7f22f29d0640 1 Processor -- start 2023-12-19T05:43:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 -- start start 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ec13e600 0x7f22ec13c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec13ad20 0x7f22ec15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0cd9d0 con 0x7f22d80047c0 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.497+0000 7f22f29d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0cd0c0 con 0x7f22ec13e600 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22f29d0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec13caf0 con 0x7f22ec13ad20 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49378/0 (socket says 172.21.15.49:49378) 2023-12-19T05:43:49.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 -- 172.21.15.49:0/821289510 learned_addr learned my addr 172.21.15.49:0/821289510 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22f0f6d640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec13ad20 0x7f22ec15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 -- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec13ad20 msgr2=0x7f22ec15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec13ad20 0x7f22ec15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 -- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ec13e600 msgr2=0x7f22ec13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ec13e600 0x7f22ec13c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.498+0000 7f22ebfff640 1 -- 172.21.15.49:0/821289510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0cd310 con 0x7f22d80047c0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22ebfff640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d840 tx=0x7f22dc00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0074e0 con 0x7f22d80047c0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc007640 con 0x7f22d80047c0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc004a00 con 0x7f22d80047c0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec0cd5f0 con 0x7f22d80047c0 2023-12-19T05:43:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.499+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec13c8a0 con 0x7f22d80047c0 2023-12-19T05:43:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.500+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec06bf20 con 0x7f22d80047c0 2023-12-19T05:43:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.501+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22dc004b60 con 0x7f22d80047c0 2023-12-19T05:43:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.503+0000 7f22e97fa640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 0x7f22cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.503+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22dc087fe0 con 0x7f22d80047c0 2023-12-19T05:43:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.503+0000 7f22e37fe640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 0x7f22cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.504+0000 7f22e37fe640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 0x7f22cc06c920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22d4036000 tx=0x7f22d402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.507+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22dc053830 con 0x7f22d80047c0 2023-12-19T05:43:49.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.701+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ec061910 con 0x7f22d80047c0 2023-12-19T05:43:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.702+0000 7f22e97fa640 1 -- 172.21.15.49:0/821289510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f22dc019070 con 0x7f22d80047c0 2023-12-19T05:43:49.703 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:49.704 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":86,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:48.689022+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 msgr2=0x7f22cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 0x7f22cc06c920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22d4036000 tx=0x7f22d402e000 comp rx=0 tx=0).stop 2023-12-19T05:43:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 msgr2=0x7f22ec1518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d840 tx=0x7f22dc00dd00 comp rx=0 tx=0).stop 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 shutdown_connections 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22cc06a460 0x7f22cc06c920 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ec13ad20 0x7f22ec15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ec13e600 0x7f22ec13c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 --2- 172.21.15.49:0/821289510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d80047c0 0x7f22ec1518f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 >> 172.21.15.49:0/821289510 conn(0x7f22ec0cbb70 msgr2=0x7f22ec15aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 shutdown_connections 2023-12-19T05:43:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.705+0000 7f22f29d0640 1 -- 172.21.15.49:0/821289510 wait complete. 2023-12-19T05:43:49.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:43:49.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:43:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.960+0000 7f563aedb640 1 Processor -- start 2023-12-19T05:43:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.960+0000 7f563aedb640 1 -- start start 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.962+0000 7f563aedb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f56340cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f563aedb640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cc530 con 0x7f56340b1830 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f563aedb640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cb920 con 0x7f56340ce230 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f563aedb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5634166300 con 0x7f5634161700 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f5633fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f56340b1830 0x7f56340b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48848/0 (socket says 172.21.15.49:48848) 2023-12-19T05:43:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f5633fff640 1 -- 172.21.15.49:0/1682883836 learned_addr learned my addr 172.21.15.49:0/1682883836 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f5638c77640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f56340cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246674682 0 0) 0x7f56340cc530 con 0x7f56340b1830 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.963+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5624003520 con 0x7f56340b1830 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581489543 0 0) 0x7f5624003520 con 0x7f56340b1830 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 msgr2=0x7f56340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f56340cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 >> v1:172.21.15.115:6789/0 conn(0x7f56340ce230 legacy=0x7f56340ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340cbc00 con 0x7f56340b1830 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5620001670 con 0x7f56340b1830 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 >> v1:172.21.15.49:6789/0 conn(0x7f56340b1830 legacy=0x7f56340b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624003a10 0x7f5624003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f5624005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562400ba30 con 0x7f5624003a10 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562400bb70 con 0x7f56240047c0 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562400bd00 con 0x7f5634161700 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.964+0000 7f5638c77640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624003a10 0x7f5624003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5633fff640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5639478640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f5624005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5638c77640 1 -- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 msgr2=0x7f5624005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5638c77640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f5624005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5638c77640 1 -- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 msgr2=0x7f5624004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5638c77640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5638c77640 1 -- 172.21.15.49:0/1682883836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624003520 con 0x7f5624003a10 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5639478640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634161700 0x7f5624005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.965+0000 7f5633fff640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.966+0000 7f5638c77640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624003a10 0x7f5624003df0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5628009ac0 tx=0x7f56240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99a7dacf4fb4ab4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.966+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562802c660 con 0x7f5624003a10 2023-12-19T05:43:49.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.966+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562802c7c0 con 0x7f5624003a10 2023-12-19T05:43:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.966+0000 7f56337fe640 1 -- 172.21.15.49:0/1682883836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562802cb50 con 0x7f5624003a10 2023-12-19T05:43:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 -- 172.21.15.49:0/1682883836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624003a10 msgr2=0x7f5624003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 --2- 172.21.15.49:0/1682883836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624003a10 0x7f5624003df0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5628009ac0 tx=0x7f56240057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f5639478640 1 -- 172.21.15.49:0/1682883836 reap_dead start 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 -- 172.21.15.49:0/1682883836 shutdown_connections 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 -- 172.21.15.49:0/1682883836 >> 172.21.15.49:0/1682883836 conn(0x7f5634073150 msgr2=0x7f56340659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 -- 172.21.15.49:0/1682883836 shutdown_connections 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.967+0000 7f563aedb640 1 -- 172.21.15.49:0/1682883836 wait complete. 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.969+0000 7f563aedb640 1 Processor -- start 2023-12-19T05:43:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.969+0000 7f563aedb640 1 -- start start 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624003a10 0x7f56340af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634152160 0x7f5634153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340af880 con 0x7f56340b0920 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340afb60 con 0x7f5624003a10 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.970+0000 7f563aedb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340afe40 con 0x7f5634152160 2023-12-19T05:43:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49396/0 (socket says 172.21.15.49:49396) 2023-12-19T05:43:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 -- 172.21.15.49:0/3353382135 learned_addr learned my addr 172.21.15.49:0/3353382135 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5638c77640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624003a10 0x7f56340af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5633fff640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634152160 0x7f5634153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 -- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634152160 msgr2=0x7f5634153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634152160 0x7f5634153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 -- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624003a10 msgr2=0x7f56340af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624003a10 0x7f56340af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.971+0000 7f5639478640 1 -- 172.21.15.49:0/3353382135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340b0120 con 0x7f56340b0920 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f5639478640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56340717b0 tx=0x7f562c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c003d80 con 0x7f56340b0920 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c00de50 con 0x7f56340b0920 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0052b0 con 0x7f56340b0920 2023-12-19T05:43:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340b0400 con 0x7f56340b0920 2023-12-19T05:43:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.972+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5634153ed0 con 0x7f56340b0920 2023-12-19T05:43:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.973+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340b05f0 con 0x7f56340b0920 2023-12-19T05:43:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.974+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f562c005410 con 0x7f56340b0920 2023-12-19T05:43:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.975+0000 7f56317fa640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.975+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f562c087b00 con 0x7f56340b0920 2023-12-19T05:43:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.976+0000 7f5638c77640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.977+0000 7f5638c77640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5628036000 tx=0x7f5628030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:49.980+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f562c089e60 con 0x7f56340b0920 2023-12-19T05:43:50.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.174+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5634061910 con 0x7f56340b0920 2023-12-19T05:43:50.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.175+0000 7f56317fa640 1 -- 172.21.15.49:0/3353382135 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f562c0180a0 con 0x7f56340b0920 2023-12-19T05:43:50.176 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 msgr2=0x7f561806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5628036000 tx=0x7f5628030000 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 msgr2=0x7f5634165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56340717b0 tx=0x7f562c00dc00 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 shutdown_connections 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5634152160 0x7f5634153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56340b0920 0x7f5634165100 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 --2- 172.21.15.49:0/3353382135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624003a10 0x7f56340af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.177+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 >> 172.21.15.49:0/3353382135 conn(0x7f5634073150 msgr2=0x7f56340ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.178+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 shutdown_connections 2023-12-19T05:43:50.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.178+0000 7f563aedb640 1 -- 172.21.15.49:0/3353382135 wait complete. 2023-12-19T05:43:50.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:43:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.435+0000 7f2bf96c5640 1 Processor -- start 2023-12-19T05:43:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.435+0000 7f2bf96c5640 1 -- start start 2023-12-19T05:43:50.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.436+0000 7f2bf96c5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bf40ca930 0x7f2bf40cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.436+0000 7f2bf96c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf406f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.436+0000 7f2bf96c5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf406f160 con 0x7f2bf415d120 2023-12-19T05:43:50.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.436+0000 7f2bf96c5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40ccb10 con 0x7f2bf40ca930 2023-12-19T05:43:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.436+0000 7f2bf96c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40ccdf0 con 0x7f2bf40ce7b0 2023-12-19T05:43:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bf40ca930 0x7f2bf40cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2bf415d120 0x7f2bf40ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48850/0 (socket says 172.21.15.49:48850) 2023-12-19T05:43:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf3fff640 1 -- 172.21.15.49:0/778143233 learned_addr learned my addr 172.21.15.49:0/778143233 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf8ec4640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf406f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf37fe640 1 -- 172.21.15.49:0/778143233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 msgr2=0x7f2bf406f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf37fe640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf406f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf37fe640 1 -- 172.21.15.49:0/778143233 >> v1:172.21.15.49:6789/0 conn(0x7f2bf415d120 legacy=0x7f2bf40ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf37fe640 1 -- 172.21.15.49:0/778143233 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40cd0d0 con 0x7f2bf40ca930 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.437+0000 7f2bf2ffd640 1 -- 172.21.15.49:0/778143233 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585954383 0 0) 0x7f2bf406f160 con 0x7f2bf415d120 2023-12-19T05:43:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.439+0000 7f2bf37fe640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf40ca930 0x7f2bf40cc4a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097a0 tx=0x7f2bdc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2af4d79fb5acfc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.439+0000 7f2bf2ffd640 1 -- 172.21.15.49:0/778143233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc031830 con 0x7f2bf40ca930 2023-12-19T05:43:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.439+0000 7f2bf2ffd640 1 -- 172.21.15.49:0/778143233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc031990 con 0x7f2bf40ca930 2023-12-19T05:43:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.439+0000 7f2bf2ffd640 1 -- 172.21.15.49:0/778143233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc031d20 con 0x7f2bf40ca930 2023-12-19T05:43:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 -- 172.21.15.49:0/778143233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf40ca930 msgr2=0x7f2bf40cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf40ca930 0x7f2bf40cc4a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097a0 tx=0x7f2bdc02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 -- 172.21.15.49:0/778143233 shutdown_connections 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf406f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/778143233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf40ca930 0x7f2bf40cc4a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 -- 172.21.15.49:0/778143233 >> 172.21.15.49:0/778143233 conn(0x7f2bf40cfbd0 msgr2=0x7f2bf40cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 -- 172.21.15.49:0/778143233 shutdown_connections 2023-12-19T05:43:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.440+0000 7f2bf96c5640 1 -- 172.21.15.49:0/778143233 wait complete. 2023-12-19T05:43:50.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.442+0000 7f2bf96c5640 1 Processor -- start 2023-12-19T05:43:50.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.442+0000 7f2bf96c5640 1 -- start start 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40ca930 0x7f2bf40b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf41f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40b4880 con 0x7f2bf415d120 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4157330 con 0x7f2bf40ca930 2023-12-19T05:43:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf96c5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4157610 con 0x7f2bf40ce7b0 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf8ec4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf8ec4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49408/0 (socket says 172.21.15.49:49408) 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf8ec4640 1 -- 172.21.15.49:0/3284027537 learned_addr learned my addr 172.21.15.49:0/3284027537 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.443+0000 7f2bf37fe640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf41f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf3fff640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40ca930 0x7f2bf40b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 -- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 msgr2=0x7f2bf41f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf41f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 -- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40ca930 msgr2=0x7f2bf40b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40ca930 0x7f2bf40b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 -- 172.21.15.49:0/3284027537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc009400 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf37fe640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf41f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.444+0000 7f2bf8ec4640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00d800 tx=0x7f2bec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.445+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00b6c0 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.445+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00b840 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.445+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf41578f0 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.445+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00bbf0 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.445+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4157eb0 con 0x7f2bf415d120 2023-12-19T05:43:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.446+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf4061910 con 0x7f2bf415d120 2023-12-19T05:43:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.447+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bec00bd50 con 0x7f2bf415d120 2023-12-19T05:43:50.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.448+0000 7f2bf0ff9640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 0x7f2bd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.449+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bec088b70 con 0x7f2bf415d120 2023-12-19T05:43:50.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.449+0000 7f2bf3fff640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 0x7f2bd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.450+0000 7f2bf3fff640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 0x7f2bd406c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2be40012e0 tx=0x7f2be4005eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.453+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2bec054410 con 0x7f2bf415d120 2023-12-19T05:43:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.649+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2bf40d0a70 con 0x7f2bf415d120 2023-12-19T05:43:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.650+0000 7f2bf0ff9640 1 -- 172.21.15.49:0/3284027537 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2bec057a30 con 0x7f2bf415d120 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:43:50.652 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:43:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.653+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 msgr2=0x7f2bd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 0x7f2bd406c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2be40012e0 tx=0x7f2be4005eb0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 msgr2=0x7f2bf41583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00d800 tx=0x7f2bec00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 shutdown_connections 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2bd406a430 0x7f2bd406c8f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bf40ce7b0 0x7f2bf41f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bf415d120 0x7f2bf41583d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 --2- 172.21.15.49:0/3284027537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40ca930 0x7f2bf40b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 >> 172.21.15.49:0/3284027537 conn(0x7f2bf40cfbd0 msgr2=0x7f2bf415c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 shutdown_connections 2023-12-19T05:43:50.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.654+0000 7f2bf96c5640 1 -- 172.21.15.49:0/3284027537 wait complete. 2023-12-19T05:43:50.677 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:43:50.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:43:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.918+0000 7f3302407640 1 Processor -- start 2023-12-19T05:43:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.918+0000 7f3302407640 1 -- start start 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.920+0000 7f3302407640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32fc15afd0 0x7f32fc0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.920+0000 7f3302407640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc06d070 0x7f32fc0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.920+0000 7f3302407640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15f920 con 0x7f32fc0b02f0 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.920+0000 7f3302407640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0adc40 con 0x7f32fc15afd0 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.920+0000 7f3302407640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b0780 con 0x7f32fc06d070 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32fc15afd0 0x7f32fc0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32fc15afd0 0x7f32fc0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49414/0 (socket says 172.21.15.49:49414) 2023-12-19T05:43:50.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 -- 172.21.15.49:0/144550064 learned_addr learned my addr 172.21.15.49:0/144550064 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3300c04640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc06d070 0x7f32fc0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 -- 172.21.15.49:0/144550064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc06d070 msgr2=0x7f32fc0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc06d070 0x7f32fc0afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 -- 172.21.15.49:0/144550064 >> v1:172.21.15.115:6789/0 conn(0x7f32fc0b02f0 legacy=0x7f32fc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.921+0000 7f3301405640 1 -- 172.21.15.49:0/144550064 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15ed10 con 0x7f32fc15afd0 2023-12-19T05:43:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.922+0000 7f3301405640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc15afd0 0x7f32fc0ad700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009e50 tx=0x7f32f802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658a4d481f87df36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f32f3fff640 1 -- 172.21.15.49:0/144550064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f802ca70 con 0x7f32fc15afd0 2023-12-19T05:43:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f32f3fff640 1 -- 172.21.15.49:0/144550064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f802cbd0 con 0x7f32fc15afd0 2023-12-19T05:43:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f32f3fff640 1 -- 172.21.15.49:0/144550064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80343f0 con 0x7f32fc15afd0 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 -- 172.21.15.49:0/144550064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc15afd0 msgr2=0x7f32fc0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc15afd0 0x7f32fc0ad700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009e50 tx=0x7f32f802bed0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 -- 172.21.15.49:0/144550064 shutdown_connections 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc06d070 0x7f32fc0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 --2- 172.21.15.49:0/144550064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc15afd0 0x7f32fc0ad700 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.923+0000 7f3302407640 1 -- 172.21.15.49:0/144550064 >> 172.21.15.49:0/144550064 conn(0x7f32fc0b4750 msgr2=0x7f32fc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.924+0000 7f3302407640 1 -- 172.21.15.49:0/144550064 shutdown_connections 2023-12-19T05:43:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.924+0000 7f3302407640 1 -- 172.21.15.49:0/144550064 wait complete. 2023-12-19T05:43:50.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.925+0000 7f3302407640 1 Processor -- start 2023-12-19T05:43:50.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.926+0000 7f3302407640 1 -- start start 2023-12-19T05:43:50.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.926+0000 7f3302407640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32fc06d070 0x7f32fc152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3302407640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3302407640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc15afd0 0x7f32fc1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3302407640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc156ed0 con 0x7f32fc0b02f0 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3302407640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1587f0 con 0x7f32fc06d070 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3302407640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc158220 con 0x7f32fc15afd0 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49422/0 (socket says 172.21.15.49:49422) 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 -- 172.21.15.49:0/366837528 learned_addr learned my addr 172.21.15.49:0/366837528 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 -- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc15afd0 msgr2=0x7f32fc1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc15afd0 0x7f32fc1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 -- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32fc06d070 msgr2=0x7f32fc152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32fc06d070 0x7f32fc152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.927+0000 7f3300c04640 1 -- 172.21.15.49:0/366837528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009b30 con 0x7f32fc0b02f0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f3300c04640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7f0 tx=0x7f32ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec004220 con 0x7f32fc0b02f0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0043a0 con 0x7f32fc0b02f0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec007860 con 0x7f32fc0b02f0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc1570e0 con 0x7f32fc0b02f0 2023-12-19T05:43:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.928+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc158480 con 0x7f32fc0b02f0 2023-12-19T05:43:50.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.929+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc061910 con 0x7f32fc0b02f0 2023-12-19T05:43:50.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.930+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f32ec007bd0 con 0x7f32fc0b02f0 2023-12-19T05:43:50.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.931+0000 7f32f1ffb640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 0x7f32e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:50.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.931+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32ec088580 con 0x7f32fc0b02f0 2023-12-19T05:43:50.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.932+0000 7f3301405640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 0x7f32e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:50.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.933+0000 7f3301405640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 0x7f32e006c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f32f8035000 tx=0x7f32f802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:50.935+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f32ec053ec0 con 0x7f32fc0b02f0 2023-12-19T05:43:51.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.128+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32fc158960 con 0x7f32fc0b02f0 2023-12-19T05:43:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.678+0000 7f32f1ffb640 1 -- 172.21.15.49:0/366837528 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32ec01e0b0 con 0x7f32fc0b02f0 2023-12-19T05:43:51.680 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:43:51.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.684+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 msgr2=0x7f32e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.684+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 0x7f32e006c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f32f8035000 tx=0x7f32f802e000 comp rx=0 tx=0).stop 2023-12-19T05:43:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.684+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 msgr2=0x7f32fc153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.684+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7f0 tx=0x7f32ec00ccb0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 shutdown_connections 2023-12-19T05:43:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f32e006a430 0x7f32e006c8f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32fc15afd0 0x7f32fc1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32fc0b02f0 0x7f32fc153240 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 --2- 172.21.15.49:0/366837528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32fc06d070 0x7f32fc152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.685+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 >> 172.21.15.49:0/366837528 conn(0x7f32fc0b4750 msgr2=0x7f32fc0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.687+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 shutdown_connections 2023-12-19T05:43:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.687+0000 7f3302407640 1 -- 172.21.15.49:0/366837528 wait complete. 2023-12-19T05:43:51.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:43:51.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.943+0000 7f970aa79640 1 Processor -- start 2023-12-19T05:43:51.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.943+0000 7f970aa79640 1 -- start start 2023-12-19T05:43:51.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f970aa79640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f97040b0980 0x7f970415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f970aa79640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f97040cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f970aa79640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9704161b90 con 0x7f97040b05a0 2023-12-19T05:43:51.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f970aa79640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970415b320 con 0x7f97040b0980 2023-12-19T05:43:51.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f970aa79640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9704160f80 con 0x7f970415af00 2023-12-19T05:43:51.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.945+0000 7f9709a77640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f97040b05a0 0x7f97040af3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:57524/0 (socket says 172.21.15.49:57524) 2023-12-19T05:43:51.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709a77640 1 -- 172.21.15.49:0/204057420 learned_addr learned my addr 172.21.15.49:0/204057420 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:51.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709276640 1 --2- 172.21.15.49:0/204057420 >> v2:172.21.15.115:3300/0 conn(0x7f97040b0980 0x7f970415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f970a278640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f97040cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709276640 1 -- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 msgr2=0x7f97040cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709276640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f97040cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709276640 1 -- 172.21.15.49:0/204057420 >> v1:172.21.15.115:6789/0 conn(0x7f97040b05a0 legacy=0x7f97040af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f9709276640 1 -- 172.21.15.49:0/204057420 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704161260 con 0x7f97040b0980 2023-12-19T05:43:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.946+0000 7f970a278640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f97040cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:43:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.948+0000 7f9709276640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f970415a9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f96f40097a0 tx=0x7f96f402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79de18f5e0fade5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.948+0000 7f9708a75640 1 -- 172.21.15.49:0/204057420 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4031780 con 0x7f97040b0980 2023-12-19T05:43:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.948+0000 7f9708a75640 1 -- 172.21.15.49:0/204057420 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f40318e0 con 0x7f97040b0980 2023-12-19T05:43:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.948+0000 7f9708a75640 1 -- 172.21.15.49:0/204057420 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4031c70 con 0x7f97040b0980 2023-12-19T05:43:51.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 -- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 msgr2=0x7f970415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f970415a9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f96f40097a0 tx=0x7f96f402b820 comp rx=0 tx=0).stop 2023-12-19T05:43:51.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 -- 172.21.15.49:0/204057420 shutdown_connections 2023-12-19T05:43:51.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f97040cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 --2- 172.21.15.49:0/204057420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f970415a9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 -- 172.21.15.49:0/204057420 >> 172.21.15.49:0/204057420 conn(0x7f97040659a0 msgr2=0x7f9704065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 -- 172.21.15.49:0/204057420 shutdown_connections 2023-12-19T05:43:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.949+0000 7f970aa79640 1 -- 172.21.15.49:0/204057420 wait complete. 2023-12-19T05:43:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.951+0000 7f970aa79640 1 Processor -- start 2023-12-19T05:43:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.951+0000 7f970aa79640 1 -- start start 2023-12-19T05:43:51.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f9704156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f970406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970406e140 con 0x7f97040b05a0 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970406de60 con 0x7f97040b0980 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f970aa79640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9704152540 con 0x7f970415af00 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f9709a77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f9709a77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49428/0 (socket says 172.21.15.49:49428) 2023-12-19T05:43:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.952+0000 7f9709a77640 1 -- 172.21.15.49:0/3709456985 learned_addr learned my addr 172.21.15.49:0/3709456985 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709276640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f9704156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f970a278640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f970406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 -- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 msgr2=0x7f970406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f970406d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 -- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 msgr2=0x7f9704156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f9704156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 -- 172.21.15.49:0/3709456985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009a70 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f970a278640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f970406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709276640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f9704156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f9709a77640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f970000c3c0 tx=0x7f970000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.953+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700005ce0 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.954+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700005e40 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.954+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000072d0 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.954+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f4009400 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.954+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9704152b00 con 0x7f97040b05a0 2023-12-19T05:43:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.955+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9704061910 con 0x7f97040b05a0 2023-12-19T05:43:51.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.956+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97000074f0 con 0x7f97040b05a0 2023-12-19T05:43:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.957+0000 7f96fa7fc640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 0x7f96e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.957+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9700087d00 con 0x7f97040b05a0 2023-12-19T05:43:51.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.958+0000 7f9709276640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 0x7f96e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:51.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.959+0000 7f9709276640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 0x7f96e806c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f96f4036000 tx=0x7f96f403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:51.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:51.962+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f97000534c0 con 0x7f97040b05a0 2023-12-19T05:43:52.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.158+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9704161510 con 0x7f97040b05a0 2023-12-19T05:43:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.697+0000 7f96fa7fc640 1 -- 172.21.15.49:0/3709456985 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7f97000170d0 con 0x7f97040b05a0 2023-12-19T05:43:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:43:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.705+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 msgr2=0x7f96e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.705+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 0x7f96e806c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f96f4036000 tx=0x7f96f403d040 comp rx=0 tx=0).stop 2023-12-19T05:43:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.706+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 msgr2=0x7f9704151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.706+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f970000c3c0 tx=0x7f970000c880 comp rx=0 tx=0).stop 2023-12-19T05:43:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 shutdown_connections 2023-12-19T05:43:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f96e806a430 0x7f96e806c8f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f970415af00 0x7f970406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97040b0980 0x7f9704156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 --2- 172.21.15.49:0/3709456985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97040b05a0 0x7f9704151b50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.708+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 >> 172.21.15.49:0/3709456985 conn(0x7f97040659a0 msgr2=0x7f970415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.711+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 shutdown_connections 2023-12-19T05:43:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.711+0000 7f970aa79640 1 -- 172.21.15.49:0/3709456985 wait complete. 2023-12-19T05:43:52.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:43:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.941+0000 7f6a26ed7640 1 Processor -- start 2023-12-19T05:43:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.941+0000 7f6a26ed7640 1 -- start start 2023-12-19T05:43:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a26ed7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a200afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a26ed7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2006e220 con 0x7f6a200b02a0 2023-12-19T05:43:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a26ed7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200b0700 con 0x7f6a2006dc00 2023-12-19T05:43:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a26ed7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200cbea0 con 0x7f6a20141900 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a256d4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6a200b02a0 0x7f6a2006d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48866/0 (socket says 172.21.15.49:48866) 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.943+0000 7f6a256d4640 1 -- 172.21.15.49:0/2350845211 learned_addr learned my addr 172.21.15.49:0/2350845211 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a200afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257641112 0 0) 0x7f6a2006e220 con 0x7f6a200b02a0 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c003520 con 0x7f6a200b02a0 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929863996 0 0) 0x7f6a0c003520 con 0x7f6a200b02a0 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 msgr2=0x7f6a200afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a200afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 >> v1:172.21.15.115:6789/0 conn(0x7f6a2006dc00 legacy=0x7f6a200ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200cc180 con 0x7f6a200b02a0 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f6a10001670 con 0x7f6a200b02a0 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 >> v1:172.21.15.49:6789/0 conn(0x7f6a200b02a0 legacy=0x7f6a2006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.944+0000 7f6a24ed3640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a0c0039a0 0x7f6a0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a24ed3640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a24ed3640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200cbea0 con 0x7f6a0c004d00 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00bb10 con 0x7f6a0c0039a0 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00bca0 con 0x7f6a20141900 2023-12-19T05:43:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a0c0039a0 0x7f6a0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a256d4640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 -- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 msgr2=0x7f6a0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a20141900 0x7f6a0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 -- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a0c0039a0 msgr2=0x7f6a0c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a0c0039a0 0x7f6a0c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.945+0000 7f6a266d6640 1 -- 172.21.15.49:0/2350845211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c003520 con 0x7f6a0c004d00 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a266d6640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6a18001e80 tx=0x7f6a0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b0e761778b8599 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:52.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18003b70 con 0x7f6a0c004d00 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18003cd0 con 0x7f6a0c004d00 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a24ed3640 1 -- 172.21.15.49:0/2350845211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18005310 con 0x7f6a0c004d00 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a26ed7640 1 -- 172.21.15.49:0/2350845211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a0c004d00 msgr2=0x7f6a0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.947+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/2350845211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6a18001e80 tx=0x7f6a0c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.948+0000 7f6a266d6640 1 -- 172.21.15.49:0/2350845211 reap_dead start 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.948+0000 7f6a26ed7640 1 -- 172.21.15.49:0/2350845211 shutdown_connections 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.948+0000 7f6a26ed7640 1 -- 172.21.15.49:0/2350845211 >> 172.21.15.49:0/2350845211 conn(0x7f6a2006f630 msgr2=0x7f6a2006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.948+0000 7f6a26ed7640 1 -- 172.21.15.49:0/2350845211 shutdown_connections 2023-12-19T05:43:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.948+0000 7f6a26ed7640 1 -- 172.21.15.49:0/2350845211 wait complete. 2023-12-19T05:43:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.950+0000 7f6a26ed7640 1 Processor -- start 2023-12-19T05:43:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.950+0000 7f6a26ed7640 1 -- start start 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 0x7f6a20159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a200c7750 0x7f6a200c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c8120 con 0x7f6a200cdcd0 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20134ea0 con 0x7f6a200c7750 2023-12-19T05:43:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a26ed7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2015a1d0 con 0x7f6a0c004d00 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a256d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a256d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49452/0 (socket says 172.21.15.49:49452) 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a256d4640 1 -- 172.21.15.49:0/3767171744 learned_addr learned my addr 172.21.15.49:0/3767171744 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.951+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 0x7f6a20159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 -- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 msgr2=0x7f6a20159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 0x7f6a20159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 -- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a200c7750 msgr2=0x7f6a200c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a200c7750 0x7f6a200c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 -- 172.21.15.49:0/3767171744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200ce6e0 con 0x7f6a200cdcd0 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 0x7f6a20159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a256d4640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e7f0 tx=0x7f6a1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000c850 con 0x7f6a200cdcd0 2023-12-19T05:43:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000c9b0 con 0x7f6a200cdcd0 2023-12-19T05:43:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a201350f0 con 0x7f6a200cdcd0 2023-12-19T05:43:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000cd40 con 0x7f6a200cdcd0 2023-12-19T05:43:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.952+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201356b0 con 0x7f6a200cdcd0 2023-12-19T05:43:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.953+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20061910 con 0x7f6a200cdcd0 2023-12-19T05:43:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.955+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a1001d460 con 0x7f6a200cdcd0 2023-12-19T05:43:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.956+0000 7f6a167fc640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 0x7f6a0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.956+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6a100888d0 con 0x7f6a200cdcd0 2023-12-19T05:43:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.957+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 0x7f6a0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.958+0000 7f6a25ed5640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 0x7f6a0406c8f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:52.961+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6a10053e90 con 0x7f6a200cdcd0 2023-12-19T05:43:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.195+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a2006d690 con 0x7f6a200cdcd0 2023-12-19T05:43:53.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.206+0000 7f6a167fc640 1 -- 172.21.15.49:0/3767171744 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6a100574b0 con 0x7f6a200cdcd0 2023-12-19T05:43:53.207 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 10 and data pool 11 2023-12-19T05:43:53.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 msgr2=0x7f6a0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 0x7f6a0406c8f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2023-12-19T05:43:53.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 msgr2=0x7f6a200ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e7f0 tx=0x7f6a1000ecb0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 shutdown_connections 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a0406a430 0x7f6a0406c8f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a200c7750 0x7f6a200c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a200cdcd0 0x7f6a200ce1a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 --2- 172.21.15.49:0/3767171744 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a0c004d00 0x7f6a20159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 >> 172.21.15.49:0/3767171744 conn(0x7f6a2006f630 msgr2=0x7f6a200ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.209+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 shutdown_connections 2023-12-19T05:43:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.210+0000 7f6a26ed7640 1 -- 172.21.15.49:0/3767171744 wait complete. 2023-12-19T05:43:53.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.441+0000 7fd30d277640 1 Processor -- start 2023-12-19T05:43:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.441+0000 7fd30d277640 1 -- start start 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.443+0000 7fd30d277640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd30806c6b0 0x7fd308166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.443+0000 7fd30d277640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30806bb30 con 0x7fd3081449e0 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.443+0000 7fd30d277640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080b0070 con 0x7fd3080b0b50 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.443+0000 7fd30d277640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080b0350 con 0x7fd30806c6b0 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.443+0000 7fd3077fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd30806c6b0 0x7fd308166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd306ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd3081449e0 0x7fd3080af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48872/0 (socket says 172.21.15.49:48872) 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd306ffd640 1 -- 172.21.15.49:0/1819329875 learned_addr learned my addr 172.21.15.49:0/1819329875 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd3077fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd30806c6b0 0x7fd308166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49454/0 (socket says 172.21.15.49:49454) 2023-12-19T05:43:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd3077fe640 1 -- 172.21.15.49:0/1819329875 >> v1:172.21.15.115:6789/0 conn(0x7fd3080b0b50 legacy=0x7fd30806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd3077fe640 1 -- 172.21.15.49:0/1819329875 >> v1:172.21.15.49:6789/0 conn(0x7fd3081449e0 legacy=0x7fd3080af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd3077fe640 1 -- 172.21.15.49:0/1819329875 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080b0630 con 0x7fd30806c6b0 2023-12-19T05:43:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.444+0000 7fd3067fc640 1 -- 172.21.15.49:0/1819329875 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357518953 0 0) 0x7fd30806bb30 con 0x7fd3081449e0 2023-12-19T05:43:53.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd3077fe640 1 --2- 172.21.15.49:0/1819329875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd30806c6b0 0x7fd308166200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd30002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41904c7ecadc21ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd3067fc640 1 -- 172.21.15.49:0/1819329875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30002cd00 con 0x7fd30806c6b0 2023-12-19T05:43:53.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd3067fc640 1 -- 172.21.15.49:0/1819329875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30002ce60 con 0x7fd30806c6b0 2023-12-19T05:43:53.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd3067fc640 1 -- 172.21.15.49:0/1819329875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300034660 con 0x7fd30806c6b0 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd30d277640 1 -- 172.21.15.49:0/1819329875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd30806c6b0 msgr2=0x7fd308166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.446+0000 7fd30d277640 1 --2- 172.21.15.49:0/1819329875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd30806c6b0 0x7fd308166200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd30002bf50 comp rx=0 tx=0).stop 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.447+0000 7fd30d277640 1 -- 172.21.15.49:0/1819329875 shutdown_connections 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.447+0000 7fd30d277640 1 --2- 172.21.15.49:0/1819329875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd30806c6b0 0x7fd308166200 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.447+0000 7fd30d277640 1 -- 172.21.15.49:0/1819329875 >> 172.21.15.49:0/1819329875 conn(0x7fd3080cbb70 msgr2=0x7fd3080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.447+0000 7fd30d277640 1 -- 172.21.15.49:0/1819329875 shutdown_connections 2023-12-19T05:43:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.447+0000 7fd30d277640 1 -- 172.21.15.49:0/1819329875 wait complete. 2023-12-19T05:43:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.449+0000 7fd30d277640 1 Processor -- start 2023-12-19T05:43:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.449+0000 7fd30d277640 1 -- start start 2023-12-19T05:43:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd30806c6b0 0x7fd30815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3080b0b50 0x7fd30813a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30813ab80 con 0x7fd3081449e0 2023-12-19T05:43:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080acd20 con 0x7fd3080b0b50 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.450+0000 7fd30d277640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080ad000 con 0x7fd30806c6b0 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49456/0 (socket says 172.21.15.49:49456) 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 -- 172.21.15.49:0/1814178286 learned_addr learned my addr 172.21.15.49:0/1814178286 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd306ffd640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd30806c6b0 0x7fd30815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd2fffff640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3080b0b50 0x7fd30813a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 -- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd30806c6b0 msgr2=0x7fd30815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd30806c6b0 0x7fd30815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 -- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3080b0b50 msgr2=0x7fd30813a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3080b0b50 0x7fd30813a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.451+0000 7fd3077fe640 1 -- 172.21.15.49:0/1814178286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300009a70 con 0x7fd3081449e0 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.452+0000 7fd3077fe640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.452+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30003d600 con 0x7fd3081449e0 2023-12-19T05:43:53.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.452+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30003d780 con 0x7fd3081449e0 2023-12-19T05:43:53.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.452+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30003db30 con 0x7fd3081449e0 2023-12-19T05:43:53.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.452+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3080ad2e0 con 0x7fd3081449e0 2023-12-19T05:43:53.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.453+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080cea90 con 0x7fd3081449e0 2023-12-19T05:43:53.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.454+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080ad800 con 0x7fd3081449e0 2023-12-19T05:43:53.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.455+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd30003b040 con 0x7fd3081449e0 2023-12-19T05:43:53.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.456+0000 7fd2ff7fe640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.456+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3000aa9b0 con 0x7fd3081449e0 2023-12-19T05:43:53.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.457+0000 7fd306ffd640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.458+0000 7fd306ffd640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 0x7fd2e806c8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8000f60 tx=0x7fd2f8007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.461+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3080ad800 con 0x7fd3081449e0 2023-12-19T05:43:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.655+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3080ad800 con 0x7fd3081449e0 2023-12-19T05:43:53.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.659+0000 7fd2ff7fe640 1 -- 172.21.15.49:0/1814178286 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fd3080ad800 con 0x7fd3081449e0 2023-12-19T05:43:53.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:53.661 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:53.197330+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 msgr2=0x7fd2e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 0x7fd2e806c8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8000f60 tx=0x7fd2f8007d00 comp rx=0 tx=0).stop 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 msgr2=0x7fd3080700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd300004a40 comp rx=0 tx=0).stop 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 shutdown_connections 2023-12-19T05:43:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3081449e0 0x7fd3080700d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3080b0b50 0x7fd30813a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 --2- 172.21.15.49:0/1814178286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd30806c6b0 0x7fd30815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.661+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 >> 172.21.15.49:0/1814178286 conn(0x7fd3080cbb70 msgr2=0x7fd30815ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.662+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 shutdown_connections 2023-12-19T05:43:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.662+0000 7fd30d277640 1 -- 172.21.15.49:0/1814178286 wait complete. 2023-12-19T05:43:53.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.905+0000 7f0feb59e640 1 Processor -- start 2023-12-19T05:43:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.905+0000 7f0feb59e640 1 -- start start 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.907+0000 7f0feb59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0fec0ce300 0x7f0fec15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.907+0000 7f0feb59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec15ec30 con 0x7f0fec15e5a0 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.907+0000 7f0feb59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec15fbc0 con 0x7f0fec0b2030 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.907+0000 7f0feb59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec15e980 con 0x7f0fec0ce300 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fead9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0fec0ce300 0x7f0fec15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fea59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0fec15e5a0 0x7f0fec0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48888/0 (socket says 172.21.15.49:48888) 2023-12-19T05:43:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fea59c640 1 -- 172.21.15.49:0/2640856160 learned_addr learned my addr 172.21.15.49:0/2640856160 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fe959a640 1 -- 172.21.15.49:0/2640856160 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546032647 0 0) 0x7f0fec15ec30 con 0x7f0fec15e5a0 2023-12-19T05:43:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fe959a640 1 -- 172.21.15.49:0/2640856160 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd8003520 con 0x7f0fec15e5a0 2023-12-19T05:43:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fead9d640 1 -- 172.21.15.49:0/2640856160 >> v1:172.21.15.115:6789/0 conn(0x7f0fec0b2030 legacy=0x7f0fec0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fead9d640 1 -- 172.21.15.49:0/2640856160 >> v1:172.21.15.49:6789/0 conn(0x7f0fec15e5a0 legacy=0x7f0fec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.908+0000 7f0fead9d640 1 -- 172.21.15.49:0/2640856160 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0b2f90 con 0x7f0fec0ce300 2023-12-19T05:43:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0fead9d640 1 --2- 172.21.15.49:0/2640856160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0ce300 0x7f0fec15f680 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097d0 tx=0x7f0fe402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8665a550e030ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0fe959a640 1 -- 172.21.15.49:0/2640856160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4030800 con 0x7f0fec0ce300 2023-12-19T05:43:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0fe959a640 1 -- 172.21.15.49:0/2640856160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4030960 con 0x7f0fec0ce300 2023-12-19T05:43:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0fe959a640 1 -- 172.21.15.49:0/2640856160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4030cf0 con 0x7f0fec0ce300 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0feb59e640 1 -- 172.21.15.49:0/2640856160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0ce300 msgr2=0x7f0fec15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.910+0000 7f0feb59e640 1 --2- 172.21.15.49:0/2640856160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0ce300 0x7f0fec15f680 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097d0 tx=0x7f0fe402b940 comp rx=0 tx=0).stop 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.911+0000 7f0feb59e640 1 -- 172.21.15.49:0/2640856160 shutdown_connections 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.911+0000 7f0feb59e640 1 --2- 172.21.15.49:0/2640856160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0ce300 0x7f0fec15f680 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.911+0000 7f0feb59e640 1 -- 172.21.15.49:0/2640856160 >> 172.21.15.49:0/2640856160 conn(0x7f0fec0b0100 msgr2=0x7f0fec0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.911+0000 7f0feb59e640 1 -- 172.21.15.49:0/2640856160 shutdown_connections 2023-12-19T05:43:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.911+0000 7f0feb59e640 1 -- 172.21.15.49:0/2640856160 wait complete. 2023-12-19T05:43:53.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.912+0000 7f0feb59e640 1 Processor -- start 2023-12-19T05:43:53.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.913+0000 7f0feb59e640 1 -- start start 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 0x7f0fec154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec15e5a0 0x7f0fec155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0c40a0 con 0x7f0fec0b2030 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec159700 con 0x7f0fec0ce300 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0feb59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec158e60 con 0x7f0fec15e5a0 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49474/0 (socket says 172.21.15.49:49474) 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 -- 172.21.15.49:0/769445467 learned_addr learned my addr 172.21.15.49:0/769445467 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 -- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec15e5a0 msgr2=0x7f0fec155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fe9d9b640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 0x7f0fec154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec15e5a0 0x7f0fec155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 -- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 msgr2=0x7f0fec154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:53.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 0x7f0fec154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:53.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fea59c640 1 -- 172.21.15.49:0/769445467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4009400 con 0x7f0fec0b2030 2023-12-19T05:43:53.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.914+0000 7f0fe9d9b640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 0x7f0fec154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:53.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0fea59c640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00cbc0 tx=0x7f0fdc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00ad40 con 0x7f0fec0b2030 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc012400 con 0x7f0fec0b2030 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00aea0 con 0x7f0fec0b2030 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec159140 con 0x7f0fec0b2030 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.915+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec158b50 con 0x7f0fec0b2030 2023-12-19T05:43:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.916+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec061910 con 0x7f0fec0b2030 2023-12-19T05:43:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.918+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fdc007070 con 0x7f0fec0b2030 2023-12-19T05:43:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.918+0000 7f0fe2ffd640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 0x7f0fcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.919+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fdc088880 con 0x7f0fec0b2030 2023-12-19T05:43:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.919+0000 7f0fe9d9b640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 0x7f0fcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.920+0000 7f0fe9d9b640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 0x7f0fcc06c8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0fec06e4f0 tx=0x7f0fd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:53.923+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0fdc053f00 con 0x7f0fec0b2030 2023-12-19T05:43:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.119+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fec0b2530 con 0x7f0fec0b2030 2023-12-19T05:43:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.120+0000 7f0fe2ffd640 1 -- 172.21.15.49:0/769445467 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f0fdc017020 con 0x7f0fec0b2030 2023-12-19T05:43:54.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:54.122 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:53.197330+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 msgr2=0x7f0fcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 0x7f0fcc06c8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0fec06e4f0 tx=0x7f0fd4009040 comp rx=0 tx=0).stop 2023-12-19T05:43:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 msgr2=0x7f0fec158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00cbc0 tx=0x7f0fdc00a430 comp rx=0 tx=0).stop 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 shutdown_connections 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0fcc06a430 0x7f0fcc06c8f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec15e5a0 0x7f0fec155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec0ce300 0x7f0fec154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 --2- 172.21.15.49:0/769445467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0b2030 0x7f0fec158610 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 >> 172.21.15.49:0/769445467 conn(0x7f0fec0b0100 msgr2=0x7f0fec157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 shutdown_connections 2023-12-19T05:43:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.123+0000 7f0feb59e640 1 -- 172.21.15.49:0/769445467 wait complete. 2023-12-19T05:43:54.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:43:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.380+0000 7f41644b2640 1 Processor -- start 2023-12-19T05:43:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.380+0000 7f41644b2640 1 -- start start 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f41644b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f415c15af30 0x7f415c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f41644b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f41644b2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c06e180 con 0x7f415c06dd30 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f41644b2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c15ec30 con 0x7f415c15af30 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f41644b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c15e2f0 con 0x7f415c15da70 2023-12-19T05:43:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f415c15af30 0x7f415c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f415c15af30 0x7f415c161c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56126/0 (socket says 172.21.15.49:56126) 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 -- 172.21.15.49:0/3982397102 learned_addr learned my addr 172.21.15.49:0/3982397102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 -- 172.21.15.49:0/3982397102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 msgr2=0x7f415c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 --2- 172.21.15.49:0/3982397102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 -- 172.21.15.49:0/3982397102 >> v1:172.21.15.115:6789/0 conn(0x7f415c06dd30 legacy=0x7f415c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.382+0000 7f416224e640 1 -- 172.21.15.49:0/3982397102 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c15e5d0 con 0x7f415c15af30 2023-12-19T05:43:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f416224e640 1 --2- 172.21.15.49:0/3982397102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c161c00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4150009870 tx=0x7f415002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623d03049e2fd9d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f416124c640 1 -- 172.21.15.49:0/3982397102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150031640 con 0x7f415c15af30 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f416124c640 1 -- 172.21.15.49:0/3982397102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41500317a0 con 0x7f415c15af30 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f416124c640 1 -- 172.21.15.49:0/3982397102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150031b30 con 0x7f415c15af30 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f41644b2640 1 -- 172.21.15.49:0/3982397102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 msgr2=0x7f415c161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.384+0000 7f41644b2640 1 --2- 172.21.15.49:0/3982397102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c161c00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4150009870 tx=0x7f415002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 -- 172.21.15.49:0/3982397102 shutdown_connections 2023-12-19T05:43:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 --2- 172.21.15.49:0/3982397102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 --2- 172.21.15.49:0/3982397102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c161c00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 -- 172.21.15.49:0/3982397102 >> 172.21.15.49:0/3982397102 conn(0x7f415c06a2e0 msgr2=0x7f415c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 -- 172.21.15.49:0/3982397102 shutdown_connections 2023-12-19T05:43:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.385+0000 7f41644b2640 1 -- 172.21.15.49:0/3982397102 wait complete. 2023-12-19T05:43:54.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.386+0000 7f41644b2640 1 Processor -- start 2023-12-19T05:43:54.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.387+0000 7f41644b2640 1 -- start start 2023-12-19T05:43:54.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f415c06dd30 0x7f415c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c1580a0 con 0x7f415c15af30 2023-12-19T05:43:54.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0af460 con 0x7f415c06dd30 2023-12-19T05:43:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f41644b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0af740 con 0x7f415c15da70 2023-12-19T05:43:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56138/0 (socket says 172.21.15.49:56138) 2023-12-19T05:43:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 -- 172.21.15.49:0/3981576341 learned_addr learned my addr 172.21.15.49:0/3981576341 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 -- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 msgr2=0x7f415c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4162a4f640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f416224e640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f415c06dd30 0x7f415c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 -- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f415c06dd30 msgr2=0x7f415c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f415c06dd30 0x7f415c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.388+0000 7f4161a4d640 1 -- 172.21.15.49:0/3981576341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500094d0 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f4161a4d640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f415800ba50 tx=0x7f415800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800cbe0 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800cd60 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158014680 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0ad1f0 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.389+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0ad9f0 con 0x7f415c15af30 2023-12-19T05:43:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.391+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c06e800 con 0x7f415c15af30 2023-12-19T05:43:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.391+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f415801d3b0 con 0x7f415c15af30 2023-12-19T05:43:54.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.393+0000 7f414effd640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:54.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.393+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41580889b0 con 0x7f415c15af30 2023-12-19T05:43:54.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.393+0000 7f416224e640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:54.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.395+0000 7f416224e640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4150036000 tx=0x7f415003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:54.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.396+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4158053f00 con 0x7f415c15af30 2023-12-19T05:43:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:54.629+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f415c0ad050 con 0x7f415c15af30 2023-12-19T05:43:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.237+0000 7f414effd640 1 -- 172.21.15.49:0/3981576341 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f415c0ad050 con 0x7f415c15af30 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 msgr2=0x7f414006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4150036000 tx=0x7f415003c040 comp rx=0 tx=0).stop 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 msgr2=0x7f415c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f415800ba50 tx=0x7f415800bf10 comp rx=0 tx=0).stop 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 shutdown_connections 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.241+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f415c15da70 0x7f415c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.242+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f415c15af30 0x7f415c0aed60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.242+0000 7f41644b2640 1 --2- 172.21.15.49:0/3981576341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f415c06dd30 0x7f415c150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.242+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 >> 172.21.15.49:0/3981576341 conn(0x7f415c06a2e0 msgr2=0x7f415c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.242+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 shutdown_connections 2023-12-19T05:43:55.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.242+0000 7f41644b2640 1 -- 172.21.15.49:0/3981576341 wait complete. 2023-12-19T05:43:55.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:43:55.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:43:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.507+0000 7f0a9d66c640 1 Processor -- start 2023-12-19T05:43:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.507+0000 7f0a9d66c640 1 -- start start 2023-12-19T05:43:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.509+0000 7f0a9d66c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.509+0000 7f0a9d66c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a9806ca80 0x7f0a980cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.509+0000 7f0a9d66c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9815c9c0 con 0x7f0a98155460 2023-12-19T05:43:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.509+0000 7f0a9d66c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9806d270 con 0x7f0a9806ca80 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.509+0000 7f0a9d66c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9806d550 con 0x7f0a980b0a00 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a9ce6b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a9806ca80 0x7f0a980cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a97fff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0a98155460 0x7f0a980b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50026/0 (socket says 172.21.15.49:50026) 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:43934/0 (socket says 172.21.15.49:43934) 2023-12-19T05:43:55.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a97fff640 1 -- 172.21.15.49:0/501902933 learned_addr learned my addr 172.21.15.49:0/501902933 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 -- 172.21.15.49:0/501902933 >> v2:172.21.15.115:3300/0 conn(0x7f0a9806ca80 msgr2=0x7f0a980cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 --2- 172.21.15.49:0/501902933 >> v2:172.21.15.115:3300/0 conn(0x7f0a9806ca80 0x7f0a980cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 -- 172.21.15.49:0/501902933 >> v1:172.21.15.115:6789/0 conn(0x7f0a98155460 legacy=0x7f0a980b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.510+0000 7f0a8ffff640 1 -- 172.21.15.49:0/501902933 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9806d830 con 0x7f0a980b0a00 2023-12-19T05:43:55.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.512+0000 7f0a8ffff640 1 --2- 172.21.15.49:0/501902933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a800097a0 tx=0x7f0a8002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11683113d93bbf4a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.512+0000 7f0a977fe640 1 -- 172.21.15.49:0/501902933 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8002d040 con 0x7f0a980b0a00 2023-12-19T05:43:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a977fe640 1 -- 172.21.15.49:0/501902933 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80031810 con 0x7f0a980b0a00 2023-12-19T05:43:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a977fe640 1 -- 172.21.15.49:0/501902933 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80031ba0 con 0x7f0a980b0a00 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 -- 172.21.15.49:0/501902933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 msgr2=0x7f0a9806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/501902933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a800097a0 tx=0x7f0a8002b8b0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 -- 172.21.15.49:0/501902933 shutdown_connections 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/501902933 >> v2:172.21.15.115:3300/0 conn(0x7f0a9806ca80 0x7f0a980cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/501902933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a980b0a00 0x7f0a9806c540 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 -- 172.21.15.49:0/501902933 >> 172.21.15.49:0/501902933 conn(0x7f0a980659a0 msgr2=0x7f0a98065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 -- 172.21.15.49:0/501902933 shutdown_connections 2023-12-19T05:43:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.513+0000 7f0a9d66c640 1 -- 172.21.15.49:0/501902933 wait complete. 2023-12-19T05:43:55.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.515+0000 7f0a9d66c640 1 Processor -- start 2023-12-19T05:43:55.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.515+0000 7f0a9d66c640 1 -- start start 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.516+0000 7f0a9d66c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 0x7f0a9815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.516+0000 7f0a9d66c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9d66c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 0x7f0a98070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9d66c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9814f110 con 0x7f0a980b0a00 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9d66c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98150560 con 0x7f0a98155460 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9d66c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981f2bd0 con 0x7f0a9806ca80 2023-12-19T05:43:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56152/0 (socket says 172.21.15.49:56152) 2023-12-19T05:43:55.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 -- 172.21.15.49:0/3435220670 learned_addr learned my addr 172.21.15.49:0/3435220670 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a97fff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 0x7f0a9815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9ce6b640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 0x7f0a98070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 -- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 msgr2=0x7f0a9815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 0x7f0a9815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 -- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 msgr2=0x7f0a98070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 0x7f0a98070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a8ffff640 1 -- 172.21.15.49:0/3435220670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009400 con 0x7f0a980b0a00 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a97fff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 0x7f0a9815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.517+0000 7f0a9ce6b640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 0x7f0a98070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a8ffff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098c0 tx=0x7f0a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80006e10 con 0x7f0a980b0a00 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8003ad60 con 0x7f0a980b0a00 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a981f2eb0 con 0x7f0a980b0a00 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80044620 con 0x7f0a980b0a00 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.518+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a981f3470 con 0x7f0a980b0a00 2023-12-19T05:43:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.519+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a98061910 con 0x7f0a980b0a00 2023-12-19T05:43:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.520+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a8004d440 con 0x7f0a980b0a00 2023-12-19T05:43:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.521+0000 7f0a957fa640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 0x7f0a7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.522+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a800aab70 con 0x7f0a980b0a00 2023-12-19T05:43:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.522+0000 7f0a97fff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 0x7f0a7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.523+0000 7f0a97fff640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 0x7f0a7806c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a88007fd0 tx=0x7f0a88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:55.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.526+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a800761d0 con 0x7f0a980b0a00 2023-12-19T05:43:55.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:55.761+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0a980afaf0 con 0x7f0a980b0a00 2023-12-19T05:43:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.714+0000 7f0a957fa640 1 -- 172.21.15.49:0/3435220670 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a800350c0 con 0x7f0a980b0a00 2023-12-19T05:43:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.717+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 msgr2=0x7f0a7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.717+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 0x7f0a7806c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a88007fd0 tx=0x7f0a88009040 comp rx=0 tx=0).stop 2023-12-19T05:43:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.717+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 msgr2=0x7f0a9814ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.717+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098c0 tx=0x7f0a800046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 shutdown_connections 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7806a430 0x7f0a7806c8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a98155460 0x7f0a98070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a980b0a00 0x7f0a9814ebd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 --2- 172.21.15.49:0/3435220670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9806ca80 0x7f0a9815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 >> 172.21.15.49:0/3435220670 conn(0x7f0a980659a0 msgr2=0x7f0a9806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 shutdown_connections 2023-12-19T05:43:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.718+0000 7f0a9d66c640 1 -- 172.21.15.49:0/3435220670 wait complete. 2023-12-19T05:43:56.740 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:43:56.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:56.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:56.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.951+0000 7fc296b00640 1 Processor -- start 2023-12-19T05:43:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.951+0000 7fc296b00640 1 -- start start 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.952+0000 7fc296b00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 0x7fc2900af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc296b00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2900b0b50 0x7fc29006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc296b00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 0x7fc29006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc296b00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2900afb10 con 0x7fc2900b0b50 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc296b00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29006bb30 con 0x7fc2901449e0 2023-12-19T05:43:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc296b00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900b0070 con 0x7fc29006b590 2023-12-19T05:43:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc28ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2900b0b50 0x7fc29006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc28ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2900b0b50 0x7fc29006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56166/0 (socket says 172.21.15.49:56166) 2023-12-19T05:43:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc28ffff640 1 -- 172.21.15.49:0/3449528767 learned_addr learned my addr 172.21.15.49:0/3449528767 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc29489c640 1 --2- 172.21.15.49:0/3449528767 >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 0x7fc2900af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc29509d640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 0x7fc29006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc28ffff640 1 -- 172.21.15.49:0/3449528767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 msgr2=0x7fc29006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.953+0000 7fc28ffff640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 0x7fc29006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.954+0000 7fc28ffff640 1 -- 172.21.15.49:0/3449528767 >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 msgr2=0x7fc2900af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.954+0000 7fc28ffff640 1 --2- 172.21.15.49:0/3449528767 >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 0x7fc2900af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.954+0000 7fc28ffff640 1 -- 172.21.15.49:0/3449528767 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900b0350 con 0x7fc2900b0b50 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.954+0000 7fc29489c640 1 --2- 172.21.15.49:0/3449528767 >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 0x7fc2900af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.954+0000 7fc29509d640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 0x7fc29006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.955+0000 7fc28ffff640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29006bfa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc290071cd0 tx=0x7fc27c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cb163dcd1681fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.955+0000 7fc28f7fe640 1 -- 172.21.15.49:0/3449528767 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c031880 con 0x7fc2900b0b50 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.955+0000 7fc28f7fe640 1 -- 172.21.15.49:0/3449528767 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c0319e0 con 0x7fc2900b0b50 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.955+0000 7fc28f7fe640 1 -- 172.21.15.49:0/3449528767 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c031d70 con 0x7fc2900b0b50 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 -- 172.21.15.49:0/3449528767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 msgr2=0x7fc29006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29006bfa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc290071cd0 tx=0x7fc27c02b920 comp rx=0 tx=0).stop 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 -- 172.21.15.49:0/3449528767 shutdown_connections 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc29006b590 0x7fc29006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 --2- 172.21.15.49:0/3449528767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29006bfa0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 --2- 172.21.15.49:0/3449528767 >> v2:172.21.15.115:3300/0 conn(0x7fc2901449e0 0x7fc2900af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 -- 172.21.15.49:0/3449528767 >> 172.21.15.49:0/3449528767 conn(0x7fc2900cbb70 msgr2=0x7fc2900cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 -- 172.21.15.49:0/3449528767 shutdown_connections 2023-12-19T05:43:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.956+0000 7fc296b00640 1 -- 172.21.15.49:0/3449528767 wait complete. 2023-12-19T05:43:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.958+0000 7fc296b00640 1 Processor -- start 2023-12-19T05:43:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.958+0000 7fc296b00640 1 -- start start 2023-12-19T05:43:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc29006b590 0x7fc29015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2901449e0 0x7fc290143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29015cfc0 con 0x7fc2900b0b50 2023-12-19T05:43:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29015c280 con 0x7fc29006b590 2023-12-19T05:43:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc296b00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29015c560 con 0x7fc2901449e0 2023-12-19T05:43:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56172/0 (socket says 172.21.15.49:56172) 2023-12-19T05:43:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 -- 172.21.15.49:0/259487857 learned_addr learned my addr 172.21.15.49:0/259487857 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc29509d640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2901449e0 0x7fc290143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 -- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2901449e0 msgr2=0x7fc290143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2901449e0 0x7fc290143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 -- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc29006b590 msgr2=0x7fc29015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc29489c640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc29006b590 0x7fc29015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.959+0000 7fc28ffff640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc29006b590 0x7fc29015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc28ffff640 1 -- 172.21.15.49:0/259487857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0094d0 con 0x7fc2900b0b50 2023-12-19T05:43:56.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc28ffff640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc27c02b960 tx=0x7fc27c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c031870 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c0443f0 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0447a0 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29015c840 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.960+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29015bec0 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.961+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29015ca00 con 0x7fc2900b0b50 2023-12-19T05:43:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.962+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc27c04d450 con 0x7fc2900b0b50 2023-12-19T05:43:56.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.963+0000 7fc28d7fa640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 0x7fc27406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:56.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.963+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc27c0ab1f0 con 0x7fc2900b0b50 2023-12-19T05:43:56.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.964+0000 7fc29489c640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 0x7fc27406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.965+0000 7fc29489c640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 0x7fc27406c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc2901385a0 tx=0x7fc284008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:56.968+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc29015ca00 con 0x7fc2900b0b50 2023-12-19T05:43:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.199+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc29015ca00 con 0x7fc2900b0b50 2023-12-19T05:43:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.199+0000 7fc28d7fa640 1 -- 172.21.15.49:0/259487857 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fc29015ca00 con 0x7fc2900b0b50 2023-12-19T05:43:57.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:57.201 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:43:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 msgr2=0x7fc27406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 0x7fc27406c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc2901385a0 tx=0x7fc284008040 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 msgr2=0x7fc29015ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc27c02b960 tx=0x7fc27c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 shutdown_connections 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc27406a430 0x7fc27406c8f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2901449e0 0x7fc290143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2900b0b50 0x7fc29015ac00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 --2- 172.21.15.49:0/259487857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc29006b590 0x7fc29015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 >> 172.21.15.49:0/259487857 conn(0x7fc2900cbb70 msgr2=0x7fc29013d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 shutdown_connections 2023-12-19T05:43:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.202+0000 7fc296b00640 1 -- 172.21.15.49:0/259487857 wait complete. 2023-12-19T05:43:57.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:43:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.427+0000 7fa1db079640 1 Processor -- start 2023-12-19T05:43:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.427+0000 7fa1db079640 1 -- start start 2023-12-19T05:43:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1db079640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d4146e30 0x7fa1d40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1db079640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40d0c60 0x7fa1d415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1db079640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40d12d0 con 0x7fa1d40b7ea0 2023-12-19T05:43:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1db079640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d4147210 con 0x7fa1d4146e30 2023-12-19T05:43:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1db079640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40b8330 con 0x7fa1d40d0c60 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1da077640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d4146e30 0x7fa1d40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1d9876640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1d40b7ea0 0x7fa1d40d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55620/0 (socket says 172.21.15.49:55620) 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1da077640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1d4146e30 0x7fa1d40b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56188/0 (socket says 172.21.15.49:56188) 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.429+0000 7fa1d9876640 1 -- 172.21.15.49:0/3630383343 learned_addr learned my addr 172.21.15.49:0/3630383343 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1da878640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40d0c60 0x7fa1d415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1da077640 1 -- 172.21.15.49:0/3630383343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40d0c60 msgr2=0x7fa1d415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1da077640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40d0c60 0x7fa1d415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1da077640 1 -- 172.21.15.49:0/3630383343 >> v1:172.21.15.49:6789/0 conn(0x7fa1d40b7ea0 legacy=0x7fa1d40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1da077640 1 -- 172.21.15.49:0/3630383343 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40d15b0 con 0x7fa1d4146e30 2023-12-19T05:43:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.430+0000 7fa1d9075640 1 -- 172.21.15.49:0/3630383343 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606096684 0 0) 0x7fa1d40d12d0 con 0x7fa1d40b7ea0 2023-12-19T05:43:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.431+0000 7fa1da077640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d4146e30 0x7fa1d40b7960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00097a0 tx=0x7fa1d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb44e46642e7e17 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.431+0000 7fa1d9075640 1 -- 172.21.15.49:0/3630383343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d002e070 con 0x7fa1d4146e30 2023-12-19T05:43:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.431+0000 7fa1d9075640 1 -- 172.21.15.49:0/3630383343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00315a0 con 0x7fa1d4146e30 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.431+0000 7fa1d9075640 1 -- 172.21.15.49:0/3630383343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0031930 con 0x7fa1d4146e30 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 -- 172.21.15.49:0/3630383343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d4146e30 msgr2=0x7fa1d40b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d4146e30 0x7fa1d40b7960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00097a0 tx=0x7fa1d002b840 comp rx=0 tx=0).stop 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 -- 172.21.15.49:0/3630383343 shutdown_connections 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40d0c60 0x7fa1d415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 --2- 172.21.15.49:0/3630383343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d4146e30 0x7fa1d40b7960 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 -- 172.21.15.49:0/3630383343 >> 172.21.15.49:0/3630383343 conn(0x7fa1d40b2990 msgr2=0x7fa1d40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 -- 172.21.15.49:0/3630383343 shutdown_connections 2023-12-19T05:43:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.432+0000 7fa1db079640 1 -- 172.21.15.49:0/3630383343 wait complete. 2023-12-19T05:43:57.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.434+0000 7fa1db079640 1 Processor -- start 2023-12-19T05:43:57.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.434+0000 7fa1db079640 1 -- start start 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40b7ea0 0x7fa1d413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d4146e30 0x7fa1d41449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41f2540 con 0x7fa1d40d0c60 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41e04c0 con 0x7fa1d4146e30 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1db079640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d413e150 con 0x7fa1d40b7ea0 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1d9876640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1d9876640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56202/0 (socket says 172.21.15.49:56202) 2023-12-19T05:43:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.435+0000 7fa1d9876640 1 -- 172.21.15.49:0/3294571166 learned_addr learned my addr 172.21.15.49:0/3294571166 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1da077640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40b7ea0 0x7fa1d413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1da878640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d4146e30 0x7fa1d41449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 -- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40b7ea0 msgr2=0x7fa1d413dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40b7ea0 0x7fa1d413dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 -- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d4146e30 msgr2=0x7fa1d41449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d4146e30 0x7fa1d41449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 -- 172.21.15.49:0/3294571166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0009400 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.436+0000 7fa1d9876640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c430 tx=0x7fa1c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.437+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80074e0 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.437+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8007660 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.437+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004a20 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.437+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d41dee40 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.437+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d41dfe00 con 0x7fa1d40d0c60 2023-12-19T05:43:57.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.438+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d41e0600 con 0x7fa1d40d0c60 2023-12-19T05:43:57.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.439+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1c8004b80 con 0x7fa1d40d0c60 2023-12-19T05:43:57.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.440+0000 7fa1c6ffd640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 0x7fa1b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.440+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1c80886a0 con 0x7fa1d40d0c60 2023-12-19T05:43:57.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.441+0000 7fa1da077640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 0x7fa1b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.442+0000 7fa1da077640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 0x7fa1b806c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0036000 tx=0x7fa1d003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.446+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1d41e0600 con 0x7fa1d40d0c60 2023-12-19T05:43:57.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.634+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1d41e0600 con 0x7fa1d40d0c60 2023-12-19T05:43:57.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.636+0000 7fa1c6ffd640 1 -- 172.21.15.49:0/3294571166 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fa1d41e0600 con 0x7fa1d40d0c60 2023-12-19T05:43:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:57.638 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:43:54.201976+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 msgr2=0x7fa1b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 0x7fa1b806c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0036000 tx=0x7fa1d003d040 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 msgr2=0x7fa1d41f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c430 tx=0x7fa1c800c8f0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 shutdown_connections 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1b806a430 0x7fa1b806c8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d4146e30 0x7fa1d41449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d40d0c60 0x7fa1d41f6460 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 --2- 172.21.15.49:0/3294571166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d40b7ea0 0x7fa1d413dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 >> 172.21.15.49:0/3294571166 conn(0x7fa1d40b2990 msgr2=0x7fa1d41e3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 shutdown_connections 2023-12-19T05:43:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.639+0000 7fa1db079640 1 -- 172.21.15.49:0/3294571166 wait complete. 2023-12-19T05:43:57.660 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:43:57.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:43:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.886+0000 7f074f59e640 1 Processor -- start 2023-12-19T05:43:57.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.886+0000 7f074f59e640 1 -- start start 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.888+0000 7f074f59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0750159f80 0x7f075006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.888+0000 7f074f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015b1e0 0x7f075015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.888+0000 7f074f59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075006b520 con 0x7f075015a8a0 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.888+0000 7f074f59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500b2b20 con 0x7f0750159f80 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.888+0000 7f074f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b2fb0 con 0x7f075015b1e0 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0750159f80 0x7f075006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0750159f80 0x7f075006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56208/0 (socket says 172.21.15.49:56208) 2023-12-19T05:43:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 -- 172.21.15.49:0/363589878 learned_addr learned my addr 172.21.15.49:0/363589878 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074ed9d640 1 --1- 172.21.15.49:0/363589878 >> v1:172.21.15.49:6789/0 conn(0x7f075015a8a0 0x7f075015dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55622/0 (socket says 172.21.15.49:55622) 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f0747fff640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015b1e0 0x7f075015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 -- 172.21.15.49:0/363589878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015b1e0 msgr2=0x7f075015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015b1e0 0x7f075015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 -- 172.21.15.49:0/363589878 >> v1:172.21.15.49:6789/0 conn(0x7f075015a8a0 legacy=0x7f075015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074e59c640 1 -- 172.21.15.49:0/363589878 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500b1f10 con 0x7f0750159f80 2023-12-19T05:43:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.889+0000 7f074dd9b640 1 -- 172.21.15.49:0/363589878 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486720811 0 0) 0x7f075006b520 con 0x7f075015a8a0 2023-12-19T05:43:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.890+0000 7f074e59c640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f075006f160 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0740009870 tx=0x7f074002ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34305a27d4583b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074dd9b640 1 -- 172.21.15.49:0/363589878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074002f830 con 0x7f0750159f80 2023-12-19T05:43:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074dd9b640 1 -- 172.21.15.49:0/363589878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074002f990 con 0x7f0750159f80 2023-12-19T05:43:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074dd9b640 1 -- 172.21.15.49:0/363589878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074002fd20 con 0x7f0750159f80 2023-12-19T05:43:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 -- 172.21.15.49:0/363589878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 msgr2=0x7f075006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f075006f160 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0740009870 tx=0x7f074002ba10 comp rx=0 tx=0).stop 2023-12-19T05:43:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 -- 172.21.15.49:0/363589878 shutdown_connections 2023-12-19T05:43:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015b1e0 0x7f075015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 --2- 172.21.15.49:0/363589878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f075006f160 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.891+0000 7f074f59e640 1 -- 172.21.15.49:0/363589878 >> 172.21.15.49:0/363589878 conn(0x7f07500b0100 msgr2=0x7f07500b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.892+0000 7f074f59e640 1 -- 172.21.15.49:0/363589878 shutdown_connections 2023-12-19T05:43:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.892+0000 7f074f59e640 1 -- 172.21.15.49:0/363589878 wait complete. 2023-12-19T05:43:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.893+0000 7f074f59e640 1 Processor -- start 2023-12-19T05:43:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.893+0000 7f074f59e640 1 -- start start 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 0x7f075014cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075015b1e0 0x7f0750145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075014ae10 con 0x7f0750159f80 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075014aac0 con 0x7f075015b1e0 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.894+0000 7f074f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500ad6a0 con 0x7f075015a8a0 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56220/0 (socket says 172.21.15.49:56220) 2023-12-19T05:43:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 -- 172.21.15.49:0/1691257560 learned_addr learned my addr 172.21.15.49:0/1691257560 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f0747fff640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 0x7f075014cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 -- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 msgr2=0x7f075014cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 0x7f075014cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 -- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075015b1e0 msgr2=0x7f0750145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075015b1e0 0x7f0750145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f074e59c640 1 -- 172.21.15.49:0/1691257560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07400094d0 con 0x7f0750159f80 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.895+0000 7f0747fff640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 0x7f075014cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f074e59c640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f07400090b0 tx=0x7f07400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074003b040 con 0x7f0750159f80 2023-12-19T05:43:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0740037c40 con 0x7f0750159f80 2023-12-19T05:43:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075014eab0 con 0x7f0750159f80 2023-12-19T05:43:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740004030 con 0x7f0750159f80 2023-12-19T05:43:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.896+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075014f070 con 0x7f0750159f80 2023-12-19T05:43:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.897+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0750061910 con 0x7f0750159f80 2023-12-19T05:43:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.898+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07400041b0 con 0x7f0750159f80 2023-12-19T05:43:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.899+0000 7f0746ffd640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 0x7f073006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.899+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07400ab860 con 0x7f0750159f80 2023-12-19T05:43:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.900+0000 7f0747fff640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 0x7f073006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.901+0000 7f0747fff640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 0x7f073006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0738006fd0 tx=0x7f0738008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:57.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:57.903+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0740076e40 con 0x7f0750159f80 2023-12-19T05:43:58.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.098+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07500b24d0 con 0x7f073006a430 2023-12-19T05:43:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.121+0000 7f0746ffd640 1 -- 172.21.15.49:0/1691257560 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273777 (secure 0 0 0) 0x7f0738009530 con 0x7f073006a430 2023-12-19T05:43:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 msgr2=0x7f073006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 0x7f073006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0738006fd0 tx=0x7f0738008040 comp rx=0 tx=0).stop 2023-12-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 msgr2=0x7f07500ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f07400090b0 tx=0x7f07400046c0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 shutdown_connections 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f073006a430 0x7f073006c8f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f075015a8a0 0x7f075014cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075015b1e0 0x7f0750145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 --2- 172.21.15.49:0/1691257560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0750159f80 0x7f07500ac9d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 >> 172.21.15.49:0/1691257560 conn(0x7f07500b0100 msgr2=0x7f075014fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.127+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 shutdown_connections 2023-12-19T05:43:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.128+0000 7f074f59e640 1 -- 172.21.15.49:0/1691257560 wait complete. 2023-12-19T05:43:58.152 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-12-19T05:43:56.602703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557729,"statfs":{"total":1600000000,"available":1595115136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.923456"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.681026+0000","last_change":"2023-12-19T05:43:51.681026+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.681026+0000","last_undegraded":"2023-12-19T05:43:51.681026+0000","last_fullsized":"2023-12-19T05:43:51.681026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:00.155968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.677719+0000","last_change":"2023-12-19T05:43:51.677719+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.677719+0000","last_undegraded":"2023-12-19T05:43:51.677719+0000","last_fullsized":"2023-12-19T05:43:51.677719+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:10:44.857205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.681079+0000","last_change":"2023-12-19T05:43:51.681079+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.681079+0000","last_undegraded":"2023-12-19T05:43:51.681079+0000","last_fullsized":"2023-12-19T05:43:51.681079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.102079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.682206+0000","last_change":"2023-12-19T05:43:51.682206+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.682206+0000","last_undegraded":"2023-12-19T05:43:51.682206+0000","last_fullsized":"2023-12-19T05:43:51.682206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:51:21.630873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683454+0000","last_change":"2023-12-19T05:43:51.683454+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683454+0000","last_undegraded":"2023-12-19T05:43:51.683454+0000","last_fullsized":"2023-12-19T05:43:51.683454+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:32.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.687089+0000","last_change":"2023-12-19T05:43:51.687089+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.687089+0000","last_undegraded":"2023-12-19T05:43:51.687089+0000","last_fullsized":"2023-12-19T05:43:51.687089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:44:12.162150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.686481+0000","last_change":"2023-12-19T05:43:51.686481+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.686481+0000","last_undegraded":"2023-12-19T05:43:51.686481+0000","last_fullsized":"2023-12-19T05:43:51.686481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:27:52.532334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.684355+0000","last_change":"2023-12-19T05:43:51.684355+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.684355+0000","last_undegraded":"2023-12-19T05:43:51.684355+0000","last_fullsized":"2023-12-19T05:43:51.684355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:29.203975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.680533+0000","last_change":"2023-12-19T05:43:51.680533+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.680533+0000","last_undegraded":"2023-12-19T05:43:51.680533+0000","last_fullsized":"2023-12-19T05:43:51.680533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:12.301200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.686013+0000","last_change":"2023-12-19T05:43:51.686013+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.686013+0000","last_undegraded":"2023-12-19T05:43:51.686013+0000","last_fullsized":"2023-12-19T05:43:51.686013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:06:19.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683322+0000","last_change":"2023-12-19T05:43:51.683322+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683322+0000","last_undegraded":"2023-12-19T05:43:51.683322+0000","last_fullsized":"2023-12-19T05:43:51.683322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:18.543374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.685391+0000","last_change":"2023-12-19T05:43:51.685391+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.685391+0000","last_undegraded":"2023-12-19T05:43:51.685391+0000","last_fullsized":"2023-12-19T05:43:51.685391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:50.136662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.685584+0000","last_change":"2023-12-19T05:43:51.685584+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.685584+0000","last_undegraded":"2023-12-19T05:43:51.685584+0000","last_fullsized":"2023-12-19T05:43:51.685584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:13.706880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.685510+0000","last_change":"2023-12-19T05:43:51.685510+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.685510+0000","last_undegraded":"2023-12-19T05:43:51.685510+0000","last_fullsized":"2023-12-19T05:43:51.685510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:43:41.000150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.685204+0000","last_change":"2023-12-19T05:43:51.685204+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.685204+0000","last_undegraded":"2023-12-19T05:43:51.685204+0000","last_fullsized":"2023-12-19T05:43:51.685204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:23:05.103752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.686365+0000","last_change":"2023-12-19T05:43:51.686365+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.686365+0000","last_undegraded":"2023-12-19T05:43:51.686365+0000","last_fullsized":"2023-12-19T05:43:51.686365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:49.761803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.681409+0000","last_change":"2023-12-19T05:43:51.681409+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.681409+0000","last_undegraded":"2023-12-19T05:43:51.681409+0000","last_fullsized":"2023-12-19T05:43:51.681409+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:37:50.038202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.684572+0000","last_change":"2023-12-19T05:43:51.684572+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.684572+0000","last_undegraded":"2023-12-19T05:43:51.684572+0000","last_fullsized":"2023-12-19T05:43:51.684572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:00.155968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683929+0000","last_change":"2023-12-19T05:43:51.683929+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683929+0000","last_undegraded":"2023-12-19T05:43:51.683929+0000","last_fullsized":"2023-12-19T05:43:51.683929+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:55:20.631818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.680818+0000","last_change":"2023-12-19T05:43:51.680818+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.680818+0000","last_undegraded":"2023-12-19T05:43:51.680818+0000","last_fullsized":"2023-12-19T05:43:51.680818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:28.955784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683464+0000","last_change":"2023-12-19T05:43:51.683464+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683464+0000","last_undegraded":"2023-12-19T05:43:51.683464+0000","last_fullsized":"2023-12-19T05:43:51.683464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:04.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.682189+0000","last_change":"2023-12-19T05:43:51.682189+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.682189+0000","last_undegraded":"2023-12-19T05:43:51.682189+0000","last_fullsized":"2023-12-19T05:43:51.682189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:38.780769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.677720+0000","last_change":"2023-12-19T05:43:51.677720+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.677720+0000","last_undegraded":"2023-12-19T05:43:51.677720+0000","last_fullsized":"2023-12-19T05:43:51.677720+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:44.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.681035+0000","last_change":"2023-12-19T05:43:51.681035+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.681035+0000","last_undegraded":"2023-12-19T05:43:51.681035+0000","last_fullsized":"2023-12-19T05:43:51.681035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:26:03.112690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.681233+0000","last_change":"2023-12-19T05:43:51.681233+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.681233+0000","last_undegraded":"2023-12-19T05:43:51.681233+0000","last_fullsized":"2023-12-19T05:43:51.681233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:44.276655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683044+0000","last_change":"2023-12-19T05:43:51.683044+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683044+0000","last_undegraded":"2023-12-19T05:43:51.683044+0000","last_fullsized":"2023-12-19T05:43:51.683044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:57:35.789269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683467+0000","last_change":"2023-12-19T05:43:51.683467+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683467+0000","last_undegraded":"2023-12-19T05:43:51.683467+0000","last_fullsized":"2023-12-19T05:43:51.683467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:45.899245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683299+0000","last_change":"2023-12-19T05:43:51.683299+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683299+0000","last_undegraded":"2023-12-19T05:43:51.683299+0000","last_fullsized":"2023-12-19T05:43:51.683299+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:10.461650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.677975+0000","last_change":"2023-12-19T05:43:51.677975+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.677975+0000","last_undegraded":"2023-12-19T05:43:51.677975+0000","last_fullsized":"2023-12-19T05:43:51.677975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:06:39.044733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.683076+0000","last_change":"2023-12-19T05:43:51.683076+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.683076+0000","last_undegraded":"2023-12-19T05:43:51.683076+0000","last_fullsized":"2023-12-19T05:43:51.683076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:59:44.996404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.682569+0000","last_change":"2023-12-19T05:43:51.682569+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.682569+0000","last_undegraded":"2023-12-19T05:43:51.682569+0000","last_fullsized":"2023-12-19T05:43:51.682569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:06:19.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:43:52.675316+0000","last_change":"2023-12-19T05:43:52.675316+0000","last_active":"2023-12-19T05:43:52.675316+0000","last_peered":"2023-12-19T05:43:52.675316+0000","last_clean":"2023-12-19T05:43:52.675316+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:52.675316+0000","last_undegraded":"2023-12-19T05:43:52.675316+0000","last_fullsized":"2023-12-19T05:43:52.675316+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2023-12-19T05:43:51.685313+0000","last_change":"2023-12-19T05:43:51.685313+0000","last_active":"2023-12-19T05:43:51.660771+0000","last_peered":"2023-12-19T05:43:51.660771+0000","last_clean":"2023-12-19T05:43:51.660771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:43:51.685313+0000","last_undegraded":"2023-12-19T05:43:51.685313+0000","last_fullsized":"2023-12-19T05:43:51.685313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:16.988390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-19T05:43:48.902458+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:43:48.902458+0000","last_peered":"2023-12-19T05:43:48.902458+0000","last_clean":"2023-12-19T05:43:48.902458+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:43:48.902458+0000","last_undegraded":"2023-12-19T05:43:48.902458+0000","last_fullsized":"2023-12-19T05:43:48.902458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.075,"15min":1.032},"min":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.135},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.081,"15min":1.0549999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":1.508}]},{"osd":1,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1259999999999999,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.167,"15min":1.163},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":1.3049999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2070000000000001,"15min":1.232},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.871},{"interface":"front","average":{"1min":1.216,"5min":1.0980000000000001,"15min":1.0720000000000001},"min":{"1min":0.84599999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.24}]},{"osd":3,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.194,"15min":1.139},"min":{"1min":0.78200000000000003,"5min":0.622,"15min":0.622},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.359},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.3420000000000001,"15min":1.3120000000000001},"min":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.593}]},{"osd":4,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.0940000000000001,"15min":1.03},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.9980000000000002,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2769999999999999,"15min":1.2430000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.4410000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.343,"15min":1.3160000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":6.3099999999999996,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.409},{"interface":"front","average":{"1min":1.403,"5min":1.2689999999999999,"15min":1.23},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.379}]},{"osd":6,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.389,"15min":1.319},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.452,"15min":1.3819999999999999},"min":{"1min":0.68799999999999994,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":7.7519999999999998,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.647}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1319999999999999,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4890000000000001,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.504},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.0429999999999999,"15min":1.0329999999999999},"min":{"1min":0.76500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.444,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2010000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.1719999999999999,"15min":1.1399999999999999},"min":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.2649999999999999,"15min":1.325},"min":{"1min":0.83799999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.4590000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.581,"5min":2,"15min":2},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6699999999999999,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.2809999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2609999999999999,"15min":1.371},"min":{"1min":0.84399999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.647,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3280000000000001,"15min":1.379},"min":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6539999999999999,"5min":4.452,"15min":4.452},"last":1.2430000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2989999999999999,"15min":1.353},"min":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.625,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.341,"15min":1.4690000000000001},"min":{"1min":0.76800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.486,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.0940000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4790000000000001,"15min":1.5900000000000001},"min":{"1min":0.621,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.724,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":1.353},{"interface":"front","average":{"1min":1.385,"5min":1.597,"15min":1.7569999999999999},"min":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7589999999999999,"5min":3.681,"15min":3.681},"last":1.5549999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.4470000000000001,"15min":1.5329999999999999},"min":{"1min":0.72599999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7130000000000001,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.53},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.583,"15min":1.6240000000000001},"min":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.881,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.4219999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194283,"statfs":{"total":200000000,"available":198946616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.141,"15min":1.1240000000000001},"min":{"1min":0.80200000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.67600000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.776,"5min":2.641,"15min":2.641},"last":1.417}]},{"osd":1,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2270000000000001,"15min":1.2430000000000001},"min":{"1min":0.80600000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.534,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.073},{"interface":"front","average":{"1min":1.298,"5min":1.3640000000000001,"15min":1.3740000000000001},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6679999999999999,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":1.1479999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1819999999999999,"15min":1.238},"min":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6220000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1950000000000001,"15min":1.218},"min":{"1min":0.88800000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.466,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.2150000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4099999999999999,"15min":1.47},"min":{"1min":0.83099999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.611,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.3540000000000001,"15min":1.4379999999999999},"min":{"1min":1.0049999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5549999999999999,"5min":2.754,"15min":2.754},"last":1.5580000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.4059999999999999,"15min":1.512},"min":{"1min":0.79700000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6779999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.4950000000000001,"15min":1.6140000000000001},"min":{"1min":0.85999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.708,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.284}]},{"osd":6,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4099999999999999,"15min":1.512},"min":{"1min":0.83999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6539999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.5209999999999999,"15min":1.677},"min":{"1min":0.97799999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6399999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.3640000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6319999999999999,"15min":1.7330000000000001},"min":{"1min":1.0489999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.488},{"interface":"front","average":{"1min":1.484,"5min":1.546,"15min":1.6180000000000001},"min":{"1min":1.234,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.712,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.681}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.014,"15min":1.008},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.5009999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.415},{"interface":"front","average":{"1min":1.145,"5min":1.0649999999999999,"15min":1.0589999999999999},"min":{"1min":0.84899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.637,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.1599999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0740000000000001,"15min":1.0580000000000001},"min":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.05},{"interface":"front","average":{"1min":1.258,"5min":1.1100000000000001,"15min":1.0389999999999999},"min":{"1min":0.85199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1160000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.76900000000000002,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.526,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.675},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.21,"15min":1.2050000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.734,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1200000000000001,"15min":1.0600000000000001},"min":{"1min":0.82899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.734},{"interface":"front","average":{"1min":1.367,"5min":1.284,"15min":1.284},"min":{"1min":0.95399999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.819}]},{"osd":5,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.339,"15min":1.3400000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.639},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.325,"15min":1.2749999999999999},"min":{"1min":0.85599999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.5600000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.369,"15min":1.3680000000000001},"min":{"1min":0.93100000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.8280000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4039999999999999,"15min":1.397},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.71,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.7849999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.3759999999999999,"15min":1.339},"min":{"1min":0.97199999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7669999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4650000000000001,"15min":1.4550000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9279999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.982}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.5640000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.83199999999999996,"15min":0.79700000000000004},"min":{"1min":0.435,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.407,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.501}]},{"osd":1,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.495,"5min":0.442,"15min":0.442},"max":{"1min":1.474,"5min":2.702,"15min":2.702},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.94499999999999995,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.49,"5min":1.619,"15min":1.619},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.96499999999999997,"15min":0.90600000000000003},"min":{"1min":0.55700000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.139,"5min":1.0920000000000001,"15min":1.052},"min":{"1min":0.54500000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6319999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.2909999999999999,"15min":1.2889999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.867,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.91600000000000004}]},{"osd":5,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.321,"15min":1.3069999999999999},"min":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.718,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.113},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.321,"15min":1.333},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.766,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":1.075}]},{"osd":6,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77500000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8520000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3169999999999999},"min":{"1min":0.69799999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.738,"5min":2.02,"15min":2.02},"last":1.1399999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3799999999999999,"15min":1.3759999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8260000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.405,"15min":1.417},"min":{"1min":0.748,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.788,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.995}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.78800000000000003,"15min":0.76000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.94899999999999995,"15min":0.90300000000000002},"min":{"1min":0.63600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0469999999999999,"15min":1.036},"min":{"1min":0.65700000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.177,"15min":1.143},"min":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.91200000000000003},"min":{"1min":0.73199999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5980000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.115,"15min":1.069},"min":{"1min":0.77600000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.681,"5min":1.704,"15min":1.704},"last":1.198}]},{"osd":4,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.3009999999999999,"15min":1.2549999999999999},"min":{"1min":1.0509999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.762,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.351},{"interface":"front","average":{"1min":1.345,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":1.034,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7749999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.5569999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3089999999999999,"15min":1.27},"min":{"1min":1.119,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8160000000000001,"5min":1.893,"15min":1.893},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":0.98799999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.887,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3120000000000001,"15min":1.286},"min":{"1min":1.04,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8799999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.127,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.5089999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.4339999999999999,"15min":1.401},"min":{"1min":1.109,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.3149999999999999,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.411,"15min":1.409},"min":{"1min":1.1339999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.994,"5min":2.714,"15min":2.714},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194283,"statfs":{"total":200000000,"available":198946616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90100000000000002,"15min":0.93600000000000005},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1850000000000001,"5min":2.992,"15min":2.992},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.042},"min":{"1min":0.624,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.704,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.1859999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.97199999999999998},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2649999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.8200000000000001,"15min":1.3300000000000001},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5469999999999999,"5min":70.206000000000003,"15min":70.206000000000003},"last":1.349}]},{"osd":3,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.748,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.804,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.234,"15min":1.2330000000000001},"min":{"1min":0.55200000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.915,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.0189999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2589999999999999,"15min":1.198},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6319999999999999,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.28},{"interface":"front","average":{"1min":1.399,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9079999999999999,"5min":4.306,"15min":4.306},"last":1.2350000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3620000000000001,"15min":1.3400000000000001},"min":{"1min":0.82499999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.982,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.635},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.401,"15min":1.3540000000000001},"min":{"1min":1.0309999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.97,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.6970000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.454,"15min":1.4139999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.129,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.446,"15min":1.4159999999999999},"min":{"1min":0.997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.1320000000000001,"5min":3.75,"15min":3.75},"last":1.8080000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.575,"15min":1.524},"min":{"1min":1.0229999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.036,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.619,"15min":1.599},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0979999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.78}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199536984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.78100000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3500000000000001,"5min":1.427,"15min":1.427},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":1.837,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.466}]},{"osd":2,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.022,"15min":1.042},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6859999999999999,"5min":1.706,"15min":1.706},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.125,"15min":1.143},"min":{"1min":0.53100000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.651,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.111}]},{"osd":3,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4690000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.0649999999999999,"15min":1.05},"min":{"1min":0.55300000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6120000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1439999999999999,"15min":1.139},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.359},{"interface":"front","average":{"1min":1.3,"5min":1.25,"15min":1.2410000000000001},"min":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5860000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3160000000000001,"15min":1.304},"min":{"1min":0.78500000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.853,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.284,"15min":1.266},"min":{"1min":0.82199999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.712,"5min":1.879,"15min":1.879},"last":1.4850000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.355,"15min":1.3759999999999999},"min":{"1min":0.85699999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7569999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2889999999999999,"15min":1.262},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.8280000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.405}]},{"osd":7,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4099999999999999,"15min":1.4039999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.78700000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7589999999999999,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.5600000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:43:58.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:43:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.430+0000 7fc2f0947640 1 Processor -- start 2023-12-19T05:43:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.431+0000 7fc2f0947640 1 -- start start 2023-12-19T05:43:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.432+0000 7fc2f0947640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec0d2b00 0x7fc2ec0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2f0947640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2ec0ce110 0x7fc2ec0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2f0947640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0cd840 con 0x7fc2ec146e10 2023-12-19T05:43:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2f0947640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec0d2430 con 0x7fc2ec0ce110 2023-12-19T05:43:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2f0947640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0ceae0 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2ea59c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc2ec146e10 0x7fc2ec0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50036/0 (socket says 172.21.15.49:50036) 2023-12-19T05:43:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2ea59c640 1 -- 172.21.15.49:0/1837360101 learned_addr learned my addr 172.21.15.49:0/1837360101 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.433+0000 7fc2e9d9b640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec0d2b00 0x7fc2ec0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2ead9d640 1 --2- 172.21.15.49:0/1837360101 >> v2:172.21.15.115:3300/0 conn(0x7fc2ec0ce110 0x7fc2ec0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2e959a640 1 -- 172.21.15.49:0/1837360101 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693418813 0 0) 0x7fc2ec0cd840 con 0x7fc2ec146e10 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2e959a640 1 -- 172.21.15.49:0/1837360101 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d8003520 con 0x7fc2ec146e10 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2ead9d640 1 -- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec0d2b00 msgr2=0x7fc2ec0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2ead9d640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec0d2b00 0x7fc2ec0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2ead9d640 1 -- 172.21.15.49:0/1837360101 >> v1:172.21.15.115:6789/0 conn(0x7fc2ec146e10 legacy=0x7fc2ec0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.434+0000 7fc2ead9d640 1 -- 172.21.15.49:0/1837360101 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0b6e90 con 0x7fc2ec0ce110 2023-12-19T05:43:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.436+0000 7fc2ead9d640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec0ce5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097d0 tx=0x7fc2e402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee345f5027ed4399 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.436+0000 7fc2e959a640 1 -- 172.21.15.49:0/1837360101 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031800 con 0x7fc2ec0ce110 2023-12-19T05:43:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.436+0000 7fc2e959a640 1 -- 172.21.15.49:0/1837360101 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4031960 con 0x7fc2ec0ce110 2023-12-19T05:43:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2e959a640 1 -- 172.21.15.49:0/1837360101 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031cd0 con 0x7fc2ec0ce110 2023-12-19T05:43:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 -- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 msgr2=0x7fc2ec0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec0ce5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097d0 tx=0x7fc2e402b8a0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 -- 172.21.15.49:0/1837360101 shutdown_connections 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec0ce5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1837360101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec0d2b00 0x7fc2ec0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 -- 172.21.15.49:0/1837360101 >> 172.21.15.49:0/1837360101 conn(0x7fc2ec0b29c0 msgr2=0x7fc2ec0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 -- 172.21.15.49:0/1837360101 shutdown_connections 2023-12-19T05:43:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.437+0000 7fc2f0947640 1 -- 172.21.15.49:0/1837360101 wait complete. 2023-12-19T05:43:58.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.439+0000 7fc2f0947640 1 Processor -- start 2023-12-19T05:43:58.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.439+0000 7fc2f0947640 1 -- start start 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.440+0000 7fc2f0947640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec13ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.440+0000 7fc2f0947640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.440+0000 7fc2f0947640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec146e10 0x7fc2ec145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2f0947640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec13cf80 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2f0947640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec160580 con 0x7fc2ec0ce110 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2f0947640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec15fc50 con 0x7fc2ec146e10 2023-12-19T05:43:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56234/0 (socket says 172.21.15.49:56234) 2023-12-19T05:43:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 -- 172.21.15.49:0/1273872586 learned_addr learned my addr 172.21.15.49:0/1273872586 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2ead9d640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec146e10 0x7fc2ec145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2ea59c640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec13ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 -- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec146e10 msgr2=0x7fc2ec145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec146e10 0x7fc2ec145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 -- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 msgr2=0x7fc2ec13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec13ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.441+0000 7fc2e9d9b640 1 -- 172.21.15.49:0/1273872586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009400 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2e9d9b640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00efc0 tx=0x7fc2dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc014480 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00f040 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec15ff30 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc014800 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.442+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1f69e0 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.443+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec0d2130 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.444+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2dc014960 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.445+0000 7fc2e2ffd640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.446+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2dc089550 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.446+0000 7fc2ea59c640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.447+0000 7fc2ea59c640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007fd0 tx=0x7fc2d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.449+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2dc054b30 con 0x7fc2ec0d2b00 2023-12-19T05:43:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.644+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2ec0b41c0 con 0x7fc2cc06a430 2023-12-19T05:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.666+0000 7fc2e2ffd640 1 -- 172.21.15.49:0/1273872586 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282711 (secure 0 0 0) 0x7fc2d40013f0 con 0x7fc2cc06a430 2023-12-19T05:43:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:43:58.674 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-12-19T05:43:58.668+0000 7fcc869c8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 msgr2=0x7fc2cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007fd0 tx=0x7fc2d4009040 comp rx=0 tx=0).stop 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 msgr2=0x7fc2ec145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00efc0 tx=0x7fc2dc00c490 comp rx=0 tx=0).stop 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 shutdown_connections 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc2cc06a430 0x7fc2cc06c8f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2ec146e10 0x7fc2ec145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2ec0d2b00 0x7fc2ec145960 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 --2- 172.21.15.49:0/1273872586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2ec0ce110 0x7fc2ec13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 >> 172.21.15.49:0/1273872586 conn(0x7fc2ec0b29c0 msgr2=0x7fc2ec0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 shutdown_connections 2023-12-19T05:43:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.673+0000 7fc2f0947640 1 -- 172.21.15.49:0/1273872586 wait complete. 2023-12-19T05:43:58.696 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2023-12-19T05:43:58.603294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4926,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557573,"statfs":{"total":1600000000,"available":1594955676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002032"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.206964+0000","last_change":"2023-12-19T05:43:53.212717+0000","last_active":"2023-12-19T05:43:54.206964+0000","last_peered":"2023-12-19T05:43:54.206964+0000","last_clean":"2023-12-19T05:43:54.206964+0000","last_became_active":"2023-12-19T05:43:53.212384+0000","last_became_peered":"2023-12-19T05:43:53.212384+0000","last_unstale":"2023-12-19T05:43:54.206964+0000","last_undegraded":"2023-12-19T05:43:54.206964+0000","last_fullsized":"2023-12-19T05:43:54.206964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:20.239248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557527+0000","last_change":"2023-12-19T05:43:53.228473+0000","last_active":"2023-12-19T05:43:54.557527+0000","last_peered":"2023-12-19T05:43:54.557527+0000","last_clean":"2023-12-19T05:43:54.557527+0000","last_became_active":"2023-12-19T05:43:53.228235+0000","last_became_peered":"2023-12-19T05:43:53.228235+0000","last_unstale":"2023-12-19T05:43:54.557527+0000","last_undegraded":"2023-12-19T05:43:54.557527+0000","last_fullsized":"2023-12-19T05:43:54.557527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:11.476196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.376381+0000","last_change":"2023-12-19T05:43:53.235805+0000","last_active":"2023-12-19T05:43:54.376381+0000","last_peered":"2023-12-19T05:43:54.376381+0000","last_clean":"2023-12-19T05:43:54.376381+0000","last_became_active":"2023-12-19T05:43:53.235312+0000","last_became_peered":"2023-12-19T05:43:53.235312+0000","last_unstale":"2023-12-19T05:43:54.376381+0000","last_undegraded":"2023-12-19T05:43:54.376381+0000","last_fullsized":"2023-12-19T05:43:54.376381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:38.429086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.374826+0000","last_change":"2023-12-19T05:43:53.234427+0000","last_active":"2023-12-19T05:43:54.374826+0000","last_peered":"2023-12-19T05:43:54.374826+0000","last_clean":"2023-12-19T05:43:54.374826+0000","last_became_active":"2023-12-19T05:43:53.234199+0000","last_became_peered":"2023-12-19T05:43:53.234199+0000","last_unstale":"2023-12-19T05:43:54.374826+0000","last_undegraded":"2023-12-19T05:43:54.374826+0000","last_fullsized":"2023-12-19T05:43:54.374826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:57:01.743252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.209980+0000","last_change":"2023-12-19T05:43:53.225172+0000","last_active":"2023-12-19T05:43:54.209980+0000","last_peered":"2023-12-19T05:43:54.209980+0000","last_clean":"2023-12-19T05:43:54.209980+0000","last_became_active":"2023-12-19T05:43:53.224655+0000","last_became_peered":"2023-12-19T05:43:53.224655+0000","last_unstale":"2023-12-19T05:43:54.209980+0000","last_undegraded":"2023-12-19T05:43:54.209980+0000","last_fullsized":"2023-12-19T05:43:54.209980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:47:05.773565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.373432+0000","last_change":"2023-12-19T05:43:53.237424+0000","last_active":"2023-12-19T05:43:54.373432+0000","last_peered":"2023-12-19T05:43:54.373432+0000","last_clean":"2023-12-19T05:43:54.373432+0000","last_became_active":"2023-12-19T05:43:53.237121+0000","last_became_peered":"2023-12-19T05:43:53.237121+0000","last_unstale":"2023-12-19T05:43:54.373432+0000","last_undegraded":"2023-12-19T05:43:54.373432+0000","last_fullsized":"2023-12-19T05:43:54.373432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:30.218520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558120+0000","last_change":"2023-12-19T05:43:53.231603+0000","last_active":"2023-12-19T05:43:54.558120+0000","last_peered":"2023-12-19T05:43:54.558120+0000","last_clean":"2023-12-19T05:43:54.558120+0000","last_became_active":"2023-12-19T05:43:53.224372+0000","last_became_peered":"2023-12-19T05:43:53.224372+0000","last_unstale":"2023-12-19T05:43:54.558120+0000","last_undegraded":"2023-12-19T05:43:54.558120+0000","last_fullsized":"2023-12-19T05:43:54.558120+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:27:53.546880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207374+0000","last_change":"2023-12-19T05:43:53.233538+0000","last_active":"2023-12-19T05:43:54.207374+0000","last_peered":"2023-12-19T05:43:54.207374+0000","last_clean":"2023-12-19T05:43:54.207374+0000","last_became_active":"2023-12-19T05:43:53.224376+0000","last_became_peered":"2023-12-19T05:43:53.224376+0000","last_unstale":"2023-12-19T05:43:54.207374+0000","last_undegraded":"2023-12-19T05:43:54.207374+0000","last_fullsized":"2023-12-19T05:43:54.207374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:16:18.490165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.375074+0000","last_change":"2023-12-19T05:43:53.228680+0000","last_active":"2023-12-19T05:43:54.375074+0000","last_peered":"2023-12-19T05:43:54.375074+0000","last_clean":"2023-12-19T05:43:54.375074+0000","last_became_active":"2023-12-19T05:43:53.228426+0000","last_became_peered":"2023-12-19T05:43:53.228426+0000","last_unstale":"2023-12-19T05:43:54.375074+0000","last_undegraded":"2023-12-19T05:43:54.375074+0000","last_fullsized":"2023-12-19T05:43:54.375074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:39.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558454+0000","last_change":"2023-12-19T05:43:53.234482+0000","last_active":"2023-12-19T05:43:54.558454+0000","last_peered":"2023-12-19T05:43:54.558454+0000","last_clean":"2023-12-19T05:43:54.558454+0000","last_became_active":"2023-12-19T05:43:53.233773+0000","last_became_peered":"2023-12-19T05:43:53.233773+0000","last_unstale":"2023-12-19T05:43:54.558454+0000","last_undegraded":"2023-12-19T05:43:54.558454+0000","last_fullsized":"2023-12-19T05:43:54.558454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:39.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207179+0000","last_change":"2023-12-19T05:43:53.220714+0000","last_active":"2023-12-19T05:43:54.207179+0000","last_peered":"2023-12-19T05:43:54.207179+0000","last_clean":"2023-12-19T05:43:54.207179+0000","last_became_active":"2023-12-19T05:43:53.217682+0000","last_became_peered":"2023-12-19T05:43:53.217682+0000","last_unstale":"2023-12-19T05:43:54.207179+0000","last_undegraded":"2023-12-19T05:43:54.207179+0000","last_fullsized":"2023-12-19T05:43:54.207179+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:34.103101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210075+0000","last_change":"2023-12-19T05:43:53.219531+0000","last_active":"2023-12-19T05:43:54.210075+0000","last_peered":"2023-12-19T05:43:54.210075+0000","last_clean":"2023-12-19T05:43:54.210075+0000","last_became_active":"2023-12-19T05:43:53.218856+0000","last_became_peered":"2023-12-19T05:43:53.218856+0000","last_unstale":"2023-12-19T05:43:54.210075+0000","last_undegraded":"2023-12-19T05:43:54.210075+0000","last_fullsized":"2023-12-19T05:43:54.210075+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:11:24.857310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.376497+0000","last_change":"2023-12-19T05:43:53.235940+0000","last_active":"2023-12-19T05:43:54.376497+0000","last_peered":"2023-12-19T05:43:54.376497+0000","last_clean":"2023-12-19T05:43:54.376497+0000","last_became_active":"2023-12-19T05:43:53.235618+0000","last_became_peered":"2023-12-19T05:43:53.235618+0000","last_unstale":"2023-12-19T05:43:54.376497+0000","last_undegraded":"2023-12-19T05:43:54.376497+0000","last_fullsized":"2023-12-19T05:43:54.376497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:44:13.176695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210013+0000","last_change":"2023-12-19T05:43:53.225175+0000","last_active":"2023-12-19T05:43:54.210013+0000","last_peered":"2023-12-19T05:43:54.210013+0000","last_clean":"2023-12-19T05:43:54.210013+0000","last_became_active":"2023-12-19T05:43:53.224949+0000","last_became_peered":"2023-12-19T05:43:53.224949+0000","last_unstale":"2023-12-19T05:43:54.210013+0000","last_undegraded":"2023-12-19T05:43:54.210013+0000","last_fullsized":"2023-12-19T05:43:54.210013+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:53:28.171872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.211951+0000","last_change":"2023-12-19T05:43:53.217693+0000","last_active":"2023-12-19T05:43:54.211951+0000","last_peered":"2023-12-19T05:43:54.211951+0000","last_clean":"2023-12-19T05:43:54.211951+0000","last_became_active":"2023-12-19T05:43:53.217443+0000","last_became_peered":"2023-12-19T05:43:53.217443+0000","last_unstale":"2023-12-19T05:43:54.211951+0000","last_undegraded":"2023-12-19T05:43:54.211951+0000","last_fullsized":"2023-12-19T05:43:54.211951+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:48:47.967303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207456+0000","last_change":"2023-12-19T05:43:53.225470+0000","last_active":"2023-12-19T05:43:54.207456+0000","last_peered":"2023-12-19T05:43:54.207456+0000","last_clean":"2023-12-19T05:43:54.207456+0000","last_became_active":"2023-12-19T05:43:53.224458+0000","last_became_peered":"2023-12-19T05:43:53.224458+0000","last_unstale":"2023-12-19T05:43:54.207456+0000","last_undegraded":"2023-12-19T05:43:54.207456+0000","last_fullsized":"2023-12-19T05:43:54.207456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:33.187621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.208817+0000","last_change":"2023-12-19T05:43:53.219711+0000","last_active":"2023-12-19T05:43:54.208817+0000","last_peered":"2023-12-19T05:43:54.208817+0000","last_clean":"2023-12-19T05:43:54.208817+0000","last_became_active":"2023-12-19T05:43:53.219192+0000","last_became_peered":"2023-12-19T05:43:53.219192+0000","last_unstale":"2023-12-19T05:43:54.208817+0000","last_undegraded":"2023-12-19T05:43:54.208817+0000","last_fullsized":"2023-12-19T05:43:54.208817+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:07.297694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.209665+0000","last_change":"2023-12-19T05:43:53.227913+0000","last_active":"2023-12-19T05:43:54.209665+0000","last_peered":"2023-12-19T05:43:54.209665+0000","last_clean":"2023-12-19T05:43:54.209665+0000","last_became_active":"2023-12-19T05:43:53.227694+0000","last_became_peered":"2023-12-19T05:43:53.227694+0000","last_unstale":"2023-12-19T05:43:54.209665+0000","last_undegraded":"2023-12-19T05:43:54.209665+0000","last_fullsized":"2023-12-19T05:43:54.209665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:03:26.584052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207068+0000","last_change":"2023-12-19T05:43:53.217873+0000","last_active":"2023-12-19T05:43:54.207068+0000","last_peered":"2023-12-19T05:43:54.207068+0000","last_clean":"2023-12-19T05:43:54.207068+0000","last_became_active":"2023-12-19T05:43:53.217486+0000","last_became_peered":"2023-12-19T05:43:53.217486+0000","last_unstale":"2023-12-19T05:43:54.207068+0000","last_undegraded":"2023-12-19T05:43:54.207068+0000","last_fullsized":"2023-12-19T05:43:54.207068+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:11:11.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210226+0000","last_change":"2023-12-19T05:43:53.223361+0000","last_active":"2023-12-19T05:43:54.210226+0000","last_peered":"2023-12-19T05:43:54.210226+0000","last_clean":"2023-12-19T05:43:54.210226+0000","last_became_active":"2023-12-19T05:43:53.223069+0000","last_became_peered":"2023-12-19T05:43:53.223069+0000","last_unstale":"2023-12-19T05:43:54.210226+0000","last_undegraded":"2023-12-19T05:43:54.210226+0000","last_fullsized":"2023-12-19T05:43:54.210226+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:06.539170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558336+0000","last_change":"2023-12-19T05:43:53.227302+0000","last_active":"2023-12-19T05:43:54.558336+0000","last_peered":"2023-12-19T05:43:54.558336+0000","last_clean":"2023-12-19T05:43:54.558336+0000","last_became_active":"2023-12-19T05:43:53.227081+0000","last_became_peered":"2023-12-19T05:43:53.227081+0000","last_unstale":"2023-12-19T05:43:54.558336+0000","last_undegraded":"2023-12-19T05:43:54.558336+0000","last_fullsized":"2023-12-19T05:43:54.558336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:01:05.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.373965+0000","last_change":"2023-12-19T05:43:53.220205+0000","last_active":"2023-12-19T05:43:54.373965+0000","last_peered":"2023-12-19T05:43:54.373965+0000","last_clean":"2023-12-19T05:43:54.373965+0000","last_became_active":"2023-12-19T05:43:53.219538+0000","last_became_peered":"2023-12-19T05:43:53.219538+0000","last_unstale":"2023-12-19T05:43:54.373965+0000","last_undegraded":"2023-12-19T05:43:54.373965+0000","last_fullsized":"2023-12-19T05:43:54.373965+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:33.470789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557798+0000","last_change":"2023-12-19T05:43:53.232584+0000","last_active":"2023-12-19T05:43:54.557798+0000","last_peered":"2023-12-19T05:43:54.557798+0000","last_clean":"2023-12-19T05:43:54.557798+0000","last_became_active":"2023-12-19T05:43:53.231344+0000","last_became_peered":"2023-12-19T05:43:53.231344+0000","last_unstale":"2023-12-19T05:43:54.557798+0000","last_undegraded":"2023-12-19T05:43:54.557798+0000","last_fullsized":"2023-12-19T05:43:54.557798+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:06:20.357850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207246+0000","last_change":"2023-12-19T05:43:53.215757+0000","last_active":"2023-12-19T05:43:54.207246+0000","last_peered":"2023-12-19T05:43:54.207246+0000","last_clean":"2023-12-19T05:43:54.207246+0000","last_became_active":"2023-12-19T05:43:53.215388+0000","last_became_peered":"2023-12-19T05:43:53.215388+0000","last_unstale":"2023-12-19T05:43:54.207246+0000","last_undegraded":"2023-12-19T05:43:54.207246+0000","last_fullsized":"2023-12-19T05:43:54.207246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:46:00.908227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558220+0000","last_change":"2023-12-19T05:43:53.234674+0000","last_active":"2023-12-19T05:43:54.558220+0000","last_peered":"2023-12-19T05:43:54.558220+0000","last_clean":"2023-12-19T05:43:54.558220+0000","last_became_active":"2023-12-19T05:43:53.234180+0000","last_became_peered":"2023-12-19T05:43:53.234180+0000","last_unstale":"2023-12-19T05:43:54.558220+0000","last_undegraded":"2023-12-19T05:43:54.558220+0000","last_fullsized":"2023-12-19T05:43:54.558220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:59:46.010949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207315+0000","last_change":"2023-12-19T05:43:53.234313+0000","last_active":"2023-12-19T05:43:54.207315+0000","last_peered":"2023-12-19T05:43:54.207315+0000","last_clean":"2023-12-19T05:43:54.207315+0000","last_became_active":"2023-12-19T05:43:53.225737+0000","last_became_peered":"2023-12-19T05:43:53.225737+0000","last_unstale":"2023-12-19T05:43:54.207315+0000","last_undegraded":"2023-12-19T05:43:54.207315+0000","last_fullsized":"2023-12-19T05:43:54.207315+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:47.809979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.209216+0000","last_change":"2023-12-19T05:43:53.216974+0000","last_active":"2023-12-19T05:43:54.209216+0000","last_peered":"2023-12-19T05:43:54.209216+0000","last_clean":"2023-12-19T05:43:54.209216+0000","last_became_active":"2023-12-19T05:43:53.216725+0000","last_became_peered":"2023-12-19T05:43:53.216725+0000","last_unstale":"2023-12-19T05:43:54.209216+0000","last_undegraded":"2023-12-19T05:43:54.209216+0000","last_fullsized":"2023-12-19T05:43:54.209216+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:06.934680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557225+0000","last_change":"2023-12-19T05:43:53.224100+0000","last_active":"2023-12-19T05:43:54.557225+0000","last_peered":"2023-12-19T05:43:54.557225+0000","last_clean":"2023-12-19T05:43:54.557225+0000","last_became_active":"2023-12-19T05:43:53.223277+0000","last_became_peered":"2023-12-19T05:43:53.223277+0000","last_unstale":"2023-12-19T05:43:54.557225+0000","last_undegraded":"2023-12-19T05:43:54.557225+0000","last_fullsized":"2023-12-19T05:43:54.557225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:19.557920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.375301+0000","last_change":"2023-12-19T05:43:53.225937+0000","last_active":"2023-12-19T05:43:54.375301+0000","last_peered":"2023-12-19T05:43:54.375301+0000","last_clean":"2023-12-19T05:43:54.375301+0000","last_became_active":"2023-12-19T05:43:53.225729+0000","last_became_peered":"2023-12-19T05:43:53.225729+0000","last_unstale":"2023-12-19T05:43:54.375301+0000","last_undegraded":"2023-12-19T05:43:54.375301+0000","last_fullsized":"2023-12-19T05:43:54.375301+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:25.229536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.208141+0000","last_change":"2023-12-19T05:43:53.217241+0000","last_active":"2023-12-19T05:43:54.208141+0000","last_peered":"2023-12-19T05:43:54.208141+0000","last_clean":"2023-12-19T05:43:54.208141+0000","last_became_active":"2023-12-19T05:43:53.217002+0000","last_became_peered":"2023-12-19T05:43:53.217002+0000","last_unstale":"2023-12-19T05:43:54.208141+0000","last_undegraded":"2023-12-19T05:43:54.208141+0000","last_fullsized":"2023-12-19T05:43:54.208141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:58:57.415367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558575+0000","last_change":"2023-12-19T05:43:53.230992+0000","last_active":"2023-12-19T05:43:54.558575+0000","last_peered":"2023-12-19T05:43:54.558575+0000","last_clean":"2023-12-19T05:43:54.558575+0000","last_became_active":"2023-12-19T05:43:53.230764+0000","last_became_peered":"2023-12-19T05:43:53.230764+0000","last_unstale":"2023-12-19T05:43:54.558575+0000","last_undegraded":"2023-12-19T05:43:54.558575+0000","last_fullsized":"2023-12-19T05:43:54.558575+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:57:36.803814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557779+0000","last_change":"2023-12-19T05:43:53.228940+0000","last_active":"2023-12-19T05:43:54.557779+0000","last_peered":"2023-12-19T05:43:54.557779+0000","last_clean":"2023-12-19T05:43:54.557779+0000","last_became_active":"2023-12-19T05:43:53.228720+0000","last_became_peered":"2023-12-19T05:43:53.228720+0000","last_unstale":"2023-12-19T05:43:54.557779+0000","last_undegraded":"2023-12-19T05:43:54.557779+0000","last_fullsized":"2023-12-19T05:43:54.557779+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:46.913790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207389+0000","last_change":"2023-12-19T05:43:53.223688+0000","last_active":"2023-12-19T05:43:54.207389+0000","last_peered":"2023-12-19T05:43:54.207389+0000","last_clean":"2023-12-19T05:43:54.207389+0000","last_became_active":"2023-12-19T05:43:53.223073+0000","last_became_peered":"2023-12-19T05:43:53.223073+0000","last_unstale":"2023-12-19T05:43:54.207389+0000","last_undegraded":"2023-12-19T05:43:54.207389+0000","last_fullsized":"2023-12-19T05:43:54.207389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:29:46.903007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"89'4","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.230298+0000","last_change":"2023-12-19T05:43:52.723859+0000","last_active":"2023-12-19T05:43:53.230298+0000","last_peered":"2023-12-19T05:43:53.230298+0000","last_clean":"2023-12-19T05:43:53.230298+0000","last_became_active":"2023-12-19T05:43:52.723487+0000","last_became_peered":"2023-12-19T05:43:52.723487+0000","last_unstale":"2023-12-19T05:43:53.230298+0000","last_undegraded":"2023-12-19T05:43:53.230298+0000","last_fullsized":"2023-12-19T05:43:53.230298+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:00.155968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.376654+0000","last_change":"2023-12-19T05:43:53.231993+0000","last_active":"2023-12-19T05:43:54.376654+0000","last_peered":"2023-12-19T05:43:54.376654+0000","last_clean":"2023-12-19T05:43:54.376654+0000","last_became_active":"2023-12-19T05:43:53.231675+0000","last_became_peered":"2023-12-19T05:43:53.231675+0000","last_unstale":"2023-12-19T05:43:54.376654+0000","last_undegraded":"2023-12-19T05:43:54.376654+0000","last_fullsized":"2023-12-19T05:43:54.376654+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:26:55.034160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.227620+0000","last_change":"2023-12-19T05:43:52.703089+0000","last_active":"2023-12-19T05:43:53.227620+0000","last_peered":"2023-12-19T05:43:53.227620+0000","last_clean":"2023-12-19T05:43:53.227620+0000","last_became_active":"2023-12-19T05:43:52.702462+0000","last_became_peered":"2023-12-19T05:43:52.702462+0000","last_unstale":"2023-12-19T05:43:53.227620+0000","last_undegraded":"2023-12-19T05:43:53.227620+0000","last_fullsized":"2023-12-19T05:43:53.227620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:10:44.857205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.373696+0000","last_change":"2023-12-19T05:43:53.232981+0000","last_active":"2023-12-19T05:43:54.373696+0000","last_peered":"2023-12-19T05:43:54.373696+0000","last_clean":"2023-12-19T05:43:54.373696+0000","last_became_active":"2023-12-19T05:43:53.232698+0000","last_became_peered":"2023-12-19T05:43:53.232698+0000","last_unstale":"2023-12-19T05:43:54.373696+0000","last_undegraded":"2023-12-19T05:43:54.373696+0000","last_fullsized":"2023-12-19T05:43:54.373696+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:56.143654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.238346+0000","last_change":"2023-12-19T05:43:52.708073+0000","last_active":"2023-12-19T05:43:53.238346+0000","last_peered":"2023-12-19T05:43:53.238346+0000","last_clean":"2023-12-19T05:43:53.238346+0000","last_became_active":"2023-12-19T05:43:52.707800+0000","last_became_peered":"2023-12-19T05:43:52.707800+0000","last_unstale":"2023-12-19T05:43:53.238346+0000","last_undegraded":"2023-12-19T05:43:53.238346+0000","last_fullsized":"2023-12-19T05:43:53.238346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.102079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558699+0000","last_change":"2023-12-19T05:43:53.229455+0000","last_active":"2023-12-19T05:43:54.558699+0000","last_peered":"2023-12-19T05:43:54.558699+0000","last_clean":"2023-12-19T05:43:54.558699+0000","last_became_active":"2023-12-19T05:43:53.228669+0000","last_became_peered":"2023-12-19T05:43:53.228669+0000","last_unstale":"2023-12-19T05:43:54.558699+0000","last_undegraded":"2023-12-19T05:43:54.558699+0000","last_fullsized":"2023-12-19T05:43:54.558699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:50:50.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.231629+0000","last_change":"2023-12-19T05:43:52.717898+0000","last_active":"2023-12-19T05:43:53.231629+0000","last_peered":"2023-12-19T05:43:53.231629+0000","last_clean":"2023-12-19T05:43:53.231629+0000","last_became_active":"2023-12-19T05:43:52.717496+0000","last_became_peered":"2023-12-19T05:43:52.717496+0000","last_unstale":"2023-12-19T05:43:53.231629+0000","last_undegraded":"2023-12-19T05:43:53.231629+0000","last_fullsized":"2023-12-19T05:43:53.231629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:51:21.630873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207084+0000","last_change":"2023-12-19T05:43:53.233385+0000","last_active":"2023-12-19T05:43:54.207084+0000","last_peered":"2023-12-19T05:43:54.207084+0000","last_clean":"2023-12-19T05:43:54.207084+0000","last_became_active":"2023-12-19T05:43:53.223862+0000","last_became_peered":"2023-12-19T05:43:53.223862+0000","last_unstale":"2023-12-19T05:43:54.207084+0000","last_undegraded":"2023-12-19T05:43:54.207084+0000","last_fullsized":"2023-12-19T05:43:54.207084+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:24:51.275152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"89'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.230737+0000","last_change":"2023-12-19T05:43:52.725913+0000","last_active":"2023-12-19T05:43:53.230737+0000","last_peered":"2023-12-19T05:43:53.230737+0000","last_clean":"2023-12-19T05:43:53.230737+0000","last_became_active":"2023-12-19T05:43:52.725695+0000","last_became_peered":"2023-12-19T05:43:52.725695+0000","last_unstale":"2023-12-19T05:43:53.230737+0000","last_undegraded":"2023-12-19T05:43:53.230737+0000","last_fullsized":"2023-12-19T05:43:53.230737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:32.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.374205+0000","last_change":"2023-12-19T05:43:53.221983+0000","last_active":"2023-12-19T05:43:54.374205+0000","last_peered":"2023-12-19T05:43:54.374205+0000","last_clean":"2023-12-19T05:43:54.374205+0000","last_became_active":"2023-12-19T05:43:53.219872+0000","last_became_peered":"2023-12-19T05:43:53.219872+0000","last_unstale":"2023-12-19T05:43:54.374205+0000","last_undegraded":"2023-12-19T05:43:54.374205+0000","last_fullsized":"2023-12-19T05:43:54.374205+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:12.324689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"89'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.241774+0000","last_change":"2023-12-19T05:43:52.722563+0000","last_active":"2023-12-19T05:43:53.241774+0000","last_peered":"2023-12-19T05:43:53.241774+0000","last_clean":"2023-12-19T05:43:53.241774+0000","last_became_active":"2023-12-19T05:43:52.720555+0000","last_became_peered":"2023-12-19T05:43:52.720555+0000","last_unstale":"2023-12-19T05:43:53.241774+0000","last_undegraded":"2023-12-19T05:43:53.241774+0000","last_fullsized":"2023-12-19T05:43:53.241774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:44:12.162150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.374939+0000","last_change":"2023-12-19T05:43:53.227535+0000","last_active":"2023-12-19T05:43:54.374939+0000","last_peered":"2023-12-19T05:43:54.374939+0000","last_clean":"2023-12-19T05:43:54.374939+0000","last_became_active":"2023-12-19T05:43:53.227336+0000","last_became_peered":"2023-12-19T05:43:53.227336+0000","last_unstale":"2023-12-19T05:43:54.374939+0000","last_undegraded":"2023-12-19T05:43:54.374939+0000","last_fullsized":"2023-12-19T05:43:54.374939+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:46.913790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214102+0000","last_change":"2023-12-19T05:43:52.718502+0000","last_active":"2023-12-19T05:43:53.214102+0000","last_peered":"2023-12-19T05:43:53.214102+0000","last_clean":"2023-12-19T05:43:53.214102+0000","last_became_active":"2023-12-19T05:43:52.716318+0000","last_became_peered":"2023-12-19T05:43:52.716318+0000","last_unstale":"2023-12-19T05:43:53.214102+0000","last_undegraded":"2023-12-19T05:43:53.214102+0000","last_fullsized":"2023-12-19T05:43:53.214102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:27:52.532334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210297+0000","last_change":"2023-12-19T05:43:53.226621+0000","last_active":"2023-12-19T05:43:54.210297+0000","last_peered":"2023-12-19T05:43:54.210297+0000","last_clean":"2023-12-19T05:43:54.210297+0000","last_became_active":"2023-12-19T05:43:53.225868+0000","last_became_peered":"2023-12-19T05:43:53.225868+0000","last_unstale":"2023-12-19T05:43:54.210297+0000","last_undegraded":"2023-12-19T05:43:54.210297+0000","last_fullsized":"2023-12-19T05:43:54.210297+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:37.737312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214425+0000","last_change":"2023-12-19T05:43:52.724337+0000","last_active":"2023-12-19T05:43:53.214425+0000","last_peered":"2023-12-19T05:43:53.214425+0000","last_clean":"2023-12-19T05:43:53.214425+0000","last_became_active":"2023-12-19T05:43:52.723902+0000","last_became_peered":"2023-12-19T05:43:52.723902+0000","last_unstale":"2023-12-19T05:43:53.214425+0000","last_undegraded":"2023-12-19T05:43:53.214425+0000","last_fullsized":"2023-12-19T05:43:53.214425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:29.203975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558387+0000","last_change":"2023-12-19T05:43:53.232135+0000","last_active":"2023-12-19T05:43:54.558387+0000","last_peered":"2023-12-19T05:43:54.558387+0000","last_clean":"2023-12-19T05:43:54.558387+0000","last_became_active":"2023-12-19T05:43:53.231915+0000","last_became_peered":"2023-12-19T05:43:53.231915+0000","last_unstale":"2023-12-19T05:43:54.558387+0000","last_undegraded":"2023-12-19T05:43:54.558387+0000","last_fullsized":"2023-12-19T05:43:54.558387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:14.721425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.206316+0000","last_change":"2023-12-19T05:43:52.709392+0000","last_active":"2023-12-19T05:43:53.206316+0000","last_peered":"2023-12-19T05:43:53.206316+0000","last_clean":"2023-12-19T05:43:53.206316+0000","last_became_active":"2023-12-19T05:43:52.707856+0000","last_became_peered":"2023-12-19T05:43:52.707856+0000","last_unstale":"2023-12-19T05:43:53.206316+0000","last_undegraded":"2023-12-19T05:43:53.206316+0000","last_fullsized":"2023-12-19T05:43:53.206316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:12.301200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.559321+0000","last_change":"2023-12-19T05:43:53.226853+0000","last_active":"2023-12-19T05:43:54.559321+0000","last_peered":"2023-12-19T05:43:54.559321+0000","last_clean":"2023-12-19T05:43:54.559321+0000","last_became_active":"2023-12-19T05:43:53.226344+0000","last_became_peered":"2023-12-19T05:43:53.226344+0000","last_unstale":"2023-12-19T05:43:54.559321+0000","last_undegraded":"2023-12-19T05:43:54.559321+0000","last_fullsized":"2023-12-19T05:43:54.559321+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:06:40.059279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.217943+0000","last_change":"2023-12-19T05:43:52.720193+0000","last_active":"2023-12-19T05:43:53.217943+0000","last_peered":"2023-12-19T05:43:53.217943+0000","last_clean":"2023-12-19T05:43:53.217943+0000","last_became_active":"2023-12-19T05:43:52.719960+0000","last_became_peered":"2023-12-19T05:43:52.719960+0000","last_unstale":"2023-12-19T05:43:53.217943+0000","last_undegraded":"2023-12-19T05:43:53.217943+0000","last_fullsized":"2023-12-19T05:43:53.217943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:06:19.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207545+0000","last_change":"2023-12-19T05:43:53.225319+0000","last_active":"2023-12-19T05:43:54.207545+0000","last_peered":"2023-12-19T05:43:54.207545+0000","last_clean":"2023-12-19T05:43:54.207545+0000","last_became_active":"2023-12-19T05:43:53.225076+0000","last_became_peered":"2023-12-19T05:43:53.225076+0000","last_unstale":"2023-12-19T05:43:54.207545+0000","last_undegraded":"2023-12-19T05:43:54.207545+0000","last_fullsized":"2023-12-19T05:43:54.207545+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:53:41.136143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.230070+0000","last_change":"2023-12-19T05:43:52.722141+0000","last_active":"2023-12-19T05:43:53.230070+0000","last_peered":"2023-12-19T05:43:53.230070+0000","last_clean":"2023-12-19T05:43:53.230070+0000","last_became_active":"2023-12-19T05:43:52.721878+0000","last_became_peered":"2023-12-19T05:43:52.721878+0000","last_unstale":"2023-12-19T05:43:53.230070+0000","last_undegraded":"2023-12-19T05:43:53.230070+0000","last_fullsized":"2023-12-19T05:43:53.230070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:18.543374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.209906+0000","last_change":"2023-12-19T05:43:53.220685+0000","last_active":"2023-12-19T05:43:54.209906+0000","last_peered":"2023-12-19T05:43:54.209906+0000","last_clean":"2023-12-19T05:43:54.209906+0000","last_became_active":"2023-12-19T05:43:53.220274+0000","last_became_peered":"2023-12-19T05:43:53.220274+0000","last_unstale":"2023-12-19T05:43:54.209906+0000","last_undegraded":"2023-12-19T05:43:54.209906+0000","last_fullsized":"2023-12-19T05:43:54.209906+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:14:10.257274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"89'6","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.235602+0000","last_change":"2023-12-19T05:43:52.723639+0000","last_active":"2023-12-19T05:43:53.235602+0000","last_peered":"2023-12-19T05:43:53.235602+0000","last_clean":"2023-12-19T05:43:53.235602+0000","last_became_active":"2023-12-19T05:43:52.721732+0000","last_became_peered":"2023-12-19T05:43:52.721732+0000","last_unstale":"2023-12-19T05:43:53.235602+0000","last_undegraded":"2023-12-19T05:43:53.235602+0000","last_fullsized":"2023-12-19T05:43:53.235602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:50.136662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.373790+0000","last_change":"2023-12-19T05:43:53.231754+0000","last_active":"2023-12-19T05:43:54.373790+0000","last_peered":"2023-12-19T05:43:54.373790+0000","last_clean":"2023-12-19T05:43:54.373790+0000","last_became_active":"2023-12-19T05:43:53.230692+0000","last_became_peered":"2023-12-19T05:43:53.230692+0000","last_unstale":"2023-12-19T05:43:54.373790+0000","last_undegraded":"2023-12-19T05:43:54.373790+0000","last_fullsized":"2023-12-19T05:43:54.373790+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:11.476196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.235016+0000","last_change":"2023-12-19T05:43:52.716094+0000","last_active":"2023-12-19T05:43:53.235016+0000","last_peered":"2023-12-19T05:43:53.235016+0000","last_clean":"2023-12-19T05:43:53.235016+0000","last_became_active":"2023-12-19T05:43:52.712974+0000","last_became_peered":"2023-12-19T05:43:52.712974+0000","last_unstale":"2023-12-19T05:43:53.235016+0000","last_undegraded":"2023-12-19T05:43:53.235016+0000","last_fullsized":"2023-12-19T05:43:53.235016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:13.706880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558880+0000","last_change":"2023-12-19T05:43:53.233437+0000","last_active":"2023-12-19T05:43:54.558880+0000","last_peered":"2023-12-19T05:43:54.558880+0000","last_clean":"2023-12-19T05:43:54.558880+0000","last_became_active":"2023-12-19T05:43:53.229054+0000","last_became_peered":"2023-12-19T05:43:53.229054+0000","last_unstale":"2023-12-19T05:43:54.558880+0000","last_undegraded":"2023-12-19T05:43:54.558880+0000","last_fullsized":"2023-12-19T05:43:54.558880+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:01.170513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.216003+0000","last_change":"2023-12-19T05:43:52.717542+0000","last_active":"2023-12-19T05:43:53.216003+0000","last_peered":"2023-12-19T05:43:53.216003+0000","last_clean":"2023-12-19T05:43:53.216003+0000","last_became_active":"2023-12-19T05:43:52.717268+0000","last_became_peered":"2023-12-19T05:43:52.717268+0000","last_unstale":"2023-12-19T05:43:53.216003+0000","last_undegraded":"2023-12-19T05:43:53.216003+0000","last_fullsized":"2023-12-19T05:43:53.216003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:43:41.000150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210121+0000","last_change":"2023-12-19T05:43:53.224184+0000","last_active":"2023-12-19T05:43:54.210121+0000","last_peered":"2023-12-19T05:43:54.210121+0000","last_clean":"2023-12-19T05:43:54.210121+0000","last_became_active":"2023-12-19T05:43:53.221014+0000","last_became_peered":"2023-12-19T05:43:53.221014+0000","last_unstale":"2023-12-19T05:43:54.210121+0000","last_undegraded":"2023-12-19T05:43:54.210121+0000","last_fullsized":"2023-12-19T05:43:54.210121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:08.954561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.216453+0000","last_change":"2023-12-19T05:43:52.723663+0000","last_active":"2023-12-19T05:43:53.216453+0000","last_peered":"2023-12-19T05:43:53.216453+0000","last_clean":"2023-12-19T05:43:53.216453+0000","last_became_active":"2023-12-19T05:43:52.723022+0000","last_became_peered":"2023-12-19T05:43:52.723022+0000","last_unstale":"2023-12-19T05:43:53.216453+0000","last_undegraded":"2023-12-19T05:43:53.216453+0000","last_fullsized":"2023-12-19T05:43:53.216453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:23:05.103752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.375103+0000","last_change":"2023-12-19T05:43:53.230445+0000","last_active":"2023-12-19T05:43:54.375103+0000","last_peered":"2023-12-19T05:43:54.375103+0000","last_clean":"2023-12-19T05:43:54.375103+0000","last_became_active":"2023-12-19T05:43:53.230127+0000","last_became_peered":"2023-12-19T05:43:53.230127+0000","last_unstale":"2023-12-19T05:43:54.375103+0000","last_undegraded":"2023-12-19T05:43:54.375103+0000","last_fullsized":"2023-12-19T05:43:54.375103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:12.843607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"89'8","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.240623+0000","last_change":"2023-12-19T05:43:52.722324+0000","last_active":"2023-12-19T05:43:53.240623+0000","last_peered":"2023-12-19T05:43:53.240623+0000","last_clean":"2023-12-19T05:43:53.240623+0000","last_became_active":"2023-12-19T05:43:52.720332+0000","last_became_peered":"2023-12-19T05:43:52.720332+0000","last_unstale":"2023-12-19T05:43:53.240623+0000","last_undegraded":"2023-12-19T05:43:53.240623+0000","last_fullsized":"2023-12-19T05:43:53.240623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:06:49.761803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557592+0000","last_change":"2023-12-19T05:43:53.223257+0000","last_active":"2023-12-19T05:43:54.557592+0000","last_peered":"2023-12-19T05:43:54.557592+0000","last_clean":"2023-12-19T05:43:54.557592+0000","last_became_active":"2023-12-19T05:43:53.222559+0000","last_became_peered":"2023-12-19T05:43:53.222559+0000","last_unstale":"2023-12-19T05:43:54.557592+0000","last_undegraded":"2023-12-19T05:43:54.557592+0000","last_fullsized":"2023-12-19T05:43:54.557592+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:30.218520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"89'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.237371+0000","last_change":"2023-12-19T05:43:52.723658+0000","last_active":"2023-12-19T05:43:53.237371+0000","last_peered":"2023-12-19T05:43:53.237371+0000","last_clean":"2023-12-19T05:43:53.237371+0000","last_became_active":"2023-12-19T05:43:52.723415+0000","last_became_peered":"2023-12-19T05:43:52.723415+0000","last_unstale":"2023-12-19T05:43:53.237371+0000","last_undegraded":"2023-12-19T05:43:53.237371+0000","last_fullsized":"2023-12-19T05:43:53.237371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:37:50.038202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557233+0000","last_change":"2023-12-19T05:43:53.221401+0000","last_active":"2023-12-19T05:43:54.557233+0000","last_peered":"2023-12-19T05:43:54.557233+0000","last_clean":"2023-12-19T05:43:54.557233+0000","last_became_active":"2023-12-19T05:43:53.221172+0000","last_became_peered":"2023-12-19T05:43:53.221172+0000","last_unstale":"2023-12-19T05:43:54.557233+0000","last_undegraded":"2023-12-19T05:43:54.557233+0000","last_fullsized":"2023-12-19T05:43:54.557233+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:10:45.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.224827+0000","last_change":"2023-12-19T05:43:52.719706+0000","last_active":"2023-12-19T05:43:53.224827+0000","last_peered":"2023-12-19T05:43:53.224827+0000","last_clean":"2023-12-19T05:43:53.224827+0000","last_became_active":"2023-12-19T05:43:52.719466+0000","last_became_peered":"2023-12-19T05:43:52.719466+0000","last_unstale":"2023-12-19T05:43:53.224827+0000","last_undegraded":"2023-12-19T05:43:53.224827+0000","last_fullsized":"2023-12-19T05:43:53.224827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:00.155968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.375345+0000","last_change":"2023-12-19T05:43:53.226387+0000","last_active":"2023-12-19T05:43:54.375345+0000","last_peered":"2023-12-19T05:43:54.375345+0000","last_clean":"2023-12-19T05:43:54.375345+0000","last_became_active":"2023-12-19T05:43:53.225343+0000","last_became_peered":"2023-12-19T05:43:53.225343+0000","last_unstale":"2023-12-19T05:43:54.375345+0000","last_undegraded":"2023-12-19T05:43:54.375345+0000","last_fullsized":"2023-12-19T05:43:54.375345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:30.060871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"89'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.233670+0000","last_change":"2023-12-19T05:43:52.709160+0000","last_active":"2023-12-19T05:43:53.233670+0000","last_peered":"2023-12-19T05:43:53.233670+0000","last_clean":"2023-12-19T05:43:53.233670+0000","last_became_active":"2023-12-19T05:43:52.708862+0000","last_became_peered":"2023-12-19T05:43:52.708862+0000","last_unstale":"2023-12-19T05:43:53.233670+0000","last_undegraded":"2023-12-19T05:43:53.233670+0000","last_fullsized":"2023-12-19T05:43:53.233670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:55:20.631818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.376028+0000","last_change":"2023-12-19T05:43:53.224958+0000","last_active":"2023-12-19T05:43:54.376028+0000","last_peered":"2023-12-19T05:43:54.376028+0000","last_clean":"2023-12-19T05:43:54.376028+0000","last_became_active":"2023-12-19T05:43:53.224448+0000","last_became_peered":"2023-12-19T05:43:53.224448+0000","last_unstale":"2023-12-19T05:43:54.376028+0000","last_undegraded":"2023-12-19T05:43:54.376028+0000","last_fullsized":"2023-12-19T05:43:54.376028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:14:17.385334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214591+0000","last_change":"2023-12-19T05:43:52.722161+0000","last_active":"2023-12-19T05:43:53.214591+0000","last_peered":"2023-12-19T05:43:53.214591+0000","last_clean":"2023-12-19T05:43:53.214591+0000","last_became_active":"2023-12-19T05:43:52.720469+0000","last_became_peered":"2023-12-19T05:43:52.720469+0000","last_unstale":"2023-12-19T05:43:53.214591+0000","last_undegraded":"2023-12-19T05:43:53.214591+0000","last_fullsized":"2023-12-19T05:43:53.214591+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:28.955784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.375256+0000","last_change":"2023-12-19T05:43:53.230106+0000","last_active":"2023-12-19T05:43:54.375256+0000","last_peered":"2023-12-19T05:43:54.375256+0000","last_clean":"2023-12-19T05:43:54.375256+0000","last_became_active":"2023-12-19T05:43:53.229842+0000","last_became_peered":"2023-12-19T05:43:53.229842+0000","last_unstale":"2023-12-19T05:43:54.375256+0000","last_undegraded":"2023-12-19T05:43:54.375256+0000","last_fullsized":"2023-12-19T05:43:54.375256+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:19.557920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.213529+0000","last_change":"2023-12-19T05:43:52.724202+0000","last_active":"2023-12-19T05:43:53.213529+0000","last_peered":"2023-12-19T05:43:53.213529+0000","last_clean":"2023-12-19T05:43:53.213529+0000","last_became_active":"2023-12-19T05:43:52.723957+0000","last_became_peered":"2023-12-19T05:43:52.723957+0000","last_unstale":"2023-12-19T05:43:53.213529+0000","last_undegraded":"2023-12-19T05:43:53.213529+0000","last_fullsized":"2023-12-19T05:43:53.213529+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:04.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.374953+0000","last_change":"2023-12-19T05:43:53.220692+0000","last_active":"2023-12-19T05:43:54.374953+0000","last_peered":"2023-12-19T05:43:54.374953+0000","last_clean":"2023-12-19T05:43:54.374953+0000","last_became_active":"2023-12-19T05:43:53.220462+0000","last_became_peered":"2023-12-19T05:43:53.220462+0000","last_unstale":"2023-12-19T05:43:54.374953+0000","last_undegraded":"2023-12-19T05:43:54.374953+0000","last_fullsized":"2023-12-19T05:43:54.374953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:11.476196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.218091+0000","last_change":"2023-12-19T05:43:52.724406+0000","last_active":"2023-12-19T05:43:53.218091+0000","last_peered":"2023-12-19T05:43:53.218091+0000","last_clean":"2023-12-19T05:43:53.218091+0000","last_became_active":"2023-12-19T05:43:52.724109+0000","last_became_peered":"2023-12-19T05:43:52.724109+0000","last_unstale":"2023-12-19T05:43:53.218091+0000","last_undegraded":"2023-12-19T05:43:53.218091+0000","last_fullsized":"2023-12-19T05:43:53.218091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:38.780769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.212171+0000","last_change":"2023-12-19T05:43:53.219187+0000","last_active":"2023-12-19T05:43:54.212171+0000","last_peered":"2023-12-19T05:43:54.212171+0000","last_clean":"2023-12-19T05:43:54.212171+0000","last_became_active":"2023-12-19T05:43:53.218926+0000","last_became_peered":"2023-12-19T05:43:53.218926+0000","last_unstale":"2023-12-19T05:43:54.212171+0000","last_undegraded":"2023-12-19T05:43:54.212171+0000","last_fullsized":"2023-12-19T05:43:54.212171+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:09:21.507484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.210010+0000","last_change":"2023-12-19T05:43:52.704701+0000","last_active":"2023-12-19T05:43:53.210010+0000","last_peered":"2023-12-19T05:43:53.210010+0000","last_clean":"2023-12-19T05:43:53.210010+0000","last_became_active":"2023-12-19T05:43:52.704109+0000","last_became_peered":"2023-12-19T05:43:52.704109+0000","last_unstale":"2023-12-19T05:43:53.210010+0000","last_undegraded":"2023-12-19T05:43:53.210010+0000","last_fullsized":"2023-12-19T05:43:53.210010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:44.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.210333+0000","last_change":"2023-12-19T05:43:53.220514+0000","last_active":"2023-12-19T05:43:54.210333+0000","last_peered":"2023-12-19T05:43:54.210333+0000","last_clean":"2023-12-19T05:43:54.210333+0000","last_became_active":"2023-12-19T05:43:53.219975+0000","last_became_peered":"2023-12-19T05:43:53.219975+0000","last_unstale":"2023-12-19T05:43:54.210333+0000","last_undegraded":"2023-12-19T05:43:54.210333+0000","last_fullsized":"2023-12-19T05:43:54.210333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:00:09.847387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.237715+0000","last_change":"2023-12-19T05:43:52.724284+0000","last_active":"2023-12-19T05:43:53.237715+0000","last_peered":"2023-12-19T05:43:53.237715+0000","last_clean":"2023-12-19T05:43:53.237715+0000","last_became_active":"2023-12-19T05:43:52.723021+0000","last_became_peered":"2023-12-19T05:43:52.723021+0000","last_unstale":"2023-12-19T05:43:53.237715+0000","last_undegraded":"2023-12-19T05:43:53.237715+0000","last_fullsized":"2023-12-19T05:43:53.237715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:26:03.112690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.558634+0000","last_change":"2023-12-19T05:43:53.220964+0000","last_active":"2023-12-19T05:43:54.558634+0000","last_peered":"2023-12-19T05:43:54.558634+0000","last_clean":"2023-12-19T05:43:54.558634+0000","last_became_active":"2023-12-19T05:43:53.220700+0000","last_became_peered":"2023-12-19T05:43:53.220700+0000","last_unstale":"2023-12-19T05:43:54.558634+0000","last_undegraded":"2023-12-19T05:43:54.558634+0000","last_fullsized":"2023-12-19T05:43:54.558634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:51.151207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.204168+0000","last_change":"2023-12-19T05:43:52.717957+0000","last_active":"2023-12-19T05:43:53.204168+0000","last_peered":"2023-12-19T05:43:53.204168+0000","last_clean":"2023-12-19T05:43:53.204168+0000","last_became_active":"2023-12-19T05:43:52.717706+0000","last_became_peered":"2023-12-19T05:43:52.717706+0000","last_unstale":"2023-12-19T05:43:53.204168+0000","last_undegraded":"2023-12-19T05:43:53.204168+0000","last_fullsized":"2023-12-19T05:43:53.204168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:40:44.276655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557425+0000","last_change":"2023-12-19T05:43:53.225364+0000","last_active":"2023-12-19T05:43:54.557425+0000","last_peered":"2023-12-19T05:43:54.557425+0000","last_clean":"2023-12-19T05:43:54.557425+0000","last_became_active":"2023-12-19T05:43:53.225099+0000","last_became_peered":"2023-12-19T05:43:53.225099+0000","last_unstale":"2023-12-19T05:43:54.557425+0000","last_undegraded":"2023-12-19T05:43:54.557425+0000","last_fullsized":"2023-12-19T05:43:54.557425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:09:45.014822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.215734+0000","last_change":"2023-12-19T05:43:52.724040+0000","last_active":"2023-12-19T05:43:53.215734+0000","last_peered":"2023-12-19T05:43:53.215734+0000","last_clean":"2023-12-19T05:43:53.215734+0000","last_became_active":"2023-12-19T05:43:52.723802+0000","last_became_peered":"2023-12-19T05:43:52.723802+0000","last_unstale":"2023-12-19T05:43:53.215734+0000","last_undegraded":"2023-12-19T05:43:53.215734+0000","last_fullsized":"2023-12-19T05:43:53.215734+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:57:35.789269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557739+0000","last_change":"2023-12-19T05:43:53.230246+0000","last_active":"2023-12-19T05:43:54.557739+0000","last_peered":"2023-12-19T05:43:54.557739+0000","last_clean":"2023-12-19T05:43:54.557739+0000","last_became_active":"2023-12-19T05:43:53.229580+0000","last_became_peered":"2023-12-19T05:43:53.229580+0000","last_unstale":"2023-12-19T05:43:54.557739+0000","last_undegraded":"2023-12-19T05:43:54.557739+0000","last_fullsized":"2023-12-19T05:43:54.557739+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:29.970330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214518+0000","last_change":"2023-12-19T05:43:52.720904+0000","last_active":"2023-12-19T05:43:53.214518+0000","last_peered":"2023-12-19T05:43:53.214518+0000","last_clean":"2023-12-19T05:43:53.214518+0000","last_became_active":"2023-12-19T05:43:52.720433+0000","last_became_peered":"2023-12-19T05:43:52.720433+0000","last_unstale":"2023-12-19T05:43:53.214518+0000","last_undegraded":"2023-12-19T05:43:53.214518+0000","last_fullsized":"2023-12-19T05:43:53.214518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:45.899245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.209465+0000","last_change":"2023-12-19T05:43:53.219537+0000","last_active":"2023-12-19T05:43:54.209465+0000","last_peered":"2023-12-19T05:43:54.209465+0000","last_clean":"2023-12-19T05:43:54.209465+0000","last_became_active":"2023-12-19T05:43:53.218877+0000","last_became_peered":"2023-12-19T05:43:53.218877+0000","last_unstale":"2023-12-19T05:43:54.209465+0000","last_undegraded":"2023-12-19T05:43:54.209465+0000","last_fullsized":"2023-12-19T05:43:54.209465+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:20:05.667606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.213975+0000","last_change":"2023-12-19T05:43:52.725619+0000","last_active":"2023-12-19T05:43:53.213975+0000","last_peered":"2023-12-19T05:43:53.213975+0000","last_clean":"2023-12-19T05:43:53.213975+0000","last_became_active":"2023-12-19T05:43:52.725357+0000","last_became_peered":"2023-12-19T05:43:52.725357+0000","last_unstale":"2023-12-19T05:43:53.213975+0000","last_undegraded":"2023-12-19T05:43:53.213975+0000","last_fullsized":"2023-12-19T05:43:53.213975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:10.461650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.207387+0000","last_change":"2023-12-19T05:43:53.234463+0000","last_active":"2023-12-19T05:43:54.207387+0000","last_peered":"2023-12-19T05:43:54.207387+0000","last_clean":"2023-12-19T05:43:54.207387+0000","last_became_active":"2023-12-19T05:43:53.233472+0000","last_became_peered":"2023-12-19T05:43:53.233472+0000","last_unstale":"2023-12-19T05:43:54.207387+0000","last_undegraded":"2023-12-19T05:43:54.207387+0000","last_fullsized":"2023-12-19T05:43:54.207387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:12:07.246958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.210969+0000","last_change":"2023-12-19T05:43:52.717581+0000","last_active":"2023-12-19T05:43:53.210969+0000","last_peered":"2023-12-19T05:43:53.210969+0000","last_clean":"2023-12-19T05:43:53.210969+0000","last_became_active":"2023-12-19T05:43:52.715525+0000","last_became_peered":"2023-12-19T05:43:52.715525+0000","last_unstale":"2023-12-19T05:43:53.210969+0000","last_undegraded":"2023-12-19T05:43:53.210969+0000","last_fullsized":"2023-12-19T05:43:53.210969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:06:39.044733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.374938+0000","last_change":"2023-12-19T05:43:53.229007+0000","last_active":"2023-12-19T05:43:54.374938+0000","last_peered":"2023-12-19T05:43:54.374938+0000","last_clean":"2023-12-19T05:43:54.374938+0000","last_became_active":"2023-12-19T05:43:53.228785+0000","last_became_peered":"2023-12-19T05:43:53.228785+0000","last_unstale":"2023-12-19T05:43:54.374938+0000","last_undegraded":"2023-12-19T05:43:54.374938+0000","last_fullsized":"2023-12-19T05:43:54.374938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:57:36.803814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214411+0000","last_change":"2023-12-19T05:43:52.722451+0000","last_active":"2023-12-19T05:43:53.214411+0000","last_peered":"2023-12-19T05:43:53.214411+0000","last_clean":"2023-12-19T05:43:53.214411+0000","last_became_active":"2023-12-19T05:43:52.721732+0000","last_became_peered":"2023-12-19T05:43:52.721732+0000","last_unstale":"2023-12-19T05:43:53.214411+0000","last_undegraded":"2023-12-19T05:43:53.214411+0000","last_fullsized":"2023-12-19T05:43:53.214411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:59:44.996404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.557048+0000","last_change":"2023-12-19T05:43:53.226233+0000","last_active":"2023-12-19T05:43:54.557048+0000","last_peered":"2023-12-19T05:43:54.557048+0000","last_clean":"2023-12-19T05:43:54.557048+0000","last_became_active":"2023-12-19T05:43:53.225955+0000","last_became_peered":"2023-12-19T05:43:53.225955+0000","last_unstale":"2023-12-19T05:43:54.557048+0000","last_undegraded":"2023-12-19T05:43:54.557048+0000","last_fullsized":"2023-12-19T05:43:54.557048+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:12.324689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.213620+0000","last_change":"2023-12-19T05:43:52.717988+0000","last_active":"2023-12-19T05:43:53.213620+0000","last_peered":"2023-12-19T05:43:53.213620+0000","last_clean":"2023-12-19T05:43:53.213620+0000","last_became_active":"2023-12-19T05:43:52.717662+0000","last_became_peered":"2023-12-19T05:43:52.717662+0000","last_unstale":"2023-12-19T05:43:53.213620+0000","last_undegraded":"2023-12-19T05:43:53.213620+0000","last_fullsized":"2023-12-19T05:43:53.213620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:06:19.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-19T05:43:54.208979+0000","last_change":"2023-12-19T05:43:53.212630+0000","last_active":"2023-12-19T05:43:54.208979+0000","last_peered":"2023-12-19T05:43:54.208979+0000","last_clean":"2023-12-19T05:43:54.208979+0000","last_became_active":"2023-12-19T05:43:53.212369+0000","last_became_peered":"2023-12-19T05:43:53.212369+0000","last_unstale":"2023-12-19T05:43:54.208979+0000","last_undegraded":"2023-12-19T05:43:54.208979+0000","last_fullsized":"2023-12-19T05:43:54.208979+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:52.675316+0000","last_clean_scrub_stamp":"2023-12-19T05:43:52.675316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:07:46.908452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"89'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.241412+0000","last_change":"2023-12-19T05:43:52.723085+0000","last_active":"2023-12-19T05:43:53.241412+0000","last_peered":"2023-12-19T05:43:53.241412+0000","last_clean":"2023-12-19T05:43:53.241412+0000","last_became_active":"2023-12-19T05:43:52.722831+0000","last_became_peered":"2023-12-19T05:43:52.722831+0000","last_unstale":"2023-12-19T05:43:53.241412+0000","last_undegraded":"2023-12-19T05:43:53.241412+0000","last_fullsized":"2023-12-19T05:43:53.241412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:43:51.660771+0000","last_clean_scrub_stamp":"2023-12-19T05:43:51.660771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:16.988390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-19T05:43:53.214941+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:43:53.214941+0000","last_peered":"2023-12-19T05:43:53.214941+0000","last_clean":"2023-12-19T05:43:53.214941+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:43:53.214941+0000","last_undegraded":"2023-12-19T05:43:53.214941+0000","last_fullsized":"2023-12-19T05:43:53.214941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":472,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194839,"statfs":{"total":200000000,"available":199516078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.075,"15min":1.032},"min":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.081,"15min":1.0549999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":1.089}]},{"osd":1,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1259999999999999,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.167,"15min":1.163},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.80800000000000005}]},{"osd":2,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2070000000000001,"15min":1.232},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.278},{"interface":"front","average":{"1min":1.216,"5min":1.0980000000000001,"15min":1.0720000000000001},"min":{"1min":0.84599999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.194,"15min":1.139},"min":{"1min":0.78200000000000003,"5min":0.622,"15min":0.622},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.3420000000000001,"15min":1.3120000000000001},"min":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.0940000000000001,"15min":1.03},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.9980000000000002,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2769999999999999,"15min":1.2430000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.377}]},{"osd":5,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.343,"15min":1.3160000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":6.3099999999999996,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":0.996},{"interface":"front","average":{"1min":1.403,"5min":1.2689999999999999,"15min":1.23},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.492}]},{"osd":6,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.389,"15min":1.319},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.452,"15min":1.3819999999999999},"min":{"1min":0.68799999999999994,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":7.7519999999999998,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.458}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":472,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194839,"statfs":{"total":200000000,"available":199516044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1319999999999999,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4890000000000001,"5min":4.7000000000000002,"15min":4.7000000000000002},"last":1.248},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.0429999999999999,"15min":1.0329999999999999},"min":{"1min":0.76500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.444,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.87}]},{"osd":1,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.1719999999999999,"15min":1.1399999999999999},"min":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.2649999999999999,"15min":1.325},"min":{"1min":0.83799999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.1379999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.581,"5min":2,"15min":2},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6699999999999999,"5min":3.5859999999999999,"15min":3.5859999999999999},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2609999999999999,"15min":1.371},"min":{"1min":0.84399999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.647,"5min":4.5220000000000002,"15min":4.5220000000000002},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.3280000000000001,"15min":1.379},"min":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6539999999999999,"5min":4.452,"15min":4.452},"last":1.0640000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2989999999999999,"15min":1.353},"min":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.625,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.341,"15min":1.4690000000000001},"min":{"1min":0.76800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.486,"5min":4.6689999999999996,"15min":4.6689999999999996},"last":1.1899999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4790000000000001,"15min":1.5900000000000001},"min":{"1min":0.621,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.724,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.385,"5min":1.597,"15min":1.7569999999999999},"min":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7589999999999999,"5min":3.681,"15min":3.681},"last":1.5009999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.4470000000000001,"15min":1.5329999999999999},"min":{"1min":0.72599999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7130000000000001,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.583,"15min":1.6240000000000001},"min":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.881,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.4370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194264,"statfs":{"total":200000000,"available":198927184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.141,"15min":1.1240000000000001},"min":{"1min":0.80200000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.109},{"interface":"front","average":{"1min":1.198,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.67600000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.776,"5min":2.641,"15min":2.641},"last":1.3240000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2270000000000001,"15min":1.2430000000000001},"min":{"1min":0.80600000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.534,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.997},{"interface":"front","average":{"1min":1.298,"5min":1.3640000000000001,"15min":1.3740000000000001},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6679999999999999,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":1.4690000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1819999999999999,"15min":1.238},"min":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6220000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1950000000000001,"15min":1.218},"min":{"1min":0.88800000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.466,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.4259999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4099999999999999,"15min":1.47},"min":{"1min":0.83099999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.611,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.373},{"interface":"front","average":{"1min":1.327,"5min":1.3540000000000001,"15min":1.4379999999999999},"min":{"1min":1.0049999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5549999999999999,"5min":2.754,"15min":2.754},"last":1.726}]},{"osd":4,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.4059999999999999,"15min":1.512},"min":{"1min":0.79700000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6779999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.4950000000000001,"15min":1.6140000000000001},"min":{"1min":0.85999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.708,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.272}]},{"osd":6,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4099999999999999,"15min":1.512},"min":{"1min":0.83999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6539999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.677},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.5209999999999999,"15min":1.677},"min":{"1min":0.97799999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6399999999999999,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":1.516}]},{"osd":7,"last update":"Tue Dec 19 05:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6319999999999999,"15min":1.7330000000000001},"min":{"1min":1.0489999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.546,"15min":1.6180000000000001},"min":{"1min":1.234,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.712,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.8200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194840,"statfs":{"total":200000000,"available":199516948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0209999999999999,"15min":1.01},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5680000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0720000000000001,"15min":1.0609999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4650000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.337}]},{"osd":1,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.548,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.145,"15min":1.0509999999999999},"min":{"1min":0.72399999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.538,"5min":1.694,"15min":1.694},"last":1.044}]},{"osd":2,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1830000000000001,"15min":1.198},"min":{"1min":0.78400000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.675,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2170000000000001,"15min":1.2070000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5580000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1419999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.153,"15min":1.071},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.51},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.29,"15min":1.286},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.819,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.5429999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.639,"5min":1.792,"15min":1.792},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.357,"15min":1.2849999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.712,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.575}]},{"osd":6,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.375,"15min":1.3700000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.411,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7849999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.47}]},{"osd":7,"last update":"Tue Dec 19 05:43:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.411,"15min":1.351},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.623},{"interface":"front","average":{"1min":1.54,"5min":1.4830000000000001,"15min":1.4610000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.6060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.5640000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.83199999999999996,"15min":0.79700000000000004},"min":{"1min":0.435,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.407,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.2989999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.495,"5min":0.442,"15min":0.442},"max":{"1min":1.474,"5min":2.702,"15min":2.702},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.94499999999999995,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.49,"5min":1.619,"15min":1.619},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.96499999999999997,"15min":0.90600000000000003},"min":{"1min":0.55700000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.347},{"interface":"front","average":{"1min":1.139,"5min":1.0920000000000001,"15min":1.052},"min":{"1min":0.54500000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.73699999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6319999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.874},{"interface":"front","average":{"1min":1.276,"5min":1.2909999999999999,"15min":1.2889999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.867,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.171}]},{"osd":5,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.321,"15min":1.3069999999999999},"min":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.718,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.321,"15min":1.333},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.766,"5min":3.0590000000000002,"15min":3.0590000000000002},"last":0.91300000000000003}]},{"osd":6,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77500000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8520000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3169999999999999},"min":{"1min":0.69799999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.738,"5min":2.02,"15min":2.02},"last":1.0700000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:43:00 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3799999999999999,"15min":1.3759999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8260000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.405,"15min":1.417},"min":{"1min":0.748,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.788,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194840,"statfs":{"total":200000000,"available":199517060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.78800000000000003,"15min":0.76000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.024,"5min":0.94899999999999995,"15min":0.90300000000000002},"min":{"1min":0.63600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0469999999999999,"15min":1.036},"min":{"1min":0.65700000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.177,"15min":1.143},"min":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.85399999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.91200000000000003},"min":{"1min":0.73199999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5980000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.115,"15min":1.069},"min":{"1min":0.77600000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.681,"5min":1.704,"15min":1.704},"last":1.2150000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.3009999999999999,"15min":1.2549999999999999},"min":{"1min":1.0509999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.762,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.421},{"interface":"front","average":{"1min":1.345,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":1.034,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.7749999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3}]},{"osd":5,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3089999999999999,"15min":1.27},"min":{"1min":1.119,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8160000000000001,"5min":1.893,"15min":1.893},"last":1.175},{"interface":"front","average":{"1min":1.391,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":0.98799999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.887,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.2430000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3120000000000001,"15min":1.286},"min":{"1min":1.04,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8799999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.121},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.127,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4990000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.4339999999999999,"15min":1.401},"min":{"1min":1.109,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.3149999999999999,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.411,"15min":1.409},"min":{"1min":1.1339999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.994,"5min":2.714,"15min":2.714},"last":1.349}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194264,"statfs":{"total":200000000,"available":198927274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90100000000000002,"15min":0.93600000000000005},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1850000000000001,"5min":2.992,"15min":2.992},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.042},"min":{"1min":0.624,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.704,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.97199999999999998},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2649999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.8200000000000001,"15min":1.3300000000000001},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5469999999999999,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.99099999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.748,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.804,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.234,"15min":1.2330000000000001},"min":{"1min":0.55200000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.915,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.89100000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2589999999999999,"15min":1.198},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6319999999999999,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9079999999999999,"5min":4.306,"15min":4.306},"last":1.456}]},{"osd":5,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3620000000000001,"15min":1.3400000000000001},"min":{"1min":0.82499999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.982,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.401,"15min":1.3540000000000001},"min":{"1min":1.0309999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.97,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.746}]},{"osd":6,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.454,"15min":1.4139999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.129,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.401},{"interface":"front","average":{"1min":1.494,"5min":1.446,"15min":1.4159999999999999},"min":{"1min":0.997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.1320000000000001,"5min":3.75,"15min":3.75},"last":1.6899999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:43:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.575,"15min":1.524},"min":{"1min":1.0229999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.036,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.619,"15min":1.599},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0979999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.304}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517572,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.78100000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3500000000000001,"5min":1.427,"15min":1.427},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":1.837,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.022,"15min":1.042},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6859999999999999,"5min":1.706,"15min":1.706},"last":1.397},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.125,"15min":1.143},"min":{"1min":0.53100000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.651,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.214}]},{"osd":3,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4690000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.0649999999999999,"15min":1.05},"min":{"1min":0.55300000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6120000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.97599999999999998}]},{"osd":4,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1439999999999999,"15min":1.139},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.361},{"interface":"front","average":{"1min":1.3,"5min":1.25,"15min":1.2410000000000001},"min":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5860000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3049999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3160000000000001,"15min":1.304},"min":{"1min":0.78500000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.853,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.284,"15min":1.266},"min":{"1min":0.82199999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.712,"5min":1.879,"15min":1.879},"last":1.54}]},{"osd":6,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.355,"15min":1.3759999999999999},"min":{"1min":0.85699999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7569999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2889999999999999,"15min":1.262},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.8280000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4299999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4099999999999999,"15min":1.4039999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.78700000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7589999999999999,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.643}]}]}],"pool_statfs":[]}} 2023-12-19T05:43:58.701 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:43:58.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:43:58.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.983+0000 7fe352992640 1 Processor -- start 2023-12-19T05:43:58.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.983+0000 7fe352992640 1 -- start start 2023-12-19T05:43:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe352992640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe34c144ef0 0x7fe34c06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe352992640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c15bfe0 con 0x7fe34c06bd10 2023-12-19T05:43:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe352992640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c15c2c0 con 0x7fe34c15ba90 2023-12-19T05:43:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe352992640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c06f9b0 con 0x7fe34c144ef0 2023-12-19T05:43:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe350f2f640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe34c06bd10 0x7fe34c06fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55638/0 (socket says 172.21.15.49:55638) 2023-12-19T05:43:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.985+0000 7fe350f2f640 1 -- 172.21.15.49:0/2130810797 learned_addr learned my addr 172.21.15.49:0/2130810797 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34bfff640 1 --2- 172.21.15.49:0/2130810797 >> v2:172.21.15.115:3300/0 conn(0x7fe34c144ef0 0x7fe34c06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932381029 0 0) 0x7fe34c15bfe0 con 0x7fe34c06bd10 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe334003520 con 0x7fe34c06bd10 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453311145 0 0) 0x7fe34c15c2c0 con 0x7fe34c15ba90 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe34c15bfe0 con 0x7fe34c15ba90 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.986+0000 7fe34bfff640 1 -- 172.21.15.49:0/2130810797 >> v1:172.21.15.115:6789/0 conn(0x7fe34c15ba90 legacy=0x7fe34c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.987+0000 7fe34bfff640 1 -- 172.21.15.49:0/2130810797 >> v1:172.21.15.49:6789/0 conn(0x7fe34c06bd10 legacy=0x7fe34c06fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.987+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248535838 0 0) 0x7fe334003520 con 0x7fe34c06bd10 2023-12-19T05:43:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.987+0000 7fe34bfff640 1 -- 172.21.15.49:0/2130810797 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c15c5a0 con 0x7fe34c144ef0 2023-12-19T05:43:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.988+0000 7fe34bfff640 1 --2- 172.21.15.49:0/2130810797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c144ef0 0x7fe34c06d470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4f5902277c63fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.989+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02f050 con 0x7fe34c144ef0 2023-12-19T05:43:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.989+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c031500 con 0x7fe34c144ef0 2023-12-19T05:43:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.989+0000 7fe34affd640 1 -- 172.21.15.49:0/2130810797 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440019f0 con 0x7fe34c144ef0 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 -- 172.21.15.49:0/2130810797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c144ef0 msgr2=0x7fe34c06d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 --2- 172.21.15.49:0/2130810797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c144ef0 0x7fe34c06d470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02b820 comp rx=0 tx=0).stop 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 -- 172.21.15.49:0/2130810797 shutdown_connections 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 --2- 172.21.15.49:0/2130810797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c144ef0 0x7fe34c06d470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 -- 172.21.15.49:0/2130810797 >> 172.21.15.49:0/2130810797 conn(0x7fe34c0659d0 msgr2=0x7fe34c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 -- 172.21.15.49:0/2130810797 shutdown_connections 2023-12-19T05:43:58.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.990+0000 7fe352992640 1 -- 172.21.15.49:0/2130810797 wait complete. 2023-12-19T05:43:58.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.992+0000 7fe352992640 1 Processor -- start 2023-12-19T05:43:58.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.992+0000 7fe352992640 1 -- start start 2023-12-19T05:43:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c06bd10 0x7fe34c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 0x7fe34c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c15b290 con 0x7fe34c15ba90 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c13c7d0 con 0x7fe34c06bd10 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe352992640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c13cab0 con 0x7fe34c144ef0 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe350f2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe350f2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56250/0 (socket says 172.21.15.49:56250) 2023-12-19T05:43:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.993+0000 7fe350f2f640 1 -- 172.21.15.49:0/3300735144 learned_addr learned my addr 172.21.15.49:0/3300735144 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe34bfff640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c06bd10 0x7fe34c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe34b7fe640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 0x7fe34c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 -- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 msgr2=0x7fe34c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 0x7fe34c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 -- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c06bd10 msgr2=0x7fe34c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c06bd10 0x7fe34c15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 -- 172.21.15.49:0/3300735144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009400 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe34b7fe640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 0x7fe34c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe350f2f640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe344001f70 tx=0x7fe34400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344012400 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.994+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344012560 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.995+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c13cd90 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.995+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440128f0 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.995+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c13d350 con 0x7fe34c15ba90 2023-12-19T05:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.996+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c13d570 con 0x7fe34c15ba90 2023-12-19T05:43:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.997+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe344012a50 con 0x7fe34c15ba90 2023-12-19T05:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.998+0000 7fe348ff9640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 0x7fe33806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.998+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe344089160 con 0x7fe34c15ba90 2023-12-19T05:43:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:58.999+0000 7fe34bfff640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 0x7fe33806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.000+0000 7fe34bfff640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 0x7fe33806c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe33c035000 tx=0x7fe33c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:59.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.002+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3440546d0 con 0x7fe34c15ba90 2023-12-19T05:43:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.261+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe34c061910 con 0x7fe34c15ba90 2023-12-19T05:43:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.268+0000 7fe348ff9640 1 -- 172.21.15.49:0/3300735144 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe344057cf0 con 0x7fe34c15ba90 2023-12-19T05:43:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 msgr2=0x7fe33806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 0x7fe33806c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe33c035000 tx=0x7fe33c008030 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 msgr2=0x7fe34c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe344001f70 tx=0x7fe34400a430 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 shutdown_connections 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe33806a430 0x7fe33806c8f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe34c144ef0 0x7fe34c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe34c15ba90 0x7fe34c0ac8b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 --2- 172.21.15.49:0/3300735144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe34c06bd10 0x7fe34c15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 >> 172.21.15.49:0/3300735144 conn(0x7fe34c0659d0 msgr2=0x7fe34c070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 shutdown_connections 2023-12-19T05:43:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.271+0000 7fe352992640 1 -- 172.21.15.49:0/3300735144 wait complete. 2023-12-19T05:43:59.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:43:59.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.514+0000 7f5cf10b6640 1 Processor -- start 2023-12-19T05:43:59.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.514+0000 7f5cf10b6640 1 -- start start 2023-12-19T05:43:59.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf10b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15b1e0 0x7f5cec15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf10b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5cec15a8a0 0x7f5cec15b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf10b6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec06b520 con 0x7f5cec159f80 2023-12-19T05:43:59.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf10b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec0b2b20 con 0x7f5cec15a8a0 2023-12-19T05:43:59.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf10b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b2fb0 con 0x7f5cec15b1e0 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cf08b5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5cec15a8a0 0x7f5cec15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cebfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5cec159f80 0x7f5cec06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55640/0 (socket says 172.21.15.49:55640) 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5cebfff640 1 -- 172.21.15.49:0/2201571392 learned_addr learned my addr 172.21.15.49:0/2201571392 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.516+0000 7f5ceb7fe640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15b1e0 0x7f5cec15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5ceaffd640 1 -- 172.21.15.49:0/2201571392 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189166348 0 0) 0x7f5cec06b520 con 0x7f5cec159f80 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5ceaffd640 1 -- 172.21.15.49:0/2201571392 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd4003520 con 0x7f5cec159f80 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5cf08b5640 1 -- 172.21.15.49:0/2201571392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15b1e0 msgr2=0x7f5cec15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5cf08b5640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15b1e0 0x7f5cec15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5cf08b5640 1 -- 172.21.15.49:0/2201571392 >> v1:172.21.15.49:6789/0 conn(0x7f5cec159f80 legacy=0x7f5cec06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.517+0000 7f5cf08b5640 1 -- 172.21.15.49:0/2201571392 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0b1f10 con 0x7f5cec15a8a0 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.518+0000 7f5cf08b5640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec15a8a0 0x7f5cec15b770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009d90 tx=0x7f5ce402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84d97637ae97e18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.518+0000 7f5ceaffd640 1 -- 172.21.15.49:0/2201571392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce402cce0 con 0x7f5cec15a8a0 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.518+0000 7f5ceaffd640 1 -- 172.21.15.49:0/2201571392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce402ce40 con 0x7f5cec15a8a0 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.518+0000 7f5ceaffd640 1 -- 172.21.15.49:0/2201571392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4034660 con 0x7f5cec15a8a0 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 -- 172.21.15.49:0/2201571392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec15a8a0 msgr2=0x7f5cec15b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec15a8a0 0x7f5cec15b770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009d90 tx=0x7f5ce402bf30 comp rx=0 tx=0).stop 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 -- 172.21.15.49:0/2201571392 shutdown_connections 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec15a8a0 0x7f5cec15b770 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/2201571392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15b1e0 0x7f5cec15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 -- 172.21.15.49:0/2201571392 >> 172.21.15.49:0/2201571392 conn(0x7f5cec0b0100 msgr2=0x7f5cec0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:59.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 -- 172.21.15.49:0/2201571392 shutdown_connections 2023-12-19T05:43:59.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.519+0000 7f5cf10b6640 1 -- 172.21.15.49:0/2201571392 wait complete. 2023-12-19T05:43:59.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.521+0000 7f5cf10b6640 1 Processor -- start 2023-12-19T05:43:59.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.521+0000 7f5cf10b6640 1 -- start start 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 0x7f5cec1e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec15b1e0 0x7f5cec1e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec1e3950 con 0x7f5cec159f80 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec1e2d40 con 0x7f5cec15b1e0 2023-12-19T05:43:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cf10b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec1e3020 con 0x7f5cec15a8a0 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56258/0 (socket says 172.21.15.49:56258) 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cebfff640 1 -- 172.21.15.49:0/1499567530 learned_addr learned my addr 172.21.15.49:0/1499567530 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5ceb7fe640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 0x7f5cec1e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.522+0000 7f5cebfff640 1 -- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 msgr2=0x7f5cec1e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cebfff640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 0x7f5cec1e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cebfff640 1 -- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec15b1e0 msgr2=0x7f5cec1e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cebfff640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec15b1e0 0x7f5cec1e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cebfff640 1 -- 172.21.15.49:0/1499567530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009a70 con 0x7f5cec159f80 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5ceb7fe640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 0x7f5cec1e3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cebfff640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c500 tx=0x7f5cdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc005ce0 con 0x7f5cec159f80 2023-12-19T05:43:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc005e40 con 0x7f5cec159f80 2023-12-19T05:43:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc007330 con 0x7f5cec159f80 2023-12-19T05:43:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec1e3300 con 0x7f5cec159f80 2023-12-19T05:43:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.523+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec14b3d0 con 0x7f5cec159f80 2023-12-19T05:43:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.524+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec061910 con 0x7f5cec159f80 2023-12-19T05:43:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.525+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5cdc007550 con 0x7f5cec159f80 2023-12-19T05:43:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.526+0000 7f5ce8ff9640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 0x7f5cd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:43:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.526+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cdc087fd0 con 0x7f5cec159f80 2023-12-19T05:43:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.527+0000 7f5ceb7fe640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 0x7f5cd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:43:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.528+0000 7f5ceb7fe640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 0x7f5cd806c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0006fd0 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:43:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.530+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5cdc053670 con 0x7f5cec159f80 2023-12-19T05:43:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.754+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cec0b0f70 con 0x7f5cec159f80 2023-12-19T05:43:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.755+0000 7f5ce8ff9640 1 -- 172.21.15.49:0/1499567530 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f5cdc017090 con 0x7f5cec159f80 2023-12-19T05:43:59.757 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:43:59.757 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:43:59.757 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:43:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 msgr2=0x7f5cd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 0x7f5cd806c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0006fd0 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2023-12-19T05:43:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 msgr2=0x7f5cec14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:43:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c500 tx=0x7f5cdc00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 shutdown_connections 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5cd806a430 0x7f5cd806c8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cec15a8a0 0x7f5cec1e3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec15b1e0 0x7f5cec1e4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 --2- 172.21.15.49:0/1499567530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cec159f80 0x7f5cec14ae90 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 >> 172.21.15.49:0/1499567530 conn(0x7f5cec0b0100 msgr2=0x7f5cec155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 shutdown_connections 2023-12-19T05:43:59.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:43:59.758+0000 7f5cf10b6640 1 -- 172.21.15.49:0/1499567530 wait complete. 2023-12-19T05:44:00.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:43:53.198175+0000', 'modified': '2023-12-19T05:43:56.700098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6399}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6399': {'gid': 6399, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/3621171871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 3621171871}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 3621171871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:44:00.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:44:00.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T05:44:00.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.419+0000 7fa878d77640 1 Processor -- start 2023-12-19T05:44:00.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.419+0000 7fa878d77640 1 -- start start 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa878d77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa874155460 0x7fa8740b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa878d77640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa87406cc50 0x7fa8740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa878d77640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87415c9c0 con 0x7fa8740b0830 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa878d77640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740b0cb0 con 0x7fa87406cc50 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa878d77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87406d270 con 0x7fa874155460 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa873fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa87406cc50 0x7fa8740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa86bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8740b0830 0x7fa87406c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55652/0 (socket says 172.21.15.49:55652) 2023-12-19T05:44:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.421+0000 7fa86bfff640 1 -- 172.21.15.49:0/1879628647 learned_addr learned my addr 172.21.15.49:0/1879628647 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa8737fe640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa874155460 0x7fa8740b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa872ffd640 1 -- 172.21.15.49:0/1879628647 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504816269 0 0) 0x7fa87415c9c0 con 0x7fa8740b0830 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa872ffd640 1 -- 172.21.15.49:0/1879628647 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa860003520 con 0x7fa8740b0830 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa873fff640 1 -- 172.21.15.49:0/1879628647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa874155460 msgr2=0x7fa8740b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa873fff640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa874155460 0x7fa8740b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa873fff640 1 -- 172.21.15.49:0/1879628647 >> v1:172.21.15.49:6789/0 conn(0x7fa8740b0830 legacy=0x7fa87406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.422+0000 7fa873fff640 1 -- 172.21.15.49:0/1879628647 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87406d550 con 0x7fa87406cc50 2023-12-19T05:44:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.423+0000 7fa873fff640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa87406cc50 0x7fa8740cdcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1ad31b03ca3316 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.424+0000 7fa872ffd640 1 -- 172.21.15.49:0/1879628647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c02cc50 con 0x7fa87406cc50 2023-12-19T05:44:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.424+0000 7fa872ffd640 1 -- 172.21.15.49:0/1879628647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c02cdb0 con 0x7fa87406cc50 2023-12-19T05:44:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.424+0000 7fa872ffd640 1 -- 172.21.15.49:0/1879628647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c034660 con 0x7fa87406cc50 2023-12-19T05:44:00.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.424+0000 7fa878d77640 1 -- 172.21.15.49:0/1879628647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa87406cc50 msgr2=0x7fa8740cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.424+0000 7fa878d77640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa87406cc50 0x7fa8740cdcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c02bea0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 -- 172.21.15.49:0/1879628647 shutdown_connections 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa87406cc50 0x7fa8740cdcf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 --2- 172.21.15.49:0/1879628647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa874155460 0x7fa8740b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 -- 172.21.15.49:0/1879628647 >> 172.21.15.49:0/1879628647 conn(0x7fa8740659a0 msgr2=0x7fa874065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 -- 172.21.15.49:0/1879628647 shutdown_connections 2023-12-19T05:44:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.425+0000 7fa878d77640 1 -- 172.21.15.49:0/1879628647 wait complete. 2023-12-19T05:44:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.426+0000 7fa878d77640 1 Processor -- start 2023-12-19T05:44:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.427+0000 7fa878d77640 1 -- start start 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa87406cc50 0x7fa87413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa874155460 0x7fa874158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741508a0 con 0x7fa8740b0830 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874150b80 con 0x7fa874155460 2023-12-19T05:44:00.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa878d77640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874150e60 con 0x7fa87406cc50 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa86bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa86bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56266/0 (socket says 172.21.15.49:56266) 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa86bfff640 1 -- 172.21.15.49:0/191919631 learned_addr learned my addr 172.21.15.49:0/191919631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa8737fe640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa87406cc50 0x7fa87413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.428+0000 7fa873fff640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa874155460 0x7fa874158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 -- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa87406cc50 msgr2=0x7fa87413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa87406cc50 0x7fa87413ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 -- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa874155460 msgr2=0x7fa874158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa874155460 0x7fa874158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 -- 172.21.15.49:0/191919631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009a70 con 0x7fa8740b0830 2023-12-19T05:44:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa86bfff640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c500 tx=0x7fa85c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa870ff9640 1 -- 172.21.15.49:0/191919631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c005ce0 con 0x7fa8740b0830 2023-12-19T05:44:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa874151140 con 0x7fa8740b0830 2023-12-19T05:44:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa870ff9640 1 -- 172.21.15.49:0/191919631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c005e40 con 0x7fa8740b0830 2023-12-19T05:44:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa870ff9640 1 -- 172.21.15.49:0/191919631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c007330 con 0x7fa8740b0830 2023-12-19T05:44:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.429+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8741404b0 con 0x7fa8740b0830 2023-12-19T05:44:00.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.432+0000 7fa870ff9640 1 -- 172.21.15.49:0/191919631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa85c007550 con 0x7fa8740b0830 2023-12-19T05:44:00.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.433+0000 7fa870ff9640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 0x7fa85406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.433+0000 7fa870ff9640 1 -- 172.21.15.49:0/191919631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa85c088120 con 0x7fa8740b0830 2023-12-19T05:44:00.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.433+0000 7fa8737fe640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 0x7fa85406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.433+0000 7fa87cc28740 1 Processor -- start 2023-12-19T05:44:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.434+0000 7fa87cc28740 1 -- start start 2023-12-19T05:44:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.434+0000 7fa8737fe640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 0x7fa85406c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa864006fd0 tx=0x7fa864008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 0x559aadb33180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb09a90 0x559aadb336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aada75f80 con 0x559aadb35f10 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aada73710 con 0x559aadb05e90 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aada6f000 con 0x559aadb09a90 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56278/0 (socket says 172.21.15.49:56278) 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 -- 172.21.15.49:0/2187089246 learned_addr learned my addr 172.21.15.49:0/2187089246 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa86bfff640 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 0x559aadb33180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 -- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb09a90 msgr2=0x559aadb336c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb09a90 0x559aadb336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 -- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 msgr2=0x559aadb33180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.435+0000 7fa8737fe640 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 0x559aadb33180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa8737fe640 1 -- 172.21.15.49:0/2187089246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aada36690 con 0x559aadb35f10 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa86bfff640 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 0x559aadb33180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa8737fe640 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa86400fa20 tx=0x7fa864012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b017b097063ba30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa8697fa640 1 -- 172.21.15.49:0/2187089246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864014be0 con 0x559aadb35f10 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa8697fa640 1 -- 172.21.15.49:0/2187089246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864019070 con 0x559aadb35f10 2023-12-19T05:44:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.436+0000 7fa8697fa640 1 -- 172.21.15.49:0/2187089246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864020440 con 0x559aadb35f10 2023-12-19T05:44:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 -- 172.21.15.49:0/2187089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 msgr2=0x559aadb362f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa86400fa20 tx=0x7fa864012000 comp rx=0 tx=0).stop 2023-12-19T05:44:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 -- 172.21.15.49:0/2187089246 shutdown_connections 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb09a90 0x559aadb336c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb05e90 0x559aadb33180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 --2- 172.21.15.49:0/2187089246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb35f10 0x559aadb362f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 -- 172.21.15.49:0/2187089246 >> 172.21.15.49:0/2187089246 conn(0x559aadb081a0 msgr2=0x559aadb50d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 -- 172.21.15.49:0/2187089246 shutdown_connections 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.437+0000 7fa87cc28740 1 -- 172.21.15.49:0/2187089246 wait complete. 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.438+0000 7fa87cc28740 1 -- start start 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.438+0000 7fa87cc28740 1 Processor -- start 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb2fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadb2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aada107d0 con 0x559aadb09a90 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aada10470 con 0x559aadb35f10 2023-12-19T05:44:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aad7d6f20 con 0x559aadb37a90 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa87cc28740 10 client.0 _ll_register_callbacks cb 0x559aada5f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56290/0 (socket says 172.21.15.49:56290) 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.439+0000 7fa8737fe640 1 -- 172.21.15.49:0/271240757 learned_addr learned my addr 172.21.15.49:0/271240757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa86bfff640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb2fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 -- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 msgr2=0x559aadb2a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa873fff640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadb2a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadb2a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 -- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 msgr2=0x559aadb2fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb2fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 -- 172.21.15.49:0/271240757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86400e040 con 0x559aadb09a90 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8737fe640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa8640206f0 tx=0x7fa864004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98938d971c1d9ab2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8527fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.440+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864020ce0 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa864020e40 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559aada99550 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa864015410 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 10 client.6531 fetch_fsmap learned FSMap version 40 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x559aada6d680 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aada99550 con 0x559aadb09a90 2023-12-19T05:44:00.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa864015570 con 0x559aadb09a90 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 10 client.6531 fetch_fsmap finished waiting for FSMap version 40 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 10 client.6531 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 20 client.6531 populate_metadata read hostname 'smithi049' 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb2d970 0x559aadb38920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 4 client.6531 mds_command: new command op to 6399 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.441+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 --> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559aada61b50 con 0x559aadb2d970 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.442+0000 7fa86bfff640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb2d970 0x559aadb38920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.443+0000 7fa86bfff640 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb2d970 0x559aadb38920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38958165dc6f56d3 server_cookie=bae3439d514df0eb in_seq=0 out_seq=0 2023-12-19T05:44:00.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.443+0000 7fa8527fc640 10 client.6531 ms_handle_connect on v2:172.21.15.115:6835/3621171871 2023-12-19T05:44:00.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa8527fc640 1 -- 172.21.15.49:0/271240757 <== mds.0 v2:172.21.15.115:6835/3621171871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559aada61b50 con 0x559aadb2d970 2023-12-19T05:44:00.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa8527fc640 10 client.6531 handle_command_reply: tid=0 2023-12-19T05:44:00.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 client.6531 shutdown 2023-12-19T05:44:00.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 msgr2=0x559aadb537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa8640206f0 tx=0x7fa864004730 comp rx=0 tx=0).stop 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 shutdown_connections 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb2d970 0x559aadb38920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadb2a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb2fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa8527fc640 0 client.6531 ms_handle_reset on v2:172.21.15.115:6835/3621171871 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 --2- 172.21.15.49:0/271240757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb537a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 >> 172.21.15.49:0/271240757 conn(0x559aadb05e90 msgr2=0x559aadb0a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 shutdown_connections 2023-12-19T05:44:00.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.445+0000 7fa87cc28740 1 -- 172.21.15.49:0/271240757 wait complete. 2023-12-19T05:44:00.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.446+0000 7fa87cc28740 20 client.6531 trim_cache size 0 max 16384 2023-12-19T05:44:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.462+0000 7fa87cc28740 1 Processor -- start 2023-12-19T05:44:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.462+0000 7fa87cc28740 1 -- start start 2023-12-19T05:44:00.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb334e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadbae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadb2bbe0 con 0x559aadb09a90 2023-12-19T05:44:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadb0c5d0 con 0x559aadb35f10 2023-12-19T05:44:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aadb2b910 con 0x559aadb37a90 2023-12-19T05:44:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56296/0 (socket says 172.21.15.49:56296) 2023-12-19T05:44:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa8737fe640 1 -- 172.21.15.49:0/159341295 learned_addr learned my addr 172.21.15.49:0/159341295 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa8737fe640 1 -- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 msgr2=0x559aadbae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.463+0000 7fa8737fe640 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadbae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa8737fe640 1 -- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 msgr2=0x559aadb334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa8737fe640 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa8737fe640 1 -- 172.21.15.49:0/159341295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aada0f9e0 con 0x559aadb09a90 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa8737fe640 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa864004770 tx=0x7fa86402d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e3a45b32ebde95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa869ffb640 1 -- 172.21.15.49:0/159341295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864020720 con 0x559aadb09a90 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa869ffb640 1 -- 172.21.15.49:0/159341295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8640148e0 con 0x559aadb09a90 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.464+0000 7fa869ffb640 1 -- 172.21.15.49:0/159341295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864015a80 con 0x559aadb09a90 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 -- 172.21.15.49:0/159341295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 msgr2=0x559aadb2bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa864004770 tx=0x7fa86402d040 comp rx=0 tx=0).stop 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 -- 172.21.15.49:0/159341295 shutdown_connections 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb37a90 0x559aadbae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb35f10 0x559aadb334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 --2- 172.21.15.49:0/159341295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb09a90 0x559aadb2bd60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 -- 172.21.15.49:0/159341295 >> 172.21.15.49:0/159341295 conn(0x559aadb05e90 msgr2=0x559aadb535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 -- 172.21.15.49:0/159341295 shutdown_connections 2023-12-19T05:44:00.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.465+0000 7fa87cc28740 1 -- 172.21.15.49:0/159341295 wait complete. 2023-12-19T05:44:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.466+0000 7fa87cc28740 1 -- start start 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.466+0000 7fa87cc28740 1 Processor -- start 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 0x559aadb32200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 0x559aadb54230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadb52480 con 0x559aadb37a90 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadbad7a0 con 0x559aadb09a90 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aadb31590 con 0x559aadb35f10 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa87cc28740 10 client.0 _ll_register_callbacks cb 0x7fa86400b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa873fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa873fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56304/0 (socket says 172.21.15.49:56304) 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa873fff640 1 -- 172.21.15.49:0/743510538 learned_addr learned my addr 172.21.15.49:0/743510538 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa86bfff640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 0x559aadb54230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.467+0000 7fa8737fe640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 0x559aadb32200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 -- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 msgr2=0x559aadb54230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 0x559aadb54230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 -- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 msgr2=0x559aadb32200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 0x559aadb32200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 -- 172.21.15.49:0/743510538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aada6d680 con 0x559aadb37a90 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa86bfff640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 0x559aadb54230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:44:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa8737fe640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 0x559aadb32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:44:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa873fff640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa86c037040 tx=0x7fa86c034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc59556d288c888b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa8527fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.468+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c034bf0 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa86c034d50 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa864019070 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa86c003990 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 10 client.6537 fetch_fsmap learned FSMap version 40 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x559aada34ef0 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864019070 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa86c003af0 con 0x559aadb37a90 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 10 client.6537 fetch_fsmap finished waiting for FSMap version 40 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 10 client.6537 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T05:44:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 20 client.6537 populate_metadata read hostname 'smithi049' 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb29a00 0x559aadb29de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 4 client.6537 mds_command: new command op to 6399 tid=0[{"prefix": "status"}] 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.469+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 --> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559aada68080 con 0x559aadb29a00 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.470+0000 7fa8737fe640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb29a00 0x559aadb29de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.471+0000 7fa8737fe640 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb29a00 0x559aadb29de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de9f0871bb5a07a server_cookie=d1bdf5e1d5bf20f6 in_seq=0 out_seq=0 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.471+0000 7fa8527fc640 10 client.6537 ms_handle_connect on v2:172.21.15.115:6835/3621171871 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa8527fc640 1 -- 172.21.15.49:0/743510538 <== mds.0 v2:172.21.15.115:6835/3621171871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559aada68080 con 0x559aadb29a00 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa8527fc640 10 client.6537 handle_command_reply: tid=0 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 client.6537 shutdown 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 msgr2=0x559aadb54770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa86c037040 tx=0x7fa86c034670 comp rx=0 tx=0).stop 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 shutdown_connections 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:6835/3621171871,v1:172.21.15.115:6837/3621171871] conn(0x559aadb29a00 0x559aadb29de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aadb35f10 0x559aadb54230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559aadb37a90 0x559aadb54770 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 --2- 172.21.15.49:0/743510538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aadb09a90 0x559aadb32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa8527fc640 0 client.6537 ms_handle_reset on v2:172.21.15.115:6835/3621171871 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 >> 172.21.15.49:0/743510538 conn(0x559aadb05e90 msgr2=0x559aadb071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 shutdown_connections 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 1 -- 172.21.15.49:0/743510538 wait complete. 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.472+0000 7fa87cc28740 20 client.6537 trim_cache size 0 max 16384 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6399, 2023-12-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.2687650870000002, 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 40, 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.820378249999999 2023-12-19T05:44:00.477 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 msgr2=0x7fa85406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 0x7fa85406c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa864006fd0 tx=0x7fa864008040 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 msgr2=0x7fa8741f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c500 tx=0x7fa85c00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 shutdown_connections 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa85406a430 0x7fa85406c8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa874155460 0x7fa874158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8740b0830 0x7fa8741f1eb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 --2- 172.21.15.49:0/191919631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa87406cc50 0x7fa87413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 >> 172.21.15.49:0/191919631 conn(0x7fa8740659a0 msgr2=0x7fa87406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 shutdown_connections 2023-12-19T05:44:00.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.473+0000 7fa878d77640 1 -- 172.21.15.49:0/191919631 wait complete. 2023-12-19T05:44:00.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:44:00.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.703+0000 7f9da16d7640 1 Processor -- start 2023-12-19T05:44:00.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.703+0000 7f9da16d7640 1 -- start start 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.705+0000 7f9da16d7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d9c146e30 0x7f9d9c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.705+0000 7f9da16d7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.705+0000 7f9da16d7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0d12d0 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.705+0000 7f9da16d7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c147210 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.705+0000 7f9da16d7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0b8330 con 0x7f9d9c146e30 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56312/0 (socket says 172.21.15.49:56312) 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 -- 172.21.15.49:0/2969279478 learned_addr learned my addr 172.21.15.49:0/2969279478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d9bfff640 1 --2- 172.21.15.49:0/2969279478 >> v2:172.21.15.115:3300/0 conn(0x7f9d9c146e30 0x7f9d9c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 -- 172.21.15.49:0/2969279478 >> v2:172.21.15.115:3300/0 conn(0x7f9d9c146e30 msgr2=0x7f9d9c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 --2- 172.21.15.49:0/2969279478 >> v2:172.21.15.115:3300/0 conn(0x7f9d9c146e30 0x7f9d9c0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 -- 172.21.15.49:0/2969279478 >> v1:172.21.15.49:6789/0 conn(0x7f9d9c0d0a90 legacy=0x7f9d9c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d9b7fe640 1 -- 172.21.15.49:0/2969279478 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306262708 0 0) 0x7f9d9c0d12d0 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.706+0000 7f9d93fff640 1 -- 172.21.15.49:0/2969279478 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0d15b0 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.708+0000 7f9d93fff640 1 --2- 172.21.15.49:0/2969279478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b85a0 tx=0x7f9d8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce81ed432dfb42ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.708+0000 7f9d9b7fe640 1 -- 172.21.15.49:0/2969279478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84031870 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.708+0000 7f9d9b7fe640 1 -- 172.21.15.49:0/2969279478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840319d0 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.708+0000 7f9d9b7fe640 1 -- 172.21.15.49:0/2969279478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84031d60 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 -- 172.21.15.49:0/2969279478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0b7ea0 msgr2=0x7f9d9c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 --2- 172.21.15.49:0/2969279478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b85a0 tx=0x7f9d8402b910 comp rx=0 tx=0).stop 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 -- 172.21.15.49:0/2969279478 shutdown_connections 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 --2- 172.21.15.49:0/2969279478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0b7ea0 0x7f9d9c0d0550 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 --2- 172.21.15.49:0/2969279478 >> v2:172.21.15.115:3300/0 conn(0x7f9d9c146e30 0x7f9d9c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 -- 172.21.15.49:0/2969279478 >> 172.21.15.49:0/2969279478 conn(0x7f9d9c0b2990 msgr2=0x7f9d9c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 -- 172.21.15.49:0/2969279478 shutdown_connections 2023-12-19T05:44:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.709+0000 7f9da16d7640 1 -- 172.21.15.49:0/2969279478 wait complete. 2023-12-19T05:44:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.711+0000 7f9da16d7640 1 Processor -- start 2023-12-19T05:44:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.711+0000 7f9da16d7640 1 -- start start 2023-12-19T05:44:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d9c0b7ea0 0x7f9d9c13ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 0x7f9d9c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0cb9b0 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c13b0b0 con 0x7f9d9c146e30 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9da16d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0cada0 con 0x7f9d9c0b7ea0 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56324/0 (socket says 172.21.15.49:56324) 2023-12-19T05:44:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.712+0000 7f9d93fff640 1 -- 172.21.15.49:0/3423145232 learned_addr learned my addr 172.21.15.49:0/3423145232 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d9bfff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d9c0b7ea0 0x7f9d9c13ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9da0ed6640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 0x7f9d9c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 -- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d9c0b7ea0 msgr2=0x7f9d9c13ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d9c0b7ea0 0x7f9d9c13ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 -- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 msgr2=0x7f9d9c0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 0x7f9d9c0ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 -- 172.21.15.49:0/3423145232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840094d0 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9da0ed6640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 0x7f9d9c0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.713+0000 7f9d93fff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9d840090b0 tx=0x7f9d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.714+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84004230 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.714+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840043b0 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.714+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c0cb080 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.714+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84004520 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.714+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c0cb640 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.715+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c0cbb60 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.716+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d84043070 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.717+0000 7f9d997fa640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 0x7f9d7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.717+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d8402d040 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.718+0000 7f9d9bfff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 0x7f9d7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.719+0000 7f9d9bfff640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 0x7f9d7c06c920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c006fd0 tx=0x7f9d8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.722+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d9c0cbb60 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.957+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d9c0cbb60 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.958+0000 7f9d997fa640 1 -- 172.21.15.49:0/3423145232 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9d9c0cbb60 con 0x7f9d9c0d0a90 2023-12-19T05:44:00.959 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 msgr2=0x7f9d7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 0x7f9d7c06c920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c006fd0 tx=0x7f9d8c008040 comp rx=0 tx=0).stop 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 msgr2=0x7f9d9c1d5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9d840090b0 tx=0x7f9d840046c0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 shutdown_connections 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9d7c06a460 0x7f9d7c06c920 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d9c146e30 0x7f9d9c0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d9c0d0a90 0x7f9d9c1d5420 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 --2- 172.21.15.49:0/3423145232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d9c0b7ea0 0x7f9d9c13ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 >> 172.21.15.49:0/3423145232 conn(0x7f9d9c0b2990 msgr2=0x7f9d9c0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 shutdown_connections 2023-12-19T05:44:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:00.960+0000 7f9da16d7640 1 -- 172.21.15.49:0/3423145232 wait complete. 2023-12-19T05:44:00.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:44:00.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:44:00.981 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:44:00.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:44:00.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:44:00.982 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:44:00.982 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:44:00.982 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:44:00.982 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:44:00.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:00.982 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:44:01.039 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:44:01.039 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:01.040 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42052sec preferred_lft 42052sec 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:01.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:44:01.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:01.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.043 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:44:01.149 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:44:01.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.154 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:44:01.211 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:44:01.211 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:44:01.211 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:44:01.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:44:01.211 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:44:01.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:44:01.213 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:44:01.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.418 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:44:01.472 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:44:01.473 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:44:01.474 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:44:01.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:44:01.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:44:01.582 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:44:01.641 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:44:01.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:44:01.641 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:44:01.693 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:44:01.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:01.841 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:01.841 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:44:01.877 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:01.877 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:44:01.877 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:44:01.877 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:44:01.877 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:44:01.880 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:44:01.880 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:44:01.880 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:44:01.880 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:44:01.880 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:44:01.884 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:44:01.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:44:01.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:01.976 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:44:02.056 INFO:teuthology.orchestra.run.smithi049.stdout:client6549 2023-12-19T05:44:02.056 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:44:02.057 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:02.120 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:44:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.352+0000 7f95f8d3d640 1 Processor -- start 2023-12-19T05:44:02.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.352+0000 7f95f8d3d640 1 -- start start 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f8d3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f4146e30 0x7f95f40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f8d3d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95f40d0c60 0x7f95f415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f8d3d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40b8300 con 0x7f95f40b7ea0 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f8d3d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f4147210 con 0x7f95f40d0c60 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f8d3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40d10d0 con 0x7f95f4146e30 2023-12-19T05:44:02.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95f40d0c60 0x7f95f415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95f40d0c60 0x7f95f415d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56328/0 (socket says 172.21.15.49:56328) 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f3fff640 1 -- 172.21.15.49:0/1367081631 learned_addr learned my addr 172.21.15.49:0/1367081631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.354+0000 7f95f37fe640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f4146e30 0x7f95f40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.355+0000 7f95f3fff640 1 -- 172.21.15.49:0/1367081631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f4146e30 msgr2=0x7f95f40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.355+0000 7f95f3fff640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f4146e30 0x7f95f40b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.355+0000 7f95f3fff640 1 -- 172.21.15.49:0/1367081631 >> v1:172.21.15.49:6789/0 conn(0x7f95f40b7ea0 legacy=0x7f95f40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.355+0000 7f95f2ffd640 1 -- 172.21.15.49:0/1367081631 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944776594 0 0) 0x7f95f40b8300 con 0x7f95f40b7ea0 2023-12-19T05:44:02.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.355+0000 7f95f3fff640 1 -- 172.21.15.49:0/1367081631 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40d12d0 con 0x7f95f40d0c60 2023-12-19T05:44:02.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.356+0000 7f95f3fff640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40d0c60 0x7f95f415d870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009e50 tx=0x7f95ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca79cdea5b97e577 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:02.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.356+0000 7f95f2ffd640 1 -- 172.21.15.49:0/1367081631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec02ca70 con 0x7f95f40d0c60 2023-12-19T05:44:02.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.356+0000 7f95f2ffd640 1 -- 172.21.15.49:0/1367081631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec02cbd0 con 0x7f95f40d0c60 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.356+0000 7f95f2ffd640 1 -- 172.21.15.49:0/1367081631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0343f0 con 0x7f95f40d0c60 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 -- 172.21.15.49:0/1367081631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40d0c60 msgr2=0x7f95f415d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40d0c60 0x7f95f415d870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009e50 tx=0x7f95ec02bed0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 -- 172.21.15.49:0/1367081631 shutdown_connections 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40d0c60 0x7f95f415d870 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/1367081631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f4146e30 0x7f95f40b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 -- 172.21.15.49:0/1367081631 >> 172.21.15.49:0/1367081631 conn(0x7f95f40b2990 msgr2=0x7f95f40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 -- 172.21.15.49:0/1367081631 shutdown_connections 2023-12-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.357+0000 7f95f8d3d640 1 -- 172.21.15.49:0/1367081631 wait complete. 2023-12-19T05:44:02.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.359+0000 7f95f8d3d640 1 Processor -- start 2023-12-19T05:44:02.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.359+0000 7f95f8d3d640 1 -- start start 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f40d0c60 0x7f95f413b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f4146e30 0x7f95f41e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f413f6c0 con 0x7f95f40b7ea0 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f413f390 con 0x7f95f4146e30 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f8d3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f413e0f0 con 0x7f95f40d0c60 2023-12-19T05:44:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.360+0000 7f95f37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56340/0 (socket says 172.21.15.49:56340) 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 -- 172.21.15.49:0/871988304 learned_addr learned my addr 172.21.15.49:0/871988304 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95ebfff640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f40d0c60 0x7f95f413b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f3fff640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f4146e30 0x7f95f41e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 -- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f40d0c60 msgr2=0x7f95f413b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f40d0c60 0x7f95f413b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 -- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f4146e30 msgr2=0x7f95f41e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f4146e30 0x7f95f41e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 -- 172.21.15.49:0/871988304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009b30 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.361+0000 7f95f37fe640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f95e400d800 tx=0x7f95e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.362+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400b6c0 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.362+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400b820 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.362+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400bbb0 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.362+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f413e3d0 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.362+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f413bab0 con 0x7f95f40b7ea0 2023-12-19T05:44:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.363+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f4061910 con 0x7f95f40b7ea0 2023-12-19T05:44:02.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.364+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95e400bd10 con 0x7f95f40b7ea0 2023-12-19T05:44:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.365+0000 7f95f0ff9640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 0x7f95d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.365+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95e4088e70 con 0x7f95f40b7ea0 2023-12-19T05:44:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.365+0000 7f95ebfff640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 0x7f95d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:02.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.367+0000 7f95ebfff640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 0x7f95d406c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f95dc007fd0 tx=0x7f95dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:02.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.369+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95e4054450 con 0x7f95f40b7ea0 2023-12-19T05:44:02.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.603+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95f4145b90 con 0x7f95f40b7ea0 2023-12-19T05:44:02.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.604+0000 7f95f0ff9640 1 -- 172.21.15.49:0/871988304 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f95e4057a70 con 0x7f95f40b7ea0 2023-12-19T05:44:02.605 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 msgr2=0x7f95d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 0x7f95d406c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f95dc007fd0 tx=0x7f95dc009040 comp rx=0 tx=0).stop 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 msgr2=0x7f95f413ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f95e400d800 tx=0x7f95e400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 shutdown_connections 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f95d406a430 0x7f95d406c8f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f40d0c60 0x7f95f413b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f4146e30 0x7f95f41e5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 --2- 172.21.15.49:0/871988304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f40b7ea0 0x7f95f413ab00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:02.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 >> 172.21.15.49:0/871988304 conn(0x7f95f40b2990 msgr2=0x7f95f40b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:02.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 shutdown_connections 2023-12-19T05:44:02.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:02.607+0000 7f95f8d3d640 1 -- 172.21.15.49:0/871988304 wait complete. 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:44:02.627 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:44:02.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:02.628 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:44:02.685 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:44:02.686 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42067sec preferred_lft 42067sec 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:44:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:44:02.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:02.688 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:44:02.774 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:44:02.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:02.778 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:44:02.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:44:02.827 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:44:03.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:03.000 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:44:03.050 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:44:03.050 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:44:03.051 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:44:03.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:03.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:44:03.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:44:03.143 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:44:03.194 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:44:03.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:44:03.194 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:44:03.243 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:44:03.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:03.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:03.378 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:03.379 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:44:03.415 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:44:03.416 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:44:03.416 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:44:03.416 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:44:03.416 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:44:03.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:44:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:44:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:44:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:44:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:44:03.422 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:44:03.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:03.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:44:03.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:03.499 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:44:03.555 INFO:teuthology.orchestra.run.smithi115.stdout:client6561 2023-12-19T05:44:03.556 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:44:03.556 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:03.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:44:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.847+0000 7ff509bb5640 1 Processor -- start 2023-12-19T05:44:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.847+0000 7ff509bb5640 1 -- start start 2023-12-19T05:44:03.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff509bb5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5040b0b50 0x7ff50406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff509bb5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff50406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff509bb5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50406bb30 con 0x7ff5041449e0 2023-12-19T05:44:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff509bb5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040b0070 con 0x7ff5040b0b50 2023-12-19T05:44:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff509bb5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b0350 con 0x7ff50406b590 2023-12-19T05:44:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff5037fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5041449e0 0x7ff5040af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55690/0 (socket says 172.21.15.49:55690) 2023-12-19T05:44:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.849+0000 7ff5037fe640 1 -- 172.21.15.49:0/3499081997 learned_addr learned my addr 172.21.15.49:0/3499081997 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff503fff640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff50406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469947197 0 0) 0x7ff50406bb30 con 0x7ff5041449e0 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3499081997 >> v2:172.21.15.115:3300/0 conn(0x7ff5040b0b50 0x7ff50406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0003520 con 0x7ff5041449e0 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3842282 0 0) 0x7ff4f0003520 con 0x7ff5041449e0 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 msgr2=0x7ff50406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff50406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 >> v2:172.21.15.115:3300/0 conn(0x7ff5040b0b50 msgr2=0x7ff50406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 --2- 172.21.15.49:0/3499081997 >> v2:172.21.15.115:3300/0 conn(0x7ff5040b0b50 0x7ff50406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040b0630 con 0x7ff5041449e0 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff4f4001670 con 0x7ff5041449e0 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 >> v1:172.21.15.49:6789/0 conn(0x7ff5041449e0 legacy=0x7ff5040af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f00039e0 0x7ff4f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff4f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff4f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b0070 con 0x7ff4f00047c0 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b0350 con 0x7ff4f00039e0 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.850+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f000ba60 con 0x7ff50406b590 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff4f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff503fff640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff4f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff5037fe640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f00039e0 0x7ff4f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 -- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 msgr2=0x7ff4f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50406b590 0x7ff4f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 -- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f00039e0 msgr2=0x7ff4f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4f00039e0 0x7ff4f0003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.851+0000 7ff4faffd640 1 -- 172.21.15.49:0/3499081997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0003520 con 0x7ff4f00047c0 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.852+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff4f0004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00ba00 tx=0x7ff4f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3388e83ff4a274e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec032630 con 0x7ff4f00047c0 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec032790 con 0x7ff4f00047c0 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff502ffd640 1 -- 172.21.15.49:0/3499081997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec032b20 con 0x7ff4f00047c0 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 -- 172.21.15.49:0/3499081997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 msgr2=0x7ff4f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3499081997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff4f0004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00ba00 tx=0x7ff4f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff503fff640 1 -- 172.21.15.49:0/3499081997 reap_dead start 2023-12-19T05:44:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 -- 172.21.15.49:0/3499081997 shutdown_connections 2023-12-19T05:44:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 -- 172.21.15.49:0/3499081997 >> 172.21.15.49:0/3499081997 conn(0x7ff5040cbb70 msgr2=0x7ff5040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 -- 172.21.15.49:0/3499081997 shutdown_connections 2023-12-19T05:44:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.853+0000 7ff509bb5640 1 -- 172.21.15.49:0/3499081997 wait complete. 2023-12-19T05:44:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.855+0000 7ff509bb5640 1 Processor -- start 2023-12-19T05:44:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.855+0000 7ff509bb5640 1 -- start start 2023-12-19T05:44:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50413ea50 0x7ff50413eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff50415d7a0 0x7ff50415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50413cf70 con 0x7ff4f00047c0 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50413f410 con 0x7ff50415d7a0 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.856+0000 7ff509bb5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50413ad30 con 0x7ff50413ea50 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56346/0 (socket says 172.21.15.49:56346) 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 -- 172.21.15.49:0/3667051667 learned_addr learned my addr 172.21.15.49:0/3667051667 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50413ea50 0x7ff50413eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff503fff640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff50415d7a0 0x7ff50415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 -- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50413ea50 msgr2=0x7ff50413eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50413ea50 0x7ff50413eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 -- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff50415d7a0 msgr2=0x7ff50415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff50415d7a0 0x7ff50415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.857+0000 7ff5037fe640 1 -- 172.21.15.49:0/3667051667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50415e190 con 0x7ff4f00047c0 2023-12-19T05:44:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff5037fe640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400d7a0 tx=0x7ff4f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40072d0 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4007430 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40047e0 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50413c310 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.858+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50413c8b0 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.859+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504061910 con 0x7ff4f00047c0 2023-12-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.860+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4f4004940 con 0x7ff4f00047c0 2023-12-19T05:44:03.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.861+0000 7ff500ff9640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 0x7ff4e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:03.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.861+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4f40880f0 con 0x7ff4f00047c0 2023-12-19T05:44:03.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.862+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 0x7ff4e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.863+0000 7ff4faffd640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 0x7ff4e406c920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00057a0 tx=0x7ff4ec03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:03.866+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4f4057210 con 0x7ff4f00047c0 2023-12-19T05:44:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.097+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5040ae560 con 0x7ff4f00047c0 2023-12-19T05:44:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.098+0000 7ff500ff9640 1 -- 172.21.15.49:0/3667051667 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7ff4f4056da0 con 0x7ff4f00047c0 2023-12-19T05:44:04.100 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:44:04.101 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.101+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 msgr2=0x7ff4e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.101+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 0x7ff4e406c920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00057a0 tx=0x7ff4ec03d040 comp rx=0 tx=0).stop 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.101+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 msgr2=0x7ff50413a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.101+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400d7a0 tx=0x7ff4f400dc60 comp rx=0 tx=0).stop 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 shutdown_connections 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4e406a460 0x7ff4e406c920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff50413ea50 0x7ff50413eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff50415d7a0 0x7ff50415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 --2- 172.21.15.49:0/3667051667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4f00047c0 0x7ff50413a7f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 >> 172.21.15.49:0/3667051667 conn(0x7ff5040cbb70 msgr2=0x7ff5040705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 shutdown_connections 2023-12-19T05:44:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:04.102+0000 7ff509bb5640 1 -- 172.21.15.49:0/3667051667 wait complete. 2023-12-19T05:44:04.123 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-19T05:44:04.362 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":6399,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.142881265,"mdsmap_epoch":40,"osdmap_epoch":90,"osdmap_epoch_barrier":90,"uptime":16.694498578000001} 2023-12-19T05:44:04.363 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 6399, "mdsmap_epoch": 40, "osdmap_epoch": 90, "osdmap_epoch_barrier": 90, "rank_uptime": 11.142881265, "state": "up:active", "uptime": 16.694498578, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:44:04.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:44:04.625 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:44:04.625 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:44:04.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T05:44:04.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"mon_tick_interval":"5"} 2023-12-19T05:44:04.867 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T05:44:04.867 INFO:tasks.cephfs.test_full:pool capacity 557028928, 531MB should be enough to fill it 2023-12-19T05:44:04.867 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:44:04.867 DEBUG:teuthology.orchestra.run.smithi049:> import time 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> import datetime 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> # Write some buffered data through before going full, all should be well 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> print("writing some data through which we expect to succeed") 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> bytes = 0 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T05:44:04.868 DEBUG:teuthology.orchestra.run.smithi049:> # from write 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> full = False 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(531 * 1.1)): 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> raise 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> full = True 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> break 2023-12-19T05:44:04.869 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed successfully") 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> full = True 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> break 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> if n > 531 * 0.9: 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> # Be cautious in the last region where we expect to hit 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(15.0) 2023-12-19T05:44:04.870 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> if not full: 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> # close() should not raise an error because we already caught it in 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> # since then because all IOs got cancelled on the full flag. 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> print("calling close") 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> print("close() did not raise error") 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T05:44:04.871 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:44:08.633 INFO:teuthology.orchestra.run.smithi049.stdout:writing some data through which we expect to succeed 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 1.00 MB 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 2.00 MB 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 3.00 MB 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 4.00 MB 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 5.00 MB 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 6.00 MB 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 7.00 MB 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 8.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 9.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 10.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 11.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 12.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 13.00 MB 2023-12-19T05:44:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 14.00 MB 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 15.00 MB 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 16.00 MB 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 17.00 MB 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 18.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 19.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 20.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 21.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 22.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 23.00 MB 2023-12-19T05:44:08.638 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 24.00 MB 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 25.00 MB 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 26.00 MB 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 27.00 MB 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 28.00 MB 2023-12-19T05:44:08.639 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 29.00 MB 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 30.00 MB 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 31.00 MB 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 32.00 MB 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 33.00 MB 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.640 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 34.00 MB 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 35.00 MB 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 36.00 MB 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 37.00 MB 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 38.00 MB 2023-12-19T05:44:08.641 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 39.00 MB 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 40.00 MB 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 41.00 MB 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 42.00 MB 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.642 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 43.00 MB 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 44.00 MB 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 45.00 MB 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 46.00 MB 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 47.00 MB 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.643 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 48.00 MB 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 49.00 MB 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 50.00 MB 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 51.00 MB 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 52.00 MB 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 53.00 MB 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 54.00 MB 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 55.00 MB 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 56.00 MB 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 57.00 MB 2023-12-19T05:44:08.645 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 58.00 MB 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 59.00 MB 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 60.00 MB 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 61.00 MB 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 62.00 MB 2023-12-19T05:44:08.646 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 63.00 MB 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 64.00 MB 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 65.00 MB 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 66.00 MB 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.647 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 67.00 MB 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 68.00 MB 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 69.00 MB 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 70.00 MB 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 71.00 MB 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.648 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 72.00 MB 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 73.00 MB 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 74.00 MB 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 75.00 MB 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 76.00 MB 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 77.00 MB 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 78.00 MB 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 79.00 MB 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:08.650 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 80.00 MB 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 81.00 MB 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 82.00 MB 2023-12-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 83.00 MB 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 84.00 MB 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 85.00 MB 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 86.00 MB 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.522 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 87.00 MB 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 88.00 MB 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 89.00 MB 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 90.00 MB 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 91.00 MB 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 92.00 MB 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 93.00 MB 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 94.00 MB 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 95.00 MB 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.524 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 96.00 MB 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 97.00 MB 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 98.00 MB 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 99.00 MB 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 100.00 MB 2023-12-19T05:44:09.525 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 101.00 MB 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 102.00 MB 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 103.00 MB 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 104.00 MB 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.526 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 105.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 106.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 107.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 108.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 109.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 110.00 MB 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.527 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 111.00 MB 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 112.00 MB 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 113.00 MB 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 114.00 MB 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 115.00 MB 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.528 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 116.00 MB 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 117.00 MB 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 118.00 MB 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 119.00 MB 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.529 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 120.00 MB 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 121.00 MB 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 122.00 MB 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 123.00 MB 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 124.00 MB 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.530 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 125.00 MB 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 126.00 MB 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 127.00 MB 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 128.00 MB 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 129.00 MB 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 130.00 MB 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 131.00 MB 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 132.00 MB 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 133.00 MB 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 134.00 MB 2023-12-19T05:44:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 135.00 MB 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 136.00 MB 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 137.00 MB 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 138.00 MB 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 139.00 MB 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 140.00 MB 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 141.00 MB 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 142.00 MB 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.534 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 143.00 MB 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 144.00 MB 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 145.00 MB 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 146.00 MB 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.535 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 147.00 MB 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 148.00 MB 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 149.00 MB 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 150.00 MB 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 151.00 MB 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.536 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 152.00 MB 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 153.00 MB 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 154.00 MB 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 155.00 MB 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 156.00 MB 2023-12-19T05:44:09.537 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 157.00 MB 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 158.00 MB 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 159.00 MB 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 160.00 MB 2023-12-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.329 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 161.00 MB 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 162.00 MB 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 163.00 MB 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 164.00 MB 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.330 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 165.00 MB 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 166.00 MB 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 167.00 MB 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 168.00 MB 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.331 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 169.00 MB 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 170.00 MB 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 171.00 MB 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 172.00 MB 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 173.00 MB 2023-12-19T05:44:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 174.00 MB 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 175.00 MB 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 176.00 MB 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 177.00 MB 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 178.00 MB 2023-12-19T05:44:10.333 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 179.00 MB 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 180.00 MB 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 181.00 MB 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 182.00 MB 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 183.00 MB 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.334 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 184.00 MB 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 185.00 MB 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 186.00 MB 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 187.00 MB 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 188.00 MB 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.335 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 189.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 190.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 191.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 192.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 193.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 194.00 MB 2023-12-19T05:44:10.336 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 195.00 MB 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 196.00 MB 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 197.00 MB 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 198.00 MB 2023-12-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 199.00 MB 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 200.00 MB 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 201.00 MB 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 202.00 MB 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 203.00 MB 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.338 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 204.00 MB 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 205.00 MB 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 206.00 MB 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 207.00 MB 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 208.00 MB 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 209.00 MB 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 210.00 MB 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 211.00 MB 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 212.00 MB 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 213.00 MB 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 214.00 MB 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 215.00 MB 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 216.00 MB 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 217.00 MB 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 218.00 MB 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 219.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 220.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 221.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 222.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 223.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 224.00 MB 2023-12-19T05:44:10.342 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 225.00 MB 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 226.00 MB 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 227.00 MB 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 228.00 MB 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 229.00 MB 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.343 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 230.00 MB 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 231.00 MB 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 232.00 MB 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 233.00 MB 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 234.00 MB 2023-12-19T05:44:10.344 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 235.00 MB 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 236.00 MB 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 237.00 MB 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 238.00 MB 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 239.00 MB 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 240.00 MB 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.119 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 241.00 MB 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 242.00 MB 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 243.00 MB 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 244.00 MB 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.120 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 245.00 MB 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 246.00 MB 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 247.00 MB 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 248.00 MB 2023-12-19T05:44:11.121 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 249.00 MB 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 250.00 MB 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 251.00 MB 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 252.00 MB 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 253.00 MB 2023-12-19T05:44:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 254.00 MB 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 255.00 MB 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 256.00 MB 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 257.00 MB 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.123 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 258.00 MB 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 259.00 MB 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 260.00 MB 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 261.00 MB 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 262.00 MB 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 263.00 MB 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 264.00 MB 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 265.00 MB 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 266.00 MB 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 267.00 MB 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 268.00 MB 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 269.00 MB 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 270.00 MB 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 271.00 MB 2023-12-19T05:44:11.126 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 272.00 MB 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 273.00 MB 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 274.00 MB 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 275.00 MB 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.127 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 276.00 MB 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 277.00 MB 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 278.00 MB 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 279.00 MB 2023-12-19T05:44:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 280.00 MB 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 281.00 MB 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 282.00 MB 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 283.00 MB 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 284.00 MB 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 285.00 MB 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 286.00 MB 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 287.00 MB 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.130 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 288.00 MB 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 289.00 MB 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 290.00 MB 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 291.00 MB 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 292.00 MB 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 293.00 MB 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 294.00 MB 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 295.00 MB 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 296.00 MB 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 297.00 MB 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 298.00 MB 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 299.00 MB 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 300.00 MB 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 301.00 MB 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 302.00 MB 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 303.00 MB 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 304.00 MB 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 305.00 MB 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 306.00 MB 2023-12-19T05:44:11.134 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 307.00 MB 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 308.00 MB 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 309.00 MB 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 310.00 MB 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 311.00 MB 2023-12-19T05:44:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 312.00 MB 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 313.00 MB 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 314.00 MB 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 315.00 MB 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 316.00 MB 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.136 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 317.00 MB 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 318.00 MB 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 319.00 MB 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 320.00 MB 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 321.00 MB 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 322.00 MB 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 323.00 MB 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 324.00 MB 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.913 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 325.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 326.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 327.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 328.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 329.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 330.00 MB 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.914 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 331.00 MB 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 332.00 MB 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 333.00 MB 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 334.00 MB 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.915 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 335.00 MB 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 336.00 MB 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.920 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 337.00 MB 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 338.00 MB 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 339.00 MB 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 340.00 MB 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 341.00 MB 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 342.00 MB 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 343.00 MB 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 344.00 MB 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 345.00 MB 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 346.00 MB 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 347.00 MB 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 348.00 MB 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 349.00 MB 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 350.00 MB 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.923 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 351.00 MB 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 352.00 MB 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 353.00 MB 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 354.00 MB 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 355.00 MB 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.924 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 356.00 MB 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 357.00 MB 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 358.00 MB 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 359.00 MB 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 360.00 MB 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.925 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 361.00 MB 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 362.00 MB 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 363.00 MB 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 364.00 MB 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 365.00 MB 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 366.00 MB 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 367.00 MB 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 368.00 MB 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 369.00 MB 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 370.00 MB 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.927 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 371.00 MB 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 372.00 MB 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 373.00 MB 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 374.00 MB 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 375.00 MB 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 376.00 MB 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 377.00 MB 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 378.00 MB 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 379.00 MB 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.929 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 380.00 MB 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 381.00 MB 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 382.00 MB 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 383.00 MB 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 384.00 MB 2023-12-19T05:44:11.930 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 385.00 MB 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 386.00 MB 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 387.00 MB 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 388.00 MB 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.931 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 389.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 390.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 391.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 392.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 393.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 394.00 MB 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 395.00 MB 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 396.00 MB 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 397.00 MB 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 398.00 MB 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 399.00 MB 2023-12-19T05:44:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.934 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.934 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 400.00 MB 2023-12-19T05:44:11.934 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:11.934 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:11.934 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 401.00 MB 2023-12-19T05:44:15.310 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:44:15.308+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-19T05:44:25.273 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:44:25.271+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-19T05:44:26.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:26.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 402.00 MB 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 403.00 MB 2023-12-19T05:44:42.889 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 404.00 MB 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 405.00 MB 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 406.00 MB 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 407.00 MB 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 408.00 MB 2023-12-19T05:44:42.890 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 409.00 MB 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 410.00 MB 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 411.00 MB 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 412.00 MB 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 413.00 MB 2023-12-19T05:44:42.891 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 414.00 MB 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 415.00 MB 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 416.00 MB 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 417.00 MB 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 418.00 MB 2023-12-19T05:44:42.892 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 419.00 MB 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 420.00 MB 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 421.00 MB 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 422.00 MB 2023-12-19T05:44:42.893 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 423.00 MB 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 424.00 MB 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 425.00 MB 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 426.00 MB 2023-12-19T05:44:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 427.00 MB 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 428.00 MB 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 429.00 MB 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 430.00 MB 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 431.00 MB 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.895 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 432.00 MB 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 433.00 MB 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 434.00 MB 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 435.00 MB 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 436.00 MB 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.896 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 437.00 MB 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 438.00 MB 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 439.00 MB 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 440.00 MB 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 441.00 MB 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.897 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 442.00 MB 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 443.00 MB 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 444.00 MB 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 445.00 MB 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 446.00 MB 2023-12-19T05:44:42.898 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 447.00 MB 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 448.00 MB 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 449.00 MB 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 450.00 MB 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 451.00 MB 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.899 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 452.00 MB 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 453.00 MB 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 454.00 MB 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 455.00 MB 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 456.00 MB 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.900 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 457.00 MB 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 458.00 MB 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 459.00 MB 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 460.00 MB 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 461.00 MB 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.901 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 462.00 MB 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 463.00 MB 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 464.00 MB 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 465.00 MB 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 466.00 MB 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 467.00 MB 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 468.00 MB 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 469.00 MB 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 470.00 MB 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 471.00 MB 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 472.00 MB 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 473.00 MB 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 474.00 MB 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 475.00 MB 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 476.00 MB 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 477.00 MB 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 478.00 MB 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 479.00 MB 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 480.00 MB 2023-12-19T05:44:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:44:43.028 INFO:teuthology.orchestra.run.smithi049.stdout:Reached fullness after 480.00 MB 2023-12-19T05:44:43.029 INFO:teuthology.orchestra.run.smithi049.stdout:calling close 2023-12-19T05:44:43.029 INFO:teuthology.orchestra.run.smithi049.stdout:close() did not raise error 2023-12-19T05:44:43.073 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:44:43.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:44:43.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:44:43.340 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:44:43.340 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:44:43.340 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:43.405 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:44:43.405 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:43.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:43.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.695+0000 7f4dba17e640 1 Processor -- start 2023-12-19T05:44:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.696+0000 7f4dba17e640 1 -- start start 2023-12-19T05:44:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.697+0000 7f4dba17e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4db41449e0 0x7f4db40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4dba17e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40afb10 con 0x7f4db406c6b0 2023-12-19T05:44:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4dba17e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db406bb30 con 0x7f4db40b0b50 2023-12-19T05:44:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4dba17e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40b0070 con 0x7f4db41449e0 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4db41449e0 0x7f4db40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4db406c6b0 0x7f4db40b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54090/0 (socket says 172.21.15.49:54090) 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4db41449e0 0x7f4db40af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48912/0 (socket says 172.21.15.49:48912) 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db3fff640 1 -- 172.21.15.49:0/2006955702 learned_addr learned my addr 172.21.15.49:0/2006955702 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db37fe640 1 -- 172.21.15.49:0/2006955702 >> v1:172.21.15.115:6789/0 conn(0x7f4db40b0b50 legacy=0x7f4db406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db37fe640 1 -- 172.21.15.49:0/2006955702 >> v1:172.21.15.49:6789/0 conn(0x7f4db406c6b0 legacy=0x7f4db40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db37fe640 1 -- 172.21.15.49:0/2006955702 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40b0350 con 0x7f4db41449e0 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.698+0000 7f4db27fc640 1 -- 172.21.15.49:0/2006955702 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244367725 0 0) 0x7f4db40afb10 con 0x7f4db406c6b0 2023-12-19T05:44:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4db37fe640 1 --2- 172.21.15.49:0/2006955702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db41449e0 0x7f4db40af5d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009d90 tx=0x7f4da402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2493051e4e1e7d7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4db27fc640 1 -- 172.21.15.49:0/2006955702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da402cc60 con 0x7f4db41449e0 2023-12-19T05:44:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4db27fc640 1 -- 172.21.15.49:0/2006955702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da402cdc0 con 0x7f4db41449e0 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4db27fc640 1 -- 172.21.15.49:0/2006955702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4034660 con 0x7f4db41449e0 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4dba17e640 1 -- 172.21.15.49:0/2006955702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db41449e0 msgr2=0x7f4db40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.700+0000 7f4dba17e640 1 --2- 172.21.15.49:0/2006955702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db41449e0 0x7f4db40af5d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009d90 tx=0x7f4da402beb0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.701+0000 7f4dba17e640 1 -- 172.21.15.49:0/2006955702 shutdown_connections 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.701+0000 7f4dba17e640 1 --2- 172.21.15.49:0/2006955702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db41449e0 0x7f4db40af5d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.701+0000 7f4dba17e640 1 -- 172.21.15.49:0/2006955702 >> 172.21.15.49:0/2006955702 conn(0x7f4db40cbb70 msgr2=0x7f4db40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.701+0000 7f4dba17e640 1 -- 172.21.15.49:0/2006955702 shutdown_connections 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.701+0000 7f4dba17e640 1 -- 172.21.15.49:0/2006955702 wait complete. 2023-12-19T05:44:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.703+0000 7f4dba17e640 1 Processor -- start 2023-12-19T05:44:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.703+0000 7f4dba17e640 1 -- start start 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 0x7f4db41439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4db41449e0 0x7f4db413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db415ad10 con 0x7f4db40b0b50 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40a8880 con 0x7f4db406c6b0 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4dba17e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40a8b60 con 0x7f4db41449e0 2023-12-19T05:44:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48922/0 (socket says 172.21.15.49:48922) 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.704+0000 7f4db2ffd640 1 -- 172.21.15.49:0/1136471006 learned_addr learned my addr 172.21.15.49:0/1136471006 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db3fff640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4db41449e0 0x7f4db413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db37fe640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 0x7f4db41439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 -- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4db41449e0 msgr2=0x7f4db413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4db41449e0 0x7f4db413f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 -- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 msgr2=0x7f4db41439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 0x7f4db41439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009a70 con 0x7f4db40b0b50 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db37fe640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 0x7f4db41439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4db2ffd640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c430 tx=0x7f4d9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011790 con 0x7f4db40b0b50 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c0118f0 con 0x7f4db40b0b50 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011ce0 con 0x7f4db40b0b50 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.705+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db40a8e40 con 0x7f4db40b0b50 2023-12-19T05:44:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.706+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db40a9400 con 0x7f4db40b0b50 2023-12-19T05:44:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.707+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4061910 con 0x7f4db40b0b50 2023-12-19T05:44:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.708+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d9c01c460 con 0x7f4db40b0b50 2023-12-19T05:44:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.709+0000 7f4dabfff640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 0x7f4d9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.709+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d9c0888a0 con 0x7f4db40b0b50 2023-12-19T05:44:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.709+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f4d94071f60 con 0x7f4db40b0b50 2023-12-19T05:44:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.709+0000 7f4db37fe640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 0x7f4d9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.710+0000 7f4db37fe640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 0x7f4d9406c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4da4036000 tx=0x7f4da4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.714+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d9c053e80 con 0x7f4db40b0b50 2023-12-19T05:44:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.911+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4db40ae560 con 0x7f4db40b0b50 2023-12-19T05:44:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.913+0000 7f4dabfff640 1 -- 172.21.15.49:0/1136471006 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16129 (secure 0 0 0) 0x7f4d9c0574a0 con 0x7f4db40b0b50 2023-12-19T05:44:43.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:43.915 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":94,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:17.333495+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 msgr2=0x7f4d9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 0x7f4d9406c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4da4036000 tx=0x7f4da4030000 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 msgr2=0x7f4db4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c430 tx=0x7f4d9c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 shutdown_connections 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d9406a430 0x7f4d9406c8f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4db41449e0 0x7f4db413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4db40b0b50 0x7f4db4153a00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 --2- 172.21.15.49:0/1136471006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4db406c6b0 0x7f4db41439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 >> 172.21.15.49:0/1136471006 conn(0x7f4db40cbb70 msgr2=0x7f4db40cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:43.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 shutdown_connections 2023-12-19T05:44:43.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:43.916+0000 7f4dba17e640 1 -- 172.21.15.49:0/1136471006 wait complete. 2023-12-19T05:44:43.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:43:51.193336+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:43:52.224457+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:44:43.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:44:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.167+0000 7f3f6c30a640 1 Processor -- start 2023-12-19T05:44:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.168+0000 7f3f6c30a640 1 -- start start 2023-12-19T05:44:44.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.169+0000 7f3f6c30a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3f640b2760 0x7f3f640b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.169+0000 7f3f6c30a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.169+0000 7f3f6c30a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6415fde0 con 0x7f3f6415b1d0 2023-12-19T05:44:44.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.169+0000 7f3f6c30a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f640b2400 con 0x7f3f640b2760 2023-12-19T05:44:44.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.169+0000 7f3f6c30a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640cf870 con 0x7f3f640ceea0 2023-12-19T05:44:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.170+0000 7f3f6a8a7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.170+0000 7f3f6a8a7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:35110/0 (socket says 172.21.15.49:35110) 2023-12-19T05:44:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.170+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/880861790 learned_addr learned my addr 172.21.15.49:0/880861790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.170+0000 7f3f698a5640 1 --2- 172.21.15.49:0/880861790 >> v2:172.21.15.115:3300/0 conn(0x7f3f640b2760 0x7f3f640b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.171+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/880861790 >> v2:172.21.15.115:3300/0 conn(0x7f3f640b2760 msgr2=0x7f3f640b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.171+0000 7f3f6a8a7640 1 --2- 172.21.15.49:0/880861790 >> v2:172.21.15.115:3300/0 conn(0x7f3f640b2760 0x7f3f640b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.171+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/880861790 >> v1:172.21.15.115:6789/0 conn(0x7f3f6415b1d0 legacy=0x7f3f6415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.171+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/880861790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640b2bc0 con 0x7f3f640ceea0 2023-12-19T05:44:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.171+0000 7f3f690a4640 1 -- 172.21.15.49:0/880861790 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262346006 0 0) 0x7f3f6415fde0 con 0x7f3f6415b1d0 2023-12-19T05:44:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.172+0000 7f3f6a8a7640 1 --2- 172.21.15.49:0/880861790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009e50 tx=0x7f3f5c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585efbc3264b3242 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f690a4640 1 -- 172.21.15.49:0/880861790 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c02cb00 con 0x7f3f640ceea0 2023-12-19T05:44:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f690a4640 1 -- 172.21.15.49:0/880861790 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c02cc60 con 0x7f3f640ceea0 2023-12-19T05:44:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f690a4640 1 -- 172.21.15.49:0/880861790 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0343f0 con 0x7f3f640ceea0 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 -- 172.21.15.49:0/880861790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 msgr2=0x7f3f640cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/880861790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009e50 tx=0x7f3f5c02bf60 comp rx=0 tx=0).stop 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 -- 172.21.15.49:0/880861790 shutdown_connections 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/880861790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640cf330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/880861790 >> v2:172.21.15.115:3300/0 conn(0x7f3f640b2760 0x7f3f640b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 -- 172.21.15.49:0/880861790 >> 172.21.15.49:0/880861790 conn(0x7f3f64073150 msgr2=0x7f3f640659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.173+0000 7f3f6c30a640 1 -- 172.21.15.49:0/880861790 shutdown_connections 2023-12-19T05:44:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.174+0000 7f3f6c30a640 1 -- 172.21.15.49:0/880861790 wait complete. 2023-12-19T05:44:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.175+0000 7f3f6c30a640 1 Processor -- start 2023-12-19T05:44:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.175+0000 7f3f6c30a640 1 -- start start 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f640b2760 0x7f3f640af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640af2d0 con 0x7f3f6415b1d0 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640b0d40 con 0x7f3f640b2760 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.176+0000 7f3f6c30a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640ae6c0 con 0x7f3f640ceea0 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37386/0 (socket says 172.21.15.49:37386) 2023-12-19T05:44:44.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/2303317904 learned_addr learned my addr 172.21.15.49:0/2303317904 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:44.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a0a6640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f640b2760 0x7f3f640af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f698a5640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 msgr2=0x7f3f640ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f640b2760 msgr2=0x7f3f640af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f640b2760 0x7f3f640af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.177+0000 7f3f6a8a7640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c009b30 con 0x7f3f6415b1d0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f6a8a7640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009e50 tx=0x7f3f5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c009510 con 0x7f3f6415b1d0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c03e450 con 0x7f3f6415b1d0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c03e800 con 0x7f3f6415b1d0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f640ae9a0 con 0x7f3f6415b1d0 2023-12-19T05:44:44.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.178+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640aef60 con 0x7f3f6415b1d0 2023-12-19T05:44:44.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.179+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f640af480 con 0x7f3f6415b1d0 2023-12-19T05:44:44.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.180+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f5c03e960 con 0x7f3f6415b1d0 2023-12-19T05:44:44.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.182+0000 7f3f62ffd640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 0x7f3f5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.182+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f5c0ab640 con 0x7f3f6415b1d0 2023-12-19T05:44:44.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.182+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f3f50071f60 con 0x7f3f6415b1d0 2023-12-19T05:44:44.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.183+0000 7f3f6a0a6640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 0x7f3f5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.183+0000 7f3f6a0a6640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 0x7f3f5006c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000f60 tx=0x7f3f54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.186+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f640af480 con 0x7f3f6415b1d0 2023-12-19T05:44:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.376+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f64061910 con 0x7f3f6415b1d0 2023-12-19T05:44:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.377+0000 7f3f62ffd640 1 -- 172.21.15.49:0/2303317904 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f5c076c20 con 0x7f3f6415b1d0 2023-12-19T05:44:44.378 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:44:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.379+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 msgr2=0x7f3f5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.379+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 0x7f3f5006c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000f60 tx=0x7f3f54009040 comp rx=0 tx=0).stop 2023-12-19T05:44:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.379+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 msgr2=0x7f3f640b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.379+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009e50 tx=0x7f3f5c004a40 comp rx=0 tx=0).stop 2023-12-19T05:44:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 shutdown_connections 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f5006a430 0x7f3f5006c8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f640ceea0 0x7f3f640ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f6415b1d0 0x7f3f640b0800 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 --2- 172.21.15.49:0/2303317904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f640b2760 0x7f3f640af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 >> 172.21.15.49:0/2303317904 conn(0x7f3f64073150 msgr2=0x7f3f64158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 shutdown_connections 2023-12-19T05:44:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.380+0000 7f3f6c30a640 1 -- 172.21.15.49:0/2303317904 wait complete. 2023-12-19T05:44:44.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:44:44.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.630+0000 7fb2f5563640 1 Processor -- start 2023-12-19T05:44:44.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.631+0000 7fb2f5563640 1 -- start start 2023-12-19T05:44:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.632+0000 7fb2f5563640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2f0146e10 0x7fb2f00d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.632+0000 7fb2f5563640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 0x7fb2f00b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2f5563640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f00cd840 con 0x7fb2f00ce110 2023-12-19T05:44:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2f5563640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f00d2430 con 0x7fb2f0146e10 2023-12-19T05:44:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2f5563640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00d2620 con 0x7fb2f00d2b00 2023-12-19T05:44:44.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2ee7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 0x7fb2f00b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2ef7fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb2f00ce110 0x7fb2f00b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:43318/0 (socket says 172.21.15.49:43318) 2023-12-19T05:44:44.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2ef7fe640 1 -- 172.21.15.49:0/311787513 learned_addr learned my addr 172.21.15.49:0/311787513 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:44.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.633+0000 7fb2eeffd640 1 --2- 172.21.15.49:0/311787513 >> v2:172.21.15.115:3300/0 conn(0x7fb2f0146e10 0x7fb2f00d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.634+0000 7fb2ee7fc640 1 -- 172.21.15.49:0/311787513 >> v2:172.21.15.115:3300/0 conn(0x7fb2f0146e10 msgr2=0x7fb2f00d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:44.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.634+0000 7fb2ee7fc640 1 --2- 172.21.15.49:0/311787513 >> v2:172.21.15.115:3300/0 conn(0x7fb2f0146e10 0x7fb2f00d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.634+0000 7fb2ee7fc640 1 -- 172.21.15.49:0/311787513 >> v1:172.21.15.115:6789/0 conn(0x7fb2f00ce110 legacy=0x7fb2f00b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.634+0000 7fb2ee7fc640 1 -- 172.21.15.49:0/311787513 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00b41c0 con 0x7fb2f00d2b00 2023-12-19T05:44:44.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.635+0000 7fb2ee7fc640 1 --2- 172.21.15.49:0/311787513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 0x7fb2f00b6780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097a0 tx=0x7fb2d802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7256d7b77db976f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.636+0000 7fb2edffb640 1 -- 172.21.15.49:0/311787513 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8031830 con 0x7fb2f00d2b00 2023-12-19T05:44:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.636+0000 7fb2edffb640 1 -- 172.21.15.49:0/311787513 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8031990 con 0x7fb2f00d2b00 2023-12-19T05:44:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.636+0000 7fb2edffb640 1 -- 172.21.15.49:0/311787513 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8031d20 con 0x7fb2f00d2b00 2023-12-19T05:44:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.636+0000 7fb2f5563640 1 -- 172.21.15.49:0/311787513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 msgr2=0x7fb2f00b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.636+0000 7fb2f5563640 1 --2- 172.21.15.49:0/311787513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 0x7fb2f00b6780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097a0 tx=0x7fb2d802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 -- 172.21.15.49:0/311787513 shutdown_connections 2023-12-19T05:44:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 --2- 172.21.15.49:0/311787513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00d2b00 0x7fb2f00b6780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 --2- 172.21.15.49:0/311787513 >> v2:172.21.15.115:3300/0 conn(0x7fb2f0146e10 0x7fb2f00d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 -- 172.21.15.49:0/311787513 >> 172.21.15.49:0/311787513 conn(0x7fb2f00b29c0 msgr2=0x7fb2f00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 -- 172.21.15.49:0/311787513 shutdown_connections 2023-12-19T05:44:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.637+0000 7fb2f5563640 1 -- 172.21.15.49:0/311787513 wait complete. 2023-12-19T05:44:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.639+0000 7fb2f5563640 1 Processor -- start 2023-12-19T05:44:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.639+0000 7fb2f5563640 1 -- start start 2023-12-19T05:44:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00ce110 0x7fb2f013cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2f00d2b00 0x7fb2f013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f013f2f0 con 0x7fb2f0146e10 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0140ba0 con 0x7fb2f00d2b00 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2f5563640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f013e430 con 0x7fb2f00ce110 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37396/0 (socket says 172.21.15.49:37396) 2023-12-19T05:44:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.640+0000 7fb2ef7fe640 1 -- 172.21.15.49:0/3566325860 learned_addr learned my addr 172.21.15.49:0/3566325860 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2eeffd640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00ce110 0x7fb2f013cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 -- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00ce110 msgr2=0x7fb2f013cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00ce110 0x7fb2f013cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 -- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2f00d2b00 msgr2=0x7fb2f013d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2f00d2b00 0x7fb2f013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009400 con 0x7fb2f0146e10 2023-12-19T05:44:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2ef7fe640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c420 tx=0x7fb2e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8005ce0 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8005e40 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f013e670 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80072d0 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.641+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f013ec30 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.642+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f013f430 con 0x7fb2f0146e10 2023-12-19T05:44:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.643+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2e80074f0 con 0x7fb2f0146e10 2023-12-19T05:44:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.644+0000 7fb2e77fe640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 0x7fb2d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.645+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2e8087e40 con 0x7fb2f0146e10 2023-12-19T05:44:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.645+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7fb2d0071f60 con 0x7fb2f0146e10 2023-12-19T05:44:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.645+0000 7fb2eeffd640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 0x7fb2d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.646+0000 7fb2eeffd640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 0x7fb2d006c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007380 tx=0x7fb2e000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.649+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2e8017060 con 0x7fb2f0146e10 2023-12-19T05:44:44.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.834+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2f0061910 con 0x7fb2f0146e10 2023-12-19T05:44:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.834+0000 7fb2e77fe640 1 -- 172.21.15.49:0/3566325860 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2f013f430 con 0x7fb2f0146e10 2023-12-19T05:44:44.836 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 msgr2=0x7fb2d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 0x7fb2d006c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007380 tx=0x7fb2e000b040 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 msgr2=0x7fb2f013def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c420 tx=0x7fb2e800c8e0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 shutdown_connections 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb2d006a430 0x7fb2d006c8f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0146e10 0x7fb2f013def0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2f00d2b00 0x7fb2f013d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 --2- 172.21.15.49:0/3566325860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2f00ce110 0x7fb2f013cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.837+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 >> 172.21.15.49:0/3566325860 conn(0x7fb2f00b29c0 msgr2=0x7fb2f0143680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.838+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 shutdown_connections 2023-12-19T05:44:44.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:44.838+0000 7fb2f5563640 1 -- 172.21.15.49:0/3566325860 wait complete. 2023-12-19T05:44:44.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:44:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.085+0000 7f827cef6640 1 Processor -- start 2023-12-19T05:44:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.085+0000 7f827cef6640 1 -- start start 2023-12-19T05:44:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8278141900 0x7f82780afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82780b02a0 0x7f827806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780b0730 con 0x7f8278141900 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827806e220 con 0x7f82780b02a0 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f827cef6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cbea0 con 0x7f827806da30 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f82777fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8278141900 0x7f82780afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f82777fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8278141900 0x7f82780afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37408/0 (socket says 172.21.15.49:37408) 2023-12-19T05:44:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.087+0000 7f82777fe640 1 -- 172.21.15.49:0/2552169149 learned_addr learned my addr 172.21.15.49:0/2552169149 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f8277fff640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f8276ffd640 1 --2- 172.21.15.49:0/2552169149 >> v2:172.21.15.115:3300/0 conn(0x7f82780b02a0 0x7f827806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f82777fe640 1 -- 172.21.15.49:0/2552169149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 msgr2=0x7f82780ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f82777fe640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f82777fe640 1 -- 172.21.15.49:0/2552169149 >> v2:172.21.15.115:3300/0 conn(0x7f82780b02a0 msgr2=0x7f827806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f82777fe640 1 --2- 172.21.15.49:0/2552169149 >> v2:172.21.15.115:3300/0 conn(0x7f82780b02a0 0x7f827806d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.088+0000 7f82777fe640 1 -- 172.21.15.49:0/2552169149 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780cc180 con 0x7f8278141900 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.089+0000 7f82777fe640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8278141900 0x7f82780afd60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f827804eaa0 tx=0x7f826802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6200a80eaa6ca7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.089+0000 7f82767fc640 1 -- 172.21.15.49:0/2552169149 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268031870 con 0x7f8278141900 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.089+0000 7f82767fc640 1 -- 172.21.15.49:0/2552169149 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680319d0 con 0x7f8278141900 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.089+0000 7f82767fc640 1 -- 172.21.15.49:0/2552169149 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268031d60 con 0x7f8278141900 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 -- 172.21.15.49:0/2552169149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8278141900 msgr2=0x7f82780afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8278141900 0x7f82780afd60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f827804eaa0 tx=0x7f826802b910 comp rx=0 tx=0).stop 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 -- 172.21.15.49:0/2552169149 shutdown_connections 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 --2- 172.21.15.49:0/2552169149 >> v2:172.21.15.115:3300/0 conn(0x7f82780b02a0 0x7f827806d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 --2- 172.21.15.49:0/2552169149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8278141900 0x7f82780afd60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 -- 172.21.15.49:0/2552169149 >> 172.21.15.49:0/2552169149 conn(0x7f827806f630 msgr2=0x7f827806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 -- 172.21.15.49:0/2552169149 shutdown_connections 2023-12-19T05:44:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.090+0000 7f827cef6640 1 -- 172.21.15.49:0/2552169149 wait complete. 2023-12-19T05:44:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.092+0000 7f827cef6640 1 Processor -- start 2023-12-19T05:44:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.092+0000 7f827cef6640 1 -- start start 2023-12-19T05:44:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8278141900 0x7f8278153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278159ce0 con 0x7f82780b02a0 2023-12-19T05:44:45.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82781544e0 con 0x7f8278141900 2023-12-19T05:44:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f827cef6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278154aa0 con 0x7f827806da30 2023-12-19T05:44:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f8276ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f8276ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37422/0 (socket says 172.21.15.49:37422) 2023-12-19T05:44:45.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.093+0000 7f8276ffd640 1 -- 172.21.15.49:0/3985219433 learned_addr learned my addr 172.21.15.49:0/3985219433 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8277fff640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8278141900 0x7f8278153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f82777fe640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 -- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 msgr2=0x7f82780ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 -- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8278141900 msgr2=0x7f8278153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8278141900 0x7f8278153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680094d0 con 0x7f82780b02a0 2023-12-19T05:44:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f8276ffd640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c820 tx=0x7f826c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c004220 con 0x7f82780b02a0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c0043a0 con 0x7f82780b02a0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278154290 con 0x7f82780b02a0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.094+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c007a70 con 0x7f82780b02a0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.095+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780ad120 con 0x7f82780b02a0 2023-12-19T05:44:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.096+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780ad310 con 0x7f82780b02a0 2023-12-19T05:44:45.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.097+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f826c007bd0 con 0x7f82780b02a0 2023-12-19T05:44:45.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.097+0000 7f825ffff640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 0x7f826406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.098+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f826c0887c0 con 0x7f82780b02a0 2023-12-19T05:44:45.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.098+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f8264071f60 con 0x7f82780b02a0 2023-12-19T05:44:45.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.098+0000 7f82777fe640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 0x7f826406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.099+0000 7f82777fe640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 0x7f826406c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8268036000 tx=0x7f826803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.101+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f826c01e020 con 0x7f82780b02a0 2023-12-19T05:44:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.294+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8278061910 con 0x7f82780b02a0 2023-12-19T05:44:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.294+0000 7f825ffff640 1 -- 172.21.15.49:0/3985219433 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f826c053d10 con 0x7f82780b02a0 2023-12-19T05:44:45.296 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 msgr2=0x7f826406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 0x7f826406c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8268036000 tx=0x7f826803c040 comp rx=0 tx=0).stop 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 msgr2=0x7f82781597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c820 tx=0x7f826c00cce0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 shutdown_connections 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f826406a430 0x7f826406c8f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8278141900 0x7f8278153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82780b02a0 0x7f82781597a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 --2- 172.21.15.49:0/3985219433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f827806da30 0x7f82780ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 >> 172.21.15.49:0/3985219433 conn(0x7f827806f630 msgr2=0x7f82780ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 shutdown_connections 2023-12-19T05:44:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.297+0000 7f827cef6640 1 -- 172.21.15.49:0/3985219433 wait complete. 2023-12-19T05:44:45.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:44:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.549+0000 7f1569147640 1 Processor -- start 2023-12-19T05:44:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.550+0000 7f1569147640 1 -- start start 2023-12-19T05:44:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.551+0000 7f1569147640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15640b0b50 0x7f156406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.551+0000 7f1569147640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156406bb30 con 0x7f156406b590 2023-12-19T05:44:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f1569147640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640b0070 con 0x7f15641449e0 2023-12-19T05:44:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f1569147640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15640b0350 con 0x7f15640b0b50 2023-12-19T05:44:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f156359e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f156406b590 0x7f15640b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50702/0 (socket says 172.21.15.49:50702) 2023-12-19T05:44:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f156359e640 1 -- 172.21.15.49:0/2381506383 learned_addr learned my addr 172.21.15.49:0/2381506383 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651167396 0 0) 0x7f156406bb30 con 0x7f156406b590 2023-12-19T05:44:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> v2:172.21.15.115:3300/0 conn(0x7f15640b0b50 0x7f156406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.552+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f154c003520 con 0x7f156406b590 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625001981 0 0) 0x7f154c003520 con 0x7f156406b590 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 >> v2:172.21.15.115:3300/0 conn(0x7f15640b0b50 msgr2=0x7f156406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 --2- 172.21.15.49:0/2381506383 >> v2:172.21.15.115:3300/0 conn(0x7f15640b0b50 0x7f156406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 >> v1:172.21.15.115:6789/0 conn(0x7f15641449e0 legacy=0x7f15640af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640b0630 con 0x7f156406b590 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f155c0019f0 con 0x7f156406b590 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 >> v1:172.21.15.49:6789/0 conn(0x7f156406b590 legacy=0x7f15640b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f154c0039e0 0x7f154c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f154c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f154c0051f0 0x7f154c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640b0350 con 0x7f154c0047c0 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c00c150 con 0x7f154c0051f0 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c00c310 con 0x7f154c0039e0 2023-12-19T05:44:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> v2:172.21.15.115:3300/0 conn(0x7f15640b0b50 0x7f156406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.553+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f154c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f1562d9d640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f154c0039e0 0x7f154c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156359e640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f154c0051f0 0x7f154c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156259c640 1 -- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f154c0039e0 msgr2=0x7f154c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f154c0039e0 0x7f154c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156259c640 1 -- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f154c0051f0 msgr2=0x7f154c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f154c0051f0 0x7f154c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156259c640 1 -- 172.21.15.49:0/2381506383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c003520 con 0x7f154c0047c0 2023-12-19T05:44:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.554+0000 7f156359e640 1 -- 172.21.15.49:0/2381506383 reap_dead start 2023-12-19T05:44:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.555+0000 7f156259c640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f154c004c40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f15580098a0 tx=0x7f154c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98a225bb1857c0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.555+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558030630 con 0x7f154c0047c0 2023-12-19T05:44:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.555+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1558030790 con 0x7f154c0047c0 2023-12-19T05:44:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.555+0000 7f1561d9b640 1 -- 172.21.15.49:0/2381506383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558030b00 con 0x7f154c0047c0 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 -- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 msgr2=0x7f154c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f154c004c40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f15580098a0 tx=0x7f154c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 -- 172.21.15.49:0/2381506383 shutdown_connections 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 --2- 172.21.15.49:0/2381506383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f154c004c40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 -- 172.21.15.49:0/2381506383 >> 172.21.15.49:0/2381506383 conn(0x7f15640cbb70 msgr2=0x7f15640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 -- 172.21.15.49:0/2381506383 shutdown_connections 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.556+0000 7f1569147640 1 -- 172.21.15.49:0/2381506383 wait complete. 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.558+0000 7f1569147640 1 Processor -- start 2023-12-19T05:44:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.558+0000 7f1569147640 1 -- start start 2023-12-19T05:44:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 0x7f15640c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 0x7f15640ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156414b0c0 con 0x7f154c0047c0 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c3010 con 0x7f15640c2b90 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1569147640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156414a440 con 0x7f156414cdf0 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1562d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1562d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37450/0 (socket says 172.21.15.49:37450) 2023-12-19T05:44:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.559+0000 7f1562d9d640 1 -- 172.21.15.49:0/601703409 learned_addr learned my addr 172.21.15.49:0/601703409 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f156259c640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 0x7f15640c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f156359e640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 0x7f15640ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 -- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 msgr2=0x7f15640ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 0x7f15640ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 -- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 msgr2=0x7f15640c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 0x7f15640c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156414a720 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f156259c640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 0x7f15640c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f156359e640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 0x7f15640ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1562d9d640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f155400e480 tx=0x7f155400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540052e0 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554005440 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554003810 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.560+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156414aa00 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.561+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156414d270 con 0x7f154c0047c0 2023-12-19T05:44:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.562+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156414b330 con 0x7f154c0047c0 2023-12-19T05:44:45.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.563+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1554003970 con 0x7f154c0047c0 2023-12-19T05:44:45.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.564+0000 7f154b7fe640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 0x7f155006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:45.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.564+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15540886b0 con 0x7f154c0047c0 2023-12-19T05:44:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.564+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f1550071f60 con 0x7f154c0047c0 2023-12-19T05:44:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.564+0000 7f156259c640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 0x7f155006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.565+0000 7f156259c640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 0x7f155006c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1558036000 tx=0x7f1558031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.568+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1554053c90 con 0x7f154c0047c0 2023-12-19T05:44:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.774+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1564061910 con 0x7f154c0047c0 2023-12-19T05:44:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.775+0000 7f154b7fe640 1 -- 172.21.15.49:0/601703409 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v94) v1 ==== 80+0+0 (secure 0 0 0) 0x7f15540572b0 con 0x7f154c0047c0 2023-12-19T05:44:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.777+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 msgr2=0x7f155006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.777+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 0x7f155006c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1558036000 tx=0x7f1558031000 comp rx=0 tx=0).stop 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.777+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 msgr2=0x7f156414ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.777+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f155400e480 tx=0x7f155400e940 comp rx=0 tx=0).stop 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 shutdown_connections 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155006a430 0x7f155006c8f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f156414cdf0 0x7f15640ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15640c2b90 0x7f15640c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 --2- 172.21.15.49:0/601703409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0047c0 0x7f156414ff60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 >> 172.21.15.49:0/601703409 conn(0x7f15640cbb70 msgr2=0x7f15640cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 shutdown_connections 2023-12-19T05:44:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:45.778+0000 7f1569147640 1 -- 172.21.15.49:0/601703409 wait complete. 2023-12-19T05:44:45.797 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:44:45.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:45.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:44:45.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:44:45.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:45.915 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:44:45.974 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:44:45.974 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:46.035 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:44:46.035 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:46.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.340+0000 7f1d534b6640 1 Processor -- start 2023-12-19T05:44:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.340+0000 7f1d534b6640 1 -- start start 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.341+0000 7f1d534b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d4c146e10 0x7f1d4c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d534b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d534b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d534b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0d2430 con 0x7f1d4c0ce110 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d534b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ceae0 con 0x7f1d4c146e10 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d534b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0cd840 con 0x7f1d4c0d2b00 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d51a53640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d51a53640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37452/0 (socket says 172.21.15.49:37452) 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d51a53640 1 -- 172.21.15.49:0/77365204 learned_addr learned my addr 172.21.15.49:0/77365204 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d51252640 1 --2- 172.21.15.49:0/77365204 >> v2:172.21.15.115:3300/0 conn(0x7f1d4c146e10 0x7f1d4c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.342+0000 7f1d50a51640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.343+0000 7f1d51a53640 1 -- 172.21.15.49:0/77365204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 msgr2=0x7f1d4c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.343+0000 7f1d51a53640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.343+0000 7f1d51a53640 1 -- 172.21.15.49:0/77365204 >> v2:172.21.15.115:3300/0 conn(0x7f1d4c146e10 msgr2=0x7f1d4c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.343+0000 7f1d51a53640 1 --2- 172.21.15.49:0/77365204 >> v2:172.21.15.115:3300/0 conn(0x7f1d4c146e10 0x7f1d4c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.343+0000 7f1d51a53640 1 -- 172.21.15.49:0/77365204 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0d2620 con 0x7f1d4c0ce110 2023-12-19T05:44:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.345+0000 7f1d51a53640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0d0720 tx=0x7f1d4402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26909e0a26ad77bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.345+0000 7f1d43fff640 1 -- 172.21.15.49:0/77365204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4402ca80 con 0x7f1d4c0ce110 2023-12-19T05:44:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.345+0000 7f1d43fff640 1 -- 172.21.15.49:0/77365204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4402cbe0 con 0x7f1d4c0ce110 2023-12-19T05:44:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.345+0000 7f1d43fff640 1 -- 172.21.15.49:0/77365204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440343f0 con 0x7f1d4c0ce110 2023-12-19T05:44:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 -- 172.21.15.49:0/77365204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c0ce110 msgr2=0x7f1d4c0ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0d0720 tx=0x7f1d4402bee0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 -- 172.21.15.49:0/77365204 shutdown_connections 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c0ce5a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 --2- 172.21.15.49:0/77365204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 --2- 172.21.15.49:0/77365204 >> v2:172.21.15.115:3300/0 conn(0x7f1d4c146e10 0x7f1d4c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 -- 172.21.15.49:0/77365204 >> 172.21.15.49:0/77365204 conn(0x7f1d4c0b29c0 msgr2=0x7f1d4c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 -- 172.21.15.49:0/77365204 shutdown_connections 2023-12-19T05:44:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.346+0000 7f1d534b6640 1 -- 172.21.15.49:0/77365204 wait complete. 2023-12-19T05:44:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.349+0000 7f1d534b6640 1 Processor -- start 2023-12-19T05:44:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.349+0000 7f1d534b6640 1 -- start start 2023-12-19T05:44:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c1619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15fcb0 con 0x7f1d4c146e10 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15ff50 con 0x7f1d4c0ce110 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.350+0000 7f1d534b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c160230 con 0x7f1d4c0d2b00 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d50a51640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c1619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37454/0 (socket says 172.21.15.49:37454) 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 -- 172.21.15.49:0/1740117768 learned_addr learned my addr 172.21.15.49:0/1740117768 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51252640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 -- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 msgr2=0x7f1d4c1619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c1619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 -- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4c0ce110 msgr2=0x7f1d4c160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.351+0000 7f1d51a53640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009b30 con 0x7f1d4c146e10 2023-12-19T05:44:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.352+0000 7f1d51a53640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009e50 tx=0x7f1d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.353+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44009510 con 0x7f1d4c146e10 2023-12-19T05:44:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.353+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c160510 con 0x7f1d4c146e10 2023-12-19T05:44:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.353+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4403e450 con 0x7f1d4c146e10 2023-12-19T05:44:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.353+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44009510 con 0x7f1d4c146e10 2023-12-19T05:44:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.353+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c15e740 con 0x7f1d4c146e10 2023-12-19T05:44:46.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.355+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c160a30 con 0x7f1d4c146e10 2023-12-19T05:44:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.356+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d4402cd50 con 0x7f1d4c146e10 2023-12-19T05:44:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.357+0000 7f1d41ffb640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 0x7f1d3006c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.357+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d440aaef0 con 0x7f1d4c146e10 2023-12-19T05:44:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.358+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f1d30071ff0 con 0x7f1d4c146e10 2023-12-19T05:44:46.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.358+0000 7f1d51252640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 0x7f1d3006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.360+0000 7f1d51252640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 0x7f1d3006c980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006fd0 tx=0x7f1d48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.363+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d4c160a30 con 0x7f1d4c146e10 2023-12-19T05:44:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.621+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d4c160a30 con 0x7f1d4c146e10 2023-12-19T05:44:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.624+0000 7f1d41ffb640 1 -- 172.21.15.49:0/1740117768 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16129 (secure 0 0 0) 0x7f1d4c160a30 con 0x7f1d4c146e10 2023-12-19T05:44:46.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":94,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:17.333495+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 msgr2=0x7f1d3006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 0x7f1d3006c980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006fd0 tx=0x7f1d48008040 comp rx=0 tx=0).stop 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 msgr2=0x7f1d4c145b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009e50 tx=0x7f1d44004a40 comp rx=0 tx=0).stop 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 shutdown_connections 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d3006a4c0 0x7f1d3006c980 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4c0d2b00 0x7f1d4c1619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d4c146e10 0x7f1d4c145b00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 --2- 172.21.15.49:0/1740117768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4c0ce110 0x7f1d4c160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.627+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 >> 172.21.15.49:0/1740117768 conn(0x7f1d4c0b29c0 msgr2=0x7f1d4c15cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.628+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 shutdown_connections 2023-12-19T05:44:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.628+0000 7f1d534b6640 1 -- 172.21.15.49:0/1740117768 wait complete. 2023-12-19T05:44:46.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:43:51.193336+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:43:52.224457+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:44:46.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:44:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.863+0000 7f2136bc1640 1 Processor -- start 2023-12-19T05:44:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.863+0000 7f2136bc1640 1 -- start start 2023-12-19T05:44:46.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f2136bc1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2130141900 0x7f21300afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f2136bc1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21300b02a0 0x7f213006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f2136bc1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213006e220 con 0x7f213006da30 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f2136bc1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300b0730 con 0x7f21300b02a0 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f2136bc1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300cbea0 con 0x7f2130141900 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f21353be640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21300b02a0 0x7f213006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f21353be640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21300b02a0 0x7f213006d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37466/0 (socket says 172.21.15.49:37466) 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.865+0000 7f21353be640 1 -- 172.21.15.49:0/1767889779 learned_addr learned my addr 172.21.15.49:0/1767889779 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.866+0000 7f2135bbf640 1 --2- 172.21.15.49:0/1767889779 >> v2:172.21.15.115:3300/0 conn(0x7f2130141900 0x7f21300afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.866+0000 7f21353be640 1 -- 172.21.15.49:0/1767889779 >> v2:172.21.15.115:3300/0 conn(0x7f2130141900 msgr2=0x7f21300afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.866+0000 7f21353be640 1 --2- 172.21.15.49:0/1767889779 >> v2:172.21.15.115:3300/0 conn(0x7f2130141900 0x7f21300afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.866+0000 7f21353be640 1 -- 172.21.15.49:0/1767889779 >> v1:172.21.15.49:6789/0 conn(0x7f213006da30 legacy=0x7f21300ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.866+0000 7f21353be640 1 -- 172.21.15.49:0/1767889779 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300cc180 con 0x7f21300b02a0 2023-12-19T05:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.867+0000 7f21353be640 1 --2- 172.21.15.49:0/1767889779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21300b02a0 0x7f213006d4f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2130067480 tx=0x7f212002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d74d6b1edb7d80 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.867+0000 7f2134bbd640 1 -- 172.21.15.49:0/1767889779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120030860 con 0x7f21300b02a0 2023-12-19T05:44:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2134bbd640 1 -- 172.21.15.49:0/1767889779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200309c0 con 0x7f21300b02a0 2023-12-19T05:44:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2134bbd640 1 -- 172.21.15.49:0/1767889779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120030d50 con 0x7f21300b02a0 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 -- 172.21.15.49:0/1767889779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21300b02a0 msgr2=0x7f213006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 --2- 172.21.15.49:0/1767889779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21300b02a0 0x7f213006d4f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2130067480 tx=0x7f212002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 -- 172.21.15.49:0/1767889779 shutdown_connections 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 --2- 172.21.15.49:0/1767889779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21300b02a0 0x7f213006d4f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 --2- 172.21.15.49:0/1767889779 >> v2:172.21.15.115:3300/0 conn(0x7f2130141900 0x7f21300afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 -- 172.21.15.49:0/1767889779 >> 172.21.15.49:0/1767889779 conn(0x7f213006f630 msgr2=0x7f213006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.868+0000 7f2136bc1640 1 -- 172.21.15.49:0/1767889779 shutdown_connections 2023-12-19T05:44:46.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.869+0000 7f2136bc1640 1 -- 172.21.15.49:0/1767889779 wait complete. 2023-12-19T05:44:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.871+0000 7f2136bc1640 1 Processor -- start 2023-12-19T05:44:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.871+0000 7f2136bc1640 1 -- start start 2023-12-19T05:44:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f213006da30 0x7f21301f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21300b02a0 0x7f21300b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301e4b30 con 0x7f2130141900 2023-12-19T05:44:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301f6aa0 con 0x7f213006da30 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.872+0000 7f2136bc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21301e3a90 con 0x7f21300b02a0 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37482/0 (socket says 172.21.15.49:37482) 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 -- 172.21.15.49:0/3816859778 learned_addr learned my addr 172.21.15.49:0/3816859778 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f2135bbf640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f213006da30 0x7f21301f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21353be640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21300b02a0 0x7f21300b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 -- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21300b02a0 msgr2=0x7f21300b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21300b02a0 0x7f21300b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 -- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f213006da30 msgr2=0x7f21301f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f213006da30 0x7f21301f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.873+0000 7f21363c0640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200094d0 con 0x7f2130141900 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f21363c0640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f212800c7a0 tx=0x7f212800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128003b70 con 0x7f2130141900 2023-12-19T05:44:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128003cf0 con 0x7f2130141900 2023-12-19T05:44:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21301e3d70 con 0x7f2130141900 2023-12-19T05:44:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212800aa90 con 0x7f2130141900 2023-12-19T05:44:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.874+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21301e4330 con 0x7f2130141900 2023-12-19T05:44:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.875+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130061910 con 0x7f2130141900 2023-12-19T05:44:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.876+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f212800abf0 con 0x7f2130141900 2023-12-19T05:44:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.877+0000 7f21267fc640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 0x7f211406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.878+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2128088680 con 0x7f2130141900 2023-12-19T05:44:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.878+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f2114071f60 con 0x7f2130141900 2023-12-19T05:44:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.878+0000 7f2135bbf640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 0x7f211406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.879+0000 7f2135bbf640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 0x7f211406c8f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f21300cbe70 tx=0x7f212c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:46.882+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2128003e60 con 0x7f2130141900 2023-12-19T05:44:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.075+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f213015de90 con 0x7f2130141900 2023-12-19T05:44:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.076+0000 7f21267fc640 1 -- 172.21.15.49:0/3816859778 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2128053c70 con 0x7f2130141900 2023-12-19T05:44:47.077 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.078+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 msgr2=0x7f211406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.078+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 0x7f211406c8f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f21300cbe70 tx=0x7f212c009190 comp rx=0 tx=0).stop 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.078+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 msgr2=0x7f21300ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.078+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f212800c7a0 tx=0x7f212800cc60 comp rx=0 tx=0).stop 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 shutdown_connections 2023-12-19T05:44:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f211406a430 0x7f211406c8f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21300b02a0 0x7f21300b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130141900 0x7f21300ac8b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 --2- 172.21.15.49:0/3816859778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f213006da30 0x7f21301f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 >> 172.21.15.49:0/3816859778 conn(0x7f213006f630 msgr2=0x7f213006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 shutdown_connections 2023-12-19T05:44:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.079+0000 7f2136bc1640 1 -- 172.21.15.49:0/3816859778 wait complete. 2023-12-19T05:44:47.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:44:47.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.341+0000 7f313290a640 1 Processor -- start 2023-12-19T05:44:47.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.341+0000 7f313290a640 1 -- start start 2023-12-19T05:44:47.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.342+0000 7f313290a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f312c146e10 0x7f312c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.342+0000 7f313290a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f312c0ce110 0x7f312c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.342+0000 7f313290a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0cd840 con 0x7f312c0d2b00 2023-12-19T05:44:47.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f313290a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0d2430 con 0x7f312c0ce110 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f313290a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0ceac0 con 0x7f312c146e10 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f312c0ce110 0x7f312c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f312c0ce110 0x7f312c0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37484/0 (socket says 172.21.15.49:37484) 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 -- 172.21.15.49:0/259527122 learned_addr learned my addr 172.21.15.49:0/259527122 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f312bfff640 1 --2- 172.21.15.49:0/259527122 >> v2:172.21.15.115:3300/0 conn(0x7f312c146e10 0x7f312c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 -- 172.21.15.49:0/259527122 >> v2:172.21.15.115:3300/0 conn(0x7f312c146e10 msgr2=0x7f312c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 --2- 172.21.15.49:0/259527122 >> v2:172.21.15.115:3300/0 conn(0x7f312c146e10 0x7f312c0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 -- 172.21.15.49:0/259527122 >> v1:172.21.15.49:6789/0 conn(0x7f312c0d2b00 legacy=0x7f312c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.343+0000 7f3130ea7640 1 -- 172.21.15.49:0/259527122 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0b6e90 con 0x7f312c0ce110 2023-12-19T05:44:47.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f3130ea7640 1 --2- 172.21.15.49:0/259527122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c0ce110 0x7f312c0ce580 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f312c0d0720 tx=0x7f312402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fead8136698361 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f312affd640 1 -- 172.21.15.49:0/259527122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124031870 con 0x7f312c0ce110 2023-12-19T05:44:47.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f312affd640 1 -- 172.21.15.49:0/259527122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31240319d0 con 0x7f312c0ce110 2023-12-19T05:44:47.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f312affd640 1 -- 172.21.15.49:0/259527122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124031d60 con 0x7f312c0ce110 2023-12-19T05:44:47.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f313290a640 1 -- 172.21.15.49:0/259527122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c0ce110 msgr2=0x7f312c0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.345+0000 7f313290a640 1 --2- 172.21.15.49:0/259527122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c0ce110 0x7f312c0ce580 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f312c0d0720 tx=0x7f312402b910 comp rx=0 tx=0).stop 2023-12-19T05:44:47.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 -- 172.21.15.49:0/259527122 shutdown_connections 2023-12-19T05:44:47.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 --2- 172.21.15.49:0/259527122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c0ce110 0x7f312c0ce580 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 --2- 172.21.15.49:0/259527122 >> v2:172.21.15.115:3300/0 conn(0x7f312c146e10 0x7f312c0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 -- 172.21.15.49:0/259527122 >> 172.21.15.49:0/259527122 conn(0x7f312c0b29c0 msgr2=0x7f312c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:47.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 -- 172.21.15.49:0/259527122 shutdown_connections 2023-12-19T05:44:47.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.346+0000 7f313290a640 1 -- 172.21.15.49:0/259527122 wait complete. 2023-12-19T05:44:47.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.347+0000 7f313290a640 1 Processor -- start 2023-12-19T05:44:47.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.348+0000 7f313290a640 1 -- start start 2023-12-19T05:44:47.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f312c0ce110 0x7f312c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f312c0d2b00 0x7f312c0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c14e8f0 con 0x7f312c146e10 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1f65d0 con 0x7f312c0d2b00 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f313290a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1f68b0 con 0x7f312c0ce110 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37490/0 (socket says 172.21.15.49:37490) 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 -- 172.21.15.49:0/174174836 learned_addr learned my addr 172.21.15.49:0/174174836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f312bfff640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f312c0ce110 0x7f312c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 -- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f312c0ce110 msgr2=0x7f312c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f312b7fe640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f312c0d2b00 0x7f312c0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f312c0ce110 0x7f312c14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 -- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f312c0d2b00 msgr2=0x7f312c0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f312c0d2b00 0x7f312c0ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.349+0000 7f3130ea7640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240094d0 con 0x7f312c146e10 2023-12-19T05:44:47.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f3130ea7640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f31240097f0 tx=0x7f31240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312403ac60 con 0x7f312c146e10 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312403ade0 con 0x7f312c146e10 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c1f6b90 con 0x7f312c146e10 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124044630 con 0x7f312c146e10 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.350+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c14b910 con 0x7f312c146e10 2023-12-19T05:44:47.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.352+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c061910 con 0x7f312c146e10 2023-12-19T05:44:47.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.353+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f312404d450 con 0x7f312c146e10 2023-12-19T05:44:47.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.354+0000 7f3128ff9640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 0x7f310c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.354+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f312402d040 con 0x7f312c146e10 2023-12-19T05:44:47.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.355+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f310c071f60 con 0x7f312c146e10 2023-12-19T05:44:47.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.355+0000 7f312bfff640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 0x7f310c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.356+0000 7f312bfff640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 0x7f310c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.358+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3124035020 con 0x7f312c146e10 2023-12-19T05:44:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.555+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f312c140a40 con 0x7f312c146e10 2023-12-19T05:44:47.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.556+0000 7f3128ff9640 1 -- 172.21.15.49:0/174174836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f312407c020 con 0x7f312c146e10 2023-12-19T05:44:47.558 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:44:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 msgr2=0x7f310c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 0x7f310c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114008040 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 msgr2=0x7f312c142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f31240097f0 tx=0x7f31240046c0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 shutdown_connections 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310c06a430 0x7f310c06c8f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312c146e10 0x7f312c142000 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f312c0d2b00 0x7f312c0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 --2- 172.21.15.49:0/174174836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f312c0ce110 0x7f312c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 >> 172.21.15.49:0/174174836 conn(0x7f312c0b29c0 msgr2=0x7f312c0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 shutdown_connections 2023-12-19T05:44:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.559+0000 7f313290a640 1 -- 172.21.15.49:0/174174836 wait complete. 2023-12-19T05:44:47.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:44:47.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.819+0000 7fa25be41640 1 Processor -- start 2023-12-19T05:44:47.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.819+0000 7fa25be41640 1 -- start start 2023-12-19T05:44:47.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa25be41640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa2540d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa25be41640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2540b6430 0x7fa25406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa25be41640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25406fed0 con 0x7fa25406fa70 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa25be41640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa254161080 con 0x7fa2540b6430 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa25be41640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254161e70 con 0x7fa254146ff0 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa2593dc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2540b6430 0x7fa25406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa2593dc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2540b6430 0x7fa25406f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37498/0 (socket says 172.21.15.49:37498) 2023-12-19T05:44:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.821+0000 7fa2593dc640 1 -- 172.21.15.49:0/3530382524 learned_addr learned my addr 172.21.15.49:0/3530382524 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.822+0000 7fa259bdd640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa2540d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.822+0000 7fa2593dc640 1 -- 172.21.15.49:0/3530382524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 msgr2=0x7fa2540d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.822+0000 7fa2593dc640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa2540d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.822+0000 7fa2593dc640 1 -- 172.21.15.49:0/3530382524 >> v1:172.21.15.115:6789/0 conn(0x7fa25406fa70 legacy=0x7fa25415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.822+0000 7fa2593dc640 1 -- 172.21.15.49:0/3530382524 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254161260 con 0x7fa2540b6430 2023-12-19T05:44:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.823+0000 7fa2593dc640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2540b6430 0x7fa25406f530 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa248009870 tx=0x7fa24802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be26c00c4b7cb95a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.823+0000 7fa258bdb640 1 -- 172.21.15.49:0/3530382524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248030840 con 0x7fa2540b6430 2023-12-19T05:44:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.823+0000 7fa258bdb640 1 -- 172.21.15.49:0/3530382524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2480309a0 con 0x7fa2540b6430 2023-12-19T05:44:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.823+0000 7fa258bdb640 1 -- 172.21.15.49:0/3530382524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248030d30 con 0x7fa2540b6430 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 -- 172.21.15.49:0/3530382524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2540b6430 msgr2=0x7fa25406f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2540b6430 0x7fa25406f530 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa248009870 tx=0x7fa24802b980 comp rx=0 tx=0).stop 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 -- 172.21.15.49:0/3530382524 shutdown_connections 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2540b6430 0x7fa25406f530 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 --2- 172.21.15.49:0/3530382524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa2540d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 -- 172.21.15.49:0/3530382524 >> 172.21.15.49:0/3530382524 conn(0x7fa2540d3520 msgr2=0x7fa2540d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 -- 172.21.15.49:0/3530382524 shutdown_connections 2023-12-19T05:44:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.824+0000 7fa25be41640 1 -- 172.21.15.49:0/3530382524 wait complete. 2023-12-19T05:44:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.826+0000 7fa25be41640 1 Processor -- start 2023-12-19T05:44:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.826+0000 7fa25be41640 1 -- start start 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2540b6430 0x7fa25413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa254140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540d1fc0 con 0x7fa25406fa70 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540d10d0 con 0x7fa2540b6430 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa25be41640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540d13b0 con 0x7fa254146ff0 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.827+0000 7fa259bdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37502/0 (socket says 172.21.15.49:37502) 2023-12-19T05:44:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 -- 172.21.15.49:0/396543160 learned_addr learned my addr 172.21.15.49:0/396543160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa2593dc640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2540b6430 0x7fa25413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa25a3de640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa254140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 -- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 msgr2=0x7fa254140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa254140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 -- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2540b6430 msgr2=0x7fa25413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2540b6430 0x7fa25413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480094d0 con 0x7fa25406fa70 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.828+0000 7fa259bdd640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa244007e40 tx=0x7fa24400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.829+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244014620 con 0x7fa25406fa70 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.829+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400ee90 con 0x7fa25406fa70 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.829+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2540d1690 con 0x7fa25406fa70 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.829+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440149c0 con 0x7fa25406fa70 2023-12-19T05:44:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.829+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2540d1c50 con 0x7fa25406fa70 2023-12-19T05:44:47.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.830+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254161800 con 0x7fa25406fa70 2023-12-19T05:44:47.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.831+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa244014b20 con 0x7fa25406fa70 2023-12-19T05:44:47.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.832+0000 7fa2527fc640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 0x7fa24006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:47.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.832+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa244089290 con 0x7fa25406fa70 2023-12-19T05:44:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.832+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7fa240071f60 con 0x7fa25406fa70 2023-12-19T05:44:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.833+0000 7fa2593dc640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 0x7fa24006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.834+0000 7fa2593dc640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 0x7fa24006c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa248036000 tx=0x7fa248008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:47.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:47.836+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa254161800 con 0x7fa25406fa70 2023-12-19T05:44:48.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.027+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa254161800 con 0x7fa25406fa70 2023-12-19T05:44:48.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.028+0000 7fa2527fc640 1 -- 172.21.15.49:0/396543160 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa254161800 con 0x7fa25406fa70 2023-12-19T05:44:48.030 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 msgr2=0x7fa24006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 0x7fa24006c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa248036000 tx=0x7fa248008030 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 msgr2=0x7fa2540d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa244007e40 tx=0x7fa24400e4b0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 shutdown_connections 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa24006a430 0x7fa24006c8f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa254146ff0 0x7fa254140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2540b6430 0x7fa25413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 --2- 172.21.15.49:0/396543160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25406fa70 0x7fa2540d2450 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 >> 172.21.15.49:0/396543160 conn(0x7fa2540d3520 msgr2=0x7fa2541451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 shutdown_connections 2023-12-19T05:44:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.031+0000 7fa25be41640 1 -- 172.21.15.49:0/396543160 wait complete. 2023-12-19T05:44:48.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:44:48.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.283+0000 7f107f59e640 1 Processor -- start 2023-12-19T05:44:48.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.284+0000 7f107f59e640 1 -- start start 2023-12-19T05:44:48.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.285+0000 7f107f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1080155460 0x7f10800b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.285+0000 7f107f59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10800b0830 0x7f108006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.285+0000 7f107f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108015c9c0 con 0x7f108006ca80 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.285+0000 7f107f59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800b0cb0 con 0x7f10800b0830 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.285+0000 7f107f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108006d270 con 0x7f1080155460 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.286+0000 7f107e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1080155460 0x7f10800b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.286+0000 7f1077fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10800b0830 0x7f108006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.286+0000 7f107ed9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f108006ca80 0x7f10800cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:43346/0 (socket says 172.21.15.49:43346) 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.286+0000 7f107ed9d640 1 -- 172.21.15.49:0/2220335007 learned_addr learned my addr 172.21.15.49:0/2220335007 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.287+0000 7f1077fff640 1 -- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1080155460 msgr2=0x7f10800b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.287+0000 7f1077fff640 1 --2- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1080155460 0x7f10800b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.287+0000 7f1077fff640 1 -- 172.21.15.49:0/2220335007 >> v1:172.21.15.115:6789/0 conn(0x7f108006ca80 legacy=0x7f10800cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.287+0000 7f1077fff640 1 -- 172.21.15.49:0/2220335007 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108006d550 con 0x7f10800b0830 2023-12-19T05:44:48.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.287+0000 7f107dd9b640 1 -- 172.21.15.49:0/2220335007 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272868867 0 0) 0x7f108015c9c0 con 0x7f108006ca80 2023-12-19T05:44:48.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.288+0000 7f1077fff640 1 --2- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10800b0830 0x7f108006c540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10680097a0 tx=0x7f106802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92037fda7f7225fa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.289+0000 7f107dd9b640 1 -- 172.21.15.49:0/2220335007 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068031830 con 0x7f10800b0830 2023-12-19T05:44:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.289+0000 7f107dd9b640 1 -- 172.21.15.49:0/2220335007 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1068031990 con 0x7f10800b0830 2023-12-19T05:44:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.289+0000 7f107dd9b640 1 -- 172.21.15.49:0/2220335007 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068031d20 con 0x7f10800b0830 2023-12-19T05:44:48.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 -- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10800b0830 msgr2=0x7f108006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 --2- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10800b0830 0x7f108006c540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10680097a0 tx=0x7f106802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 -- 172.21.15.49:0/2220335007 shutdown_connections 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 --2- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10800b0830 0x7f108006c540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 --2- 172.21.15.49:0/2220335007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1080155460 0x7f10800b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 -- 172.21.15.49:0/2220335007 >> 172.21.15.49:0/2220335007 conn(0x7f10800659a0 msgr2=0x7f1080065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 -- 172.21.15.49:0/2220335007 shutdown_connections 2023-12-19T05:44:48.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.290+0000 7f107f59e640 1 -- 172.21.15.49:0/2220335007 wait complete. 2023-12-19T05:44:48.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.292+0000 7f107f59e640 1 Processor -- start 2023-12-19T05:44:48.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.292+0000 7f107f59e640 1 -- start start 2023-12-19T05:44:48.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f108006ca80 0x7f10801468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10800b0830 0x7f1080158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108014ed10 con 0x7f1080155460 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801524c0 con 0x7f108006ca80 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1080151940 con 0x7f10800b0830 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37506/0 (socket says 172.21.15.49:37506) 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107ed9d640 1 -- 172.21.15.49:0/1646415264 learned_addr learned my addr 172.21.15.49:0/1646415264 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f107e59c640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f108006ca80 0x7f10801468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.294+0000 7f1077fff640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10800b0830 0x7f1080158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 -- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10800b0830 msgr2=0x7f1080158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10800b0830 0x7f1080158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 -- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f108006ca80 msgr2=0x7f10801468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f108006ca80 0x7f10801468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009400 con 0x7f1080155460 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f107ed9d640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f107800c7e0 tx=0x7f107800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.295+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800a640 con 0x7f1080155460 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.296+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800a7c0 con 0x7f1080155460 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.296+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800ab70 con 0x7f1080155460 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.296+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1080151c20 con 0x7f1080155460 2023-12-19T05:44:48.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.296+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10801521e0 con 0x7f1080155460 2023-12-19T05:44:48.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.297+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1080061910 con 0x7f1080155460 2023-12-19T05:44:48.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.298+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f107800acd0 con 0x7f1080155460 2023-12-19T05:44:48.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.299+0000 7f1076ffd640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 0x7f106006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:48.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.299+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1078087ef0 con 0x7f1080155460 2023-12-19T05:44:48.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.299+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f1060071f60 con 0x7f1080155460 2023-12-19T05:44:48.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.300+0000 7f107e59c640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 0x7f106006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.301+0000 7f107e59c640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 0x7f106006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1070009aa0 tx=0x7f1070009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.304+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1078018060 con 0x7f1080155460 2023-12-19T05:44:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.515+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1080154250 con 0x7f1080155460 2023-12-19T05:44:48.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.517+0000 7f1076ffd640 1 -- 172.21.15.49:0/1646415264 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v94) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1078053500 con 0x7f1080155460 2023-12-19T05:44:48.518 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:44:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.519+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 msgr2=0x7f106006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.519+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 0x7f106006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1070009aa0 tx=0x7f1070009190 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.519+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 msgr2=0x7f1080153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.519+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f107800c7e0 tx=0x7f107800cca0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 shutdown_connections 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f106006a430 0x7f106006c8f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10800b0830 0x7f1080158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1080155460 0x7f1080153340 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 --2- 172.21.15.49:0/1646415264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f108006ca80 0x7f10801468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 >> 172.21.15.49:0/1646415264 conn(0x7f10800659a0 msgr2=0x7f1080154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 shutdown_connections 2023-12-19T05:44:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:48.520+0000 7f107f59e640 1 -- 172.21.15.49:0/1646415264 wait complete. 2023-12-19T05:44:48.540 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:44:48.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:48.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:44:48.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:44:48.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:44:48.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:44:48.701 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:44:48.747 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:48.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:44:48.812 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:44:48.812 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:44:48.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:44:48.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:44:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.110+0000 7f1cdca56640 1 Processor -- start 2023-12-19T05:44:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.110+0000 7f1cdca56640 1 -- start start 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cdca56640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1cd80b2030 0x7f1cd815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cdca56640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cd80cdbf0 0x7f1cd80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cdca56640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd815ec30 con 0x7f1cd815e5a0 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cdca56640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd815fbc0 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cdca56640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80ce560 con 0x7f1cd80b2030 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cd759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cd80cdbf0 0x7f1cd80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cd759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cd80cdbf0 0x7f1cd80ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37516/0 (socket says 172.21.15.49:37516) 2023-12-19T05:44:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.112+0000 7f1cd759e640 1 -- 172.21.15.49:0/891894630 learned_addr learned my addr 172.21.15.49:0/891894630 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.113+0000 7f1cd659c640 1 --2- 172.21.15.49:0/891894630 >> v2:172.21.15.115:3300/0 conn(0x7f1cd80b2030 0x7f1cd815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.113+0000 7f1cd759e640 1 -- 172.21.15.49:0/891894630 >> v2:172.21.15.115:3300/0 conn(0x7f1cd80b2030 msgr2=0x7f1cd815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.113+0000 7f1cd759e640 1 --2- 172.21.15.49:0/891894630 >> v2:172.21.15.115:3300/0 conn(0x7f1cd80b2030 0x7f1cd815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.113+0000 7f1cd759e640 1 -- 172.21.15.49:0/891894630 >> v1:172.21.15.115:6789/0 conn(0x7f1cd815e5a0 legacy=0x7f1cd80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.113+0000 7f1cd759e640 1 -- 172.21.15.49:0/891894630 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd815e980 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.114+0000 7f1cd759e640 1 --2- 172.21.15.49:0/891894630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80cdbf0 0x7f1cd80ce020 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009e50 tx=0x7f1cd002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbcd932d1bd370e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.115+0000 7f1cd5d9b640 1 -- 172.21.15.49:0/891894630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd002ca80 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.115+0000 7f1cd5d9b640 1 -- 172.21.15.49:0/891894630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd002cbe0 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.115+0000 7f1cd5d9b640 1 -- 172.21.15.49:0/891894630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00343f0 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.115+0000 7f1cdca56640 1 -- 172.21.15.49:0/891894630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80cdbf0 msgr2=0x7f1cd80ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.115+0000 7f1cdca56640 1 --2- 172.21.15.49:0/891894630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80cdbf0 0x7f1cd80ce020 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009e50 tx=0x7f1cd002bee0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 -- 172.21.15.49:0/891894630 shutdown_connections 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 --2- 172.21.15.49:0/891894630 >> v2:172.21.15.115:3300/0 conn(0x7f1cd80b2030 0x7f1cd815f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 --2- 172.21.15.49:0/891894630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80cdbf0 0x7f1cd80ce020 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 -- 172.21.15.49:0/891894630 >> 172.21.15.49:0/891894630 conn(0x7f1cd80b0100 msgr2=0x7f1cd80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 -- 172.21.15.49:0/891894630 shutdown_connections 2023-12-19T05:44:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.116+0000 7f1cdca56640 1 -- 172.21.15.49:0/891894630 wait complete. 2023-12-19T05:44:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.118+0000 7f1cdca56640 1 Processor -- start 2023-12-19T05:44:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.118+0000 7f1cdca56640 1 -- start start 2023-12-19T05:44:49.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cd80cdbf0 0x7f1cd80c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cd815e5a0 0x7f1cd814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd81f2b20 con 0x7f1cd80b2030 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c5080 con 0x7f1cd815e5a0 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cdca56640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c4470 con 0x7f1cd80cdbf0 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37524/0 (socket says 172.21.15.49:37524) 2023-12-19T05:44:49.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.119+0000 7f1cd6d9d640 1 -- 172.21.15.49:0/4195133798 learned_addr learned my addr 172.21.15.49:0/4195133798 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 -- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cd80cdbf0 msgr2=0x7f1cd80c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cd80cdbf0 0x7f1cd80c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd759e640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cd815e5a0 0x7f1cd814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 -- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cd815e5a0 msgr2=0x7f1cd814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cd815e5a0 0x7f1cd814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009b30 con 0x7f1cd80b2030 2023-12-19T05:44:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cd6d9d640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c430 tx=0x7f1cc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8011790 con 0x7f1cd80b2030 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc80118f0 con 0x7f1cd80b2030 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd80c4750 con 0x7f1cd80b2030 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8011ce0 con 0x7f1cd80b2030 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.120+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd80c4d10 con 0x7f1cd80b2030 2023-12-19T05:44:49.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.122+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd8061910 con 0x7f1cd80b2030 2023-12-19T05:44:49.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.123+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cc801c460 con 0x7f1cd80b2030 2023-12-19T05:44:49.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.124+0000 7f1cbf7fe640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 0x7f1cc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.124+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cc80887f0 con 0x7f1cd80b2030 2023-12-19T05:44:49.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.124+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f1cc4071f60 con 0x7f1cd80b2030 2023-12-19T05:44:49.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.125+0000 7f1cd659c640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 0x7f1cc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.126+0000 7f1cd659c640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 0x7f1cc406c8f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006fd0 tx=0x7f1ccc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.129+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cc8053de0 con 0x7f1cd80b2030 2023-12-19T05:44:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.369+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd80ce980 con 0x7f1cd80b2030 2023-12-19T05:44:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.370+0000 7f1cbf7fe640 1 -- 172.21.15.49:0/4195133798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f1cc8057400 con 0x7f1cd80b2030 2023-12-19T05:44:49.372 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:49.372 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:44:49.372 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:44:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 msgr2=0x7f1cc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 0x7f1cc406c8f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006fd0 tx=0x7f1ccc008040 comp rx=0 tx=0).stop 2023-12-19T05:44:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 msgr2=0x7f1cd81f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c430 tx=0x7f1cc800c8f0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 shutdown_connections 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cc406a430 0x7f1cc406c8f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cd80cdbf0 0x7f1cd80c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cd815e5a0 0x7f1cd814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 --2- 172.21.15.49:0/4195133798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cd80b2030 0x7f1cd81f25e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 >> 172.21.15.49:0/4195133798 conn(0x7f1cd80b0100 msgr2=0x7f1cd80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 shutdown_connections 2023-12-19T05:44:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.373+0000 7f1cdca56640 1 -- 172.21.15.49:0/4195133798 wait complete. 2023-12-19T05:44:49.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:49.458 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:44:49.457+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-12-19T05:44:49.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.629+0000 7f558cd8b640 1 Processor -- start 2023-12-19T05:44:49.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.630+0000 7f558cd8b640 1 -- start start 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f558cd8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55880cbab0 0x7f558806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f558cd8b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558806fcf0 con 0x7f5588161c40 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f558cd8b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558806ffd0 con 0x7f5588161860 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f558cd8b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880702b0 con 0x7f55880cbab0 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f5585d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55880cbab0 0x7f558806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f5585d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55880cbab0 0x7f558806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37538/0 (socket says 172.21.15.49:37538) 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f5585d9b640 1 -- 172.21.15.49:0/2590865323 learned_addr learned my addr 172.21.15.49:0/2590865323 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.632+0000 7f5586d9d640 1 --1- 172.21.15.49:0/2590865323 >> v1:172.21.15.49:6789/0 conn(0x7f5588161c40 0x7f55880cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50712/0 (socket says 172.21.15.49:50712) 2023-12-19T05:44:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.633+0000 7f5585d9b640 1 -- 172.21.15.49:0/2590865323 >> v1:172.21.15.115:6789/0 conn(0x7f5588161860 legacy=0x7f55880cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.633+0000 7f5585d9b640 1 -- 172.21.15.49:0/2590865323 >> v1:172.21.15.49:6789/0 conn(0x7f5588161c40 legacy=0x7f55880cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.633+0000 7f5585d9b640 1 -- 172.21.15.49:0/2590865323 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588070590 con 0x7f55880cbab0 2023-12-19T05:44:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.633+0000 7f558559a640 1 -- 172.21.15.49:0/2590865323 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039234293 0 0) 0x7f558806fcf0 con 0x7f5588161c40 2023-12-19T05:44:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.635+0000 7f5585d9b640 1 --2- 172.21.15.49:0/2590865323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55880cbab0 0x7f558806d110 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f557c009870 tx=0x7f557c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc991690dad1118 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.635+0000 7f558559a640 1 -- 172.21.15.49:0/2590865323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c02f840 con 0x7f55880cbab0 2023-12-19T05:44:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.635+0000 7f558559a640 1 -- 172.21.15.49:0/2590865323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c02f9a0 con 0x7f55880cbab0 2023-12-19T05:44:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.635+0000 7f558559a640 1 -- 172.21.15.49:0/2590865323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c02fd30 con 0x7f55880cbab0 2023-12-19T05:44:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 -- 172.21.15.49:0/2590865323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55880cbab0 msgr2=0x7f558806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2590865323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55880cbab0 0x7f558806d110 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f557c009870 tx=0x7f557c02ba20 comp rx=0 tx=0).stop 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 -- 172.21.15.49:0/2590865323 shutdown_connections 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2590865323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55880cbab0 0x7f558806d110 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 -- 172.21.15.49:0/2590865323 >> 172.21.15.49:0/2590865323 conn(0x7f55880b11d0 msgr2=0x7f55880cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 -- 172.21.15.49:0/2590865323 shutdown_connections 2023-12-19T05:44:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.636+0000 7f558cd8b640 1 -- 172.21.15.49:0/2590865323 wait complete. 2023-12-19T05:44:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.638+0000 7f558cd8b640 1 Processor -- start 2023-12-19T05:44:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.638+0000 7f558cd8b640 1 -- start start 2023-12-19T05:44:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 0x7f5588159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 0x7f5588153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588159d10 con 0x7f5588161c40 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881f7430 con 0x7f5588161860 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f558cd8b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588159a30 con 0x7f55880cbab0 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f5586d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f5586d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37544/0 (socket says 172.21.15.49:37544) 2023-12-19T05:44:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.639+0000 7f5586d9d640 1 -- 172.21.15.49:0/2540379038 learned_addr learned my addr 172.21.15.49:0/2540379038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f558659c640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 0x7f5588159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 -- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 msgr2=0x7f5588159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 0x7f5588159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 -- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 msgr2=0x7f5588153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5585d9b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 0x7f5588153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 0x7f5588153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0094d0 con 0x7f5588161c40 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f558659c640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 0x7f5588159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5585d9b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 0x7f5588153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5586d9d640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f558000c700 tx=0x7f558000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000ce10 con 0x7f5588161c40 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558000a640 con 0x7f5588161c40 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000a9f0 con 0x7f5588161c40 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.640+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55881565a0 con 0x7f5588161c40 2023-12-19T05:44:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.641+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588156b60 con 0x7f5588161c40 2023-12-19T05:44:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.642+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5588074770 con 0x7f5588161c40 2023-12-19T05:44:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.643+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f558000ab50 con 0x7f5588161c40 2023-12-19T05:44:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.643+0000 7f5576ffd640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.644+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5580087e40 con 0x7f5588161c40 2023-12-19T05:44:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.644+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=96}) v3 -- 0x7f5568071f60 con 0x7f5588161c40 2023-12-19T05:44:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.644+0000 7f558659c640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.645+0000 7f558659c640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 0x7f556806c8f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5578000f60 tx=0x7f5578009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:49.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.648+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5580053390 con 0x7f5588161c40 2023-12-19T05:44:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.842+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5588156400 con 0x7f5588161c40 2023-12-19T05:44:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.845+0000 7f5576ffd640 1 -- 172.21.15.49:0/2540379038 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f5588156400 con 0x7f5588161c40 2023-12-19T05:44:49.846 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:49.846 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":95,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:49.458201+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 msgr2=0x7f556806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 0x7f556806c8f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5578000f60 tx=0x7f5578009040 comp rx=0 tx=0).stop 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 msgr2=0x7f5588164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f558000c700 tx=0x7f558000cbc0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 shutdown_connections 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5588161c40 0x7f5588164290 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5588161860 0x7f5588153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 --2- 172.21.15.49:0/2540379038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55880cbab0 0x7f5588159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.847+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 >> 172.21.15.49:0/2540379038 conn(0x7f55880b11d0 msgr2=0x7f5588160350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.848+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 shutdown_connections 2023-12-19T05:44:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:49.848+0000 7f558cd8b640 1 -- 172.21.15.49:0/2540379038 wait complete. 2023-12-19T05:44:49.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:43:51.193336+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:43:52.224457+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:44:49.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:44:50.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.086+0000 7f2fe187d640 1 Processor -- start 2023-12-19T05:44:50.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.086+0000 7f2fe187d640 1 -- start start 2023-12-19T05:44:50.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fe187d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fdc0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fe187d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc15da00 con 0x7f2fdc0cce30 2023-12-19T05:44:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fe187d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc15dcc0 con 0x7f2fdc157c30 2023-12-19T05:44:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fe187d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc15e940 con 0x7f2fdc0ad300 2023-12-19T05:44:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fdb7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2fdc0cce30 0x7f2fdc0cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50726/0 (socket says 172.21.15.49:50726) 2023-12-19T05:44:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.088+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/3971953815 learned_addr learned my addr 172.21.15.49:0/3971953815 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fdc0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278259724 0 0) 0x7f2fdc15da00 con 0x7f2fdc0cce30 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc4003520 con 0x7f2fdc0cce30 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711238447 0 0) 0x7f2fc4003520 con 0x7f2fdc0cce30 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 msgr2=0x7f2fdc0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fdc0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 >> v1:172.21.15.115:6789/0 conn(0x7f2fdc157c30 legacy=0x7f2fdc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc15dfa0 con 0x7f2fdc0cce30 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f2fd40019f0 con 0x7f2fdc0cce30 2023-12-19T05:44:50.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.089+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 >> v1:172.21.15.49:6789/0 conn(0x7f2fdc0cce30 legacy=0x7f2fdc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc4003a10 0x7f2fc4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc40047c0 0x7f2fc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fc40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc15e940 con 0x7f2fc40047c0 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc400bb40 con 0x7f2fc4003a10 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc400bd00 con 0x7f2fdc0ad300 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc40047c0 0x7f2fc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fdb7fe640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fc40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fdaffd640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc4003a10 0x7f2fc4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 -- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 msgr2=0x7f2fc40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fc40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 -- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc4003a10 msgr2=0x7f2fc4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc4003a10 0x7f2fc4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fda7fc640 1 -- 172.21.15.49:0/3971953815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4003520 con 0x7f2fc40047c0 2023-12-19T05:44:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fdaffd640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc4003a10 0x7f2fc4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:50.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.090+0000 7f2fdb7fe640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fdc0ad300 0x7f2fc40051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc40047c0 0x7f2fc4004c40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009ac0 tx=0x7f2fc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d7df30b59d9ea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd002c6b0 con 0x7f2fc40047c0 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd002c810 con 0x7f2fc40047c0 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fd9ffb640 1 -- 172.21.15.49:0/3971953815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd002cba0 con 0x7f2fc40047c0 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fe187d640 1 -- 172.21.15.49:0/3971953815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc40047c0 msgr2=0x7f2fc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.092+0000 7f2fe187d640 1 --2- 172.21.15.49:0/3971953815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fc40047c0 0x7f2fc4004c40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009ac0 tx=0x7f2fc40057f0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.093+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/3971953815 reap_dead start 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.093+0000 7f2fe187d640 1 -- 172.21.15.49:0/3971953815 shutdown_connections 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.093+0000 7f2fe187d640 1 -- 172.21.15.49:0/3971953815 >> 172.21.15.49:0/3971953815 conn(0x7f2fdc073150 msgr2=0x7f2fdc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.093+0000 7f2fe187d640 1 -- 172.21.15.49:0/3971953815 shutdown_connections 2023-12-19T05:44:50.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.093+0000 7f2fe187d640 1 -- 172.21.15.49:0/3971953815 wait complete. 2023-12-19T05:44:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.095+0000 7f2fe187d640 1 Processor -- start 2023-12-19T05:44:50.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.095+0000 7f2fe187d640 1 -- start start 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40047c0 0x7f2fdc14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 0x7f2fdc0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc15f3c0 con 0x7f2fdc160650 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc154200 con 0x7f2fdc1601d0 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fe187d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1f3a30 con 0x7f2fc40047c0 2023-12-19T05:44:50.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fdb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fdb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37560/0 (socket says 172.21.15.49:37560) 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/224294176 learned_addr learned my addr 172.21.15.49:0/224294176 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.096+0000 7f2fdaffd640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40047c0 0x7f2fdc14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 0x7f2fdc0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40047c0 msgr2=0x7f2fdc14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40047c0 0x7f2fdc14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 msgr2=0x7f2fdc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 0x7f2fdc0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc1544c0 con 0x7f2fdc160650 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fda7fc640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 0x7f2fdc0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:50.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fdb7fe640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0ce890 tx=0x7f2fd400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400b8d0 con 0x7f2fdc160650 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400ba30 con 0x7f2fdc160650 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc1547a0 con 0x7f2fdc160650 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.097+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400bda0 con 0x7f2fdc160650 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.098+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc154cc0 con 0x7f2fdc160650 2023-12-19T05:44:50.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.099+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc154990 con 0x7f2fdc160650 2023-12-19T05:44:50.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.100+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2fd4007070 con 0x7f2fdc160650 2023-12-19T05:44:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.101+0000 7f2fc3fff640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 0x7f2fc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.101+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fd4088c80 con 0x7f2fdc160650 2023-12-19T05:44:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.101+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=96}) v3 -- 0x7f2fc8071f90 con 0x7f2fdc160650 2023-12-19T05:44:50.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.101+0000 7f2fdaffd640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 0x7f2fc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.102+0000 7f2fdaffd640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 0x7f2fc806c920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000f60 tx=0x7f2fcc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.105+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2fd40541d0 con 0x7f2fdc160650 2023-12-19T05:44:50.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.298+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fdc061910 con 0x7f2fdc160650 2023-12-19T05:44:50.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.299+0000 7f2fc3fff640 1 -- 172.21.15.49:0/224294176 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fd40577f0 con 0x7f2fdc160650 2023-12-19T05:44:50.300 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.301+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 msgr2=0x7f2fc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.301+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 0x7f2fc806c920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000f60 tx=0x7f2fcc009040 comp rx=0 tx=0).stop 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.301+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 msgr2=0x7f2fdc0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.301+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0ce890 tx=0x7f2fd400b0d0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 shutdown_connections 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2fc806a460 0x7f2fc806c920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fdc160650 0x7f2fdc0b0760 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fdc1601d0 0x7f2fdc0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 --2- 172.21.15.49:0/224294176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40047c0 0x7f2fdc14d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 >> 172.21.15.49:0/224294176 conn(0x7f2fdc073150 msgr2=0x7f2fdc0af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:50.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 shutdown_connections 2023-12-19T05:44:50.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.302+0000 7f2fe187d640 1 -- 172.21.15.49:0/224294176 wait complete. 2023-12-19T05:44:50.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:44:50.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.550+0000 7fe8044d5640 1 Processor -- start 2023-12-19T05:44:50.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.550+0000 7fe8044d5640 1 -- start start 2023-12-19T05:44:50.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe8044d5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe8044d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 0x7fe7fc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe8044d5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc06bb30 con 0x7fe7fc1449e0 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe8044d5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0b0070 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe8044d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0b0350 con 0x7fe7fc06b590 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe801a70640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe801a70640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37570/0 (socket says 172.21.15.49:37570) 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.552+0000 7fe801a70640 1 -- 172.21.15.49:0/2619053998 learned_addr learned my addr 172.21.15.49:0/2619053998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe801a70640 1 -- 172.21.15.49:0/2619053998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 msgr2=0x7fe7fc06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe802a72640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 0x7fe7fc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe801a70640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 0x7fe7fc06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe801a70640 1 -- 172.21.15.49:0/2619053998 >> v1:172.21.15.115:6789/0 conn(0x7fe7fc1449e0 legacy=0x7fe7fc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe801a70640 1 -- 172.21.15.49:0/2619053998 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0b0630 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.553+0000 7fe802a72640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 0x7fe7fc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.554+0000 7fe801a70640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009870 tx=0x7fe7ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214bea4ff8d90eee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.554+0000 7fe80126f640 1 -- 172.21.15.49:0/2619053998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec031640 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.554+0000 7fe80126f640 1 -- 172.21.15.49:0/2619053998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0317a0 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.554+0000 7fe80126f640 1 -- 172.21.15.49:0/2619053998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec031b30 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 -- 172.21.15.49:0/2619053998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc0b0b50 msgr2=0x7fe7fc06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009870 tx=0x7fe7ec02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 -- 172.21.15.49:0/2619053998 shutdown_connections 2023-12-19T05:44:50.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc06b590 0x7fe7fc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 --2- 172.21.15.49:0/2619053998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc06bfa0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 -- 172.21.15.49:0/2619053998 >> 172.21.15.49:0/2619053998 conn(0x7fe7fc0cbb70 msgr2=0x7fe7fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:50.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 -- 172.21.15.49:0/2619053998 shutdown_connections 2023-12-19T05:44:50.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.555+0000 7fe8044d5640 1 -- 172.21.15.49:0/2619053998 wait complete. 2023-12-19T05:44:50.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.557+0000 7fe8044d5640 1 Processor -- start 2023-12-19T05:44:50.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.557+0000 7fe8044d5640 1 -- start start 2023-12-19T05:44:50.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc1449e0 0x7fe7fc140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc157a30 con 0x7fe7fc06b590 2023-12-19T05:44:50.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc15bb10 con 0x7fe7fc0b0b50 2023-12-19T05:44:50.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe8044d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc13d460 con 0x7fe7fc1449e0 2023-12-19T05:44:50.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe802271640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe802271640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37574/0 (socket says 172.21.15.49:37574) 2023-12-19T05:44:50.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe802271640 1 -- 172.21.15.49:0/3908601918 learned_addr learned my addr 172.21.15.49:0/3908601918 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe801a70640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.558+0000 7fe802a72640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc1449e0 0x7fe7fc140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 -- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc1449e0 msgr2=0x7fe7fc140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc1449e0 0x7fe7fc140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 -- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 msgr2=0x7fe7fc140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 -- 172.21.15.49:0/3908601918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0094d0 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe801a70640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe802271640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800b3f0 tx=0x7fe7f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8011830 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8011990 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8011d40 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc13d740 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.559+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc13dd00 con 0x7fe7fc06b590 2023-12-19T05:44:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.561+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc0b16d0 con 0x7fe7fc06b590 2023-12-19T05:44:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.562+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe7f801a400 con 0x7fe7fc06b590 2023-12-19T05:44:50.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.563+0000 7fe7f2ffd640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 0x7fe7e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:50.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.563+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7f8088900 con 0x7fe7fc06b590 2023-12-19T05:44:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.564+0000 7fe801a70640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 0x7fe7e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.565+0000 7fe801a70640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 0x7fe7e006c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec036000 tx=0x7fe7ec03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:50.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.568+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe7f8053e50 con 0x7fe7fc06b590 2023-12-19T05:44:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.767+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7fc061910 con 0x7fe7fc06b590 2023-12-19T05:44:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.768+0000 7fe7f2ffd640 1 -- 172.21.15.49:0/3908601918 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7f8057470 con 0x7fe7fc06b590 2023-12-19T05:44:50.769 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 msgr2=0x7fe7e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 0x7fe7e006c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec036000 tx=0x7fe7ec03c040 comp rx=0 tx=0).stop 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 msgr2=0x7fe7fc13eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800b3f0 tx=0x7fe7f800b8b0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 shutdown_connections 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe7e006a430 0x7fe7e006c8f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7fc1449e0 0x7fe7fc140b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7fc0b0b50 0x7fe7fc140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 --2- 172.21.15.49:0/3908601918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7fc06b590 0x7fe7fc13eae0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.770+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 >> 172.21.15.49:0/3908601918 conn(0x7fe7fc0cbb70 msgr2=0x7fe7fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.771+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 shutdown_connections 2023-12-19T05:44:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:50.771+0000 7fe8044d5640 1 -- 172.21.15.49:0/3908601918 wait complete. 2023-12-19T05:44:50.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:44:51.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.031+0000 7ff6dad37640 1 Processor -- start 2023-12-19T05:44:51.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.032+0000 7ff6dad37640 1 -- start start 2023-12-19T05:44:51.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6dad37640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 0x7ff6d406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6dad37640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6d40d1670 0x7ff6d40d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6dad37640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d406fe30 con 0x7ff6d4146cd0 2023-12-19T05:44:51.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6dad37640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d41470b0 con 0x7ff6d40d1670 2023-12-19T05:44:51.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6dad37640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d4070260 con 0x7ff6d406f490 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6da536640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6d40d1670 0x7ff6d40d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6da536640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6d40d1670 0x7ff6d40d1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37590/0 (socket says 172.21.15.49:37590) 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6da536640 1 -- 172.21.15.49:0/715354676 learned_addr learned my addr 172.21.15.49:0/715354676 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.034+0000 7ff6d9534640 1 --2- 172.21.15.49:0/715354676 >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 0x7ff6d406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.035+0000 7ff6da536640 1 -- 172.21.15.49:0/715354676 >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 msgr2=0x7ff6d406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.035+0000 7ff6da536640 1 --2- 172.21.15.49:0/715354676 >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 0x7ff6d406f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.035+0000 7ff6da536640 1 -- 172.21.15.49:0/715354676 >> v1:172.21.15.115:6789/0 conn(0x7ff6d4146cd0 legacy=0x7ff6d40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.035+0000 7ff6da536640 1 -- 172.21.15.49:0/715354676 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40b6ea0 con 0x7ff6d40d1670 2023-12-19T05:44:51.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.035+0000 7ff6d9534640 1 --2- 172.21.15.49:0/715354676 >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 0x7ff6d406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:51.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.036+0000 7ff6da536640 1 --2- 172.21.15.49:0/715354676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d40d1670 0x7ff6d40d1b00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40724b0 tx=0x7ff6cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13815c9b55c8ad1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.036+0000 7ff6d8d33640 1 -- 172.21.15.49:0/715354676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0317e0 con 0x7ff6d40d1670 2023-12-19T05:44:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.036+0000 7ff6d8d33640 1 -- 172.21.15.49:0/715354676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc031940 con 0x7ff6d40d1670 2023-12-19T05:44:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.036+0000 7ff6d8d33640 1 -- 172.21.15.49:0/715354676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc031cd0 con 0x7ff6d40d1670 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 -- 172.21.15.49:0/715354676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d40d1670 msgr2=0x7ff6d40d1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 --2- 172.21.15.49:0/715354676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d40d1670 0x7ff6d40d1b00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40724b0 tx=0x7ff6cc02b880 comp rx=0 tx=0).stop 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 -- 172.21.15.49:0/715354676 shutdown_connections 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 --2- 172.21.15.49:0/715354676 >> v2:172.21.15.115:3300/0 conn(0x7ff6d406f490 0x7ff6d406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 --2- 172.21.15.49:0/715354676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d40d1670 0x7ff6d40d1b00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 -- 172.21.15.49:0/715354676 >> 172.21.15.49:0/715354676 conn(0x7ff6d40d3200 msgr2=0x7ff6d40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 -- 172.21.15.49:0/715354676 shutdown_connections 2023-12-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.037+0000 7ff6dad37640 1 -- 172.21.15.49:0/715354676 wait complete. 2023-12-19T05:44:51.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.039+0000 7ff6dad37640 1 Processor -- start 2023-12-19T05:44:51.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.039+0000 7ff6dad37640 1 -- start start 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 0x7ff6d41401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6d40d1670 0x7ff6d40ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 0x7ff6d41f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d41f69a0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40cc920 con 0x7ff6d406f490 2023-12-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.040+0000 7ff6dad37640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40ccc00 con 0x7ff6d40d1670 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6d9d35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 0x7ff6d41401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 0x7ff6d41f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6d9534640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6d40d1670 0x7ff6d40ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6d9d35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 0x7ff6d41401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:44852/0 (socket says 172.21.15.49:44852) 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6d9d35640 1 -- 172.21.15.49:0/1475532333 learned_addr learned my addr 172.21.15.49:0/1475532333 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 -- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6d40d1670 msgr2=0x7ff6d40ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6d40d1670 0x7ff6d40ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 -- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 msgr2=0x7ff6d41401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 0x7ff6d41401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.041+0000 7ff6da536640 1 -- 172.21.15.49:0/1475532333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0094d0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6da536640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 0x7ff6d41f5b20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc033000 tx=0x7ff6cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc032940 con 0x7ff6d4146cd0 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc032aa0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc032e50 con 0x7ff6d4146cd0 2023-12-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d40ccee0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.042+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d40cd4a0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.044+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d40cd690 con 0x7ff6d4146cd0 2023-12-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.044+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6cc04e450 con 0x7ff6d4146cd0 2023-12-19T05:44:51.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.045+0000 7ff6d27fc640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 0x7ff6c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.045+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6cc0aa9d0 con 0x7ff6d4146cd0 2023-12-19T05:44:51.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.046+0000 7ff6d9d35640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 0x7ff6c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.047+0000 7ff6d9d35640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 0x7ff6c006c920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400e250 tx=0x7ff6c400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.049+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6cc076060 con 0x7ff6d4146cd0 2023-12-19T05:44:51.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.242+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6d4061910 con 0x7ff6d4146cd0 2023-12-19T05:44:51.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.243+0000 7ff6d27fc640 1 -- 172.21.15.49:0/1475532333 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6cc079680 con 0x7ff6d4146cd0 2023-12-19T05:44:51.244 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:44:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.245+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 msgr2=0x7ff6c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.245+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 0x7ff6c006c920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400e250 tx=0x7ff6c400b040 comp rx=0 tx=0).stop 2023-12-19T05:44:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 msgr2=0x7ff6d41f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 0x7ff6d41f5b20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc033000 tx=0x7ff6cc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 shutdown_connections 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6c006a460 0x7ff6c006c920 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6d40d1670 0x7ff6d40ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d4146cd0 0x7ff6d41f5b20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 --2- 172.21.15.49:0/1475532333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d406f490 0x7ff6d41401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 >> 172.21.15.49:0/1475532333 conn(0x7ff6d40d3200 msgr2=0x7ff6d4144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 shutdown_connections 2023-12-19T05:44:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.246+0000 7ff6dad37640 1 -- 172.21.15.49:0/1475532333 wait complete. 2023-12-19T05:44:51.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:44:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.493+0000 7ff760e73640 1 Processor -- start 2023-12-19T05:44:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.493+0000 7ff760e73640 1 -- start start 2023-12-19T05:44:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff760e73640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff75c0cdf50 0x7ff75c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff760e73640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0b22b0 con 0x7ff75c06f160 2023-12-19T05:44:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff760e73640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0b2830 con 0x7ff75c161810 2023-12-19T05:44:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff760e73640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c161bf0 con 0x7ff75c0cdf50 2023-12-19T05:44:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff75bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff75c06f160 0x7ff75c06f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50728/0 (socket says 172.21.15.49:50728) 2023-12-19T05:44:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.495+0000 7ff75bfff640 1 -- 172.21.15.49:0/3793684329 learned_addr learned my addr 172.21.15.49:0/3793684329 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786535706 0 0) 0x7ff75c0b22b0 con 0x7ff75c06f160 2023-12-19T05:44:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff748003520 con 0x7ff75c06f160 2023-12-19T05:44:51.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 599980860 0 0) 0x7ff748003520 con 0x7ff75c06f160 2023-12-19T05:44:51.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 >> v2:172.21.15.115:3300/0 conn(0x7ff75c0cdf50 msgr2=0x7ff75c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 --2- 172.21.15.49:0/3793684329 >> v2:172.21.15.115:3300/0 conn(0x7ff75c0cdf50 0x7ff75c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 >> v1:172.21.15.115:6789/0 conn(0x7ff75c161810 legacy=0x7ff75c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0b2550 con 0x7ff75c06f160 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff7540019f0 con 0x7ff75c06f160 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 >> v1:172.21.15.49:6789/0 conn(0x7ff75c06f160 legacy=0x7ff75c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff748003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480047c0 0x7ff748004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748005380 0x7ff74800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c161bf0 con 0x7ff748003970 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74800c220 con 0x7ff748005380 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.496+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74800c3e0 con 0x7ff7480047c0 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff748003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 -- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480047c0 msgr2=0x7ff748004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480047c0 0x7ff748004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 -- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748005380 msgr2=0x7ff74800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748005380 0x7ff74800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75b7fe640 1 -- 172.21.15.49:0/3793684329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748003520 con 0x7ff748003970 2023-12-19T05:44:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.497+0000 7ff75bfff640 1 -- 172.21.15.49:0/3793684329 reap_dead start 2023-12-19T05:44:51.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.498+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff748003d70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff74c001650 tx=0x7ff7480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f517ca7e8583119b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c005270 con 0x7ff748003970 2023-12-19T05:44:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c02e070 con 0x7ff748003970 2023-12-19T05:44:51.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff75affd640 1 -- 172.21.15.49:0/3793684329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c003610 con 0x7ff748003970 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff760e73640 1 -- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 msgr2=0x7ff748003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff760e73640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff748003d70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff74c001650 tx=0x7ff7480057f0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff760e73640 1 -- 172.21.15.49:0/3793684329 shutdown_connections 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.500+0000 7ff760e73640 1 --2- 172.21.15.49:0/3793684329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff748003d70 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.501+0000 7ff760e73640 1 -- 172.21.15.49:0/3793684329 >> 172.21.15.49:0/3793684329 conn(0x7ff75c0b0100 msgr2=0x7ff75c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.501+0000 7ff760e73640 1 -- 172.21.15.49:0/3793684329 shutdown_connections 2023-12-19T05:44:51.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.501+0000 7ff760e73640 1 -- 172.21.15.49:0/3793684329 wait complete. 2023-12-19T05:44:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.503+0000 7ff760e73640 1 Processor -- start 2023-12-19T05:44:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.503+0000 7ff760e73640 1 -- start start 2023-12-19T05:44:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff75c141d40 0x7ff75c15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 0x7ff75c160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15ee00 con 0x7ff748003970 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15f050 con 0x7ff75c1421c0 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff760e73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15f330 con 0x7ff75c141d40 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff75b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff75b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37628/0 (socket says 172.21.15.49:37628) 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.504+0000 7ff75b7fe640 1 -- 172.21.15.49:0/400852534 learned_addr learned my addr 172.21.15.49:0/400852534 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff753fff640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff75c141d40 0x7ff75c15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75bfff640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 0x7ff75c160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 -- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff75c141d40 msgr2=0x7ff75c15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff75c141d40 0x7ff75c15fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 -- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 msgr2=0x7ff75c160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 0x7ff75c160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 -- 172.21.15.49:0/400852534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c15f610 con 0x7ff748003970 2023-12-19T05:44:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75bfff640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 0x7ff75c160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.505+0000 7ff75b7fe640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff74c02bb10 tx=0x7ff74c000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.506+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c003a00 con 0x7ff748003970 2023-12-19T05:44:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.506+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c003b60 con 0x7ff748003970 2023-12-19T05:44:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.506+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c15f8f0 con 0x7ff748003970 2023-12-19T05:44:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.506+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c033430 con 0x7ff748003970 2023-12-19T05:44:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.506+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c06bcf0 con 0x7ff748003970 2023-12-19T05:44:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.507+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c0cb5e0 con 0x7ff748003970 2023-12-19T05:44:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.508+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff74c030030 con 0x7ff748003970 2023-12-19T05:44:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.509+0000 7ff758ff9640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 0x7ff73c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.509+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff74c0aa260 con 0x7ff748003970 2023-12-19T05:44:51.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.510+0000 7ff753fff640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 0x7ff73c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.511+0000 7ff753fff640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 0x7ff73c06c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff744006fd0 tx=0x7ff744008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.513+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff74c0757b0 con 0x7ff748003970 2023-12-19T05:44:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.741+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff75c06bcf0 con 0x7ff748003970 2023-12-19T05:44:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.743+0000 7ff758ff9640 1 -- 172.21.15.49:0/400852534 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7ff75c06bcf0 con 0x7ff748003970 2023-12-19T05:44:51.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:51.745 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:44:51.745 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:44:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 msgr2=0x7ff73c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 0x7ff73c06c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff744006fd0 tx=0x7ff744008040 comp rx=0 tx=0).stop 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 msgr2=0x7ff75c06b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff74c02bb10 tx=0x7ff74c000fb0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 shutdown_connections 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff73c06a430 0x7ff73c06c8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff75c141d40 0x7ff75c15fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff75c1421c0 0x7ff75c160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 --2- 172.21.15.49:0/400852534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff748003970 0x7ff75c06b5d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.745+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 >> 172.21.15.49:0/400852534 conn(0x7ff75c0b0100 msgr2=0x7ff75c15e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:51.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.746+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 shutdown_connections 2023-12-19T05:44:51.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.746+0000 7ff760e73640 1 -- 172.21.15.49:0/400852534 wait complete. 2023-12-19T05:44:51.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:51.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.994+0000 7fe9853b5640 1 Processor -- start 2023-12-19T05:44:51.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.994+0000 7fe9853b5640 1 -- start start 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe9853b5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe98015b1e0 0x7fe98015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe9853b5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe98015a8a0 0x7fe98015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe9853b5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98006b520 con 0x7fe980159f80 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe9853b5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800b2b20 con 0x7fe98015a8a0 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe9853b5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800b2fb0 con 0x7fe98015b1e0 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe97ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe980159f80 0x7fe98006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50736/0 (socket says 172.21.15.49:50736) 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe97ffff640 1 -- 172.21.15.49:0/3400848218 learned_addr learned my addr 172.21.15.49:0/3400848218 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:51.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.996+0000 7fe984bb4640 1 --2- 172.21.15.49:0/3400848218 >> v2:172.21.15.49:3300/0 conn(0x7fe98015a8a0 0x7fe98015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe97f7fe640 1 --2- 172.21.15.49:0/3400848218 >> v2:172.21.15.115:3300/0 conn(0x7fe98015b1e0 0x7fe98015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe97effd640 1 -- 172.21.15.49:0/3400848218 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251342781 0 0) 0x7fe98006b520 con 0x7fe980159f80 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe984bb4640 1 -- 172.21.15.49:0/3400848218 >> v2:172.21.15.115:3300/0 conn(0x7fe98015b1e0 msgr2=0x7fe98015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe984bb4640 1 --2- 172.21.15.49:0/3400848218 >> v2:172.21.15.115:3300/0 conn(0x7fe98015b1e0 0x7fe98015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe984bb4640 1 -- 172.21.15.49:0/3400848218 >> v1:172.21.15.49:6789/0 conn(0x7fe980159f80 legacy=0x7fe98006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.997+0000 7fe984bb4640 1 -- 172.21.15.49:0/3400848218 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800b1f10 con 0x7fe98015a8a0 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.998+0000 7fe984bb4640 1 --2- 172.21.15.49:0/3400848218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98015b770 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe9800cff10 tx=0x7fe97802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd98e3884aa412c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.998+0000 7fe97effd640 1 -- 172.21.15.49:0/3400848218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97802cd00 con 0x7fe98015a8a0 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.998+0000 7fe97effd640 1 -- 172.21.15.49:0/3400848218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97802ce60 con 0x7fe98015a8a0 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.998+0000 7fe97effd640 1 -- 172.21.15.49:0/3400848218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978034660 con 0x7fe98015a8a0 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 -- 172.21.15.49:0/3400848218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 msgr2=0x7fe98015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3400848218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98015b770 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe9800cff10 tx=0x7fe97802bf50 comp rx=0 tx=0).stop 2023-12-19T05:44:52.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 -- 172.21.15.49:0/3400848218 shutdown_connections 2023-12-19T05:44:52.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3400848218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98015b770 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3400848218 >> v2:172.21.15.115:3300/0 conn(0x7fe98015b1e0 0x7fe98015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 -- 172.21.15.49:0/3400848218 >> 172.21.15.49:0/3400848218 conn(0x7fe9800b0100 msgr2=0x7fe9800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:52.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 -- 172.21.15.49:0/3400848218 shutdown_connections 2023-12-19T05:44:52.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:51.999+0000 7fe9853b5640 1 -- 172.21.15.49:0/3400848218 wait complete. 2023-12-19T05:44:52.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.001+0000 7fe9853b5640 1 Processor -- start 2023-12-19T05:44:52.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.001+0000 7fe9853b5640 1 -- start start 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 0x7fe98014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98015b1e0 0x7fe980150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98014e990 con 0x7fe98015a8a0 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe980155c40 con 0x7fe98015b1e0 2023-12-19T05:44:52.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe9853b5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe980155f20 con 0x7fe980159f80 2023-12-19T05:44:52.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37642/0 (socket says 172.21.15.49:37642) 2023-12-19T05:44:52.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 -- 172.21.15.49:0/3073115104 learned_addr learned my addr 172.21.15.49:0/3073115104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97ffff640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 0x7fe98014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 -- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 msgr2=0x7fe98014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe984bb4640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98015b1e0 0x7fe980150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 0x7fe98014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 -- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98015b1e0 msgr2=0x7fe980150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98015b1e0 0x7fe980150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.002+0000 7fe97f7fe640 1 -- 172.21.15.49:0/3073115104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009a70 con 0x7fe98015a8a0 2023-12-19T05:44:52.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe97ffff640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 0x7fe98014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe97f7fe640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe97400d5f0 tx=0x7fe97400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740125f0 con 0x7fe98015a8a0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974012750 con 0x7fe98015a8a0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe980156200 con 0x7fe98015a8a0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974012b00 con 0x7fe98015a8a0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.003+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9801567c0 con 0x7fe98015a8a0 2023-12-19T05:44:52.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.005+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe980156980 con 0x7fe98015a8a0 2023-12-19T05:44:52.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.005+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe974012c60 con 0x7fe98015a8a0 2023-12-19T05:44:52.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.006+0000 7fe97cff9640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.007+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe974088de0 con 0x7fe98015a8a0 2023-12-19T05:44:52.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.007+0000 7fe97ffff640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.009+0000 7fe97ffff640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe970000f60 tx=0x7fe970009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.011+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe9740543c0 con 0x7fe98015a8a0 2023-12-19T05:44:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.211+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe980061910 con 0x7fe98015a8a0 2023-12-19T05:44:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.214+0000 7fe97cff9640 1 -- 172.21.15.49:0/3073115104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fe9740579e0 con 0x7fe98015a8a0 2023-12-19T05:44:52.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:52.216 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":97,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:51.486184+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 msgr2=0x7fe96c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe970000f60 tx=0x7fe970009040 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 msgr2=0x7fe98014ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe97400d5f0 tx=0x7fe97400dab0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 shutdown_connections 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98015b1e0 0x7fe980150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98015a8a0 0x7fe98014ee70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 --2- 172.21.15.49:0/3073115104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe980159f80 0x7fe98014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 >> 172.21.15.49:0/3073115104 conn(0x7fe9800b0100 msgr2=0x7fe9800ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 shutdown_connections 2023-12-19T05:44:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.217+0000 7fe9853b5640 1 -- 172.21.15.49:0/3073115104 wait complete. 2023-12-19T05:44:52.240 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:44:52.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:44:52.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.474+0000 7f7c9f59e640 1 Processor -- start 2023-12-19T05:44:52.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.474+0000 7f7c9f59e640 1 -- start start 2023-12-19T05:44:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.476+0000 7f7c9f59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ca00b8070 0x7f7ca00d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.476+0000 7f7c9f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.476+0000 7f7c9f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00d12d0 con 0x7f7ca0146e30 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.476+0000 7f7c9f59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0147210 con 0x7f7ca00b8070 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.476+0000 7f7c9f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00d2370 con 0x7f7ca00d0a90 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ca00b8070 0x7f7ca00d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ca00b8070 0x7f7ca00d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37652/0 (socket says 172.21.15.49:37652) 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 -- 172.21.15.49:0/980566681 learned_addr learned my addr 172.21.15.49:0/980566681 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9ed9d640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 -- 172.21.15.49:0/980566681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 msgr2=0x7f7ca015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 -- 172.21.15.49:0/980566681 >> v1:172.21.15.115:6789/0 conn(0x7f7ca0146e30 legacy=0x7f7ca00b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.477+0000 7f7c9dd9b640 1 -- 172.21.15.49:0/980566681 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00d15b0 con 0x7f7ca00b8070 2023-12-19T05:44:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.478+0000 7f7c9dd9b640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca00d0550 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2383aac6a473da5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.479+0000 7f7c9d59a640 1 -- 172.21.15.49:0/980566681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94031640 con 0x7f7ca00b8070 2023-12-19T05:44:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.479+0000 7f7c9d59a640 1 -- 172.21.15.49:0/980566681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c940317a0 con 0x7f7ca00b8070 2023-12-19T05:44:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.479+0000 7f7c9d59a640 1 -- 172.21.15.49:0/980566681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94031b30 con 0x7f7ca00b8070 2023-12-19T05:44:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.479+0000 7f7c9f59e640 1 -- 172.21.15.49:0/980566681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 msgr2=0x7f7ca00d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.479+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca00d0550 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 -- 172.21.15.49:0/980566681 shutdown_connections 2023-12-19T05:44:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/980566681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca00d0550 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 -- 172.21.15.49:0/980566681 >> 172.21.15.49:0/980566681 conn(0x7f7ca00b2990 msgr2=0x7f7ca00b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 -- 172.21.15.49:0/980566681 shutdown_connections 2023-12-19T05:44:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.480+0000 7f7c9f59e640 1 -- 172.21.15.49:0/980566681 wait complete. 2023-12-19T05:44:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.482+0000 7f7c9f59e640 1 Processor -- start 2023-12-19T05:44:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.482+0000 7f7c9f59e640 1 -- start start 2023-12-19T05:44:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca01e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca0146e30 0x7f7ca01e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca013b3b0 con 0x7f7ca00b8070 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca013b690 con 0x7f7ca0146e30 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca013b970 con 0x7f7ca00d0a90 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37662/0 (socket says 172.21.15.49:37662) 2023-12-19T05:44:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.483+0000 7f7c9e59c640 1 -- 172.21.15.49:0/2903923730 learned_addr learned my addr 172.21.15.49:0/2903923730 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9dd9b640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca01e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9ed9d640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca0146e30 0x7f7ca01e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 -- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 msgr2=0x7f7ca01e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca01e5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 -- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca0146e30 msgr2=0x7f7ca01e58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca0146e30 0x7f7ca01e58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 -- 172.21.15.49:0/2903923730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940094d0 con 0x7f7ca00b8070 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c9e59c640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c400 tx=0x7f7c9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900052d0 con 0x7f7ca00b8070 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90005430 con 0x7f7ca00b8070 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.484+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90003830 con 0x7f7ca00b8070 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.485+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca013bc50 con 0x7f7ca00b8070 2023-12-19T05:44:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.485+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca0141650 con 0x7f7ca00b8070 2023-12-19T05:44:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.486+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0061910 con 0x7f7ca00b8070 2023-12-19T05:44:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.487+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c90003990 con 0x7f7ca00b8070 2023-12-19T05:44:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.488+0000 7f7c8effd640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 0x7f7c8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.488+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c90087ed0 con 0x7f7ca00b8070 2023-12-19T05:44:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.488+0000 7f7c9dd9b640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 0x7f7c8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.490+0000 7f7c9dd9b640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 0x7f7c8006c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c94036000 tx=0x7f7c9403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.492+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c900534b0 con 0x7f7ca00b8070 2023-12-19T05:44:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.729+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca0141b70 con 0x7f7ca00b8070 2023-12-19T05:44:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.730+0000 7f7c8effd640 1 -- 172.21.15.49:0/2903923730 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f7c90056ad0 con 0x7f7ca00b8070 2023-12-19T05:44:52.732 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:52.732 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:44:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:44:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 msgr2=0x7f7c8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 0x7f7c8006c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c94036000 tx=0x7f7c9403c040 comp rx=0 tx=0).stop 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 msgr2=0x7f7ca0141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c400 tx=0x7f7c9000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 shutdown_connections 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c8006a430 0x7f7c8006c8f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00d0a90 0x7f7ca01e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca0146e30 0x7f7ca01e58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 --2- 172.21.15.49:0/2903923730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca00b8070 0x7f7ca0141110 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.734+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 >> 172.21.15.49:0/2903923730 conn(0x7f7ca00b2990 msgr2=0x7f7ca01e40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.735+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 shutdown_connections 2023-12-19T05:44:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.735+0000 7f7c9f59e640 1 -- 172.21.15.49:0/2903923730 wait complete. 2023-12-19T05:44:52.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:44:52.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.986+0000 7f151a0fa640 1 Processor -- start 2023-12-19T05:44:52.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.986+0000 7f151a0fa640 1 -- start start 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f151415e5a0 0x7f15140b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f151415f680 0x7f15140b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140cdbf0 0x7f15140ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140ce5c0 con 0x7f15140cdbf0 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151415ec30 con 0x7f151415f680 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.988+0000 7f151a0fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b2cc0 con 0x7f151415e5a0 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140cdbf0 0x7f15140ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140cdbf0 0x7f15140ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37670/0 (socket says 172.21.15.49:37670) 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 -- 172.21.15.49:0/785530841 learned_addr learned my addr 172.21.15.49:0/785530841 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15190f8640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f151415e5a0 0x7f15140b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15188f7640 1 --2- 172.21.15.49:0/785530841 >> v2:172.21.15.115:3300/0 conn(0x7f151415f680 0x7f15140b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 -- 172.21.15.49:0/785530841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f151415e5a0 msgr2=0x7f15140b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f151415e5a0 0x7f15140b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 -- 172.21.15.49:0/785530841 >> v2:172.21.15.115:3300/0 conn(0x7f151415f680 msgr2=0x7f15140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 --2- 172.21.15.49:0/785530841 >> v2:172.21.15.115:3300/0 conn(0x7f151415f680 0x7f15140b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.989+0000 7f15198f9640 1 -- 172.21.15.49:0/785530841 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151415e980 con 0x7f15140cdbf0 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.990+0000 7f15198f9640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140cdbf0 0x7f15140ce080 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f15140cfe20 tx=0x7f150c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2835c943258a22e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f150bfff640 1 -- 172.21.15.49:0/785530841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c02ca70 con 0x7f15140cdbf0 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f150bfff640 1 -- 172.21.15.49:0/785530841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c02cbd0 con 0x7f15140cdbf0 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f150bfff640 1 -- 172.21.15.49:0/785530841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0343f0 con 0x7f15140cdbf0 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 -- 172.21.15.49:0/785530841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140cdbf0 msgr2=0x7f15140ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140cdbf0 0x7f15140ce080 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f15140cfe20 tx=0x7f150c02bed0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 -- 172.21.15.49:0/785530841 shutdown_connections 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140cdbf0 0x7f15140ce080 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 --2- 172.21.15.49:0/785530841 >> v2:172.21.15.115:3300/0 conn(0x7f151415f680 0x7f15140b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 --2- 172.21.15.49:0/785530841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f151415e5a0 0x7f15140b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.991+0000 7f151a0fa640 1 -- 172.21.15.49:0/785530841 >> 172.21.15.49:0/785530841 conn(0x7f15140b0100 msgr2=0x7f15140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.992+0000 7f151a0fa640 1 -- 172.21.15.49:0/785530841 shutdown_connections 2023-12-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.992+0000 7f151a0fa640 1 -- 172.21.15.49:0/785530841 wait complete. 2023-12-19T05:44:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.993+0000 7f151a0fa640 1 Processor -- start 2023-12-19T05:44:52.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.994+0000 7f151a0fa640 1 -- start start 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15140cdbf0 0x7f1514145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151415f680 0x7f15140af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514145ca0 con 0x7f151415e5a0 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514145f20 con 0x7f151415f680 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f151a0fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1514146200 con 0x7f15140cdbf0 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37682/0 (socket says 172.21.15.49:37682) 2023-12-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 -- 172.21.15.49:0/971382226 learned_addr learned my addr 172.21.15.49:0/971382226 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15190f8640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15140cdbf0 0x7f1514145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 -- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15140cdbf0 msgr2=0x7f1514145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15140cdbf0 0x7f1514145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 -- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151415f680 msgr2=0x7f15140af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151415f680 0x7f15140af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:52.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.995+0000 7f15188f7640 1 -- 172.21.15.49:0/971382226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c009b30 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f15188f7640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f150400d5f0 tx=0x7f150400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040125f0 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504012750 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15141464e0 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504012b00 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.996+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1514141e60 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.997+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151414ae50 con 0x7f151415e5a0 2023-12-19T05:44:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.998+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1504012c60 con 0x7f151415e5a0 2023-12-19T05:44:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.999+0000 7f1509ffb640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:52.999+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1504088da0 con 0x7f151415e5a0 2023-12-19T05:44:53.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.000+0000 7f15190f8640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.001+0000 7f15190f8640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1510006fd0 tx=0x7f1510008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.003+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f151414ae50 con 0x7f151415e5a0 2023-12-19T05:44:53.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.239+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f151414ae50 con 0x7f151415e5a0 2023-12-19T05:44:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.239+0000 7f1509ffb640 1 -- 172.21.15.49:0/971382226 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f151414ae50 con 0x7f151415e5a0 2023-12-19T05:44:53.241 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:53.241 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:43:53.198175+0000","modified":"2023-12-19T05:43:56.700098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3621171871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3621171871},{"type":"v1","addr":"172.21.15.115:6837","nonce":3621171871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T05:44:53.242 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 msgr2=0x7f14f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1510006fd0 tx=0x7f1510008040 comp rx=0 tx=0).stop 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 msgr2=0x7f1514141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f150400d5f0 tx=0x7f150400dab0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 shutdown_connections 2023-12-19T05:44:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151415f680 0x7f15140af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f151415e5a0 0x7f1514141920 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 --2- 172.21.15.49:0/971382226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15140cdbf0 0x7f1514145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 >> 172.21.15.49:0/971382226 conn(0x7f15140b0100 msgr2=0x7f15140cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 shutdown_connections 2023-12-19T05:44:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.242+0000 7f151a0fa640 1 -- 172.21.15.49:0/971382226 wait complete. 2023-12-19T05:44:53.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:53.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.498+0000 7f1293e51640 1 Processor -- start 2023-12-19T05:44:53.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.498+0000 7f1293e51640 1 -- start start 2023-12-19T05:44:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1293e51640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f128c0ce820 0x7f128c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1293e51640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0cd840 con 0x7f128c146e10 2023-12-19T05:44:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1293e51640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0b6e90 con 0x7f128c0d2b00 2023-12-19T05:44:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1293e51640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0d2430 con 0x7f128c0ce820 2023-12-19T05:44:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1291bed640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f128c146e10 0x7f128c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50748/0 (socket says 172.21.15.49:50748) 2023-12-19T05:44:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.500+0000 7f1291bed640 1 -- 172.21.15.49:0/293039341 learned_addr learned my addr 172.21.15.49:0/293039341 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f12923ee640 1 --2- 172.21.15.49:0/293039341 >> v2:172.21.15.49:3300/0 conn(0x7f128c0ce820 0x7f128c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861656702 0 0) 0x7f128c0cd840 con 0x7f128c146e10 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1278003520 con 0x7f128c146e10 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f12923ee640 1 -- 172.21.15.49:0/293039341 >> v1:172.21.15.115:6789/0 conn(0x7f128c0d2b00 legacy=0x7f128c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f12923ee640 1 -- 172.21.15.49:0/293039341 >> v1:172.21.15.49:6789/0 conn(0x7f128c146e10 legacy=0x7f128c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250488054 0 0) 0x7f1278003520 con 0x7f128c146e10 2023-12-19T05:44:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.501+0000 7f12923ee640 1 -- 172.21.15.49:0/293039341 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0d2620 con 0x7f128c0ce820 2023-12-19T05:44:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.502+0000 7f12923ee640 1 --2- 172.21.15.49:0/293039341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0ce820 0x7f128c0d1ef0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128402bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ff0391688bd63d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288001670 con 0x7f128c0ce820 2023-12-19T05:44:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128402c820 con 0x7f128c0ce820 2023-12-19T05:44:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1290beb640 1 -- 172.21.15.49:0/293039341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128402cbb0 con 0x7f128c0ce820 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 -- 172.21.15.49:0/293039341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0ce820 msgr2=0x7f128c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 --2- 172.21.15.49:0/293039341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0ce820 0x7f128c0d1ef0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128402bcf0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 -- 172.21.15.49:0/293039341 shutdown_connections 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 --2- 172.21.15.49:0/293039341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0ce820 0x7f128c0d1ef0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 -- 172.21.15.49:0/293039341 >> 172.21.15.49:0/293039341 conn(0x7f128c0b29c0 msgr2=0x7f128c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.503+0000 7f1293e51640 1 -- 172.21.15.49:0/293039341 shutdown_connections 2023-12-19T05:44:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.504+0000 7f1293e51640 1 -- 172.21.15.49:0/293039341 wait complete. 2023-12-19T05:44:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.505+0000 7f1293e51640 1 Processor -- start 2023-12-19T05:44:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.505+0000 7f1293e51640 1 -- start start 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f128c0ce820 0x7f128c13ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 0x7f128c13ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c143d20 con 0x7f128c0d2b00 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c13f380 con 0x7f128c146e10 2023-12-19T05:44:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.506+0000 7f1293e51640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c13f620 con 0x7f128c0ce820 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37690/0 (socket says 172.21.15.49:37690) 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 -- 172.21.15.49:0/201113356 learned_addr learned my addr 172.21.15.49:0/201113356 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f1291bed640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f128c0ce820 0x7f128c13ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12923ee640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 0x7f128c13ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 -- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f128c0ce820 msgr2=0x7f128c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f128c0ce820 0x7f128c13ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 -- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 msgr2=0x7f128c13ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 0x7f128c13ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12913ec640 1 -- 172.21.15.49:0/201113356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284009a70 con 0x7f128c0d2b00 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.507+0000 7f12923ee640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 0x7f128c13ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f12913ec640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c430 tx=0x7f127c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011790 con 0x7f128c0d2b00 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c0118f0 con 0x7f128c0d2b00 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011ce0 con 0x7f128c0d2b00 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c13f900 con 0x7f128c0d2b00 2023-12-19T05:44:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.508+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c143f70 con 0x7f128c0d2b00 2023-12-19T05:44:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.509+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c13fe20 con 0x7f128c0d2b00 2023-12-19T05:44:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.510+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f127c01c460 con 0x7f128c0d2b00 2023-12-19T05:44:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.511+0000 7f12827fc640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 0x7f127006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.511+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f127c0888d0 con 0x7f128c0d2b00 2023-12-19T05:44:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.511+0000 7f1291bed640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 0x7f127006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.512+0000 7f1291bed640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 0x7f127006c8f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1288001af0 tx=0x7f1288009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.515+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f128c13fe20 con 0x7f128c0d2b00 2023-12-19T05:44:53.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.719+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128c13fe20 con 0x7f128c0d2b00 2023-12-19T05:44:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.721+0000 7f12827fc640 1 -- 172.21.15.49:0/201113356 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16186 (secure 0 0 0) 0x7f128c13fe20 con 0x7f128c0d2b00 2023-12-19T05:44:53.724 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:44:53.724 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:53.481571+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:43:51.193336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-19T05:43:52.224457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1d","mappings":[{"from":1,"to":2}]},{"pgid":"11.26","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 msgr2=0x7f127006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 0x7f127006c8f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1288001af0 tx=0x7f1288009040 comp rx=0 tx=0).stop 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 msgr2=0x7f128c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c430 tx=0x7f127c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 shutdown_connections 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f127006a430 0x7f127006c8f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f128c146e10 0x7f128c13ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f128c0d2b00 0x7f128c1437e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 --2- 172.21.15.49:0/201113356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f128c0ce820 0x7f128c13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.724+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 >> 172.21.15.49:0/201113356 conn(0x7f128c0b29c0 msgr2=0x7f128c0b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.725+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 shutdown_connections 2023-12-19T05:44:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.725+0000 7f1293e51640 1 -- 172.21.15.49:0/201113356 wait complete. 2023-12-19T05:44:53.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:44:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.977+0000 7f6011e54640 1 Processor -- start 2023-12-19T05:44:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.977+0000 7f6011e54640 1 -- start start 2023-12-19T05:44:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011e54640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f600c0b02f0 0x7f600c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011e54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f600c161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011e54640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c15d7d0 con 0x7f600c157710 2023-12-19T05:44:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011e54640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0b0ce0 con 0x7f600c0b02f0 2023-12-19T05:44:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011e54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0b2ea0 con 0x7f600c160dc0 2023-12-19T05:44:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6010e52640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f600c157710 0x7f600c0b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50756/0 (socket says 172.21.15.49:50756) 2023-12-19T05:44:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6010e52640 1 -- 172.21.15.49:0/3549398485 learned_addr learned my addr 172.21.15.49:0/3549398485 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f600bfff640 1 --2- 172.21.15.49:0/3549398485 >> v2:172.21.15.115:3300/0 conn(0x7f600c0b02f0 0x7f600c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f6011653640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f600c161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.979+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196086021 0 0) 0x7f600c15d7d0 con 0x7f600c157710 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff8003520 con 0x7f600c157710 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261057496 0 0) 0x7f5ff8003520 con 0x7f600c157710 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 msgr2=0x7f600c161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f600c161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 >> v2:172.21.15.115:3300/0 conn(0x7f600c0b02f0 msgr2=0x7f600c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 --2- 172.21.15.49:0/3549398485 >> v2:172.21.15.115:3300/0 conn(0x7f600c0b02f0 0x7f600c0b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c15da90 con 0x7f600c157710 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5ffc0019f0 con 0x7f600c157710 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 >> v1:172.21.15.49:6789/0 conn(0x7f600c157710 legacy=0x7f600c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ff80039e0 0x7f5ff8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f5ff80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff8004d00 0x7f5ff8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0b0ce0 con 0x7f5ff80039e0 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0b2ea0 con 0x7f5ff8004d00 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.980+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff800ba80 con 0x7f600c160dc0 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ff80039e0 0x7f5ff8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f600bfff640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f5ff80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6011653640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff8004d00 0x7f5ff8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 -- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 msgr2=0x7f5ff80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c160dc0 0x7f5ff80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 -- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff8004d00 msgr2=0x7f5ff8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff8004d00 0x7f5ff8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.981+0000 7f6010e52640 1 -- 172.21.15.49:0/3549398485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8003520 con 0x7f5ff80039e0 2023-12-19T05:44:53.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.982+0000 7f6010e52640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ff80039e0 0x7f5ff8003e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00a900 tx=0x7f5ff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea71e1ad8b6ac745 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.982+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc034630 con 0x7f5ff80039e0 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc02f070 con 0x7f5ff80039e0 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f600b7fe640 1 -- 172.21.15.49:0/3549398485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc034a10 con 0x7f5ff80039e0 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 -- 172.21.15.49:0/3549398485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ff80039e0 msgr2=0x7f5ff8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 --2- 172.21.15.49:0/3549398485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ff80039e0 0x7f5ff8003e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00a900 tx=0x7f5ff80057f0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011653640 1 -- 172.21.15.49:0/3549398485 reap_dead start 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 -- 172.21.15.49:0/3549398485 shutdown_connections 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 -- 172.21.15.49:0/3549398485 >> 172.21.15.49:0/3549398485 conn(0x7f600c0659a0 msgr2=0x7f600c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 -- 172.21.15.49:0/3549398485 shutdown_connections 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.983+0000 7f6011e54640 1 -- 172.21.15.49:0/3549398485 wait complete. 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.985+0000 7f6011e54640 1 Processor -- start 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.985+0000 7f6011e54640 1 -- start start 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff80039e0 0x7f600c157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c148b80 0x7f600c145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c145d60 con 0x7f600c145fd0 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15b980 con 0x7f5ff80039e0 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.986+0000 7f6011e54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15bc60 con 0x7f600c148b80 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37702/0 (socket says 172.21.15.49:37702) 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 -- 172.21.15.49:0/3318569341 learned_addr learned my addr 172.21.15.49:0/3318569341 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6010e52640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff80039e0 0x7f600c157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f600bfff640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c148b80 0x7f600c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 -- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c148b80 msgr2=0x7f600c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c148b80 0x7f600c145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 -- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff80039e0 msgr2=0x7f600c157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff80039e0 0x7f600c157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.987+0000 7f6011653640 1 -- 172.21.15.49:0/3318569341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c15bf40 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f6011653640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f600c15e940 tx=0x7f6004011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004004500 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004003610 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040039c0 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c15c220 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.988+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c146450 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.989+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c061910 con 0x7f600c145fd0 2023-12-19T05:44:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.990+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6004003b20 con 0x7f600c145fd0 2023-12-19T05:44:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.991+0000 7f60097fa640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 0x7f5fec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.991+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f6004088dd0 con 0x7f600c145fd0 2023-12-19T05:44:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.992+0000 7f6010e52640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 0x7f5fec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.993+0000 7f6010e52640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 0x7f5fec06c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:53.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:53.995+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6004054350 con 0x7f600c145fd0 2023-12-19T05:44:54.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.227+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f600c0ae7b0 con 0x7f600c145fd0 2023-12-19T05:44:54.231 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:44:54.229+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:44:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.246+0000 7f60097fa640 1 -- 172.21.15.49:0/3318569341 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6004057970 con 0x7f600c145fd0 2023-12-19T05:44:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:44:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 msgr2=0x7f5fec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 0x7f5fec06c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc009030 comp rx=0 tx=0).stop 2023-12-19T05:44:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 msgr2=0x7f600c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f600c15e940 tx=0x7f6004011920 comp rx=0 tx=0).stop 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 shutdown_connections 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a430 0x7f5fec06c8f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f600c148b80 0x7f600c145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600c145fd0 0x7f600c0cef10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 --2- 172.21.15.49:0/3318569341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ff80039e0 0x7f600c157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 >> 172.21.15.49:0/3318569341 conn(0x7f600c0659a0 msgr2=0x7f600c1566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 shutdown_connections 2023-12-19T05:44:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.250+0000 7f6011e54640 1 -- 172.21.15.49:0/3318569341 wait complete. 2023-12-19T05:44:54.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:44:54.365 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:44:54.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.483+0000 7f61f8b57640 1 Processor -- start 2023-12-19T05:44:54.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.483+0000 7f61f8b57640 1 -- start start 2023-12-19T05:44:54.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.485+0000 7f61f8b57640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61f40b0a00 0x7f61f40b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.485+0000 7f61f8b57640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.485+0000 7f61f8b57640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f406b3a0 con 0x7f61f4159e40 2023-12-19T05:44:54.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.485+0000 7f61f8b57640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40b23e0 con 0x7f61f40b0a00 2023-12-19T05:44:54.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.485+0000 7f61f8b57640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40b1860 con 0x7f61f40cd430 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.486+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.486+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:58574/0 (socket says 172.21.15.49:58574) 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.486+0000 7f61f3fff640 1 -- 172.21.15.49:0/1263466044 learned_addr learned my addr 172.21.15.49:0/1263466044 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.486+0000 7f61ebfff640 1 --2- 172.21.15.49:0/1263466044 >> v2:172.21.15.115:3300/0 conn(0x7f61f40b0a00 0x7f61f40b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.487+0000 7f61f3fff640 1 -- 172.21.15.49:0/1263466044 >> v2:172.21.15.115:3300/0 conn(0x7f61f40b0a00 msgr2=0x7f61f40b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.487+0000 7f61f3fff640 1 --2- 172.21.15.49:0/1263466044 >> v2:172.21.15.115:3300/0 conn(0x7f61f40b0a00 0x7f61f40b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.487+0000 7f61f3fff640 1 -- 172.21.15.49:0/1263466044 >> v1:172.21.15.115:6789/0 conn(0x7f61f4159e40 legacy=0x7f61f40b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.487+0000 7f61f3fff640 1 -- 172.21.15.49:0/1263466044 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40b1b40 con 0x7f61f40cd430 2023-12-19T05:44:54.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.488+0000 7f61f3fff640 1 --2- 172.21.15.49:0/1263466044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009e50 tx=0x7f61ec02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4828a122a6348c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:54.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.488+0000 7f61f2ffd640 1 -- 172.21.15.49:0/1263466044 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec02cb90 con 0x7f61f40cd430 2023-12-19T05:44:54.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f2ffd640 1 -- 172.21.15.49:0/1263466044 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec02ccf0 con 0x7f61f40cd430 2023-12-19T05:44:54.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f2ffd640 1 -- 172.21.15.49:0/1263466044 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec034610 con 0x7f61f40cd430 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 -- 172.21.15.49:0/1263466044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 msgr2=0x7f61f406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1263466044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009e50 tx=0x7f61ec02bff0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 -- 172.21.15.49:0/1263466044 shutdown_connections 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1263466044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40cd430 0x7f61f406b810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1263466044 >> v2:172.21.15.115:3300/0 conn(0x7f61f40b0a00 0x7f61f40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 -- 172.21.15.49:0/1263466044 >> 172.21.15.49:0/1263466044 conn(0x7f61f40659a0 msgr2=0x7f61f4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 -- 172.21.15.49:0/1263466044 shutdown_connections 2023-12-19T05:44:54.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.489+0000 7f61f8b57640 1 -- 172.21.15.49:0/1263466044 wait complete. 2023-12-19T05:44:54.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.491+0000 7f61f8b57640 1 Processor -- start 2023-12-19T05:44:54.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.491+0000 7f61f8b57640 1 -- start start 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40b0a00 0x7f61f414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61f4159e40 0x7f61f415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f414c6d0 con 0x7f61f40cd430 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4136d50 con 0x7f61f4159e40 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.492+0000 7f61f8b57640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f414ba50 con 0x7f61f40b0a00 2023-12-19T05:44:54.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39896/0 (socket says 172.21.15.49:39896) 2023-12-19T05:44:54.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 -- 172.21.15.49:0/1461640772 learned_addr learned my addr 172.21.15.49:0/1461640772 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61f3fff640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61f4159e40 0x7f61f415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61f37fe640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40b0a00 0x7f61f414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 -- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40b0a00 msgr2=0x7f61f414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40b0a00 0x7f61f414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 -- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61f4159e40 msgr2=0x7f61f415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61f4159e40 0x7f61f415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.493+0000 7f61ebfff640 1 -- 172.21.15.49:0/1461640772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009b30 con 0x7f61f40cd430 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61ebfff640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9b0 tx=0x7f61dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc009670 con 0x7f61f40cd430 2023-12-19T05:44:54.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc00c9a0 con 0x7f61f40cd430 2023-12-19T05:44:54.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00cd50 con 0x7f61f40cd430 2023-12-19T05:44:54.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f414bd30 con 0x7f61f40cd430 2023-12-19T05:44:54.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.494+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f414c2f0 con 0x7f61f40cd430 2023-12-19T05:44:54.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.495+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f4061910 con 0x7f61f40cd430 2023-12-19T05:44:54.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.496+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61dc013470 con 0x7f61f40cd430 2023-12-19T05:44:54.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.497+0000 7f61f0ff9640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 0x7f61d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:54.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.497+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f61dc088cf0 con 0x7f61f40cd430 2023-12-19T05:44:54.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.498+0000 7f61f37fe640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 0x7f61d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:54.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.499+0000 7f61f37fe640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 0x7f61d406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f61f40ad670 tx=0x7f61e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:54.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.501+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61dc054190 con 0x7f61f40cd430 2023-12-19T05:44:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:54.740+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61f41594f0 con 0x7f61f40cd430 2023-12-19T05:44:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.252+0000 7f61f0ff9640 1 -- 172.21.15.49:0/1461640772 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f61dc0577b0 con 0x7f61f40cd430 2023-12-19T05:44:55.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.255+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 msgr2=0x7f61d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.255+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 0x7f61d406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f61f40ad670 tx=0x7f61e4009040 comp rx=0 tx=0).stop 2023-12-19T05:44:55.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 msgr2=0x7f61f4136810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9b0 tx=0x7f61dc00ee70 comp rx=0 tx=0).stop 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 shutdown_connections 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61d406a430 0x7f61d406c8f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61f4159e40 0x7f61f415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f40cd430 0x7f61f4136810 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 --2- 172.21.15.49:0/1461640772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61f40b0a00 0x7f61f414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 >> 172.21.15.49:0/1461640772 conn(0x7f61f40659a0 msgr2=0x7f61f406f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:55.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 shutdown_connections 2023-12-19T05:44:55.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.256+0000 7f61f8b57640 1 -- 172.21.15.49:0/1461640772 wait complete. 2023-12-19T05:44:55.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:44:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.523+0000 7f61db5fd640 1 Processor -- start 2023-12-19T05:44:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.524+0000 7f61db5fd640 1 -- start start 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.525+0000 7f61db5fd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61d415b290 0x7f61d40ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61db5fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61d40cf740 0x7f61d406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61db5fd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40d0c50 con 0x7f61d406dc50 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61db5fd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40d00b0 con 0x7f61d40cf740 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61db5fd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d406e600 con 0x7f61d415b290 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61d8b98640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f61d406dc50 0x7f61d40cf030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60256/0 (socket says 172.21.15.49:60256) 2023-12-19T05:44:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61d8b98640 1 -- 172.21.15.49:0/804559010 learned_addr learned my addr 172.21.15.49:0/804559010 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/804559010 >> v2:172.21.15.49:3300/0 conn(0x7f61d40cf740 0x7f61d406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.526+0000 7f61d9399640 1 --2- 172.21.15.49:0/804559010 >> v2:172.21.15.115:3300/0 conn(0x7f61d415b290 0x7f61d40ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.527+0000 7f61d9b9a640 1 -- 172.21.15.49:0/804559010 >> v2:172.21.15.115:3300/0 conn(0x7f61d415b290 msgr2=0x7f61d40ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.527+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/804559010 >> v2:172.21.15.115:3300/0 conn(0x7f61d415b290 0x7f61d40ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.527+0000 7f61d9b9a640 1 -- 172.21.15.49:0/804559010 >> v1:172.21.15.49:6789/0 conn(0x7f61d406dc50 legacy=0x7f61d40cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.527+0000 7f61d9b9a640 1 -- 172.21.15.49:0/804559010 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40cfb40 con 0x7f61d40cf740 2023-12-19T05:44:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.528+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/804559010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d40cf740 0x7f61d406e0c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f61d40d04a0 tx=0x7f61cc02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29071aacfeb4ea64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.528+0000 7f61cbfff640 1 -- 172.21.15.49:0/804559010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02cbe0 con 0x7f61d40cf740 2023-12-19T05:44:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.528+0000 7f61cbfff640 1 -- 172.21.15.49:0/804559010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc02cd40 con 0x7f61d40cf740 2023-12-19T05:44:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.528+0000 7f61cbfff640 1 -- 172.21.15.49:0/804559010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc034660 con 0x7f61d40cf740 2023-12-19T05:44:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 -- 172.21.15.49:0/804559010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d40cf740 msgr2=0x7f61d406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 --2- 172.21.15.49:0/804559010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d40cf740 0x7f61d406e0c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f61d40d04a0 tx=0x7f61cc02be30 comp rx=0 tx=0).stop 2023-12-19T05:44:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 -- 172.21.15.49:0/804559010 shutdown_connections 2023-12-19T05:44:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 --2- 172.21.15.49:0/804559010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d40cf740 0x7f61d406e0c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 --2- 172.21.15.49:0/804559010 >> v2:172.21.15.115:3300/0 conn(0x7f61d415b290 0x7f61d40ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 -- 172.21.15.49:0/804559010 >> 172.21.15.49:0/804559010 conn(0x7f61d4071370 msgr2=0x7f61d4071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 -- 172.21.15.49:0/804559010 shutdown_connections 2023-12-19T05:44:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.529+0000 7f61db5fd640 1 -- 172.21.15.49:0/804559010 wait complete. 2023-12-19T05:44:55.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.531+0000 7f61db5fd640 1 Processor -- start 2023-12-19T05:44:55.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.531+0000 7f61db5fd640 1 -- start start 2023-12-19T05:44:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 0x7f61d414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 0x7f61d4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d414b760 con 0x7f61d415b290 2023-12-19T05:44:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40b1c70 con 0x7f61d406dc50 2023-12-19T05:44:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61db5fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41f2dc0 con 0x7f61d40cf740 2023-12-19T05:44:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61d9b9a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61d9b9a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39910/0 (socket says 172.21.15.49:39910) 2023-12-19T05:44:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.532+0000 7f61d9b9a640 1 -- 172.21.15.49:0/998056590 learned_addr learned my addr 172.21.15.49:0/998056590 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 -- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 msgr2=0x7f61d4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9399640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 0x7f61d414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d8b98640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 0x7f61d4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 0x7f61d4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 -- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 msgr2=0x7f61d414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 0x7f61d414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 -- 172.21.15.49:0/998056590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009a70 con 0x7f61d415b290 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9399640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 0x7f61d414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d8b98640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 0x7f61d4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61d9b9a640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f61cc037040 tx=0x7f61cc004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc040650 con 0x7f61d415b290 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0407b0 con 0x7f61d415b290 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d41f30a0 con 0x7f61d415b290 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.533+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc040b60 con 0x7f61d415b290 2023-12-19T05:44:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.534+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d41f3660 con 0x7f61d415b290 2023-12-19T05:44:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.535+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d4061910 con 0x7f61d415b290 2023-12-19T05:44:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.536+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61cc040cc0 con 0x7f61d415b290 2023-12-19T05:44:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.537+0000 7f61c9ffb640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.537+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f61cc0ab730 con 0x7f61d415b290 2023-12-19T05:44:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.537+0000 7f61d9399640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.538+0000 7f61d9399640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61d0006fd0 tx=0x7f61d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.541+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61cc076d20 con 0x7f61d415b290 2023-12-19T05:44:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:55.737+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61d40cd580 con 0x7f61d415b290 2023-12-19T05:44:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.520+0000 7f61c9ffb640 1 -- 172.21.15.49:0/998056590 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f61cc009450 con 0x7f61d415b290 2023-12-19T05:44:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:44:56.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 msgr2=0x7f61b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61d0006fd0 tx=0x7f61d0008040 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 msgr2=0x7f61d415db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f61cc037040 tx=0x7f61cc004a90 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 shutdown_connections 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d40cf740 0x7f61d4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d415b290 0x7f61d415db70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 --2- 172.21.15.49:0/998056590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d406dc50 0x7f61d414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.524+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 >> 172.21.15.49:0/998056590 conn(0x7f61d4071370 msgr2=0x7f61d40b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.525+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 shutdown_connections 2023-12-19T05:44:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.525+0000 7f61db5fd640 1 -- 172.21.15.49:0/998056590 wait complete. 2023-12-19T05:44:56.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:44:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.795+0000 7f47992b2640 1 Processor -- start 2023-12-19T05:44:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.795+0000 7f47992b2640 1 -- start start 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f47992b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f479406c460 0x7f47940ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f47992b2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47940cd3a0 0x7f479415b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f47992b2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47940cda60 con 0x7f479406c080 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f47992b2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479415b6d0 con 0x7f479406c460 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f47992b2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47940cdd40 con 0x7f47940cd3a0 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f4792ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f479406c080 0x7f47940c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60262/0 (socket says 172.21.15.49:60262) 2023-12-19T05:44:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.797+0000 7f4792ffd640 1 -- 172.21.15.49:0/2349185852 learned_addr learned my addr 172.21.15.49:0/2349185852 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47927fc640 1 --2- 172.21.15.49:0/2349185852 >> v2:172.21.15.49:3300/0 conn(0x7f479406c460 0x7f47940ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47937fe640 1 --2- 172.21.15.49:0/2349185852 >> v2:172.21.15.115:3300/0 conn(0x7f47940cd3a0 0x7f479415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47927fc640 1 -- 172.21.15.49:0/2349185852 >> v2:172.21.15.115:3300/0 conn(0x7f47940cd3a0 msgr2=0x7f479415b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47927fc640 1 --2- 172.21.15.49:0/2349185852 >> v2:172.21.15.115:3300/0 conn(0x7f47940cd3a0 0x7f479415b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47927fc640 1 -- 172.21.15.49:0/2349185852 >> v1:172.21.15.49:6789/0 conn(0x7f479406c080 legacy=0x7f47940c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.798+0000 7f47927fc640 1 -- 172.21.15.49:0/2349185852 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940ce020 con 0x7f479406c460 2023-12-19T05:44:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.799+0000 7f47927fc640 1 --2- 172.21.15.49:0/2349185852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c460 0x7f47940ceb00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f4794065f30 tx=0x7f478802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb37cb750b41723b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.800+0000 7f4791ffb640 1 -- 172.21.15.49:0/2349185852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788031830 con 0x7f479406c460 2023-12-19T05:44:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.800+0000 7f4791ffb640 1 -- 172.21.15.49:0/2349185852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788031990 con 0x7f479406c460 2023-12-19T05:44:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.800+0000 7f4791ffb640 1 -- 172.21.15.49:0/2349185852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788031d20 con 0x7f479406c460 2023-12-19T05:44:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 -- 172.21.15.49:0/2349185852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c460 msgr2=0x7f47940ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 --2- 172.21.15.49:0/2349185852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c460 0x7f47940ceb00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f4794065f30 tx=0x7f478802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 -- 172.21.15.49:0/2349185852 shutdown_connections 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 --2- 172.21.15.49:0/2349185852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c460 0x7f47940ceb00 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 --2- 172.21.15.49:0/2349185852 >> v2:172.21.15.115:3300/0 conn(0x7f47940cd3a0 0x7f479415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 -- 172.21.15.49:0/2349185852 >> 172.21.15.49:0/2349185852 conn(0x7f47940cf7d0 msgr2=0x7f47940cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 -- 172.21.15.49:0/2349185852 shutdown_connections 2023-12-19T05:44:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.801+0000 7f47992b2640 1 -- 172.21.15.49:0/2349185852 wait complete. 2023-12-19T05:44:56.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.803+0000 7f47992b2640 1 Processor -- start 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.803+0000 7f47992b2640 1 -- start start 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f479406c460 0x7f47940acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47940cd3a0 0x7f4794143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47940ad1a0 con 0x7f479406c080 2023-12-19T05:44:56.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47940ad480 con 0x7f479406c460 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f47992b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47940ad760 con 0x7f47940cd3a0 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f4792ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f4792ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39936/0 (socket says 172.21.15.49:39936) 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.804+0000 7f4792ffd640 1 -- 172.21.15.49:0/659785117 learned_addr learned my addr 172.21.15.49:0/659785117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f47927fc640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f479406c460 0x7f47940acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f47937fe640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47940cd3a0 0x7f4794143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 -- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47940cd3a0 msgr2=0x7f4794143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47940cd3a0 0x7f4794143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 -- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f479406c460 msgr2=0x7f47940acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f479406c460 0x7f47940acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 -- 172.21.15.49:0/659785117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788009400 con 0x7f479406c080 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f4792ffd640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f478400c480 tx=0x7f478400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:56.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.805+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784005ce0 con 0x7f479406c080 2023-12-19T05:44:56.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.806+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784005e40 con 0x7f479406c080 2023-12-19T05:44:56.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.806+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840072f0 con 0x7f479406c080 2023-12-19T05:44:56.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.806+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47940ada40 con 0x7f479406c080 2023-12-19T05:44:56.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.806+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794143970 con 0x7f479406c080 2023-12-19T05:44:56.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.807+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4794143b60 con 0x7f479406c080 2023-12-19T05:44:56.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.808+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4784007510 con 0x7f479406c080 2023-12-19T05:44:56.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.809+0000 7f477b7fe640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 0x7f478006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:56.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.809+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f4784087d20 con 0x7f479406c080 2023-12-19T05:44:56.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.810+0000 7f47927fc640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 0x7f478006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:56.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.811+0000 7f47927fc640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 0x7f478006c8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4788036000 tx=0x7f478803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:56.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:56.814+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47840534d0 con 0x7f479406c080 2023-12-19T05:44:57.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.013+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4794061910 con 0x7f479406c080 2023-12-19T05:44:57.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:57.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.529+0000 7f477b7fe640 1 -- 172.21.15.49:0/659785117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f47840170d0 con 0x7f479406c080 2023-12-19T05:44:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:44:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.534+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 msgr2=0x7f478006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.534+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 0x7f478006c8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4788036000 tx=0x7f478803c040 comp rx=0 tx=0).stop 2023-12-19T05:44:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.534+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 msgr2=0x7f47940afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.534+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f478400c480 tx=0x7f478400c940 comp rx=0 tx=0).stop 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 shutdown_connections 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f478006a430 0x7f478006c8f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47940cd3a0 0x7f4794143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f479406c460 0x7f47940acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 --2- 172.21.15.49:0/659785117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f479406c080 0x7f47940afe60 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.535+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 >> 172.21.15.49:0/659785117 conn(0x7f47940cf7d0 msgr2=0x7f479415d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:57.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.536+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 shutdown_connections 2023-12-19T05:44:57.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.536+0000 7f47992b2640 1 -- 172.21.15.49:0/659785117 wait complete. 2023-12-19T05:44:57.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:44:57.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.785+0000 7fd1c0a0a640 1 Processor -- start 2023-12-19T05:44:57.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.785+0000 7fd1c0a0a640 1 -- start start 2023-12-19T05:44:57.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.787+0000 7fd1c0a0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 0x7fd1bc0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.787+0000 7fd1c0a0a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1bc0cd430 0x7fd1bc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.787+0000 7fd1c0a0a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc06b3a0 con 0x7fd1bc159e40 2023-12-19T05:44:57.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.787+0000 7fd1c0a0a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b23e0 con 0x7fd1bc0cd430 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.787+0000 7fd1c0a0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cd8a0 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 0x7fd1bc0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1bc0cd430 0x7fd1bc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1bc0cd430 0x7fd1bc06b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38996/0 (socket says 172.21.15.49:38996) 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 -- 172.21.15.49:0/1134426062 learned_addr learned my addr 172.21.15.49:0/1134426062 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 0x7fd1bc0b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:58606/0 (socket says 172.21.15.49:58606) 2023-12-19T05:44:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 -- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 msgr2=0x7fd1bc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 --2- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 0x7fd1bc0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 -- 172.21.15.49:0/1134426062 >> v1:172.21.15.115:6789/0 conn(0x7fd1bc159e40 legacy=0x7fd1bc0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.788+0000 7fd1bb59e640 1 -- 172.21.15.49:0/1134426062 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0b1860 con 0x7fd1bc0cd430 2023-12-19T05:44:57.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.790+0000 7fd1bb59e640 1 --2- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc0cd430 0x7fd1bc06b810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e50 tx=0x7fd1b402bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9a8c73b08f77b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:57.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.790+0000 7fd1ba59c640 1 -- 172.21.15.49:0/1134426062 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b402cb90 con 0x7fd1bc0cd430 2023-12-19T05:44:57.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.790+0000 7fd1ba59c640 1 -- 172.21.15.49:0/1134426062 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b402ccf0 con 0x7fd1bc0cd430 2023-12-19T05:44:57.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.790+0000 7fd1ba59c640 1 -- 172.21.15.49:0/1134426062 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4034610 con 0x7fd1bc0cd430 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc0cd430 msgr2=0x7fd1bc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc0cd430 0x7fd1bc06b810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e50 tx=0x7fd1b402bff0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1134426062 shutdown_connections 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc0cd430 0x7fd1bc06b810 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1134426062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0b0a00 0x7fd1bc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1134426062 >> 172.21.15.49:0/1134426062 conn(0x7fd1bc0659a0 msgr2=0x7fd1bc065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1134426062 shutdown_connections 2023-12-19T05:44:57.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.791+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1134426062 wait complete. 2023-12-19T05:44:57.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.793+0000 7fd1c0a0a640 1 Processor -- start 2023-12-19T05:44:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.793+0000 7fd1c0a0a640 1 -- start start 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.794+0000 7fd1c0a0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.794+0000 7fd1c0a0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0cd430 0x7fd1bc15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.794+0000 7fd1c0a0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc159e40 0x7fd1bc144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.794+0000 7fd1c0a0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc147300 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1c0a0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1475d0 con 0x7fd1bc159e40 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1c0a0a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1478b0 con 0x7fd1bc0cd430 2023-12-19T05:44:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39950/0 (socket says 172.21.15.49:39950) 2023-12-19T05:44:57.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 -- 172.21.15.49:0/1133655592 learned_addr learned my addr 172.21.15.49:0/1133655592 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bb59e640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc159e40 0x7fd1bc144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1b3fff640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0cd430 0x7fd1bc15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 -- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0cd430 msgr2=0x7fd1bc15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0cd430 0x7fd1bc15ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 -- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc159e40 msgr2=0x7fd1bc144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc159e40 0x7fd1bc144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:57.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.795+0000 7fd1bad9d640 1 -- 172.21.15.49:0/1133655592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009b30 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1bad9d640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c450 tx=0x7fd1ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0052d0 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac005430 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac012870 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc147b90 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.796+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc148150 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.797+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc0afc70 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.798+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1ac0129d0 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.799+0000 7fd1b37fe640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 0x7fd19c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:57.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.799+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1ac088180 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.800+0000 7fd1b3fff640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 0x7fd19c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:57.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.801+0000 7fd1b3fff640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 0x7fd19c06c8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc070be0 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:57.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.804+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1ac053a70 con 0x7fd1bc0b0a00 2023-12-19T05:44:57.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:57.997+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd1bc061910 con 0x7fd1bc0b0a00 2023-12-19T05:44:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.004+0000 7fd1b37fe640 1 -- 172.21.15.49:0/1133655592 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1ac057090 con 0x7fd1bc0b0a00 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 msgr2=0x7fd19c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 0x7fd19c06c8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc070be0 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 msgr2=0x7fd1bc1f42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c450 tx=0x7fd1ac00c910 comp rx=0 tx=0).stop 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 shutdown_connections 2023-12-19T05:44:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd19c06a430 0x7fd19c06c8f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1bc0cd430 0x7fd1bc15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1bc159e40 0x7fd1bc144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 --2- 172.21.15.49:0/1133655592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc0b0a00 0x7fd1bc1f42d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 >> 172.21.15.49:0/1133655592 conn(0x7fd1bc0659a0 msgr2=0x7fd1bc0ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 shutdown_connections 2023-12-19T05:44:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.007+0000 7fd1c0a0a640 1 -- 172.21.15.49:0/1133655592 wait complete. 2023-12-19T05:44:58.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-19T05:44:58.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.262+0000 7f257e94e640 1 Processor -- start 2023-12-19T05:44:58.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.262+0000 7f257e94e640 1 -- start start 2023-12-19T05:44:58.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.263+0000 7f257e94e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 0x7f25780d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f257e94e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25780ce110 0x7f25780ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f257e94e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25780cd840 con 0x7f25780d2b00 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f257e94e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780d2430 con 0x7f25780ce110 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f257e94e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25780ceae0 con 0x7f2578146e10 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f25777fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25780d2b00 0x7f25780b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60270/0 (socket says 172.21.15.49:60270) 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f25777fe640 1 -- 172.21.15.49:0/4153449027 learned_addr learned my addr 172.21.15.49:0/4153449027 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f257ceeb640 1 --2- 172.21.15.49:0/4153449027 >> v2:172.21.15.49:3300/0 conn(0x7f25780ce110 0x7f25780ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.264+0000 7f2577fff640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 0x7f25780d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.265+0000 7f257ceeb640 1 -- 172.21.15.49:0/4153449027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 msgr2=0x7f25780d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.265+0000 7f257ceeb640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 0x7f25780d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.265+0000 7f257ceeb640 1 -- 172.21.15.49:0/4153449027 >> v1:172.21.15.49:6789/0 conn(0x7f25780d2b00 legacy=0x7f25780b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.265+0000 7f257ceeb640 1 -- 172.21.15.49:0/4153449027 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25780b6e90 con 0x7f25780ce110 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.265+0000 7f2577fff640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 0x7f25780d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:44:58.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.266+0000 7f257ceeb640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780ce110 0x7f25780ce5a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f25700097d0 tx=0x7f257002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7257480737186633 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:58.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.267+0000 7f2576ffd640 1 -- 172.21.15.49:0/4153449027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570031800 con 0x7f25780ce110 2023-12-19T05:44:58.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.267+0000 7f2576ffd640 1 -- 172.21.15.49:0/4153449027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570031960 con 0x7f25780ce110 2023-12-19T05:44:58.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.267+0000 7f2576ffd640 1 -- 172.21.15.49:0/4153449027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570031cf0 con 0x7f25780ce110 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.267+0000 7f257e94e640 1 -- 172.21.15.49:0/4153449027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780ce110 msgr2=0x7f25780ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.267+0000 7f257e94e640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780ce110 0x7f25780ce5a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f25700097d0 tx=0x7f257002b8a0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 -- 172.21.15.49:0/4153449027 shutdown_connections 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780ce110 0x7f25780ce5a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 --2- 172.21.15.49:0/4153449027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2578146e10 0x7f25780d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 -- 172.21.15.49:0/4153449027 >> 172.21.15.49:0/4153449027 conn(0x7f25780b29c0 msgr2=0x7f25780b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 -- 172.21.15.49:0/4153449027 shutdown_connections 2023-12-19T05:44:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.268+0000 7f257e94e640 1 -- 172.21.15.49:0/4153449027 wait complete. 2023-12-19T05:44:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.270+0000 7f257e94e640 1 Processor -- start 2023-12-19T05:44:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.270+0000 7f257e94e640 1 -- start start 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 0x7f257813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 0x7f25780d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578142e10 con 0x7f25780d2b00 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578143230 con 0x7f2578146e10 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f257e94e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578141ed0 con 0x7f25780ce110 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f25777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f25777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39980/0 (socket says 172.21.15.49:39980) 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.271+0000 7f25777fe640 1 -- 172.21.15.49:0/4247175075 learned_addr learned my addr 172.21.15.49:0/4247175075 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f2577fff640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 0x7f257813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f257ceeb640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 0x7f25780d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 -- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 msgr2=0x7f257813fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 0x7f257813fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 -- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 msgr2=0x7f25780d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 0x7f25780d33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 -- 172.21.15.49:0/4247175075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009400 con 0x7f25780d2b00 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f2577fff640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 0x7f257813fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f257ceeb640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 0x7f25780d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f25777fe640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f256000c4a0 tx=0x7f256000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560005ce0 con 0x7f25780d2b00 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560005e40 con 0x7f25780d2b00 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560007270 con 0x7f25780d2b00 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578142190 con 0x7f25780d2b00 2023-12-19T05:44:58.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.272+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2578142750 con 0x7f25780d2b00 2023-12-19T05:44:58.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.274+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2578061910 con 0x7f25780d2b00 2023-12-19T05:44:58.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.275+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25600073d0 con 0x7f25780d2b00 2023-12-19T05:44:58.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.276+0000 7f2574ff9640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 0x7f255806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:58.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.276+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2560087ab0 con 0x7f25780d2b00 2023-12-19T05:44:58.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.277+0000 7f2577fff640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 0x7f255806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:58.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.278+0000 7f2577fff640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 0x7f255806c940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2568009540 tx=0x7f256800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:58.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.281+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2560053430 con 0x7f25780d2b00 2023-12-19T05:44:58.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:58.556+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f25780b6040 con 0x7f25780d2b00 2023-12-19T05:44:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.554+0000 7f2574ff9640 1 -- 172.21.15.49:0/4247175075 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v305) v1 ==== 133+0+0 (secure 0 0 0) 0x7f25600170c0 con 0x7f25780d2b00 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 msgr2=0x7f255806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 0x7f255806c940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2568009540 tx=0x7f256800b040 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 msgr2=0x7f2578143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f256000c4a0 tx=0x7f256000c960 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 shutdown_connections 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f255806a480 0x7f255806c940 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2578146e10 0x7f25780d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780d2b00 0x7f2578143560 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 --2- 172.21.15.49:0/4247175075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25780ce110 0x7f257813fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 >> 172.21.15.49:0/4247175075 conn(0x7f25780b29c0 msgr2=0x7f25780b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 shutdown_connections 2023-12-19T05:44:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.558+0000 7f257e94e640 1 -- 172.21.15.49:0/4247175075 wait complete. 2023-12-19T05:44:59.581 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-19T05:44:59.581 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-19T05:44:59.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:44:59.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.818+0000 7efc18a30640 1 Processor -- start 2023-12-19T05:44:59.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.818+0000 7efc18a30640 1 -- start start 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc18a30640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc1415e5a0 0x7efc140b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc18a30640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc1415f680 0x7efc140b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc18a30640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1415ec30 con 0x7efc140cdbf0 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc18a30640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc140b2cc0 con 0x7efc1415e5a0 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc18a30640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1415e980 con 0x7efc1415f680 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.820+0000 7efc12d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc1415e5a0 0x7efc140b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc1415e5a0 0x7efc140b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39982/0 (socket says 172.21.15.49:39982) 2023-12-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 -- 172.21.15.49:0/2629632117 learned_addr learned my addr 172.21.15.49:0/2629632117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:59.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc1259c640 1 --2- 172.21.15.49:0/2629632117 >> v2:172.21.15.115:3300/0 conn(0x7efc1415f680 0x7efc140b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 -- 172.21.15.49:0/2629632117 >> v2:172.21.15.115:3300/0 conn(0x7efc1415f680 msgr2=0x7efc140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:44:59.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 --2- 172.21.15.49:0/2629632117 >> v2:172.21.15.115:3300/0 conn(0x7efc1415f680 0x7efc140b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 -- 172.21.15.49:0/2629632117 >> v1:172.21.15.115:6789/0 conn(0x7efc140cdbf0 legacy=0x7efc1406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.821+0000 7efc12d9d640 1 -- 172.21.15.49:0/2629632117 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140b2f90 con 0x7efc1415e5a0 2023-12-19T05:44:59.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.823+0000 7efc12d9d640 1 --2- 172.21.15.49:0/2629632117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc1415e5a0 0x7efc140b2030 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efc04009870 tx=0x7efc0402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4681ec4eddb80c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:59.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.823+0000 7efc11d9b640 1 -- 172.21.15.49:0/2629632117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04030860 con 0x7efc1415e5a0 2023-12-19T05:44:59.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.823+0000 7efc11d9b640 1 -- 172.21.15.49:0/2629632117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc040309c0 con 0x7efc1415e5a0 2023-12-19T05:44:59.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.823+0000 7efc11d9b640 1 -- 172.21.15.49:0/2629632117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04030d50 con 0x7efc1415e5a0 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 -- 172.21.15.49:0/2629632117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc1415e5a0 msgr2=0x7efc140b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 --2- 172.21.15.49:0/2629632117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc1415e5a0 0x7efc140b2030 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efc04009870 tx=0x7efc0402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 -- 172.21.15.49:0/2629632117 shutdown_connections 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 --2- 172.21.15.49:0/2629632117 >> v2:172.21.15.115:3300/0 conn(0x7efc1415f680 0x7efc140b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 --2- 172.21.15.49:0/2629632117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc1415e5a0 0x7efc140b2030 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 -- 172.21.15.49:0/2629632117 >> 172.21.15.49:0/2629632117 conn(0x7efc140b0100 msgr2=0x7efc140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 -- 172.21.15.49:0/2629632117 shutdown_connections 2023-12-19T05:44:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.824+0000 7efc18a30640 1 -- 172.21.15.49:0/2629632117 wait complete. 2023-12-19T05:44:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.826+0000 7efc18a30640 1 Processor -- start 2023-12-19T05:44:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.826+0000 7efc18a30640 1 -- start start 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 0x7efc14155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 0x7efc14155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14152800 con 0x7efc140cdbf0 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c8ab0 con 0x7efc1415e5a0 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.827+0000 7efc18a30640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c87d0 con 0x7efc1415f680 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39998/0 (socket says 172.21.15.49:39998) 2023-12-19T05:44:59.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 -- 172.21.15.49:0/3669048334 learned_addr learned my addr 172.21.15.49:0/3669048334 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc1259c640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 0x7efc14155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc1359e640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 0x7efc14155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 -- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 msgr2=0x7efc14155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 0x7efc14155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 -- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 msgr2=0x7efc14155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 0x7efc14155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc12d9d640 1 -- 172.21.15.49:0/3669048334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040094d0 con 0x7efc140cdbf0 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc1259c640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 0x7efc14155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.828+0000 7efc1359e640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 0x7efc14155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efc12d9d640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efc0402b9e0 tx=0x7efc04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04039c90 con 0x7efc140cdbf0 2023-12-19T05:44:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04039df0 con 0x7efc140cdbf0 2023-12-19T05:44:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc14152140 con 0x7efc140cdbf0 2023-12-19T05:44:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040446c0 con 0x7efc140cdbf0 2023-12-19T05:44:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.829+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc14148980 con 0x7efc140cdbf0 2023-12-19T05:44:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.830+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14151fa0 con 0x7efc140cdbf0 2023-12-19T05:44:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.831+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc0404d3b0 con 0x7efc140cdbf0 2023-12-19T05:44:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.832+0000 7efbfb7fe640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 0x7efc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:44:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.832+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc0403e070 con 0x7efc140cdbf0 2023-12-19T05:44:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.833+0000 7efc1259c640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 0x7efc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:44:59.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.834+0000 7efc1259c640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 0x7efc0006c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc08006fd0 tx=0x7efc08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:44:59.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:44:59.836+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc040ddc80 con 0x7efc140cdbf0 2023-12-19T05:45:00.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.030+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc14061910 con 0x7efc140cdbf0 2023-12-19T05:45:00.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.032+0000 7efbfb7fe640 1 -- 172.21.15.49:0/3669048334 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+12522 (secure 0 0 0) 0x7efc14151fa0 con 0x7efc140cdbf0 2023-12-19T05:45:00.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:00.034 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":101,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:44:57.517029+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6837/3621171871":"2023-12-20T05:44:54.230363+0000","172.21.15.115:6835/3621171871":"2023-12-20T05:44:54.230363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 msgr2=0x7efc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 0x7efc0006c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc08006fd0 tx=0x7efc08008040 comp rx=0 tx=0).stop 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 msgr2=0x7efc141f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efc0402b9e0 tx=0x7efc04004730 comp rx=0 tx=0).stop 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 shutdown_connections 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc0006a430 0x7efc0006c8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc1415f680 0x7efc14155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc1415e5a0 0x7efc14155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 --2- 172.21.15.49:0/3669048334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc140cdbf0 0x7efc141f2340 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 >> 172.21.15.49:0/3669048334 conn(0x7efc140b0100 msgr2=0x7efc1415aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:00.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.034+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 shutdown_connections 2023-12-19T05:45:00.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.035+0000 7efc18a30640 1 -- 172.21.15.49:0/3669048334 wait complete. 2023-12-19T05:45:00.057 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:00.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.294+0000 7fe2bf59e640 1 Processor -- start 2023-12-19T05:45:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.295+0000 7fe2bf59e640 1 -- start start 2023-12-19T05:45:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.296+0000 7fe2bf59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2c014acd0 0x7fe2c00afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.296+0000 7fe2bf59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2c00b1e60 0x7fe2c00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.296+0000 7fe2bf59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c00b2410 con 0x7fe2c014b0b0 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.296+0000 7fe2bf59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00b26f0 con 0x7fe2c014acd0 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.296+0000 7fe2bf59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00ce030 con 0x7fe2c00b1e60 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2c014acd0 0x7fe2c00afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2c014acd0 0x7fe2c00afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40006/0 (socket says 172.21.15.49:40006) 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 -- 172.21.15.49:0/305749304 learned_addr learned my addr 172.21.15.49:0/305749304 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2bed9d640 1 --2- 172.21.15.49:0/305749304 >> v2:172.21.15.115:3300/0 conn(0x7fe2c00b1e60 0x7fe2c00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 -- 172.21.15.49:0/305749304 >> v2:172.21.15.115:3300/0 conn(0x7fe2c00b1e60 msgr2=0x7fe2c00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 --2- 172.21.15.49:0/305749304 >> v2:172.21.15.115:3300/0 conn(0x7fe2c00b1e60 0x7fe2c00b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 -- 172.21.15.49:0/305749304 >> v1:172.21.15.115:6789/0 conn(0x7fe2c014b0b0 legacy=0x7fe2c00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.297+0000 7fe2be59c640 1 -- 172.21.15.49:0/305749304 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00ce310 con 0x7fe2c014acd0 2023-12-19T05:45:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.298+0000 7fe2be59c640 1 --2- 172.21.15.49:0/305749304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014acd0 0x7fe2c00afd60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00718d0 tx=0x7fe2b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c187771443310c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bdd9b640 1 -- 172.21.15.49:0/305749304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0031870 con 0x7fe2c014acd0 2023-12-19T05:45:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bdd9b640 1 -- 172.21.15.49:0/305749304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00319d0 con 0x7fe2c014acd0 2023-12-19T05:45:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bdd9b640 1 -- 172.21.15.49:0/305749304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0031d60 con 0x7fe2c014acd0 2023-12-19T05:45:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 -- 172.21.15.49:0/305749304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014acd0 msgr2=0x7fe2c00afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/305749304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014acd0 0x7fe2c00afd60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00718d0 tx=0x7fe2b002b910 comp rx=0 tx=0).stop 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 -- 172.21.15.49:0/305749304 shutdown_connections 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/305749304 >> v2:172.21.15.115:3300/0 conn(0x7fe2c00b1e60 0x7fe2c00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/305749304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014acd0 0x7fe2c00afd60 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.299+0000 7fe2bf59e640 1 -- 172.21.15.49:0/305749304 >> 172.21.15.49:0/305749304 conn(0x7fe2c006f630 msgr2=0x7fe2c006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.300+0000 7fe2bf59e640 1 -- 172.21.15.49:0/305749304 shutdown_connections 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.300+0000 7fe2bf59e640 1 -- 172.21.15.49:0/305749304 wait complete. 2023-12-19T05:45:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.301+0000 7fe2bf59e640 1 Processor -- start 2023-12-19T05:45:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.302+0000 7fe2bf59e640 1 -- start start 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.302+0000 7fe2bf59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 0x7fe2c00c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bf59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 0x7fe2c013af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bf59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bf59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c7bb0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bf59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c7e90 con 0x7fe2c014acd0 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bf59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c8170 con 0x7fe2c00b1e60 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40010/0 (socket says 172.21.15.49:40010) 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 -- 172.21.15.49:0/3921724400 learned_addr learned my addr 172.21.15.49:0/3921724400 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2be59c640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 0x7fe2c00c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2b7fff640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 0x7fe2c013af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 -- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 msgr2=0x7fe2c00c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 0x7fe2c00c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 -- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 msgr2=0x7fe2c013af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 0x7fe2c013af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2bed9d640 1 -- 172.21.15.49:0/3921724400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00094d0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2be59c640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 0x7fe2c00c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.303+0000 7fe2b7fff640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 0x7fe2c013af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2bed9d640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800cd70 tx=0x7fe2b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8003b90 con 0x7fe2c014b0b0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8003cf0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004240 con 0x7fe2c014b0b0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00c8450 con 0x7fe2c014b0b0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.304+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00c7840 con 0x7fe2c014b0b0 2023-12-19T05:45:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.305+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c0061910 con 0x7fe2c014b0b0 2023-12-19T05:45:00.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.306+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2b80043a0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.307+0000 7fe2b6ffd640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 0x7fe2a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.307+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2b8012070 con 0x7fe2c014b0b0 2023-12-19T05:45:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.308+0000 7fe2be59c640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 0x7fe2a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.309+0000 7fe2be59c640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 0x7fe2a006c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0036000 tx=0x7fe2b003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.312+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2b80548d0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.513+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2c00b2ec0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.514+0000 7fe2b6ffd640 1 -- 172.21.15.49:0/3921724400 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2b8057ef0 con 0x7fe2c014b0b0 2023-12-19T05:45:00.516 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 msgr2=0x7fe2a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 0x7fe2a006c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0036000 tx=0x7fe2b003c040 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 msgr2=0x7fe2c013b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800cd70 tx=0x7fe2b800a660 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 shutdown_connections 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe2a006a430 0x7fe2a006c8f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2c014b0b0 0x7fe2c013b480 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c014acd0 0x7fe2c013af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 --2- 172.21.15.49:0/3921724400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c00b1e60 0x7fe2c00c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 >> 172.21.15.49:0/3921724400 conn(0x7fe2c006f630 msgr2=0x7fe2c006dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 shutdown_connections 2023-12-19T05:45:00.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.518+0000 7fe2bf59e640 1 -- 172.21.15.49:0/3921724400 wait complete. 2023-12-19T05:45:00.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-19T05:45:00.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.771+0000 7f3cd0b63640 1 Processor -- start 2023-12-19T05:45:00.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.771+0000 7f3cd0b63640 1 -- start start 2023-12-19T05:45:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.772+0000 7f3cd0b63640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cd0b63640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc0cd840 con 0x7f3ccc0d2b00 2023-12-19T05:45:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cd0b63640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc0b6e90 con 0x7f3ccc0ce110 2023-12-19T05:45:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cd0b63640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0d2430 con 0x7f3ccc146e10 2023-12-19T05:45:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cca59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cca59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40026/0 (socket says 172.21.15.49:40026) 2023-12-19T05:45:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cca59c640 1 -- 172.21.15.49:0/936103794 learned_addr learned my addr 172.21.15.49:0/936103794 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.773+0000 7f3cca59c640 1 -- 172.21.15.49:0/936103794 >> v1:172.21.15.115:6789/0 conn(0x7f3ccc0ce110 legacy=0x7f3ccc0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.774+0000 7f3cca59c640 1 -- 172.21.15.49:0/936103794 >> v1:172.21.15.49:6789/0 conn(0x7f3ccc0d2b00 legacy=0x7f3ccc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.774+0000 7f3cca59c640 1 -- 172.21.15.49:0/936103794 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0d2620 con 0x7f3ccc146e10 2023-12-19T05:45:00.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.775+0000 7f3cca59c640 1 --2- 172.21.15.49:0/936103794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009870 tx=0x7f3cbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68b49742adcf3ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.775+0000 7f3cc959a640 1 -- 172.21.15.49:0/936103794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc031870 con 0x7f3ccc146e10 2023-12-19T05:45:00.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.775+0000 7f3cc959a640 1 -- 172.21.15.49:0/936103794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0319d0 con 0x7f3ccc146e10 2023-12-19T05:45:00.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.775+0000 7f3cc959a640 1 -- 172.21.15.49:0/936103794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc031d60 con 0x7f3ccc146e10 2023-12-19T05:45:00.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 -- 172.21.15.49:0/936103794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 msgr2=0x7f3ccc0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/936103794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009870 tx=0x7f3cbc02b910 comp rx=0 tx=0).stop 2023-12-19T05:45:00.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 -- 172.21.15.49:0/936103794 shutdown_connections 2023-12-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/936103794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc0d1ef0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 -- 172.21.15.49:0/936103794 >> 172.21.15.49:0/936103794 conn(0x7f3ccc0b29c0 msgr2=0x7f3ccc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 -- 172.21.15.49:0/936103794 shutdown_connections 2023-12-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.776+0000 7f3cd0b63640 1 -- 172.21.15.49:0/936103794 wait complete. 2023-12-19T05:45:00.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.778+0000 7f3cd0b63640 1 Processor -- start 2023-12-19T05:45:00.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.778+0000 7f3cd0b63640 1 -- start start 2023-12-19T05:45:00.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 0x7f3ccc0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 0x7f3ccc0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0cd440 con 0x7f3ccc146e10 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc14c340 con 0x7f3ccc0ce110 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cd0b63640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0cc8c0 con 0x7f3ccc0d2b00 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3ccad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3ccad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40034/0 (socket says 172.21.15.49:40034) 2023-12-19T05:45:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3ccad9d640 1 -- 172.21.15.49:0/2400366367 learned_addr learned my addr 172.21.15.49:0/2400366367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:00.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cca59c640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 0x7f3ccc0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3ccad9d640 1 -- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 msgr2=0x7f3ccc0cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.779+0000 7f3cc9d9b640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 0x7f3ccc0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3ccad9d640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 0x7f3ccc0cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3ccad9d640 1 -- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 msgr2=0x7f3ccc0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3ccad9d640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 0x7f3ccc0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3ccad9d640 1 -- 172.21.15.49:0/2400366367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0094d0 con 0x7f3ccc146e10 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cca59c640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 0x7f3ccc0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cc9d9b640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 0x7f3ccc0cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3ccad9d640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c7b0 tx=0x7f3cc400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004b60 con 0x7f3ccc146e10 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4004cc0 con 0x7f3ccc146e10 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc0ccba0 con 0x7f3ccc146e10 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400aa90 con 0x7f3ccc146e10 2023-12-19T05:45:00.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.780+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0cd160 con 0x7f3ccc146e10 2023-12-19T05:45:00.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.782+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc061910 con 0x7f3ccc146e10 2023-12-19T05:45:00.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.783+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cc400abf0 con 0x7f3ccc146e10 2023-12-19T05:45:00.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.783+0000 7f3cbaffd640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 0x7f3cac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:00.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.784+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3cc4088790 con 0x7f3ccc146e10 2023-12-19T05:45:00.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.784+0000 7f3cca59c640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 0x7f3cac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:00.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.785+0000 7f3cca59c640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 0x7f3cac06c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc036000 tx=0x7f3cbc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:00.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:00.788+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3cc4054080 con 0x7f3ccc146e10 2023-12-19T05:45:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.052+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f3ccc0008d0 con 0x7f3ccc146e10 2023-12-19T05:45:01.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.567+0000 7f3cbaffd640 1 -- 172.21.15.49:0/2400366367 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v307) v1 ==== 140+0+0 (secure 0 0 0) 0x7f3cc40576a0 con 0x7f3ccc146e10 2023-12-19T05:45:01.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.570+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 msgr2=0x7f3cac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:01.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.570+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 0x7f3cac06c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc036000 tx=0x7f3cbc03c040 comp rx=0 tx=0).stop 2023-12-19T05:45:01.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.570+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 msgr2=0x7f3ccc13ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:01.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.570+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c7b0 tx=0x7f3cc400cc70 comp rx=0 tx=0).stop 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 shutdown_connections 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3cac06a430 0x7f3cac06c8f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ccc0d2b00 0x7f3ccc0cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc146e10 0x7f3ccc13ce70 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 --2- 172.21.15.49:0/2400366367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ccc0ce110 0x7f3ccc0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 >> 172.21.15.49:0/2400366367 conn(0x7f3ccc0b29c0 msgr2=0x7f3ccc0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 shutdown_connections 2023-12-19T05:45:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:01.571+0000 7f3cd0b63640 1 -- 172.21.15.49:0/2400366367 wait complete. 2023-12-19T05:45:01.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-19T05:45:01.842 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_objectstore":"memstore"} 2023-12-19T05:45:01.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-19T05:45:01.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:45:02.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.081+0000 7f5382e4c640 1 Processor -- start 2023-12-19T05:45:02.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.082+0000 7f5382e4c640 1 -- start start 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.083+0000 7f5382e4c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c157bc0 0x7f537c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.083+0000 7f5382e4c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f537c0cfc20 0x7f537c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f5382e4c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0b2ad0 con 0x7f537c0b2f60 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f5382e4c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0b24c0 con 0x7f537c0cfc20 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f5382e4c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0d00a0 con 0x7f537c157bc0 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f537c0cfc20 0x7f537c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f537c0cfc20 0x7f537c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40042/0 (socket says 172.21.15.49:40042) 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 -- 172.21.15.49:0/200583928 learned_addr learned my addr 172.21.15.49:0/200583928 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 -- 172.21.15.49:0/200583928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c157bc0 msgr2=0x7f537c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 --2- 172.21.15.49:0/200583928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c157bc0 0x7f537c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 -- 172.21.15.49:0/200583928 >> v1:172.21.15.115:6789/0 conn(0x7f537c0b2f60 legacy=0x7f537c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:02.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.084+0000 7f537bfff640 1 -- 172.21.15.49:0/200583928 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0b2760 con 0x7f537c0cfc20 2023-12-19T05:45:02.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.085+0000 7f537bfff640 1 --2- 172.21.15.49:0/200583928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c0cfc20 0x7f537c0af720 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5370009870 tx=0x7f537002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e4c85804ab87e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:02.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.086+0000 7f537b7fe640 1 -- 172.21.15.49:0/200583928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700317c0 con 0x7f537c0cfc20 2023-12-19T05:45:02.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.086+0000 7f537b7fe640 1 -- 172.21.15.49:0/200583928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370031920 con 0x7f537c0cfc20 2023-12-19T05:45:02.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.086+0000 7f537b7fe640 1 -- 172.21.15.49:0/200583928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370031cb0 con 0x7f537c0cfc20 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.086+0000 7f5382e4c640 1 -- 172.21.15.49:0/200583928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c0cfc20 msgr2=0x7f537c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 --2- 172.21.15.49:0/200583928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c0cfc20 0x7f537c0af720 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5370009870 tx=0x7f537002b860 comp rx=0 tx=0).stop 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 -- 172.21.15.49:0/200583928 shutdown_connections 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 --2- 172.21.15.49:0/200583928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c0cfc20 0x7f537c0af720 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 --2- 172.21.15.49:0/200583928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c157bc0 0x7f537c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 -- 172.21.15.49:0/200583928 >> 172.21.15.49:0/200583928 conn(0x7f537c06b950 msgr2=0x7f537c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:02.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 -- 172.21.15.49:0/200583928 shutdown_connections 2023-12-19T05:45:02.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.087+0000 7f5382e4c640 1 -- 172.21.15.49:0/200583928 wait complete. 2023-12-19T05:45:02.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.089+0000 7f5382e4c640 1 Processor -- start 2023-12-19T05:45:02.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.089+0000 7f5382e4c640 1 -- start start 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c0b2f60 0x7f537c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 0x7f537c1f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0b5780 con 0x7f537c157bc0 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0b4b70 con 0x7f537c0cfc20 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f5382e4c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0b4e50 con 0x7f537c0b2f60 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40058/0 (socket says 172.21.15.49:40058) 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 -- 172.21.15.49:0/3695209817 learned_addr learned my addr 172.21.15.49:0/3695209817 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:02.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f537bfff640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 0x7f537c1f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 -- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c0b2f60 msgr2=0x7f537c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c0b2f60 0x7f537c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 -- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 msgr2=0x7f537c1f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 0x7f537c1f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f53813e9640 1 -- 172.21.15.49:0/3695209817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700094d0 con 0x7f537c157bc0 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.090+0000 7f537bfff640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 0x7f537c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:02.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f53813e9640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f537400b490 tx=0x7f537400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011830 con 0x7f537c157bc0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740119b0 con 0x7f537c157bc0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0b5130 con 0x7f537c157bc0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011d60 con 0x7f537c157bc0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.091+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c1523f0 con 0x7f537c157bc0 2023-12-19T05:45:02.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.092+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c061910 con 0x7f537c157bc0 2023-12-19T05:45:02.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.093+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f537401a400 con 0x7f537c157bc0 2023-12-19T05:45:02.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.094+0000 7f53797fa640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 0x7f536806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:02.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.094+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5374088700 con 0x7f537c157bc0 2023-12-19T05:45:02.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.095+0000 7f5380be8640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 0x7f536806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:02.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.096+0000 7f5380be8640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 0x7f536806c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ab90 tx=0x7f536c009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:02.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.098+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5374053fe0 con 0x7f537c157bc0 2023-12-19T05:45:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.295+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f537c0cd7f0 con 0x7f537c157bc0 2023-12-19T05:45:02.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.304+0000 7f53797fa640 1 -- 172.21.15.49:0/3695209817 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53740150c0 con 0x7f537c157bc0 2023-12-19T05:45:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 msgr2=0x7f536806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 0x7f536806c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ab90 tx=0x7f536c009250 comp rx=0 tx=0).stop 2023-12-19T05:45:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 msgr2=0x7f537c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f537400b490 tx=0x7f537400b950 comp rx=0 tx=0).stop 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 shutdown_connections 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f536806a430 0x7f536806c8f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f537c157bc0 0x7f537c071370 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f537c0cfc20 0x7f537c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 --2- 172.21.15.49:0/3695209817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f537c0b2f60 0x7f537c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.307+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 >> 172.21.15.49:0/3695209817 conn(0x7f537c06b950 msgr2=0x7f537c06e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.308+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 shutdown_connections 2023-12-19T05:45:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:02.308+0000 7f5382e4c640 1 -- 172.21.15.49:0/3695209817 wait complete. 2023-12-19T05:45:02.329 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:45:02.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:45:02.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:45:02.578 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:45:02.578 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:02.578 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:02.642 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:45:02.642 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:02.642 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:02.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:45:02.703 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:02.703 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:02.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:45:02.768 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:02.769 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:02.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:45:02.828 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:45:02.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:03.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.069+0000 7f15122ce640 1 Processor -- start 2023-12-19T05:45:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.069+0000 7f15122ce640 1 -- start start 2023-12-19T05:45:03.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f15122ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c0b0b50 0x7f150c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f15122ce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f150c06b590 0x7f150c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f15122ce640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c06bb30 con 0x7f150c1449e0 2023-12-19T05:45:03.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f15122ce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c0b0070 con 0x7f150c06b590 2023-12-19T05:45:03.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f15122ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b0350 con 0x7f150c0b0b50 2023-12-19T05:45:03.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f151086b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f150c06b590 0x7f150c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f151086b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f150c06b590 0x7f150c06c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40074/0 (socket says 172.21.15.49:40074) 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.071+0000 7f151086b640 1 -- 172.21.15.49:0/3403397597 learned_addr learned my addr 172.21.15.49:0/3403397597 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.072+0000 7f150b7fe640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c0b0b50 0x7f150c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.072+0000 7f151086b640 1 -- 172.21.15.49:0/3403397597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c0b0b50 msgr2=0x7f150c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.072+0000 7f151086b640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c0b0b50 0x7f150c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.072+0000 7f151086b640 1 -- 172.21.15.49:0/3403397597 >> v1:172.21.15.49:6789/0 conn(0x7f150c1449e0 legacy=0x7f150c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.072+0000 7f151086b640 1 -- 172.21.15.49:0/3403397597 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0b0630 con 0x7f150c06b590 2023-12-19T05:45:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.073+0000 7f151086b640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c06b590 0x7f150c06c4e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1504009e50 tx=0x7f150402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904ebc4b011f2e3f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.073+0000 7f150affd640 1 -- 172.21.15.49:0/3403397597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150402cb00 con 0x7f150c06b590 2023-12-19T05:45:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.073+0000 7f150affd640 1 -- 172.21.15.49:0/3403397597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150402cc60 con 0x7f150c06b590 2023-12-19T05:45:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.073+0000 7f150affd640 1 -- 172.21.15.49:0/3403397597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040343f0 con 0x7f150c06b590 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 -- 172.21.15.49:0/3403397597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c06b590 msgr2=0x7f150c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c06b590 0x7f150c06c4e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1504009e50 tx=0x7f150402bf60 comp rx=0 tx=0).stop 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 -- 172.21.15.49:0/3403397597 shutdown_connections 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c06b590 0x7f150c06c4e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 --2- 172.21.15.49:0/3403397597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c0b0b50 0x7f150c06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 -- 172.21.15.49:0/3403397597 >> 172.21.15.49:0/3403397597 conn(0x7f150c0cbb70 msgr2=0x7f150c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 -- 172.21.15.49:0/3403397597 shutdown_connections 2023-12-19T05:45:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.074+0000 7f15122ce640 1 -- 172.21.15.49:0/3403397597 wait complete. 2023-12-19T05:45:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.076+0000 7f15122ce640 1 Processor -- start 2023-12-19T05:45:03.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.076+0000 7f15122ce640 1 -- start start 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c06b590 0x7f150c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f150c0b0b50 0x7f150c143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c13e4b0 con 0x7f150c1449e0 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0cd750 con 0x7f150c0b0b50 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.077+0000 7f15122ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c13b800 con 0x7f150c06b590 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40088/0 (socket says 172.21.15.49:40088) 2023-12-19T05:45:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 -- 172.21.15.49:0/655744694 learned_addr learned my addr 172.21.15.49:0/655744694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f150b7fe640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f150c0b0b50 0x7f150c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f150bfff640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c06b590 0x7f150c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 -- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c06b590 msgr2=0x7f150c1f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c06b590 0x7f150c1f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 -- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f150c0b0b50 msgr2=0x7f150c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f150c0b0b50 0x7f150c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.078+0000 7f151086b640 1 -- 172.21.15.49:0/655744694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009b30 con 0x7f150c1449e0 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f151086b640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1504036040 tx=0x7f1504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504009510 con 0x7f150c1449e0 2023-12-19T05:45:03.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150403e450 con 0x7f150c1449e0 2023-12-19T05:45:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150403e800 con 0x7f150c1449e0 2023-12-19T05:45:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c15b7f0 con 0x7f150c1449e0 2023-12-19T05:45:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.079+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c0cd100 con 0x7f150c1449e0 2023-12-19T05:45:03.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.081+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c061910 con 0x7f150c1449e0 2023-12-19T05:45:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.081+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f150403e960 con 0x7f150c1449e0 2023-12-19T05:45:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.083+0000 7f1508ff9640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.083+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f15040ab420 con 0x7f150c1449e0 2023-12-19T05:45:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.084+0000 7f150bfff640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.085+0000 7f150bfff640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000f60 tx=0x7f14fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.087+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1504076c80 con 0x7f150c1449e0 2023-12-19T05:45:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.319+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f150c0b16e0 con 0x7f150c1449e0 2023-12-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.319+0000 7f1508ff9640 1 -- 172.21.15.49:0/655744694 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f1504043de0 con 0x7f150c1449e0 2023-12-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2151324463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2151324463},{"type":"v1","addr":"172.21.15.49:6834","nonce":2151324463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1472744083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1472744083},{"type":"v1","addr":"172.21.15.115:6837","nonce":1472744083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3080004558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3080004558},{"type":"v1","addr":"172.21.15.49:6835","nonce":3080004558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2796124031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2796124031},{"type":"v1","addr":"172.21.15.115:6836","nonce":2796124031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-12-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2023-12-19T05:45:03.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 msgr2=0x7f14f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000f60 tx=0x7f14fc009040 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 msgr2=0x7f150c143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1504036040 tx=0x7f1504004a40 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 shutdown_connections 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14f806a430 0x7f14f806c8f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f150c1449e0 0x7f150c143560 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f150c0b0b50 0x7f150c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 --2- 172.21.15.49:0/655744694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f150c06b590 0x7f150c1f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 >> 172.21.15.49:0/655744694 conn(0x7f150c0cbb70 msgr2=0x7f150c140be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.322+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 shutdown_connections 2023-12-19T05:45:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.323+0000 7f15122ce640 1 -- 172.21.15.49:0/655744694 wait complete. 2023-12-19T05:45:03.342 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:45:03.342 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:45:03.342 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:45:03.343 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:45:03.343 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:45:03.343 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:45:03.343 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:45:03.343 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:45:03.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:45:03.344 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:45:03.344 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:45:03.344 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:45:03.362 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:45:03.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:45:03.363 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:45:03.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:45:03.369 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:45:03.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:45:03.379 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:45:03.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:45:03.411 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:45:03.412 DEBUG:teuthology.parallel:result is None 2023-12-19T05:45:03.418 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:45:03.418 DEBUG:teuthology.parallel:result is None 2023-12-19T05:45:03.426 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:45:03.427 DEBUG:teuthology.parallel:result is None 2023-12-19T05:45:03.433 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:45:03.434 DEBUG:teuthology.parallel:result is None 2023-12-19T05:45:03.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:45:03.585 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:45:03.590 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:45:03.595 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:45:03.595 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:45:03.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.644+0000 7fecf457e640 1 Processor -- start 2023-12-19T05:45:03.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.644+0000 7fecf457e640 1 -- start start 2023-12-19T05:45:03.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.645+0000 7fecf457e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 0x7fecec0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf457e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecec0d2b00 0x7fecec0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf457e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec0cd840 con 0x7fecec0ce110 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf457e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0d2430 con 0x7fecec0d2b00 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf457e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0d2620 con 0x7fecec146e10 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1b19640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecec0d2b00 0x7fecec0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf2b1b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fecec0ce110 0x7fecec0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60294/0 (socket says 172.21.15.49:60294) 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf2b1b640 1 -- 172.21.15.49:0/2179896693 learned_addr learned my addr 172.21.15.49:0/2179896693 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf231a640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 0x7fecec0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1318640 1 -- 172.21.15.49:0/2179896693 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518187399 0 0) 0x7fecec0cd840 con 0x7fecec0ce110 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1b19640 1 -- 172.21.15.49:0/2179896693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 msgr2=0x7fecec0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1b19640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 0x7fecec0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1b19640 1 -- 172.21.15.49:0/2179896693 >> v1:172.21.15.49:6789/0 conn(0x7fecec0ce110 legacy=0x7fecec0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.646+0000 7fecf1b19640 1 -- 172.21.15.49:0/2179896693 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0b41c0 con 0x7fecec0d2b00 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.647+0000 7fecf231a640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 0x7fecec0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:03.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf1b19640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec0d2b00 0x7fecec0b6780 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0097a0 tx=0x7fecdc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8108676619596562 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf1318640 1 -- 172.21.15.49:0/2179896693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc02d040 con 0x7fecec0d2b00 2023-12-19T05:45:03.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf1318640 1 -- 172.21.15.49:0/2179896693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc031810 con 0x7fecec0d2b00 2023-12-19T05:45:03.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf1318640 1 -- 172.21.15.49:0/2179896693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc031ba0 con 0x7fecec0d2b00 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf457e640 1 -- 172.21.15.49:0/2179896693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec0d2b00 msgr2=0x7fecec0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.648+0000 7fecf457e640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec0d2b00 0x7fecec0b6780 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0097a0 tx=0x7fecdc02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 -- 172.21.15.49:0/2179896693 shutdown_connections 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec0d2b00 0x7fecec0b6780 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 --2- 172.21.15.49:0/2179896693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec146e10 0x7fecec0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 -- 172.21.15.49:0/2179896693 >> 172.21.15.49:0/2179896693 conn(0x7fecec0b29c0 msgr2=0x7fecec0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 -- 172.21.15.49:0/2179896693 shutdown_connections 2023-12-19T05:45:03.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.649+0000 7fecf457e640 1 -- 172.21.15.49:0/2179896693 wait complete. 2023-12-19T05:45:03.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.650+0000 7fecf457e640 1 Processor -- start 2023-12-19T05:45:03.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.651+0000 7fecf457e640 1 -- start start 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.651+0000 7fecf457e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 0x7fecec13cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf457e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec0d2b00 0x7fecec0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf457e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf457e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b8f00 con 0x7fecec146e10 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf457e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b8280 con 0x7fecec0ce110 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf457e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b8560 con 0x7fecec0d2b00 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40110/0 (socket says 172.21.15.49:40110) 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 -- 172.21.15.49:0/3767746950 learned_addr learned my addr 172.21.15.49:0/3767746950 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf1b19640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec0d2b00 0x7fecec0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf231a640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 0x7fecec13cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 -- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec0d2b00 msgr2=0x7fecec0b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec0d2b00 0x7fecec0b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 -- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 msgr2=0x7fecec13cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 0x7fecec13cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf2b1b640 1 -- 172.21.15.49:0/3767746950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8009400 con 0x7fecec146e10 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.652+0000 7fecf231a640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 0x7fecec13cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fecf2b1b640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fece400c7e0 tx=0x7fece400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400a640 con 0x7fecec146e10 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400a7c0 con 0x7fecec146e10 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400ab70 con 0x7fecec146e10 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc009400 con 0x7fecec146e10 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.653+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec0b8b20 con 0x7fecec146e10 2023-12-19T05:45:03.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.654+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec0b9040 con 0x7fecec146e10 2023-12-19T05:45:03.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.656+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fece400acd0 con 0x7fecec146e10 2023-12-19T05:45:03.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.657+0000 7fece2ffd640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 0x7fecd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.657+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fece4087c20 con 0x7fecec146e10 2023-12-19T05:45:03.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.657+0000 7fecf231a640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 0x7fecd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.658+0000 7fecf231a640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 0x7fecd006c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fecec162100 tx=0x7fece8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.661+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecec0b9040 con 0x7fecec146e10 2023-12-19T05:45:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:03.866+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fecec0b9040 con 0x7fecec146e10 2023-12-19T05:45:04.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.630+0000 7fece2ffd640 1 -- 172.21.15.49:0/3767746950 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7fecec0b9040 con 0x7fecec146e10 2023-12-19T05:45:04.632 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:45:04.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.633+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 msgr2=0x7fecd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.633+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 0x7fecd006c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fecec162100 tx=0x7fece8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:04.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.633+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 msgr2=0x7fecec06fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fece400c7e0 tx=0x7fece400cca0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 shutdown_connections 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd006a430 0x7fecd006c8f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecec0d2b00 0x7fecec0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecec146e10 0x7fecec06fc50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 --2- 172.21.15.49:0/3767746950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecec0ce110 0x7fecec13cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 >> 172.21.15.49:0/3767746950 conn(0x7fecec0b29c0 msgr2=0x7fecec15ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 shutdown_connections 2023-12-19T05:45:04.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.634+0000 7fecf457e640 1 -- 172.21.15.49:0/3767746950 wait complete. 2023-12-19T05:45:04.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:45:04.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.876+0000 7f537cc26640 1 Processor -- start 2023-12-19T05:45:04.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.877+0000 7f537cc26640 1 -- start start 2023-12-19T05:45:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.878+0000 7f537cc26640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 0x7f53780b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.878+0000 7f537cc26640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f537cc26640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53780ae640 con 0x7f5378157bf0 2023-12-19T05:45:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f537cc26640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537806b8c0 con 0x7f53780ae110 2023-12-19T05:45:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f537cc26640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53780b0ab0 con 0x7f53780b0640 2023-12-19T05:45:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f5376d9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f5376d9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:42510/0 (socket says 172.21.15.49:42510) 2023-12-19T05:45:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f5376d9d640 1 -- 172.21.15.49:0/726376069 learned_addr learned my addr 172.21.15.49:0/726376069 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.879+0000 7f536ffff640 1 --2- 172.21.15.49:0/726376069 >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 0x7f53780b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.880+0000 7f5376d9d640 1 -- 172.21.15.49:0/726376069 >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 msgr2=0x7f53780b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.880+0000 7f5376d9d640 1 --2- 172.21.15.49:0/726376069 >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 0x7f53780b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.880+0000 7f5376d9d640 1 -- 172.21.15.49:0/726376069 >> v1:172.21.15.115:6789/0 conn(0x7f5378157bf0 legacy=0x7f537815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.880+0000 7f5376d9d640 1 -- 172.21.15.49:0/726376069 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53780ae920 con 0x7f53780b0640 2023-12-19T05:45:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.880+0000 7f536ffff640 1 --2- 172.21.15.49:0/726376069 >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 0x7f53780b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:04.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.881+0000 7f5376d9d640 1 --2- 172.21.15.49:0/726376069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5370009e50 tx=0x7f537002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7399dada25788fd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:04.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.882+0000 7f5375d9b640 1 -- 172.21.15.49:0/726376069 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537002cb00 con 0x7f53780b0640 2023-12-19T05:45:04.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.882+0000 7f5375d9b640 1 -- 172.21.15.49:0/726376069 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537002cc60 con 0x7f53780b0640 2023-12-19T05:45:04.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.882+0000 7f5375d9b640 1 -- 172.21.15.49:0/726376069 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700343f0 con 0x7f53780b0640 2023-12-19T05:45:04.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 -- 172.21.15.49:0/726376069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 msgr2=0x7f537806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 --2- 172.21.15.49:0/726376069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5370009e50 tx=0x7f537002bf60 comp rx=0 tx=0).stop 2023-12-19T05:45:04.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 -- 172.21.15.49:0/726376069 shutdown_connections 2023-12-19T05:45:04.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 --2- 172.21.15.49:0/726376069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53780b0640 0x7f537806d230 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 --2- 172.21.15.49:0/726376069 >> v2:172.21.15.115:3300/0 conn(0x7f53780ae110 0x7f53780b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 -- 172.21.15.49:0/726376069 >> 172.21.15.49:0/726376069 conn(0x7f53780cbb70 msgr2=0x7f53780cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 -- 172.21.15.49:0/726376069 shutdown_connections 2023-12-19T05:45:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.883+0000 7f537cc26640 1 -- 172.21.15.49:0/726376069 wait complete. 2023-12-19T05:45:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.885+0000 7f537cc26640 1 Processor -- start 2023-12-19T05:45:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.886+0000 7f537cc26640 1 -- start start 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53780b0640 0x7f537815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5378157bf0 0x7f53780ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537806f120 con 0x7f53780ae110 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53781488c0 con 0x7f53780b0640 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537cc26640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537815ce80 con 0x7f5378157bf0 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47216/0 (socket says 172.21.15.49:47216) 2023-12-19T05:45:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.887+0000 7f537659c640 1 -- 172.21.15.49:0/1779485490 learned_addr learned my addr 172.21.15.49:0/1779485490 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f5376d9d640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5378157bf0 0x7f53780ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f536ffff640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53780b0640 0x7f537815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 -- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5378157bf0 msgr2=0x7f53780ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5378157bf0 0x7f53780ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 -- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53780b0640 msgr2=0x7f537815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53780b0640 0x7f537815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 -- 172.21.15.49:0/1779485490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360009400 con 0x7f53780ae110 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.888+0000 7f537659c640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f536800c390 tx=0x7f536800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.889+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680052d0 con 0x7f53780ae110 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.889+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5368005430 con 0x7f53780ae110 2023-12-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.889+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368003830 con 0x7f53780ae110 2023-12-19T05:45:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.889+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5370009b30 con 0x7f53780ae110 2023-12-19T05:45:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.889+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537806f650 con 0x7f53780ae110 2023-12-19T05:45:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.890+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5378061910 con 0x7f53780ae110 2023-12-19T05:45:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.891+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5368003990 con 0x7f53780ae110 2023-12-19T05:45:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.892+0000 7f536effd640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 0x7f535806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.892+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5368087aa0 con 0x7f53780ae110 2023-12-19T05:45:04.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.893+0000 7f536ffff640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 0x7f535806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.894+0000 7f536ffff640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 0x7f535806c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f537814b3a0 tx=0x7f5360008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:04.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:04.896+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5368053470 con 0x7f53780ae110 2023-12-19T05:45:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.161+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5378159340 con 0x7f53780ae110 2023-12-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.163+0000 7f536effd640 1 -- 172.21.15.49:0/1779485490 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5368056a90 con 0x7f53780ae110 2023-12-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:45:05.166 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:45:05.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.168 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:45:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.173 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:45:05.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.176 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:45:05.178 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.179 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:05.179 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:05.179 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 msgr2=0x7f535806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 0x7f535806c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f537814b3a0 tx=0x7f5360008040 comp rx=0 tx=0).stop 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 msgr2=0x7f5378148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f536800c390 tx=0x7f536800c850 comp rx=0 tx=0).stop 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 shutdown_connections 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f535806a430 0x7f535806c8f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5378157bf0 0x7f53780ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53780b0640 0x7f537815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 --2- 172.21.15.49:0/1779485490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780ae110 0x7f5378148380 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 >> 172.21.15.49:0/1779485490 conn(0x7f53780cbb70 msgr2=0x7f5378072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:05.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 shutdown_connections 2023-12-19T05:45:05.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.166+0000 7f537cc26640 1 -- 172.21.15.49:0/1779485490 wait complete. 2023-12-19T05:45:05.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:05.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.421+0000 7efcdc347640 1 Processor -- start 2023-12-19T05:45:05.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.421+0000 7efcdc347640 1 -- start start 2023-12-19T05:45:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcdc347640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efcd4157bf0 0x7efcd415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcdc347640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcd40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcdc347640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd40b0a90 con 0x7efcd40b0640 2023-12-19T05:45:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcdc347640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd406b8c0 con 0x7efcd4157bf0 2023-12-19T05:45:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcdc347640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd415b740 con 0x7efcd40ae110 2023-12-19T05:45:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcda8e4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efcd40b0640 0x7efcd415dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40024/0 (socket says 172.21.15.49:40024) 2023-12-19T05:45:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.423+0000 7efcda8e4640 1 -- 172.21.15.49:0/2083205361 learned_addr learned my addr 172.21.15.49:0/2083205361 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcda0e3640 1 --2- 172.21.15.49:0/2083205361 >> v2:172.21.15.115:3300/0 conn(0x7efcd4157bf0 0x7efcd415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd98e2640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcd40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920715673 0 0) 0x7efccc001490 con 0x7efcd40b0640 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc0005730 con 0x7efcd40b0640 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544451134 0 0) 0x7efcc0005730 con 0x7efcd40b0640 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 msgr2=0x7efcd40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcd40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 >> v2:172.21.15.115:3300/0 conn(0x7efcd4157bf0 msgr2=0x7efcd415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 --2- 172.21.15.49:0/2083205361 >> v2:172.21.15.115:3300/0 conn(0x7efcd4157bf0 0x7efcd415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd40ae640 con 0x7efcd40b0640 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7efccc001b80 con 0x7efcd40b0640 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 >> v1:172.21.15.49:6789/0 conn(0x7efcd40b0640 legacy=0x7efcd415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcc0005bf0 0x7efcc0006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcc00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcc0006f10 0x7efcc0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd406b8c0 con 0x7efcc0005bf0 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd415b740 con 0x7efcc0006f10 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.424+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc000db90 con 0x7efcd40ae110 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcc0005bf0 0x7efcc0006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcd98e2640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcc00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 -- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 msgr2=0x7efcc00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd40ae110 0x7efcc00069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 -- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcc0006f10 msgr2=0x7efcc0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcc0006f10 0x7efcc0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.425+0000 7efcda0e3640 1 -- 172.21.15.49:0/2083205361 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0005730 con 0x7efcc0005bf0 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.426+0000 7efcda0e3640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcc0005bf0 0x7efcc0006010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efcc0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900e44f2f16aa68d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd002c710 con 0x7efcc0005bf0 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd002c870 con 0x7efcc0005bf0 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcd90e1640 1 -- 172.21.15.49:0/2083205361 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd002cc00 con 0x7efcc0005bf0 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 -- 172.21.15.49:0/2083205361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcc0005bf0 msgr2=0x7efcc0006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 --2- 172.21.15.49:0/2083205361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcc0005bf0 0x7efcc0006010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efcc0007a00 comp rx=0 tx=0).stop 2023-12-19T05:45:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcda8e4640 1 -- 172.21.15.49:0/2083205361 reap_dead start 2023-12-19T05:45:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 -- 172.21.15.49:0/2083205361 shutdown_connections 2023-12-19T05:45:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 -- 172.21.15.49:0/2083205361 >> 172.21.15.49:0/2083205361 conn(0x7efcd40cbb70 msgr2=0x7efcd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 -- 172.21.15.49:0/2083205361 shutdown_connections 2023-12-19T05:45:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.427+0000 7efcdc347640 1 -- 172.21.15.49:0/2083205361 wait complete. 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.429+0000 7efcdc347640 1 Processor -- start 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.429+0000 7efcdc347640 1 -- start start 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcc0005bf0 0x7efcd4151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 0x7efcd41596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd41518c0 con 0x7efcd4148e30 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd415a260 con 0x7efcd41489b0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.430+0000 7efcdc347640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4158ad0 con 0x7efcc0005bf0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47228/0 (socket says 172.21.15.49:47228) 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 -- 172.21.15.49:0/946551274 learned_addr learned my addr 172.21.15.49:0/946551274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda0e3640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcc0005bf0 0x7efcd4151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcd98e2640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 0x7efcd41596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 -- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcc0005bf0 msgr2=0x7efcd4151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcc0005bf0 0x7efcd4151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 -- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 msgr2=0x7efcd41596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 0x7efcd41596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 -- 172.21.15.49:0/946551274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd415b9b0 con 0x7efcd4148e30 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcd98e2640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 0x7efcd41596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.431+0000 7efcda8e4640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7efcd40b29b0 tx=0x7efccc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.432+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc004d60 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.432+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00a610 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.432+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00a9c0 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.432+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd415bc90 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.432+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd415c250 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.433+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd415c470 con 0x7efcd4148e30 2023-12-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.434+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efccc00ab20 con 0x7efcd4148e30 2023-12-19T05:45:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.435+0000 7efccaffd640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 0x7efcb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.435+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efccc087c30 con 0x7efcd4148e30 2023-12-19T05:45:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.436+0000 7efcda0e3640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 0x7efcb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.437+0000 7efcda0e3640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 0x7efcb806c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efcd0036000 tx=0x7efcd0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.440+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efccc053560 con 0x7efcd4148e30 2023-12-19T05:45:05.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.635+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcd40b0a90 con 0x7efcd4148e30 2023-12-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.636+0000 7efccaffd640 1 -- 172.21.15.49:0/946551274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+12391 (secure 0 0 0) 0x7efcd40b0a90 con 0x7efcd4148e30 2023-12-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:04.623672+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:05.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 msgr2=0x7efcb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 0x7efcb806c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efcd0036000 tx=0x7efcd0030000 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 msgr2=0x7efcd4159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7efcd40b29b0 tx=0x7efccc00cc00 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 shutdown_connections 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efcb806a430 0x7efcb806c8f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd4148e30 0x7efcd4159c30 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd41489b0 0x7efcd41596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 --2- 172.21.15.49:0/946551274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcc0005bf0 0x7efcd4151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 >> 172.21.15.49:0/946551274 conn(0x7efcd40cbb70 msgr2=0x7efcd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 shutdown_connections 2023-12-19T05:45:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.639+0000 7efcdc347640 1 -- 172.21.15.49:0/946551274 wait complete. 2023-12-19T05:45:05.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:05.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.895+0000 7f61d5acf640 1 Processor -- start 2023-12-19T05:45:05.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.895+0000 7f61d5acf640 1 -- start start 2023-12-19T05:45:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.897+0000 7f61d5acf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 0x7f61d00afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d5acf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61d006dc00 0x7f61d00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d5acf640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d006e220 con 0x7f61d00b02a0 2023-12-19T05:45:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d5acf640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00cbea0 con 0x7f61d006dc00 2023-12-19T05:45:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d5acf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00cc180 con 0x7f61d0141900 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61d006dc00 0x7f61d00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61d006dc00 0x7f61d00ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47232/0 (socket says 172.21.15.49:47232) 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 -- 172.21.15.49:0/3413605718 learned_addr learned my addr 172.21.15.49:0/3413605718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d4acd640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 0x7f61d00afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 -- 172.21.15.49:0/3413605718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 msgr2=0x7f61d00afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 0x7f61d00afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 -- 172.21.15.49:0/3413605718 >> v1:172.21.15.49:6789/0 conn(0x7f61d00b02a0 legacy=0x7f61d006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d52ce640 1 -- 172.21.15.49:0/3413605718 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00b0700 con 0x7f61d006dc00 2023-12-19T05:45:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.898+0000 7f61d4acd640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 0x7f61d00afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.900+0000 7f61d52ce640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d006dc00 0x7f61d00ccc60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6de271c0a3e7174 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.900+0000 7f61cf7fe640 1 -- 172.21.15.49:0/3413605718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c802cb00 con 0x7f61d006dc00 2023-12-19T05:45:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.900+0000 7f61cf7fe640 1 -- 172.21.15.49:0/3413605718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c802cc60 con 0x7f61d006dc00 2023-12-19T05:45:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.900+0000 7f61cf7fe640 1 -- 172.21.15.49:0/3413605718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80343f0 con 0x7f61d006dc00 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 -- 172.21.15.49:0/3413605718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d006dc00 msgr2=0x7f61d00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d006dc00 0x7f61d00ccc60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c802bf60 comp rx=0 tx=0).stop 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 -- 172.21.15.49:0/3413605718 shutdown_connections 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d006dc00 0x7f61d00ccc60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 --2- 172.21.15.49:0/3413605718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d0141900 0x7f61d00afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 -- 172.21.15.49:0/3413605718 >> 172.21.15.49:0/3413605718 conn(0x7f61d006f630 msgr2=0x7f61d006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 -- 172.21.15.49:0/3413605718 shutdown_connections 2023-12-19T05:45:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.901+0000 7f61d5acf640 1 -- 172.21.15.49:0/3413605718 wait complete. 2023-12-19T05:45:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.903+0000 7f61d5acf640 1 Processor -- start 2023-12-19T05:45:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.903+0000 7f61d5acf640 1 -- start start 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d006dc00 0x7f61d01e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d0141900 0x7f61d00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d015ab40 con 0x7f61d00b02a0 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01e6a90 con 0x7f61d0141900 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61d5acf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b2820 con 0x7f61d006dc00 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47242/0 (socket says 172.21.15.49:47242) 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.904+0000 7f61cffff640 1 -- 172.21.15.49:0/658230757 learned_addr learned my addr 172.21.15.49:0/658230757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61d4acd640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d006dc00 0x7f61d01e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61d52ce640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d0141900 0x7f61d00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 -- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d006dc00 msgr2=0x7f61d01e53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d006dc00 0x7f61d01e53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 -- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d0141900 msgr2=0x7f61d00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d0141900 0x7f61d00ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 -- 172.21.15.49:0/658230757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009b30 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.905+0000 7f61cffff640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.906+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0052d0 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.906+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc005430 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.906+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc012870 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.906+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00b2b00 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.906+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00b30c0 con 0x7f61d00b02a0 2023-12-19T05:45:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.907+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d01e5bb0 con 0x7f61d00b02a0 2023-12-19T05:45:05.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.908+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61bc0129d0 con 0x7f61d00b02a0 2023-12-19T05:45:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.909+0000 7f61cd7fa640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.909+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f61bc088140 con 0x7f61d00b02a0 2023-12-19T05:45:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.910+0000 7f61d4acd640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.911+0000 7f61d4acd640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 0x7f61b406c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f61d00afcc0 tx=0x7f61c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:05.913+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61bc053a70 con 0x7f61d00b02a0 2023-12-19T05:45:06.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.109+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61d0061910 con 0x7f61d00b02a0 2023-12-19T05:45:06.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.110+0000 7f61cd7fa640 1 -- 172.21.15.49:0/658230757 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61bc057090 con 0x7f61d00b02a0 2023-12-19T05:45:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 msgr2=0x7f61b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 0x7f61b406c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f61d00afcc0 tx=0x7f61c4008040 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 msgr2=0x7f61d015a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 shutdown_connections 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f61b406a430 0x7f61b406c8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d0141900 0x7f61d00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61d00b02a0 0x7f61d015a600 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 --2- 172.21.15.49:0/658230757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61d006dc00 0x7f61d01e53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.112+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 >> 172.21.15.49:0/658230757 conn(0x7f61d006f630 msgr2=0x7f61d00cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.113+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 shutdown_connections 2023-12-19T05:45:06.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.113+0000 7f61d5acf640 1 -- 172.21.15.49:0/658230757 wait complete. 2023-12-19T05:45:06.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:45:06.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.370+0000 7ff11e3c4640 1 Processor -- start 2023-12-19T05:45:06.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.371+0000 7ff11e3c4640 1 -- start start 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.372+0000 7ff11e3c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1180b86e0 0x7ff11815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.372+0000 7ff11e3c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff1180b7710 0x7ff1180d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.372+0000 7ff11e3c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff118142df0 con 0x7ff1180d2a60 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.372+0000 7ff11e3c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1181430d0 con 0x7ff1180b86e0 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.372+0000 7ff11e3c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1181433b0 con 0x7ff1180b7710 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1180b86e0 0x7ff11815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1180b86e0 0x7ff11815e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47248/0 (socket says 172.21.15.49:47248) 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 -- 172.21.15.49:0/134366376 learned_addr learned my addr 172.21.15.49:0/134366376 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11cbc1640 1 --2- 172.21.15.49:0/134366376 >> v2:172.21.15.115:3300/0 conn(0x7ff1180b7710 0x7ff1180d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 -- 172.21.15.49:0/134366376 >> v2:172.21.15.115:3300/0 conn(0x7ff1180b7710 msgr2=0x7ff1180d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 --2- 172.21.15.49:0/134366376 >> v2:172.21.15.115:3300/0 conn(0x7ff1180b7710 0x7ff1180d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 -- 172.21.15.49:0/134366376 >> v1:172.21.15.49:6789/0 conn(0x7ff1180d2a60 legacy=0x7ff1180b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff11d3c2640 1 -- 172.21.15.49:0/134366376 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118143690 con 0x7ff1180b86e0 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.373+0000 7ff10ffff640 1 -- 172.21.15.49:0/134366376 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280583129 0 0) 0x7ff118142df0 con 0x7ff1180d2a60 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.375+0000 7ff11d3c2640 1 --2- 172.21.15.49:0/134366376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b86e0 0x7ff11815e2d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff118074020 tx=0x7ff11402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915f011ea30b4ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.375+0000 7ff10ffff640 1 -- 172.21.15.49:0/134366376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114031870 con 0x7ff1180b86e0 2023-12-19T05:45:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.375+0000 7ff10ffff640 1 -- 172.21.15.49:0/134366376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1140319d0 con 0x7ff1180b86e0 2023-12-19T05:45:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.375+0000 7ff10ffff640 1 -- 172.21.15.49:0/134366376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114031d60 con 0x7ff1180b86e0 2023-12-19T05:45:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 -- 172.21.15.49:0/134366376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b86e0 msgr2=0x7ff11815e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/134366376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b86e0 0x7ff11815e2d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff118074020 tx=0x7ff11402b910 comp rx=0 tx=0).stop 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 -- 172.21.15.49:0/134366376 shutdown_connections 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/134366376 >> v2:172.21.15.115:3300/0 conn(0x7ff1180b7710 0x7ff1180d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/134366376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b86e0 0x7ff11815e2d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 -- 172.21.15.49:0/134366376 >> 172.21.15.49:0/134366376 conn(0x7ff1180d3230 msgr2=0x7ff1180d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 -- 172.21.15.49:0/134366376 shutdown_connections 2023-12-19T05:45:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.376+0000 7ff11e3c4640 1 -- 172.21.15.49:0/134366376 wait complete. 2023-12-19T05:45:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.378+0000 7ff11e3c4640 1 Processor -- start 2023-12-19T05:45:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.378+0000 7ff11e3c4640 1 -- start start 2023-12-19T05:45:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1180b86e0 0x7ff1181f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 0x7ff118145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118160750 con 0x7ff1180b7710 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11815fb40 con 0x7ff1180d2a60 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11e3c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11815fe20 con 0x7ff1180b86e0 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11d3c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11d3c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47254/0 (socket says 172.21.15.49:47254) 2023-12-19T05:45:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.380+0000 7ff11d3c2640 1 -- 172.21.15.49:0/3315729197 learned_addr learned my addr 172.21.15.49:0/3315729197 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:06.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 -- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1180b86e0 msgr2=0x7ff1181f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11cbc1640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1180b86e0 0x7ff1181f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11dbc3640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 0x7ff118145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1180b86e0 0x7ff1181f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 -- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 msgr2=0x7ff118145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 0x7ff118145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 -- 172.21.15.49:0/3315729197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140094d0 con 0x7ff1180b7710 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11dbc3640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 0x7ff118145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11d3c2640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff11402b950 tx=0x7ff1140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11403ad30 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1140443f0 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140447a0 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.381+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118160100 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.382+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11815f830 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.383+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff118061910 con 0x7ff1180b7710 2023-12-19T05:45:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.384+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff11404d450 con 0x7ff1180b7710 2023-12-19T05:45:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.385+0000 7ff10dffb640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.385+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff11402d040 con 0x7ff1180b7710 2023-12-19T05:45:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.386+0000 7ff11cbc1640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.387+0000 7ff11cbc1640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff11814a000 tx=0x7ff108008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.388+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff1140769e0 con 0x7ff1180b7710 2023-12-19T05:45:06.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.587+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1180b74f0 con 0x7ff1180b7710 2023-12-19T05:45:06.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.588+0000 7ff10dffb640 1 -- 172.21.15.49:0/3315729197 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff114035090 con 0x7ff1180b7710 2023-12-19T05:45:06.590 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:06.590 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:45:06.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:06.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:45:06.591 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:45:06.591 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:06.591 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 msgr2=0x7ff0fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff11814a000 tx=0x7ff108008040 comp rx=0 tx=0).stop 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 msgr2=0x7ff11815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff11402b950 tx=0x7ff1140046c0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 shutdown_connections 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1180b86e0 0x7ff1181f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1180d2a60 0x7ff118145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 --2- 172.21.15.49:0/3315729197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1180b7710 0x7ff11815f2f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 >> 172.21.15.49:0/3315729197 conn(0x7ff1180d3230 msgr2=0x7ff1180b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 shutdown_connections 2023-12-19T05:45:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.591+0000 7ff11e3c4640 1 -- 172.21.15.49:0/3315729197 wait complete. 2023-12-19T05:45:06.613 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:45:06.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:45:06.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.850+0000 7faae2fac640 1 Processor -- start 2023-12-19T05:45:06.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.850+0000 7faae2fac640 1 -- start start 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.851+0000 7faae2fac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faadc15afd0 0x7faadc0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.851+0000 7faae2fac640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faadc06d070 0x7faadc0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.851+0000 7faae2fac640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc15f920 con 0x7faadc0b02f0 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.851+0000 7faae2fac640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0adc40 con 0x7faadc15afd0 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.851+0000 7faae2fac640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0b0720 con 0x7faadc06d070 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faadc15afd0 0x7faadc0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faadc15afd0 0x7faadc0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47262/0 (socket says 172.21.15.49:47262) 2023-12-19T05:45:06.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 -- 172.21.15.49:0/735294238 learned_addr learned my addr 172.21.15.49:0/735294238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:06.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 -- 172.21.15.49:0/735294238 >> v2:172.21.15.115:3300/0 conn(0x7faadc06d070 msgr2=0x7faadc0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:06.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 --2- 172.21.15.49:0/735294238 >> v2:172.21.15.115:3300/0 conn(0x7faadc06d070 0x7faadc0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 -- 172.21.15.49:0/735294238 >> v1:172.21.15.115:6789/0 conn(0x7faadc0b02f0 legacy=0x7faadc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:06.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.852+0000 7faae1faa640 1 -- 172.21.15.49:0/735294238 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc15ed10 con 0x7faadc15afd0 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.853+0000 7faae1faa640 1 --2- 172.21.15.49:0/735294238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc15afd0 0x7faadc0ad700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7faadc0666e0 tx=0x7faacc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd199ddec54cb03 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.854+0000 7faae0fa8640 1 -- 172.21.15.49:0/735294238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc02ca80 con 0x7faadc15afd0 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.854+0000 7faae0fa8640 1 -- 172.21.15.49:0/735294238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc02cbe0 con 0x7faadc15afd0 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.854+0000 7faae0fa8640 1 -- 172.21.15.49:0/735294238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0343f0 con 0x7faadc15afd0 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.854+0000 7faae2fac640 1 -- 172.21.15.49:0/735294238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc15afd0 msgr2=0x7faadc0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.854+0000 7faae2fac640 1 --2- 172.21.15.49:0/735294238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc15afd0 0x7faadc0ad700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7faadc0666e0 tx=0x7faacc02bee0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 -- 172.21.15.49:0/735294238 shutdown_connections 2023-12-19T05:45:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 --2- 172.21.15.49:0/735294238 >> v2:172.21.15.115:3300/0 conn(0x7faadc06d070 0x7faadc0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 --2- 172.21.15.49:0/735294238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc15afd0 0x7faadc0ad700 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 -- 172.21.15.49:0/735294238 >> 172.21.15.49:0/735294238 conn(0x7faadc0b4750 msgr2=0x7faadc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 -- 172.21.15.49:0/735294238 shutdown_connections 2023-12-19T05:45:06.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.855+0000 7faae2fac640 1 -- 172.21.15.49:0/735294238 wait complete. 2023-12-19T05:45:06.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.856+0000 7faae2fac640 1 Processor -- start 2023-12-19T05:45:06.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.857+0000 7faae2fac640 1 -- start start 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 0x7faadc1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faadc15afd0 0x7faadc15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc146cf0 con 0x7faadc0b02f0 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc147390 con 0x7faadc06d070 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae2fac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc147670 con 0x7faadc15afd0 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47278/0 (socket says 172.21.15.49:47278) 2023-12-19T05:45:06.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 -- 172.21.15.49:0/8389038 learned_addr learned my addr 172.21.15.49:0/8389038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae27ab640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faadc15afd0 0x7faadc15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae1faa640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 0x7faadc1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 -- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faadc15afd0 msgr2=0x7faadc15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faadc15afd0 0x7faadc15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.858+0000 7faae17a9640 1 -- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 msgr2=0x7faadc1467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae17a9640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 0x7faadc1467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae17a9640 1 -- 172.21.15.49:0/8389038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009b30 con 0x7faadc0b02f0 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae1faa640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 0x7faadc1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:06.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae17a9640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7faad000b4a0 tx=0x7faad000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0010610 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0010770 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0010b20 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc147950 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.859+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc147f10 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.860+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc148130 con 0x7faadc0b02f0 2023-12-19T05:45:06.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.861+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faad0010c80 con 0x7faadc0b02f0 2023-12-19T05:45:06.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.862+0000 7faada7fc640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 0x7faac806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:06.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.862+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faad00882f0 con 0x7faadc0b02f0 2023-12-19T05:45:06.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.863+0000 7faae1faa640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 0x7faac806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:06.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.864+0000 7faae1faa640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 0x7faac806c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faacc035000 tx=0x7faacc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:06.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:06.867+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faad0053b90 con 0x7faadc0b02f0 2023-12-19T05:45:07.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.059+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faadc061910 con 0x7faadc0b02f0 2023-12-19T05:45:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.703+0000 7faada7fc640 1 -- 172.21.15.49:0/8389038 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7faad00571b0 con 0x7faadc0b02f0 2023-12-19T05:45:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:45:07.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 msgr2=0x7faac806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 0x7faac806c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faacc035000 tx=0x7faacc030000 comp rx=0 tx=0).stop 2023-12-19T05:45:07.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 msgr2=0x7faadc1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7faad000b4a0 tx=0x7faad000b960 comp rx=0 tx=0).stop 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 shutdown_connections 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faac806a430 0x7faac806c8f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faadc15afd0 0x7faadc15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0b02f0 0x7faadc1571f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.709+0000 7faae2fac640 1 --2- 172.21.15.49:0/8389038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faadc06d070 0x7faadc1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.710+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 >> 172.21.15.49:0/8389038 conn(0x7faadc0b4750 msgr2=0x7faadc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:07.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.711+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 shutdown_connections 2023-12-19T05:45:07.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.712+0000 7faae2fac640 1 -- 172.21.15.49:0/8389038 wait complete. 2023-12-19T05:45:07.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:45:07.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.976+0000 7f2d6ffff640 1 Processor -- start 2023-12-19T05:45:07.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.977+0000 7f2d6ffff640 1 -- start start 2023-12-19T05:45:07.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d700d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6ffff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7015e730 con 0x7f2d700d2a60 2023-12-19T05:45:07.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d70142df0 con 0x7f2d700b86e0 2023-12-19T05:45:07.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701430d0 con 0x7f2d7015e2d0 2023-12-19T05:45:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d700d2a60 0x7f2d700b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40048/0 (socket says 172.21.15.49:40048) 2023-12-19T05:45:07.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d6f7fe640 1 -- 172.21.15.49:0/806624006 learned_addr learned my addr 172.21.15.49:0/806624006 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.979+0000 7f2d67fff640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d700d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761394407 0 0) 0x7f2d7015e730 con 0x7f2d700d2a60 2023-12-19T05:45:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d5c003520 con 0x7f2d700d2a60 2023-12-19T05:45:07.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789310453 0 0) 0x7f2d5c003520 con 0x7f2d700d2a60 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 msgr2=0x7f2d700d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d700d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 >> v1:172.21.15.115:6789/0 conn(0x7f2d700b86e0 legacy=0x7f2d700b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d701433b0 con 0x7f2d700d2a60 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f2d680019f0 con 0x7f2d700d2a60 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 >> v1:172.21.15.49:6789/0 conn(0x7f2d700d2a60 legacy=0x7f2d700b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d5c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.980+0000 7f2d6e7fc640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c003ee0 0x7f2d5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6e7fc640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701430d0 con 0x7f2d5c004d00 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c00bac0 con 0x7f2d5c003ee0 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c00bc80 con 0x7f2d7015e2d0 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d67fff640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c003ee0 0x7f2d5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6effd640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d5c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 -- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 msgr2=0x7f2d5c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d7015e2d0 0x7f2d5c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 -- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c003ee0 msgr2=0x7f2d5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c003ee0 0x7f2d5c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.981+0000 7f2d6f7fe640 1 -- 172.21.15.49:0/806624006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c003520 con 0x7f2d5c004d00 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6f7fe640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a810 tx=0x7f2d5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e337a9012d644f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68034630 con 0x7f2d5c004d00 2023-12-19T05:45:07.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6802f070 con 0x7f2d5c004d00 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6e7fc640 1 -- 172.21.15.49:0/806624006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68034a10 con 0x7f2d5c004d00 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6ffff640 1 -- 172.21.15.49:0/806624006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 msgr2=0x7f2d5c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/806624006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d5c005180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a810 tx=0x7f2d5c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.983+0000 7f2d6f7fe640 1 -- 172.21.15.49:0/806624006 reap_dead start 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.984+0000 7f2d6ffff640 1 -- 172.21.15.49:0/806624006 shutdown_connections 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.984+0000 7f2d6ffff640 1 -- 172.21.15.49:0/806624006 >> 172.21.15.49:0/806624006 conn(0x7f2d700d3230 msgr2=0x7f2d700d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.984+0000 7f2d6ffff640 1 -- 172.21.15.49:0/806624006 shutdown_connections 2023-12-19T05:45:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.984+0000 7f2d6ffff640 1 -- 172.21.15.49:0/806624006 wait complete. 2023-12-19T05:45:07.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.986+0000 7f2d6ffff640 1 Processor -- start 2023-12-19T05:45:07.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.986+0000 7f2d6ffff640 1 -- start start 2023-12-19T05:45:07.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 0x7f2d70141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d7013e3f0 0x7f2d7013e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7013edb0 con 0x7f2d5c004d00 2023-12-19T05:45:07.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70142af0 con 0x7f2d7013e3f0 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70141ee0 con 0x7f2d70131ab0 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47298/0 (socket says 172.21.15.49:47298) 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.987+0000 7f2d6effd640 1 -- 172.21.15.49:0/356164043 learned_addr learned my addr 172.21.15.49:0/356164043 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d67fff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 0x7f2d70141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6f7fe640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d7013e3f0 0x7f2d7013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 -- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 msgr2=0x7f2d70141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 0x7f2d70141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 -- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d7013e3f0 msgr2=0x7f2d7013e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d7013e3f0 0x7f2d7013e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 -- 172.21.15.49:0/356164043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d701421c0 con 0x7f2d5c004d00 2023-12-19T05:45:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d67fff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 0x7f2d70141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.988+0000 7f2d6effd640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e7d0 tx=0x7f2d6000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.989+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600050d0 con 0x7f2d5c004d00 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.989+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60005230 con 0x7f2d5c004d00 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.989+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000c6c0 con 0x7f2d5c004d00 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.989+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d701424a0 con 0x7f2d5c004d00 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.989+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d70131f30 con 0x7f2d5c004d00 2023-12-19T05:45:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.990+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70061910 con 0x7f2d5c004d00 2023-12-19T05:45:07.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.991+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d6000c820 con 0x7f2d5c004d00 2023-12-19T05:45:07.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.992+0000 7f2d6cff9640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 0x7f2d5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:07.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.992+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2d60088690 con 0x7f2d5c004d00 2023-12-19T05:45:07.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.993+0000 7f2d67fff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 0x7f2d5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.994+0000 7f2d67fff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 0x7f2d5006c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2d70157300 tx=0x7f2d58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:07.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:07.998+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d600578e0 con 0x7f2d5c004d00 2023-12-19T05:45:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.192+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d700b74f0 con 0x7f2d5c004d00 2023-12-19T05:45:08.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.723+0000 7f2d6cff9640 1 -- 172.21.15.49:0/356164043 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2d600012d0 con 0x7f2d5c004d00 2023-12-19T05:45:08.728 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:45:08.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.731+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 msgr2=0x7f2d5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.731+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 0x7f2d5006c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2d70157300 tx=0x7f2d58008040 comp rx=0 tx=0).stop 2023-12-19T05:45:08.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.731+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 msgr2=0x7f2d701f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.731+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e7d0 tx=0x7f2d6000ec90 comp rx=0 tx=0).stop 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 shutdown_connections 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d5006a430 0x7f2d5006c8f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70131ab0 0x7f2d70141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d7013e3f0 0x7f2d7013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 --2- 172.21.15.49:0/356164043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c004d00 0x7f2d701f6460 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.733+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 >> 172.21.15.49:0/356164043 conn(0x7f2d700d3230 msgr2=0x7f2d70070660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:08.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.734+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 shutdown_connections 2023-12-19T05:45:08.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.735+0000 7f2d6ffff640 1 -- 172.21.15.49:0/356164043 wait complete. 2023-12-19T05:45:08.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:45:08.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.971+0000 7fef7a004640 1 Processor -- start 2023-12-19T05:45:08.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.971+0000 7fef7a004640 1 -- start start 2023-12-19T05:45:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef7a004640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef7415e460 0x7fef740ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef7a004640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740cd020 con 0x7fef7415ae50 2023-12-19T05:45:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef7a004640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740cca30 con 0x7fef740ce750 2023-12-19T05:45:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef7a004640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7415e8e0 con 0x7fef7415e460 2023-12-19T05:45:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef79002640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef7415ae50 0x7fef740b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40064/0 (socket says 172.21.15.49:40064) 2023-12-19T05:45:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef79002640 1 -- 172.21.15.49:0/960309890 learned_addr learned my addr 172.21.15.49:0/960309890 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.973+0000 7fef78801640 1 --2- 172.21.15.49:0/960309890 >> v2:172.21.15.49:3300/0 conn(0x7fef7415e460 0x7fef740ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.974+0000 7fef6bfff640 1 -- 172.21.15.49:0/960309890 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938668324 0 0) 0x7fef740cd020 con 0x7fef7415ae50 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.974+0000 7fef6bfff640 1 -- 172.21.15.49:0/960309890 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef60003520 con 0x7fef7415ae50 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.974+0000 7fef78801640 1 -- 172.21.15.49:0/960309890 >> v1:172.21.15.115:6789/0 conn(0x7fef740ce750 legacy=0x7fef740cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.974+0000 7fef78801640 1 -- 172.21.15.49:0/960309890 >> v1:172.21.15.49:6789/0 conn(0x7fef7415ae50 legacy=0x7fef740b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.974+0000 7fef78801640 1 -- 172.21.15.49:0/960309890 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740b2f20 con 0x7fef7415e460 2023-12-19T05:45:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.975+0000 7fef78801640 1 --2- 172.21.15.49:0/960309890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef740ce210 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fef640097a0 tx=0x7fef6402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a2b1beb9ff33ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef6bfff640 1 -- 172.21.15.49:0/960309890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64030610 con 0x7fef7415e460 2023-12-19T05:45:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef6bfff640 1 -- 172.21.15.49:0/960309890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64030770 con 0x7fef7415e460 2023-12-19T05:45:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef6bfff640 1 -- 172.21.15.49:0/960309890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64030b00 con 0x7fef7415e460 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 -- 172.21.15.49:0/960309890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 msgr2=0x7fef740ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 --2- 172.21.15.49:0/960309890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef740ce210 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fef640097a0 tx=0x7fef6402b960 comp rx=0 tx=0).stop 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 -- 172.21.15.49:0/960309890 shutdown_connections 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 --2- 172.21.15.49:0/960309890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef740ce210 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 -- 172.21.15.49:0/960309890 >> 172.21.15.49:0/960309890 conn(0x7fef7406f630 msgr2=0x7fef7406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 -- 172.21.15.49:0/960309890 shutdown_connections 2023-12-19T05:45:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.976+0000 7fef7a004640 1 -- 172.21.15.49:0/960309890 wait complete. 2023-12-19T05:45:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.978+0000 7fef7a004640 1 Processor -- start 2023-12-19T05:45:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.978+0000 7fef7a004640 1 -- start start 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 0x7fef7415fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef7415ae50 0x7fef741602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7415bd00 con 0x7fef7415e460 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef741f6a00 con 0x7fef740ce750 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.979+0000 7fef7a004640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef741f5e80 con 0x7fef7415ae50 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47322/0 (socket says 172.21.15.49:47322) 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 -- 172.21.15.49:0/610902611 learned_addr learned my addr 172.21.15.49:0/610902611 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79002640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 0x7fef7415fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 -- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef7415ae50 msgr2=0x7fef741602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef78801640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef7415ae50 0x7fef741602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef7415ae50 0x7fef741602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 -- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 msgr2=0x7fef7415fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 0x7fef7415fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 -- 172.21.15.49:0/610902611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64009400 con 0x7fef7415e460 2023-12-19T05:45:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79002640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 0x7fef7415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.980+0000 7fef79803640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c730 tx=0x7fef6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.981+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c003b70 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.981+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c003cd0 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.981+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00aa90 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.981+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef741f6160 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.981+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef741f6720 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.982+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7406b2b0 con 0x7fef7415e460 2023-12-19T05:45:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.983+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef6c00abf0 con 0x7fef7415e460 2023-12-19T05:45:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.985+0000 7fef69ffb640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 0x7fef5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.985+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fef6c0886d0 con 0x7fef7415e460 2023-12-19T05:45:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.985+0000 7fef79002640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 0x7fef5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.986+0000 7fef79002640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 0x7fef5806c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef700011e0 tx=0x7fef70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:08.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:08.990+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef7406b2b0 con 0x7fef7415e460 2023-12-19T05:45:09.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.224+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fef7406b2b0 con 0x7fef7415e460 2023-12-19T05:45:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.239+0000 7fef69ffb640 1 -- 172.21.15.49:0/610902611 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7fef7406b2b0 con 0x7fef7415e460 2023-12-19T05:45:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 12 and data pool 13 2023-12-19T05:45:09.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 msgr2=0x7fef5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 0x7fef5806c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef700011e0 tx=0x7fef70009040 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 msgr2=0x7fef741480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c730 tx=0x7fef6c00cbf0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 shutdown_connections 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fef5806a430 0x7fef5806c8f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef7415ae50 0x7fef741602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef7415e460 0x7fef741480d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 --2- 172.21.15.49:0/610902611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef740ce750 0x7fef7415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.250+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 >> 172.21.15.49:0/610902611 conn(0x7fef7406f630 msgr2=0x7fef740b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:09.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.251+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 shutdown_connections 2023-12-19T05:45:09.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.251+0000 7fef7a004640 1 -- 172.21.15.49:0/610902611 wait complete. 2023-12-19T05:45:09.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:09.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.470+0000 7f8f5a896640 1 Processor -- start 2023-12-19T05:45:09.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.470+0000 7f8f5a896640 1 -- start start 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541449e0 0x7f8f540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540b0b50 0x7f8f5406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 0x7f8f5406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f540afb10 con 0x7f8f540b0b50 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5406bb30 con 0x7f8f5406b590 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.471+0000 7f8f5a896640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540b0070 con 0x7f8f541449e0 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540b0b50 0x7f8f5406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540b0b50 0x7f8f5406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47330/0 (socket says 172.21.15.49:47330) 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 -- 172.21.15.49:0/404592160 learned_addr learned my addr 172.21.15.49:0/404592160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f58e33640 1 --2- 172.21.15.49:0/404592160 >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 0x7f8f5406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f53fff640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541449e0 0x7f8f540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 -- 172.21.15.49:0/404592160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541449e0 msgr2=0x7f8f540af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541449e0 0x7f8f540af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 -- 172.21.15.49:0/404592160 >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 msgr2=0x7f8f5406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/404592160 >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 0x7f8f5406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f4bfff640 1 -- 172.21.15.49:0/404592160 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540b0350 con 0x7f8f540b0b50 2023-12-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.472+0000 7f8f58e33640 1 --2- 172.21.15.49:0/404592160 >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 0x7f8f5406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540b0b50 0x7f8f5406bfa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8f54071c50 tx=0x7f8f3c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408adad83621133d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f537fe640 1 -- 172.21.15.49:0/404592160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c031860 con 0x7f8f540b0b50 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f537fe640 1 -- 172.21.15.49:0/404592160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c0319c0 con 0x7f8f540b0b50 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f537fe640 1 -- 172.21.15.49:0/404592160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c031d50 con 0x7f8f540b0b50 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f5a896640 1 -- 172.21.15.49:0/404592160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540b0b50 msgr2=0x7f8f5406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.474+0000 7f8f5a896640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540b0b50 0x7f8f5406bfa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8f54071c50 tx=0x7f8f3c02b900 comp rx=0 tx=0).stop 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 -- 172.21.15.49:0/404592160 shutdown_connections 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 --2- 172.21.15.49:0/404592160 >> v2:172.21.15.115:3300/0 conn(0x7f8f5406b590 0x7f8f5406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540b0b50 0x7f8f5406bfa0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 --2- 172.21.15.49:0/404592160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541449e0 0x7f8f540af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 -- 172.21.15.49:0/404592160 >> 172.21.15.49:0/404592160 conn(0x7f8f540cbb70 msgr2=0x7f8f540cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 -- 172.21.15.49:0/404592160 shutdown_connections 2023-12-19T05:45:09.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.475+0000 7f8f5a896640 1 -- 172.21.15.49:0/404592160 wait complete. 2023-12-19T05:45:09.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.477+0000 7f8f5a896640 1 Processor -- start 2023-12-19T05:45:09.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.477+0000 7f8f5a896640 1 -- start start 2023-12-19T05:45:09.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f540b0b50 0x7f8f541f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f541449e0 0x7f8f5413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54141900 con 0x7f8f5406b590 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54140c80 con 0x7f8f541449e0 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f5a896640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54140f60 con 0x7f8f540b0b50 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47336/0 (socket says 172.21.15.49:47336) 2023-12-19T05:45:09.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f53fff640 1 -- 172.21.15.49:0/3562201029 learned_addr learned my addr 172.21.15.49:0/3562201029 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f58e33640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f541449e0 0x7f8f5413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f540b0b50 0x7f8f541f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.478+0000 7f8f53fff640 1 -- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f540b0b50 msgr2=0x7f8f541f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f53fff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f540b0b50 0x7f8f541f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f53fff640 1 -- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f541449e0 msgr2=0x7f8f5413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f53fff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f541449e0 0x7f8f5413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f53fff640 1 -- 172.21.15.49:0/3562201029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0094d0 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f53fff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400c7f0 tx=0x7f8f4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44004220 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f440043a0 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44007860 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f54141240 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.479+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5415b140 con 0x7f8f5406b590 2023-12-19T05:45:09.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.480+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f540cb5b0 con 0x7f8f5406b590 2023-12-19T05:45:09.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.482+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f44007bd0 con 0x7f8f5406b590 2023-12-19T05:45:09.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.482+0000 7f8f517fa640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.483+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f44088a40 con 0x7f8f5406b590 2023-12-19T05:45:09.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.483+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.484+0000 7f8f4bfff640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c036000 tx=0x7f8f3c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.487+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f44053f90 con 0x7f8f5406b590 2023-12-19T05:45:09.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.681+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f54061910 con 0x7f8f5406b590 2023-12-19T05:45:09.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.685+0000 7f8f517fa640 1 -- 172.21.15.49:0/3562201029 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16128 (secure 0 0 0) 0x7f8f4401e020 con 0x7f8f5406b590 2023-12-19T05:45:09.687 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:09.687 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":109,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:09.226298+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:09.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 msgr2=0x7f8f3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c036000 tx=0x7f8f3c03c040 comp rx=0 tx=0).stop 2023-12-19T05:45:09.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 msgr2=0x7f8f5415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400c7f0 tx=0x7f8f4400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 shutdown_connections 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f3406a430 0x7f8f3406c8f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f540b0b50 0x7f8f541f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f541449e0 0x7f8f5413fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.687+0000 7f8f5a896640 1 --2- 172.21.15.49:0/3562201029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f5406b590 0x7f8f5415ac00 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.688+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 >> 172.21.15.49:0/3562201029 conn(0x7f8f540cbb70 msgr2=0x7f8f5406f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.688+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 shutdown_connections 2023-12-19T05:45:09.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.688+0000 7f8f5a896640 1 -- 172.21.15.49:0/3562201029 wait complete. 2023-12-19T05:45:09.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.927+0000 7fc87e2e5640 1 Processor -- start 2023-12-19T05:45:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.927+0000 7fc87e2e5640 1 -- start start 2023-12-19T05:45:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.929+0000 7fc87e2e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.929+0000 7fc87e2e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 0x7fc8780b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.929+0000 7fc87e2e5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87815ec30 con 0x7fc8780cdbf0 2023-12-19T05:45:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.929+0000 7fc87e2e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780b2cc0 con 0x7fc87815f680 2023-12-19T05:45:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.929+0000 7fc87e2e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815e980 con 0x7fc87815e5a0 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:42654/0 (socket says 172.21.15.49:42654) 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3484735102 learned_addr learned my addr 172.21.15.49:0/3484735102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87cae2640 1 --2- 172.21.15.49:0/3484735102 >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 0x7fc8780b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3484735102 >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 msgr2=0x7fc8780b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 --2- 172.21.15.49:0/3484735102 >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 0x7fc8780b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3484735102 >> v1:172.21.15.115:6789/0 conn(0x7fc8780cdbf0 legacy=0x7fc87806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3484735102 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780b2f90 con 0x7fc87815e5a0 2023-12-19T05:45:09.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.930+0000 7fc87cae2640 1 --2- 172.21.15.49:0/3484735102 >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 0x7fc8780b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.932+0000 7fc87d2e3640 1 --2- 172.21.15.49:0/3484735102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc87402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f45aa9f5074aafd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.932+0000 7fc86ffff640 1 -- 172.21.15.49:0/3484735102 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874030840 con 0x7fc87815e5a0 2023-12-19T05:45:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.932+0000 7fc86ffff640 1 -- 172.21.15.49:0/3484735102 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740309a0 con 0x7fc87815e5a0 2023-12-19T05:45:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.932+0000 7fc86ffff640 1 -- 172.21.15.49:0/3484735102 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874030d30 con 0x7fc87815e5a0 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3484735102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 msgr2=0x7fc8780b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3484735102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc87402b980 comp rx=0 tx=0).stop 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3484735102 shutdown_connections 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3484735102 >> v2:172.21.15.115:3300/0 conn(0x7fc87815f680 0x7fc8780b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3484735102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc8780b2030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3484735102 >> 172.21.15.49:0/3484735102 conn(0x7fc8780b0100 msgr2=0x7fc8780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3484735102 shutdown_connections 2023-12-19T05:45:09.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.933+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3484735102 wait complete. 2023-12-19T05:45:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.935+0000 7fc87e2e5640 1 Processor -- start 2023-12-19T05:45:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.935+0000 7fc87e2e5640 1 -- start start 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc878159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc87815f680 0x7fc87815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815b540 con 0x7fc8780cdbf0 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815a930 con 0x7fc87815f680 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87e2e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815ac10 con 0x7fc87815e5a0 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87d2e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87d2e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47348/0 (socket says 172.21.15.49:47348) 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3816226457 learned_addr learned my addr 172.21.15.49:0/3816226457 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.936+0000 7fc87cae2640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc878159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 msgr2=0x7fc878159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc878159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87dae4640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc87815f680 0x7fc87815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc87815f680 msgr2=0x7fc87815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc87815f680 0x7fc87815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 -- 172.21.15.49:0/3816226457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094d0 con 0x7fc8780cdbf0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87d2e3640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874039c90 con 0x7fc8780cdbf0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874039df0 con 0x7fc8780cdbf0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874043640 con 0x7fc8780cdbf0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87815aef0 con 0x7fc8780cdbf0 2023-12-19T05:45:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.937+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc878153250 con 0x7fc8780cdbf0 2023-12-19T05:45:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.939+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878061910 con 0x7fc8780cdbf0 2023-12-19T05:45:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.940+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8740437a0 con 0x7fc8780cdbf0 2023-12-19T05:45:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.940+0000 7fc86dffb640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 0x7fc85c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.941+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc87403e070 con 0x7fc8780cdbf0 2023-12-19T05:45:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.941+0000 7fc87cae2640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 0x7fc85c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.942+0000 7fc87cae2640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 0x7fc85c06c8f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc87815c240 tx=0x7fc868008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:09.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:09.945+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc874077030 con 0x7fc8780cdbf0 2023-12-19T05:45:10.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.140+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8780cb780 con 0x7fc8780cdbf0 2023-12-19T05:45:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.142+0000 7fc86dffb640 1 -- 172.21.15.49:0/3816226457 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16128 (secure 0 0 0) 0x7fc874034090 con 0x7fc8780cdbf0 2023-12-19T05:45:10.144 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:10.144 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":109,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:09.226298+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 msgr2=0x7fc85c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 0x7fc85c06c8f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc87815c240 tx=0x7fc868008040 comp rx=0 tx=0).stop 2023-12-19T05:45:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 msgr2=0x7fc878152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc874004730 comp rx=0 tx=0).stop 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 shutdown_connections 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc85c06a430 0x7fc85c06c8f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc87815e5a0 0x7fc878159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc87815f680 0x7fc87815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 --2- 172.21.15.49:0/3816226457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780cdbf0 0x7fc878152d10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 >> 172.21.15.49:0/3816226457 conn(0x7fc8780b0100 msgr2=0x7fc8780b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 shutdown_connections 2023-12-19T05:45:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.145+0000 7fc87e2e5640 1 -- 172.21.15.49:0/3816226457 wait complete. 2023-12-19T05:45:10.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:45:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.398+0000 7f2a5b59e640 1 Processor -- start 2023-12-19T05:45:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.399+0000 7f2a5b59e640 1 -- start start 2023-12-19T05:45:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.400+0000 7f2a5b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.400+0000 7f2a5b59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a5c06f160 0x7f2a5c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a5b59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0af1e0 con 0x7f2a5c0aee00 2023-12-19T05:45:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a5b59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c06fb10 con 0x7f2a5c06f160 2023-12-19T05:45:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a5b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1613a0 con 0x7f2a5c06e330 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:42666/0 (socket says 172.21.15.49:42666) 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.401+0000 7f2a53fff640 1 -- 172.21.15.49:0/3917812373 learned_addr learned my addr 172.21.15.49:0/3917812373 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.402+0000 7f2a5ad9d640 1 --2- 172.21.15.49:0/3917812373 >> v2:172.21.15.115:3300/0 conn(0x7f2a5c06f160 0x7f2a5c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.402+0000 7f2a53fff640 1 -- 172.21.15.49:0/3917812373 >> v2:172.21.15.115:3300/0 conn(0x7f2a5c06f160 msgr2=0x7f2a5c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.402+0000 7f2a53fff640 1 --2- 172.21.15.49:0/3917812373 >> v2:172.21.15.115:3300/0 conn(0x7f2a5c06f160 0x7f2a5c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.402+0000 7f2a53fff640 1 -- 172.21.15.49:0/3917812373 >> v1:172.21.15.115:6789/0 conn(0x7f2a5c0aee00 legacy=0x7f2a5c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.402+0000 7f2a53fff640 1 -- 172.21.15.49:0/3917812373 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c15e760 con 0x7f2a5c06e330 2023-12-19T05:45:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.403+0000 7f2a53fff640 1 --2- 172.21.15.49:0/3917812373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009870 tx=0x7f2a4402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bf56b614aff08e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:10.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.404+0000 7f2a59d9b640 1 -- 172.21.15.49:0/3917812373 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44030840 con 0x7f2a5c06e330 2023-12-19T05:45:10.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.404+0000 7f2a59d9b640 1 -- 172.21.15.49:0/3917812373 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440309a0 con 0x7f2a5c06e330 2023-12-19T05:45:10.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.404+0000 7f2a59d9b640 1 -- 172.21.15.49:0/3917812373 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44030d30 con 0x7f2a5c06e330 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 -- 172.21.15.49:0/3917812373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 msgr2=0x7f2a5c160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/3917812373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009870 tx=0x7f2a4402b980 comp rx=0 tx=0).stop 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 -- 172.21.15.49:0/3917812373 shutdown_connections 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/3917812373 >> v2:172.21.15.115:3300/0 conn(0x7f2a5c06f160 0x7f2a5c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/3917812373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06e330 0x7f2a5c160e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 -- 172.21.15.49:0/3917812373 >> 172.21.15.49:0/3917812373 conn(0x7f2a5c0b25e0 msgr2=0x7f2a5c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 -- 172.21.15.49:0/3917812373 shutdown_connections 2023-12-19T05:45:10.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.405+0000 7f2a5b59e640 1 -- 172.21.15.49:0/3917812373 wait complete. 2023-12-19T05:45:10.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.407+0000 7f2a5b59e640 1 Processor -- start 2023-12-19T05:45:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.407+0000 7f2a5b59e640 1 -- start start 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06f160 0x7f2a5c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a5c0aee00 0x7f2a5c0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c14f480 con 0x7f2a5c06e330 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1e6c50 con 0x7f2a5c0aee00 2023-12-19T05:45:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1e6f30 con 0x7f2a5c06f160 2023-12-19T05:45:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47352/0 (socket says 172.21.15.49:47352) 2023-12-19T05:45:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 -- 172.21.15.49:0/2337952900 learned_addr learned my addr 172.21.15.49:0/2337952900 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 -- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06f160 msgr2=0x7f2a5c14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06f160 0x7f2a5c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 -- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a5c0aee00 msgr2=0x7f2a5c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a5c0aee00 0x7f2a5c0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.409+0000 7f2a5a59c640 1 -- 172.21.15.49:0/2337952900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440094d0 con 0x7f2a5c06e330 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a5a59c640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00c400 tx=0x7f2a4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0052d0 con 0x7f2a5c06e330 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c005430 con 0x7f2a5c06e330 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c003830 con 0x7f2a5c06e330 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c1e7210 con 0x7f2a5c06e330 2023-12-19T05:45:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.410+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c1e77d0 con 0x7f2a5c06e330 2023-12-19T05:45:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.411+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c1e79c0 con 0x7f2a5c06e330 2023-12-19T05:45:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.412+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a4c003990 con 0x7f2a5c06e330 2023-12-19T05:45:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.414+0000 7f2a52ffd640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 0x7f2a3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.414+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a4c087f20 con 0x7f2a5c06e330 2023-12-19T05:45:10.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.415+0000 7f2a53fff640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 0x7f2a3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.416+0000 7f2a53fff640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 0x7f2a3c06c920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a4403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.419+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a4c0533e0 con 0x7f2a5c06e330 2023-12-19T05:45:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:10.650+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a5c061910 con 0x7f2a5c06e330 2023-12-19T05:45:11.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.306+0000 7f2a52ffd640 1 -- 172.21.15.49:0/2337952900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a4c0170b0 con 0x7f2a5c06e330 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.310+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 msgr2=0x7f2a3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.310+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 0x7f2a3c06c920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a4403b040 comp rx=0 tx=0).stop 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.310+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 msgr2=0x7f2a5c1e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.310+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00c400 tx=0x7f2a4c00c8c0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 shutdown_connections 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a3c06a460 0x7f2a3c06c920 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a5c06f160 0x7f2a5c14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a5c0aee00 0x7f2a5c0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 --2- 172.21.15.49:0/2337952900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a5c06e330 0x7f2a5c1e7cf0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 >> 172.21.15.49:0/2337952900 conn(0x7f2a5c0b25e0 msgr2=0x7f2a5c157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:11.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 shutdown_connections 2023-12-19T05:45:11.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.311+0000 7f2a5b59e640 1 -- 172.21.15.49:0/2337952900 wait complete. 2023-12-19T05:45:11.334 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:45:11.334 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:45:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.558+0000 7f3f95b01640 1 Processor -- start 2023-12-19T05:45:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.558+0000 7f3f95b01640 1 -- start start 2023-12-19T05:45:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95b01640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 0x7f3f900b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95b01640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f900cd430 0x7f3f9006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95b01640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9006b3a0 con 0x7f3f90159e40 2023-12-19T05:45:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95b01640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900b23e0 con 0x7f3f900cd430 2023-12-19T05:45:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95b01640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900b1860 con 0x7f3f900b0a00 2023-12-19T05:45:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f94aff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3f90159e40 0x7f3f900b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40066/0 (socket says 172.21.15.49:40066) 2023-12-19T05:45:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f94aff640 1 -- 172.21.15.49:0/590722679 learned_addr learned my addr 172.21.15.49:0/590722679 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.560+0000 7f3f95300640 1 --2- 172.21.15.49:0/590722679 >> v2:172.21.15.49:3300/0 conn(0x7f3f900cd430 0x7f3f9006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f8f7fe640 1 -- 172.21.15.49:0/590722679 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895865554 0 0) 0x7f3f9006b3a0 con 0x7f3f90159e40 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f8f7fe640 1 -- 172.21.15.49:0/590722679 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f78003520 con 0x7f3f90159e40 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f95300640 1 -- 172.21.15.49:0/590722679 >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 msgr2=0x7f3f900b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f8ffff640 1 --2- 172.21.15.49:0/590722679 >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 0x7f3f900b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f95300640 1 --2- 172.21.15.49:0/590722679 >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 0x7f3f900b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f95300640 1 -- 172.21.15.49:0/590722679 >> v1:172.21.15.49:6789/0 conn(0x7f3f90159e40 legacy=0x7f3f900b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f95300640 1 -- 172.21.15.49:0/590722679 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900b1b40 con 0x7f3f900cd430 2023-12-19T05:45:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.561+0000 7f3f8ffff640 1 --2- 172.21.15.49:0/590722679 >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 0x7f3f900b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.562+0000 7f3f95300640 1 --2- 172.21.15.49:0/590722679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f9006b810 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b2b90 tx=0x7f3f8802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbdcfe7b0439943 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.562+0000 7f3f8f7fe640 1 -- 172.21.15.49:0/590722679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8802cd00 con 0x7f3f900cd430 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.562+0000 7f3f8f7fe640 1 -- 172.21.15.49:0/590722679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8802ce60 con 0x7f3f900cd430 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.562+0000 7f3f8f7fe640 1 -- 172.21.15.49:0/590722679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88034660 con 0x7f3f900cd430 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 -- 172.21.15.49:0/590722679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 msgr2=0x7f3f9006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 --2- 172.21.15.49:0/590722679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f9006b810 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b2b90 tx=0x7f3f8802bf50 comp rx=0 tx=0).stop 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 -- 172.21.15.49:0/590722679 shutdown_connections 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 --2- 172.21.15.49:0/590722679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f9006b810 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 --2- 172.21.15.49:0/590722679 >> v2:172.21.15.115:3300/0 conn(0x7f3f900b0a00 0x7f3f900b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 -- 172.21.15.49:0/590722679 >> 172.21.15.49:0/590722679 conn(0x7f3f900659a0 msgr2=0x7f3f90065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 -- 172.21.15.49:0/590722679 shutdown_connections 2023-12-19T05:45:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.563+0000 7f3f95b01640 1 -- 172.21.15.49:0/590722679 wait complete. 2023-12-19T05:45:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.565+0000 7f3f95b01640 1 Processor -- start 2023-12-19T05:45:11.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.565+0000 7f3f95b01640 1 -- start start 2023-12-19T05:45:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900b0a00 0x7f3f9006b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f90159e40 0x7f3f90151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9015bb30 con 0x7f3f900cd430 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9014a280 con 0x7f3f900b0a00 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f95b01640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9015b570 con 0x7f3f90159e40 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.566+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47362/0 (socket says 172.21.15.49:47362) 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 -- 172.21.15.49:0/1417502965 learned_addr learned my addr 172.21.15.49:0/1417502965 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f94aff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900b0a00 0x7f3f9006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f95300640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f90159e40 0x7f3f90151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 -- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f90159e40 msgr2=0x7f3f90151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f90159e40 0x7f3f90151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 -- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900b0a00 msgr2=0x7f3f9006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900b0a00 0x7f3f9006b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:11.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 -- 172.21.15.49:0/1417502965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009a70 con 0x7f3f900cd430 2023-12-19T05:45:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.567+0000 7f3f8ffff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c820 tx=0x7f3f8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.568+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80007a30 con 0x7f3f900cd430 2023-12-19T05:45:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.568+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80007b90 con 0x7f3f900cd430 2023-12-19T05:45:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.568+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8000ce70 con 0x7f3f900cd430 2023-12-19T05:45:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.568+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9015b850 con 0x7f3f900cd430 2023-12-19T05:45:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.568+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9015d380 con 0x7f3f900cd430 2023-12-19T05:45:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.569+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f90061910 con 0x7f3f900cd430 2023-12-19T05:45:11.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.570+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f800113f0 con 0x7f3f900cd430 2023-12-19T05:45:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.571+0000 7f3f8d7fa640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 0x7f3f7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.571+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f80088ba0 con 0x7f3f900cd430 2023-12-19T05:45:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.572+0000 7f3f94aff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 0x7f3f7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.573+0000 7f3f94aff640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 0x7f3f7c06c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f840011e0 tx=0x7f3f84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:11.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.575+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f800540f0 con 0x7f3f900cd430 2023-12-19T05:45:11.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:11.807+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3f9006e1e0 con 0x7f3f900cd430 2023-12-19T05:45:12.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.739+0000 7f3f8d7fa640 1 -- 172.21.15.49:0/1417502965 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f8001f0c0 con 0x7f3f900cd430 2023-12-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 msgr2=0x7f3f7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 0x7f3f7c06c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f840011e0 tx=0x7f3f84009040 comp rx=0 tx=0).stop 2023-12-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 msgr2=0x7f3f901375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c820 tx=0x7f3f8000cc20 comp rx=0 tx=0).stop 2023-12-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 shutdown_connections 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3f7c06a430 0x7f3f7c06c8f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f90159e40 0x7f3f90151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f900cd430 0x7f3f901375b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 --2- 172.21.15.49:0/1417502965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900b0a00 0x7f3f9006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 >> 172.21.15.49:0/1417502965 conn(0x7f3f900659a0 msgr2=0x7f3f90158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 shutdown_connections 2023-12-19T05:45:12.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:12.743+0000 7f3f95b01640 1 -- 172.21.15.49:0/1417502965 wait complete. 2023-12-19T05:45:12.768 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:45:12.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.002+0000 7f46b52b9640 1 Processor -- start 2023-12-19T05:45:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.002+0000 7f46b52b9640 1 -- start start 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46b52b9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46b0159f80 0x7f46b006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46b52b9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46b015aa70 0x7f46b015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46b52b9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b006b520 con 0x7f46b015b1e0 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46b52b9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00b2b20 con 0x7f46b0159f80 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46b52b9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00b2fb0 con 0x7f46b015aa70 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46affff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46b0159f80 0x7f46b006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46affff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46b0159f80 0x7f46b006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47370/0 (socket says 172.21.15.49:47370) 2023-12-19T05:45:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.004+0000 7f46affff640 1 -- 172.21.15.49:0/3563714494 learned_addr learned my addr 172.21.15.49:0/3563714494 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.005+0000 7f46affff640 1 -- 172.21.15.49:0/3563714494 >> v2:172.21.15.115:3300/0 conn(0x7f46b015aa70 msgr2=0x7f46b015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.005+0000 7f46affff640 1 --2- 172.21.15.49:0/3563714494 >> v2:172.21.15.115:3300/0 conn(0x7f46b015aa70 0x7f46b015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.005+0000 7f46affff640 1 -- 172.21.15.49:0/3563714494 >> v1:172.21.15.115:6789/0 conn(0x7f46b015b1e0 legacy=0x7f46b015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.005+0000 7f46affff640 1 -- 172.21.15.49:0/3563714494 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00b1f10 con 0x7f46b0159f80 2023-12-19T05:45:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.006+0000 7f46affff640 1 --2- 172.21.15.49:0/3563714494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b0159f80 0x7f46b006f160 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ae020 tx=0x7f46a002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83eba425371eb48e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.006+0000 7f46aeffd640 1 -- 172.21.15.49:0/3563714494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0036440 con 0x7f46b0159f80 2023-12-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.006+0000 7f46aeffd640 1 -- 172.21.15.49:0/3563714494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a00365a0 con 0x7f46b0159f80 2023-12-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.006+0000 7f46aeffd640 1 -- 172.21.15.49:0/3563714494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0036930 con 0x7f46b0159f80 2023-12-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 -- 172.21.15.49:0/3563714494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b0159f80 msgr2=0x7f46b006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 --2- 172.21.15.49:0/3563714494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b0159f80 0x7f46b006f160 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ae020 tx=0x7f46a002e170 comp rx=0 tx=0).stop 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 -- 172.21.15.49:0/3563714494 shutdown_connections 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 --2- 172.21.15.49:0/3563714494 >> v2:172.21.15.115:3300/0 conn(0x7f46b015aa70 0x7f46b015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 --2- 172.21.15.49:0/3563714494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b0159f80 0x7f46b006f160 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 -- 172.21.15.49:0/3563714494 >> 172.21.15.49:0/3563714494 conn(0x7f46b00b0100 msgr2=0x7f46b00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 -- 172.21.15.49:0/3563714494 shutdown_connections 2023-12-19T05:45:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.007+0000 7f46b52b9640 1 -- 172.21.15.49:0/3563714494 wait complete. 2023-12-19T05:45:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.009+0000 7f46b52b9640 1 Processor -- start 2023-12-19T05:45:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.009+0000 7f46b52b9640 1 -- start start 2023-12-19T05:45:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b0159f80 0x7f46b00c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 0x7f46b00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0145940 con 0x7f46b015aa70 2023-12-19T05:45:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b01455f0 con 0x7f46b0159f80 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.010+0000 7f46b52b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00c4750 con 0x7f46b015b1e0 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47376/0 (socket says 172.21.15.49:47376) 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 -- 172.21.15.49:0/393341356 learned_addr learned my addr 172.21.15.49:0/393341356 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46affff640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b0159f80 0x7f46b00c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46b4ab8640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 0x7f46b00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 -- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 msgr2=0x7f46b00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 0x7f46b00c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 -- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b0159f80 msgr2=0x7f46b00c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b0159f80 0x7f46b00c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 -- 172.21.15.49:0/393341356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a000b770 con 0x7f46b015aa70 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46b4ab8640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 0x7f46b00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.011+0000 7f46af7fe640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b3e0 tx=0x7f46a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.012+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4011830 con 0x7f46b015aa70 2023-12-19T05:45:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.012+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40119b0 con 0x7f46b015aa70 2023-12-19T05:45:13.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.012+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4011d60 con 0x7f46b015aa70 2023-12-19T05:45:13.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.012+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b00c4a30 con 0x7f46b015aa70 2023-12-19T05:45:13.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.012+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b00c4440 con 0x7f46b015aa70 2023-12-19T05:45:13.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.013+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b0145a80 con 0x7f46b015aa70 2023-12-19T05:45:13.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.014+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f46a401a400 con 0x7f46b015aa70 2023-12-19T05:45:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.015+0000 7f46acff9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 0x7f469c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.015+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a4088b40 con 0x7f46b015aa70 2023-12-19T05:45:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.016+0000 7f46affff640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 0x7f469c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.017+0000 7f46affff640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 0x7f469c06c8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f46a0038000 tx=0x7f46a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.020+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f46b0145a80 con 0x7f46b015aa70 2023-12-19T05:45:13.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.251+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46b0145a80 con 0x7f46b015aa70 2023-12-19T05:45:13.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.253+0000 7f46acff9640 1 -- 172.21.15.49:0/393341356 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f46b0145a80 con 0x7f46b015aa70 2023-12-19T05:45:13.255 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:13.255 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:13.255 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:13.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 msgr2=0x7f469c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 0x7f469c06c8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f46a0038000 tx=0x7f46a0008040 comp rx=0 tx=0).stop 2023-12-19T05:45:13.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 msgr2=0x7f46b0144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b3e0 tx=0x7f46a400b8a0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 shutdown_connections 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f469c06a430 0x7f469c06c8f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b015b1e0 0x7f46b00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b015aa70 0x7f46b0144d30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 --2- 172.21.15.49:0/393341356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b0159f80 0x7f46b00c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 >> 172.21.15.49:0/393341356 conn(0x7f46b00b0100 msgr2=0x7f46b00b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 shutdown_connections 2023-12-19T05:45:13.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.256+0000 7f46b52b9640 1 -- 172.21.15.49:0/393341356 wait complete. 2023-12-19T05:45:13.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.511+0000 7f1d8759e640 1 Processor -- start 2023-12-19T05:45:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.511+0000 7f1d8759e640 1 -- start start 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.513+0000 7f1d8759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.513+0000 7f1d8759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 0x7f1d880b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.513+0000 7f1d8759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8815ec30 con 0x7f1d880cdbf0 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.513+0000 7f1d8759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880b2cc0 con 0x7f1d8815f680 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.513+0000 7f1d8759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8815e980 con 0x7f1d8815e5a0 2023-12-19T05:45:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:42694/0 (socket says 172.21.15.49:42694) 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 -- 172.21.15.49:0/3283923767 learned_addr learned my addr 172.21.15.49:0/3283923767 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d85d9b640 1 --2- 172.21.15.49:0/3283923767 >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 0x7f1d880b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 -- 172.21.15.49:0/3283923767 >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 msgr2=0x7f1d880b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 --2- 172.21.15.49:0/3283923767 >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 0x7f1d880b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 -- 172.21.15.49:0/3283923767 >> v1:172.21.15.115:6789/0 conn(0x7f1d880cdbf0 legacy=0x7f1d8806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d8659c640 1 -- 172.21.15.49:0/3283923767 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880b2f90 con 0x7f1d8815e5a0 2023-12-19T05:45:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.514+0000 7f1d85d9b640 1 --2- 172.21.15.49:0/3283923767 >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 0x7f1d880b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.516+0000 7f1d8659c640 1 --2- 172.21.15.49:0/3283923767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d7802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74dcaffe35dbdb2f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.516+0000 7f1d8559a640 1 -- 172.21.15.49:0/3283923767 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78030840 con 0x7f1d8815e5a0 2023-12-19T05:45:13.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.516+0000 7f1d8559a640 1 -- 172.21.15.49:0/3283923767 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780309a0 con 0x7f1d8815e5a0 2023-12-19T05:45:13.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.516+0000 7f1d8559a640 1 -- 172.21.15.49:0/3283923767 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78030d30 con 0x7f1d8815e5a0 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 -- 172.21.15.49:0/3283923767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 msgr2=0x7f1d880b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3283923767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d7802b980 comp rx=0 tx=0).stop 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 -- 172.21.15.49:0/3283923767 shutdown_connections 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3283923767 >> v2:172.21.15.115:3300/0 conn(0x7f1d8815f680 0x7f1d880b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3283923767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d880b2030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 -- 172.21.15.49:0/3283923767 >> 172.21.15.49:0/3283923767 conn(0x7f1d880b0100 msgr2=0x7f1d880b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 -- 172.21.15.49:0/3283923767 shutdown_connections 2023-12-19T05:45:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.517+0000 7f1d8759e640 1 -- 172.21.15.49:0/3283923767 wait complete. 2023-12-19T05:45:13.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.519+0000 7f1d8759e640 1 Processor -- start 2023-12-19T05:45:13.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.519+0000 7f1d8759e640 1 -- start start 2023-12-19T05:45:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d88157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 0x7f1d88153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8814fc20 con 0x7f1d880cdbf0 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881460b0 con 0x7f1d8815f680 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.520+0000 7f1d8759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88157be0 con 0x7f1d8815e5a0 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47390/0 (socket says 172.21.15.49:47390) 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 -- 172.21.15.49:0/3637584739 learned_addr learned my addr 172.21.15.49:0/3637584739 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d85d9b640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d88157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 -- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 msgr2=0x7f1d88157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d88157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 -- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 msgr2=0x7f1d88153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d86d9d640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 0x7f1d88153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 0x7f1d88153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 -- 172.21.15.49:0/3637584739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780094d0 con 0x7f1d880cdbf0 2023-12-19T05:45:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d86d9d640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 0x7f1d88153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.521+0000 7f1d8659c640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.522+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78039c90 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.522+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78039df0 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.522+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78043640 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.522+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88157ec0 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.522+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8814f840 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.523+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d88061910 con 0x7f1d880cdbf0 2023-12-19T05:45:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.524+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d780437a0 con 0x7f1d880cdbf0 2023-12-19T05:45:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.525+0000 7f1d76ffd640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 0x7f1d6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.525+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d7803e070 con 0x7f1d880cdbf0 2023-12-19T05:45:13.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.526+0000 7f1d85d9b640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 0x7f1d6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.527+0000 7f1d85d9b640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 0x7f1d6806c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006fd0 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.530+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d78077030 con 0x7f1d880cdbf0 2023-12-19T05:45:13.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.728+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d880b4ed0 con 0x7f1d880cdbf0 2023-12-19T05:45:13.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.731+0000 7f1d76ffd640 1 -- 172.21.15.49:0/3637584739 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f1d78034090 con 0x7f1d880cdbf0 2023-12-19T05:45:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":110,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:10.230673+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 msgr2=0x7f1d6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 0x7f1d6806c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006fd0 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 msgr2=0x7f1d88145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d78004730 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 shutdown_connections 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1d6806a430 0x7f1d6806c8f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d8815e5a0 0x7f1d88157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d8815f680 0x7f1d88153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 --2- 172.21.15.49:0/3637584739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d880cdbf0 0x7f1d88145b70 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 >> 172.21.15.49:0/3637584739 conn(0x7f1d880b0100 msgr2=0x7f1d880709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 shutdown_connections 2023-12-19T05:45:13.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.734+0000 7f1d8759e640 1 -- 172.21.15.49:0/3637584739 wait complete. 2023-12-19T05:45:13.757 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:45:13.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:45:13.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.983+0000 7f1b2f4b2640 1 Processor -- start 2023-12-19T05:45:13.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.984+0000 7f1b2f4b2640 1 -- start start 2023-12-19T05:45:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2f4b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b280b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2f4b2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280b8300 con 0x7f1b280b7ea0 2023-12-19T05:45:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2f4b2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280d12d0 con 0x7f1b280d0c60 2023-12-19T05:45:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2f4b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28147210 con 0x7f1b28146e30 2023-12-19T05:45:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2dcaf640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b280b7ea0 0x7f1b280d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40070/0 (socket says 172.21.15.49:40070) 2023-12-19T05:45:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.985+0000 7f1b2dcaf640 1 -- 172.21.15.49:0/1735616613 learned_addr learned my addr 172.21.15.49:0/1735616613 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b280b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913897867 0 0) 0x7f1b280b8300 con 0x7f1b280b7ea0 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b14003520 con 0x7f1b280b7ea0 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119571750 0 0) 0x7f1b14003520 con 0x7f1b280b7ea0 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 msgr2=0x7f1b280b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b280b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 >> v1:172.21.15.115:6789/0 conn(0x7f1b280d0c60 legacy=0x7f1b2815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280d15b0 con 0x7f1b280b7ea0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1b18001670 con 0x7f1b280b7ea0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 >> v1:172.21.15.49:6789/0 conn(0x7f1b280b7ea0 legacy=0x7f1b280d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b140039a0 0x7f1b14003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b140047c0 0x7f1b14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28147210 con 0x7f1b140039a0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1400ba80 con 0x7f1b140047c0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.986+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1400bc40 con 0x7f1b28146e30 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b140039a0 0x7f1b14003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2ecb1640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2dcaf640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b140047c0 0x7f1b14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 -- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 msgr2=0x7f1b14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 -- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b140047c0 msgr2=0x7f1b14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b140047c0 0x7f1b14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2e4b0640 1 -- 172.21.15.49:0/1735616613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14003520 con 0x7f1b140039a0 2023-12-19T05:45:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2ecb1640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b28146e30 0x7f1b14005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.987+0000 7f1b2dcaf640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b140047c0 0x7f1b14004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.988+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b140039a0 0x7f1b14003d80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009ac0 tx=0x7f1b140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d6d628ddb2a70c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2402c6b0 con 0x7f1b140039a0 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2402c810 con 0x7f1b140039a0 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2d4ae640 1 -- 172.21.15.49:0/1735616613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2402cba0 con 0x7f1b140039a0 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1735616613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b140039a0 msgr2=0x7f1b14003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1735616613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b140039a0 0x7f1b14003d80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009ac0 tx=0x7f1b140057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2ecb1640 1 -- 172.21.15.49:0/1735616613 reap_dead start 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1735616613 shutdown_connections 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1735616613 >> 172.21.15.49:0/1735616613 conn(0x7f1b280b2990 msgr2=0x7f1b280b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.989+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1735616613 shutdown_connections 2023-12-19T05:45:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.990+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1735616613 wait complete. 2023-12-19T05:45:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.992+0000 7f1b2f4b2640 1 Processor -- start 2023-12-19T05:45:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.992+0000 7f1b2f4b2640 1 -- start start 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b140039a0 0x7f1b281e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b281e1b50 0x7f1b28142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280d0a50 con 0x7f1b280c9c90 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281e1fb0 con 0x7f1b281e1b50 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2f4b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28142ab0 con 0x7f1b140039a0 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2ecb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2ecb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51470/0 (socket says 172.21.15.49:51470) 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2ecb1640 1 -- 172.21.15.49:0/1158106501 learned_addr learned my addr 172.21.15.49:0/1158106501 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b140039a0 0x7f1b281e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2dcaf640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b281e1b50 0x7f1b28142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2ecb1640 1 -- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b140039a0 msgr2=0x7f1b281e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.993+0000 7f1b2ecb1640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b140039a0 0x7f1b281e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2ecb1640 1 -- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b281e1b50 msgr2=0x7f1b28142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2ecb1640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b281e1b50 0x7f1b28142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2ecb1640 1 -- 172.21.15.49:0/1158106501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280ca4a0 con 0x7f1b280c9c90 2023-12-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2ecb1640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b6450 tx=0x7f1b2000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20003b70 con 0x7f1b280c9c90 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20003cf0 con 0x7f1b280c9c90 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200052b0 con 0x7f1b280c9c90 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b280ca780 con 0x7f1b280c9c90 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.994+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b281e1350 con 0x7f1b280c9c90 2023-12-19T05:45:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.995+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b28061910 con 0x7f1b280c9c90 2023-12-19T05:45:13.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.996+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b20005410 con 0x7f1b280c9c90 2023-12-19T05:45:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.997+0000 7f1b1effd640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 0x7f1b0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.998+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b20087d30 con 0x7f1b280c9c90 2023-12-19T05:45:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.998+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 0x7f1b0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:13.999+0000 7f1b2e4b0640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 0x7f1b0c06c920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b24036000 tx=0x7f1b24030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:14.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.002+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b200533b0 con 0x7f1b280c9c90 2023-12-19T05:45:14.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.191+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b280d2370 con 0x7f1b0c06a460 2023-12-19T05:45:14.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.216+0000 7f1b1effd640 1 -- 172.21.15.49:0/1158106501 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282943 (secure 0 0 0) 0x7f1b240040c0 con 0x7f1b0c06a460 2023-12-19T05:45:14.222 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:14.224 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 msgr2=0x7f1b0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 0x7f1b0c06c920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b24036000 tx=0x7f1b24030000 comp rx=0 tx=0).stop 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 msgr2=0x7f1b281de390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b6450 tx=0x7f1b2000dc00 comp rx=0 tx=0).stop 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 shutdown_connections 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1b0c06a460 0x7f1b0c06c920 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b280c9c90 0x7f1b281de390 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b281e1b50 0x7f1b28142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 --2- 172.21.15.49:0/1158106501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b140039a0 0x7f1b281e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 >> 172.21.15.49:0/1158106501 conn(0x7f1b280b2990 msgr2=0x7f1b28143520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 shutdown_connections 2023-12-19T05:45:14.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.223+0000 7f1b2f4b2640 1 -- 172.21.15.49:0/1158106501 wait complete. 2023-12-19T05:45:14.245 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-12-19T05:45:12.630949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556635,"statfs":{"total":1600000000,"available":1593994256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929127"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244990+0000","last_change":"2023-12-19T05:45:09.257043+0000","last_active":"2023-12-19T05:45:10.244990+0000","last_peered":"2023-12-19T05:45:10.244990+0000","last_clean":"2023-12-19T05:45:10.244990+0000","last_became_active":"2023-12-19T05:45:09.256797+0000","last_became_peered":"2023-12-19T05:45:09.256797+0000","last_unstale":"2023-12-19T05:45:10.244990+0000","last_undegraded":"2023-12-19T05:45:10.244990+0000","last_fullsized":"2023-12-19T05:45:10.244990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:36:21.741080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470790+0000","last_change":"2023-12-19T05:45:09.258690+0000","last_active":"2023-12-19T05:45:11.470790+0000","last_peered":"2023-12-19T05:45:11.470790+0000","last_clean":"2023-12-19T05:45:11.470790+0000","last_became_active":"2023-12-19T05:45:09.256960+0000","last_became_peered":"2023-12-19T05:45:09.256960+0000","last_unstale":"2023-12-19T05:45:11.470790+0000","last_undegraded":"2023-12-19T05:45:11.470790+0000","last_fullsized":"2023-12-19T05:45:11.470790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.016593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082566+0000","last_change":"2023-12-19T05:45:09.240450+0000","last_active":"2023-12-19T05:45:12.082566+0000","last_peered":"2023-12-19T05:45:12.082566+0000","last_clean":"2023-12-19T05:45:12.082566+0000","last_became_active":"2023-12-19T05:45:09.240179+0000","last_became_peered":"2023-12-19T05:45:09.240179+0000","last_unstale":"2023-12-19T05:45:12.082566+0000","last_undegraded":"2023-12-19T05:45:12.082566+0000","last_fullsized":"2023-12-19T05:45:12.082566+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.016593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471248+0000","last_change":"2023-12-19T05:45:09.249771+0000","last_active":"2023-12-19T05:45:11.471248+0000","last_peered":"2023-12-19T05:45:11.471248+0000","last_clean":"2023-12-19T05:45:11.471248+0000","last_became_active":"2023-12-19T05:45:09.249159+0000","last_became_peered":"2023-12-19T05:45:09.249159+0000","last_unstale":"2023-12-19T05:45:11.471248+0000","last_undegraded":"2023-12-19T05:45:11.471248+0000","last_fullsized":"2023-12-19T05:45:11.471248+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:29:09.348594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245062+0000","last_change":"2023-12-19T05:45:09.254180+0000","last_active":"2023-12-19T05:45:10.245062+0000","last_peered":"2023-12-19T05:45:10.245062+0000","last_clean":"2023-12-19T05:45:10.245062+0000","last_became_active":"2023-12-19T05:45:09.251778+0000","last_became_peered":"2023-12-19T05:45:09.251778+0000","last_unstale":"2023-12-19T05:45:10.245062+0000","last_undegraded":"2023-12-19T05:45:10.245062+0000","last_fullsized":"2023-12-19T05:45:10.245062+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:33.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083051+0000","last_change":"2023-12-19T05:45:09.256051+0000","last_active":"2023-12-19T05:45:12.083051+0000","last_peered":"2023-12-19T05:45:12.083051+0000","last_clean":"2023-12-19T05:45:12.083051+0000","last_became_active":"2023-12-19T05:45:09.255770+0000","last_became_peered":"2023-12-19T05:45:09.255770+0000","last_unstale":"2023-12-19T05:45:12.083051+0000","last_undegraded":"2023-12-19T05:45:12.083051+0000","last_fullsized":"2023-12-19T05:45:12.083051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471269+0000","last_change":"2023-12-19T05:45:09.259912+0000","last_active":"2023-12-19T05:45:11.471269+0000","last_peered":"2023-12-19T05:45:11.471269+0000","last_clean":"2023-12-19T05:45:11.471269+0000","last_became_active":"2023-12-19T05:45:09.259643+0000","last_became_peered":"2023-12-19T05:45:09.259643+0000","last_unstale":"2023-12-19T05:45:11.471269+0000","last_undegraded":"2023-12-19T05:45:11.471269+0000","last_fullsized":"2023-12-19T05:45:11.471269+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:34.190637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469562+0000","last_change":"2023-12-19T05:45:09.254982+0000","last_active":"2023-12-19T05:45:11.469562+0000","last_peered":"2023-12-19T05:45:11.469562+0000","last_clean":"2023-12-19T05:45:11.469562+0000","last_became_active":"2023-12-19T05:45:09.254657+0000","last_became_peered":"2023-12-19T05:45:09.254657+0000","last_unstale":"2023-12-19T05:45:11.469562+0000","last_undegraded":"2023-12-19T05:45:11.469562+0000","last_fullsized":"2023-12-19T05:45:11.469562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244295+0000","last_change":"2023-12-19T05:45:09.242428+0000","last_active":"2023-12-19T05:45:10.244295+0000","last_peered":"2023-12-19T05:45:10.244295+0000","last_clean":"2023-12-19T05:45:10.244295+0000","last_became_active":"2023-12-19T05:45:09.242192+0000","last_became_peered":"2023-12-19T05:45:09.242192+0000","last_unstale":"2023-12-19T05:45:10.244295+0000","last_undegraded":"2023-12-19T05:45:10.244295+0000","last_fullsized":"2023-12-19T05:45:10.244295+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:52.241869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082712+0000","last_change":"2023-12-19T05:45:09.251882+0000","last_active":"2023-12-19T05:45:12.082712+0000","last_peered":"2023-12-19T05:45:12.082712+0000","last_clean":"2023-12-19T05:45:12.082712+0000","last_became_active":"2023-12-19T05:45:09.250718+0000","last_became_peered":"2023-12-19T05:45:09.250718+0000","last_unstale":"2023-12-19T05:45:12.082712+0000","last_undegraded":"2023-12-19T05:45:12.082712+0000","last_fullsized":"2023-12-19T05:45:12.082712+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:37.772485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248091+0000","last_change":"2023-12-19T05:45:09.257164+0000","last_active":"2023-12-19T05:45:10.248091+0000","last_peered":"2023-12-19T05:45:10.248091+0000","last_clean":"2023-12-19T05:45:10.248091+0000","last_became_active":"2023-12-19T05:45:09.256430+0000","last_became_peered":"2023-12-19T05:45:09.256430+0000","last_unstale":"2023-12-19T05:45:10.248091+0000","last_undegraded":"2023-12-19T05:45:10.248091+0000","last_fullsized":"2023-12-19T05:45:10.248091+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:48.512653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469517+0000","last_change":"2023-12-19T05:45:09.256968+0000","last_active":"2023-12-19T05:45:11.469517+0000","last_peered":"2023-12-19T05:45:11.469517+0000","last_clean":"2023-12-19T05:45:11.469517+0000","last_became_active":"2023-12-19T05:45:09.256679+0000","last_became_peered":"2023-12-19T05:45:09.256679+0000","last_unstale":"2023-12-19T05:45:11.469517+0000","last_undegraded":"2023-12-19T05:45:11.469517+0000","last_fullsized":"2023-12-19T05:45:11.469517+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243757+0000","last_change":"2023-12-19T05:45:09.240022+0000","last_active":"2023-12-19T05:45:10.243757+0000","last_peered":"2023-12-19T05:45:10.243757+0000","last_clean":"2023-12-19T05:45:10.243757+0000","last_became_active":"2023-12-19T05:45:09.239429+0000","last_became_peered":"2023-12-19T05:45:09.239429+0000","last_unstale":"2023-12-19T05:45:10.243757+0000","last_undegraded":"2023-12-19T05:45:10.243757+0000","last_fullsized":"2023-12-19T05:45:10.243757+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:42.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083125+0000","last_change":"2023-12-19T05:45:09.251489+0000","last_active":"2023-12-19T05:45:12.083125+0000","last_peered":"2023-12-19T05:45:12.083125+0000","last_clean":"2023-12-19T05:45:12.083125+0000","last_became_active":"2023-12-19T05:45:09.250067+0000","last_became_peered":"2023-12-19T05:45:09.250067+0000","last_unstale":"2023-12-19T05:45:12.083125+0000","last_undegraded":"2023-12-19T05:45:12.083125+0000","last_fullsized":"2023-12-19T05:45:12.083125+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:43.858482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471200+0000","last_change":"2023-12-19T05:45:09.246309+0000","last_active":"2023-12-19T05:45:11.471200+0000","last_peered":"2023-12-19T05:45:11.471200+0000","last_clean":"2023-12-19T05:45:11.471200+0000","last_became_active":"2023-12-19T05:45:09.246093+0000","last_became_peered":"2023-12-19T05:45:09.246093+0000","last_unstale":"2023-12-19T05:45:11.471200+0000","last_undegraded":"2023-12-19T05:45:11.471200+0000","last_fullsized":"2023-12-19T05:45:11.471200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:01.175099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083198+0000","last_change":"2023-12-19T05:45:09.263999+0000","last_active":"2023-12-19T05:45:12.083198+0000","last_peered":"2023-12-19T05:45:12.083198+0000","last_clean":"2023-12-19T05:45:12.083198+0000","last_became_active":"2023-12-19T05:45:09.263700+0000","last_became_peered":"2023-12-19T05:45:09.263700+0000","last_unstale":"2023-12-19T05:45:12.083198+0000","last_undegraded":"2023-12-19T05:45:12.083198+0000","last_fullsized":"2023-12-19T05:45:12.083198+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:34.190637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469795+0000","last_change":"2023-12-19T05:45:09.254732+0000","last_active":"2023-12-19T05:45:11.469795+0000","last_peered":"2023-12-19T05:45:11.469795+0000","last_clean":"2023-12-19T05:45:11.469795+0000","last_became_active":"2023-12-19T05:45:09.253688+0000","last_became_peered":"2023-12-19T05:45:09.253688+0000","last_unstale":"2023-12-19T05:45:11.469795+0000","last_undegraded":"2023-12-19T05:45:11.469795+0000","last_fullsized":"2023-12-19T05:45:11.469795+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:09.638557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247168+0000","last_change":"2023-12-19T05:45:09.256783+0000","last_active":"2023-12-19T05:45:10.247168+0000","last_peered":"2023-12-19T05:45:10.247168+0000","last_clean":"2023-12-19T05:45:10.247168+0000","last_became_active":"2023-12-19T05:45:09.256235+0000","last_became_peered":"2023-12-19T05:45:09.256235+0000","last_unstale":"2023-12-19T05:45:10.247168+0000","last_undegraded":"2023-12-19T05:45:10.247168+0000","last_fullsized":"2023-12-19T05:45:10.247168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083380+0000","last_change":"2023-12-19T05:45:09.251689+0000","last_active":"2023-12-19T05:45:12.083380+0000","last_peered":"2023-12-19T05:45:12.083380+0000","last_clean":"2023-12-19T05:45:12.083380+0000","last_became_active":"2023-12-19T05:45:09.250376+0000","last_became_peered":"2023-12-19T05:45:09.250376+0000","last_unstale":"2023-12-19T05:45:12.083380+0000","last_undegraded":"2023-12-19T05:45:12.083380+0000","last_fullsized":"2023-12-19T05:45:12.083380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:42:26.944633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083760+0000","last_change":"2023-12-19T05:45:09.248404+0000","last_active":"2023-12-19T05:45:12.083760+0000","last_peered":"2023-12-19T05:45:12.083760+0000","last_clean":"2023-12-19T05:45:12.083760+0000","last_became_active":"2023-12-19T05:45:09.248030+0000","last_became_peered":"2023-12-19T05:45:09.248030+0000","last_unstale":"2023-12-19T05:45:12.083760+0000","last_undegraded":"2023-12-19T05:45:12.083760+0000","last_fullsized":"2023-12-19T05:45:12.083760+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:54:36.050441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472065+0000","last_change":"2023-12-19T05:45:09.250385+0000","last_active":"2023-12-19T05:45:11.472065+0000","last_peered":"2023-12-19T05:45:11.472065+0000","last_clean":"2023-12-19T05:45:11.472065+0000","last_became_active":"2023-12-19T05:45:09.249688+0000","last_became_peered":"2023-12-19T05:45:09.249688+0000","last_unstale":"2023-12-19T05:45:11.472065+0000","last_undegraded":"2023-12-19T05:45:11.472065+0000","last_fullsized":"2023-12-19T05:45:11.472065+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:11:36.453396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084485+0000","last_change":"2023-12-19T05:45:09.252853+0000","last_active":"2023-12-19T05:45:12.084485+0000","last_peered":"2023-12-19T05:45:12.084485+0000","last_clean":"2023-12-19T05:45:12.084485+0000","last_became_active":"2023-12-19T05:45:09.250464+0000","last_became_peered":"2023-12-19T05:45:09.250464+0000","last_unstale":"2023-12-19T05:45:12.084485+0000","last_undegraded":"2023-12-19T05:45:12.084485+0000","last_fullsized":"2023-12-19T05:45:12.084485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:17:00.203574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469810+0000","last_change":"2023-12-19T05:45:09.250742+0000","last_active":"2023-12-19T05:45:11.469810+0000","last_peered":"2023-12-19T05:45:11.469810+0000","last_clean":"2023-12-19T05:45:11.469810+0000","last_became_active":"2023-12-19T05:45:09.250320+0000","last_became_peered":"2023-12-19T05:45:09.250320+0000","last_unstale":"2023-12-19T05:45:11.469810+0000","last_undegraded":"2023-12-19T05:45:11.469810+0000","last_fullsized":"2023-12-19T05:45:11.469810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247350+0000","last_change":"2023-12-19T05:45:09.250997+0000","last_active":"2023-12-19T05:45:10.247350+0000","last_peered":"2023-12-19T05:45:10.247350+0000","last_clean":"2023-12-19T05:45:10.247350+0000","last_became_active":"2023-12-19T05:45:09.250691+0000","last_became_peered":"2023-12-19T05:45:09.250691+0000","last_unstale":"2023-12-19T05:45:10.247350+0000","last_undegraded":"2023-12-19T05:45:10.247350+0000","last_fullsized":"2023-12-19T05:45:10.247350+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:52.241869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247612+0000","last_change":"2023-12-19T05:45:09.255317+0000","last_active":"2023-12-19T05:45:10.247612+0000","last_peered":"2023-12-19T05:45:10.247612+0000","last_clean":"2023-12-19T05:45:10.247612+0000","last_became_active":"2023-12-19T05:45:09.255193+0000","last_became_peered":"2023-12-19T05:45:09.255193+0000","last_unstale":"2023-12-19T05:45:10.247612+0000","last_undegraded":"2023-12-19T05:45:10.247612+0000","last_fullsized":"2023-12-19T05:45:10.247612+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244051+0000","last_change":"2023-12-19T05:45:09.252819+0000","last_active":"2023-12-19T05:45:10.244051+0000","last_peered":"2023-12-19T05:45:10.244051+0000","last_clean":"2023-12-19T05:45:10.244051+0000","last_became_active":"2023-12-19T05:45:09.252171+0000","last_became_peered":"2023-12-19T05:45:09.252171+0000","last_unstale":"2023-12-19T05:45:10.244051+0000","last_undegraded":"2023-12-19T05:45:10.244051+0000","last_fullsized":"2023-12-19T05:45:10.244051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:38.851859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244122+0000","last_change":"2023-12-19T05:45:09.256654+0000","last_active":"2023-12-19T05:45:10.244122+0000","last_peered":"2023-12-19T05:45:10.244122+0000","last_clean":"2023-12-19T05:45:10.244122+0000","last_became_active":"2023-12-19T05:45:09.251792+0000","last_became_peered":"2023-12-19T05:45:09.251792+0000","last_unstale":"2023-12-19T05:45:10.244122+0000","last_undegraded":"2023-12-19T05:45:10.244122+0000","last_fullsized":"2023-12-19T05:45:10.244122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:41:18.495526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245246+0000","last_change":"2023-12-19T05:45:09.242419+0000","last_active":"2023-12-19T05:45:10.245246+0000","last_peered":"2023-12-19T05:45:10.245246+0000","last_clean":"2023-12-19T05:45:10.245246+0000","last_became_active":"2023-12-19T05:45:09.242177+0000","last_became_peered":"2023-12-19T05:45:09.242177+0000","last_unstale":"2023-12-19T05:45:10.245246+0000","last_undegraded":"2023-12-19T05:45:10.245246+0000","last_fullsized":"2023-12-19T05:45:10.245246+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:05:29.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471492+0000","last_change":"2023-12-19T05:45:09.246461+0000","last_active":"2023-12-19T05:45:11.471492+0000","last_peered":"2023-12-19T05:45:11.471492+0000","last_clean":"2023-12-19T05:45:11.471492+0000","last_became_active":"2023-12-19T05:45:09.245377+0000","last_became_peered":"2023-12-19T05:45:09.245377+0000","last_unstale":"2023-12-19T05:45:11.471492+0000","last_undegraded":"2023-12-19T05:45:11.471492+0000","last_fullsized":"2023-12-19T05:45:11.471492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:01:13.331960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083442+0000","last_change":"2023-12-19T05:45:09.248253+0000","last_active":"2023-12-19T05:45:12.083442+0000","last_peered":"2023-12-19T05:45:12.083442+0000","last_clean":"2023-12-19T05:45:12.083442+0000","last_became_active":"2023-12-19T05:45:09.247727+0000","last_became_peered":"2023-12-19T05:45:09.247727+0000","last_unstale":"2023-12-19T05:45:12.083442+0000","last_undegraded":"2023-12-19T05:45:12.083442+0000","last_fullsized":"2023-12-19T05:45:12.083442+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:23.403608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083325+0000","last_change":"2023-12-19T05:45:09.258429+0000","last_active":"2023-12-19T05:45:12.083325+0000","last_peered":"2023-12-19T05:45:12.083325+0000","last_clean":"2023-12-19T05:45:12.083325+0000","last_became_active":"2023-12-19T05:45:09.258110+0000","last_became_peered":"2023-12-19T05:45:09.258110+0000","last_unstale":"2023-12-19T05:45:12.083325+0000","last_undegraded":"2023-12-19T05:45:12.083325+0000","last_fullsized":"2023-12-19T05:45:12.083325+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082746+0000","last_change":"2023-12-19T05:45:09.248757+0000","last_active":"2023-12-19T05:45:12.082746+0000","last_peered":"2023-12-19T05:45:12.082746+0000","last_clean":"2023-12-19T05:45:12.082746+0000","last_became_active":"2023-12-19T05:45:09.247496+0000","last_became_peered":"2023-12-19T05:45:09.247496+0000","last_unstale":"2023-12-19T05:45:12.082746+0000","last_undegraded":"2023-12-19T05:45:12.082746+0000","last_fullsized":"2023-12-19T05:45:12.082746+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:42.687568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469447+0000","last_change":"2023-12-19T05:45:09.258639+0000","last_active":"2023-12-19T05:45:11.469447+0000","last_peered":"2023-12-19T05:45:11.469447+0000","last_clean":"2023-12-19T05:45:11.469447+0000","last_became_active":"2023-12-19T05:45:09.258426+0000","last_became_peered":"2023-12-19T05:45:09.258426+0000","last_unstale":"2023-12-19T05:45:11.469447+0000","last_undegraded":"2023-12-19T05:45:11.469447+0000","last_fullsized":"2023-12-19T05:45:11.469447+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"109'4","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244375+0000","last_change":"2023-12-19T05:45:08.747340+0000","last_active":"2023-12-19T05:45:10.244375+0000","last_peered":"2023-12-19T05:45:10.244375+0000","last_clean":"2023-12-19T05:45:10.244375+0000","last_became_active":"2023-12-19T05:45:08.746253+0000","last_became_peered":"2023-12-19T05:45:08.746253+0000","last_unstale":"2023-12-19T05:45:10.244375+0000","last_undegraded":"2023-12-19T05:45:10.244375+0000","last_fullsized":"2023-12-19T05:45:10.244375+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:52:41.570071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245498+0000","last_change":"2023-12-19T05:45:09.252985+0000","last_active":"2023-12-19T05:45:10.245498+0000","last_peered":"2023-12-19T05:45:10.245498+0000","last_clean":"2023-12-19T05:45:10.245498+0000","last_became_active":"2023-12-19T05:45:09.252752+0000","last_became_peered":"2023-12-19T05:45:09.252752+0000","last_unstale":"2023-12-19T05:45:10.245498+0000","last_undegraded":"2023-12-19T05:45:10.245498+0000","last_fullsized":"2023-12-19T05:45:10.245498+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:33:51.673172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083097+0000","last_change":"2023-12-19T05:45:08.741725+0000","last_active":"2023-12-19T05:45:12.083097+0000","last_peered":"2023-12-19T05:45:12.083097+0000","last_clean":"2023-12-19T05:45:12.083097+0000","last_became_active":"2023-12-19T05:45:08.741037+0000","last_became_peered":"2023-12-19T05:45:08.741037+0000","last_unstale":"2023-12-19T05:45:12.083097+0000","last_undegraded":"2023-12-19T05:45:12.083097+0000","last_fullsized":"2023-12-19T05:45:12.083097+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:16:18.151837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470275+0000","last_change":"2023-12-19T05:45:09.252545+0000","last_active":"2023-12-19T05:45:11.470275+0000","last_peered":"2023-12-19T05:45:11.470275+0000","last_clean":"2023-12-19T05:45:11.470275+0000","last_became_active":"2023-12-19T05:45:09.252321+0000","last_became_peered":"2023-12-19T05:45:09.252321+0000","last_unstale":"2023-12-19T05:45:11.470275+0000","last_undegraded":"2023-12-19T05:45:11.470275+0000","last_fullsized":"2023-12-19T05:45:11.470275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248023+0000","last_change":"2023-12-19T05:45:08.742875+0000","last_active":"2023-12-19T05:45:10.248023+0000","last_peered":"2023-12-19T05:45:10.248023+0000","last_clean":"2023-12-19T05:45:10.248023+0000","last_became_active":"2023-12-19T05:45:08.742637+0000","last_became_peered":"2023-12-19T05:45:08.742637+0000","last_unstale":"2023-12-19T05:45:10.248023+0000","last_undegraded":"2023-12-19T05:45:10.248023+0000","last_fullsized":"2023-12-19T05:45:10.248023+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:42.842358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245597+0000","last_change":"2023-12-19T05:45:09.248434+0000","last_active":"2023-12-19T05:45:10.245597+0000","last_peered":"2023-12-19T05:45:10.245597+0000","last_clean":"2023-12-19T05:45:10.245597+0000","last_became_active":"2023-12-19T05:45:09.247747+0000","last_became_peered":"2023-12-19T05:45:09.247747+0000","last_unstale":"2023-12-19T05:45:10.245597+0000","last_undegraded":"2023-12-19T05:45:10.245597+0000","last_fullsized":"2023-12-19T05:45:10.245597+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:33.051045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472502+0000","last_change":"2023-12-19T05:45:08.726111+0000","last_active":"2023-12-19T05:45:11.472502+0000","last_peered":"2023-12-19T05:45:11.472502+0000","last_clean":"2023-12-19T05:45:11.472502+0000","last_became_active":"2023-12-19T05:45:08.725492+0000","last_became_peered":"2023-12-19T05:45:08.725492+0000","last_unstale":"2023-12-19T05:45:11.472502+0000","last_undegraded":"2023-12-19T05:45:11.472502+0000","last_fullsized":"2023-12-19T05:45:11.472502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:47.081130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471376+0000","last_change":"2023-12-19T05:45:09.246587+0000","last_active":"2023-12-19T05:45:11.471376+0000","last_peered":"2023-12-19T05:45:11.471376+0000","last_clean":"2023-12-19T05:45:11.471376+0000","last_became_active":"2023-12-19T05:45:09.246339+0000","last_became_peered":"2023-12-19T05:45:09.246339+0000","last_unstale":"2023-12-19T05:45:11.471376+0000","last_undegraded":"2023-12-19T05:45:11.471376+0000","last_fullsized":"2023-12-19T05:45:11.471376+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:16:10.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470417+0000","last_change":"2023-12-19T05:45:08.744138+0000","last_active":"2023-12-19T05:45:11.470417+0000","last_peered":"2023-12-19T05:45:11.470417+0000","last_clean":"2023-12-19T05:45:11.470417+0000","last_became_active":"2023-12-19T05:45:08.743807+0000","last_became_peered":"2023-12-19T05:45:08.743807+0000","last_unstale":"2023-12-19T05:45:11.470417+0000","last_undegraded":"2023-12-19T05:45:11.470417+0000","last_fullsized":"2023-12-19T05:45:11.470417+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:45.160451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082983+0000","last_change":"2023-12-19T05:45:09.256926+0000","last_active":"2023-12-19T05:45:12.082983+0000","last_peered":"2023-12-19T05:45:12.082983+0000","last_clean":"2023-12-19T05:45:12.082983+0000","last_became_active":"2023-12-19T05:45:09.256496+0000","last_became_peered":"2023-12-19T05:45:09.256496+0000","last_unstale":"2023-12-19T05:45:12.082983+0000","last_undegraded":"2023-12-19T05:45:12.082983+0000","last_fullsized":"2023-12-19T05:45:12.082983+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082807+0000","last_change":"2023-12-19T05:45:08.732844+0000","last_active":"2023-12-19T05:45:12.082807+0000","last_peered":"2023-12-19T05:45:12.082807+0000","last_clean":"2023-12-19T05:45:12.082807+0000","last_became_active":"2023-12-19T05:45:08.726979+0000","last_became_peered":"2023-12-19T05:45:08.726979+0000","last_unstale":"2023-12-19T05:45:12.082807+0000","last_undegraded":"2023-12-19T05:45:12.082807+0000","last_fullsized":"2023-12-19T05:45:12.082807+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:45.160451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245672+0000","last_change":"2023-12-19T05:45:09.248578+0000","last_active":"2023-12-19T05:45:10.245672+0000","last_peered":"2023-12-19T05:45:10.245672+0000","last_clean":"2023-12-19T05:45:10.245672+0000","last_became_active":"2023-12-19T05:45:09.248022+0000","last_became_peered":"2023-12-19T05:45:09.248022+0000","last_unstale":"2023-12-19T05:45:10.245672+0000","last_undegraded":"2023-12-19T05:45:10.245672+0000","last_fullsized":"2023-12-19T05:45:10.245672+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:16:19.167961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083997+0000","last_change":"2023-12-19T05:45:08.743159+0000","last_active":"2023-12-19T05:45:12.083997+0000","last_peered":"2023-12-19T05:45:12.083997+0000","last_clean":"2023-12-19T05:45:12.083997+0000","last_became_active":"2023-12-19T05:45:08.742883+0000","last_became_peered":"2023-12-19T05:45:08.742883+0000","last_unstale":"2023-12-19T05:45:12.083997+0000","last_undegraded":"2023-12-19T05:45:12.083997+0000","last_fullsized":"2023-12-19T05:45:12.083997+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:57:27.706674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083676+0000","last_change":"2023-12-19T05:45:09.254059+0000","last_active":"2023-12-19T05:45:12.083676+0000","last_peered":"2023-12-19T05:45:12.083676+0000","last_clean":"2023-12-19T05:45:12.083676+0000","last_became_active":"2023-12-19T05:45:09.253810+0000","last_became_peered":"2023-12-19T05:45:09.253810+0000","last_unstale":"2023-12-19T05:45:12.083676+0000","last_undegraded":"2023-12-19T05:45:12.083676+0000","last_fullsized":"2023-12-19T05:45:12.083676+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:55:54.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083887+0000","last_change":"2023-12-19T05:45:08.746018+0000","last_active":"2023-12-19T05:45:12.083887+0000","last_peered":"2023-12-19T05:45:12.083887+0000","last_clean":"2023-12-19T05:45:12.083887+0000","last_became_active":"2023-12-19T05:45:08.745772+0000","last_became_peered":"2023-12-19T05:45:08.745772+0000","last_unstale":"2023-12-19T05:45:12.083887+0000","last_undegraded":"2023-12-19T05:45:12.083887+0000","last_fullsized":"2023-12-19T05:45:12.083887+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:45.546773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083999+0000","last_change":"2023-12-19T05:45:09.245272+0000","last_active":"2023-12-19T05:45:12.083999+0000","last_peered":"2023-12-19T05:45:12.083999+0000","last_clean":"2023-12-19T05:45:12.083999+0000","last_became_active":"2023-12-19T05:45:09.244582+0000","last_became_peered":"2023-12-19T05:45:09.244582+0000","last_unstale":"2023-12-19T05:45:12.083999+0000","last_undegraded":"2023-12-19T05:45:12.083999+0000","last_fullsized":"2023-12-19T05:45:12.083999+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:20.857366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245339+0000","last_change":"2023-12-19T05:45:08.738935+0000","last_active":"2023-12-19T05:45:10.245339+0000","last_peered":"2023-12-19T05:45:10.245339+0000","last_clean":"2023-12-19T05:45:10.245339+0000","last_became_active":"2023-12-19T05:45:08.737980+0000","last_became_peered":"2023-12-19T05:45:08.737980+0000","last_unstale":"2023-12-19T05:45:10.245339+0000","last_undegraded":"2023-12-19T05:45:10.245339+0000","last_fullsized":"2023-12-19T05:45:10.245339+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:46.143058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245224+0000","last_change":"2023-12-19T05:45:09.245221+0000","last_active":"2023-12-19T05:45:10.245224+0000","last_peered":"2023-12-19T05:45:10.245224+0000","last_clean":"2023-12-19T05:45:10.245224+0000","last_became_active":"2023-12-19T05:45:09.244705+0000","last_became_peered":"2023-12-19T05:45:09.244705+0000","last_unstale":"2023-12-19T05:45:10.245224+0000","last_undegraded":"2023-12-19T05:45:10.245224+0000","last_fullsized":"2023-12-19T05:45:10.245224+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:46.176575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083108+0000","last_change":"2023-12-19T05:45:08.739788+0000","last_active":"2023-12-19T05:45:12.083108+0000","last_peered":"2023-12-19T05:45:12.083108+0000","last_clean":"2023-12-19T05:45:12.083108+0000","last_became_active":"2023-12-19T05:45:08.735625+0000","last_became_peered":"2023-12-19T05:45:08.735625+0000","last_unstale":"2023-12-19T05:45:12.083108+0000","last_undegraded":"2023-12-19T05:45:12.083108+0000","last_fullsized":"2023-12-19T05:45:12.083108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:47.068361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247609+0000","last_change":"2023-12-19T05:45:09.253680+0000","last_active":"2023-12-19T05:45:10.247609+0000","last_peered":"2023-12-19T05:45:10.247609+0000","last_clean":"2023-12-19T05:45:10.247609+0000","last_became_active":"2023-12-19T05:45:09.252873+0000","last_became_peered":"2023-12-19T05:45:09.252873+0000","last_unstale":"2023-12-19T05:45:10.247609+0000","last_undegraded":"2023-12-19T05:45:10.247609+0000","last_fullsized":"2023-12-19T05:45:10.247609+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"109'3","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.246150+0000","last_change":"2023-12-19T05:45:08.742011+0000","last_active":"2023-12-19T05:45:10.246150+0000","last_peered":"2023-12-19T05:45:10.246150+0000","last_clean":"2023-12-19T05:45:10.246150+0000","last_became_active":"2023-12-19T05:45:08.741500+0000","last_became_peered":"2023-12-19T05:45:08.741500+0000","last_unstale":"2023-12-19T05:45:10.246150+0000","last_undegraded":"2023-12-19T05:45:10.246150+0000","last_fullsized":"2023-12-19T05:45:10.246150+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:44.949930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243922+0000","last_change":"2023-12-19T05:45:09.250896+0000","last_active":"2023-12-19T05:45:10.243922+0000","last_peered":"2023-12-19T05:45:10.243922+0000","last_clean":"2023-12-19T05:45:10.243922+0000","last_became_active":"2023-12-19T05:45:09.247273+0000","last_became_peered":"2023-12-19T05:45:09.247273+0000","last_unstale":"2023-12-19T05:45:10.243922+0000","last_undegraded":"2023-12-19T05:45:10.243922+0000","last_fullsized":"2023-12-19T05:45:10.243922+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:42:56.844932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"109'6","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470039+0000","last_change":"2023-12-19T05:45:08.741952+0000","last_active":"2023-12-19T05:45:11.470039+0000","last_peered":"2023-12-19T05:45:11.470039+0000","last_clean":"2023-12-19T05:45:11.470039+0000","last_became_active":"2023-12-19T05:45:08.741565+0000","last_became_peered":"2023-12-19T05:45:08.741565+0000","last_unstale":"2023-12-19T05:45:11.470039+0000","last_undegraded":"2023-12-19T05:45:11.470039+0000","last_fullsized":"2023-12-19T05:45:11.470039+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247400+0000","last_change":"2023-12-19T05:45:09.259534+0000","last_active":"2023-12-19T05:45:10.247400+0000","last_peered":"2023-12-19T05:45:10.247400+0000","last_clean":"2023-12-19T05:45:10.247400+0000","last_became_active":"2023-12-19T05:45:09.259130+0000","last_became_peered":"2023-12-19T05:45:09.259130+0000","last_unstale":"2023-12-19T05:45:10.247400+0000","last_undegraded":"2023-12-19T05:45:10.247400+0000","last_fullsized":"2023-12-19T05:45:10.247400+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:09.638557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472307+0000","last_change":"2023-12-19T05:45:08.739496+0000","last_active":"2023-12-19T05:45:11.472307+0000","last_peered":"2023-12-19T05:45:11.472307+0000","last_clean":"2023-12-19T05:45:11.472307+0000","last_became_active":"2023-12-19T05:45:08.739216+0000","last_became_peered":"2023-12-19T05:45:08.739216+0000","last_unstale":"2023-12-19T05:45:11.472307+0000","last_undegraded":"2023-12-19T05:45:11.472307+0000","last_fullsized":"2023-12-19T05:45:11.472307+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:00.264114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245831+0000","last_change":"2023-12-19T05:45:09.248229+0000","last_active":"2023-12-19T05:45:10.245831+0000","last_peered":"2023-12-19T05:45:10.245831+0000","last_clean":"2023-12-19T05:45:10.245831+0000","last_became_active":"2023-12-19T05:45:09.247433+0000","last_became_peered":"2023-12-19T05:45:09.247433+0000","last_unstale":"2023-12-19T05:45:10.245831+0000","last_undegraded":"2023-12-19T05:45:10.245831+0000","last_fullsized":"2023-12-19T05:45:10.245831+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:13.028752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472035+0000","last_change":"2023-12-19T05:45:08.736105+0000","last_active":"2023-12-19T05:45:11.472035+0000","last_peered":"2023-12-19T05:45:11.472035+0000","last_clean":"2023-12-19T05:45:11.472035+0000","last_became_active":"2023-12-19T05:45:08.735643+0000","last_became_peered":"2023-12-19T05:45:08.735643+0000","last_unstale":"2023-12-19T05:45:11.472035+0000","last_undegraded":"2023-12-19T05:45:11.472035+0000","last_fullsized":"2023-12-19T05:45:11.472035+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:05.063364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083387+0000","last_change":"2023-12-19T05:45:09.246197+0000","last_active":"2023-12-19T05:45:12.083387+0000","last_peered":"2023-12-19T05:45:12.083387+0000","last_clean":"2023-12-19T05:45:12.083387+0000","last_became_active":"2023-12-19T05:45:09.245972+0000","last_became_peered":"2023-12-19T05:45:09.245972+0000","last_unstale":"2023-12-19T05:45:12.083387+0000","last_undegraded":"2023-12-19T05:45:12.083387+0000","last_fullsized":"2023-12-19T05:45:12.083387+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:45.192753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083341+0000","last_change":"2023-12-19T05:45:08.744931+0000","last_active":"2023-12-19T05:45:12.083341+0000","last_peered":"2023-12-19T05:45:12.083341+0000","last_clean":"2023-12-19T05:45:12.083341+0000","last_became_active":"2023-12-19T05:45:08.744677+0000","last_became_peered":"2023-12-19T05:45:08.744677+0000","last_unstale":"2023-12-19T05:45:12.083341+0000","last_undegraded":"2023-12-19T05:45:12.083341+0000","last_fullsized":"2023-12-19T05:45:12.083341+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:40:33.418081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247098+0000","last_change":"2023-12-19T05:45:09.251474+0000","last_active":"2023-12-19T05:45:10.247098+0000","last_peered":"2023-12-19T05:45:10.247098+0000","last_clean":"2023-12-19T05:45:10.247098+0000","last_became_active":"2023-12-19T05:45:09.251248+0000","last_became_peered":"2023-12-19T05:45:09.251248+0000","last_unstale":"2023-12-19T05:45:10.247098+0000","last_undegraded":"2023-12-19T05:45:10.247098+0000","last_fullsized":"2023-12-19T05:45:10.247098+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:39.592937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"109'8","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247350+0000","last_change":"2023-12-19T05:45:08.747952+0000","last_active":"2023-12-19T05:45:10.247350+0000","last_peered":"2023-12-19T05:45:10.247350+0000","last_clean":"2023-12-19T05:45:10.247350+0000","last_became_active":"2023-12-19T05:45:08.747803+0000","last_became_peered":"2023-12-19T05:45:08.747803+0000","last_unstale":"2023-12-19T05:45:10.247350+0000","last_undegraded":"2023-12-19T05:45:10.247350+0000","last_fullsized":"2023-12-19T05:45:10.247350+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:22.387485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469638+0000","last_change":"2023-12-19T05:45:09.253864+0000","last_active":"2023-12-19T05:45:11.469638+0000","last_peered":"2023-12-19T05:45:11.469638+0000","last_clean":"2023-12-19T05:45:11.469638+0000","last_became_active":"2023-12-19T05:45:09.253617+0000","last_became_peered":"2023-12-19T05:45:09.253617+0000","last_unstale":"2023-12-19T05:45:11.469638+0000","last_undegraded":"2023-12-19T05:45:11.469638+0000","last_fullsized":"2023-12-19T05:45:11.469638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:42.687568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243770+0000","last_change":"2023-12-19T05:45:08.743053+0000","last_active":"2023-12-19T05:45:10.243770+0000","last_peered":"2023-12-19T05:45:10.243770+0000","last_clean":"2023-12-19T05:45:10.243770+0000","last_became_active":"2023-12-19T05:45:08.737706+0000","last_became_peered":"2023-12-19T05:45:08.737706+0000","last_unstale":"2023-12-19T05:45:10.243770+0000","last_undegraded":"2023-12-19T05:45:10.243770+0000","last_fullsized":"2023-12-19T05:45:10.243770+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:47:24.142613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082567+0000","last_change":"2023-12-19T05:45:09.238776+0000","last_active":"2023-12-19T05:45:12.082567+0000","last_peered":"2023-12-19T05:45:12.082567+0000","last_clean":"2023-12-19T05:45:12.082567+0000","last_became_active":"2023-12-19T05:45:09.238552+0000","last_became_peered":"2023-12-19T05:45:09.238552+0000","last_unstale":"2023-12-19T05:45:12.082567+0000","last_undegraded":"2023-12-19T05:45:12.082567+0000","last_fullsized":"2023-12-19T05:45:12.082567+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084116+0000","last_change":"2023-12-19T05:45:08.743694+0000","last_active":"2023-12-19T05:45:12.084116+0000","last_peered":"2023-12-19T05:45:12.084116+0000","last_clean":"2023-12-19T05:45:12.084116+0000","last_became_active":"2023-12-19T05:45:08.743435+0000","last_became_peered":"2023-12-19T05:45:08.743435+0000","last_unstale":"2023-12-19T05:45:12.084116+0000","last_undegraded":"2023-12-19T05:45:12.084116+0000","last_fullsized":"2023-12-19T05:45:12.084116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:50.675400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470024+0000","last_change":"2023-12-19T05:45:09.255603+0000","last_active":"2023-12-19T05:45:11.470024+0000","last_peered":"2023-12-19T05:45:11.470024+0000","last_clean":"2023-12-19T05:45:11.470024+0000","last_became_active":"2023-12-19T05:45:09.253923+0000","last_became_peered":"2023-12-19T05:45:09.253923+0000","last_unstale":"2023-12-19T05:45:11.470024+0000","last_undegraded":"2023-12-19T05:45:11.470024+0000","last_fullsized":"2023-12-19T05:45:11.470024+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:37.772485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084705+0000","last_change":"2023-12-19T05:45:08.741660+0000","last_active":"2023-12-19T05:45:12.084705+0000","last_peered":"2023-12-19T05:45:12.084705+0000","last_clean":"2023-12-19T05:45:12.084705+0000","last_became_active":"2023-12-19T05:45:08.741418+0000","last_became_peered":"2023-12-19T05:45:08.741418+0000","last_unstale":"2023-12-19T05:45:12.084705+0000","last_undegraded":"2023-12-19T05:45:12.084705+0000","last_fullsized":"2023-12-19T05:45:12.084705+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:57.767271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470906+0000","last_change":"2023-12-19T05:45:09.248695+0000","last_active":"2023-12-19T05:45:11.470906+0000","last_peered":"2023-12-19T05:45:11.470906+0000","last_clean":"2023-12-19T05:45:11.470906+0000","last_became_active":"2023-12-19T05:45:09.248319+0000","last_became_peered":"2023-12-19T05:45:09.248319+0000","last_unstale":"2023-12-19T05:45:11.470906+0000","last_undegraded":"2023-12-19T05:45:11.470906+0000","last_fullsized":"2023-12-19T05:45:11.470906+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083583+0000","last_change":"2023-12-19T05:45:08.740811+0000","last_active":"2023-12-19T05:45:12.083583+0000","last_peered":"2023-12-19T05:45:12.083583+0000","last_clean":"2023-12-19T05:45:12.083583+0000","last_became_active":"2023-12-19T05:45:08.740584+0000","last_became_peered":"2023-12-19T05:45:08.740584+0000","last_unstale":"2023-12-19T05:45:12.083583+0000","last_undegraded":"2023-12-19T05:45:12.083583+0000","last_fullsized":"2023-12-19T05:45:12.083583+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:02.185973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244233+0000","last_change":"2023-12-19T05:45:09.250743+0000","last_active":"2023-12-19T05:45:10.244233+0000","last_peered":"2023-12-19T05:45:10.244233+0000","last_clean":"2023-12-19T05:45:10.244233+0000","last_became_active":"2023-12-19T05:45:09.246721+0000","last_became_peered":"2023-12-19T05:45:09.246721+0000","last_unstale":"2023-12-19T05:45:10.244233+0000","last_undegraded":"2023-12-19T05:45:10.244233+0000","last_fullsized":"2023-12-19T05:45:10.244233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:12:16.113871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471212+0000","last_change":"2023-12-19T05:45:08.741766+0000","last_active":"2023-12-19T05:45:11.471212+0000","last_peered":"2023-12-19T05:45:11.471212+0000","last_clean":"2023-12-19T05:45:11.471212+0000","last_became_active":"2023-12-19T05:45:08.741451+0000","last_became_peered":"2023-12-19T05:45:08.741451+0000","last_unstale":"2023-12-19T05:45:11.471212+0000","last_undegraded":"2023-12-19T05:45:11.471212+0000","last_fullsized":"2023-12-19T05:45:11.471212+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:47.496530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472296+0000","last_change":"2023-12-19T05:45:09.258187+0000","last_active":"2023-12-19T05:45:11.472296+0000","last_peered":"2023-12-19T05:45:11.472296+0000","last_clean":"2023-12-19T05:45:11.472296+0000","last_became_active":"2023-12-19T05:45:09.257870+0000","last_became_peered":"2023-12-19T05:45:09.257870+0000","last_unstale":"2023-12-19T05:45:11.472296+0000","last_undegraded":"2023-12-19T05:45:11.472296+0000","last_fullsized":"2023-12-19T05:45:11.472296+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:20:22.389169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248231+0000","last_change":"2023-12-19T05:45:08.740580+0000","last_active":"2023-12-19T05:45:10.248231+0000","last_peered":"2023-12-19T05:45:10.248231+0000","last_clean":"2023-12-19T05:45:10.248231+0000","last_became_active":"2023-12-19T05:45:08.740333+0000","last_became_peered":"2023-12-19T05:45:08.740333+0000","last_unstale":"2023-12-19T05:45:10.248231+0000","last_undegraded":"2023-12-19T05:45:10.248231+0000","last_fullsized":"2023-12-19T05:45:10.248231+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:36:20.724957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469768+0000","last_change":"2023-12-19T05:45:09.251814+0000","last_active":"2023-12-19T05:45:11.469768+0000","last_peered":"2023-12-19T05:45:11.469768+0000","last_clean":"2023-12-19T05:45:11.469768+0000","last_became_active":"2023-12-19T05:45:09.251262+0000","last_became_peered":"2023-12-19T05:45:09.251262+0000","last_unstale":"2023-12-19T05:45:11.469768+0000","last_undegraded":"2023-12-19T05:45:11.469768+0000","last_fullsized":"2023-12-19T05:45:11.469768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083590+0000","last_change":"2023-12-19T05:45:08.739814+0000","last_active":"2023-12-19T05:45:12.083590+0000","last_peered":"2023-12-19T05:45:12.083590+0000","last_clean":"2023-12-19T05:45:12.083590+0000","last_became_active":"2023-12-19T05:45:08.739424+0000","last_became_peered":"2023-12-19T05:45:08.739424+0000","last_unstale":"2023-12-19T05:45:12.083590+0000","last_undegraded":"2023-12-19T05:45:12.083590+0000","last_fullsized":"2023-12-19T05:45:12.083590+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:36.371144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244082+0000","last_change":"2023-12-19T05:45:09.243663+0000","last_active":"2023-12-19T05:45:10.244082+0000","last_peered":"2023-12-19T05:45:10.244082+0000","last_clean":"2023-12-19T05:45:10.244082+0000","last_became_active":"2023-12-19T05:45:09.243187+0000","last_became_peered":"2023-12-19T05:45:09.243187+0000","last_unstale":"2023-12-19T05:45:10.244082+0000","last_undegraded":"2023-12-19T05:45:10.244082+0000","last_fullsized":"2023-12-19T05:45:10.244082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:23.166134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084251+0000","last_change":"2023-12-19T05:45:08.744356+0000","last_active":"2023-12-19T05:45:12.084251+0000","last_peered":"2023-12-19T05:45:12.084251+0000","last_clean":"2023-12-19T05:45:12.084251+0000","last_became_active":"2023-12-19T05:45:08.744133+0000","last_became_peered":"2023-12-19T05:45:08.744133+0000","last_unstale":"2023-12-19T05:45:12.084251+0000","last_undegraded":"2023-12-19T05:45:12.084251+0000","last_fullsized":"2023-12-19T05:45:12.084251+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:26.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244398+0000","last_change":"2023-12-19T05:45:09.261852+0000","last_active":"2023-12-19T05:45:10.244398+0000","last_peered":"2023-12-19T05:45:10.244398+0000","last_clean":"2023-12-19T05:45:10.244398+0000","last_became_active":"2023-12-19T05:45:09.256876+0000","last_became_peered":"2023-12-19T05:45:09.256876+0000","last_unstale":"2023-12-19T05:45:10.244398+0000","last_undegraded":"2023-12-19T05:45:10.244398+0000","last_fullsized":"2023-12-19T05:45:10.244398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:42:04.641955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247475+0000","last_change":"2023-12-19T05:45:08.741091+0000","last_active":"2023-12-19T05:45:10.247475+0000","last_peered":"2023-12-19T05:45:10.247475+0000","last_clean":"2023-12-19T05:45:10.247475+0000","last_became_active":"2023-12-19T05:45:08.739204+0000","last_became_peered":"2023-12-19T05:45:08.739204+0000","last_unstale":"2023-12-19T05:45:10.247475+0000","last_undegraded":"2023-12-19T05:45:10.247475+0000","last_fullsized":"2023-12-19T05:45:10.247475+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:19.841242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245291+0000","last_change":"2023-12-19T05:45:09.254360+0000","last_active":"2023-12-19T05:45:10.245291+0000","last_peered":"2023-12-19T05:45:10.245291+0000","last_clean":"2023-12-19T05:45:10.245291+0000","last_became_active":"2023-12-19T05:45:09.253885+0000","last_became_peered":"2023-12-19T05:45:09.253885+0000","last_unstale":"2023-12-19T05:45:10.245291+0000","last_undegraded":"2023-12-19T05:45:10.245291+0000","last_fullsized":"2023-12-19T05:45:10.245291+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:58:17.010167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470284+0000","last_change":"2023-12-19T05:45:08.741067+0000","last_active":"2023-12-19T05:45:11.470284+0000","last_peered":"2023-12-19T05:45:11.470284+0000","last_clean":"2023-12-19T05:45:11.470284+0000","last_became_active":"2023-12-19T05:45:08.739014+0000","last_became_peered":"2023-12-19T05:45:08.739014+0000","last_unstale":"2023-12-19T05:45:11.470284+0000","last_undegraded":"2023-12-19T05:45:11.470284+0000","last_fullsized":"2023-12-19T05:45:11.470284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:12.012629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082828+0000","last_change":"2023-12-19T05:45:09.260480+0000","last_active":"2023-12-19T05:45:12.082828+0000","last_peered":"2023-12-19T05:45:12.082828+0000","last_clean":"2023-12-19T05:45:12.082828+0000","last_became_active":"2023-12-19T05:45:09.256295+0000","last_became_peered":"2023-12-19T05:45:09.256295+0000","last_unstale":"2023-12-19T05:45:12.082828+0000","last_undegraded":"2023-12-19T05:45:12.082828+0000","last_fullsized":"2023-12-19T05:45:12.082828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082981+0000","last_change":"2023-12-19T05:45:08.745003+0000","last_active":"2023-12-19T05:45:12.082981+0000","last_peered":"2023-12-19T05:45:12.082981+0000","last_clean":"2023-12-19T05:45:12.082981+0000","last_became_active":"2023-12-19T05:45:08.744346+0000","last_became_peered":"2023-12-19T05:45:08.744346+0000","last_unstale":"2023-12-19T05:45:12.082981+0000","last_undegraded":"2023-12-19T05:45:12.082981+0000","last_fullsized":"2023-12-19T05:45:12.082981+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245045+0000","last_change":"2023-12-19T05:45:09.257580+0000","last_active":"2023-12-19T05:45:10.245045+0000","last_peered":"2023-12-19T05:45:10.245045+0000","last_clean":"2023-12-19T05:45:10.245045+0000","last_became_active":"2023-12-19T05:45:09.257299+0000","last_became_peered":"2023-12-19T05:45:09.257299+0000","last_unstale":"2023-12-19T05:45:10.245045+0000","last_undegraded":"2023-12-19T05:45:10.245045+0000","last_fullsized":"2023-12-19T05:45:10.245045+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:29.818802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472140+0000","last_change":"2023-12-19T05:45:08.744768+0000","last_active":"2023-12-19T05:45:11.472140+0000","last_peered":"2023-12-19T05:45:11.472140+0000","last_clean":"2023-12-19T05:45:11.472140+0000","last_became_active":"2023-12-19T05:45:08.743857+0000","last_became_peered":"2023-12-19T05:45:08.743857+0000","last_unstale":"2023-12-19T05:45:11.472140+0000","last_undegraded":"2023-12-19T05:45:11.472140+0000","last_fullsized":"2023-12-19T05:45:11.472140+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:38.576813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247707+0000","last_change":"2023-12-19T05:45:09.257308+0000","last_active":"2023-12-19T05:45:10.247707+0000","last_peered":"2023-12-19T05:45:10.247707+0000","last_clean":"2023-12-19T05:45:10.247707+0000","last_became_active":"2023-12-19T05:45:09.256931+0000","last_became_peered":"2023-12-19T05:45:09.256931+0000","last_unstale":"2023-12-19T05:45:10.247707+0000","last_undegraded":"2023-12-19T05:45:10.247707+0000","last_fullsized":"2023-12-19T05:45:10.247707+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083226+0000","last_change":"2023-12-19T05:45:08.728337+0000","last_active":"2023-12-19T05:45:12.083226+0000","last_peered":"2023-12-19T05:45:12.083226+0000","last_clean":"2023-12-19T05:45:12.083226+0000","last_became_active":"2023-12-19T05:45:08.724245+0000","last_became_peered":"2023-12-19T05:45:08.724245+0000","last_unstale":"2023-12-19T05:45:12.083226+0000","last_undegraded":"2023-12-19T05:45:12.083226+0000","last_fullsized":"2023-12-19T05:45:12.083226+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:12.012629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244430+0000","last_change":"2023-12-19T05:45:09.258232+0000","last_active":"2023-12-19T05:45:10.244430+0000","last_peered":"2023-12-19T05:45:10.244430+0000","last_clean":"2023-12-19T05:45:10.244430+0000","last_became_active":"2023-12-19T05:45:09.257991+0000","last_became_peered":"2023-12-19T05:45:09.257991+0000","last_unstale":"2023-12-19T05:45:10.244430+0000","last_undegraded":"2023-12-19T05:45:10.244430+0000","last_fullsized":"2023-12-19T05:45:10.244430+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:41:09.250850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.246408+0000","last_change":"2023-12-19T05:45:08.741797+0000","last_active":"2023-12-19T05:45:10.246408+0000","last_peered":"2023-12-19T05:45:10.246408+0000","last_clean":"2023-12-19T05:45:10.246408+0000","last_became_active":"2023-12-19T05:45:08.741086+0000","last_became_peered":"2023-12-19T05:45:08.741086+0000","last_unstale":"2023-12-19T05:45:10.246408+0000","last_undegraded":"2023-12-19T05:45:10.246408+0000","last_fullsized":"2023-12-19T05:45:10.246408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:06.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245739+0000","last_change":"2023-12-19T05:45:09.247212+0000","last_active":"2023-12-19T05:45:10.245739+0000","last_peered":"2023-12-19T05:45:10.245739+0000","last_clean":"2023-12-19T05:45:10.245739+0000","last_became_active":"2023-12-19T05:45:09.247004+0000","last_became_peered":"2023-12-19T05:45:09.247004+0000","last_unstale":"2023-12-19T05:45:10.245739+0000","last_undegraded":"2023-12-19T05:45:10.245739+0000","last_fullsized":"2023-12-19T05:45:10.245739+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:38:35.317190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470486+0000","last_change":"2023-12-19T05:45:08.745274+0000","last_active":"2023-12-19T05:45:11.470486+0000","last_peered":"2023-12-19T05:45:11.470486+0000","last_clean":"2023-12-19T05:45:11.470486+0000","last_became_active":"2023-12-19T05:45:08.744966+0000","last_became_peered":"2023-12-19T05:45:08.744966+0000","last_unstale":"2023-12-19T05:45:11.470486+0000","last_undegraded":"2023-12-19T05:45:11.470486+0000","last_fullsized":"2023-12-19T05:45:11.470486+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:47.068361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247391+0000","last_change":"2023-12-19T05:45:09.263384+0000","last_active":"2023-12-19T05:45:10.247391+0000","last_peered":"2023-12-19T05:45:10.247391+0000","last_clean":"2023-12-19T05:45:10.247391+0000","last_became_active":"2023-12-19T05:45:09.263174+0000","last_became_peered":"2023-12-19T05:45:09.263174+0000","last_unstale":"2023-12-19T05:45:10.247391+0000","last_undegraded":"2023-12-19T05:45:10.247391+0000","last_fullsized":"2023-12-19T05:45:10.247391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244471+0000","last_change":"2023-12-19T05:45:08.739321+0000","last_active":"2023-12-19T05:45:10.244471+0000","last_peered":"2023-12-19T05:45:10.244471+0000","last_clean":"2023-12-19T05:45:10.244471+0000","last_became_active":"2023-12-19T05:45:08.739072+0000","last_became_peered":"2023-12-19T05:45:08.739072+0000","last_unstale":"2023-12-19T05:45:10.244471+0000","last_undegraded":"2023-12-19T05:45:10.244471+0000","last_fullsized":"2023-12-19T05:45:10.244471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:58:01.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-19T05:45:09.237120+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:45:09.237120+0000","last_peered":"2023-12-19T05:45:09.237120+0000","last_clean":"2023-12-19T05:45:09.237120+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:45:09.237120+0000","last_undegraded":"2023-12-19T05:45:09.237120+0000","last_fullsized":"2023-12-19T05:45:09.237120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194723,"statfs":{"total":200000000,"available":199396607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.119,"15min":1.0469999999999999},"min":{"1min":0.66900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.587,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.137,"15min":1.073},"min":{"1min":0.79800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.716,"5min":3.976,"15min":3.976},"last":1.4910000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.175,"15min":1.079},"min":{"1min":0.89500000000000002,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":1.5069999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.143},{"interface":"front","average":{"1min":1.111,"5min":1.1659999999999999,"15min":1.1619999999999999},"min":{"1min":0.74399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.611,"5min":4.25,"15min":4.25},"last":1.6299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.234},"min":{"1min":0.81499999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5489999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0900000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.72,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.95399999999999996}]},{"osd":3,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.2809999999999999,"15min":1.1679999999999999},"min":{"1min":1.107,"5min":0.73999999999999999,"15min":0.622},"max":{"1min":1.925,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.099},{"interface":"front","average":{"1min":1.387,"5min":1.383,"15min":1.3260000000000001},"min":{"1min":0.96299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":1.819,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.7629999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1639999999999999,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.8160000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.298,"15min":1.25},"min":{"1min":0.82399999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.784,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.026}]},{"osd":5,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.353,"15min":1.319},"min":{"1min":1.028,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6930000000000001,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3080000000000001,"15min":1.2430000000000001},"min":{"1min":0.873,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":1.903,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.345}]},{"osd":6,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4690000000000001,"15min":1.3460000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.994,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.264},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.504,"15min":1.3999999999999999},"min":{"1min":0.998,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":1.9279999999999999,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.5880000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194722,"statfs":{"total":200000000,"available":199396005,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0309999999999999,"15min":1.2150000000000001},"min":{"1min":0.70299999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.05,"15min":1.036},"min":{"1min":0.752,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.214,"15min":1.1539999999999999},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.631,"5min":1.792,"15min":1.792},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.214,"15min":1.3080000000000001},"min":{"1min":0.88600000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8120000000000001,"5min":1.851,"15min":3.4670000000000001},"last":1.161}]},{"osd":2,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1519999999999999,"15min":1.1859999999999999},"min":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.823,"5min":2,"15min":2},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.198,"15min":1.296},"min":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5980000000000001,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.163,"15min":1.339},"min":{"1min":0.84999999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7050000000000001,"5min":1.857,"15min":4.5220000000000002},"last":0.998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.3620000000000001},"min":{"1min":0.89500000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0059999999999998,"5min":2.1579999999999999,"15min":4.452},"last":1.0980000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.206,"15min":1.3220000000000001},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7470000000000001,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.421},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.208,"15min":1.425},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.6930000000000001,"5min":2.7240000000000002,"15min":4.6689999999999996},"last":1.5269999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.369,"15min":1.5529999999999999},"min":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.726,"5min":2.5070000000000001,"15min":4.5670000000000002},"last":1.488},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4430000000000001,"15min":1.706},"min":{"1min":0.871,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8700000000000001,"5min":2.21,"15min":3.681},"last":1.2629999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3779999999999999,"15min":1.51},"min":{"1min":0.73699999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.917,"5min":1.972,"15min":3.2719999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.534,"15min":1.6080000000000001},"min":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9099999999999999,"5min":2.4609999999999999,"15min":4.7480000000000002},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.147,"15min":1.1259999999999999},"min":{"1min":0.65000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8200000000000001,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1100000000000001,"15min":1.115},"min":{"1min":0.85399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.5049999999999999,"5min":1.776,"15min":2.641},"last":2.012}]},{"osd":1,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2170000000000001,"15min":1.2390000000000001},"min":{"1min":0.81499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":3.9540000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.355,"15min":1.371},"min":{"1min":0.90400000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6819999999999999,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.175,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.5230000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.90200000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.484,"5min":1.54,"15min":2.8250000000000002},"last":1.4490000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.343,"15min":1.448},"min":{"1min":1.0409999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3260000000000001,"15min":1.429},"min":{"1min":0.80500000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.754},"last":1.883}]},{"osd":4,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.25,"15min":1.46},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.569,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.956},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3660000000000001,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.8280000000000001,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":2.577}]},{"osd":6,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.3680000000000001,"15min":1.498},"min":{"1min":0.68700000000000006,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.3399999999999999},"last":2.1019999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3859999999999999,"15min":1.6319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7569999999999999,"5min":2.1739999999999999,"15min":6.3579999999999997},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.534,"15min":1.7},"min":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9830000000000001,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":2.1920000000000002},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.54,"15min":1.6160000000000001},"min":{"1min":0.753,"5min":0.65000000000000002,"15min":0.53200000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":2.508}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194723,"statfs":{"total":200000000,"available":199396643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.04,"15min":1.016},"min":{"1min":0.79400000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.514,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.087,"15min":1.0660000000000001},"min":{"1min":0.78900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.494,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":2.0270000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0880000000000001,"15min":1.0629999999999999},"min":{"1min":0.75700000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.339},{"interface":"front","average":{"1min":1.224,"5min":1.1890000000000001,"15min":1.0649999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.53},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.248,"15min":1.218},"min":{"1min":0.97799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0680000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1879999999999999,"15min":1.083},"min":{"1min":0.70599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.617,"5min":1.734,"15min":1.734},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3069999999999999,"15min":1.292},"min":{"1min":1.04,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.671,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.7270000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3500000000000001,"15min":1.3440000000000001},"min":{"1min":0.88400000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":2.081},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3839999999999999,"15min":1.294},"min":{"1min":0.78300000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.708,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":2.4039999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3839999999999999,"15min":1.373},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8540000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.421,"15min":1.403},"min":{"1min":0.84699999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.897}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4399999999999999,"15min":1.3600000000000001},"min":{"1min":0.83799999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":2.4790000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.496,"15min":1.466},"min":{"1min":0.91700000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.887,"5min":1.982,"15min":1.982},"last":2.1930000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194722,"statfs":{"total":200000000,"available":199396003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.86399999999999999,"15min":0.82399999999999995},"min":{"1min":0.628,"5min":0.314,"15min":0.314},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.90000000000000002,"15min":0.81999999999999995},"min":{"1min":0.56599999999999995,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4650000000000001,"5min":1.72,"15min":1.72},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.65600000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":2.702},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.208,"5min":1.032,"15min":0.95799999999999996},"min":{"1min":0.73199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.349}]},{"osd":2,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0649999999999999,"15min":0.93899999999999995},"min":{"1min":0.93000000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4239999999999999,"5min":1.716,"15min":1.716},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.1970000000000001,"15min":1.087},"min":{"1min":0.57499999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.573}]},{"osd":4,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.173,"15min":1.157},"min":{"1min":0.97399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5389999999999999,"5min":1.6779999999999999,"15min":1.8759999999999999},"last":1.373},{"interface":"front","average":{"1min":1.335,"5min":1.304,"15min":1.294},"min":{"1min":1.006,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.708,"5min":1.867,"15min":2.5859999999999999},"last":1.109}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.379,"15min":1.3260000000000001},"min":{"1min":1.012,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.494},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.3899999999999999,"15min":1.3560000000000001},"min":{"1min":1.1639999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.5149999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.4159999999999999,"15min":1.369},"min":{"1min":1.151,"5min":0.74199999999999999,"15min":0.71499999999999997},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.333,"15min":1.3260000000000001},"min":{"1min":1.0780000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.4670000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4099999999999999,"15min":1.3859999999999999},"min":{"1min":1.125,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8400000000000001,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.55},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4159999999999999,"15min":1.421},"min":{"1min":1.2210000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8839999999999999,"5min":1.968,"15min":2.8900000000000001},"last":1.5960000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194729,"statfs":{"total":200000000,"available":199402977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.77000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.4510000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97699999999999998,"15min":0.91300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5029999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.75700000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.085,"15min":1.0489999999999999},"min":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.534},{"interface":"front","average":{"1min":1.276,"5min":1.2310000000000001,"15min":1.161},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.639,"5min":1.75,"15min":1.75},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98399999999999999,"15min":0.92800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4490000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.173,"15min":1.089},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.498}]},{"osd":4,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3420000000000001,"15min":1.2689999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.694,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.325,"15min":1.246},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.843,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.377,"15min":1.2929999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.81499999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.71,"5min":1.929,"15min":2.5960000000000001},"last":0.90400000000000003}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":1.008,"5min":0.84899999999999998,"15min":0.83599999999999997},"max":{"1min":1.897,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.87},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.423,"15min":1.333},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7889999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.861}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.486,"15min":1.4179999999999999},"min":{"1min":1.0960000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":2.101,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.121},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.714},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1165,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194146,"statfs":{"total":200000000,"available":198806219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.89600000000000002,"15min":0.93400000000000005},"min":{"1min":0.375,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.1110000000000002,"15min":2.992},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.0369999999999999,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6799999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92800000000000005,"15min":0.96499999999999997},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.577,"5min":1.742,"15min":2.2789999999999999},"last":1.01},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.8580000000000001,"15min":1.3420000000000001},"min":{"1min":0.56000000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":70.206000000000003,"15min":70.206000000000003},"last":1.1120000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.71399999999999997,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":2.0059999999999998,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.393},{"interface":"front","average":{"1min":1.498,"5min":1.268,"15min":1.244},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":2.3580000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.3460000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.3480000000000001,"15min":1.228},"min":{"1min":0.86699999999999999,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":2.3969999999999998,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.643,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":0.85699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5960000000000001,"5min":4.306,"15min":4.306},"last":1.5189999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.4319999999999999,"15min":1.3640000000000001},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.68400000000000005},"max":{"1min":2.5550000000000002,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.4490000000000001,"15min":1.3700000000000001},"min":{"1min":0.81899999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.464,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.579}]},{"osd":6,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.5309999999999999,"15min":1.4399999999999999},"min":{"1min":1.0409999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.8860000000000001,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.617,"5min":1.494,"15min":1.4319999999999999},"min":{"1min":0.93500000000000005,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.6899999999999999,"5min":3.75,"15min":3.75},"last":1.46}]},{"osd":7,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6299999999999999,"15min":1.542},"min":{"1min":0.999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.5059999999999998,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.619},{"interface":"front","average":{"1min":1.8859999999999999,"5min":1.6719999999999999,"15min":1.617},"min":{"1min":1.1559999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.7290000000000001,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.548}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":590,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194721,"statfs":{"total":200000000,"available":199395091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86099999999999999,"15min":0.79700000000000004},"min":{"1min":0.60599999999999998,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.2390000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.94899999999999995,"15min":0.89500000000000002},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.032}]},{"osd":2,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0760000000000001,"15min":1.0600000000000001},"min":{"1min":0.67600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3500000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92900000000000005,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.464,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.872},{"interface":"front","average":{"1min":1.218,"5min":1.1120000000000001,"15min":1.0660000000000001},"min":{"1min":0.53900000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.653,"5min":1.653,"15min":1.8720000000000001},"last":1.9790000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2090000000000001,"15min":1.161},"min":{"1min":0.83299999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.294},{"interface":"front","average":{"1min":1.444,"5min":1.3200000000000001,"15min":1.264},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":2.149}]},{"osd":5,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.3600000000000001,"15min":1.3180000000000001},"min":{"1min":0.86799999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.345,"15min":1.286},"min":{"1min":0.85599999999999998,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8240000000000001,"5min":1.879,"15min":1.879},"last":1.7270000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.401,"15min":1.391},"min":{"1min":0.877,"5min":0.81100000000000005,"15min":0.76300000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":2.4870000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.355,"15min":1.284},"min":{"1min":0.77000000000000002,"5min":0.746,"15min":0.746},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.7030000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.4610000000000001,"15min":1.421},"min":{"1min":0.94999999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.609},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.421,"15min":1.375},"min":{"1min":0.94099999999999995,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":2.0510000000000002,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.5800000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:45:14.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:45:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.520+0000 7fcac3a0b640 1 Processor -- start 2023-12-19T05:45:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.520+0000 7fcac3a0b640 1 -- start start 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac3a0b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcabc1449e0 0x7fcabc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac3a0b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc0b0b50 0x7fcabc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac3a0b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc0afb10 con 0x7fcabc06b590 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac3a0b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc06bb30 con 0x7fcabc1449e0 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac3a0b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0b0070 con 0x7fcabc0b0b50 2023-12-19T05:45:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac17a7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcabc1449e0 0x7fcabc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac17a7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcabc1449e0 0x7fcabc0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51474/0 (socket says 172.21.15.49:51474) 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.522+0000 7fcac17a7640 1 -- 172.21.15.49:0/3887137446 learned_addr learned my addr 172.21.15.49:0/3887137446 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.523+0000 7fcac0fa6640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc0b0b50 0x7fcabc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.523+0000 7fcac17a7640 1 -- 172.21.15.49:0/3887137446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc0b0b50 msgr2=0x7fcabc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.523+0000 7fcac17a7640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc0b0b50 0x7fcabc06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.523+0000 7fcac17a7640 1 -- 172.21.15.49:0/3887137446 >> v1:172.21.15.115:6789/0 conn(0x7fcabc06b590 legacy=0x7fcabc15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.523+0000 7fcac17a7640 1 -- 172.21.15.49:0/3887137446 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0b0350 con 0x7fcabc1449e0 2023-12-19T05:45:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.524+0000 7fcac17a7640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc1449e0 0x7fcabc0af5d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5df62a7e224c1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.524+0000 7fcab3fff640 1 -- 172.21.15.49:0/3887137446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8031640 con 0x7fcabc1449e0 2023-12-19T05:45:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.524+0000 7fcab3fff640 1 -- 172.21.15.49:0/3887137446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80317a0 con 0x7fcabc1449e0 2023-12-19T05:45:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.524+0000 7fcab3fff640 1 -- 172.21.15.49:0/3887137446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8031b30 con 0x7fcabc1449e0 2023-12-19T05:45:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 -- 172.21.15.49:0/3887137446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc1449e0 msgr2=0x7fcabc0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc1449e0 0x7fcabc0af5d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 -- 172.21.15.49:0/3887137446 shutdown_connections 2023-12-19T05:45:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc0b0b50 0x7fcabc06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/3887137446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc1449e0 0x7fcabc0af5d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 -- 172.21.15.49:0/3887137446 >> 172.21.15.49:0/3887137446 conn(0x7fcabc0cbb70 msgr2=0x7fcabc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 -- 172.21.15.49:0/3887137446 shutdown_connections 2023-12-19T05:45:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.525+0000 7fcac3a0b640 1 -- 172.21.15.49:0/3887137446 wait complete. 2023-12-19T05:45:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.528+0000 7fcac3a0b640 1 Processor -- start 2023-12-19T05:45:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.528+0000 7fcac3a0b640 1 -- start start 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 0x7fcabc0a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 0x7fcabc1f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0a9620 con 0x7fcabc0b0b50 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0ab180 con 0x7fcabc06b590 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac3a0b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc1f1580 con 0x7fcabc1449e0 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac0fa6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac0fa6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51486/0 (socket says 172.21.15.49:51486) 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.529+0000 7fcac0fa6640 1 -- 172.21.15.49:0/502392436 learned_addr learned my addr 172.21.15.49:0/502392436 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac17a7640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 0x7fcabc0a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac1fa8640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 0x7fcabc1f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 -- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 msgr2=0x7fcabc1f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 0x7fcabc1f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 -- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 msgr2=0x7fcabc0a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 0x7fcabc0a9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 -- 172.21.15.49:0/502392436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094d0 con 0x7fcabc0b0b50 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac17a7640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 0x7fcabc0a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac1fa8640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 0x7fcabc1f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcac0fa6640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00d800 tx=0x7fcaac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00b6c0 con 0x7fcabc0b0b50 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00b820 con 0x7fcabc0b0b50 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.530+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00bbb0 con 0x7fcabc0b0b50 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.531+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc0a89a0 con 0x7fcabc0b0b50 2023-12-19T05:45:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.531+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc0a8f60 con 0x7fcabc0b0b50 2023-12-19T05:45:14.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.532+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc061910 con 0x7fcabc0b0b50 2023-12-19T05:45:14.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.533+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcaac00bd10 con 0x7fcabc0b0b50 2023-12-19T05:45:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.534+0000 7fcab1ffb640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 0x7fcaa006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.534+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaac088d30 con 0x7fcabc0b0b50 2023-12-19T05:45:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.534+0000 7fcac17a7640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 0x7fcaa006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:14.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.536+0000 7fcac17a7640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 0x7fcaa006c940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcab8036000 tx=0x7fcab803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.538+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcaac054410 con 0x7fcabc0b0b50 2023-12-19T05:45:14.598 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-12-19T05:45:14.597+0000 7fbc5a8dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:45:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.729+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcabc0b0630 con 0x7fcaa006a480 2023-12-19T05:45:14.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.753+0000 7fcab1ffb640 1 -- 172.21.15.49:0/502392436 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282943 (secure 0 0 0) 0x7fcab8031a10 con 0x7fcaa006a480 2023-12-19T05:45:14.760 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:45:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.759+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 msgr2=0x7fcaa006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.759+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 0x7fcaa006c940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcab8036000 tx=0x7fcab803c040 comp rx=0 tx=0).stop 2023-12-19T05:45:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.759+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 msgr2=0x7fcabc0ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.759+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00d800 tx=0x7fcaac00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 shutdown_connections 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcaa006a480 0x7fcaa006c940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcabc1449e0 0x7fcabc1f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcabc0b0b50 0x7fcabc0ca710 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 --2- 172.21.15.49:0/502392436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcabc06b590 0x7fcabc0a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 >> 172.21.15.49:0/502392436 conn(0x7fcabc0cbb70 msgr2=0x7fcabc15db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 shutdown_connections 2023-12-19T05:45:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:14.760+0000 7fcac3a0b640 1 -- 172.21.15.49:0/502392436 wait complete. 2023-12-19T05:45:14.781 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2023-12-19T05:45:14.631776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556635,"statfs":{"total":1600000000,"available":1593994256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002006"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244990+0000","last_change":"2023-12-19T05:45:09.257043+0000","last_active":"2023-12-19T05:45:10.244990+0000","last_peered":"2023-12-19T05:45:10.244990+0000","last_clean":"2023-12-19T05:45:10.244990+0000","last_became_active":"2023-12-19T05:45:09.256797+0000","last_became_peered":"2023-12-19T05:45:09.256797+0000","last_unstale":"2023-12-19T05:45:10.244990+0000","last_undegraded":"2023-12-19T05:45:10.244990+0000","last_fullsized":"2023-12-19T05:45:10.244990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:36:21.741080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470790+0000","last_change":"2023-12-19T05:45:09.258690+0000","last_active":"2023-12-19T05:45:11.470790+0000","last_peered":"2023-12-19T05:45:11.470790+0000","last_clean":"2023-12-19T05:45:11.470790+0000","last_became_active":"2023-12-19T05:45:09.256960+0000","last_became_peered":"2023-12-19T05:45:09.256960+0000","last_unstale":"2023-12-19T05:45:11.470790+0000","last_undegraded":"2023-12-19T05:45:11.470790+0000","last_fullsized":"2023-12-19T05:45:11.470790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.016593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082566+0000","last_change":"2023-12-19T05:45:09.240450+0000","last_active":"2023-12-19T05:45:12.082566+0000","last_peered":"2023-12-19T05:45:12.082566+0000","last_clean":"2023-12-19T05:45:12.082566+0000","last_became_active":"2023-12-19T05:45:09.240179+0000","last_became_peered":"2023-12-19T05:45:09.240179+0000","last_unstale":"2023-12-19T05:45:12.082566+0000","last_undegraded":"2023-12-19T05:45:12.082566+0000","last_fullsized":"2023-12-19T05:45:12.082566+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:56.016593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471248+0000","last_change":"2023-12-19T05:45:09.249771+0000","last_active":"2023-12-19T05:45:11.471248+0000","last_peered":"2023-12-19T05:45:11.471248+0000","last_clean":"2023-12-19T05:45:11.471248+0000","last_became_active":"2023-12-19T05:45:09.249159+0000","last_became_peered":"2023-12-19T05:45:09.249159+0000","last_unstale":"2023-12-19T05:45:11.471248+0000","last_undegraded":"2023-12-19T05:45:11.471248+0000","last_fullsized":"2023-12-19T05:45:11.471248+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:29:09.348594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245062+0000","last_change":"2023-12-19T05:45:09.254180+0000","last_active":"2023-12-19T05:45:10.245062+0000","last_peered":"2023-12-19T05:45:10.245062+0000","last_clean":"2023-12-19T05:45:10.245062+0000","last_became_active":"2023-12-19T05:45:09.251778+0000","last_became_peered":"2023-12-19T05:45:09.251778+0000","last_unstale":"2023-12-19T05:45:10.245062+0000","last_undegraded":"2023-12-19T05:45:10.245062+0000","last_fullsized":"2023-12-19T05:45:10.245062+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:33.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083051+0000","last_change":"2023-12-19T05:45:09.256051+0000","last_active":"2023-12-19T05:45:12.083051+0000","last_peered":"2023-12-19T05:45:12.083051+0000","last_clean":"2023-12-19T05:45:12.083051+0000","last_became_active":"2023-12-19T05:45:09.255770+0000","last_became_peered":"2023-12-19T05:45:09.255770+0000","last_unstale":"2023-12-19T05:45:12.083051+0000","last_undegraded":"2023-12-19T05:45:12.083051+0000","last_fullsized":"2023-12-19T05:45:12.083051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471269+0000","last_change":"2023-12-19T05:45:09.259912+0000","last_active":"2023-12-19T05:45:11.471269+0000","last_peered":"2023-12-19T05:45:11.471269+0000","last_clean":"2023-12-19T05:45:11.471269+0000","last_became_active":"2023-12-19T05:45:09.259643+0000","last_became_peered":"2023-12-19T05:45:09.259643+0000","last_unstale":"2023-12-19T05:45:11.471269+0000","last_undegraded":"2023-12-19T05:45:11.471269+0000","last_fullsized":"2023-12-19T05:45:11.471269+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:34.190637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469562+0000","last_change":"2023-12-19T05:45:09.254982+0000","last_active":"2023-12-19T05:45:11.469562+0000","last_peered":"2023-12-19T05:45:11.469562+0000","last_clean":"2023-12-19T05:45:11.469562+0000","last_became_active":"2023-12-19T05:45:09.254657+0000","last_became_peered":"2023-12-19T05:45:09.254657+0000","last_unstale":"2023-12-19T05:45:11.469562+0000","last_undegraded":"2023-12-19T05:45:11.469562+0000","last_fullsized":"2023-12-19T05:45:11.469562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244295+0000","last_change":"2023-12-19T05:45:09.242428+0000","last_active":"2023-12-19T05:45:10.244295+0000","last_peered":"2023-12-19T05:45:10.244295+0000","last_clean":"2023-12-19T05:45:10.244295+0000","last_became_active":"2023-12-19T05:45:09.242192+0000","last_became_peered":"2023-12-19T05:45:09.242192+0000","last_unstale":"2023-12-19T05:45:10.244295+0000","last_undegraded":"2023-12-19T05:45:10.244295+0000","last_fullsized":"2023-12-19T05:45:10.244295+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:52.241869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082712+0000","last_change":"2023-12-19T05:45:09.251882+0000","last_active":"2023-12-19T05:45:12.082712+0000","last_peered":"2023-12-19T05:45:12.082712+0000","last_clean":"2023-12-19T05:45:12.082712+0000","last_became_active":"2023-12-19T05:45:09.250718+0000","last_became_peered":"2023-12-19T05:45:09.250718+0000","last_unstale":"2023-12-19T05:45:12.082712+0000","last_undegraded":"2023-12-19T05:45:12.082712+0000","last_fullsized":"2023-12-19T05:45:12.082712+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:37.772485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248091+0000","last_change":"2023-12-19T05:45:09.257164+0000","last_active":"2023-12-19T05:45:10.248091+0000","last_peered":"2023-12-19T05:45:10.248091+0000","last_clean":"2023-12-19T05:45:10.248091+0000","last_became_active":"2023-12-19T05:45:09.256430+0000","last_became_peered":"2023-12-19T05:45:09.256430+0000","last_unstale":"2023-12-19T05:45:10.248091+0000","last_undegraded":"2023-12-19T05:45:10.248091+0000","last_fullsized":"2023-12-19T05:45:10.248091+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:48.512653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469517+0000","last_change":"2023-12-19T05:45:09.256968+0000","last_active":"2023-12-19T05:45:11.469517+0000","last_peered":"2023-12-19T05:45:11.469517+0000","last_clean":"2023-12-19T05:45:11.469517+0000","last_became_active":"2023-12-19T05:45:09.256679+0000","last_became_peered":"2023-12-19T05:45:09.256679+0000","last_unstale":"2023-12-19T05:45:11.469517+0000","last_undegraded":"2023-12-19T05:45:11.469517+0000","last_fullsized":"2023-12-19T05:45:11.469517+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243757+0000","last_change":"2023-12-19T05:45:09.240022+0000","last_active":"2023-12-19T05:45:10.243757+0000","last_peered":"2023-12-19T05:45:10.243757+0000","last_clean":"2023-12-19T05:45:10.243757+0000","last_became_active":"2023-12-19T05:45:09.239429+0000","last_became_peered":"2023-12-19T05:45:09.239429+0000","last_unstale":"2023-12-19T05:45:10.243757+0000","last_undegraded":"2023-12-19T05:45:10.243757+0000","last_fullsized":"2023-12-19T05:45:10.243757+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:42.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083125+0000","last_change":"2023-12-19T05:45:09.251489+0000","last_active":"2023-12-19T05:45:12.083125+0000","last_peered":"2023-12-19T05:45:12.083125+0000","last_clean":"2023-12-19T05:45:12.083125+0000","last_became_active":"2023-12-19T05:45:09.250067+0000","last_became_peered":"2023-12-19T05:45:09.250067+0000","last_unstale":"2023-12-19T05:45:12.083125+0000","last_undegraded":"2023-12-19T05:45:12.083125+0000","last_fullsized":"2023-12-19T05:45:12.083125+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:43.858482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471200+0000","last_change":"2023-12-19T05:45:09.246309+0000","last_active":"2023-12-19T05:45:11.471200+0000","last_peered":"2023-12-19T05:45:11.471200+0000","last_clean":"2023-12-19T05:45:11.471200+0000","last_became_active":"2023-12-19T05:45:09.246093+0000","last_became_peered":"2023-12-19T05:45:09.246093+0000","last_unstale":"2023-12-19T05:45:11.471200+0000","last_undegraded":"2023-12-19T05:45:11.471200+0000","last_fullsized":"2023-12-19T05:45:11.471200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:24:01.175099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083198+0000","last_change":"2023-12-19T05:45:09.263999+0000","last_active":"2023-12-19T05:45:12.083198+0000","last_peered":"2023-12-19T05:45:12.083198+0000","last_clean":"2023-12-19T05:45:12.083198+0000","last_became_active":"2023-12-19T05:45:09.263700+0000","last_became_peered":"2023-12-19T05:45:09.263700+0000","last_unstale":"2023-12-19T05:45:12.083198+0000","last_undegraded":"2023-12-19T05:45:12.083198+0000","last_fullsized":"2023-12-19T05:45:12.083198+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:34.190637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469795+0000","last_change":"2023-12-19T05:45:09.254732+0000","last_active":"2023-12-19T05:45:11.469795+0000","last_peered":"2023-12-19T05:45:11.469795+0000","last_clean":"2023-12-19T05:45:11.469795+0000","last_became_active":"2023-12-19T05:45:09.253688+0000","last_became_peered":"2023-12-19T05:45:09.253688+0000","last_unstale":"2023-12-19T05:45:11.469795+0000","last_undegraded":"2023-12-19T05:45:11.469795+0000","last_fullsized":"2023-12-19T05:45:11.469795+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:09.638557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247168+0000","last_change":"2023-12-19T05:45:09.256783+0000","last_active":"2023-12-19T05:45:10.247168+0000","last_peered":"2023-12-19T05:45:10.247168+0000","last_clean":"2023-12-19T05:45:10.247168+0000","last_became_active":"2023-12-19T05:45:09.256235+0000","last_became_peered":"2023-12-19T05:45:09.256235+0000","last_unstale":"2023-12-19T05:45:10.247168+0000","last_undegraded":"2023-12-19T05:45:10.247168+0000","last_fullsized":"2023-12-19T05:45:10.247168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083380+0000","last_change":"2023-12-19T05:45:09.251689+0000","last_active":"2023-12-19T05:45:12.083380+0000","last_peered":"2023-12-19T05:45:12.083380+0000","last_clean":"2023-12-19T05:45:12.083380+0000","last_became_active":"2023-12-19T05:45:09.250376+0000","last_became_peered":"2023-12-19T05:45:09.250376+0000","last_unstale":"2023-12-19T05:45:12.083380+0000","last_undegraded":"2023-12-19T05:45:12.083380+0000","last_fullsized":"2023-12-19T05:45:12.083380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:42:26.944633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083760+0000","last_change":"2023-12-19T05:45:09.248404+0000","last_active":"2023-12-19T05:45:12.083760+0000","last_peered":"2023-12-19T05:45:12.083760+0000","last_clean":"2023-12-19T05:45:12.083760+0000","last_became_active":"2023-12-19T05:45:09.248030+0000","last_became_peered":"2023-12-19T05:45:09.248030+0000","last_unstale":"2023-12-19T05:45:12.083760+0000","last_undegraded":"2023-12-19T05:45:12.083760+0000","last_fullsized":"2023-12-19T05:45:12.083760+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:54:36.050441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472065+0000","last_change":"2023-12-19T05:45:09.250385+0000","last_active":"2023-12-19T05:45:11.472065+0000","last_peered":"2023-12-19T05:45:11.472065+0000","last_clean":"2023-12-19T05:45:11.472065+0000","last_became_active":"2023-12-19T05:45:09.249688+0000","last_became_peered":"2023-12-19T05:45:09.249688+0000","last_unstale":"2023-12-19T05:45:11.472065+0000","last_undegraded":"2023-12-19T05:45:11.472065+0000","last_fullsized":"2023-12-19T05:45:11.472065+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:11:36.453396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084485+0000","last_change":"2023-12-19T05:45:09.252853+0000","last_active":"2023-12-19T05:45:12.084485+0000","last_peered":"2023-12-19T05:45:12.084485+0000","last_clean":"2023-12-19T05:45:12.084485+0000","last_became_active":"2023-12-19T05:45:09.250464+0000","last_became_peered":"2023-12-19T05:45:09.250464+0000","last_unstale":"2023-12-19T05:45:12.084485+0000","last_undegraded":"2023-12-19T05:45:12.084485+0000","last_fullsized":"2023-12-19T05:45:12.084485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:17:00.203574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469810+0000","last_change":"2023-12-19T05:45:09.250742+0000","last_active":"2023-12-19T05:45:11.469810+0000","last_peered":"2023-12-19T05:45:11.469810+0000","last_clean":"2023-12-19T05:45:11.469810+0000","last_became_active":"2023-12-19T05:45:09.250320+0000","last_became_peered":"2023-12-19T05:45:09.250320+0000","last_unstale":"2023-12-19T05:45:11.469810+0000","last_undegraded":"2023-12-19T05:45:11.469810+0000","last_fullsized":"2023-12-19T05:45:11.469810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247350+0000","last_change":"2023-12-19T05:45:09.250997+0000","last_active":"2023-12-19T05:45:10.247350+0000","last_peered":"2023-12-19T05:45:10.247350+0000","last_clean":"2023-12-19T05:45:10.247350+0000","last_became_active":"2023-12-19T05:45:09.250691+0000","last_became_peered":"2023-12-19T05:45:09.250691+0000","last_unstale":"2023-12-19T05:45:10.247350+0000","last_undegraded":"2023-12-19T05:45:10.247350+0000","last_fullsized":"2023-12-19T05:45:10.247350+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:52:52.241869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247612+0000","last_change":"2023-12-19T05:45:09.255317+0000","last_active":"2023-12-19T05:45:10.247612+0000","last_peered":"2023-12-19T05:45:10.247612+0000","last_clean":"2023-12-19T05:45:10.247612+0000","last_became_active":"2023-12-19T05:45:09.255193+0000","last_became_peered":"2023-12-19T05:45:09.255193+0000","last_unstale":"2023-12-19T05:45:10.247612+0000","last_undegraded":"2023-12-19T05:45:10.247612+0000","last_fullsized":"2023-12-19T05:45:10.247612+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244051+0000","last_change":"2023-12-19T05:45:09.252819+0000","last_active":"2023-12-19T05:45:10.244051+0000","last_peered":"2023-12-19T05:45:10.244051+0000","last_clean":"2023-12-19T05:45:10.244051+0000","last_became_active":"2023-12-19T05:45:09.252171+0000","last_became_peered":"2023-12-19T05:45:09.252171+0000","last_unstale":"2023-12-19T05:45:10.244051+0000","last_undegraded":"2023-12-19T05:45:10.244051+0000","last_fullsized":"2023-12-19T05:45:10.244051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:38.851859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244122+0000","last_change":"2023-12-19T05:45:09.256654+0000","last_active":"2023-12-19T05:45:10.244122+0000","last_peered":"2023-12-19T05:45:10.244122+0000","last_clean":"2023-12-19T05:45:10.244122+0000","last_became_active":"2023-12-19T05:45:09.251792+0000","last_became_peered":"2023-12-19T05:45:09.251792+0000","last_unstale":"2023-12-19T05:45:10.244122+0000","last_undegraded":"2023-12-19T05:45:10.244122+0000","last_fullsized":"2023-12-19T05:45:10.244122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:41:18.495526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245246+0000","last_change":"2023-12-19T05:45:09.242419+0000","last_active":"2023-12-19T05:45:10.245246+0000","last_peered":"2023-12-19T05:45:10.245246+0000","last_clean":"2023-12-19T05:45:10.245246+0000","last_became_active":"2023-12-19T05:45:09.242177+0000","last_became_peered":"2023-12-19T05:45:09.242177+0000","last_unstale":"2023-12-19T05:45:10.245246+0000","last_undegraded":"2023-12-19T05:45:10.245246+0000","last_fullsized":"2023-12-19T05:45:10.245246+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:05:29.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471492+0000","last_change":"2023-12-19T05:45:09.246461+0000","last_active":"2023-12-19T05:45:11.471492+0000","last_peered":"2023-12-19T05:45:11.471492+0000","last_clean":"2023-12-19T05:45:11.471492+0000","last_became_active":"2023-12-19T05:45:09.245377+0000","last_became_peered":"2023-12-19T05:45:09.245377+0000","last_unstale":"2023-12-19T05:45:11.471492+0000","last_undegraded":"2023-12-19T05:45:11.471492+0000","last_fullsized":"2023-12-19T05:45:11.471492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:01:13.331960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083442+0000","last_change":"2023-12-19T05:45:09.248253+0000","last_active":"2023-12-19T05:45:12.083442+0000","last_peered":"2023-12-19T05:45:12.083442+0000","last_clean":"2023-12-19T05:45:12.083442+0000","last_became_active":"2023-12-19T05:45:09.247727+0000","last_became_peered":"2023-12-19T05:45:09.247727+0000","last_unstale":"2023-12-19T05:45:12.083442+0000","last_undegraded":"2023-12-19T05:45:12.083442+0000","last_fullsized":"2023-12-19T05:45:12.083442+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:23.403608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083325+0000","last_change":"2023-12-19T05:45:09.258429+0000","last_active":"2023-12-19T05:45:12.083325+0000","last_peered":"2023-12-19T05:45:12.083325+0000","last_clean":"2023-12-19T05:45:12.083325+0000","last_became_active":"2023-12-19T05:45:09.258110+0000","last_became_peered":"2023-12-19T05:45:09.258110+0000","last_unstale":"2023-12-19T05:45:12.083325+0000","last_undegraded":"2023-12-19T05:45:12.083325+0000","last_fullsized":"2023-12-19T05:45:12.083325+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082746+0000","last_change":"2023-12-19T05:45:09.248757+0000","last_active":"2023-12-19T05:45:12.082746+0000","last_peered":"2023-12-19T05:45:12.082746+0000","last_clean":"2023-12-19T05:45:12.082746+0000","last_became_active":"2023-12-19T05:45:09.247496+0000","last_became_peered":"2023-12-19T05:45:09.247496+0000","last_unstale":"2023-12-19T05:45:12.082746+0000","last_undegraded":"2023-12-19T05:45:12.082746+0000","last_fullsized":"2023-12-19T05:45:12.082746+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:42.687568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469447+0000","last_change":"2023-12-19T05:45:09.258639+0000","last_active":"2023-12-19T05:45:11.469447+0000","last_peered":"2023-12-19T05:45:11.469447+0000","last_clean":"2023-12-19T05:45:11.469447+0000","last_became_active":"2023-12-19T05:45:09.258426+0000","last_became_peered":"2023-12-19T05:45:09.258426+0000","last_unstale":"2023-12-19T05:45:11.469447+0000","last_undegraded":"2023-12-19T05:45:11.469447+0000","last_fullsized":"2023-12-19T05:45:11.469447+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"109'4","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244375+0000","last_change":"2023-12-19T05:45:08.747340+0000","last_active":"2023-12-19T05:45:10.244375+0000","last_peered":"2023-12-19T05:45:10.244375+0000","last_clean":"2023-12-19T05:45:10.244375+0000","last_became_active":"2023-12-19T05:45:08.746253+0000","last_became_peered":"2023-12-19T05:45:08.746253+0000","last_unstale":"2023-12-19T05:45:10.244375+0000","last_undegraded":"2023-12-19T05:45:10.244375+0000","last_fullsized":"2023-12-19T05:45:10.244375+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:52:41.570071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245498+0000","last_change":"2023-12-19T05:45:09.252985+0000","last_active":"2023-12-19T05:45:10.245498+0000","last_peered":"2023-12-19T05:45:10.245498+0000","last_clean":"2023-12-19T05:45:10.245498+0000","last_became_active":"2023-12-19T05:45:09.252752+0000","last_became_peered":"2023-12-19T05:45:09.252752+0000","last_unstale":"2023-12-19T05:45:10.245498+0000","last_undegraded":"2023-12-19T05:45:10.245498+0000","last_fullsized":"2023-12-19T05:45:10.245498+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:33:51.673172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083097+0000","last_change":"2023-12-19T05:45:08.741725+0000","last_active":"2023-12-19T05:45:12.083097+0000","last_peered":"2023-12-19T05:45:12.083097+0000","last_clean":"2023-12-19T05:45:12.083097+0000","last_became_active":"2023-12-19T05:45:08.741037+0000","last_became_peered":"2023-12-19T05:45:08.741037+0000","last_unstale":"2023-12-19T05:45:12.083097+0000","last_undegraded":"2023-12-19T05:45:12.083097+0000","last_fullsized":"2023-12-19T05:45:12.083097+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:16:18.151837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470275+0000","last_change":"2023-12-19T05:45:09.252545+0000","last_active":"2023-12-19T05:45:11.470275+0000","last_peered":"2023-12-19T05:45:11.470275+0000","last_clean":"2023-12-19T05:45:11.470275+0000","last_became_active":"2023-12-19T05:45:09.252321+0000","last_became_peered":"2023-12-19T05:45:09.252321+0000","last_unstale":"2023-12-19T05:45:11.470275+0000","last_undegraded":"2023-12-19T05:45:11.470275+0000","last_fullsized":"2023-12-19T05:45:11.470275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:48.097254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248023+0000","last_change":"2023-12-19T05:45:08.742875+0000","last_active":"2023-12-19T05:45:10.248023+0000","last_peered":"2023-12-19T05:45:10.248023+0000","last_clean":"2023-12-19T05:45:10.248023+0000","last_became_active":"2023-12-19T05:45:08.742637+0000","last_became_peered":"2023-12-19T05:45:08.742637+0000","last_unstale":"2023-12-19T05:45:10.248023+0000","last_undegraded":"2023-12-19T05:45:10.248023+0000","last_fullsized":"2023-12-19T05:45:10.248023+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:03:42.842358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245597+0000","last_change":"2023-12-19T05:45:09.248434+0000","last_active":"2023-12-19T05:45:10.245597+0000","last_peered":"2023-12-19T05:45:10.245597+0000","last_clean":"2023-12-19T05:45:10.245597+0000","last_became_active":"2023-12-19T05:45:09.247747+0000","last_became_peered":"2023-12-19T05:45:09.247747+0000","last_unstale":"2023-12-19T05:45:10.245597+0000","last_undegraded":"2023-12-19T05:45:10.245597+0000","last_fullsized":"2023-12-19T05:45:10.245597+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:33.051045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472502+0000","last_change":"2023-12-19T05:45:08.726111+0000","last_active":"2023-12-19T05:45:11.472502+0000","last_peered":"2023-12-19T05:45:11.472502+0000","last_clean":"2023-12-19T05:45:11.472502+0000","last_became_active":"2023-12-19T05:45:08.725492+0000","last_became_peered":"2023-12-19T05:45:08.725492+0000","last_unstale":"2023-12-19T05:45:11.472502+0000","last_undegraded":"2023-12-19T05:45:11.472502+0000","last_fullsized":"2023-12-19T05:45:11.472502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:47.081130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471376+0000","last_change":"2023-12-19T05:45:09.246587+0000","last_active":"2023-12-19T05:45:11.471376+0000","last_peered":"2023-12-19T05:45:11.471376+0000","last_clean":"2023-12-19T05:45:11.471376+0000","last_became_active":"2023-12-19T05:45:09.246339+0000","last_became_peered":"2023-12-19T05:45:09.246339+0000","last_unstale":"2023-12-19T05:45:11.471376+0000","last_undegraded":"2023-12-19T05:45:11.471376+0000","last_fullsized":"2023-12-19T05:45:11.471376+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:16:10.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470417+0000","last_change":"2023-12-19T05:45:08.744138+0000","last_active":"2023-12-19T05:45:11.470417+0000","last_peered":"2023-12-19T05:45:11.470417+0000","last_clean":"2023-12-19T05:45:11.470417+0000","last_became_active":"2023-12-19T05:45:08.743807+0000","last_became_peered":"2023-12-19T05:45:08.743807+0000","last_unstale":"2023-12-19T05:45:11.470417+0000","last_undegraded":"2023-12-19T05:45:11.470417+0000","last_fullsized":"2023-12-19T05:45:11.470417+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:45.160451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082983+0000","last_change":"2023-12-19T05:45:09.256926+0000","last_active":"2023-12-19T05:45:12.082983+0000","last_peered":"2023-12-19T05:45:12.082983+0000","last_clean":"2023-12-19T05:45:12.082983+0000","last_became_active":"2023-12-19T05:45:09.256496+0000","last_became_peered":"2023-12-19T05:45:09.256496+0000","last_unstale":"2023-12-19T05:45:12.082983+0000","last_undegraded":"2023-12-19T05:45:12.082983+0000","last_fullsized":"2023-12-19T05:45:12.082983+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082807+0000","last_change":"2023-12-19T05:45:08.732844+0000","last_active":"2023-12-19T05:45:12.082807+0000","last_peered":"2023-12-19T05:45:12.082807+0000","last_clean":"2023-12-19T05:45:12.082807+0000","last_became_active":"2023-12-19T05:45:08.726979+0000","last_became_peered":"2023-12-19T05:45:08.726979+0000","last_unstale":"2023-12-19T05:45:12.082807+0000","last_undegraded":"2023-12-19T05:45:12.082807+0000","last_fullsized":"2023-12-19T05:45:12.082807+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:45.160451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245672+0000","last_change":"2023-12-19T05:45:09.248578+0000","last_active":"2023-12-19T05:45:10.245672+0000","last_peered":"2023-12-19T05:45:10.245672+0000","last_clean":"2023-12-19T05:45:10.245672+0000","last_became_active":"2023-12-19T05:45:09.248022+0000","last_became_peered":"2023-12-19T05:45:09.248022+0000","last_unstale":"2023-12-19T05:45:10.245672+0000","last_undegraded":"2023-12-19T05:45:10.245672+0000","last_fullsized":"2023-12-19T05:45:10.245672+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:16:19.167961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083997+0000","last_change":"2023-12-19T05:45:08.743159+0000","last_active":"2023-12-19T05:45:12.083997+0000","last_peered":"2023-12-19T05:45:12.083997+0000","last_clean":"2023-12-19T05:45:12.083997+0000","last_became_active":"2023-12-19T05:45:08.742883+0000","last_became_peered":"2023-12-19T05:45:08.742883+0000","last_unstale":"2023-12-19T05:45:12.083997+0000","last_undegraded":"2023-12-19T05:45:12.083997+0000","last_fullsized":"2023-12-19T05:45:12.083997+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:57:27.706674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083676+0000","last_change":"2023-12-19T05:45:09.254059+0000","last_active":"2023-12-19T05:45:12.083676+0000","last_peered":"2023-12-19T05:45:12.083676+0000","last_clean":"2023-12-19T05:45:12.083676+0000","last_became_active":"2023-12-19T05:45:09.253810+0000","last_became_peered":"2023-12-19T05:45:09.253810+0000","last_unstale":"2023-12-19T05:45:12.083676+0000","last_undegraded":"2023-12-19T05:45:12.083676+0000","last_fullsized":"2023-12-19T05:45:12.083676+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:55:54.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083887+0000","last_change":"2023-12-19T05:45:08.746018+0000","last_active":"2023-12-19T05:45:12.083887+0000","last_peered":"2023-12-19T05:45:12.083887+0000","last_clean":"2023-12-19T05:45:12.083887+0000","last_became_active":"2023-12-19T05:45:08.745772+0000","last_became_peered":"2023-12-19T05:45:08.745772+0000","last_unstale":"2023-12-19T05:45:12.083887+0000","last_undegraded":"2023-12-19T05:45:12.083887+0000","last_fullsized":"2023-12-19T05:45:12.083887+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:45.546773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083999+0000","last_change":"2023-12-19T05:45:09.245272+0000","last_active":"2023-12-19T05:45:12.083999+0000","last_peered":"2023-12-19T05:45:12.083999+0000","last_clean":"2023-12-19T05:45:12.083999+0000","last_became_active":"2023-12-19T05:45:09.244582+0000","last_became_peered":"2023-12-19T05:45:09.244582+0000","last_unstale":"2023-12-19T05:45:12.083999+0000","last_undegraded":"2023-12-19T05:45:12.083999+0000","last_fullsized":"2023-12-19T05:45:12.083999+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:20.857366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245339+0000","last_change":"2023-12-19T05:45:08.738935+0000","last_active":"2023-12-19T05:45:10.245339+0000","last_peered":"2023-12-19T05:45:10.245339+0000","last_clean":"2023-12-19T05:45:10.245339+0000","last_became_active":"2023-12-19T05:45:08.737980+0000","last_became_peered":"2023-12-19T05:45:08.737980+0000","last_unstale":"2023-12-19T05:45:10.245339+0000","last_undegraded":"2023-12-19T05:45:10.245339+0000","last_fullsized":"2023-12-19T05:45:10.245339+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:46.143058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245224+0000","last_change":"2023-12-19T05:45:09.245221+0000","last_active":"2023-12-19T05:45:10.245224+0000","last_peered":"2023-12-19T05:45:10.245224+0000","last_clean":"2023-12-19T05:45:10.245224+0000","last_became_active":"2023-12-19T05:45:09.244705+0000","last_became_peered":"2023-12-19T05:45:09.244705+0000","last_unstale":"2023-12-19T05:45:10.245224+0000","last_undegraded":"2023-12-19T05:45:10.245224+0000","last_fullsized":"2023-12-19T05:45:10.245224+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:46.176575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083108+0000","last_change":"2023-12-19T05:45:08.739788+0000","last_active":"2023-12-19T05:45:12.083108+0000","last_peered":"2023-12-19T05:45:12.083108+0000","last_clean":"2023-12-19T05:45:12.083108+0000","last_became_active":"2023-12-19T05:45:08.735625+0000","last_became_peered":"2023-12-19T05:45:08.735625+0000","last_unstale":"2023-12-19T05:45:12.083108+0000","last_undegraded":"2023-12-19T05:45:12.083108+0000","last_fullsized":"2023-12-19T05:45:12.083108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:47.068361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247609+0000","last_change":"2023-12-19T05:45:09.253680+0000","last_active":"2023-12-19T05:45:10.247609+0000","last_peered":"2023-12-19T05:45:10.247609+0000","last_clean":"2023-12-19T05:45:10.247609+0000","last_became_active":"2023-12-19T05:45:09.252873+0000","last_became_peered":"2023-12-19T05:45:09.252873+0000","last_unstale":"2023-12-19T05:45:10.247609+0000","last_undegraded":"2023-12-19T05:45:10.247609+0000","last_fullsized":"2023-12-19T05:45:10.247609+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"109'3","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.246150+0000","last_change":"2023-12-19T05:45:08.742011+0000","last_active":"2023-12-19T05:45:10.246150+0000","last_peered":"2023-12-19T05:45:10.246150+0000","last_clean":"2023-12-19T05:45:10.246150+0000","last_became_active":"2023-12-19T05:45:08.741500+0000","last_became_peered":"2023-12-19T05:45:08.741500+0000","last_unstale":"2023-12-19T05:45:10.246150+0000","last_undegraded":"2023-12-19T05:45:10.246150+0000","last_fullsized":"2023-12-19T05:45:10.246150+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:44.949930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243922+0000","last_change":"2023-12-19T05:45:09.250896+0000","last_active":"2023-12-19T05:45:10.243922+0000","last_peered":"2023-12-19T05:45:10.243922+0000","last_clean":"2023-12-19T05:45:10.243922+0000","last_became_active":"2023-12-19T05:45:09.247273+0000","last_became_peered":"2023-12-19T05:45:09.247273+0000","last_unstale":"2023-12-19T05:45:10.243922+0000","last_undegraded":"2023-12-19T05:45:10.243922+0000","last_fullsized":"2023-12-19T05:45:10.243922+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:42:56.844932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"109'6","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470039+0000","last_change":"2023-12-19T05:45:08.741952+0000","last_active":"2023-12-19T05:45:11.470039+0000","last_peered":"2023-12-19T05:45:11.470039+0000","last_clean":"2023-12-19T05:45:11.470039+0000","last_became_active":"2023-12-19T05:45:08.741565+0000","last_became_peered":"2023-12-19T05:45:08.741565+0000","last_unstale":"2023-12-19T05:45:11.470039+0000","last_undegraded":"2023-12-19T05:45:11.470039+0000","last_fullsized":"2023-12-19T05:45:11.470039+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247400+0000","last_change":"2023-12-19T05:45:09.259534+0000","last_active":"2023-12-19T05:45:10.247400+0000","last_peered":"2023-12-19T05:45:10.247400+0000","last_clean":"2023-12-19T05:45:10.247400+0000","last_became_active":"2023-12-19T05:45:09.259130+0000","last_became_peered":"2023-12-19T05:45:09.259130+0000","last_unstale":"2023-12-19T05:45:10.247400+0000","last_undegraded":"2023-12-19T05:45:10.247400+0000","last_fullsized":"2023-12-19T05:45:10.247400+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:09.638557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472307+0000","last_change":"2023-12-19T05:45:08.739496+0000","last_active":"2023-12-19T05:45:11.472307+0000","last_peered":"2023-12-19T05:45:11.472307+0000","last_clean":"2023-12-19T05:45:11.472307+0000","last_became_active":"2023-12-19T05:45:08.739216+0000","last_became_peered":"2023-12-19T05:45:08.739216+0000","last_unstale":"2023-12-19T05:45:11.472307+0000","last_undegraded":"2023-12-19T05:45:11.472307+0000","last_fullsized":"2023-12-19T05:45:11.472307+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:00.264114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245831+0000","last_change":"2023-12-19T05:45:09.248229+0000","last_active":"2023-12-19T05:45:10.245831+0000","last_peered":"2023-12-19T05:45:10.245831+0000","last_clean":"2023-12-19T05:45:10.245831+0000","last_became_active":"2023-12-19T05:45:09.247433+0000","last_became_peered":"2023-12-19T05:45:09.247433+0000","last_unstale":"2023-12-19T05:45:10.245831+0000","last_undegraded":"2023-12-19T05:45:10.245831+0000","last_fullsized":"2023-12-19T05:45:10.245831+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:13.028752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472035+0000","last_change":"2023-12-19T05:45:08.736105+0000","last_active":"2023-12-19T05:45:11.472035+0000","last_peered":"2023-12-19T05:45:11.472035+0000","last_clean":"2023-12-19T05:45:11.472035+0000","last_became_active":"2023-12-19T05:45:08.735643+0000","last_became_peered":"2023-12-19T05:45:08.735643+0000","last_unstale":"2023-12-19T05:45:11.472035+0000","last_undegraded":"2023-12-19T05:45:11.472035+0000","last_fullsized":"2023-12-19T05:45:11.472035+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:05.063364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083387+0000","last_change":"2023-12-19T05:45:09.246197+0000","last_active":"2023-12-19T05:45:12.083387+0000","last_peered":"2023-12-19T05:45:12.083387+0000","last_clean":"2023-12-19T05:45:12.083387+0000","last_became_active":"2023-12-19T05:45:09.245972+0000","last_became_peered":"2023-12-19T05:45:09.245972+0000","last_unstale":"2023-12-19T05:45:12.083387+0000","last_undegraded":"2023-12-19T05:45:12.083387+0000","last_fullsized":"2023-12-19T05:45:12.083387+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:05:45.192753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083341+0000","last_change":"2023-12-19T05:45:08.744931+0000","last_active":"2023-12-19T05:45:12.083341+0000","last_peered":"2023-12-19T05:45:12.083341+0000","last_clean":"2023-12-19T05:45:12.083341+0000","last_became_active":"2023-12-19T05:45:08.744677+0000","last_became_peered":"2023-12-19T05:45:08.744677+0000","last_unstale":"2023-12-19T05:45:12.083341+0000","last_undegraded":"2023-12-19T05:45:12.083341+0000","last_fullsized":"2023-12-19T05:45:12.083341+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:40:33.418081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247098+0000","last_change":"2023-12-19T05:45:09.251474+0000","last_active":"2023-12-19T05:45:10.247098+0000","last_peered":"2023-12-19T05:45:10.247098+0000","last_clean":"2023-12-19T05:45:10.247098+0000","last_became_active":"2023-12-19T05:45:09.251248+0000","last_became_peered":"2023-12-19T05:45:09.251248+0000","last_unstale":"2023-12-19T05:45:10.247098+0000","last_undegraded":"2023-12-19T05:45:10.247098+0000","last_fullsized":"2023-12-19T05:45:10.247098+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:39.592937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"109'8","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247350+0000","last_change":"2023-12-19T05:45:08.747952+0000","last_active":"2023-12-19T05:45:10.247350+0000","last_peered":"2023-12-19T05:45:10.247350+0000","last_clean":"2023-12-19T05:45:10.247350+0000","last_became_active":"2023-12-19T05:45:08.747803+0000","last_became_peered":"2023-12-19T05:45:08.747803+0000","last_unstale":"2023-12-19T05:45:10.247350+0000","last_undegraded":"2023-12-19T05:45:10.247350+0000","last_fullsized":"2023-12-19T05:45:10.247350+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:22.387485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469638+0000","last_change":"2023-12-19T05:45:09.253864+0000","last_active":"2023-12-19T05:45:11.469638+0000","last_peered":"2023-12-19T05:45:11.469638+0000","last_clean":"2023-12-19T05:45:11.469638+0000","last_became_active":"2023-12-19T05:45:09.253617+0000","last_became_peered":"2023-12-19T05:45:09.253617+0000","last_unstale":"2023-12-19T05:45:11.469638+0000","last_undegraded":"2023-12-19T05:45:11.469638+0000","last_fullsized":"2023-12-19T05:45:11.469638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:42.687568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.243770+0000","last_change":"2023-12-19T05:45:08.743053+0000","last_active":"2023-12-19T05:45:10.243770+0000","last_peered":"2023-12-19T05:45:10.243770+0000","last_clean":"2023-12-19T05:45:10.243770+0000","last_became_active":"2023-12-19T05:45:08.737706+0000","last_became_peered":"2023-12-19T05:45:08.737706+0000","last_unstale":"2023-12-19T05:45:10.243770+0000","last_undegraded":"2023-12-19T05:45:10.243770+0000","last_fullsized":"2023-12-19T05:45:10.243770+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:47:24.142613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082567+0000","last_change":"2023-12-19T05:45:09.238776+0000","last_active":"2023-12-19T05:45:12.082567+0000","last_peered":"2023-12-19T05:45:12.082567+0000","last_clean":"2023-12-19T05:45:12.082567+0000","last_became_active":"2023-12-19T05:45:09.238552+0000","last_became_peered":"2023-12-19T05:45:09.238552+0000","last_unstale":"2023-12-19T05:45:12.082567+0000","last_undegraded":"2023-12-19T05:45:12.082567+0000","last_fullsized":"2023-12-19T05:45:12.082567+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084116+0000","last_change":"2023-12-19T05:45:08.743694+0000","last_active":"2023-12-19T05:45:12.084116+0000","last_peered":"2023-12-19T05:45:12.084116+0000","last_clean":"2023-12-19T05:45:12.084116+0000","last_became_active":"2023-12-19T05:45:08.743435+0000","last_became_peered":"2023-12-19T05:45:08.743435+0000","last_unstale":"2023-12-19T05:45:12.084116+0000","last_undegraded":"2023-12-19T05:45:12.084116+0000","last_fullsized":"2023-12-19T05:45:12.084116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:50.675400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470024+0000","last_change":"2023-12-19T05:45:09.255603+0000","last_active":"2023-12-19T05:45:11.470024+0000","last_peered":"2023-12-19T05:45:11.470024+0000","last_clean":"2023-12-19T05:45:11.470024+0000","last_became_active":"2023-12-19T05:45:09.253923+0000","last_became_peered":"2023-12-19T05:45:09.253923+0000","last_unstale":"2023-12-19T05:45:11.470024+0000","last_undegraded":"2023-12-19T05:45:11.470024+0000","last_fullsized":"2023-12-19T05:45:11.470024+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:06:37.772485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084705+0000","last_change":"2023-12-19T05:45:08.741660+0000","last_active":"2023-12-19T05:45:12.084705+0000","last_peered":"2023-12-19T05:45:12.084705+0000","last_clean":"2023-12-19T05:45:12.084705+0000","last_became_active":"2023-12-19T05:45:08.741418+0000","last_became_peered":"2023-12-19T05:45:08.741418+0000","last_unstale":"2023-12-19T05:45:12.084705+0000","last_undegraded":"2023-12-19T05:45:12.084705+0000","last_fullsized":"2023-12-19T05:45:12.084705+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:09:57.767271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470906+0000","last_change":"2023-12-19T05:45:09.248695+0000","last_active":"2023-12-19T05:45:11.470906+0000","last_peered":"2023-12-19T05:45:11.470906+0000","last_clean":"2023-12-19T05:45:11.470906+0000","last_became_active":"2023-12-19T05:45:09.248319+0000","last_became_peered":"2023-12-19T05:45:09.248319+0000","last_unstale":"2023-12-19T05:45:11.470906+0000","last_undegraded":"2023-12-19T05:45:11.470906+0000","last_fullsized":"2023-12-19T05:45:11.470906+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:33.825164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083583+0000","last_change":"2023-12-19T05:45:08.740811+0000","last_active":"2023-12-19T05:45:12.083583+0000","last_peered":"2023-12-19T05:45:12.083583+0000","last_clean":"2023-12-19T05:45:12.083583+0000","last_became_active":"2023-12-19T05:45:08.740584+0000","last_became_peered":"2023-12-19T05:45:08.740584+0000","last_unstale":"2023-12-19T05:45:12.083583+0000","last_undegraded":"2023-12-19T05:45:12.083583+0000","last_fullsized":"2023-12-19T05:45:12.083583+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:02.185973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244233+0000","last_change":"2023-12-19T05:45:09.250743+0000","last_active":"2023-12-19T05:45:10.244233+0000","last_peered":"2023-12-19T05:45:10.244233+0000","last_clean":"2023-12-19T05:45:10.244233+0000","last_became_active":"2023-12-19T05:45:09.246721+0000","last_became_peered":"2023-12-19T05:45:09.246721+0000","last_unstale":"2023-12-19T05:45:10.244233+0000","last_undegraded":"2023-12-19T05:45:10.244233+0000","last_fullsized":"2023-12-19T05:45:10.244233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:12:16.113871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.471212+0000","last_change":"2023-12-19T05:45:08.741766+0000","last_active":"2023-12-19T05:45:11.471212+0000","last_peered":"2023-12-19T05:45:11.471212+0000","last_clean":"2023-12-19T05:45:11.471212+0000","last_became_active":"2023-12-19T05:45:08.741451+0000","last_became_peered":"2023-12-19T05:45:08.741451+0000","last_unstale":"2023-12-19T05:45:11.471212+0000","last_undegraded":"2023-12-19T05:45:11.471212+0000","last_fullsized":"2023-12-19T05:45:11.471212+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:42:47.496530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472296+0000","last_change":"2023-12-19T05:45:09.258187+0000","last_active":"2023-12-19T05:45:11.472296+0000","last_peered":"2023-12-19T05:45:11.472296+0000","last_clean":"2023-12-19T05:45:11.472296+0000","last_became_active":"2023-12-19T05:45:09.257870+0000","last_became_peered":"2023-12-19T05:45:09.257870+0000","last_unstale":"2023-12-19T05:45:11.472296+0000","last_undegraded":"2023-12-19T05:45:11.472296+0000","last_fullsized":"2023-12-19T05:45:11.472296+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:20:22.389169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.248231+0000","last_change":"2023-12-19T05:45:08.740580+0000","last_active":"2023-12-19T05:45:10.248231+0000","last_peered":"2023-12-19T05:45:10.248231+0000","last_clean":"2023-12-19T05:45:10.248231+0000","last_became_active":"2023-12-19T05:45:08.740333+0000","last_became_peered":"2023-12-19T05:45:08.740333+0000","last_unstale":"2023-12-19T05:45:10.248231+0000","last_undegraded":"2023-12-19T05:45:10.248231+0000","last_fullsized":"2023-12-19T05:45:10.248231+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:36:20.724957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.469768+0000","last_change":"2023-12-19T05:45:09.251814+0000","last_active":"2023-12-19T05:45:11.469768+0000","last_peered":"2023-12-19T05:45:11.469768+0000","last_clean":"2023-12-19T05:45:11.469768+0000","last_became_active":"2023-12-19T05:45:09.251262+0000","last_became_peered":"2023-12-19T05:45:09.251262+0000","last_unstale":"2023-12-19T05:45:11.469768+0000","last_undegraded":"2023-12-19T05:45:11.469768+0000","last_fullsized":"2023-12-19T05:45:11.469768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:51:24.014669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083590+0000","last_change":"2023-12-19T05:45:08.739814+0000","last_active":"2023-12-19T05:45:12.083590+0000","last_peered":"2023-12-19T05:45:12.083590+0000","last_clean":"2023-12-19T05:45:12.083590+0000","last_became_active":"2023-12-19T05:45:08.739424+0000","last_became_peered":"2023-12-19T05:45:08.739424+0000","last_unstale":"2023-12-19T05:45:12.083590+0000","last_undegraded":"2023-12-19T05:45:12.083590+0000","last_fullsized":"2023-12-19T05:45:12.083590+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:36.371144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244082+0000","last_change":"2023-12-19T05:45:09.243663+0000","last_active":"2023-12-19T05:45:10.244082+0000","last_peered":"2023-12-19T05:45:10.244082+0000","last_clean":"2023-12-19T05:45:10.244082+0000","last_became_active":"2023-12-19T05:45:09.243187+0000","last_became_peered":"2023-12-19T05:45:09.243187+0000","last_unstale":"2023-12-19T05:45:10.244082+0000","last_undegraded":"2023-12-19T05:45:10.244082+0000","last_fullsized":"2023-12-19T05:45:10.244082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:23.166134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.084251+0000","last_change":"2023-12-19T05:45:08.744356+0000","last_active":"2023-12-19T05:45:12.084251+0000","last_peered":"2023-12-19T05:45:12.084251+0000","last_clean":"2023-12-19T05:45:12.084251+0000","last_became_active":"2023-12-19T05:45:08.744133+0000","last_became_peered":"2023-12-19T05:45:08.744133+0000","last_unstale":"2023-12-19T05:45:12.084251+0000","last_undegraded":"2023-12-19T05:45:12.084251+0000","last_fullsized":"2023-12-19T05:45:12.084251+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:26.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244398+0000","last_change":"2023-12-19T05:45:09.261852+0000","last_active":"2023-12-19T05:45:10.244398+0000","last_peered":"2023-12-19T05:45:10.244398+0000","last_clean":"2023-12-19T05:45:10.244398+0000","last_became_active":"2023-12-19T05:45:09.256876+0000","last_became_peered":"2023-12-19T05:45:09.256876+0000","last_unstale":"2023-12-19T05:45:10.244398+0000","last_undegraded":"2023-12-19T05:45:10.244398+0000","last_fullsized":"2023-12-19T05:45:10.244398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:42:04.641955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247475+0000","last_change":"2023-12-19T05:45:08.741091+0000","last_active":"2023-12-19T05:45:10.247475+0000","last_peered":"2023-12-19T05:45:10.247475+0000","last_clean":"2023-12-19T05:45:10.247475+0000","last_became_active":"2023-12-19T05:45:08.739204+0000","last_became_peered":"2023-12-19T05:45:08.739204+0000","last_unstale":"2023-12-19T05:45:10.247475+0000","last_undegraded":"2023-12-19T05:45:10.247475+0000","last_fullsized":"2023-12-19T05:45:10.247475+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:19.841242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245291+0000","last_change":"2023-12-19T05:45:09.254360+0000","last_active":"2023-12-19T05:45:10.245291+0000","last_peered":"2023-12-19T05:45:10.245291+0000","last_clean":"2023-12-19T05:45:10.245291+0000","last_became_active":"2023-12-19T05:45:09.253885+0000","last_became_peered":"2023-12-19T05:45:09.253885+0000","last_unstale":"2023-12-19T05:45:10.245291+0000","last_undegraded":"2023-12-19T05:45:10.245291+0000","last_fullsized":"2023-12-19T05:45:10.245291+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:58:17.010167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470284+0000","last_change":"2023-12-19T05:45:08.741067+0000","last_active":"2023-12-19T05:45:11.470284+0000","last_peered":"2023-12-19T05:45:11.470284+0000","last_clean":"2023-12-19T05:45:11.470284+0000","last_became_active":"2023-12-19T05:45:08.739014+0000","last_became_peered":"2023-12-19T05:45:08.739014+0000","last_unstale":"2023-12-19T05:45:11.470284+0000","last_undegraded":"2023-12-19T05:45:11.470284+0000","last_fullsized":"2023-12-19T05:45:11.470284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:12.012629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082828+0000","last_change":"2023-12-19T05:45:09.260480+0000","last_active":"2023-12-19T05:45:12.082828+0000","last_peered":"2023-12-19T05:45:12.082828+0000","last_clean":"2023-12-19T05:45:12.082828+0000","last_became_active":"2023-12-19T05:45:09.256295+0000","last_became_peered":"2023-12-19T05:45:09.256295+0000","last_unstale":"2023-12-19T05:45:12.082828+0000","last_undegraded":"2023-12-19T05:45:12.082828+0000","last_fullsized":"2023-12-19T05:45:12.082828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:24:04.874749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.082981+0000","last_change":"2023-12-19T05:45:08.745003+0000","last_active":"2023-12-19T05:45:12.082981+0000","last_peered":"2023-12-19T05:45:12.082981+0000","last_clean":"2023-12-19T05:45:12.082981+0000","last_became_active":"2023-12-19T05:45:08.744346+0000","last_became_peered":"2023-12-19T05:45:08.744346+0000","last_unstale":"2023-12-19T05:45:12.082981+0000","last_undegraded":"2023-12-19T05:45:12.082981+0000","last_fullsized":"2023-12-19T05:45:12.082981+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245045+0000","last_change":"2023-12-19T05:45:09.257580+0000","last_active":"2023-12-19T05:45:10.245045+0000","last_peered":"2023-12-19T05:45:10.245045+0000","last_clean":"2023-12-19T05:45:10.245045+0000","last_became_active":"2023-12-19T05:45:09.257299+0000","last_became_peered":"2023-12-19T05:45:09.257299+0000","last_unstale":"2023-12-19T05:45:10.245045+0000","last_undegraded":"2023-12-19T05:45:10.245045+0000","last_fullsized":"2023-12-19T05:45:10.245045+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:57:29.818802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.472140+0000","last_change":"2023-12-19T05:45:08.744768+0000","last_active":"2023-12-19T05:45:11.472140+0000","last_peered":"2023-12-19T05:45:11.472140+0000","last_clean":"2023-12-19T05:45:11.472140+0000","last_became_active":"2023-12-19T05:45:08.743857+0000","last_became_peered":"2023-12-19T05:45:08.743857+0000","last_unstale":"2023-12-19T05:45:11.472140+0000","last_undegraded":"2023-12-19T05:45:11.472140+0000","last_fullsized":"2023-12-19T05:45:11.472140+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:38.576813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247707+0000","last_change":"2023-12-19T05:45:09.257308+0000","last_active":"2023-12-19T05:45:10.247707+0000","last_peered":"2023-12-19T05:45:10.247707+0000","last_clean":"2023-12-19T05:45:10.247707+0000","last_became_active":"2023-12-19T05:45:09.256931+0000","last_became_peered":"2023-12-19T05:45:09.256931+0000","last_unstale":"2023-12-19T05:45:10.247707+0000","last_undegraded":"2023-12-19T05:45:10.247707+0000","last_fullsized":"2023-12-19T05:45:10.247707+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:12.083226+0000","last_change":"2023-12-19T05:45:08.728337+0000","last_active":"2023-12-19T05:45:12.083226+0000","last_peered":"2023-12-19T05:45:12.083226+0000","last_clean":"2023-12-19T05:45:12.083226+0000","last_became_active":"2023-12-19T05:45:08.724245+0000","last_became_peered":"2023-12-19T05:45:08.724245+0000","last_unstale":"2023-12-19T05:45:12.083226+0000","last_undegraded":"2023-12-19T05:45:12.083226+0000","last_fullsized":"2023-12-19T05:45:12.083226+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:28:12.012629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244430+0000","last_change":"2023-12-19T05:45:09.258232+0000","last_active":"2023-12-19T05:45:10.244430+0000","last_peered":"2023-12-19T05:45:10.244430+0000","last_clean":"2023-12-19T05:45:10.244430+0000","last_became_active":"2023-12-19T05:45:09.257991+0000","last_became_peered":"2023-12-19T05:45:09.257991+0000","last_unstale":"2023-12-19T05:45:10.244430+0000","last_undegraded":"2023-12-19T05:45:10.244430+0000","last_fullsized":"2023-12-19T05:45:10.244430+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:41:09.250850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.246408+0000","last_change":"2023-12-19T05:45:08.741797+0000","last_active":"2023-12-19T05:45:10.246408+0000","last_peered":"2023-12-19T05:45:10.246408+0000","last_clean":"2023-12-19T05:45:10.246408+0000","last_became_active":"2023-12-19T05:45:08.741086+0000","last_became_peered":"2023-12-19T05:45:08.741086+0000","last_unstale":"2023-12-19T05:45:10.246408+0000","last_undegraded":"2023-12-19T05:45:10.246408+0000","last_fullsized":"2023-12-19T05:45:10.246408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:06.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.245739+0000","last_change":"2023-12-19T05:45:09.247212+0000","last_active":"2023-12-19T05:45:10.245739+0000","last_peered":"2023-12-19T05:45:10.245739+0000","last_clean":"2023-12-19T05:45:10.245739+0000","last_became_active":"2023-12-19T05:45:09.247004+0000","last_became_peered":"2023-12-19T05:45:09.247004+0000","last_unstale":"2023-12-19T05:45:10.245739+0000","last_undegraded":"2023-12-19T05:45:10.245739+0000","last_fullsized":"2023-12-19T05:45:10.245739+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:38:35.317190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:11.470486+0000","last_change":"2023-12-19T05:45:08.745274+0000","last_active":"2023-12-19T05:45:11.470486+0000","last_peered":"2023-12-19T05:45:11.470486+0000","last_clean":"2023-12-19T05:45:11.470486+0000","last_became_active":"2023-12-19T05:45:08.744966+0000","last_became_peered":"2023-12-19T05:45:08.744966+0000","last_unstale":"2023-12-19T05:45:11.470486+0000","last_undegraded":"2023-12-19T05:45:11.470486+0000","last_fullsized":"2023-12-19T05:45:11.470486+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:47.068361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.247391+0000","last_change":"2023-12-19T05:45:09.263384+0000","last_active":"2023-12-19T05:45:10.247391+0000","last_peered":"2023-12-19T05:45:10.247391+0000","last_clean":"2023-12-19T05:45:10.247391+0000","last_became_active":"2023-12-19T05:45:09.263174+0000","last_became_peered":"2023-12-19T05:45:09.263174+0000","last_unstale":"2023-12-19T05:45:10.247391+0000","last_undegraded":"2023-12-19T05:45:10.247391+0000","last_fullsized":"2023-12-19T05:45:10.247391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:08.700505+0000","last_clean_scrub_stamp":"2023-12-19T05:45:08.700505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:46:01.280237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-19T05:45:10.244471+0000","last_change":"2023-12-19T05:45:08.739321+0000","last_active":"2023-12-19T05:45:10.244471+0000","last_peered":"2023-12-19T05:45:10.244471+0000","last_clean":"2023-12-19T05:45:10.244471+0000","last_became_active":"2023-12-19T05:45:08.739072+0000","last_became_peered":"2023-12-19T05:45:08.739072+0000","last_unstale":"2023-12-19T05:45:10.244471+0000","last_undegraded":"2023-12-19T05:45:10.244471+0000","last_fullsized":"2023-12-19T05:45:10.244471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:45:07.684381+0000","last_clean_scrub_stamp":"2023-12-19T05:45:07.684381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:58:01.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-19T05:45:09.237120+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:45:09.237120+0000","last_peered":"2023-12-19T05:45:09.237120+0000","last_clean":"2023-12-19T05:45:09.237120+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:45:09.237120+0000","last_undegraded":"2023-12-19T05:45:09.237120+0000","last_fullsized":"2023-12-19T05:45:09.237120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194723,"statfs":{"total":200000000,"available":199396607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.119,"15min":1.0469999999999999},"min":{"1min":0.66900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.587,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.137,"15min":1.073},"min":{"1min":0.79800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.716,"5min":3.976,"15min":3.976},"last":1.4910000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.175,"15min":1.079},"min":{"1min":0.89500000000000002,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":1.5069999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.143},{"interface":"front","average":{"1min":1.111,"5min":1.1659999999999999,"15min":1.1619999999999999},"min":{"1min":0.74399999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.611,"5min":4.25,"15min":4.25},"last":1.6299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.234},"min":{"1min":0.81499999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5489999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0900000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.72,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.95399999999999996}]},{"osd":3,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.2809999999999999,"15min":1.1679999999999999},"min":{"1min":1.107,"5min":0.73999999999999999,"15min":0.622},"max":{"1min":1.925,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.099},{"interface":"front","average":{"1min":1.387,"5min":1.383,"15min":1.3260000000000001},"min":{"1min":0.96299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":1.819,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.7629999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1639999999999999,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.8160000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.298,"15min":1.25},"min":{"1min":0.82399999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.784,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.026}]},{"osd":5,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.353,"15min":1.319},"min":{"1min":1.028,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6930000000000001,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3080000000000001,"15min":1.2430000000000001},"min":{"1min":0.873,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":1.903,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.345}]},{"osd":6,"last update":"Tue Dec 19 05:45:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4690000000000001,"15min":1.3460000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.994,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.264},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.504,"15min":1.3999999999999999},"min":{"1min":0.998,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":1.9279999999999999,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.5880000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194722,"statfs":{"total":200000000,"available":199396005,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0309999999999999,"15min":1.2150000000000001},"min":{"1min":0.70299999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.05,"15min":1.036},"min":{"1min":0.752,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.214,"15min":1.1539999999999999},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.631,"5min":1.792,"15min":1.792},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.214,"15min":1.3080000000000001},"min":{"1min":0.88600000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8120000000000001,"5min":1.851,"15min":3.4670000000000001},"last":1.161}]},{"osd":2,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1519999999999999,"15min":1.1859999999999999},"min":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.823,"5min":2,"15min":2},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.198,"15min":1.296},"min":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5980000000000001,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.163,"15min":1.339},"min":{"1min":0.84999999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7050000000000001,"5min":1.857,"15min":4.5220000000000002},"last":0.998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.3620000000000001},"min":{"1min":0.89500000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0059999999999998,"5min":2.1579999999999999,"15min":4.452},"last":1.0980000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.206,"15min":1.3220000000000001},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7470000000000001,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.421},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.208,"15min":1.425},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.6930000000000001,"5min":2.7240000000000002,"15min":4.6689999999999996},"last":1.5269999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.369,"15min":1.5529999999999999},"min":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.726,"5min":2.5070000000000001,"15min":4.5670000000000002},"last":1.488},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4430000000000001,"15min":1.706},"min":{"1min":0.871,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8700000000000001,"5min":2.21,"15min":3.681},"last":1.2629999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3779999999999999,"15min":1.51},"min":{"1min":0.73699999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.917,"5min":1.972,"15min":3.2719999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.534,"15min":1.6080000000000001},"min":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9099999999999999,"5min":2.4609999999999999,"15min":4.7480000000000002},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.147,"15min":1.1259999999999999},"min":{"1min":0.65000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8200000000000001,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1100000000000001,"15min":1.115},"min":{"1min":0.85399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.5049999999999999,"5min":1.776,"15min":2.641},"last":2.012}]},{"osd":1,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2170000000000001,"15min":1.2390000000000001},"min":{"1min":0.81499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":3.9540000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.355,"15min":1.371},"min":{"1min":0.90400000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6819999999999999,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.175,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.5230000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.90200000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.484,"5min":1.54,"15min":2.8250000000000002},"last":1.4490000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.343,"15min":1.448},"min":{"1min":1.0409999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3260000000000001,"15min":1.429},"min":{"1min":0.80500000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.754},"last":1.883}]},{"osd":4,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.25,"15min":1.46},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.569,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.956},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.3660000000000001,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.8280000000000001,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":2.577}]},{"osd":6,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.3680000000000001,"15min":1.498},"min":{"1min":0.68700000000000006,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.3399999999999999},"last":2.1019999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3859999999999999,"15min":1.6319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7569999999999999,"5min":2.1739999999999999,"15min":6.3579999999999997},"last":1.738}]},{"osd":7,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.534,"15min":1.7},"min":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9830000000000001,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":2.1920000000000002},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.54,"15min":1.6160000000000001},"min":{"1min":0.753,"5min":0.65000000000000002,"15min":0.53200000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":2.508}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194723,"statfs":{"total":200000000,"available":199396643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.04,"15min":1.016},"min":{"1min":0.79400000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.514,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.087,"15min":1.0660000000000001},"min":{"1min":0.78900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.494,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":2.0270000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0880000000000001,"15min":1.0629999999999999},"min":{"1min":0.75700000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.339},{"interface":"front","average":{"1min":1.224,"5min":1.1890000000000001,"15min":1.0649999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.53},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.248,"15min":1.218},"min":{"1min":0.97799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0680000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1879999999999999,"15min":1.083},"min":{"1min":0.70599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.617,"5min":1.734,"15min":1.734},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3069999999999999,"15min":1.292},"min":{"1min":1.04,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.671,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.7270000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3500000000000001,"15min":1.3440000000000001},"min":{"1min":0.88400000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":2.081},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3839999999999999,"15min":1.294},"min":{"1min":0.78300000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.708,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":2.4039999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3839999999999999,"15min":1.373},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8540000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.421,"15min":1.403},"min":{"1min":0.84699999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.897}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4399999999999999,"15min":1.3600000000000001},"min":{"1min":0.83799999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":2.4790000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.496,"15min":1.466},"min":{"1min":0.91700000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.887,"5min":1.982,"15min":1.982},"last":2.1930000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194722,"statfs":{"total":200000000,"available":199396003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.86399999999999999,"15min":0.82399999999999995},"min":{"1min":0.628,"5min":0.314,"15min":0.314},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.90000000000000002,"15min":0.81999999999999995},"min":{"1min":0.56599999999999995,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4650000000000001,"5min":1.72,"15min":1.72},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.65600000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":2.702},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.208,"5min":1.032,"15min":0.95799999999999996},"min":{"1min":0.73199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.349}]},{"osd":2,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0649999999999999,"15min":0.93899999999999995},"min":{"1min":0.93000000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4239999999999999,"5min":1.716,"15min":1.716},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.1970000000000001,"15min":1.087},"min":{"1min":0.57499999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.573}]},{"osd":4,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.173,"15min":1.157},"min":{"1min":0.97399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5389999999999999,"5min":1.6779999999999999,"15min":1.8759999999999999},"last":1.373},{"interface":"front","average":{"1min":1.335,"5min":1.304,"15min":1.294},"min":{"1min":1.006,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.708,"5min":1.867,"15min":2.5859999999999999},"last":1.109}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.379,"15min":1.3260000000000001},"min":{"1min":1.012,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.494},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.3899999999999999,"15min":1.3560000000000001},"min":{"1min":1.1639999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.5149999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.4159999999999999,"15min":1.369},"min":{"1min":1.151,"5min":0.74199999999999999,"15min":0.71499999999999997},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.333,"15min":1.3260000000000001},"min":{"1min":1.0780000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.4670000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4099999999999999,"15min":1.3859999999999999},"min":{"1min":1.125,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8400000000000001,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.55},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4159999999999999,"15min":1.421},"min":{"1min":1.2210000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8839999999999999,"5min":1.968,"15min":2.8900000000000001},"last":1.5960000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194729,"statfs":{"total":200000000,"available":199402977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.77000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.4510000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97699999999999998,"15min":0.91300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5029999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.75700000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.085,"15min":1.0489999999999999},"min":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.534},{"interface":"front","average":{"1min":1.276,"5min":1.2310000000000001,"15min":1.161},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.639,"5min":1.75,"15min":1.75},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98399999999999999,"15min":0.92800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4490000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.173,"15min":1.089},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.498}]},{"osd":4,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3420000000000001,"15min":1.2689999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.694,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.325,"15min":1.246},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.843,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.377,"15min":1.2929999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.81499999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.71,"5min":1.929,"15min":2.5960000000000001},"last":0.90400000000000003}]},{"osd":6,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":1.008,"5min":0.84899999999999998,"15min":0.83599999999999997},"max":{"1min":1.897,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.87},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.423,"15min":1.333},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7889999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.861}]},{"osd":7,"last update":"Tue Dec 19 05:45:01 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.486,"15min":1.4179999999999999},"min":{"1min":1.0960000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":2.101,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.121},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.714},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1165,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194146,"statfs":{"total":200000000,"available":198806219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.89600000000000002,"15min":0.93400000000000005},"min":{"1min":0.375,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.1110000000000002,"15min":2.992},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.0369999999999999,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6799999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92800000000000005,"15min":0.96499999999999997},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.577,"5min":1.742,"15min":2.2789999999999999},"last":1.01},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.8580000000000001,"15min":1.3420000000000001},"min":{"1min":0.56000000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":70.206000000000003,"15min":70.206000000000003},"last":1.1120000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.71399999999999997,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":2.0059999999999998,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.393},{"interface":"front","average":{"1min":1.498,"5min":1.268,"15min":1.244},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":2.3580000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.3460000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.3480000000000001,"15min":1.228},"min":{"1min":0.86699999999999999,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":2.3969999999999998,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.643,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":0.85699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5960000000000001,"5min":4.306,"15min":4.306},"last":1.5189999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.4319999999999999,"15min":1.3640000000000001},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.68400000000000005},"max":{"1min":2.5550000000000002,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.4490000000000001,"15min":1.3700000000000001},"min":{"1min":0.81899999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.464,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.579}]},{"osd":6,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.5309999999999999,"15min":1.4399999999999999},"min":{"1min":1.0409999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.8860000000000001,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.617,"5min":1.494,"15min":1.4319999999999999},"min":{"1min":0.93500000000000005,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.6899999999999999,"5min":3.75,"15min":3.75},"last":1.46}]},{"osd":7,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6299999999999999,"15min":1.542},"min":{"1min":0.999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.5059999999999998,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.619},{"interface":"front","average":{"1min":1.8859999999999999,"5min":1.6719999999999999,"15min":1.617},"min":{"1min":1.1559999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.7290000000000001,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.548}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":590,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194721,"statfs":{"total":200000000,"available":199395091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86099999999999999,"15min":0.79700000000000004},"min":{"1min":0.60599999999999998,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.2390000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.94899999999999995,"15min":0.89500000000000002},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.032}]},{"osd":2,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0760000000000001,"15min":1.0600000000000001},"min":{"1min":0.67600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3500000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92900000000000005,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.464,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.872},{"interface":"front","average":{"1min":1.218,"5min":1.1120000000000001,"15min":1.0660000000000001},"min":{"1min":0.53900000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.653,"5min":1.653,"15min":1.8720000000000001},"last":1.9790000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2090000000000001,"15min":1.161},"min":{"1min":0.83299999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.294},{"interface":"front","average":{"1min":1.444,"5min":1.3200000000000001,"15min":1.264},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":2.149}]},{"osd":5,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.3600000000000001,"15min":1.3180000000000001},"min":{"1min":0.86799999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.345,"15min":1.286},"min":{"1min":0.85599999999999998,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8240000000000001,"5min":1.879,"15min":1.879},"last":1.7270000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.401,"15min":1.391},"min":{"1min":0.877,"5min":0.81100000000000005,"15min":0.76300000000000001},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":2.4870000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.355,"15min":1.284},"min":{"1min":0.77000000000000002,"5min":0.746,"15min":0.746},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.7030000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:44:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.4610000000000001,"15min":1.421},"min":{"1min":0.94999999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.609},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.421,"15min":1.375},"min":{"1min":0.94099999999999995,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":2.0510000000000002,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.5800000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:45:14.789 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:45:14.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:45:15.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.066+0000 7f54bef9f640 1 Processor -- start 2023-12-19T05:45:15.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.067+0000 7f54bef9f640 1 -- start start 2023-12-19T05:45:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.068+0000 7f54bef9f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b80b8500 0x7f54b80d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.068+0000 7f54bef9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 0x7f54b806f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bef9f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80b88e0 con 0x7f54b80659d0 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bef9f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b815df50 con 0x7f54b80b8500 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bef9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b815e230 con 0x7f54b815da00 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b80b8500 0x7f54b80d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b80b8500 0x7f54b80d4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51488/0 (socket says 172.21.15.49:51488) 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 -- 172.21.15.49:0/2784319220 learned_addr learned my addr 172.21.15.49:0/2784319220 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54b7fff640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 0x7f54b806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 -- 172.21.15.49:0/2784319220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 msgr2=0x7f54b806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 0x7f54b806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.069+0000 7f54bcd3b640 1 -- 172.21.15.49:0/2784319220 >> v1:172.21.15.115:6789/0 conn(0x7f54b80659d0 legacy=0x7f54b81614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.070+0000 7f54bcd3b640 1 -- 172.21.15.49:0/2784319220 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b815e510 con 0x7f54b80b8500 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.070+0000 7f54b7fff640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 0x7f54b806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.071+0000 7f54bcd3b640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b80b8500 0x7f54b80d4050 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009870 tx=0x7f54ac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358ad69b05f41406 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.071+0000 7f54b77fe640 1 -- 172.21.15.49:0/2784319220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0317c0 con 0x7f54b80b8500 2023-12-19T05:45:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.071+0000 7f54b77fe640 1 -- 172.21.15.49:0/2784319220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac031920 con 0x7f54b80b8500 2023-12-19T05:45:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.071+0000 7f54b77fe640 1 -- 172.21.15.49:0/2784319220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac031cb0 con 0x7f54b80b8500 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 -- 172.21.15.49:0/2784319220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b80b8500 msgr2=0x7f54b80d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b80b8500 0x7f54b80d4050 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009870 tx=0x7f54ac02b860 comp rx=0 tx=0).stop 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 -- 172.21.15.49:0/2784319220 shutdown_connections 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b815da00 0x7f54b806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2784319220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b80b8500 0x7f54b80d4050 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 -- 172.21.15.49:0/2784319220 >> 172.21.15.49:0/2784319220 conn(0x7f54b80b4120 msgr2=0x7f54b80b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 -- 172.21.15.49:0/2784319220 shutdown_connections 2023-12-19T05:45:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.072+0000 7f54bef9f640 1 -- 172.21.15.49:0/2784319220 wait complete. 2023-12-19T05:45:15.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.074+0000 7f54bef9f640 1 Processor -- start 2023-12-19T05:45:15.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.074+0000 7f54bef9f640 1 -- start start 2023-12-19T05:45:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b80659d0 0x7f54b80b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80b8500 0x7f54b815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8142a70 con 0x7f54b815da00 2023-12-19T05:45:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8153550 con 0x7f54b80b8500 2023-12-19T05:45:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.075+0000 7f54bef9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81421d0 con 0x7f54b80659d0 2023-12-19T05:45:15.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51492/0 (socket says 172.21.15.49:51492) 2023-12-19T05:45:15.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 -- 172.21.15.49:0/2169527703 learned_addr learned my addr 172.21.15.49:0/2169527703 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54b7fff640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80b8500 0x7f54b815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bcd3b640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b80659d0 0x7f54b80b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 -- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b80659d0 msgr2=0x7f54b80b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b80659d0 0x7f54b80b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 -- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80b8500 msgr2=0x7f54b815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80b8500 0x7f54b815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.076+0000 7f54bd53c640 1 -- 172.21.15.49:0/2169527703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0094d0 con 0x7f54b815da00 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54bd53c640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f54b000b970 tx=0x7f54b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000cb40 con 0x7f54b815da00 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b000cca0 con 0x7f54b815da00 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0014680 con 0x7f54b815da00 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b81424b0 con 0x7f54b815da00 2023-12-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.077+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b8144270 con 0x7f54b815da00 2023-12-19T05:45:15.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.078+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b81440d0 con 0x7f54b815da00 2023-12-19T05:45:15.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.079+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54b001d3b0 con 0x7f54b815da00 2023-12-19T05:45:15.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.080+0000 7f54b57fa640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 0x7f549c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.080+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54b00887e0 con 0x7f54b815da00 2023-12-19T05:45:15.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.081+0000 7f54bcd3b640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 0x7f549c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.082+0000 7f54bcd3b640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 0x7f549c06c8f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54ac036000 tx=0x7f54ac03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.084+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54b81440d0 con 0x7f54b815da00 2023-12-19T05:45:15.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.358+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f54b81440d0 con 0x7f54b815da00 2023-12-19T05:45:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.364+0000 7f54b57fa640 1 -- 172.21.15.49:0/2169527703 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f54b81440d0 con 0x7f54b815da00 2023-12-19T05:45:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:45:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 msgr2=0x7f549c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 0x7f549c06c8f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54ac036000 tx=0x7f54ac03d040 comp rx=0 tx=0).stop 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 msgr2=0x7f54b815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f54b000b970 tx=0x7f54b000be30 comp rx=0 tx=0).stop 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 shutdown_connections 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f549c06a430 0x7f549c06c8f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b815da00 0x7f54b815c7c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80b8500 0x7f54b815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 --2- 172.21.15.49:0/2169527703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b80659d0 0x7f54b80b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.367+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 >> 172.21.15.49:0/2169527703 conn(0x7f54b80b4120 msgr2=0x7f54b80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:15.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.368+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 shutdown_connections 2023-12-19T05:45:15.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.368+0000 7f54bef9f640 1 -- 172.21.15.49:0/2169527703 wait complete. 2023-12-19T05:45:15.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:15.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.611+0000 7f0c9653c640 1 Processor -- start 2023-12-19T05:45:15.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.611+0000 7f0c9653c640 1 -- start start 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.612+0000 7f0c9653c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c900d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c9653c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c900ce110 0x7f0c900ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c9653c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900cd840 con 0x7f0c900d2b00 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c9653c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900d2430 con 0x7f0c900ce110 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c9653c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900ceae0 con 0x7f0c90146e10 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c8f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0c900d2b00 0x7f0c900b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49362/0 (socket says 172.21.15.49:49362) 2023-12-19T05:45:15.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c8f7fe640 1 -- 172.21.15.49:0/829680053 learned_addr learned my addr 172.21.15.49:0/829680053 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311784043 0 0) 0x7f0c900cd840 con 0x7f0c900d2b00 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c900d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c78003520 con 0x7f0c900d2b00 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.613+0000 7f0c94ad9640 1 --2- 172.21.15.49:0/829680053 >> v2:172.21.15.115:3300/0 conn(0x7f0c900ce110 0x7f0c900ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322205601 0 0) 0x7f0c78003520 con 0x7f0c900d2b00 2023-12-19T05:45:15.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 msgr2=0x7f0c900d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c900d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 >> v2:172.21.15.115:3300/0 conn(0x7f0c900ce110 msgr2=0x7f0c900ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 --2- 172.21.15.49:0/829680053 >> v2:172.21.15.115:3300/0 conn(0x7f0c900ce110 0x7f0c900ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900b6e90 con 0x7f0c900d2b00 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0c84001670 con 0x7f0c900d2b00 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 >> v1:172.21.15.49:6789/0 conn(0x7f0c900d2b00 legacy=0x7f0c900b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c78003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c78003f90 0x7f0c780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78004d00 0x7f0c78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900ceae0 con 0x7f0c78003f90 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800ba30 con 0x7f0c78004d00 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800bbc0 con 0x7f0c90146e10 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.614+0000 7f0c8f7fe640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c78003f90 0x7f0c780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c78003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8f7fe640 1 -- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 msgr2=0x7f0c78003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8f7fe640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c90146e10 0x7f0c78003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8f7fe640 1 -- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78004d00 msgr2=0x7f0c78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c94ad9640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78004d00 0x7f0c78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8f7fe640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78004d00 0x7f0c78005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.615+0000 7f0c8f7fe640 1 -- 172.21.15.49:0/829680053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78003520 con 0x7f0c78003f90 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.616+0000 7f0c8f7fe640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c78003f90 0x7f0c780047c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400c270 tx=0x7f0c780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b8131238f8b540 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.616+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84005ad0 con 0x7f0c78003f90 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.616+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c84005c50 con 0x7f0c78003f90 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.616+0000 7f0c8effd640 1 -- 172.21.15.49:0/829680053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8402c8a0 con 0x7f0c78003f90 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 -- 172.21.15.49:0/829680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c78003f90 msgr2=0x7f0c780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 --2- 172.21.15.49:0/829680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c78003f90 0x7f0c780047c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400c270 tx=0x7f0c780057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c94ad9640 1 -- 172.21.15.49:0/829680053 reap_dead start 2023-12-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 -- 172.21.15.49:0/829680053 shutdown_connections 2023-12-19T05:45:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 -- 172.21.15.49:0/829680053 >> 172.21.15.49:0/829680053 conn(0x7f0c900b29c0 msgr2=0x7f0c900b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 -- 172.21.15.49:0/829680053 shutdown_connections 2023-12-19T05:45:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.617+0000 7f0c9653c640 1 -- 172.21.15.49:0/829680053 wait complete. 2023-12-19T05:45:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.619+0000 7f0c9653c640 1 Processor -- start 2023-12-19T05:45:15.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.619+0000 7f0c9653c640 1 -- start start 2023-12-19T05:45:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 0x7f0c90140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c9013b450 0x7f0c9013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9013cab0 con 0x7f0c9013b8d0 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901f2550 con 0x7f0c78003f90 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c9653c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9013be30 con 0x7f0c9013b450 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c94ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c94ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51514/0 (socket says 172.21.15.49:51514) 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.620+0000 7f0c94ad9640 1 -- 172.21.15.49:0/3074718587 learned_addr learned my addr 172.21.15.49:0/3074718587 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c8f7fe640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c9013b450 0x7f0c9013d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 0x7f0c90140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 -- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c9013b450 msgr2=0x7f0c9013d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c9013b450 0x7f0c9013d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 -- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 msgr2=0x7f0c90140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 0x7f0c90140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 -- 172.21.15.49:0/3074718587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9013c110 con 0x7f0c9013b8d0 2023-12-19T05:45:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 0x7f0c90140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.621+0000 7f0c94ad9640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ced80 tx=0x7f0c88009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.622+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88007d20 con 0x7f0c9013b8d0 2023-12-19T05:45:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.622+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88014400 con 0x7f0c9013b8d0 2023-12-19T05:45:15.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.622+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88007ea0 con 0x7f0c9013b8d0 2023-12-19T05:45:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.622+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9013c3f0 con 0x7f0c9013b8d0 2023-12-19T05:45:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.622+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c901408a0 con 0x7f0c9013b8d0 2023-12-19T05:45:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.623+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c90061910 con 0x7f0c9013b8d0 2023-12-19T05:45:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.624+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c8801d3b0 con 0x7f0c9013b8d0 2023-12-19T05:45:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.625+0000 7f0c8cff9640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 0x7f0c7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.625+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c88088710 con 0x7f0c9013b8d0 2023-12-19T05:45:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.626+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 0x7f0c7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.627+0000 7f0c8ffff640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 0x7f0c7c06c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0c80006ce0 tx=0x7f0c80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.629+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c88053d00 con 0x7f0c9013b8d0 2023-12-19T05:45:15.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.863+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c900b4a50 con 0x7f0c9013b8d0 2023-12-19T05:45:15.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.864+0000 7f0c8cff9640 1 -- 172.21.15.49:0/3074718587 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f0c88057320 con 0x7f0c9013b8d0 2023-12-19T05:45:15.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:15.866 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:15.866 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 msgr2=0x7f0c7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 0x7f0c7c06c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0c80006ce0 tx=0x7f0c80008040 comp rx=0 tx=0).stop 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 msgr2=0x7f0c9013db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ced80 tx=0x7f0c88009d40 comp rx=0 tx=0).stop 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 shutdown_connections 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0c7c06a430 0x7f0c7c06c8f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c9013b450 0x7f0c9013d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c9013b8d0 0x7f0c9013db50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 --2- 172.21.15.49:0/3074718587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c78003f90 0x7f0c90140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 >> 172.21.15.49:0/3074718587 conn(0x7f0c900b29c0 msgr2=0x7f0c900b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 shutdown_connections 2023-12-19T05:45:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:15.867+0000 7f0c9653c640 1 -- 172.21.15.49:0/3074718587 wait complete. 2023-12-19T05:45:16.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:45:09.226653+0000', 'modified': '2023-12-19T05:45:12.725224+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6795': {'gid': 6795, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/3756494171', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 3756494171}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 3756494171}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:45:16.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:45:16.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T05:45:16.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.531+0000 7f1cc72d7640 1 Processor -- start 2023-12-19T05:45:16.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.532+0000 7f1cc72d7640 1 -- start start 2023-12-19T05:45:16.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.533+0000 7f1cc72d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00b0a00 0x7f1cc00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.533+0000 7f1cc72d7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cc00cd430 0x7f1cc006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc72d7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc006b3a0 con 0x7f1cc0159e40 2023-12-19T05:45:16.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc72d7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00b23e0 con 0x7f1cc00cd430 2023-12-19T05:45:16.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc72d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00cd8a0 con 0x7f1cc00b0a00 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc62d5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1cc0159e40 0x7f1cc00b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49370/0 (socket says 172.21.15.49:49370) 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc62d5640 1 -- 172.21.15.49:0/333055573 learned_addr learned my addr 172.21.15.49:0/333055573 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/333055573 >> v2:172.21.15.49:3300/0 conn(0x7f1cc00cd430 0x7f1cc006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/333055573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00b0a00 msgr2=0x7f1cc00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/333055573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00b0a00 0x7f1cc00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/333055573 >> v1:172.21.15.49:6789/0 conn(0x7f1cc0159e40 legacy=0x7f1cc00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.534+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/333055573 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00b1860 con 0x7f1cc00cd430 2023-12-19T05:45:16.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.536+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/333055573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00cd430 0x7f1cc006b810 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009d90 tx=0x7f1cb802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc466f32fb3930 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.536+0000 7f1cc52d3640 1 -- 172.21.15.49:0/333055573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb802cce0 con 0x7f1cc00cd430 2023-12-19T05:45:16.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.536+0000 7f1cc52d3640 1 -- 172.21.15.49:0/333055573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb802ce40 con 0x7f1cc00cd430 2023-12-19T05:45:16.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.536+0000 7f1cc52d3640 1 -- 172.21.15.49:0/333055573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034660 con 0x7f1cc00cd430 2023-12-19T05:45:16.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 -- 172.21.15.49:0/333055573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00cd430 msgr2=0x7f1cc006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/333055573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00cd430 0x7f1cc006b810 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009d90 tx=0x7f1cb802bf30 comp rx=0 tx=0).stop 2023-12-19T05:45:16.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 -- 172.21.15.49:0/333055573 shutdown_connections 2023-12-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/333055573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00cd430 0x7f1cc006b810 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/333055573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00b0a00 0x7f1cc00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 -- 172.21.15.49:0/333055573 >> 172.21.15.49:0/333055573 conn(0x7f1cc00659a0 msgr2=0x7f1cc0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 -- 172.21.15.49:0/333055573 shutdown_connections 2023-12-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.537+0000 7f1cc72d7640 1 -- 172.21.15.49:0/333055573 wait complete. 2023-12-19T05:45:16.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.539+0000 7f1cc72d7640 1 Processor -- start 2023-12-19T05:45:16.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.539+0000 7f1cc72d7640 1 -- start start 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00cd430 0x7f1cc0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cc0159e40 0x7f1cc0158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc015b7d0 con 0x7f1cc00b0a00 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc015bab0 con 0x7f1cc0159e40 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.540+0000 7f1cc72d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc015bd90 con 0x7f1cc00cd430 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51544/0 (socket says 172.21.15.49:51544) 2023-12-19T05:45:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 -- 172.21.15.49:0/1582763998 learned_addr learned my addr 172.21.15.49:0/1582763998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 -- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00cd430 msgr2=0x7f1cc0152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00cd430 0x7f1cc0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 -- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cc0159e40 msgr2=0x7f1cc0158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cc0159e40 0x7f1cc0158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 -- 172.21.15.49:0/1582763998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009a70 con 0x7f1cc00b0a00 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.541+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c4a0 tx=0x7f1cbc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.542+0000 7f1cb6ffd640 1 -- 172.21.15.49:0/1582763998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc005ce0 con 0x7f1cc00b0a00 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.542+0000 7f1cb6ffd640 1 -- 172.21.15.49:0/1582763998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc005e40 con 0x7f1cc00b0a00 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.542+0000 7f1cb6ffd640 1 -- 172.21.15.49:0/1582763998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc007270 con 0x7f1cc00b0a00 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.542+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc015c070 con 0x7f1cc00b0a00 2023-12-19T05:45:16.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.542+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00cc400 con 0x7f1cc00b0a00 2023-12-19T05:45:16.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.544+0000 7f1cb6ffd640 1 -- 172.21.15.49:0/1582763998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cbc007490 con 0x7f1cc00b0a00 2023-12-19T05:45:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.546+0000 7f1cb6ffd640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 0x7f1ca406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.546+0000 7f1cb6ffd640 1 -- 172.21.15.49:0/1582763998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cbc087de0 con 0x7f1cc00b0a00 2023-12-19T05:45:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.546+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 0x7f1ca406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.547+0000 7f1ccb17b740 1 Processor -- start 2023-12-19T05:45:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.547+0000 7f1ccb17b740 1 -- start start 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 0x7f1ca406c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00cb8c0 tx=0x7f1cb0006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea51f10 0x5578bea522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea21e90 0x5578bea4f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578be991f80 con 0x5578bea25a90 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578be98f710 con 0x5578bea21e90 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578be98b000 con 0x5578bea51f10 2023-12-19T05:45:16.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51546/0 (socket says 172.21.15.49:51546) 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1720601026 learned_addr learned my addr 172.21.15.49:0/1720601026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea21e90 0x5578bea4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea51f10 0x5578bea522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea51f10 msgr2=0x5578bea522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea51f10 0x5578bea522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea21e90 msgr2=0x5578bea4f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea21e90 0x5578bea4f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.548+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1720601026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578be952690 con 0x5578bea25a90 2023-12-19T05:45:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.549+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009d90 tx=0x7f1cb802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b1091424d39070 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.549+0000 7f1ca3fff640 1 -- 172.21.15.49:0/1720601026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034440 con 0x5578bea25a90 2023-12-19T05:45:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.549+0000 7f1ca3fff640 1 -- 172.21.15.49:0/1720601026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb80345c0 con 0x5578bea25a90 2023-12-19T05:45:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.549+0000 7f1ca3fff640 1 -- 172.21.15.49:0/1720601026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034970 con 0x5578bea25a90 2023-12-19T05:45:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1720601026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 msgr2=0x5578bea4f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009d90 tx=0x7f1cb802e070 comp rx=0 tx=0).stop 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1720601026 shutdown_connections 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea25a90 0x5578bea4f6c0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea21e90 0x5578bea4f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1720601026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea51f10 0x5578bea522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1720601026 >> 172.21.15.49:0/1720601026 conn(0x5578bea241a0 msgr2=0x5578bea6cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1720601026 shutdown_connections 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.550+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1720601026 wait complete. 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.551+0000 7f1ccb17b740 1 -- start start 2023-12-19T05:45:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.551+0000 7f1ccb17b740 1 Processor -- start 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea7bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578be92c7d0 con 0x5578bea59470 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578be92c470 con 0x5578bea51f10 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578be6f2f20 con 0x5578bea25a90 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1ccb17b740 10 client.0 _ll_register_callbacks cb 0x5578be97b1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.552+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51558/0 (socket says 172.21.15.49:51558) 2023-12-19T05:45:16.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1807769200 learned_addr learned my addr 172.21.15.49:0/1807769200 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea7bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 msgr2=0x5578bea7bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea7bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 msgr2=0x5578bea542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1807769200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00b1860 con 0x5578bea59470 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80095c0 tx=0x7f1cb8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b7a57d54c87c8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.553+0000 7f1ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034b40 con 0x5578bea59470 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb8034ca0 con 0x5578bea59470 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578be9b5550 con 0x5578bea59470 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cb8034ea0 con 0x5578bea59470 2023-12-19T05:45:16.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 10 client.6921 fetch_fsmap learned FSMap version 48 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x5578be989680 con 0x5578bea59470 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578be9b5550 con 0x5578bea59470 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 48) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1cb8004040 con 0x5578bea59470 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 10 client.6921 fetch_fsmap finished waiting for FSMap version 48 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 10 client.6921 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 20 client.6921 populate_metadata read hostname 'smithi049' 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bea40ec0 0x5578bea412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 4 client.6921 mds_command: new command op to 6795 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.554+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 --> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578be97db50 con 0x5578bea40ec0 2023-12-19T05:45:16.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.555+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bea40ec0 0x5578bea412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.556+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bea40ec0 0x5578bea412a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439d37da7f08409d server_cookie=24990067df6fbd41 in_seq=0 out_seq=0 2023-12-19T05:45:16.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.556+0000 7f1ca17fa640 10 client.6921 ms_handle_connect on v2:172.21.15.115:6835/3756494171 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.558+0000 7f1ca17fa640 1 -- 172.21.15.49:0/1807769200 <== mds.0 v2:172.21.15.115:6835/3756494171 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5578be97db50 con 0x5578bea40ec0 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.558+0000 7f1ca17fa640 10 client.6921 handle_command_reply: tid=0 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.558+0000 7f1ccb17b740 1 client.6921 shutdown 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 msgr2=0x5578bea598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80095c0 tx=0x7f1cb8004ab0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 shutdown_connections 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bea40ec0 0x5578bea412a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea598f0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1807769200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea7bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ca17fa640 0 client.6921 ms_handle_reset on v2:172.21.15.115:6835/3756494171 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 >> 172.21.15.49:0/1807769200 conn(0x5578bea21e90 msgr2=0x5578bea55bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 shutdown_connections 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1807769200 wait complete. 2023-12-19T05:45:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.559+0000 7f1ccb17b740 20 client.6921 trim_cache size 0 max 16384 2023-12-19T05:45:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.576+0000 7f1ccb17b740 1 Processor -- start 2023-12-19T05:45:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.576+0000 7f1ccb17b740 1 -- start start 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578bea3f970 con 0x5578bea59470 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578bea256b0 con 0x5578bea51f10 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578bea7f3f0 con 0x5578bea25a90 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51564/0 (socket says 172.21.15.49:51564) 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1188506574 learned_addr learned my addr 172.21.15.49:0/1188506574 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 msgr2=0x5578bea26180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 msgr2=0x5578bea424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.577+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.578+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/1188506574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578be92b9e0 con 0x5578bea59470 2023-12-19T05:45:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.578+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000f80 tx=0x7f1cb803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b52876681463ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.578+0000 7f1cb4ff9640 1 -- 172.21.15.49:0/1188506574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb805f070 con 0x5578bea59470 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.578+0000 7f1cb4ff9640 1 -- 172.21.15.49:0/1188506574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8034440 con 0x5578bea59470 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.578+0000 7f1cb4ff9640 1 -- 172.21.15.49:0/1188506574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8004550 con 0x5578bea59470 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1188506574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 msgr2=0x5578bea42a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000f80 tx=0x7f1cb803f040 comp rx=0 tx=0).stop 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1188506574 shutdown_connections 2023-12-19T05:45:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea42a00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/1188506574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bea26180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1188506574 >> 172.21.15.49:0/1188506574 conn(0x5578bea21e90 msgr2=0x5578bea54010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1188506574 shutdown_connections 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.579+0000 7f1ccb17b740 1 -- 172.21.15.49:0/1188506574 wait complete. 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.580+0000 7f1ccb17b740 1 -- start start 2023-12-19T05:45:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.580+0000 7f1ccb17b740 1 Processor -- start 2023-12-19T05:45:16.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bead1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea7e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578bea42590 con 0x5578bea59470 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578bead24f0 con 0x5578bea51f10 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578bea7f000 con 0x5578bea25a90 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1ccb17b740 10 client.0 _ll_register_callbacks cb 0x7f1cb8037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.581+0000 7f1cc6ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51572/0 (socket says 172.21.15.49:51572) 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/3101192457 learned_addr learned my addr 172.21.15.49:0/3101192457 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bead1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 msgr2=0x5578bead1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bead1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 msgr2=0x5578bea7e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc5ad4640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea7e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea7e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 -- 172.21.15.49:0/3101192457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578be989680 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1cc6ad6640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009920 tx=0x7f1cb802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc26a9b22c0d1fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb805f040 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.582+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb8034b40 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578be984080 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cb8004170 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 10 client.6927 fetch_fsmap learned FSMap version 48 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x5578be950ef0 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578be984080 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 48) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1cb806a020 con 0x5578bea59470 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 10 client.6927 fetch_fsmap finished waiting for FSMap version 48 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 10 client.6927 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 20 client.6927 populate_metadata read hostname 'smithi049' 2023-12-19T05:45:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bead5770 0x5578bead5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 4 client.6927 mds_command: new command op to 6795 tid=0[{"prefix": "status"}] 2023-12-19T05:45:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.583+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 --> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5578be983da0 con 0x5578bead5770 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.584+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bead5770 0x5578bead5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.585+0000 7f1cc62d5640 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bead5770 0x5578bead5b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=382efe1849a00f0 server_cookie=2852530c484bd220 in_seq=0 out_seq=0 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.585+0000 7f1ca17fa640 10 client.6927 ms_handle_connect on v2:172.21.15.115:6835/3756494171 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ca17fa640 1 -- 172.21.15.49:0/3101192457 <== mds.0 v2:172.21.15.115:6835/3756494171 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x5578be983da0 con 0x5578bead5770 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ca17fa640 10 client.6927 handle_command_reply: tid=0 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 client.6927 shutdown 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 msgr2=0x5578bea7e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009920 tx=0x7f1cb802e000 comp rx=0 tx=0).stop 2023-12-19T05:45:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 shutdown_connections 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:6835/3756494171,v1:172.21.15.115:6837/3756494171] conn(0x5578bead5770 0x5578bead5b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578bea59470 0x5578bea7e7f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5578bea51f10 0x5578bea7e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 --2- 172.21.15.49:0/3101192457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5578bea25a90 0x5578bead1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ca17fa640 0 client.6927 ms_handle_reset on v2:172.21.15.115:6835/3756494171 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 >> 172.21.15.49:0/3101192457 conn(0x5578bea21e90 msgr2=0x5578bea54010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 shutdown_connections 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 1 -- 172.21.15.49:0/3101192457 wait complete. 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.586+0000 7f1ccb17b740 20 client.6927 trim_cache size 0 max 16384 2023-12-19T05:45:16.589 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6795, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.353923945, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 48, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 110, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 110, 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.984914003 2023-12-19T05:45:16.590 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 msgr2=0x7f1ca406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 0x7f1ca406c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00cb8c0 tx=0x7f1cb0006bf0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 msgr2=0x7f1cc015b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c4a0 tx=0x7f1cbc00c960 comp rx=0 tx=0).stop 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 shutdown_connections 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ca406a430 0x7f1ca406c8f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cc00cd430 0x7f1cc0152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cc0159e40 0x7f1cc0158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 --2- 172.21.15.49:0/1582763998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cc00b0a00 0x7f1cc015b110 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 >> 172.21.15.49:0/1582763998 conn(0x7f1cc00659a0 msgr2=0x7f1cc006f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 shutdown_connections 2023-12-19T05:45:16.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.587+0000 7f1cc72d7640 1 -- 172.21.15.49:0/1582763998 wait complete. 2023-12-19T05:45:16.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:45:16.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.836+0000 7f82ea3a9640 1 Processor -- start 2023-12-19T05:45:16.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.836+0000 7f82ea3a9640 1 -- start start 2023-12-19T05:45:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82ea3a9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82e40ce300 0x7f82e415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82ea3a9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e415ec30 con 0x7f82e40b2030 2023-12-19T05:45:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82ea3a9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e415fbc0 con 0x7f82e415e5a0 2023-12-19T05:45:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82ea3a9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e415e980 con 0x7f82e40ce300 2023-12-19T05:45:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e9ba8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82e40ce300 0x7f82e415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e8ba6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f82e40b2030 0x7f82e40cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49376/0 (socket says 172.21.15.49:49376) 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e9ba8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82e40ce300 0x7f82e415f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51576/0 (socket says 172.21.15.49:51576) 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e8ba6640 1 -- 172.21.15.49:0/4114327390 learned_addr learned my addr 172.21.15.49:0/4114327390 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e9ba8640 1 -- 172.21.15.49:0/4114327390 >> v1:172.21.15.115:6789/0 conn(0x7f82e415e5a0 legacy=0x7f82e40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e9ba8640 1 -- 172.21.15.49:0/4114327390 >> v1:172.21.15.49:6789/0 conn(0x7f82e40b2030 legacy=0x7f82e40cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.838+0000 7f82e9ba8640 1 -- 172.21.15.49:0/4114327390 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40b2f90 con 0x7f82e40ce300 2023-12-19T05:45:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82e9ba8640 1 --2- 172.21.15.49:0/4114327390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e415f680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009dc0 tx=0x7f82dc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726bdd93459244c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82dbfff640 1 -- 172.21.15.49:0/4114327390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc02cc40 con 0x7f82e40ce300 2023-12-19T05:45:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82dbfff640 1 -- 172.21.15.49:0/4114327390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc02cda0 con 0x7f82e40ce300 2023-12-19T05:45:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82dbfff640 1 -- 172.21.15.49:0/4114327390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc034660 con 0x7f82e40ce300 2023-12-19T05:45:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4114327390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 msgr2=0x7f82e415f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.840+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4114327390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e415f680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009dc0 tx=0x7f82dc02be90 comp rx=0 tx=0).stop 2023-12-19T05:45:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.841+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4114327390 shutdown_connections 2023-12-19T05:45:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.841+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4114327390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e415f680 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.841+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4114327390 >> 172.21.15.49:0/4114327390 conn(0x7f82e40b0100 msgr2=0x7f82e40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:16.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.841+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4114327390 shutdown_connections 2023-12-19T05:45:16.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.841+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4114327390 wait complete. 2023-12-19T05:45:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.842+0000 7f82ea3a9640 1 Processor -- start 2023-12-19T05:45:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.843+0000 7f82ea3a9640 1 -- start start 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82e40b2030 0x7f82e40ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82e415e5a0 0x7f82e40caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40cd330 con 0x7f82e40ce300 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40cc960 con 0x7f82e40b2030 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82ea3a9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e414eff0 con 0x7f82e415e5a0 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51584/0 (socket says 172.21.15.49:51584) 2023-12-19T05:45:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 -- 172.21.15.49:0/4015760424 learned_addr learned my addr 172.21.15.49:0/4015760424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e93a7640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82e40b2030 0x7f82e40ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e9ba8640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82e415e5a0 0x7f82e40caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 -- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82e415e5a0 msgr2=0x7f82e40caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82e415e5a0 0x7f82e40caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 -- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82e40b2030 msgr2=0x7f82e40ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.844+0000 7f82e8ba6640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82e40b2030 0x7f82e40ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82e8ba6640 1 -- 172.21.15.49:0/4015760424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009a70 con 0x7f82e40ce300 2023-12-19T05:45:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82e8ba6640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c4a0 tx=0x7f82d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4005ce0 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4005e40 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4007270 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e40cb4b0 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.845+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40a9330 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.846+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e40ccaf0 con 0x7f82e40ce300 2023-12-19T05:45:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.847+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f82d4007490 con 0x7f82e40ce300 2023-12-19T05:45:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.848+0000 7f82d9ffb640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 0x7f82c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:16.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.848+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82d4087db0 con 0x7f82e40ce300 2023-12-19T05:45:16.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.849+0000 7f82e93a7640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 0x7f82c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.850+0000 7f82e93a7640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 0x7f82c806c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006fd0 tx=0x7f82e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:16.853+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f82d40533d0 con 0x7f82e40ce300 2023-12-19T05:45:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.088+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82e4061910 con 0x7f82e40ce300 2023-12-19T05:45:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.089+0000 7f82d9ffb640 1 -- 172.21.15.49:0/4015760424 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82d40569f0 con 0x7f82e40ce300 2023-12-19T05:45:17.090 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 msgr2=0x7f82c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 0x7f82c806c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006fd0 tx=0x7f82e0008040 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 msgr2=0x7f82e414eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c4a0 tx=0x7f82d400c960 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 shutdown_connections 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82c806a430 0x7f82c806c8f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82e415e5a0 0x7f82e40caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e40ce300 0x7f82e414eab0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 --2- 172.21.15.49:0/4015760424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82e40b2030 0x7f82e40ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 >> 172.21.15.49:0/4015760424 conn(0x7f82e40b0100 msgr2=0x7f82e40b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 shutdown_connections 2023-12-19T05:45:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:17.092+0000 7f82ea3a9640 1 -- 172.21.15.49:0/4015760424 wait complete. 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:45:17.114 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:45:17.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.115 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:17.170 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41975sec preferred_lft 41975sec 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:45:17.171 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:45:17.172 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:17.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.173 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:45:17.268 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:45:17.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.272 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:45:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:45:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:45:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:45:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:45:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:45:17.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.330 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:45:17.330 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:45:17.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:45:17.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:45:17.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:45:17.331 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:45:17.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.540 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:45:17.594 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:45:17.594 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:45:17.595 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:45:17.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:45:17.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:45:17.696 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:45:17.751 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:45:17.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:45:17.752 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:45:17.806 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:45:17.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:17.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:17.964 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:17.964 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:45:18.006 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:45:18.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:45:18.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.093 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:45:18.166 INFO:teuthology.orchestra.run.smithi049.stdout:client5459 2023-12-19T05:45:18.166 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:18.166 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:18.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:45:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.462+0000 7f15ded7e640 1 Processor -- start 2023-12-19T05:45:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.462+0000 7f15ded7e640 1 -- start start 2023-12-19T05:45:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.464+0000 7f15ded7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15d815e3f0 0x7f15d80b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.464+0000 7f15ded7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15d80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.464+0000 7f15ded7e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d80b2fa0 con 0x7f15d80acdf0 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.464+0000 7f15ded7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d80ad280 con 0x7f15d815e3f0 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.464+0000 7f15ded7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806f600 con 0x7f15d80b2460 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15de57d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15d80acdf0 0x7f15d8160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49388/0 (socket says 172.21.15.49:49388) 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15de57d640 1 -- 172.21.15.49:0/561605580 learned_addr learned my addr 172.21.15.49:0/561605580 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dd57b640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15d80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15ddd7c640 1 --2- 172.21.15.49:0/561605580 >> v2:172.21.15.115:3300/0 conn(0x7f15d815e3f0 0x7f15d80b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142262402 0 0) 0x7f15d80b2fa0 con 0x7f15d80acdf0 2023-12-19T05:45:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c4003520 con 0x7f15d80acdf0 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671231073 0 0) 0x7f15c4003520 con 0x7f15d80acdf0 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 msgr2=0x7f15d80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15d80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 >> v2:172.21.15.115:3300/0 conn(0x7f15d815e3f0 msgr2=0x7f15d80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.465+0000 7f15dcd7a640 1 --2- 172.21.15.49:0/561605580 >> v2:172.21.15.115:3300/0 conn(0x7f15d815e3f0 0x7f15d80b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d815e7d0 con 0x7f15d80acdf0 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f15d00019f0 con 0x7f15d80acdf0 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 >> v1:172.21.15.49:6789/0 conn(0x7f15d80acdf0 legacy=0x7f15d8160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15c4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15c4003f40 0x7f15c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80ad280 con 0x7f15c4004d00 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806f600 con 0x7f15c4003f40 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c400ba30 con 0x7f15d80b2460 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15de57d640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15dd57b640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15c4003f40 0x7f15c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15ddd7c640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15c4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.466+0000 7f15de57d640 1 -- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 msgr2=0x7f15c4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.467+0000 7f15de57d640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80b2460 0x7f15c4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.467+0000 7f15de57d640 1 -- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15c4003f40 msgr2=0x7f15c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.467+0000 7f15de57d640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15c4003f40 0x7f15c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.467+0000 7f15de57d640 1 -- 172.21.15.49:0/561605580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4003520 con 0x7f15c4004d00 2023-12-19T05:45:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15de57d640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15c4005180 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f15d000a790 tx=0x7f15c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d48baa8ae8cdcbb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0034630 con 0x7f15c4004d00 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d002f070 con 0x7f15c4004d00 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15dcd7a640 1 -- 172.21.15.49:0/561605580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0034a30 con 0x7f15c4004d00 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15ded7e640 1 -- 172.21.15.49:0/561605580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 msgr2=0x7f15c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.468+0000 7f15ded7e640 1 --2- 172.21.15.49:0/561605580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15c4005180 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f15d000a790 tx=0x7f15c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.469+0000 7f15de57d640 1 -- 172.21.15.49:0/561605580 reap_dead start 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.469+0000 7f15ded7e640 1 -- 172.21.15.49:0/561605580 shutdown_connections 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.469+0000 7f15ded7e640 1 -- 172.21.15.49:0/561605580 >> 172.21.15.49:0/561605580 conn(0x7f15d80b0100 msgr2=0x7f15d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.469+0000 7f15ded7e640 1 -- 172.21.15.49:0/561605580 shutdown_connections 2023-12-19T05:45:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.469+0000 7f15ded7e640 1 -- 172.21.15.49:0/561605580 wait complete. 2023-12-19T05:45:18.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.471+0000 7f15ded7e640 1 Processor -- start 2023-12-19T05:45:18.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.471+0000 7f15ded7e640 1 -- start start 2023-12-19T05:45:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80cc7e0 0x7f15d806c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ccc60 0x7f15d806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806e130 con 0x7f15c4004d00 2023-12-19T05:45:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806dbe0 con 0x7f15d80cc7e0 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ded7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806d590 con 0x7f15d80ccc60 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ddd7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ddd7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51612/0 (socket says 172.21.15.49:51612) 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15ddd7c640 1 -- 172.21.15.49:0/954345814 learned_addr learned my addr 172.21.15.49:0/954345814 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.472+0000 7f15dd57b640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80cc7e0 0x7f15d806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15de57d640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ccc60 0x7f15d806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 -- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ccc60 msgr2=0x7f15d806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ccc60 0x7f15d806c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 -- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80cc7e0 msgr2=0x7f15d806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80cc7e0 0x7f15d806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 -- 172.21.15.49:0/954345814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d806de50 con 0x7f15c4004d00 2023-12-19T05:45:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ddd7c640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15d4011700 tx=0x7f15d4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400f9c0 con 0x7f15c4004d00 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400fb20 con 0x7f15c4004d00 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d806d870 con 0x7f15c4004d00 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.473+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400fe90 con 0x7f15c4004d00 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.474+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d81f61e0 con 0x7f15c4004d00 2023-12-19T05:45:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.475+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d8061910 con 0x7f15c4004d00 2023-12-19T05:45:18.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.476+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f15d4015460 con 0x7f15c4004d00 2023-12-19T05:45:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.476+0000 7f15ce7fc640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 0x7f15bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.477+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15d4089280 con 0x7f15c4004d00 2023-12-19T05:45:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.477+0000 7f15dd57b640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 0x7f15bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:18.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.478+0000 7f15dd57b640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 0x7f15bc06c920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15d80af9b0 tx=0x7f15c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:18.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.481+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f15d40547d0 con 0x7f15c4004d00 2023-12-19T05:45:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.719+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15d806bc90 con 0x7f15c4004d00 2023-12-19T05:45:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.720+0000 7f15ce7fc640 1 -- 172.21.15.49:0/954345814 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f15d4057df0 con 0x7f15c4004d00 2023-12-19T05:45:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:45:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.722+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 msgr2=0x7f15bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.722+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 0x7f15bc06c920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15d80af9b0 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 msgr2=0x7f15d8151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15d4011700 tx=0x7f15d4011bc0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 shutdown_connections 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15bc06a460 0x7f15bc06c920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ccc60 0x7f15d806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80cc7e0 0x7f15d806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 --2- 172.21.15.49:0/954345814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c4004d00 0x7f15d8151790 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 >> 172.21.15.49:0/954345814 conn(0x7f15d80b0100 msgr2=0x7f15d80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 shutdown_connections 2023-12-19T05:45:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:18.723+0000 7f15ded7e640 1 -- 172.21.15.49:0/954345814 wait complete. 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:45:18.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:45:18.743 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:45:18.743 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:45:18.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.743 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:45:18.803 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:45:18.803 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:45:18.804 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41991sec preferred_lft 41991sec 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:45:18.805 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.806 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:45:18.806 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:45:18.806 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:45:18.806 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:45:18.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.806 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:45:18.896 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:45:18.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.901 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:45:18.955 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:45:18.956 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:45:18.956 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:45:18.956 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:45:18.956 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:45:18.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:45:18.956 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:45:19.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:19.133 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:45:19.182 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:45:19.182 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:45:19.183 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:45:19.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:19.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:45:19.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:45:19.277 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:45:19.333 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:45:19.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:45:19.333 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:45:19.379 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:45:19.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:19.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:19.566 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:19.567 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:45:19.597 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:45:19.598 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:45:19.598 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:45:19.598 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:45:19.598 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:45:19.599 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:45:19.599 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:45:19.599 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:45:19.599 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:45:19.599 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:45:19.603 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:45:19.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:19.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:45:19.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:19.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:45:19.734 INFO:teuthology.orchestra.run.smithi115.stdout:client6945 2023-12-19T05:45:19.734 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:19.734 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:19.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:20.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.023+0000 7f7463fff640 1 Processor -- start 2023-12-19T05:45:20.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.023+0000 7f7463fff640 1 -- start start 2023-12-19T05:45:20.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f7463fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f74640b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f7463fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74640b7ea0 0x7f74640d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f7463fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640b8300 con 0x7f74640d0a90 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f7463fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7464147210 con 0x7f74640b7ea0 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f7463fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640d2370 con 0x7f7464146e30 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f74627fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74640b7ea0 0x7f74640d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f74627fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74640b7ea0 0x7f74640d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51616/0 (socket says 172.21.15.49:51616) 2023-12-19T05:45:20.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.025+0000 7f74627fc640 1 -- 172.21.15.49:0/3673964963 learned_addr learned my addr 172.21.15.49:0/3673964963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.026+0000 7f7462ffd640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f74640b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.026+0000 7f74627fc640 1 -- 172.21.15.49:0/3673964963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 msgr2=0x7f74640b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.026+0000 7f74627fc640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f74640b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.026+0000 7f74627fc640 1 -- 172.21.15.49:0/3673964963 >> v1:172.21.15.115:6789/0 conn(0x7f74640d0a90 legacy=0x7f746406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.026+0000 7f74627fc640 1 -- 172.21.15.49:0/3673964963 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640d12d0 con 0x7f74640b7ea0 2023-12-19T05:45:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.027+0000 7f74627fc640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640b7ea0 0x7f74640d0550 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f744c0098a0 tx=0x7f744c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc5f3c012f6c4f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.027+0000 7f7461ffb640 1 -- 172.21.15.49:0/3673964963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0317c0 con 0x7f74640b7ea0 2023-12-19T05:45:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.027+0000 7f7461ffb640 1 -- 172.21.15.49:0/3673964963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c031920 con 0x7f74640b7ea0 2023-12-19T05:45:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.027+0000 7f7461ffb640 1 -- 172.21.15.49:0/3673964963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c031cb0 con 0x7f74640b7ea0 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 -- 172.21.15.49:0/3673964963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640b7ea0 msgr2=0x7f74640d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640b7ea0 0x7f74640d0550 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f744c0098a0 tx=0x7f744c02b860 comp rx=0 tx=0).stop 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 -- 172.21.15.49:0/3673964963 shutdown_connections 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640b7ea0 0x7f74640d0550 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 --2- 172.21.15.49:0/3673964963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f74640b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 -- 172.21.15.49:0/3673964963 >> 172.21.15.49:0/3673964963 conn(0x7f74640b2990 msgr2=0x7f74640b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 -- 172.21.15.49:0/3673964963 shutdown_connections 2023-12-19T05:45:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.028+0000 7f7463fff640 1 -- 172.21.15.49:0/3673964963 wait complete. 2023-12-19T05:45:20.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.030+0000 7f7463fff640 1 Processor -- start 2023-12-19T05:45:20.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.030+0000 7f7463fff640 1 -- start start 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74640b7ea0 0x7f74641d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f746406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641e2120 con 0x7f74640d0a90 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641cc100 con 0x7f74640b7ea0 2023-12-19T05:45:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.031+0000 7f7463fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74641cc3e0 con 0x7f7464146e30 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51628/0 (socket says 172.21.15.49:51628) 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74627fc640 1 -- 172.21.15.49:0/2340043540 learned_addr learned my addr 172.21.15.49:0/2340043540 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74637fe640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f746406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f7462ffd640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74640b7ea0 0x7f74641d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74627fc640 1 -- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 msgr2=0x7f746406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:20.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.032+0000 7f74627fc640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f746406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.033+0000 7f74627fc640 1 -- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74640b7ea0 msgr2=0x7f74641d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:20.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.033+0000 7f74627fc640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74640b7ea0 0x7f74641d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.033+0000 7f74627fc640 1 -- 172.21.15.49:0/2340043540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0094d0 con 0x7f74640d0a90 2023-12-19T05:45:20.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.033+0000 7f74627fc640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f744c02b8a0 tx=0x7f744c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.033+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c032860 con 0x7f74640d0a90 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.034+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0329e0 con 0x7f74640d0a90 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.034+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c032d90 con 0x7f74640d0a90 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.034+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74641cc6c0 con 0x7f74640d0a90 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.034+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74641d12e0 con 0x7f74640d0a90 2023-12-19T05:45:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.035+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74641ccbe0 con 0x7f74640d0a90 2023-12-19T05:45:20.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.036+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f744c04e450 con 0x7f74640d0a90 2023-12-19T05:45:20.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.037+0000 7f745b7fe640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 0x7f744406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:20.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.037+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f744c0aa8e0 con 0x7f74640d0a90 2023-12-19T05:45:20.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.038+0000 7f7462ffd640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 0x7f744406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:20.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.039+0000 7f7462ffd640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 0x7f744406c8f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7454003b80 tx=0x7f74540098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.041+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74641ccbe0 con 0x7f74640d0a90 2023-12-19T05:45:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.276+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74641ccbe0 con 0x7f74640d0a90 2023-12-19T05:45:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.277+0000 7f745b7fe640 1 -- 172.21.15.49:0/2340043540 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f74641ccbe0 con 0x7f74640d0a90 2023-12-19T05:45:20.279 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:20.279 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:20.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 msgr2=0x7f744406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 0x7f744406c8f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7454003b80 tx=0x7f74540098d0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 msgr2=0x7f74641e1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f744c02b8a0 tx=0x7f744c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 shutdown_connections 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f744406a430 0x7f744406c8f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7464146e30 0x7f746406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74640d0a90 0x7f74641e1650 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 --2- 172.21.15.49:0/2340043540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74640b7ea0 0x7f74641d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 >> 172.21.15.49:0/2340043540 conn(0x7f74640b2990 msgr2=0x7f74640b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 shutdown_connections 2023-12-19T05:45:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:20.282+0000 7f7463fff640 1 -- 172.21.15.49:0/2340043540 wait complete. 2023-12-19T05:45:20.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:45:20.539 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.290834848999999,"mdsmap_epoch":48,"osdmap_epoch":110,"osdmap_epoch_barrier":110,"uptime":16.921830571000001} 2023-12-19T05:45:20.539 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 48, "osdmap_epoch": 110, "osdmap_epoch_barrier": 110, "rank_uptime": 11.290834849, "state": "up:active", "uptime": 16.921830571, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:45:20.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:45:20.798 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:45:20.798 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:45:20.798 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-19T05:45:20.798 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:20.798 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:20.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:20.854 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-19T05:45:22.967 INFO:teuthology.orchestra.run.smithi049.stderr:265+0 records in 2023-12-19T05:45:22.967 INFO:teuthology.orchestra.run.smithi049.stderr:265+0 records out 2023-12-19T05:45:22.967 INFO:teuthology.orchestra.run.smithi049.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.04857 s, 136 MB/s 2023-12-19T05:45:22.968 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:22.968 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:23.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:23.014 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-19T05:45:25.219 INFO:teuthology.orchestra.run.smithi049.stderr:292+0 records in 2023-12-19T05:45:25.219 INFO:teuthology.orchestra.run.smithi049.stderr:292+0 records out 2023-12-19T05:45:25.219 INFO:teuthology.orchestra.run.smithi049.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.10472 s, 145 MB/s 2023-12-19T05:45:25.220 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T05:45:25.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.424+0000 7f0ed9c5f640 1 Processor -- start 2023-12-19T05:45:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.425+0000 7f0ed9c5f640 1 -- start start 2023-12-19T05:45:25.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 0x7f0ed415da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed4143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ed40b63c0 0x7f0ed40b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed415df70 con 0x7f0ed40b63c0 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed415e1a0 con 0x7f0ed4161020 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.426+0000 7f0ed9c5f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415e480 con 0x7f0ed4143230 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ed40b63c0 0x7f0ed40b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ed40b63c0 0x7f0ed40b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41778/0 (socket says 172.21.15.49:41778) 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 -- 172.21.15.49:0/2792606455 learned_addr learned my addr 172.21.15.49:0/2792606455 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed2ffd640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed4143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 -- 172.21.15.49:0/2792606455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 msgr2=0x7f0ed4143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed37fe640 1 --2- 172.21.15.49:0/2792606455 >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 0x7f0ed415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed4143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 -- 172.21.15.49:0/2792606455 >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 msgr2=0x7f0ed415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 --2- 172.21.15.49:0/2792606455 >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 0x7f0ed415da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed3fff640 1 -- 172.21.15.49:0/2792606455 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed415e760 con 0x7f0ed40b63c0 2023-12-19T05:45:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed2ffd640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed4143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.427+0000 7f0ed37fe640 1 --2- 172.21.15.49:0/2792606455 >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 0x7f0ed415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.428+0000 7f0ed3fff640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed40b67f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b5ed0 tx=0x7f0ecc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08d135d39b2f22b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed27fc640 1 -- 172.21.15.49:0/2792606455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc02ca70 con 0x7f0ed40b63c0 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed27fc640 1 -- 172.21.15.49:0/2792606455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc02cbd0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed27fc640 1 -- 172.21.15.49:0/2792606455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0343f0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/2792606455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 msgr2=0x7f0ed40b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed40b67f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b5ed0 tx=0x7f0ecc02bed0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/2792606455 shutdown_connections 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed40b67f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/2792606455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed4143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/2792606455 >> v2:172.21.15.115:3300/0 conn(0x7f0ed4161020 0x7f0ed415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.429+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/2792606455 >> 172.21.15.49:0/2792606455 conn(0x7f0ed40b26f0 msgr2=0x7f0ed40b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.430+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/2792606455 shutdown_connections 2023-12-19T05:45:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.430+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/2792606455 wait complete. 2023-12-19T05:45:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.431+0000 7f0ed9c5f640 1 Processor -- start 2023-12-19T05:45:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.432+0000 7f0ed9c5f640 1 -- start start 2023-12-19T05:45:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.432+0000 7f0ed9c5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed9c5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed41553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed9c5f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed4161020 0x7f0ed41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed9c5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415cfb0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed9c5f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415d530 con 0x7f0ed4161020 2023-12-19T05:45:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed9c5f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415d250 con 0x7f0ed4143230 2023-12-19T05:45:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41790/0 (socket says 172.21.15.49:41790) 2023-12-19T05:45:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 -- 172.21.15.49:0/1322270220 learned_addr learned my addr 172.21.15.49:0/1322270220 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 -- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 msgr2=0x7f0ed41553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed41553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 -- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed4161020 msgr2=0x7f0ed41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed4161020 0x7f0ed41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.433+0000 7f0ed37fe640 1 -- 172.21.15.49:0/1322270220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009b30 con 0x7f0ed40b63c0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ed37fe640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c7f0 tx=0x7f0ec400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007820 con 0x7f0ed40b63c0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4007980 con 0x7f0ed40b63c0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007cf0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4154bb0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.434+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4158f30 con 0x7f0ed40b63c0 2023-12-19T05:45:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.435+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4061910 con 0x7f0ed40b63c0 2023-12-19T05:45:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.436+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ec40113f0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.437+0000 7f0ebbfff640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 0x7f0ec006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:25.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.437+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec4088bf0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.438+0000 7f0ed2ffd640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 0x7f0ec006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.439+0000 7f0ed2ffd640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 0x7f0ec006c920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006b10 tx=0x7f0ec8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.442+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ec40541d0 con 0x7f0ed40b63c0 2023-12-19T05:45:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.640+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0ed4070820 con 0x7f0ed40b63c0 2023-12-19T05:45:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.644+0000 7f0ebbfff640 1 -- 172.21.15.49:0/1322270220 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+33550 (secure 0 0 0) 0x7f0ec401f090 con 0x7f0ed40b63c0 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 110, 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:10.230673+0000", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "97", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "109", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "110", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:25.741 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 msgr2=0x7f0ec006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 0x7f0ec006c920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006b10 tx=0x7f0ec8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 msgr2=0x7f0ed41589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c7f0 tx=0x7f0ec400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 shutdown_connections 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ec006a460 0x7f0ec006c920 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed4143230 0x7f0ed41553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed4161020 0x7f0ed41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 --2- 172.21.15.49:0/1322270220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed40b63c0 0x7f0ed41589f0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 >> 172.21.15.49:0/1322270220 conn(0x7f0ed40b26f0 msgr2=0x7f0ed413fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.647+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 shutdown_connections 2023-12-19T05:45:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:25.648+0000 7f0ed9c5f640 1 -- 172.21.15.49:0/1322270220 wait complete. 2023-12-19T05:45:25.744 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:45:27.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:27.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:27.343 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:45:27.341+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-19T05:45:30.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.986+0000 7f9fdbce5640 1 Processor -- start 2023-12-19T05:45:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.986+0000 7f9fdbce5640 1 -- start start 2023-12-19T05:45:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.988+0000 7f9fdbce5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fd4157bf0 0x7f9fd415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.988+0000 7f9fdbce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.988+0000 7f9fdbce5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd40b0a90 con 0x7f9fd40b0640 2023-12-19T05:45:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.988+0000 7f9fdbce5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd406b8c0 con 0x7f9fd4157bf0 2023-12-19T05:45:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.988+0000 7f9fdbce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd415b740 con 0x7f9fd40ae110 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.989+0000 7f9fd9280640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.989+0000 7f9fd9280640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:40646/0 (socket says 172.21.15.49:40646) 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.989+0000 7f9fd9280640 1 -- 172.21.15.49:0/2100669081 learned_addr learned my addr 172.21.15.49:0/2100669081 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.989+0000 7f9fd9a81640 1 --2- 172.21.15.49:0/2100669081 >> v2:172.21.15.115:3300/0 conn(0x7f9fd4157bf0 0x7f9fd415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.990+0000 7f9fd9280640 1 -- 172.21.15.49:0/2100669081 >> v2:172.21.15.115:3300/0 conn(0x7f9fd4157bf0 msgr2=0x7f9fd415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.990+0000 7f9fd9280640 1 --2- 172.21.15.49:0/2100669081 >> v2:172.21.15.115:3300/0 conn(0x7f9fd4157bf0 0x7f9fd415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.990+0000 7f9fd9280640 1 -- 172.21.15.49:0/2100669081 >> v1:172.21.15.115:6789/0 conn(0x7f9fd40b0640 legacy=0x7f9fd415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.990+0000 7f9fd9280640 1 -- 172.21.15.49:0/2100669081 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40ae640 con 0x7f9fd40ae110 2023-12-19T05:45:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.991+0000 7f9fd9280640 1 --2- 172.21.15.49:0/2100669081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009870 tx=0x7f9fc402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9856345025e6025 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.991+0000 7f9fd8a7f640 1 -- 172.21.15.49:0/2100669081 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4030840 con 0x7f9fd40ae110 2023-12-19T05:45:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fd8a7f640 1 -- 172.21.15.49:0/2100669081 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc40309a0 con 0x7f9fd40ae110 2023-12-19T05:45:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fd8a7f640 1 -- 172.21.15.49:0/2100669081 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4030d30 con 0x7f9fd40ae110 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 -- 172.21.15.49:0/2100669081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 msgr2=0x7f9fd40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/2100669081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009870 tx=0x7f9fc402b980 comp rx=0 tx=0).stop 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 -- 172.21.15.49:0/2100669081 shutdown_connections 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/2100669081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40ae110 0x7f9fd40b0100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/2100669081 >> v2:172.21.15.115:3300/0 conn(0x7f9fd4157bf0 0x7f9fd415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 -- 172.21.15.49:0/2100669081 >> 172.21.15.49:0/2100669081 conn(0x7f9fd40cbb70 msgr2=0x7f9fd40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.992+0000 7f9fdbce5640 1 -- 172.21.15.49:0/2100669081 shutdown_connections 2023-12-19T05:45:30.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.993+0000 7f9fdbce5640 1 -- 172.21.15.49:0/2100669081 wait complete. 2023-12-19T05:45:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.995+0000 7f9fdbce5640 1 Processor -- start 2023-12-19T05:45:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.995+0000 7f9fdbce5640 1 -- start start 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd40ae110 0x7f9fd40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40b0640 0x7f9fd40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40ca9e0 con 0x7f9fd4157bf0 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40aa990 con 0x7f9fd40ae110 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.996+0000 7f9fdbce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41f0c60 con 0x7f9fd40b0640 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:30.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41794/0 (socket says 172.21.15.49:41794) 2023-12-19T05:45:31.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 -- 172.21.15.49:0/3188824451 learned_addr learned my addr 172.21.15.49:0/3188824451 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:31.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fd9a81640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd40ae110 0x7f9fd40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:31.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fd9280640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40b0640 0x7f9fd40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:31.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 -- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40b0640 msgr2=0x7f9fd40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:31.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40b0640 0x7f9fd40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 -- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd40ae110 msgr2=0x7f9fd40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd40ae110 0x7f9fd40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.997+0000 7f9fda282640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40094d0 con 0x7f9fd4157bf0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fda282640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00c7a0 tx=0x7f9fcc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc003b70 con 0x7f9fd4157bf0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc003cf0 con 0x7f9fd4157bf0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc003ea0 con 0x7f9fd4157bf0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd41f0f40 con 0x7f9fd4157bf0 2023-12-19T05:45:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.998+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd41f1500 con 0x7f9fd4157bf0 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:30.999+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd415b8b0 con 0x7f9fd4157bf0 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.000+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fcc00aa90 con 0x7f9fd4157bf0 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.001+0000 7f9fca7fc640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 0x7f9fb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.001+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fcc088460 con 0x7f9fd4157bf0 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.002+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f9fb8071f60 con 0x7f9fd4157bf0 2023-12-19T05:45:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.002+0000 7f9fd9a81640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 0x7f9fb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.003+0000 7f9fd9a81640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 0x7f9fb806c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009aa0 tx=0x7f9fd0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.006+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fd415b8b0 con 0x7f9fd4157bf0 2023-12-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.205+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9fd40b0a90 con 0x7f9fd4157bf0 2023-12-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.207+0000 7f9fca7fc640 1 -- 172.21.15.49:0/3188824451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+33726 (secure 0 0 0) 0x7f9fd40b0a90 con 0x7f9fd4157bf0 2023-12-19T05:45:31.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:31.211 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:31.211 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 113, 2023-12-19T05:45:31.211 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:31.211 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:29.400062+0000", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:31.216 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:31.218 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:31.220 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.221 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:31.222 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:31.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:31.224 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:31.225 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:31.227 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:31.228 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:31.229 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:31.230 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:31.231 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.232 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.238 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:31.240 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:45:31.242 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.243 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.244 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.245 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.246 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:31.247 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.248 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:31.249 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.251 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:31.252 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.253 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.254 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.255 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:31.258 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.259 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:31.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:31.264 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.265 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.266 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.267 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:31.270 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.271 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.273 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.274 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:31.275 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.276 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.278 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:31.279 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.280 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:31.281 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:31.282 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:31.283 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:31.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:31.284 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:31.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 msgr2=0x7f9fb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:31.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 0x7f9fb806c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009aa0 tx=0x7f9fd0009190 comp rx=0 tx=0).stop 2023-12-19T05:45:31.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 msgr2=0x7f9fd40ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00c7a0 tx=0x7f9fcc00cc60 comp rx=0 tx=0).stop 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 shutdown_connections 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fb806a430 0x7f9fb806c8f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fd40b0640 0x7f9fd40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd4157bf0 0x7f9fd40ccc20 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 --2- 172.21.15.49:0/3188824451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd40ae110 0x7f9fd40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 >> 172.21.15.49:0/3188824451 conn(0x7f9fd40cbb70 msgr2=0x7f9fd40cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 shutdown_connections 2023-12-19T05:45:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:31.210+0000 7f9fdbce5640 1 -- 172.21.15.49:0/3188824451 wait complete. 2023-12-19T05:45:31.287 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T05:45:31.287 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:31.287 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:31.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:31.351 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-19T05:45:31.785 INFO:teuthology.orchestra.run.smithi049.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T05:45:31.785 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:45:31.785 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:45:31.785 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.358788 s, 146 MB/s 2023-12-19T05:45:31.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:45:31.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.005+0000 7f5652595640 1 Processor -- start 2023-12-19T05:45:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.005+0000 7f5652595640 1 -- start start 2023-12-19T05:45:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f564c146e10 0x7f564c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f564c0d2b00 0x7f564c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 0x7f564c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c0d2430 con 0x7f564c146e10 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c0ceac0 con 0x7f564c0d2b00 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f5652595640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0cd840 con 0x7f564c0ce110 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f564bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f564c146e10 0x7f564c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f564bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f564c146e10 0x7f564c0d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41802/0 (socket says 172.21.15.49:41802) 2023-12-19T05:45:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.007+0000 7f564bfff640 1 -- 172.21.15.49:0/3665989417 learned_addr learned my addr 172.21.15.49:0/3665989417 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f5650b32640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 0x7f564c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564bfff640 1 -- 172.21.15.49:0/3665989417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 msgr2=0x7f564c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564b7fe640 1 --2- 172.21.15.49:0/3665989417 >> v2:172.21.15.115:3300/0 conn(0x7f564c0d2b00 0x7f564c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564bfff640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 0x7f564c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564bfff640 1 -- 172.21.15.49:0/3665989417 >> v2:172.21.15.115:3300/0 conn(0x7f564c0d2b00 msgr2=0x7f564c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564bfff640 1 --2- 172.21.15.49:0/3665989417 >> v2:172.21.15.115:3300/0 conn(0x7f564c0d2b00 0x7f564c0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f564bfff640 1 -- 172.21.15.49:0/3665989417 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0d2620 con 0x7f564c146e10 2023-12-19T05:45:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.008+0000 7f5650b32640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 0x7f564c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.009+0000 7f564bfff640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c146e10 0x7f564c0d1ef0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f564c0d3360 tx=0x7f563c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57313bcae5d589b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.009+0000 7f564affd640 1 -- 172.21.15.49:0/3665989417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c031640 con 0x7f564c146e10 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.009+0000 7f564affd640 1 -- 172.21.15.49:0/3665989417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c0317a0 con 0x7f564c146e10 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.009+0000 7f564affd640 1 -- 172.21.15.49:0/3665989417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c031b30 con 0x7f564c146e10 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 -- 172.21.15.49:0/3665989417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c146e10 msgr2=0x7f564c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c146e10 0x7f564c0d1ef0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f564c0d3360 tx=0x7f563c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 -- 172.21.15.49:0/3665989417 shutdown_connections 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c0ce110 0x7f564c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 --2- 172.21.15.49:0/3665989417 >> v2:172.21.15.115:3300/0 conn(0x7f564c0d2b00 0x7f564c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 --2- 172.21.15.49:0/3665989417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c146e10 0x7f564c0d1ef0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 -- 172.21.15.49:0/3665989417 >> 172.21.15.49:0/3665989417 conn(0x7f564c0b29c0 msgr2=0x7f564c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 -- 172.21.15.49:0/3665989417 shutdown_connections 2023-12-19T05:45:32.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.010+0000 7f5652595640 1 -- 172.21.15.49:0/3665989417 wait complete. 2023-12-19T05:45:32.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.012+0000 7f5652595640 1 Processor -- start 2023-12-19T05:45:32.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.012+0000 7f5652595640 1 -- start start 2023-12-19T05:45:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 0x7f564c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 0x7f564c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c1f6850 con 0x7f564c0d2b00 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c14f220 con 0x7f564c0ce110 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f5652595640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c1f5eb0 con 0x7f564c146e10 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.013+0000 7f564b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41808/0 (socket says 172.21.15.49:41808) 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 -- 172.21.15.49:0/1231465345 learned_addr learned my addr 172.21.15.49:0/1231465345 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564bfff640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 0x7f564c06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 -- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 msgr2=0x7f564c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f5650b32640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 0x7f564c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 0x7f564c0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 -- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 msgr2=0x7f564c06f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 0x7f564c06f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0094d0 con 0x7f564c0d2b00 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564bfff640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 0x7f564c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f5650b32640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 0x7f564c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.014+0000 7f564b7fe640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f564000c7f0 tx=0x7f564000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.015+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640004220 con 0x7f564c0d2b00 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.015+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400043a0 con 0x7f564c0d2b00 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.015+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c1f6190 con 0x7f564c0d2b00 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.015+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640007860 con 0x7f564c0d2b00 2023-12-19T05:45:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.015+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c1f6c70 con 0x7f564c0d2b00 2023-12-19T05:45:32.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.016+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c1f6990 con 0x7f564c0d2b00 2023-12-19T05:45:32.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.017+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5640007bd0 con 0x7f564c0d2b00 2023-12-19T05:45:32.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.018+0000 7f5648ff9640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 0x7f563806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.018+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5640088900 con 0x7f564c0d2b00 2023-12-19T05:45:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.018+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f5638071f60 con 0x7f564c0d2b00 2023-12-19T05:45:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.019+0000 7f564bfff640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 0x7f563806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.020+0000 7f564bfff640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 0x7f563806c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f563c036000 tx=0x7f563c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.022+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f564001e020 con 0x7f564c0d2b00 2023-12-19T05:45:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.215+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f564c061910 con 0x7f564c0d2b00 2023-12-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.218+0000 7f5648ff9640 1 -- 172.21.15.49:0/1231465345 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+33726 (secure 0 0 0) 0x7f564c1f6990 con 0x7f564c0d2b00 2023-12-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 113, 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:29.400062+0000", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:32.222 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:32.225 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:32.231 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.233 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:32.234 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:32.235 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:32.236 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:32.238 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:32.239 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.240 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:32.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.243 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.246 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.247 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:32.248 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:32.249 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.250 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.251 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.254 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.269 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.270 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.272 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:32.274 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.275 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.276 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:32.278 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.281 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:32.283 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:32.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:32.290 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.294 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:32.297 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.300 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:32.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:32.303 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:32.304 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.220+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 msgr2=0x7f563806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.220+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 0x7f563806c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f563c036000 tx=0x7f563c03c040 comp rx=0 tx=0).stop 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.220+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 msgr2=0x7f564c0ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.220+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f564000c7f0 tx=0x7f564000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 shutdown_connections 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f563806a430 0x7f563806c8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564c146e10 0x7f564c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564c0d2b00 0x7f564c0ca130 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 --2- 172.21.15.49:0/1231465345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564c0ce110 0x7f564c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 >> 172.21.15.49:0/1231465345 conn(0x7f564c0b29c0 msgr2=0x7f564c0b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 shutdown_connections 2023-12-19T05:45:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.221+0000 7f5652595640 1 -- 172.21.15.49:0/1231465345 wait complete. 2023-12-19T05:45:32.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.542+0000 7fe630631640 1 Processor -- start 2023-12-19T05:45:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.543+0000 7fe630631640 1 -- start start 2023-12-19T05:45:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.544+0000 7fe630631640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe6280d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe630631640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6280ce110 0x7fe6280ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe630631640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280cd840 con 0x7fe628146e10 2023-12-19T05:45:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe630631640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280d2430 con 0x7fe6280ce110 2023-12-19T05:45:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe630631640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280ceae0 con 0x7fe6280d2b00 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe62e3cd640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe628146e10 0x7fe6280b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:41136/0 (socket says 172.21.15.49:41136) 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe62e3cd640 1 -- 172.21.15.49:0/3122389057 learned_addr learned my addr 172.21.15.49:0/3122389057 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.545+0000 7fe62dbcc640 1 --2- 172.21.15.49:0/3122389057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe6280d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62ebce640 1 --2- 172.21.15.49:0/3122389057 >> v2:172.21.15.115:3300/0 conn(0x7fe6280ce110 0x7fe6280ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62dbcc640 1 -- 172.21.15.49:0/3122389057 >> v2:172.21.15.115:3300/0 conn(0x7fe6280ce110 msgr2=0x7fe6280ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62dbcc640 1 --2- 172.21.15.49:0/3122389057 >> v2:172.21.15.115:3300/0 conn(0x7fe6280ce110 0x7fe6280ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62dbcc640 1 -- 172.21.15.49:0/3122389057 >> v1:172.21.15.115:6789/0 conn(0x7fe628146e10 legacy=0x7fe6280b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62dbcc640 1 -- 172.21.15.49:0/3122389057 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280b6e90 con 0x7fe6280d2b00 2023-12-19T05:45:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.546+0000 7fe62d3cb640 1 -- 172.21.15.49:0/3122389057 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772104858 0 0) 0x7fe6280cd840 con 0x7fe628146e10 2023-12-19T05:45:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.548+0000 7fe62dbcc640 1 --2- 172.21.15.49:0/3122389057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe6280d1ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6240097a0 tx=0x7fe62402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f863bea6d780bed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.548+0000 7fe62d3cb640 1 -- 172.21.15.49:0/3122389057 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624031830 con 0x7fe6280d2b00 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.548+0000 7fe62d3cb640 1 -- 172.21.15.49:0/3122389057 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe624031990 con 0x7fe6280d2b00 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.548+0000 7fe62d3cb640 1 -- 172.21.15.49:0/3122389057 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624031d20 con 0x7fe6280d2b00 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 -- 172.21.15.49:0/3122389057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 msgr2=0x7fe6280d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 --2- 172.21.15.49:0/3122389057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe6280d1ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6240097a0 tx=0x7fe62402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 -- 172.21.15.49:0/3122389057 shutdown_connections 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 --2- 172.21.15.49:0/3122389057 >> v2:172.21.15.115:3300/0 conn(0x7fe6280ce110 0x7fe6280ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 --2- 172.21.15.49:0/3122389057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe6280d1ef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 -- 172.21.15.49:0/3122389057 >> 172.21.15.49:0/3122389057 conn(0x7fe6280b29c0 msgr2=0x7fe6280b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 -- 172.21.15.49:0/3122389057 shutdown_connections 2023-12-19T05:45:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.549+0000 7fe630631640 1 -- 172.21.15.49:0/3122389057 wait complete. 2023-12-19T05:45:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.551+0000 7fe630631640 1 Processor -- start 2023-12-19T05:45:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.551+0000 7fe630631640 1 -- start start 2023-12-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6280ce110 0x7fe62813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe62814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814e500 con 0x7fe628146e10 2023-12-19T05:45:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814df40 con 0x7fe6280ce110 2023-12-19T05:45:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe630631640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814e220 con 0x7fe6280d2b00 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe62ebce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe62ebce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41824/0 (socket says 172.21.15.49:41824) 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe62ebce640 1 -- 172.21.15.49:0/1978949837 learned_addr learned my addr 172.21.15.49:0/1978949837 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.552+0000 7fe62dbcc640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe62814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62e3cd640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6280ce110 0x7fe62813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 -- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 msgr2=0x7fe62814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe62814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 -- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6280ce110 msgr2=0x7fe62813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6280ce110 0x7fe62813cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624009400 con 0x7fe628146e10 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe62ebce640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620009ba0 con 0x7fe628146e10 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000f040 con 0x7fe628146e10 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200146c0 con 0x7fe628146e10 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.553+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62814b600 con 0x7fe628146e10 2023-12-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.554+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62813d220 con 0x7fe628146e10 2023-12-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.555+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe628061910 con 0x7fe628146e10 2023-12-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.556+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe620014820 con 0x7fe628146e10 2023-12-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.557+0000 7fe61affd640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 0x7fe60c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.557+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe620089380 con 0x7fe628146e10 2023-12-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.557+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7fe60c071f90 con 0x7fe628146e10 2023-12-19T05:45:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.557+0000 7fe62e3cd640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 0x7fe60c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.558+0000 7fe62e3cd640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 0x7fe60c06c920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe61c000f60 tx=0x7fe61c007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.561+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe620054a00 con 0x7fe628146e10 2023-12-19T05:45:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.796+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe628146430 con 0x7fe628146e10 2023-12-19T05:45:32.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.798+0000 7fe61affd640 1 -- 172.21.15.49:0/1978949837 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fe620018070 con 0x7fe628146e10 2023-12-19T05:45:32.801 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:32.801 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.800+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 msgr2=0x7fe60c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.800+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 0x7fe60c06c920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe61c000f60 tx=0x7fe61c007b50 comp rx=0 tx=0).stop 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.800+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 msgr2=0x7fe62806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.800+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c490 comp rx=0 tx=0).stop 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 shutdown_connections 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60c06a460 0x7fe60c06c920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6280d2b00 0x7fe62814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe628146e10 0x7fe62806fe80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 --2- 172.21.15.49:0/1978949837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6280ce110 0x7fe62813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 >> 172.21.15.49:0/1978949837 conn(0x7fe6280b29c0 msgr2=0x7fe6280b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 shutdown_connections 2023-12-19T05:45:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:32.801+0000 7fe630631640 1 -- 172.21.15.49:0/1978949837 wait complete. 2023-12-19T05:45:32.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:45:33.061 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.812904641999999,"mdsmap_epoch":48,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":29.443886557999999} 2023-12-19T05:45:33.062 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 48, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 23.812904642, "state": "up:active", "uptime": 29.443886558, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:45:33.062 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:45:33.062 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:33.062 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:33.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:33.128 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-19T05:45:33.188 INFO:teuthology.orchestra.run.smithi049.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-19T05:45:33.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:45:33.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:33.190 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T05:45:33.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:33.255 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T05:45:33.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.615+0000 7f7b0c9ef640 1 Processor -- start 2023-12-19T05:45:33.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.615+0000 7f7b0c9ef640 1 -- start start 2023-12-19T05:45:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b0c9ef640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b080b2030 0x7f7b0815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b0c9ef640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b080cdbf0 0x7f7b080ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b0c9ef640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0815ec30 con 0x7f7b0815e5a0 2023-12-19T05:45:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b0c9ef640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0815fbc0 con 0x7f7b080cdbf0 2023-12-19T05:45:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b0c9ef640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080ce560 con 0x7f7b080b2030 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b07fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b080cdbf0 0x7f7b080ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b077fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b0815e5a0 0x7f7b080b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54450/0 (socket says 172.21.15.49:54450) 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b077fe640 1 -- 172.21.15.49:0/3799500103 learned_addr learned my addr 172.21.15.49:0/3799500103 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7afffff640 1 --2- 172.21.15.49:0/3799500103 >> v2:172.21.15.115:3300/0 conn(0x7f7b080b2030 0x7f7b0815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b07fff640 1 -- 172.21.15.49:0/3799500103 >> v2:172.21.15.115:3300/0 conn(0x7f7b080b2030 msgr2=0x7f7b0815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b07fff640 1 --2- 172.21.15.49:0/3799500103 >> v2:172.21.15.115:3300/0 conn(0x7f7b080b2030 0x7f7b0815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b07fff640 1 -- 172.21.15.49:0/3799500103 >> v1:172.21.15.49:6789/0 conn(0x7f7b0815e5a0 legacy=0x7f7b080b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.617+0000 7f7b07fff640 1 -- 172.21.15.49:0/3799500103 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0815e980 con 0x7f7b080cdbf0 2023-12-19T05:45:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.618+0000 7f7b07fff640 1 --2- 172.21.15.49:0/3799500103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b080cdbf0 0x7f7b080ce020 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009d90 tx=0x7f7b0002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d09508328e6fd23 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b06ffd640 1 -- 172.21.15.49:0/3799500103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0002cc60 con 0x7f7b080cdbf0 2023-12-19T05:45:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b06ffd640 1 -- 172.21.15.49:0/3799500103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0002cdc0 con 0x7f7b080cdbf0 2023-12-19T05:45:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b06ffd640 1 -- 172.21.15.49:0/3799500103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00034660 con 0x7f7b080cdbf0 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/3799500103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b080cdbf0 msgr2=0x7f7b080ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/3799500103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b080cdbf0 0x7f7b080ce020 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009d90 tx=0x7f7b0002beb0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/3799500103 shutdown_connections 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/3799500103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b080cdbf0 0x7f7b080ce020 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/3799500103 >> v2:172.21.15.115:3300/0 conn(0x7f7b080b2030 0x7f7b0815f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.619+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/3799500103 >> 172.21.15.49:0/3799500103 conn(0x7f7b080b0100 msgr2=0x7f7b080b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.620+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/3799500103 shutdown_connections 2023-12-19T05:45:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.620+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/3799500103 wait complete. 2023-12-19T05:45:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.622+0000 7f7b0c9ef640 1 Processor -- start 2023-12-19T05:45:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 -- start start 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b080b2030 0x7f7b08155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b080cdbf0 0x7f7b081f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081561f0 con 0x7f7b0815e5a0 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081f3b40 con 0x7f7b080b2030 2023-12-19T05:45:33.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b0c9ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081f3580 con 0x7f7b080cdbf0 2023-12-19T05:45:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41836/0 (socket says 172.21.15.49:41836) 2023-12-19T05:45:33.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 -- 172.21.15.49:0/2615935041 learned_addr learned my addr 172.21.15.49:0/2615935041 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 -- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b080cdbf0 msgr2=0x7f7b081f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b080cdbf0 0x7f7b081f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 -- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b080b2030 msgr2=0x7f7b08155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b080b2030 0x7f7b08155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.623+0000 7f7b07fff640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009a70 con 0x7f7b0815e5a0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b07fff640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009d90 tx=0x7f7b00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00040650 con 0x7f7b0815e5a0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b000407d0 con 0x7f7b0815e5a0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00040b80 con 0x7f7b0815e5a0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b081f3860 con 0x7f7b0815e5a0 2023-12-19T05:45:33.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.625+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b081f40c0 con 0x7f7b0815e5a0 2023-12-19T05:45:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.626+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08061910 con 0x7f7b0815e5a0 2023-12-19T05:45:33.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.626+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b00040ce0 con 0x7f7b0815e5a0 2023-12-19T05:45:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.628+0000 7f7b04ff9640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 0x7f7ae806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.628+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b000ab830 con 0x7f7b0815e5a0 2023-12-19T05:45:33.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.628+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=115}) v3 -- 0x7f7ae8071f60 con 0x7f7b0815e5a0 2023-12-19T05:45:33.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.628+0000 7f7b077fe640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 0x7f7ae806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:33.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.629+0000 7f7b077fe640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 0x7f7ae806c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7af80015f0 tx=0x7f7af8007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:33.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.633+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7b00076d80 con 0x7f7b0815e5a0 2023-12-19T05:45:33.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.828+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7b080ce980 con 0x7f7b0815e5a0 2023-12-19T05:45:33.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.832+0000 7f7b04ff9640 1 -- 172.21.15.49:0/2615935041 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v114) v1 ==== 81+0+33694 (secure 0 0 0) 0x7f7b00044090 con 0x7f7b0815e5a0 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 114, 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:33.430511+0000", 2023-12-19T05:45:33.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:33.835 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:33.837 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:33.839 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:33.840 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:33.841 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:33.843 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:33.844 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:33.845 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:33.846 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:33.847 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:33.848 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 3, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full", 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:33.849 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "111", 2023-12-19T05:45:33.850 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:33.851 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:33.852 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:33.853 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.855 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.857 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.858 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.859 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.860 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.861 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.864 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:33.865 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull", 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.866 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.867 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.868 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.872 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.873 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.875 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.876 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.877 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:33.878 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.878 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.878 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.880 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.881 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.883 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.885 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:33.886 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:33.887 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:33.889 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.890 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.891 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.893 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.894 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:33.895 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:33.896 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.897 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.899 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.900 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "full", 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:33.901 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.902 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.903 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.905 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:33.906 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:33.907 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.908 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:33.909 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.834+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 msgr2=0x7f7ae806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.834+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 0x7f7ae806c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7af80015f0 tx=0x7f7af8007a40 comp rx=0 tx=0).stop 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.834+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 msgr2=0x7f7b0815adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.834+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009d90 tx=0x7f7b00004a40 comp rx=0 tx=0).stop 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 shutdown_connections 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ae806a430 0x7f7ae806c8f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b080cdbf0 0x7f7b081f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b0815e5a0 0x7f7b0815adb0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 --2- 172.21.15.49:0/2615935041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b080b2030 0x7f7b08155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 >> 172.21.15.49:0/2615935041 conn(0x7f7b080b0100 msgr2=0x7f7b080b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 shutdown_connections 2023-12-19T05:45:33.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:33.835+0000 7f7b0c9ef640 1 -- 172.21.15.49:0/2615935041 wait complete. 2023-12-19T05:45:33.912 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:45:35.301 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:45:35.300+0000 7f9987548640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-19T05:45:38.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.157+0000 7efe50007640 1 Processor -- start 2023-12-19T05:45:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.158+0000 7efe50007640 1 -- start start 2023-12-19T05:45:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe50007640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe4806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe50007640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4806bb30 con 0x7efe481449e0 2023-12-19T05:45:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe50007640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe480b0070 con 0x7efe4806b590 2023-12-19T05:45:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe50007640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe480b0350 con 0x7efe480b0b50 2023-12-19T05:45:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe4dda3640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efe481449e0 0x7efe480af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50738/0 (socket says 172.21.15.49:50738) 2023-12-19T05:45:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.159+0000 7efe4dda3640 1 -- 172.21.15.49:0/3582065654 learned_addr learned my addr 172.21.15.49:0/3582065654 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe4806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298718164 0 0) 0x7efe4806bb30 con 0x7efe481449e0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe34003520 con 0x7efe481449e0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 367688024 0 0) 0x7efe34003520 con 0x7efe481449e0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 msgr2=0x7efe4806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe4806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 >> v1:172.21.15.115:6789/0 conn(0x7efe4806b590 legacy=0x7efe480b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480b0630 con 0x7efe481449e0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7efe44001670 con 0x7efe481449e0 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 >> v1:172.21.15.49:6789/0 conn(0x7efe481449e0 legacy=0x7efe480af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe34003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe34003fe0 0x7efe340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34004d00 0x7efe34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480b0350 con 0x7efe34003fe0 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3400bb40 con 0x7efe34004d00 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.160+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3400bd00 con 0x7efe480b0b50 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe34003fe0 0x7efe340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4dda3640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe34003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4e5a4640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34004d00 0x7efe34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 -- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 msgr2=0x7efe34003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe480b0b50 0x7efe34003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 -- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34004d00 msgr2=0x7efe34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34004d00 0x7efe34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4d5a2640 1 -- 172.21.15.49:0/3582065654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34003520 con 0x7efe34003fe0 2023-12-19T05:45:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.161+0000 7efe4e5a4640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34004d00 0x7efe34005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:39.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.162+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe34003fe0 0x7efe340047c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7efe38009ac0 tx=0x7efe340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891d84313d2fa15a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3802c6b0 con 0x7efe34003fe0 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3802c810 con 0x7efe34003fe0 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe4cda1640 1 -- 172.21.15.49:0/3582065654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3802cba0 con 0x7efe34003fe0 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 -- 172.21.15.49:0/3582065654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe34003fe0 msgr2=0x7efe340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 --2- 172.21.15.49:0/3582065654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe34003fe0 0x7efe340047c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7efe38009ac0 tx=0x7efe340057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe4e5a4640 1 -- 172.21.15.49:0/3582065654 reap_dead start 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 -- 172.21.15.49:0/3582065654 shutdown_connections 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 -- 172.21.15.49:0/3582065654 >> 172.21.15.49:0/3582065654 conn(0x7efe480cbb70 msgr2=0x7efe480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 -- 172.21.15.49:0/3582065654 shutdown_connections 2023-12-19T05:45:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.163+0000 7efe50007640 1 -- 172.21.15.49:0/3582065654 wait complete. 2023-12-19T05:45:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.165+0000 7efe50007640 1 Processor -- start 2023-12-19T05:45:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.165+0000 7efe50007640 1 -- start start 2023-12-19T05:45:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.166+0000 7efe50007640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe34003fe0 0x7efe481f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.166+0000 7efe50007640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe50007640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe48152750 0x7efe48152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe50007640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe48142070 con 0x7efe48143e30 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe50007640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe481f68a0 con 0x7efe48152750 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe50007640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe481f6b80 con 0x7efe34003fe0 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41336/0 (socket says 172.21.15.49:41336) 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 -- 172.21.15.49:0/2893984286 learned_addr learned my addr 172.21.15.49:0/2893984286 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4dda3640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe34003fe0 0x7efe481f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 -- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe34003fe0 msgr2=0x7efe481f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe34003fe0 0x7efe481f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 -- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe48152750 msgr2=0x7efe48152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4e5a4640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe48152750 0x7efe48152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe48152750 0x7efe48152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.167+0000 7efe4d5a2640 1 -- 172.21.15.49:0/2893984286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe481422e0 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe4d5a2640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7efe3802c250 tx=0x7efe38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38003810 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38003970 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe48142070 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38003ce0 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.168+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe481f6e60 con 0x7efe48143e30 2023-12-19T05:45:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.169+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48142470 con 0x7efe48143e30 2023-12-19T05:45:39.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.170+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe38034440 con 0x7efe48143e30 2023-12-19T05:45:39.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.171+0000 7efe3e7fc640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 0x7efe2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.171+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe380aac80 con 0x7efe48143e30 2023-12-19T05:45:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.172+0000 7efe4dda3640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 0x7efe2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.173+0000 7efe4dda3640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 0x7efe2c06c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efe44001eb0 tx=0x7efe44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.176+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe38076280 con 0x7efe48143e30 2023-12-19T05:45:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.370+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efe48061910 con 0x7efe48143e30 2023-12-19T05:45:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.374+0000 7efe3e7fc640 1 -- 172.21.15.49:0/2893984286 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+33551 (secure 0 0 0) 0x7efe38039090 con 0x7efe48143e30 2023-12-19T05:45:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:39.376 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 116, 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:38.452289+0000", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.423 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.424 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.425 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:39.428 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:39.430 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.431 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.432 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.433 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.434 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:39.440 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.441 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:39.442 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.443 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.444 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:39.445 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:39.446 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.447 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 msgr2=0x7efe2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 0x7efe2c06c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efe44001eb0 tx=0x7efe44009040 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 msgr2=0x7efe4813aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7efe3802c250 tx=0x7efe38004730 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 shutdown_connections 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe2c06a430 0x7efe2c06c8f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe48152750 0x7efe48152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe48143e30 0x7efe4813aa00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 --2- 172.21.15.49:0/2893984286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe34003fe0 0x7efe481f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 >> 172.21.15.49:0/2893984286 conn(0x7efe480cbb70 msgr2=0x7efe4806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 shutdown_connections 2023-12-19T05:45:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.377+0000 7efe50007640 1 -- 172.21.15.49:0/2893984286 wait complete. 2023-12-19T05:45:39.450 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T05:45:39.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:45:39.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.684+0000 7f7c81c95640 1 Processor -- start 2023-12-19T05:45:39.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.684+0000 7f7c81c95640 1 -- start start 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.686+0000 7f7c81c95640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c7c15e3f0 0x7f7c7c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.686+0000 7f7c81c95640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0b2fa0 con 0x7f7c7c0acfc0 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.686+0000 7f7c81c95640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c06f600 con 0x7f7c7c0b2460 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.686+0000 7f7c81c95640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c15e7d0 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c80c93640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c7c15e3f0 0x7f7c7c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c81494640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7c7c0acfc0 0x7f7c7c06fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50740/0 (socket says 172.21.15.49:50740) 2023-12-19T05:45:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c81494640 1 -- 172.21.15.49:0/3669472147 learned_addr learned my addr 172.21.15.49:0/3669472147 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:39.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c7b7fe640 1 -- 172.21.15.49:0/3669472147 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403312876 0 0) 0x7f7c7c0b2fa0 con 0x7f7c7c0acfc0 2023-12-19T05:45:39.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c7b7fe640 1 -- 172.21.15.49:0/3669472147 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6c003520 con 0x7f7c7c0acfc0 2023-12-19T05:45:39.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c80c93640 1 -- 172.21.15.49:0/3669472147 >> v1:172.21.15.115:6789/0 conn(0x7f7c7c0b2460 legacy=0x7f7c7c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.687+0000 7f7c80c93640 1 -- 172.21.15.49:0/3669472147 >> v1:172.21.15.49:6789/0 conn(0x7f7c7c0acfc0 legacy=0x7f7c7c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.688+0000 7f7c80c93640 1 -- 172.21.15.49:0/3669472147 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0b29e0 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.689+0000 7f7c80c93640 1 --2- 172.21.15.49:0/3669472147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c0b1f20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7c700097a0 tx=0x7f7c7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8438f87e5fa2a197 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c7b7fe640 1 -- 172.21.15.49:0/3669472147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70031830 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c7b7fe640 1 -- 172.21.15.49:0/3669472147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70031990 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c7b7fe640 1 -- 172.21.15.49:0/3669472147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70031d20 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 -- 172.21.15.49:0/3669472147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 msgr2=0x7f7c7c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3669472147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c0b1f20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7c700097a0 tx=0x7f7c7002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 -- 172.21.15.49:0/3669472147 shutdown_connections 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3669472147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c0b1f20 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 -- 172.21.15.49:0/3669472147 >> 172.21.15.49:0/3669472147 conn(0x7f7c7c0b0100 msgr2=0x7f7c7c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 -- 172.21.15.49:0/3669472147 shutdown_connections 2023-12-19T05:45:39.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.690+0000 7f7c81c95640 1 -- 172.21.15.49:0/3669472147 wait complete. 2023-12-19T05:45:39.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.692+0000 7f7c81c95640 1 Processor -- start 2023-12-19T05:45:39.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.692+0000 7f7c81c95640 1 -- start start 2023-12-19T05:45:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c7c0acfc0 0x7f7c7c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c7c0b2460 0x7f7c7c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c158420 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1596d0 con 0x7f7c7c0b2460 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81c95640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c159240 con 0x7f7c7c0acfc0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81494640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.693+0000 7f7c81494640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41354/0 (socket says 172.21.15.49:41354) 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 -- 172.21.15.49:0/3549402568 learned_addr learned my addr 172.21.15.49:0/3549402568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c80c93640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c7c0acfc0 0x7f7c7c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c7bfff640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c7c0b2460 0x7f7c7c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 -- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c7c0acfc0 msgr2=0x7f7c7c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c7c0acfc0 0x7f7c7c156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 -- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c7c0b2460 msgr2=0x7f7c7c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c7c0b2460 0x7f7c7c157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 -- 172.21.15.49:0/3549402568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009400 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c81494640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400caa0 tx=0x7f7c7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.694+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400ac00 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.695+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400ad60 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.695+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74012600 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.695+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c158630 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.695+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c158bf0 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.696+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c061910 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.697+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c74007070 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.698+0000 7f7c797fa640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 0x7f7c6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.698+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c74088770 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.698+0000 7f7c80c93640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 0x7f7c6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.699+0000 7f7c80c93640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 0x7f7c6006c920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7c70036000 tx=0x7f7c70008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.702+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c74053d70 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.895+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7c7c15daa0 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.897+0000 7f7c797fa640 1 -- 172.21.15.49:0/3549402568 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+33551 (secure 0 0 0) 0x7f7c74017090 con 0x7f7c7c15e3f0 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 116, 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:45:38.452289+0000", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:45:39.900 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 13, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:45:39.901 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.902 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.904 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.905 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.906 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 12, 2023-12-19T05:45:39.907 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:07.124896+0000", 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:45:39.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.910 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.911 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:39.912 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.75, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.75, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.75, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.75, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.913 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 13, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:45:08.260498+0000", 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:45:39.914 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:45:39.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:45:39.916 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:45:39.917 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:45:39.918 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:45:39.919 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.920 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:45:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:45:39.922 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.925 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.926 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.927 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:45:39.930 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.931 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.932 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.933 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.934 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.935 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.937 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.939 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.940 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:45:39.941 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.942 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.944 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.945 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.946 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.947 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:45:39.948 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:45:39.949 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:45:39.950 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:45:39.951 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:39.952 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.953 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.955 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.956 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.957 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 108, 2023-12-19T05:45:39.958 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.960 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.961 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:45:39.962 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.963 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.964 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.965 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.967 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:45:39.968 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:45:39.969 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:45:39.970 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 msgr2=0x7f7c6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 0x7f7c6006c920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7c70036000 tx=0x7f7c70008030 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 msgr2=0x7f7c7c15a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400caa0 tx=0x7f7c7400cf60 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 shutdown_connections 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7c6006a460 0x7f7c6006c920 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c7c15e3f0 0x7f7c7c15a070 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c7c0b2460 0x7f7c7c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 --2- 172.21.15.49:0/3549402568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c7c0acfc0 0x7f7c7c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:39.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 >> 172.21.15.49:0/3549402568 conn(0x7f7c7c0b0100 msgr2=0x7f7c7c15eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:39.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 shutdown_connections 2023-12-19T05:45:39.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:39.900+0000 7f7c81c95640 1 -- 172.21.15.49:0/3549402568 wait complete. 2023-12-19T05:45:39.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.207+0000 7f7bf759e640 1 Processor -- start 2023-12-19T05:45:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.207+0000 7f7bf759e640 1 -- start start 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bf815f680 0x7f7bf80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 0x7f7bf80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80ce5c0 con 0x7f7bf815f680 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf815ec30 con 0x7f7bf80cdbf0 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.208+0000 7f7bf759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80b2cc0 con 0x7f7bf815e5a0 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bf815f680 0x7f7bf80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bf815f680 0x7f7bf80b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41362/0 (socket says 172.21.15.49:41362) 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 -- 172.21.15.49:0/1256215504 learned_addr learned my addr 172.21.15.49:0/1256215504 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7bf659c640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7bf6d9d640 1 --2- 172.21.15.49:0/1256215504 >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 0x7f7bf80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 -- 172.21.15.49:0/1256215504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 msgr2=0x7f7bf80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 -- 172.21.15.49:0/1256215504 >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 msgr2=0x7f7bf80ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 --2- 172.21.15.49:0/1256215504 >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 0x7f7bf80ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7beffff640 1 -- 172.21.15.49:0/1256215504 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf815e980 con 0x7f7bf815f680 2023-12-19T05:45:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.209+0000 7f7bf6d9d640 1 --2- 172.21.15.49:0/1256215504 >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 0x7f7bf80ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.211+0000 7f7beffff640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf80b2780 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80711b0 tx=0x7f7be002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8021315a0603e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.211+0000 7f7bf5d9b640 1 -- 172.21.15.49:0/1256215504 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0031860 con 0x7f7bf815f680 2023-12-19T05:45:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.211+0000 7f7bf5d9b640 1 -- 172.21.15.49:0/1256215504 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00319c0 con 0x7f7bf815f680 2023-12-19T05:45:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.211+0000 7f7bf5d9b640 1 -- 172.21.15.49:0/1256215504 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0031d50 con 0x7f7bf815f680 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 -- 172.21.15.49:0/1256215504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 msgr2=0x7f7bf80b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf80b2780 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80711b0 tx=0x7f7be002b900 comp rx=0 tx=0).stop 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 -- 172.21.15.49:0/1256215504 shutdown_connections 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 --2- 172.21.15.49:0/1256215504 >> v2:172.21.15.115:3300/0 conn(0x7f7bf80cdbf0 0x7f7bf80ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf80b2780 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 --2- 172.21.15.49:0/1256215504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 -- 172.21.15.49:0/1256215504 >> 172.21.15.49:0/1256215504 conn(0x7f7bf80b0100 msgr2=0x7f7bf80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 -- 172.21.15.49:0/1256215504 shutdown_connections 2023-12-19T05:45:40.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.212+0000 7f7bf759e640 1 -- 172.21.15.49:0/1256215504 wait complete. 2023-12-19T05:45:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.214+0000 7f7bf759e640 1 Processor -- start 2023-12-19T05:45:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.214+0000 7f7bf759e640 1 -- start start 2023-12-19T05:45:40.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bf80cdbf0 0x7f7bf8151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8150e40 con 0x7f7bf815f680 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81f1940 con 0x7f7bf80cdbf0 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf814fda0 con 0x7f7bf815e5a0 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41374/0 (socket says 172.21.15.49:41374) 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf6d9d640 1 -- 172.21.15.49:0/2293172254 learned_addr learned my addr 172.21.15.49:0/2293172254 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.215+0000 7f7bf659c640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bf80cdbf0 0x7f7bf8151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7beffff640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 -- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 msgr2=0x7f7bf815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 -- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bf80cdbf0 msgr2=0x7f7bf8151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bf80cdbf0 0x7f7bf8151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 -- 172.21.15.49:0/2293172254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00094d0 con 0x7f7bf815f680 2023-12-19T05:45:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf6d9d640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000cef0 tx=0x7f7bf000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000d840 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf000d9c0 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.216+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8150080 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.217+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000dd70 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.217+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf8150640 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.218+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8061910 con 0x7f7bf815f680 2023-12-19T05:45:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.219+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7bf001e3b0 con 0x7f7bf815f680 2023-12-19T05:45:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.220+0000 7f7beeffd640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 0x7f7bd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:40.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.221+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bf00893f0 con 0x7f7bf815f680 2023-12-19T05:45:40.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.221+0000 7f7bf659c640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 0x7f7bd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:40.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.222+0000 7f7bf659c640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 0x7f7bd806c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006fd0 tx=0x7f7be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:40.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.225+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7bf0054a90 con 0x7f7bf815f680 2023-12-19T05:45:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.457+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf80b2220 con 0x7f7bf815f680 2023-12-19T05:45:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.458+0000 7f7beeffd640 1 -- 172.21.15.49:0/2293172254 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f7bf00580b0 con 0x7f7bf815f680 2023-12-19T05:45:40.461 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:40.461 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 msgr2=0x7f7bd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 0x7f7bd806c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006fd0 tx=0x7f7be8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 msgr2=0x7f7bf814e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000cef0 tx=0x7f7bf000a710 comp rx=0 tx=0).stop 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 shutdown_connections 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7bd806a430 0x7f7bd806c8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bf815e5a0 0x7f7bf815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bf815f680 0x7f7bf814e780 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 --2- 172.21.15.49:0/2293172254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bf80cdbf0 0x7f7bf8151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:40.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 >> 172.21.15.49:0/2293172254 conn(0x7f7bf80b0100 msgr2=0x7f7bf814f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:40.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 shutdown_connections 2023-12-19T05:45:40.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:40.461+0000 7f7bf759e640 1 -- 172.21.15.49:0/2293172254 wait complete. 2023-12-19T05:45:40.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:45:40.717 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.467942686000001,"mdsmap_epoch":48,"osdmap_epoch":116,"osdmap_epoch_barrier":113,"uptime":37.098944148000001} 2023-12-19T05:45:40.718 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 48, "osdmap_epoch": 116, "osdmap_epoch_barrier": 113, "rank_uptime": 31.467942686, "state": "up:active", "uptime": 37.098944148, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:45:40.718 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:45:40.718 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:40.718 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:40.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:40.785 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T05:45:41.369 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:45:41.370 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:45:41.370 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.521138 s, 101 MB/s 2023-12-19T05:45:41.371 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:45:41.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:45:41.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:45:41.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:45:41.617 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:41.617 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:41.683 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:41.683 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:41.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:41.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.982+0000 7f9a84dce640 1 Processor -- start 2023-12-19T05:45:41.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.982+0000 7f9a84dce640 1 -- start start 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a80161810 0x7f9a800cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a800cc8a0 0x7f9a800cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a80165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80161bf0 con 0x7f9a80161810 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a800b22b0 con 0x7f9a800cc8a0 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a84dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800b2830 con 0x7f9a800ce490 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.984+0000 7f9a7f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a80161810 0x7f9a800cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a80161810 0x7f9a800cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41376/0 (socket says 172.21.15.49:41376) 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 -- 172.21.15.49:0/3183958086 learned_addr learned my addr 172.21.15.49:0/3183958086 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7ffff640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a80165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7effd640 1 --2- 172.21.15.49:0/3183958086 >> v2:172.21.15.115:3300/0 conn(0x7f9a800cc8a0 0x7f9a800cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 -- 172.21.15.49:0/3183958086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 msgr2=0x7f9a80165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a80165260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 -- 172.21.15.49:0/3183958086 >> v2:172.21.15.115:3300/0 conn(0x7f9a800cc8a0 msgr2=0x7f9a800cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:41.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3183958086 >> v2:172.21.15.115:3300/0 conn(0x7f9a800cc8a0 0x7f9a800cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7f7fe640 1 -- 172.21.15.49:0/3183958086 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800b2550 con 0x7f9a80161810 2023-12-19T05:45:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.985+0000 7f9a7ffff640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a80165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.987+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a80161810 0x7f9a800cc360 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ada80 tx=0x7f9a7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f36721b02228720 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a7e7fc640 1 -- 172.21.15.49:0/3183958086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700317e0 con 0x7f9a80161810 2023-12-19T05:45:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a7e7fc640 1 -- 172.21.15.49:0/3183958086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a70031940 con 0x7f9a80161810 2023-12-19T05:45:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a7e7fc640 1 -- 172.21.15.49:0/3183958086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70031cd0 con 0x7f9a80161810 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 -- 172.21.15.49:0/3183958086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a80161810 msgr2=0x7f9a800cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a80161810 0x7f9a800cc360 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ada80 tx=0x7f9a7002b880 comp rx=0 tx=0).stop 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 -- 172.21.15.49:0/3183958086 shutdown_connections 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a80165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3183958086 >> v2:172.21.15.115:3300/0 conn(0x7f9a800cc8a0 0x7f9a800cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3183958086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a80161810 0x7f9a800cc360 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.988+0000 7f9a84dce640 1 -- 172.21.15.49:0/3183958086 >> 172.21.15.49:0/3183958086 conn(0x7f9a800b0100 msgr2=0x7f9a800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.989+0000 7f9a84dce640 1 -- 172.21.15.49:0/3183958086 shutdown_connections 2023-12-19T05:45:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.989+0000 7f9a84dce640 1 -- 172.21.15.49:0/3183958086 wait complete. 2023-12-19T05:45:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.990+0000 7f9a84dce640 1 Processor -- start 2023-12-19T05:45:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.991+0000 7f9a84dce640 1 -- start start 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 0x7f9a80165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a801f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801f7340 con 0x7f9a8015ed60 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8006c3b0 con 0x7f9a800cc8a0 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a84dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8006cc50 con 0x7f9a800ce490 2023-12-19T05:45:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41384/0 (socket says 172.21.15.49:41384) 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 -- 172.21.15.49:0/3970776303 learned_addr learned my addr 172.21.15.49:0/3970776303 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7effd640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a801f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 0x7f9a80165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 -- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 msgr2=0x7f9a801f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a801f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 -- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 msgr2=0x7f9a80165540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 0x7f9a80165540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7ffff640 1 -- 172.21.15.49:0/3970776303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700094d0 con 0x7f9a8015ed60 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7effd640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a801f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.992+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 0x7f9a80165540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a7ffff640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9a78007ef0 tx=0x7f9a7800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78003b90 con 0x7f9a8015ed60 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800f040 con 0x7f9a8015ed60 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800de80 con 0x7f9a8015ed60 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8015e450 con 0x7f9a8015ed60 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.993+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8006c8e0 con 0x7f9a8015ed60 2023-12-19T05:45:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.994+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8006ce00 con 0x7f9a8015ed60 2023-12-19T05:45:41.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.996+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a78004030 con 0x7f9a8015ed60 2023-12-19T05:45:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.996+0000 7f9a67fff640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 0x7f9a6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.997+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a78088b70 con 0x7f9a8015ed60 2023-12-19T05:45:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.997+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 0x7f9a6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:41.998+0000 7f9a7f7fe640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 0x7f9a6c06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9a70036000 tx=0x7f9a7003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.001+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9a8006ce00 con 0x7f9a8015ed60 2023-12-19T05:45:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.200+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a8006cdc0 con 0x7f9a8015ed60 2023-12-19T05:45:42.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.203+0000 7f9a67fff640 1 -- 172.21.15.49:0/3970776303 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f9a7801a090 con 0x7f9a8015ed60 2023-12-19T05:45:42.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:42.205 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:38.452289+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 msgr2=0x7f9a6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 0x7f9a6c06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9a70036000 tx=0x7f9a7003d040 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 msgr2=0x7f9a801f9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9a78007ef0 tx=0x7f9a7800d4a0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 shutdown_connections 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a6c06a430 0x7f9a6c06c8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a800ce490 0x7f9a801f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a8015ed60 0x7f9a801f9ac0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 --2- 172.21.15.49:0/3970776303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a800cc8a0 0x7f9a80165540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 >> 172.21.15.49:0/3970776303 conn(0x7f9a800b0100 msgr2=0x7f9a80163d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 shutdown_connections 2023-12-19T05:45:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.206+0000 7f9a84dce640 1 -- 172.21.15.49:0/3970776303 wait complete. 2023-12-19T05:45:42.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:45:07.124896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:45:08.260498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:42.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.465+0000 7f942a483640 1 Processor -- start 2023-12-19T05:45:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.465+0000 7f942a483640 1 -- start start 2023-12-19T05:45:42.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f942a483640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f942415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f942a483640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942415c580 con 0x7f9424155530 2023-12-19T05:45:42.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f942a483640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94240cf910 con 0x7f942415c0d0 2023-12-19T05:45:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f942a483640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240cfbf0 con 0x7f94240660e0 2023-12-19T05:45:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f9429481640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9424155530 0x7f94240cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50752/0 (socket says 172.21.15.49:50752) 2023-12-19T05:45:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f9429481640 1 -- 172.21.15.49:0/1504277514 learned_addr learned my addr 172.21.15.49:0/1504277514 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460329106 0 0) 0x7f942415c580 con 0x7f9424155530 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f940c003520 con 0x7f9424155530 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.467+0000 7f9429c82640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f942415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652640190 0 0) 0x7f940c003520 con 0x7f9424155530 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 msgr2=0x7f942415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f942415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 >> v1:172.21.15.115:6789/0 conn(0x7f942415c0d0 legacy=0x7f94240659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942415b8d0 con 0x7f9424155530 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9414001670 con 0x7f9424155530 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 >> v1:172.21.15.49:6789/0 conn(0x7f9424155530 legacy=0x7f94240cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f940c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f940c003f70 0x7f940c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f940c004d00 0x7f940c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94240cfbf0 con 0x7f940c004d00 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c00bb70 con 0x7f940c003f70 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c00bd30 con 0x7f94240660e0 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.468+0000 7f9429c82640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f940c004d00 0x7f940c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9428c80640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f940c003f70 0x7f940c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429481640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f940c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429c82640 1 -- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 msgr2=0x7f940c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429c82640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94240660e0 0x7f940c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429c82640 1 -- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f940c003f70 msgr2=0x7f940c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429c82640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f940c003f70 0x7f940c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.469+0000 7f9429c82640 1 -- 172.21.15.49:0/1504277514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c003520 con 0x7f940c004d00 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.470+0000 7f9429c82640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f940c004d00 0x7f940c005180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f941c009fc0 tx=0x7f940c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ae9b1795d994ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c02cc20 con 0x7f940c004d00 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c00f040 con 0x7f940c004d00 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f9423fff640 1 -- 172.21.15.49:0/1504277514 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c034440 con 0x7f940c004d00 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f942a483640 1 -- 172.21.15.49:0/1504277514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f940c004d00 msgr2=0x7f940c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f942a483640 1 --2- 172.21.15.49:0/1504277514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f940c004d00 0x7f940c005180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f941c009fc0 tx=0x7f940c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f9429c82640 1 -- 172.21.15.49:0/1504277514 reap_dead start 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f942a483640 1 -- 172.21.15.49:0/1504277514 shutdown_connections 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.471+0000 7f942a483640 1 -- 172.21.15.49:0/1504277514 >> 172.21.15.49:0/1504277514 conn(0x7f94240735a0 msgr2=0x7f94240b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.472+0000 7f942a483640 1 -- 172.21.15.49:0/1504277514 shutdown_connections 2023-12-19T05:45:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.472+0000 7f942a483640 1 -- 172.21.15.49:0/1504277514 wait complete. 2023-12-19T05:45:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.473+0000 7f942a483640 1 Processor -- start 2023-12-19T05:45:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.474+0000 7f942a483640 1 -- start start 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f942414cba0 0x7f94241559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 0x7f94240ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94240b11c0 con 0x7f94240b07f0 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94240ada50 con 0x7f942414cf80 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f942a483640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94241f3a80 con 0x7f942414cba0 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f9429c82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f9429c82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41396/0 (socket says 172.21.15.49:41396) 2023-12-19T05:45:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f9429c82640 1 -- 172.21.15.49:0/269515563 learned_addr learned my addr 172.21.15.49:0/269515563 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.475+0000 7f9429481640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f942414cba0 0x7f94241559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9428c80640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 0x7f94240ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 -- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f942414cba0 msgr2=0x7f94241559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f942414cba0 0x7f94241559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 -- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 msgr2=0x7f94240ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 0x7f94240ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 -- 172.21.15.49:0/269515563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240ad1b0 con 0x7f94240b07f0 2023-12-19T05:45:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9428c80640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 0x7f94240ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9429c82640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f941c002230 tx=0x7f941c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c043070 con 0x7f94240b07f0 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c02de00 con 0x7f94240b07f0 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94240ad490 con 0x7f94240b07f0 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.476+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c034d10 con 0x7f94240b07f0 2023-12-19T05:45:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.477+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241573c0 con 0x7f94240b07f0 2023-12-19T05:45:42.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.478+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94241575e0 con 0x7f94240b07f0 2023-12-19T05:45:42.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.479+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f941c03e440 con 0x7f94240b07f0 2023-12-19T05:45:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.480+0000 7f9421ffb640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 0x7f941006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.480+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f941c0aa400 con 0x7f94240b07f0 2023-12-19T05:45:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.481+0000 7f9429481640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 0x7f941006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.482+0000 7f9429481640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 0x7f941006c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9414001050 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.484+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f941c075a80 con 0x7f94240b07f0 2023-12-19T05:45:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.678+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9424061910 con 0x7f94240b07f0 2023-12-19T05:45:42.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.679+0000 7f9421ffb640 1 -- 172.21.15.49:0/269515563 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f941c0790a0 con 0x7f94240b07f0 2023-12-19T05:45:42.681 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 msgr2=0x7f941006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 0x7f941006c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9414001050 tx=0x7f9414009040 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 msgr2=0x7f94240b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f941c002230 tx=0x7f941c009750 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 shutdown_connections 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f941006a430 0x7f941006c8f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94240b07f0 0x7f94240b0c80 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f942414cf80 0x7f94240ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 --2- 172.21.15.49:0/269515563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f942414cba0 0x7f94241559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 >> 172.21.15.49:0/269515563 conn(0x7f94240735a0 msgr2=0x7f94240cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:42.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 shutdown_connections 2023-12-19T05:45:42.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.682+0000 7f942a483640 1 -- 172.21.15.49:0/269515563 wait complete. 2023-12-19T05:45:42.702 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:45:42.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.931+0000 7fe2b221f640 1 Processor -- start 2023-12-19T05:45:42.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.931+0000 7fe2b221f640 1 -- start start 2023-12-19T05:45:42.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.933+0000 7fe2b221f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2ac0b7360 0x7fe2ac0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.933+0000 7fe2b221f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.933+0000 7fe2b221f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac0b7d00 con 0x7fe2ac146c40 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.933+0000 7fe2b221f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac0700c0 con 0x7fe2ac0b7360 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.933+0000 7fe2b221f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac06f160 con 0x7fe2ac0cf8e0 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b1a1e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b0a1c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2ac0b7360 0x7fe2ac0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b121d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe2ac146c40 0x7fe2ac070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:48428/0 (socket says 172.21.15.49:48428) 2023-12-19T05:45:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b121d640 1 -- 172.21.15.49:0/1390234274 learned_addr learned my addr 172.21.15.49:0/1390234274 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b1a1e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:51580/0 (socket says 172.21.15.49:51580) 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.934+0000 7fe2b0a1c640 1 -- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 msgr2=0x7fe2ac0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.935+0000 7fe2b0a1c640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.935+0000 7fe2b0a1c640 1 -- 172.21.15.49:0/1390234274 >> v1:172.21.15.115:6789/0 conn(0x7fe2ac146c40 legacy=0x7fe2ac070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.935+0000 7fe2b0a1c640 1 -- 172.21.15.49:0/1390234274 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac06f440 con 0x7fe2ac0b7360 2023-12-19T05:45:42.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.935+0000 7fe2b1a1e640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:42.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.936+0000 7fe2b0a1c640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac0b77c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2ecce0045f3bda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.936+0000 7fe2a3fff640 1 -- 172.21.15.49:0/1390234274 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c02d040 con 0x7fe2ac0b7360 2023-12-19T05:45:42.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2a3fff640 1 -- 172.21.15.49:0/1390234274 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c031810 con 0x7fe2ac0b7360 2023-12-19T05:45:42.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2a3fff640 1 -- 172.21.15.49:0/1390234274 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c031ba0 con 0x7fe2ac0b7360 2023-12-19T05:45:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 -- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 msgr2=0x7fe2ac0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac0b77c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 -- 172.21.15.49:0/1390234274 shutdown_connections 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 --2- 172.21.15.49:0/1390234274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac0b77c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 -- 172.21.15.49:0/1390234274 >> 172.21.15.49:0/1390234274 conn(0x7fe2ac0d31b0 msgr2=0x7fe2ac0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 -- 172.21.15.49:0/1390234274 shutdown_connections 2023-12-19T05:45:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.937+0000 7fe2b221f640 1 -- 172.21.15.49:0/1390234274 wait complete. 2023-12-19T05:45:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.939+0000 7fe2b221f640 1 Processor -- start 2023-12-19T05:45:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.939+0000 7fe2b221f640 1 -- start start 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac1f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c9be0 con 0x7fe2ac146c40 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac1389b0 con 0x7fe2ac0b7360 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.940+0000 7fe2b221f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c9240 con 0x7fe2ac0cf8e0 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41408/0 (socket says 172.21.15.49:41408) 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 -- 172.21.15.49:0/522076584 learned_addr learned my addr 172.21.15.49:0/522076584 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b121d640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac1f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b0a1c640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 -- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 msgr2=0x7fe2ac0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 -- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 msgr2=0x7fe2ac1f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac1f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.941+0000 7fe2b1a1e640 1 -- 172.21.15.49:0/522076584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009400 con 0x7fe2ac146c40 2023-12-19T05:45:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2b1a1e640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400e880 tx=0x7fe2a400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4009660 con 0x7fe2ac146c40 2023-12-19T05:45:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4004020 con 0x7fe2ac146c40 2023-12-19T05:45:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40043b0 con 0x7fe2ac146c40 2023-12-19T05:45:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c009400 con 0x7fe2ac146c40 2023-12-19T05:45:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.942+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac0c9800 con 0x7fe2ac146c40 2023-12-19T05:45:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.943+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac0c9d20 con 0x7fe2ac146c40 2023-12-19T05:45:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.944+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2a400c940 con 0x7fe2ac146c40 2023-12-19T05:45:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.945+0000 7fe2a1ffb640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 0x7fe29006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.945+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2a4088750 con 0x7fe2ac146c40 2023-12-19T05:45:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.946+0000 7fe2b121d640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 0x7fe29006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:42.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.947+0000 7fe2b121d640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 0x7fe29006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005c00 tx=0x7fe2a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:42.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:42.950+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2ac0c9d20 con 0x7fe2ac146c40 2023-12-19T05:45:43.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.145+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2ac0c9d20 con 0x7fe2ac146c40 2023-12-19T05:45:43.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.146+0000 7fe2a1ffb640 1 -- 172.21.15.49:0/522076584 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2ac0c9d20 con 0x7fe2ac146c40 2023-12-19T05:45:43.147 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 msgr2=0x7fe29006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 0x7fe29006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005c00 tx=0x7fe2a8009040 comp rx=0 tx=0).stop 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 msgr2=0x7fe2ac0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400e880 tx=0x7fe2a400ed40 comp rx=0 tx=0).stop 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 shutdown_connections 2023-12-19T05:45:43.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe29006a430 0x7fe29006c8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2ac0cf8e0 0x7fe2ac0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ac146c40 0x7fe2ac0cc570 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 --2- 172.21.15.49:0/522076584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2ac0b7360 0x7fe2ac1f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.148+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 >> 172.21.15.49:0/522076584 conn(0x7fe2ac0d31b0 msgr2=0x7fe2ac0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.149+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 shutdown_connections 2023-12-19T05:45:43.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.149+0000 7fe2b221f640 1 -- 172.21.15.49:0/522076584 wait complete. 2023-12-19T05:45:43.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:45:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.401+0000 7fed3db88640 1 Processor -- start 2023-12-19T05:45:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.401+0000 7fed3db88640 1 -- start start 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.402+0000 7fed3db88640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed380b2b90 0x7fed380d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.402+0000 7fed3db88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380d0a10 0x7fed380b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.402+0000 7fed3db88640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3815edb0 con 0x7fed38144d90 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.402+0000 7fed3db88640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3815f090 con 0x7fed380b2b90 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.402+0000 7fed3db88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3815f370 con 0x7fed380d0a10 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed377fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fed38144d90 0x7fed380b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50766/0 (socket says 172.21.15.49:50766) 2023-12-19T05:45:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed377fe640 1 -- 172.21.15.49:0/3530096479 learned_addr learned my addr 172.21.15.49:0/3530096479 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed36ffd640 1 --2- 172.21.15.49:0/3530096479 >> v2:172.21.15.115:3300/0 conn(0x7fed380b2b90 0x7fed380d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed37fff640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380d0a10 0x7fed380b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110894360 0 0) 0x7fed3815edb0 con 0x7fed38144d90 2023-12-19T05:45:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.403+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed24003520 con 0x7fed38144d90 2023-12-19T05:45:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.404+0000 7fed36ffd640 1 -- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380d0a10 msgr2=0x7fed380b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.404+0000 7fed36ffd640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380d0a10 0x7fed380b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.404+0000 7fed36ffd640 1 -- 172.21.15.49:0/3530096479 >> v1:172.21.15.49:6789/0 conn(0x7fed38144d90 legacy=0x7fed380b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.404+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138045796 0 0) 0x7fed24003520 con 0x7fed38144d90 2023-12-19T05:45:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.404+0000 7fed36ffd640 1 -- 172.21.15.49:0/3530096479 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3815f650 con 0x7fed380b2b90 2023-12-19T05:45:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.405+0000 7fed36ffd640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380b2b90 0x7fed380d04d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed200097a0 tx=0x7fed2002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c81d700aec3a0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed280019f0 con 0x7fed380b2b90 2023-12-19T05:45:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2002e050 con 0x7fed380b2b90 2023-12-19T05:45:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed367fc640 1 -- 172.21.15.49:0/3530096479 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20030710 con 0x7fed380b2b90 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 -- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380b2b90 msgr2=0x7fed380d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380b2b90 0x7fed380d04d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed200097a0 tx=0x7fed2002b710 comp rx=0 tx=0).stop 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 -- 172.21.15.49:0/3530096479 shutdown_connections 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380d0a10 0x7fed380b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 --2- 172.21.15.49:0/3530096479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380b2b90 0x7fed380d04d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 -- 172.21.15.49:0/3530096479 >> 172.21.15.49:0/3530096479 conn(0x7fed3806a2e0 msgr2=0x7fed3806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 -- 172.21.15.49:0/3530096479 shutdown_connections 2023-12-19T05:45:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.406+0000 7fed3db88640 1 -- 172.21.15.49:0/3530096479 wait complete. 2023-12-19T05:45:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.408+0000 7fed3db88640 1 Processor -- start 2023-12-19T05:45:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.408+0000 7fed3db88640 1 -- start start 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380b2b90 0x7fed380ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380d0a10 0x7fed38142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed380cc1c0 con 0x7fed38144d90 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed380cc460 con 0x7fed380d0a10 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.409+0000 7fed3db88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed380cc740 con 0x7fed380b2b90 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41420/0 (socket says 172.21.15.49:41420) 2023-12-19T05:45:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 -- 172.21.15.49:0/798705134 learned_addr learned my addr 172.21.15.49:0/798705134 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed36ffd640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380d0a10 0x7fed38142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed377fe640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380b2b90 0x7fed380ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 -- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380b2b90 msgr2=0x7fed380ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380b2b90 0x7fed380ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 -- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380d0a10 msgr2=0x7fed38142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380d0a10 0x7fed38142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 -- 172.21.15.49:0/798705134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009400 con 0x7fed38144d90 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.410+0000 7fed37fff640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e930 tx=0x7fed3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.411+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30009690 con 0x7fed38144d90 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.411+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3000c980 con 0x7fed38144d90 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.411+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000cd30 con 0x7fed38144d90 2023-12-19T05:45:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.411+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed380cca20 con 0x7fed38144d90 2023-12-19T05:45:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.411+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3806fd70 con 0x7fed38144d90 2023-12-19T05:45:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.412+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed380cdc00 con 0x7fed38144d90 2023-12-19T05:45:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.413+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fed30013470 con 0x7fed38144d90 2023-12-19T05:45:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.414+0000 7fed2ffff640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 0x7fed1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.414+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed30088c10 con 0x7fed38144d90 2023-12-19T05:45:43.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.415+0000 7fed377fe640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 0x7fed1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.416+0000 7fed377fe640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 0x7fed1806c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fed28001560 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.418+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fed30054220 con 0x7fed38144d90 2023-12-19T05:45:43.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.614+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed380ccc10 con 0x7fed38144d90 2023-12-19T05:45:43.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.614+0000 7fed2ffff640 1 -- 172.21.15.49:0/798705134 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed300170a0 con 0x7fed38144d90 2023-12-19T05:45:43.616 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:45:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 msgr2=0x7fed1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 0x7fed1806c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fed28001560 tx=0x7fed28009040 comp rx=0 tx=0).stop 2023-12-19T05:45:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 msgr2=0x7fed3806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e930 tx=0x7fed3000edf0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 shutdown_connections 2023-12-19T05:45:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed1806a430 0x7fed1806c8f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed38144d90 0x7fed3806f2b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed380d0a10 0x7fed38142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 --2- 172.21.15.49:0/798705134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed380b2b90 0x7fed380ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 >> 172.21.15.49:0/798705134 conn(0x7fed3806a2e0 msgr2=0x7fed38070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.617+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 shutdown_connections 2023-12-19T05:45:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.618+0000 7fed3db88640 1 -- 172.21.15.49:0/798705134 wait complete. 2023-12-19T05:45:43.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:45:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.860+0000 7fa7e7fff640 1 Processor -- start 2023-12-19T05:45:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.860+0000 7fa7e7fff640 1 -- start start 2023-12-19T05:45:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.861+0000 7fa7e7fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7e80b0a00 0x7fa7e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e806ca80 0x7fa7e80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e7fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e815c9c0 con 0x7fa7e8155460 2023-12-19T05:45:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e7fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e806d270 con 0x7fa7e806ca80 2023-12-19T05:45:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e7fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e806d550 con 0x7fa7e80b0a00 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e806ca80 0x7fa7e80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e806ca80 0x7fa7e80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41424/0 (socket says 172.21.15.49:41424) 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 -- 172.21.15.49:0/318612632 learned_addr learned my addr 172.21.15.49:0/318612632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 -- 172.21.15.49:0/318612632 >> v2:172.21.15.115:3300/0 conn(0x7fa7e80b0a00 msgr2=0x7fa7e806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 --2- 172.21.15.49:0/318612632 >> v2:172.21.15.115:3300/0 conn(0x7fa7e80b0a00 0x7fa7e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.862+0000 7fa7e77fe640 1 -- 172.21.15.49:0/318612632 >> v1:172.21.15.115:6789/0 conn(0x7fa7e8155460 legacy=0x7fa7e80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:43.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.863+0000 7fa7e77fe640 1 -- 172.21.15.49:0/318612632 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e806d830 con 0x7fa7e806ca80 2023-12-19T05:45:43.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.864+0000 7fa7e77fe640 1 --2- 172.21.15.49:0/318612632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e806ca80 0x7fa7e80cdcf0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80afea0 tx=0x7fa7e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b5164c08c41971 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.864+0000 7fa7e5ffb640 1 -- 172.21.15.49:0/318612632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e002ca80 con 0x7fa7e806ca80 2023-12-19T05:45:43.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.864+0000 7fa7e5ffb640 1 -- 172.21.15.49:0/318612632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e002cbe0 con 0x7fa7e806ca80 2023-12-19T05:45:43.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.864+0000 7fa7e5ffb640 1 -- 172.21.15.49:0/318612632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00343f0 con 0x7fa7e806ca80 2023-12-19T05:45:43.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 -- 172.21.15.49:0/318612632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e806ca80 msgr2=0x7fa7e80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/318612632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e806ca80 0x7fa7e80cdcf0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80afea0 tx=0x7fa7e002bee0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 -- 172.21.15.49:0/318612632 shutdown_connections 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/318612632 >> v2:172.21.15.115:3300/0 conn(0x7fa7e80b0a00 0x7fa7e806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/318612632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e806ca80 0x7fa7e80cdcf0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 -- 172.21.15.49:0/318612632 >> 172.21.15.49:0/318612632 conn(0x7fa7e80659a0 msgr2=0x7fa7e8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 -- 172.21.15.49:0/318612632 shutdown_connections 2023-12-19T05:45:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.865+0000 7fa7e7fff640 1 -- 172.21.15.49:0/318612632 wait complete. 2023-12-19T05:45:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.866+0000 7fa7e7fff640 1 Processor -- start 2023-12-19T05:45:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.867+0000 7fa7e7fff640 1 -- start start 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.867+0000 7fa7e7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7e806ca80 0x7fa7e80b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.867+0000 7fa7e7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e8155460 0x7fa7e81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e7fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80cfbd0 con 0x7fa7e80b0a00 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e7fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8150e30 con 0x7fa7e8155460 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80b2110 con 0x7fa7e806ca80 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41428/0 (socket says 172.21.15.49:41428) 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 -- 172.21.15.49:0/2461250371 learned_addr learned my addr 172.21.15.49:0/2461250371 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e77fe640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e8155460 0x7fa7e81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e6ffd640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7e806ca80 0x7fa7e80b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 -- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7e806ca80 msgr2=0x7fa7e80b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7e806ca80 0x7fa7e80b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 -- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e8155460 msgr2=0x7fa7e81508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e8155460 0x7fa7e81508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.868+0000 7fa7e67fc640 1 -- 172.21.15.49:0/2461250371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009b30 con 0x7fa7e80b0a00 2023-12-19T05:45:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7e67fc640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00b4d0 tx=0x7fa7dc00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc010870 con 0x7fa7e80b0a00 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc0109d0 con 0x7fa7e80b0a00 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc010d80 con 0x7fa7e80b0a00 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80b2cb0 con 0x7fa7e80b0a00 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.869+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80b2660 con 0x7fa7e80b0a00 2023-12-19T05:45:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.870+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80b1120 con 0x7fa7e80b0a00 2023-12-19T05:45:43.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.872+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7dc00f3c0 con 0x7fa7e80b0a00 2023-12-19T05:45:43.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.872+0000 7fa7cffff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 0x7fa7d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:43.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.873+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7dc0888e0 con 0x7fa7e80b0a00 2023-12-19T05:45:43.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.873+0000 7fa7e6ffd640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 0x7fa7d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:43.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.874+0000 7fa7e6ffd640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 0x7fa7d406c920 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a750 tx=0x7fa7d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:43.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:43.877+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7dc053e30 con 0x7fa7e80b0a00 2023-12-19T05:45:44.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.083+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7e80cc900 con 0x7fa7e80b0a00 2023-12-19T05:45:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.083+0000 7fa7cffff640 1 -- 172.21.15.49:0/2461250371 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa7dc014080 con 0x7fa7e80b0a00 2023-12-19T05:45:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 msgr2=0x7fa7d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 0x7fa7d406c920 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a750 tx=0x7fa7d8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 msgr2=0x7fa7e806f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00b4d0 tx=0x7fa7dc00b990 comp rx=0 tx=0).stop 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 shutdown_connections 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7d406a460 0x7fa7d406c920 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e8155460 0x7fa7e81508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80b0a00 0x7fa7e806f6c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 --2- 172.21.15.49:0/2461250371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7e806ca80 0x7fa7e80b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 >> 172.21.15.49:0/2461250371 conn(0x7fa7e80659a0 msgr2=0x7fa7e815d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.086+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 shutdown_connections 2023-12-19T05:45:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.087+0000 7fa7e7fff640 1 -- 172.21.15.49:0/2461250371 wait complete. 2023-12-19T05:45:44.108 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:45:44.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:44.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:45:44.279 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:45:44.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:44.279 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:45:44.322 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:44.323 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:44.369 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:44.369 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:44.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.705+0000 7f3e9b204640 1 Processor -- start 2023-12-19T05:45:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.705+0000 7f3e9b204640 1 -- start start 2023-12-19T05:45:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e9b204640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3e94146e10 0x7f3e940d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e9b204640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e9b204640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e940cd840 con 0x7f3e940ce110 2023-12-19T05:45:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e9b204640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e940d2430 con 0x7f3e94146e10 2023-12-19T05:45:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e9b204640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940d2620 con 0x7f3e940d2b00 2023-12-19T05:45:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.707+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:45000/0 (socket says 172.21.15.49:45000) 2023-12-19T05:45:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e93fff640 1 -- 172.21.15.49:0/2339587654 learned_addr learned my addr 172.21.15.49:0/2339587654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:44.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2339587654 >> v2:172.21.15.115:3300/0 conn(0x7f3e94146e10 0x7f3e940d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e98fa0640 1 -- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 msgr2=0x7f3e940b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e98fa0640 1 -- 172.21.15.49:0/2339587654 >> v1:172.21.15.115:6789/0 conn(0x7f3e940ce110 legacy=0x7f3e940b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e98fa0640 1 -- 172.21.15.49:0/2339587654 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940b41c0 con 0x7f3e94146e10 2023-12-19T05:45:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.708+0000 7f3e93fff640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.710+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94146e10 0x7f3e940d1ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200e8a0834d6a27e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.710+0000 7f3e937fe640 1 -- 172.21.15.49:0/2339587654 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8402cc60 con 0x7f3e94146e10 2023-12-19T05:45:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.710+0000 7f3e937fe640 1 -- 172.21.15.49:0/2339587654 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8402cdc0 con 0x7f3e94146e10 2023-12-19T05:45:44.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.710+0000 7f3e937fe640 1 -- 172.21.15.49:0/2339587654 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84034660 con 0x7f3e94146e10 2023-12-19T05:45:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 -- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94146e10 msgr2=0x7f3e940d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94146e10 0x7f3e940d1ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8402beb0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 -- 172.21.15.49:0/2339587654 shutdown_connections 2023-12-19T05:45:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940d2b00 0x7f3e940b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2339587654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94146e10 0x7f3e940d1ef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 -- 172.21.15.49:0/2339587654 >> 172.21.15.49:0/2339587654 conn(0x7f3e940b29c0 msgr2=0x7f3e940b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 -- 172.21.15.49:0/2339587654 shutdown_connections 2023-12-19T05:45:44.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.711+0000 7f3e9b204640 1 -- 172.21.15.49:0/2339587654 wait complete. 2023-12-19T05:45:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.714+0000 7f3e9b204640 1 Processor -- start 2023-12-19T05:45:44.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.714+0000 7f3e9b204640 1 -- start start 2023-12-19T05:45:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 0x7f3e9413aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e940d2b00 0x7f3e9413c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941590d0 con 0x7f3e94146e10 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941584c0 con 0x7f3e940d2b00 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e9b204640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941587a0 con 0x7f3e940ce110 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.715+0000 7f3e997a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40056/0 (socket says 172.21.15.49:40056) 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 -- 172.21.15.49:0/2178636694 learned_addr learned my addr 172.21.15.49:0/2178636694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 0x7f3e9413aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e93fff640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e940d2b00 0x7f3e9413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 -- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 msgr2=0x7f3e9413aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 0x7f3e9413aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 -- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e940d2b00 msgr2=0x7f3e9413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e940d2b00 0x7f3e9413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 -- 172.21.15.49:0/2178636694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0094d0 con 0x7f3e94146e10 2023-12-19T05:45:44.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 0x7f3e9413aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.716+0000 7f3e997a1640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c001eb0 tx=0x7f3e8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.717+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0052d0 con 0x7f3e94146e10 2023-12-19T05:45:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.717+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c005430 con 0x7f3e94146e10 2023-12-19T05:45:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.717+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e84009a70 con 0x7f3e94146e10 2023-12-19T05:45:44.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.717+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c003810 con 0x7f3e94146e10 2023-12-19T05:45:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.717+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94158d60 con 0x7f3e94146e10 2023-12-19T05:45:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.718+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94061910 con 0x7f3e94146e10 2023-12-19T05:45:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.719+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e8c003970 con 0x7f3e94146e10 2023-12-19T05:45:44.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.721+0000 7f3e917fa640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 0x7f3e7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:44.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.721+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e8c087ed0 con 0x7f3e94146e10 2023-12-19T05:45:44.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.721+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 0x7f3e7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.722+0000 7f3e98fa0640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 0x7f3e7406c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e84036000 tx=0x7f3e84030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.725+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e8c0534b0 con 0x7f3e94146e10 2023-12-19T05:45:44.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.917+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e94159210 con 0x7f3e94146e10 2023-12-19T05:45:44.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.919+0000 7f3e917fa640 1 -- 172.21.15.49:0/2178636694 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f3e94159210 con 0x7f3e94146e10 2023-12-19T05:45:44.921 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:44.921 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:38.452289+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 msgr2=0x7f3e7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 0x7f3e7406c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e84036000 tx=0x7f3e84030000 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 msgr2=0x7f3e9413cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c001eb0 tx=0x7f3e8c00c890 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 shutdown_connections 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e7406a430 0x7f3e7406c8f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94146e10 0x7f3e9413cca0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e940d2b00 0x7f3e9413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 --2- 172.21.15.49:0/2178636694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e940ce110 0x7f3e9413aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 >> 172.21.15.49:0/2178636694 conn(0x7f3e940b29c0 msgr2=0x7f3e940d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 shutdown_connections 2023-12-19T05:45:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:44.922+0000 7f3e9b204640 1 -- 172.21.15.49:0/2178636694 wait complete. 2023-12-19T05:45:44.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:45:07.124896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:45:08.260498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:44.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:45.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.170+0000 7fb2a359e640 1 Processor -- start 2023-12-19T05:45:45.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.171+0000 7fb2a359e640 1 -- start start 2023-12-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.172+0000 7fb2a359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2a415e580 0x7fb2a40afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.172+0000 7fb2a359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2a40b02a0 0x7fb2a40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.172+0000 7fb2a359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40b06b0 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.172+0000 7fb2a359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a415ea30 con 0x7fb2a415e580 2023-12-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.172+0000 7fb2a359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a415dae0 con 0x7fb2a40b02a0 2023-12-19T05:45:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2a415e580 0x7fb2a40afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a2d9d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2a40b02a0 0x7fb2a40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2a415e580 0x7fb2a40afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40068/0 (socket says 172.21.15.49:40068) 2023-12-19T05:45:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/3443649274 learned_addr learned my addr 172.21.15.49:0/3443649274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:45.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/3443649274 >> v2:172.21.15.115:3300/0 conn(0x7fb2a40b02a0 msgr2=0x7fb2a40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 --2- 172.21.15.49:0/3443649274 >> v2:172.21.15.115:3300/0 conn(0x7fb2a40b02a0 0x7fb2a40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/3443649274 >> v1:172.21.15.115:6789/0 conn(0x7fb2a40cd4e0 legacy=0x7fb2a415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.173+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/3443649274 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a415b000 con 0x7fb2a415e580 2023-12-19T05:45:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.175+0000 7fb2a1d9b640 1 --2- 172.21.15.49:0/3443649274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a415e580 0x7fb2a40afd60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4067a50 tx=0x7fb28c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3d8fae9e7e3fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.175+0000 7fb2a159a640 1 -- 172.21.15.49:0/3443649274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c030860 con 0x7fb2a415e580 2023-12-19T05:45:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.175+0000 7fb2a159a640 1 -- 172.21.15.49:0/3443649274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c0309c0 con 0x7fb2a415e580 2023-12-19T05:45:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.175+0000 7fb2a159a640 1 -- 172.21.15.49:0/3443649274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c030d50 con 0x7fb2a415e580 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 -- 172.21.15.49:0/3443649274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a415e580 msgr2=0x7fb2a40afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 --2- 172.21.15.49:0/3443649274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a415e580 0x7fb2a40afd60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4067a50 tx=0x7fb28c02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 -- 172.21.15.49:0/3443649274 shutdown_connections 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 --2- 172.21.15.49:0/3443649274 >> v2:172.21.15.115:3300/0 conn(0x7fb2a40b02a0 0x7fb2a40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 --2- 172.21.15.49:0/3443649274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a415e580 0x7fb2a40afd60 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 -- 172.21.15.49:0/3443649274 >> 172.21.15.49:0/3443649274 conn(0x7fb2a406f630 msgr2=0x7fb2a406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 -- 172.21.15.49:0/3443649274 shutdown_connections 2023-12-19T05:45:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.176+0000 7fb2a359e640 1 -- 172.21.15.49:0/3443649274 wait complete. 2023-12-19T05:45:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.178+0000 7fb2a359e640 1 Processor -- start 2023-12-19T05:45:45.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.178+0000 7fb2a359e640 1 -- start start 2023-12-19T05:45:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a40b02a0 0x7fb2a4141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2a415e580 0x7fb2a40b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406d470 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414f380 con 0x7fb2a40b02a0 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414f660 con 0x7fb2a415e580 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40070/0 (socket says 172.21.15.49:40070) 2023-12-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/1971873194 learned_addr learned my addr 172.21.15.49:0/1971873194 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.179+0000 7fb2a259c640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a40b02a0 0x7fb2a4141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a2d9d640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2a415e580 0x7fb2a40b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2a415e580 msgr2=0x7fb2a40b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2a415e580 0x7fb2a40b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a40b02a0 msgr2=0x7fb2a4141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a40b02a0 0x7fb2a4141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 -- 172.21.15.49:0/1971873194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0094d0 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a1d9b640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb28c02b9e0 tx=0x7fb28c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c039c90 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c039e10 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a414f940 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.180+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c043640 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.181+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a406c270 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.182+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a414fe60 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.183+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb28c0437a0 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.184+0000 7fb29affd640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.184+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb28c03e070 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.185+0000 7fb2a259c640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.186+0000 7fb2a259c640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 0x7fb28406c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb2940012e0 tx=0x7fb294009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.189+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2a414fe60 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.384+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2a414fe60 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.385+0000 7fb29affd640 1 -- 172.21.15.49:0/1971873194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb28c034020 con 0x7fb2a40cd4e0 2023-12-19T05:45:45.387 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 msgr2=0x7fb28406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 0x7fb28406c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb2940012e0 tx=0x7fb294009040 comp rx=0 tx=0).stop 2023-12-19T05:45:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 msgr2=0x7fb2a406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb28c02b9e0 tx=0x7fb28c004730 comp rx=0 tx=0).stop 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 shutdown_connections 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2a415e580 0x7fb2a40b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2a40cd4e0 0x7fb2a406c9b0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 --2- 172.21.15.49:0/1971873194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a40b02a0 0x7fb2a4141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 >> 172.21.15.49:0/1971873194 conn(0x7fb2a406f630 msgr2=0x7fb2a4153c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 shutdown_connections 2023-12-19T05:45:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.388+0000 7fb2a359e640 1 -- 172.21.15.49:0/1971873194 wait complete. 2023-12-19T05:45:45.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:45:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.633+0000 7fd164631640 1 Processor -- start 2023-12-19T05:45:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.634+0000 7fd164631640 1 -- start start 2023-12-19T05:45:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.635+0000 7fd164631640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd15c0b0b50 0x7fd15c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd164631640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 0x7fd15c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd164631640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c06bb30 con 0x7fd15c1449e0 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd164631640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0b0070 con 0x7fd15c0b0b50 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd164631640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0b0350 con 0x7fd15c06b590 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd161bcc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd15c0b0b50 0x7fd15c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd161bcc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd15c0b0b50 0x7fd15c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40082/0 (socket says 172.21.15.49:40082) 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd161bcc640 1 -- 172.21.15.49:0/2747863529 learned_addr learned my addr 172.21.15.49:0/2747863529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd162bce640 1 --2- 172.21.15.49:0/2747863529 >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 0x7fd15c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd161bcc640 1 -- 172.21.15.49:0/2747863529 >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 msgr2=0x7fd15c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.636+0000 7fd161bcc640 1 --2- 172.21.15.49:0/2747863529 >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 0x7fd15c06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.637+0000 7fd161bcc640 1 -- 172.21.15.49:0/2747863529 >> v1:172.21.15.115:6789/0 conn(0x7fd15c1449e0 legacy=0x7fd15c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.637+0000 7fd161bcc640 1 -- 172.21.15.49:0/2747863529 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0b0630 con 0x7fd15c0b0b50 2023-12-19T05:45:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.637+0000 7fd162bce640 1 --2- 172.21.15.49:0/2747863529 >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 0x7fd15c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.638+0000 7fd161bcc640 1 --2- 172.21.15.49:0/2747863529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c0b0b50 0x7fd15c06bfa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0b1270 tx=0x7fd15002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd17a5f262ebaeb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.638+0000 7fd1613cb640 1 -- 172.21.15.49:0/2747863529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150031870 con 0x7fd15c0b0b50 2023-12-19T05:45:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.638+0000 7fd1613cb640 1 -- 172.21.15.49:0/2747863529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500319d0 con 0x7fd15c0b0b50 2023-12-19T05:45:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.638+0000 7fd1613cb640 1 -- 172.21.15.49:0/2747863529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150031d60 con 0x7fd15c0b0b50 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 -- 172.21.15.49:0/2747863529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c0b0b50 msgr2=0x7fd15c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 --2- 172.21.15.49:0/2747863529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c0b0b50 0x7fd15c06bfa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0b1270 tx=0x7fd15002b910 comp rx=0 tx=0).stop 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 -- 172.21.15.49:0/2747863529 shutdown_connections 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 --2- 172.21.15.49:0/2747863529 >> v2:172.21.15.115:3300/0 conn(0x7fd15c06b590 0x7fd15c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 --2- 172.21.15.49:0/2747863529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c0b0b50 0x7fd15c06bfa0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 -- 172.21.15.49:0/2747863529 >> 172.21.15.49:0/2747863529 conn(0x7fd15c0cbb70 msgr2=0x7fd15c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 -- 172.21.15.49:0/2747863529 shutdown_connections 2023-12-19T05:45:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.639+0000 7fd164631640 1 -- 172.21.15.49:0/2747863529 wait complete. 2023-12-19T05:45:45.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.641+0000 7fd164631640 1 Processor -- start 2023-12-19T05:45:45.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.641+0000 7fd164631640 1 -- start start 2023-12-19T05:45:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd15c0b0b50 0x7fd15c0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 0x7fd15c140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c1407c0 con 0x7fd15c06b590 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c13bfd0 con 0x7fd15c0b0b50 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd164631640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c15a4e0 con 0x7fd15c1449e0 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.642+0000 7fd1623cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40092/0 (socket says 172.21.15.49:40092) 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 -- 172.21.15.49:0/1431975146 learned_addr learned my addr 172.21.15.49:0/1431975146 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd161bcc640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd15c0b0b50 0x7fd15c0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd162bce640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 0x7fd15c140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 -- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 msgr2=0x7fd15c140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 0x7fd15c140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 -- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd15c0b0b50 msgr2=0x7fd15c0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd15c0b0b50 0x7fd15c0adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 -- 172.21.15.49:0/1431975146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500094d0 con 0x7fd15c06b590 2023-12-19T05:45:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd162bce640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 0x7fd15c140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.643+0000 7fd1623cd640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ba50 tx=0x7fd14c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.644+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00cbe0 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.644+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00cd80 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.644+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c13fb40 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.644+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c014680 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.644+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c140100 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.645+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c061910 con 0x7fd15c06b590 2023-12-19T05:45:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.646+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd14c0147e0 con 0x7fd15c06b590 2023-12-19T05:45:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.647+0000 7fd15affd640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 0x7fd14806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.647+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd14c088940 con 0x7fd15c06b590 2023-12-19T05:45:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.648+0000 7fd161bcc640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 0x7fd14806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:45.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.649+0000 7fd161bcc640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 0x7fd14806c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd150036000 tx=0x7fd15003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:45.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.652+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd14c053eb0 con 0x7fd15c06b590 2023-12-19T05:45:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.848+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd15c140a30 con 0x7fd15c06b590 2023-12-19T05:45:45.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.849+0000 7fd15affd640 1 -- 172.21.15.49:0/1431975146 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd14c0190a0 con 0x7fd15c06b590 2023-12-19T05:45:45.851 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:45:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.851+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 msgr2=0x7fd14806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.851+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 0x7fd14806c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd150036000 tx=0x7fd15003c040 comp rx=0 tx=0).stop 2023-12-19T05:45:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.851+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 msgr2=0x7fd15c13ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.851+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ba50 tx=0x7fd14c00bf10 comp rx=0 tx=0).stop 2023-12-19T05:45:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 shutdown_connections 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd14806a430 0x7fd14806c8f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd15c1449e0 0x7fd15c140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd15c0b0b50 0x7fd15c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 --2- 172.21.15.49:0/1431975146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd15c06b590 0x7fd15c13ba90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 >> 172.21.15.49:0/1431975146 conn(0x7fd15c0cbb70 msgr2=0x7fd15c06fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 shutdown_connections 2023-12-19T05:45:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:45.852+0000 7fd164631640 1 -- 172.21.15.49:0/1431975146 wait complete. 2023-12-19T05:45:45.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:45:46.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.115+0000 7f07c7577640 1 Processor -- start 2023-12-19T05:45:46.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.115+0000 7f07c7577640 1 -- start start 2023-12-19T05:45:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c7577640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07c015b1d0 0x7f07c00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c7577640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c015fde0 con 0x7f07c00ceea0 2023-12-19T05:45:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c7577640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c015ef10 con 0x7f07c00b1ec0 2023-12-19T05:45:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c7577640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b2320 con 0x7f07c015b1d0 2023-12-19T05:45:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c5b14640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07c00ceea0 0x7f07c006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49838/0 (socket says 172.21.15.49:49838) 2023-12-19T05:45:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c5b14640 1 -- 172.21.15.49:0/1570339762 learned_addr learned my addr 172.21.15.49:0/1570339762 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.117+0000 7f07c5313640 1 --2- 172.21.15.49:0/1570339762 >> v2:172.21.15.115:3300/0 conn(0x7f07c015b1d0 0x7f07c00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504470083 0 0) 0x7f07c015fde0 con 0x7f07c00ceea0 2023-12-19T05:45:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ac003520 con 0x7f07c00ceea0 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471169019 0 0) 0x7f07ac003520 con 0x7f07c00ceea0 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 >> v2:172.21.15.115:3300/0 conn(0x7f07c015b1d0 msgr2=0x7f07c00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 --2- 172.21.15.49:0/1570339762 >> v2:172.21.15.115:3300/0 conn(0x7f07c015b1d0 0x7f07c00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 >> v1:172.21.15.115:6789/0 conn(0x7f07c00b1ec0 legacy=0x7f07c015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b2e40 con 0x7f07c00ceea0 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f07b80019f0 con 0x7f07c00ceea0 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 >> v1:172.21.15.49:6789/0 conn(0x7f07c00ceea0 legacy=0x7f07c006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac003a30 0x7f07ac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 0x7f07ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0051d0 0x7f07ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b2320 con 0x7f07ac0047c0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac00c100 con 0x7f07ac003a30 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.118+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac00c2c0 con 0x7f07ac0051d0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 0x7f07ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c5313640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac003a30 0x7f07ac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c5b14640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0051d0 0x7f07ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 -- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0051d0 msgr2=0x7f07ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0051d0 0x7f07ac00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 -- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac003a30 msgr2=0x7f07ac003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac003a30 0x7f07ac003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c4b12640 1 -- 172.21.15.49:0/1570339762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac003520 con 0x7f07ac0047c0 2023-12-19T05:45:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.119+0000 7f07c5b14640 1 -- 172.21.15.49:0/1570339762 reap_dead start 2023-12-19T05:45:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.120+0000 7f07c4b12640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 0x7f07ac004c40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07b0001750 tx=0x7f07ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc95b3725e431f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00052d0 con 0x7f07ac0047c0 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b002e050 con 0x7f07ac0047c0 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07b7fff640 1 -- 172.21.15.49:0/1570339762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0003830 con 0x7f07ac0047c0 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07c7577640 1 -- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 msgr2=0x7f07ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07c7577640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 0x7f07ac004c40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07b0001750 tx=0x7f07ac0057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07c7577640 1 -- 172.21.15.49:0/1570339762 shutdown_connections 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.121+0000 7f07c7577640 1 --2- 172.21.15.49:0/1570339762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0047c0 0x7f07ac004c40 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.122+0000 7f07c7577640 1 -- 172.21.15.49:0/1570339762 >> 172.21.15.49:0/1570339762 conn(0x7f07c0073150 msgr2=0x7f07c00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.122+0000 7f07c7577640 1 -- 172.21.15.49:0/1570339762 shutdown_connections 2023-12-19T05:45:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.122+0000 7f07c7577640 1 -- 172.21.15.49:0/1570339762 wait complete. 2023-12-19T05:45:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.124+0000 7f07c7577640 1 Processor -- start 2023-12-19T05:45:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.124+0000 7f07c7577640 1 -- start start 2023-12-19T05:45:46.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 0x7f07c01455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c015bb60 0x7f07c00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c015d290 con 0x7f07c01f2460 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01485a0 con 0x7f07ac0047c0 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c7577640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0147a20 con 0x7f07c015bb60 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c4b12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c4b12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40112/0 (socket says 172.21.15.49:40112) 2023-12-19T05:45:46.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.125+0000 7f07c4b12640 1 -- 172.21.15.49:0/2669767328 learned_addr learned my addr 172.21.15.49:0/2669767328 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:46.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c5b14640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c015bb60 0x7f07c00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c5313640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 0x7f07c01455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 -- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c015bb60 msgr2=0x7f07c00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c015bb60 0x7f07c00ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 -- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 msgr2=0x7f07c01455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 0x7f07c01455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 -- 172.21.15.49:0/2669767328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0147d00 con 0x7f07c01f2460 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c5313640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 0x7f07c01455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07c4b12640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00076c0 con 0x7f07c01f2460 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0007a30 con 0x7f07c01f2460 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.126+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0006be0 con 0x7f07c01f2460 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.127+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c0147fe0 con 0x7f07c01f2460 2023-12-19T05:45:46.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.127+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c0147610 con 0x7f07c01f2460 2023-12-19T05:45:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.128+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c01477a0 con 0x7f07c01f2460 2023-12-19T05:45:46.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.129+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07b0006d40 con 0x7f07c01f2460 2023-12-19T05:45:46.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.130+0000 7f07b5ffb640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.130+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07b00aa570 con 0x7f07c01f2460 2023-12-19T05:45:46.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.131+0000 7f07c5313640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.132+0000 7f07c5313640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 0x7f07a406c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009a80 tx=0x7f07bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.134+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07b0075b60 con 0x7f07c01f2460 2023-12-19T05:45:46.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.329+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07c0061910 con 0x7f07c01f2460 2023-12-19T05:45:46.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.330+0000 7f07b5ffb640 1 -- 172.21.15.49:0/2669767328 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07b0079180 con 0x7f07c01f2460 2023-12-19T05:45:46.331 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:45:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 msgr2=0x7f07a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 0x7f07a406c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009a80 tx=0x7f07bc008040 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 msgr2=0x7f07c015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0001120 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 shutdown_connections 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c015bb60 0x7f07c00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01f2460 0x7f07c015b620 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 --2- 172.21.15.49:0/2669767328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0047c0 0x7f07c01455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 >> 172.21.15.49:0/2669767328 conn(0x7f07c0073150 msgr2=0x7f07c006e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 shutdown_connections 2023-12-19T05:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.333+0000 7f07c7577640 1 -- 172.21.15.49:0/2669767328 wait complete. 2023-12-19T05:45:46.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:45:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.600+0000 7f7e4e4ec640 1 Processor -- start 2023-12-19T05:45:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.600+0000 7f7e4e4ec640 1 -- start start 2023-12-19T05:45:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e4e4ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e480b0810 0x7f7e48164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e4e4ec640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480ae640 con 0x7f7e48157bf0 2023-12-19T05:45:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e4e4ec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480ae920 con 0x7f7e480ae110 2023-12-19T05:45:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e4e4ec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4806b8c0 con 0x7f7e480b0810 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e47fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7e48157bf0 0x7f7e4815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49850/0 (socket says 172.21.15.49:49850) 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.602+0000 7f7e47fff640 1 -- 172.21.15.49:0/3593162745 learned_addr learned my addr 172.21.15.49:0/3593162745 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e4ca89640 1 --2- 172.21.15.49:0/3593162745 >> v2:172.21.15.49:3300/0 conn(0x7f7e480b0810 0x7f7e48164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e477fe640 1 -- 172.21.15.49:0/3593162745 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871122232 0 0) 0x7f7e480ae640 con 0x7f7e48157bf0 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e477fe640 1 -- 172.21.15.49:0/3593162745 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e34005730 con 0x7f7e48157bf0 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e4ca89640 1 -- 172.21.15.49:0/3593162745 >> v1:172.21.15.115:6789/0 conn(0x7f7e480ae110 legacy=0x7f7e480b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e4ca89640 1 -- 172.21.15.49:0/3593162745 >> v1:172.21.15.49:6789/0 conn(0x7f7e48157bf0 legacy=0x7f7e4815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.603+0000 7f7e4ca89640 1 -- 172.21.15.49:0/3593162745 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480aec00 con 0x7f7e480b0810 2023-12-19T05:45:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.605+0000 7f7e4ca89640 1 --2- 172.21.15.49:0/3593162745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480b0810 0x7f7e48164ed0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009d90 tx=0x7f7e4002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193ab79156e8e017 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.605+0000 7f7e477fe640 1 -- 172.21.15.49:0/3593162745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4002ccf0 con 0x7f7e480b0810 2023-12-19T05:45:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.605+0000 7f7e477fe640 1 -- 172.21.15.49:0/3593162745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4002ce50 con 0x7f7e480b0810 2023-12-19T05:45:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.605+0000 7f7e477fe640 1 -- 172.21.15.49:0/3593162745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40034640 con 0x7f7e480b0810 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/3593162745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480b0810 msgr2=0x7f7e48164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/3593162745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480b0810 0x7f7e48164ed0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009d90 tx=0x7f7e4002bf40 comp rx=0 tx=0).stop 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/3593162745 shutdown_connections 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/3593162745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480b0810 0x7f7e48164ed0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/3593162745 >> 172.21.15.49:0/3593162745 conn(0x7f7e480cbb70 msgr2=0x7f7e480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/3593162745 shutdown_connections 2023-12-19T05:45:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.606+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/3593162745 wait complete. 2023-12-19T05:45:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.608+0000 7f7e4e4ec640 1 Processor -- start 2023-12-19T05:45:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.608+0000 7f7e4e4ec640 1 -- start start 2023-12-19T05:45:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e480b0810 0x7f7e4815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e48157bf0 0x7f7e481f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e481f6030 con 0x7f7e480ae110 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815bf10 con 0x7f7e48157bf0 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e4e4ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e481481c0 con 0x7f7e480b0810 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40124/0 (socket says 172.21.15.49:40124) 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.609+0000 7f7e47fff640 1 -- 172.21.15.49:0/694187992 learned_addr learned my addr 172.21.15.49:0/694187992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e3ffff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e480b0810 0x7f7e4815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e4ca89640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e48157bf0 0x7f7e481f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 -- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e480b0810 msgr2=0x7f7e4815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e480b0810 0x7f7e4815a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 -- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e48157bf0 msgr2=0x7f7e481f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e48157bf0 0x7f7e481f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 -- 172.21.15.49:0/694187992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009a70 con 0x7f7e480ae110 2023-12-19T05:45:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e47fff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c440 tx=0x7f7e3800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38005ce0 con 0x7f7e480ae110 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38005e40 con 0x7f7e480ae110 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380072b0 con 0x7f7e480ae110 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.610+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4815b670 con 0x7f7e480ae110 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.611+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4815bc30 con 0x7f7e480ae110 2023-12-19T05:45:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.612+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e48061910 con 0x7f7e480ae110 2023-12-19T05:45:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.613+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e38007410 con 0x7f7e480ae110 2023-12-19T05:45:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.614+0000 7f7e457fa640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 0x7f7e2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.614+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e38087ed0 con 0x7f7e480ae110 2023-12-19T05:45:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.615+0000 7f7e3ffff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 0x7f7e2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.616+0000 7f7e3ffff640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 0x7f7e2806c920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e48152e10 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.619+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e380534e0 con 0x7f7e480ae110 2023-12-19T05:45:46.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.828+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e480ad2b0 con 0x7f7e480ae110 2023-12-19T05:45:46.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.829+0000 7f7e457fa640 1 -- 172.21.15.49:0/694187992 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e38017080 con 0x7f7e480ae110 2023-12-19T05:45:46.830 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:45:46.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 msgr2=0x7f7e2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 0x7f7e2806c920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e48152e10 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2023-12-19T05:45:46.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 msgr2=0x7f7e48147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:46.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c440 tx=0x7f7e3800c900 comp rx=0 tx=0).stop 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 shutdown_connections 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e2806a460 0x7f7e2806c920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e480b0810 0x7f7e4815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e48157bf0 0x7f7e481f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.831+0000 7f7e4e4ec640 1 --2- 172.21.15.49:0/694187992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e480ae110 0x7f7e48147c80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.832+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 >> 172.21.15.49:0/694187992 conn(0x7f7e480cbb70 msgr2=0x7f7e4806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.832+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 shutdown_connections 2023-12-19T05:45:46.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:46.832+0000 7f7e4e4ec640 1 -- 172.21.15.49:0/694187992 wait complete. 2023-12-19T05:45:46.854 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:45:46.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:46.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:45:46.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:45:46.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:45:46.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:45:47.026 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:45:47.026 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:47.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:45:47.091 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:45:47.091 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:45:47.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:45:47.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.384+0000 7efc7759e640 1 Processor -- start 2023-12-19T05:45:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.384+0000 7efc7759e640 1 -- start start 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc7815e5a0 0x7efc780b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc780b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 0x7efc780ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc780ce5c0 con 0x7efc7815e5a0 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7815ec30 con 0x7efc780cdbf0 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.386+0000 7efc7759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc780b2cc0 con 0x7efc7815f680 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc7815e5a0 0x7efc780b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc7815e5a0 0x7efc780b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40130/0 (socket says 172.21.15.49:40130) 2023-12-19T05:45:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 -- 172.21.15.49:0/1253275440 learned_addr learned my addr 172.21.15.49:0/1253275440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc76d9d640 1 --2- 172.21.15.49:0/1253275440 >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 0x7efc780ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc6ffff640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc780b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 -- 172.21.15.49:0/1253275440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 msgr2=0x7efc780b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc780b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 -- 172.21.15.49:0/1253275440 >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 msgr2=0x7efc780ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 --2- 172.21.15.49:0/1253275440 >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 0x7efc780ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc7659c640 1 -- 172.21.15.49:0/1253275440 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7815e980 con 0x7efc7815e5a0 2023-12-19T05:45:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.387+0000 7efc76d9d640 1 --2- 172.21.15.49:0/1253275440 >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 0x7efc780ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.389+0000 7efc7659c640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc780b2030 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7efc7806b310 tx=0x7efc6802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50528f57f738d06d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.390+0000 7efc75d9b640 1 -- 172.21.15.49:0/1253275440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68031860 con 0x7efc7815e5a0 2023-12-19T05:45:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.390+0000 7efc75d9b640 1 -- 172.21.15.49:0/1253275440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc680319c0 con 0x7efc7815e5a0 2023-12-19T05:45:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.390+0000 7efc75d9b640 1 -- 172.21.15.49:0/1253275440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68031d50 con 0x7efc7815e5a0 2023-12-19T05:45:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.390+0000 7efc7759e640 1 -- 172.21.15.49:0/1253275440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 msgr2=0x7efc780b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc780b2030 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7efc7806b310 tx=0x7efc6802b900 comp rx=0 tx=0).stop 2023-12-19T05:45:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 -- 172.21.15.49:0/1253275440 shutdown_connections 2023-12-19T05:45:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 --2- 172.21.15.49:0/1253275440 >> v2:172.21.15.115:3300/0 conn(0x7efc780cdbf0 0x7efc780ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc780b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 --2- 172.21.15.49:0/1253275440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc780b2030 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 -- 172.21.15.49:0/1253275440 >> 172.21.15.49:0/1253275440 conn(0x7efc780b0100 msgr2=0x7efc780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 -- 172.21.15.49:0/1253275440 shutdown_connections 2023-12-19T05:45:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.391+0000 7efc7759e640 1 -- 172.21.15.49:0/1253275440 wait complete. 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.393+0000 7efc7759e640 1 Processor -- start 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.393+0000 7efc7759e640 1 -- start start 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc780cdbf0 0x7efc781efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc781f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc781f4b60 con 0x7efc7815e5a0 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc78153c70 con 0x7efc780cdbf0 2023-12-19T05:45:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78153f50 con 0x7efc7815f680 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40140/0 (socket says 172.21.15.49:40140) 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 -- 172.21.15.49:0/3902950271 learned_addr learned my addr 172.21.15.49:0/3902950271 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 -- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 msgr2=0x7efc781f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc7659c640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc780cdbf0 0x7efc781efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc781f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 -- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc780cdbf0 msgr2=0x7efc781efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc780cdbf0 0x7efc781efe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.395+0000 7efc6ffff640 1 -- 172.21.15.49:0/3902950271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680094d0 con 0x7efc7815e5a0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc6ffff640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7efc6000d5f0 tx=0x7efc6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600125f0 con 0x7efc7815e5a0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc60012750 con 0x7efc7815e5a0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60012b00 con 0x7efc7815e5a0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc78154230 con 0x7efc7815e5a0 2023-12-19T05:45:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.396+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7814fd80 con 0x7efc7815e5a0 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.398+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc78061910 con 0x7efc7815e5a0 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.399+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc60012c60 con 0x7efc7815e5a0 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.400+0000 7efc6effd640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 0x7efc5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.400+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc60088d00 con 0x7efc7815e5a0 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.400+0000 7efc7659c640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 0x7efc5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.402+0000 7efc7659c640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 0x7efc5806c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc68036000 tx=0x7efc6803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.405+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc600542e0 con 0x7efc7815e5a0 2023-12-19T05:45:47.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.641+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc780ce980 con 0x7efc7815e5a0 2023-12-19T05:45:47.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.642+0000 7efc6effd640 1 -- 172.21.15.49:0/3902950271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7efc60057900 con 0x7efc7815e5a0 2023-12-19T05:45:47.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:47.644 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:47.644 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 msgr2=0x7efc5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 0x7efc5806c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc68036000 tx=0x7efc6803c040 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 msgr2=0x7efc78152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7efc6000d5f0 tx=0x7efc6000dab0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 shutdown_connections 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5806a430 0x7efc5806c8f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7815f680 0x7efc781f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7815e5a0 0x7efc78152890 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 --2- 172.21.15.49:0/3902950271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc780cdbf0 0x7efc781efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 >> 172.21.15.49:0/3902950271 conn(0x7efc780b0100 msgr2=0x7efc780ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.645+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 shutdown_connections 2023-12-19T05:45:47.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.646+0000 7efc7759e640 1 -- 172.21.15.49:0/3902950271 wait complete. 2023-12-19T05:45:47.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.879+0000 7f6ffd8fa640 1 Processor -- start 2023-12-19T05:45:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.880+0000 7f6ffd8fa640 1 -- start start 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.881+0000 7f6ffd8fa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ff8146e30 0x7f6ff80b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.881+0000 7f6ffd8fa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ff80d0c60 0x7f6ff815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.881+0000 7f6ffd8fa640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80d1070 con 0x7f6ff80b7ea0 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.881+0000 7f6ffd8fa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff8147210 con 0x7f6ff8146e30 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.881+0000 7f6ffd8fa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80b8330 con 0x7f6ff80d0c60 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffc8f8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ff8146e30 0x7f6ff80b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ff7fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6ff80b7ea0 0x7f6ff80d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49854/0 (socket says 172.21.15.49:49854) 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ff7fff640 1 -- 172.21.15.49:0/2825412302 learned_addr learned my addr 172.21.15.49:0/2825412302 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffc8f8640 1 -- 172.21.15.49:0/2825412302 >> v2:172.21.15.115:3300/0 conn(0x7f6ff80d0c60 msgr2=0x7f6ff815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffd0f9640 1 --2- 172.21.15.49:0/2825412302 >> v2:172.21.15.115:3300/0 conn(0x7f6ff80d0c60 0x7f6ff815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffc8f8640 1 --2- 172.21.15.49:0/2825412302 >> v2:172.21.15.115:3300/0 conn(0x7f6ff80d0c60 0x7f6ff815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffc8f8640 1 -- 172.21.15.49:0/2825412302 >> v1:172.21.15.49:6789/0 conn(0x7f6ff80b7ea0 legacy=0x7f6ff80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.882+0000 7f6ffc8f8640 1 -- 172.21.15.49:0/2825412302 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80d12d0 con 0x7f6ff8146e30 2023-12-19T05:45:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ffc8f8640 1 --2- 172.21.15.49:0/2825412302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80b7960 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b6450 tx=0x7f6fec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e113b02422f1fc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ff77fe640 1 -- 172.21.15.49:0/2825412302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec02e070 con 0x7f6ff8146e30 2023-12-19T05:45:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ff77fe640 1 -- 172.21.15.49:0/2825412302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0315a0 con 0x7f6ff8146e30 2023-12-19T05:45:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ff77fe640 1 -- 172.21.15.49:0/2825412302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec031930 con 0x7f6ff8146e30 2023-12-19T05:45:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/2825412302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 msgr2=0x7f6ff80b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.884+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/2825412302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80b7960 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b6450 tx=0x7f6fec02b840 comp rx=0 tx=0).stop 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/2825412302 shutdown_connections 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/2825412302 >> v2:172.21.15.115:3300/0 conn(0x7f6ff80d0c60 0x7f6ff815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/2825412302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80b7960 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/2825412302 >> 172.21.15.49:0/2825412302 conn(0x7f6ff80b2990 msgr2=0x7f6ff80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/2825412302 shutdown_connections 2023-12-19T05:45:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.885+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/2825412302 wait complete. 2023-12-19T05:45:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.887+0000 7f6ffd8fa640 1 Processor -- start 2023-12-19T05:45:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.887+0000 7f6ffd8fa640 1 -- start start 2023-12-19T05:45:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ff80b7ea0 0x7f6ff81425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ff80d0c60 0x7f6ff813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cba20 con 0x7f6ff8146e30 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff813fd00 con 0x7f6ff80b7ea0 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd8fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8140800 con 0x7f6ff80d0c60 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd0f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd0f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40156/0 (socket says 172.21.15.49:40156) 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.888+0000 7f6ffd0f9640 1 -- 172.21.15.49:0/591223478 learned_addr learned my addr 172.21.15.49:0/591223478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffc8f8640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ff80b7ea0 0x7f6ff81425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ff7fff640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ff80d0c60 0x7f6ff813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 -- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ff80d0c60 msgr2=0x7f6ff813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ff80d0c60 0x7f6ff813f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 -- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ff80b7ea0 msgr2=0x7f6ff81425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ff80b7ea0 0x7f6ff81425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 -- 172.21.15.49:0/591223478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009400 con 0x7f6ff8146e30 2023-12-19T05:45:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ffd0f9640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000cd70 tx=0x7f6ff000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.889+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0003b90 con 0x7f6ff8146e30 2023-12-19T05:45:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.890+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0003cf0 con 0x7f6ff8146e30 2023-12-19T05:45:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.890+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0004240 con 0x7f6ff8146e30 2023-12-19T05:45:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.890+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff813ff60 con 0x7f6ff8146e30 2023-12-19T05:45:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.890+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff8140520 con 0x7f6ff8146e30 2023-12-19T05:45:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.891+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff8061910 con 0x7f6ff8146e30 2023-12-19T05:45:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.892+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ff00043a0 con 0x7f6ff8146e30 2023-12-19T05:45:47.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.893+0000 7f6ff57fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 0x7f6fdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:47.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.893+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ff0012070 con 0x7f6ff8146e30 2023-12-19T05:45:47.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.893+0000 7f6ffc8f8640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 0x7f6fdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:47.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.895+0000 7f6ffc8f8640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 0x7f6fdc06c8f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6fec036000 tx=0x7f6fec03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:47.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:47.897+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ff0054970 con 0x7f6ff8146e30 2023-12-19T05:45:48.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.095+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff8070030 con 0x7f6ff8146e30 2023-12-19T05:45:48.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.098+0000 7f6ff57fa640 1 -- 172.21.15.49:0/591223478 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f6ff0057f90 con 0x7f6ff8146e30 2023-12-19T05:45:48.100 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:48.100 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:38.452289+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 msgr2=0x7f6fdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 0x7f6fdc06c8f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6fec036000 tx=0x7f6fec03d040 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 msgr2=0x7f6ff80c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000cd70 tx=0x7f6ff000a660 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 shutdown_connections 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6fdc06a430 0x7f6fdc06c8f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ff80d0c60 0x7f6ff813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ff8146e30 0x7f6ff80c9ca0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 --2- 172.21.15.49:0/591223478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ff80b7ea0 0x7f6ff81425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 >> 172.21.15.49:0/591223478 conn(0x7f6ff80b2990 msgr2=0x7f6ff80b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:48.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.101+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 shutdown_connections 2023-12-19T05:45:48.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.102+0000 7f6ffd8fa640 1 -- 172.21.15.49:0/591223478 wait complete. 2023-12-19T05:45:48.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:45:07.124896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:45:08.260498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:48.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.354+0000 7efc80a41640 1 Processor -- start 2023-12-19T05:45:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.354+0000 7efc80a41640 1 -- start start 2023-12-19T05:45:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc80a41640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc7c15b1d0 0x7efc7c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc80a41640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc7c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc80a41640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c15ef10 con 0x7efc7c0ceea0 2023-12-19T05:45:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc80a41640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0b2320 con 0x7efc7c15b1d0 2023-12-19T05:45:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc80a41640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0b2e40 con 0x7efc7c0b1ec0 2023-12-19T05:45:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc7ad9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc7c0ceea0 0x7efc7c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49862/0 (socket says 172.21.15.49:49862) 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.356+0000 7efc7ad9d640 1 -- 172.21.15.49:0/2811474222 learned_addr learned my addr 172.21.15.49:0/2811474222 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> v2:172.21.15.115:3300/0 conn(0x7efc7c15b1d0 0x7efc7c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc73fff640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc7c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406216697 0 0) 0x7efc7c15ef10 con 0x7efc7c0ceea0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc68003520 con 0x7efc7c0ceea0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929608763 0 0) 0x7efc68003520 con 0x7efc7c0ceea0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 msgr2=0x7efc7c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc7c15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 >> v2:172.21.15.115:3300/0 conn(0x7efc7c15b1d0 msgr2=0x7efc7c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 --2- 172.21.15.49:0/2811474222 >> v2:172.21.15.115:3300/0 conn(0x7efc7c15b1d0 0x7efc7c0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0b3120 con 0x7efc7c0ceea0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7efc740019f0 con 0x7efc7c0ceea0 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> v2:172.21.15.115:3300/0 conn(0x7efc7c15b1d0 0x7efc7c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 >> v1:172.21.15.49:6789/0 conn(0x7efc7c0ceea0 legacy=0x7efc7c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680039e0 0x7efc68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680047c0 0x7efc68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0b2320 con 0x7efc680039e0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0b2e40 con 0x7efc680047c0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.357+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6800b980 con 0x7efc7c0b1ec0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680039e0 0x7efc68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc73fff640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680047c0 0x7efc68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7ad9d640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 -- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 msgr2=0x7efc68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc7c0b1ec0 0x7efc68005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 -- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680047c0 msgr2=0x7efc68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680047c0 0x7efc68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc7a59c640 1 -- 172.21.15.49:0/2811474222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68003520 con 0x7efc680039e0 2023-12-19T05:45:48.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.358+0000 7efc73fff640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680047c0 0x7efc68004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.359+0000 7efc7a59c640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680039e0 0x7efc68003e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009cc0 tx=0x7efc680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acee404067c252b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c02c960 con 0x7efc680039e0 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c02cac0 con 0x7efc680039e0 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc79d9b640 1 -- 172.21.15.49:0/2811474222 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c02ce70 con 0x7efc680039e0 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 -- 172.21.15.49:0/2811474222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680039e0 msgr2=0x7efc68003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 --2- 172.21.15.49:0/2811474222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680039e0 0x7efc68003e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009cc0 tx=0x7efc680057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc7ad9d640 1 -- 172.21.15.49:0/2811474222 reap_dead start 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 -- 172.21.15.49:0/2811474222 shutdown_connections 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 -- 172.21.15.49:0/2811474222 >> 172.21.15.49:0/2811474222 conn(0x7efc7c073150 msgr2=0x7efc7c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 -- 172.21.15.49:0/2811474222 shutdown_connections 2023-12-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.360+0000 7efc80a41640 1 -- 172.21.15.49:0/2811474222 wait complete. 2023-12-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.362+0000 7efc80a41640 1 Processor -- start 2023-12-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.362+0000 7efc80a41640 1 -- start start 2023-12-19T05:45:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc680039e0 0x7efc7c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc7c1544f0 0x7efc7c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c15cac0 con 0x7efc7c159130 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c159af0 con 0x7efc7c1544f0 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.363+0000 7efc80a41640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1f5750 con 0x7efc680039e0 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40186/0 (socket says 172.21.15.49:40186) 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 -- 172.21.15.49:0/3820085360 learned_addr learned my addr 172.21.15.49:0/3820085360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7a59c640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc680039e0 0x7efc7c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc73fff640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc7c1544f0 0x7efc7c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 -- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc680039e0 msgr2=0x7efc7c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc680039e0 0x7efc7c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 -- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc7c1544f0 msgr2=0x7efc7c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc7c1544f0 0x7efc7c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.364+0000 7efc7ad9d640 1 -- 172.21.15.49:0/3820085360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c15c7e0 con 0x7efc7c159130 2023-12-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc7ad9d640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0cfd50 tx=0x7efc7400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74004d60 con 0x7efc7c159130 2023-12-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400bb20 con 0x7efc7c159130 2023-12-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400bed0 con 0x7efc7c159130 2023-12-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c1f5100 con 0x7efc7c159130 2023-12-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.365+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c15c440 con 0x7efc7c159130 2023-12-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.367+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c061910 con 0x7efc7c159130 2023-12-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.368+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc74007110 con 0x7efc7c159130 2023-12-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.369+0000 7efc72ffd640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 0x7efc5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.369+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc74088c10 con 0x7efc7c159130 2023-12-19T05:45:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.370+0000 7efc7a59c640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 0x7efc5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.371+0000 7efc7a59c640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 0x7efc5c06c920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.373+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc74054290 con 0x7efc7c159130 2023-12-19T05:45:48.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.570+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc7c1f5890 con 0x7efc7c159130 2023-12-19T05:45:48.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.571+0000 7efc72ffd640 1 -- 172.21.15.49:0/3820085360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc740578b0 con 0x7efc7c159130 2023-12-19T05:45:48.573 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 msgr2=0x7efc5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 0x7efc5c06c920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c030000 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 msgr2=0x7efc7c1595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0cfd50 tx=0x7efc7400b4a0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 shutdown_connections 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a460 0x7efc5c06c920 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc7c159130 0x7efc7c1595b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc7c1544f0 0x7efc7c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 --2- 172.21.15.49:0/3820085360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc680039e0 0x7efc7c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 >> 172.21.15.49:0/3820085360 conn(0x7efc7c073150 msgr2=0x7efc7c155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 shutdown_connections 2023-12-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.574+0000 7efc80a41640 1 -- 172.21.15.49:0/3820085360 wait complete. 2023-12-19T05:45:48.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:45:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.825+0000 7f312998b640 1 Processor -- start 2023-12-19T05:45:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.825+0000 7f312998b640 1 -- start start 2023-12-19T05:45:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f312998b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 0x7f312406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f312998b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f312406b590 0x7f312406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f312998b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312406bb30 con 0x7f31241449e0 2023-12-19T05:45:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f312998b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31240b0070 con 0x7f312406b590 2023-12-19T05:45:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f312998b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31240b0350 con 0x7f31240b0b50 2023-12-19T05:45:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f311a7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 0x7f312406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.828+0000 7f31237fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f312406b590 0x7f312406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f3122ffd640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f31241449e0 0x7f31240af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:55412/0 (socket says 172.21.15.49:55412) 2023-12-19T05:45:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f3122ffd640 1 -- 172.21.15.49:0/1159183058 learned_addr learned my addr 172.21.15.49:0/1159183058 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f311a7fc640 1 -- 172.21.15.49:0/1159183058 >> v2:172.21.15.115:3300/0 conn(0x7f312406b590 msgr2=0x7f312406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f311a7fc640 1 --2- 172.21.15.49:0/1159183058 >> v2:172.21.15.115:3300/0 conn(0x7f312406b590 0x7f312406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f311a7fc640 1 -- 172.21.15.49:0/1159183058 >> v1:172.21.15.115:6789/0 conn(0x7f31241449e0 legacy=0x7f31240af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.829+0000 7f311a7fc640 1 -- 172.21.15.49:0/1159183058 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240b0630 con 0x7f31240b0b50 2023-12-19T05:45:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.831+0000 7f311a7fc640 1 --2- 172.21.15.49:0/1159183058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 0x7f312406bfa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f310c0097a0 tx=0x7f310c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10477d3549f54f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.831+0000 7f31227fc640 1 -- 172.21.15.49:0/1159183058 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c031830 con 0x7f31240b0b50 2023-12-19T05:45:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.832+0000 7f31227fc640 1 -- 172.21.15.49:0/1159183058 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c031990 con 0x7f31240b0b50 2023-12-19T05:45:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.832+0000 7f31227fc640 1 -- 172.21.15.49:0/1159183058 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c031d20 con 0x7f31240b0b50 2023-12-19T05:45:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.832+0000 7f312998b640 1 -- 172.21.15.49:0/1159183058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 msgr2=0x7f312406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.832+0000 7f312998b640 1 --2- 172.21.15.49:0/1159183058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 0x7f312406bfa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f310c0097a0 tx=0x7f310c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 -- 172.21.15.49:0/1159183058 shutdown_connections 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 --2- 172.21.15.49:0/1159183058 >> v2:172.21.15.115:3300/0 conn(0x7f312406b590 0x7f312406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 --2- 172.21.15.49:0/1159183058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31240b0b50 0x7f312406bfa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 -- 172.21.15.49:0/1159183058 >> 172.21.15.49:0/1159183058 conn(0x7f31240cbb70 msgr2=0x7f31240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 -- 172.21.15.49:0/1159183058 shutdown_connections 2023-12-19T05:45:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.833+0000 7f312998b640 1 -- 172.21.15.49:0/1159183058 wait complete. 2023-12-19T05:45:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.835+0000 7f312998b640 1 Processor -- start 2023-12-19T05:45:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.835+0000 7f312998b640 1 -- start start 2023-12-19T05:45:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240b0b50 0x7f312413b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31241449e0 0x7f312415c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312415a350 con 0x7f312406b590 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31241f27b0 con 0x7f31240b0b50 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f312998b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312413ba10 con 0x7f31241449e0 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40194/0 (socket says 172.21.15.49:40194) 2023-12-19T05:45:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.837+0000 7f3122ffd640 1 -- 172.21.15.49:0/3246787496 learned_addr learned my addr 172.21.15.49:0/3246787496 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f31237fe640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31241449e0 0x7f312415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f311a7fc640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240b0b50 0x7f312413b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 -- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31241449e0 msgr2=0x7f312415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31241449e0 0x7f312415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 -- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240b0b50 msgr2=0x7f312413b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240b0b50 0x7f312413b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 -- 172.21.15.49:0/3246787496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c009400 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3122ffd640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f311400cac0 tx=0x7f311400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311400ac30 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311400ad90 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114012620 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.838+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312413bcb0 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.839+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312413c270 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.840+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124061910 con 0x7f312406b590 2023-12-19T05:45:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.841+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3114007070 con 0x7f312406b590 2023-12-19T05:45:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.843+0000 7f3120ff9640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 0x7f310406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.843+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3114088920 con 0x7f312406b590 2023-12-19T05:45:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.843+0000 7f311a7fc640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 0x7f310406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:48.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.845+0000 7f311a7fc640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 0x7f310406c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f310c036000 tx=0x7f310c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:48.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:48.847+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3114053e70 con 0x7f312406b590 2023-12-19T05:45:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.041+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31240cec70 con 0x7f312406b590 2023-12-19T05:45:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.042+0000 7f3120ff9640 1 -- 172.21.15.49:0/3246787496 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31140170a0 con 0x7f312406b590 2023-12-19T05:45:49.044 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 msgr2=0x7f310406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 0x7f310406c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f310c036000 tx=0x7f310c03c040 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 msgr2=0x7f3124159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f311400cac0 tx=0x7f311400cf80 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 shutdown_connections 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f310406a430 0x7f310406c8f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31241449e0 0x7f312415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240b0b50 0x7f312413b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 --2- 172.21.15.49:0/3246787496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f312406b590 0x7f3124159e10 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 >> 172.21.15.49:0/3246787496 conn(0x7f31240cbb70 msgr2=0x7f312406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 shutdown_connections 2023-12-19T05:45:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.045+0000 7f312998b640 1 -- 172.21.15.49:0/3246787496 wait complete. 2023-12-19T05:45:49.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:45:49.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.306+0000 7fec91dce640 1 Processor -- start 2023-12-19T05:45:49.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.307+0000 7fec91dce640 1 -- start start 2023-12-19T05:45:49.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec8c154760 0x7fec8c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c0cb810 0x7fec8c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec8c0b0070 0x7fec8c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0ccf20 con 0x7fec8c154760 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0b0a30 con 0x7fec8c0b0070 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.308+0000 7fec91dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0ccbd0 con 0x7fec8c0cb810 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec8c154760 0x7fec8c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec8c154760 0x7fec8c15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40208/0 (socket says 172.21.15.49:40208) 2023-12-19T05:45:49.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 -- 172.21.15.49:0/1611299498 learned_addr learned my addr 172.21.15.49:0/1611299498 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec83fff640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c0cb810 0x7fec8c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8bfff640 1 --2- 172.21.15.49:0/1611299498 >> v2:172.21.15.115:3300/0 conn(0x7fec8c0b0070 0x7fec8c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 -- 172.21.15.49:0/1611299498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c0cb810 msgr2=0x7fec8c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c0cb810 0x7fec8c0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 -- 172.21.15.49:0/1611299498 >> v2:172.21.15.115:3300/0 conn(0x7fec8c0b0070 msgr2=0x7fec8c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/1611299498 >> v2:172.21.15.115:3300/0 conn(0x7fec8c0b0070 0x7fec8c0b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.309+0000 7fec8b7fe640 1 -- 172.21.15.49:0/1611299498 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c154b40 con 0x7fec8c154760 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c154760 0x7fec8c15b290 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0ce230 tx=0x7fec7c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b629a87e7946381c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec8affd640 1 -- 172.21.15.49:0/1611299498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0317e0 con 0x7fec8c154760 2023-12-19T05:45:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec8affd640 1 -- 172.21.15.49:0/1611299498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c031940 con 0x7fec8c154760 2023-12-19T05:45:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec8affd640 1 -- 172.21.15.49:0/1611299498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c031cd0 con 0x7fec8c154760 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec91dce640 1 -- 172.21.15.49:0/1611299498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c154760 msgr2=0x7fec8c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.311+0000 7fec91dce640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c154760 0x7fec8c15b290 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0ce230 tx=0x7fec7c02b880 comp rx=0 tx=0).stop 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 -- 172.21.15.49:0/1611299498 shutdown_connections 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 --2- 172.21.15.49:0/1611299498 >> v2:172.21.15.115:3300/0 conn(0x7fec8c0b0070 0x7fec8c0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c0cb810 0x7fec8c0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 --2- 172.21.15.49:0/1611299498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c154760 0x7fec8c15b290 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 -- 172.21.15.49:0/1611299498 >> 172.21.15.49:0/1611299498 conn(0x7fec8c073150 msgr2=0x7fec8c0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 -- 172.21.15.49:0/1611299498 shutdown_connections 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.312+0000 7fec91dce640 1 -- 172.21.15.49:0/1611299498 wait complete. 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.313+0000 7fec91dce640 1 Processor -- start 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.314+0000 7fec91dce640 1 -- start start 2023-12-19T05:45:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 0x7fec8c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c154760 0x7fec8c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c152880 con 0x7fec8c0cb810 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c156ff0 con 0x7fec8c0b0070 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec91dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c1572d0 con 0x7fec8c154760 2023-12-19T05:45:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40216/0 (socket says 172.21.15.49:40216) 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec83fff640 1 -- 172.21.15.49:0/3400282613 learned_addr learned my addr 172.21.15.49:0/3400282613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 0x7fec8c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.315+0000 7fec8bfff640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c154760 0x7fec8c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 -- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c154760 msgr2=0x7fec8c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c154760 0x7fec8c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 -- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 msgr2=0x7fec8c152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 0x7fec8c152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 -- 172.21.15.49:0/3400282613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0094d0 con 0x7fec8c0cb810 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 0x7fec8c152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec83fff640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d5d0 tx=0x7fec7400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74004240 con 0x7fec8c0cb810 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec740043a0 con 0x7fec8c0cb810 2023-12-19T05:45:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74003830 con 0x7fec8c0cb810 2023-12-19T05:45:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c1575b0 con 0x7fec8c0cb810 2023-12-19T05:45:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.316+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c15b6a0 con 0x7fec8c0cb810 2023-12-19T05:45:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.318+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c1577a0 con 0x7fec8c0cb810 2023-12-19T05:45:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.318+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec74003990 con 0x7fec8c0cb810 2023-12-19T05:45:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.319+0000 7fec88ff9640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 0x7fec6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.319+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec74088b90 con 0x7fec8c0cb810 2023-12-19T05:45:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.320+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 0x7fec6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.321+0000 7fec8b7fe640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 0x7fec6c06c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec7c036000 tx=0x7fec7c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.324+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fec740540e0 con 0x7fec8c0cb810 2023-12-19T05:45:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.518+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec8c061910 con 0x7fec8c0cb810 2023-12-19T05:45:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.519+0000 7fec88ff9640 1 -- 172.21.15.49:0/3400282613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec74057700 con 0x7fec8c0cb810 2023-12-19T05:45:49.520 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:45:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.521+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 msgr2=0x7fec6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.521+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 0x7fec6c06c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec7c036000 tx=0x7fec7c03d040 comp rx=0 tx=0).stop 2023-12-19T05:45:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.521+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 msgr2=0x7fec8c1567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.521+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d5d0 tx=0x7fec7400da90 comp rx=0 tx=0).stop 2023-12-19T05:45:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 shutdown_connections 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fec6c06a430 0x7fec6c06c8f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec8c154760 0x7fec8c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec8c0cb810 0x7fec8c1567a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 --2- 172.21.15.49:0/3400282613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec8c0b0070 0x7fec8c152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 >> 172.21.15.49:0/3400282613 conn(0x7fec8c073150 msgr2=0x7fec8c070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 shutdown_connections 2023-12-19T05:45:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.522+0000 7fec91dce640 1 -- 172.21.15.49:0/3400282613 wait complete. 2023-12-19T05:45:49.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.766+0000 7fba16eb6640 1 Processor -- start 2023-12-19T05:45:49.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.766+0000 7fba16eb6640 1 -- start start 2023-12-19T05:45:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba16eb6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fba101449e0 0x7fba100af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba16eb6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100afb10 con 0x7fba1006c6b0 2023-12-19T05:45:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba16eb6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1006bb30 con 0x7fba100b0b50 2023-12-19T05:45:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba16eb6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100b0070 con 0x7fba101449e0 2023-12-19T05:45:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba15453640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fba1006c6b0 0x7fba100b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49874/0 (socket says 172.21.15.49:49874) 2023-12-19T05:45:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.768+0000 7fba15453640 1 -- 172.21.15.49:0/2051240372 learned_addr learned my addr 172.21.15.49:0/2051240372 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966838167 0 0) 0x7fba100afb10 con 0x7fba1006c6b0 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc003520 con 0x7fba1006c6b0 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba14c52640 1 --2- 172.21.15.49:0/2051240372 >> v2:172.21.15.115:3300/0 conn(0x7fba101449e0 0x7fba100af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393080273 0 0) 0x7fb9fc003520 con 0x7fba1006c6b0 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 >> v2:172.21.15.115:3300/0 conn(0x7fba101449e0 msgr2=0x7fba100af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 --2- 172.21.15.49:0/2051240372 >> v2:172.21.15.115:3300/0 conn(0x7fba101449e0 0x7fba100af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 >> v1:172.21.15.115:6789/0 conn(0x7fba100b0b50 legacy=0x7fba1006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100b0350 con 0x7fba1006c6b0 2023-12-19T05:45:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fba08001670 con 0x7fba1006c6b0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 >> v1:172.21.15.49:6789/0 conn(0x7fba1006c6b0 legacy=0x7fba100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.769+0000 7fba0f7fe640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0f7fe640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0f7fe640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 0x7fb9fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100b0070 con 0x7fb9fc0051f0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c150 con 0x7fb9fc0039e0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c310 con 0x7fb9fc0047c0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 0x7fb9fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba14c52640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba0ffff640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 -- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9fc0047c0 msgr2=0x7fb9fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 -- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0039e0 msgr2=0x7fb9fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.770+0000 7fba15453640 1 -- 172.21.15.49:0/2051240372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc003520 con 0x7fb9fc0051f0 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.771+0000 7fba15453640 1 -- 172.21.15.49:0/2051240372 reap_dead start 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.771+0000 7fba15453640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 0x7fb9fc00b980 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c240 tx=0x7fb9fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c86d1a25e3380 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08005ad0 con 0x7fb9fc0051f0 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08005c70 con 0x7fb9fc0051f0 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba0f7fe640 1 -- 172.21.15.49:0/2051240372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0802c8b0 con 0x7fb9fc0051f0 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba16eb6640 1 -- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 msgr2=0x7fb9fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba16eb6640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 0x7fb9fc00b980 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c240 tx=0x7fb9fc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba16eb6640 1 -- 172.21.15.49:0/2051240372 shutdown_connections 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba16eb6640 1 --2- 172.21.15.49:0/2051240372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc0051f0 0x7fb9fc00b980 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.772+0000 7fba16eb6640 1 -- 172.21.15.49:0/2051240372 >> 172.21.15.49:0/2051240372 conn(0x7fba100cbb70 msgr2=0x7fba100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.773+0000 7fba16eb6640 1 -- 172.21.15.49:0/2051240372 shutdown_connections 2023-12-19T05:45:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.773+0000 7fba16eb6640 1 -- 172.21.15.49:0/2051240372 wait complete. 2023-12-19T05:45:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.774+0000 7fba16eb6640 1 Processor -- start 2023-12-19T05:45:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 -- start start 2023-12-19T05:45:49.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0051f0 0x7fba10142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba101344e0 0x7fba101f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba10142780 con 0x7fba10134960 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101f2fe0 con 0x7fb9fc0051f0 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.775+0000 7fba16eb6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba101f32c0 con 0x7fba101344e0 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40228/0 (socket says 172.21.15.49:40228) 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 -- 172.21.15.49:0/1397771094 learned_addr learned my addr 172.21.15.49:0/1397771094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 -- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba101344e0 msgr2=0x7fba101f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba0ffff640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba101344e0 0x7fba101f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba101344e0 0x7fba101f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 -- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0051f0 msgr2=0x7fba10142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0051f0 0x7fba10142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.776+0000 7fba15453640 1 -- 172.21.15.49:0/1397771094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba101f35a0 con 0x7fba10134960 2023-12-19T05:45:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba15453640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c360 tx=0x7fba08001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080049e0 con 0x7fba10134960 2023-12-19T05:45:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08004b40 con 0x7fba10134960 2023-12-19T05:45:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0802de80 con 0x7fba10134960 2023-12-19T05:45:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101f3880 con 0x7fba10134960 2023-12-19T05:45:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.777+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100c3e90 con 0x7fba10134960 2023-12-19T05:45:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.778+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba101f6280 con 0x7fba10134960 2023-12-19T05:45:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.779+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba08032070 con 0x7fba10134960 2023-12-19T05:45:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.780+0000 7fba0d7fa640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.780+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba0803c070 con 0x7fba10134960 2023-12-19T05:45:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.781+0000 7fba14c52640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.782+0000 7fba14c52640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 0x7fb9f006c920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba000070b0 tx=0x7fba0000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:49.784+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba101f6280 con 0x7fba10134960 2023-12-19T05:45:50.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.015+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba101f6280 con 0x7fba10134960 2023-12-19T05:45:50.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.016+0000 7fba0d7fa640 1 -- 172.21.15.49:0/1397771094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fba101f6280 con 0x7fba10134960 2023-12-19T05:45:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:50.018 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:50.018 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 msgr2=0x7fb9f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 0x7fb9f006c920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba000070b0 tx=0x7fba0000b040 comp rx=0 tx=0).stop 2023-12-19T05:45:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 msgr2=0x7fba101f6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c360 tx=0x7fba08001a00 comp rx=0 tx=0).stop 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 shutdown_connections 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba101344e0 0x7fba101f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba10134960 0x7fba101f6aa0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 --2- 172.21.15.49:0/1397771094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9fc0051f0 0x7fba10142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 >> 172.21.15.49:0/1397771094 conn(0x7fba100cbb70 msgr2=0x7fba1006f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 shutdown_connections 2023-12-19T05:45:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.018+0000 7fba16eb6640 1 -- 172.21.15.49:0/1397771094 wait complete. 2023-12-19T05:45:50.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.266+0000 7fe6b759e640 1 Processor -- start 2023-12-19T05:45:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.266+0000 7fe6b759e640 1 -- start start 2023-12-19T05:45:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6b815e5a0 0x7fe6b80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b815ec30 con 0x7fe6b815f680 2023-12-19T05:45:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b815e980 con 0x7fe6b80cdbf0 2023-12-19T05:45:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b80b2f90 con 0x7fe6b815e5a0 2023-12-19T05:45:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b5d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6b815f680 0x7fe6b80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49884/0 (socket says 172.21.15.49:49884) 2023-12-19T05:45:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.268+0000 7fe6b5d9b640 1 -- 172.21.15.49:0/3429390174 learned_addr learned my addr 172.21.15.49:0/3429390174 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b659c640 1 --2- 172.21.15.49:0/3429390174 >> v2:172.21.15.115:3300/0 conn(0x7fe6b815e5a0 0x7fe6b80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349249025 0 0) 0x7fe6b815ec30 con 0x7fe6b815f680 2023-12-19T05:45:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6a0003520 con 0x7fe6b815f680 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3034327620 0 0) 0x7fe6a0003520 con 0x7fe6b815f680 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 >> v2:172.21.15.115:3300/0 conn(0x7fe6b815e5a0 msgr2=0x7fe6b80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 --2- 172.21.15.49:0/3429390174 >> v2:172.21.15.115:3300/0 conn(0x7fe6b815e5a0 0x7fe6b80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 >> v1:172.21.15.115:6789/0 conn(0x7fe6b80cdbf0 legacy=0x7fe6b806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80b3270 con 0x7fe6b815f680 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe6ac001670 con 0x7fe6b815f680 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 >> v1:172.21.15.49:6789/0 conn(0x7fe6b815f680 legacy=0x7fe6b80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a00039c0 0x7fe6a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80b2f90 con 0x7fe6a0005180 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.269+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000c080 con 0x7fe6a00047c0 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000c240 con 0x7fe6a00039c0 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b5d9b640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b659c640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a00039c0 0x7fe6a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a00039c0 msgr2=0x7fe6a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a00039c0 0x7fe6a0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a00047c0 msgr2=0x7fe6a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.270+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/3429390174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0003520 con 0x7fe6a0005180 2023-12-19T05:45:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.271+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/3429390174 reap_dead start 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 0x7fe6a000b980 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001e50 tx=0x7fe6a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829986124ffe48b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0003b70 con 0x7fe6a0005180 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0003d10 con 0x7fe6a0005180 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b559a640 1 -- 172.21.15.49:0/3429390174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0005310 con 0x7fe6a0005180 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b759e640 1 -- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 msgr2=0x7fe6a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.272+0000 7fe6b759e640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 0x7fe6a000b980 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001e50 tx=0x7fe6a00057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.273+0000 7fe6b759e640 1 -- 172.21.15.49:0/3429390174 shutdown_connections 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.273+0000 7fe6b759e640 1 --2- 172.21.15.49:0/3429390174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.273+0000 7fe6b759e640 1 -- 172.21.15.49:0/3429390174 >> 172.21.15.49:0/3429390174 conn(0x7fe6b80b0100 msgr2=0x7fe6b80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.273+0000 7fe6b759e640 1 -- 172.21.15.49:0/3429390174 shutdown_connections 2023-12-19T05:45:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.273+0000 7fe6b759e640 1 -- 172.21.15.49:0/3429390174 wait complete. 2023-12-19T05:45:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.274+0000 7fe6b759e640 1 Processor -- start 2023-12-19T05:45:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.275+0000 7fe6b759e640 1 -- start start 2023-12-19T05:45:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a0005180 0x7fe6b81f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b80acdc0 0x7fe6b815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81f18e0 con 0x7fe6b81f45f0 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81f0e30 con 0x7fe6b80acdc0 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b815dcb0 con 0x7fe6a0005180 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40250/0 (socket says 172.21.15.49:40250) 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/1325451528 learned_addr learned my addr 172.21.15.49:0/1325451528 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b659c640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a0005180 0x7fe6b81f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b5d9b640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b80acdc0 0x7fe6b815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a0005180 msgr2=0x7fe6b81f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a0005180 0x7fe6b81f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b80acdc0 msgr2=0x7fe6b815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.276+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b80acdc0 0x7fe6b815d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6b6d9d640 1 -- 172.21.15.49:0/1325451528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b81f1040 con 0x7fe6b81f45f0 2023-12-19T05:45:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6b6d9d640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001f70 tx=0x7fe6b00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0003b30 con 0x7fe6b81f45f0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0039480 con 0x7fe6b81f45f0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0039810 con 0x7fe6b81f45f0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b81f1320 con 0x7fe6b81f45f0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.277+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b81f40d0 con 0x7fe6b81f45f0 2023-12-19T05:45:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.279+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b81f3f30 con 0x7fe6b81f45f0 2023-12-19T05:45:50.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.280+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6b0039970 con 0x7fe6b81f45f0 2023-12-19T05:45:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.281+0000 7fe6a6ffd640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 0x7fe69806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.281+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6b00aa9c0 con 0x7fe6b81f45f0 2023-12-19T05:45:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.281+0000 7fe6b659c640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 0x7fe69806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.282+0000 7fe6b659c640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 0x7fe69806c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009990 tx=0x7fe6a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.285+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6b81f3f30 con 0x7fe6b81f45f0 2023-12-19T05:45:50.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.481+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6b81f3f30 con 0x7fe6b81f45f0 2023-12-19T05:45:50.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.484+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/1325451528 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fe6b81f3f30 con 0x7fe6b81f45f0 2023-12-19T05:45:50.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:50.486 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:38.452289+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:50.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 msgr2=0x7fe69806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 0x7fe69806c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009990 tx=0x7fe6a8008040 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 msgr2=0x7fe6b81f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001f70 tx=0x7fe6b00014a0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 shutdown_connections 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe69806a430 0x7fe69806c8f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6b81f45f0 0x7fe6b81f4a70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b80acdc0 0x7fe6b815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 --2- 172.21.15.49:0/1325451528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a0005180 0x7fe6b81f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 >> 172.21.15.49:0/1325451528 conn(0x7fe6b80b0100 msgr2=0x7fe6b80ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:50.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 shutdown_connections 2023-12-19T05:45:50.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.487+0000 7fe6b759e640 1 -- 172.21.15.49:0/1325451528 wait complete. 2023-12-19T05:45:50.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:45:50.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.735+0000 7fc4972b6640 1 Processor -- start 2023-12-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.736+0000 7fc4972b6640 1 -- start start 2023-12-19T05:45:50.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.737+0000 7fc4972b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc490159f30 0x7fc4900ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc4972b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900b2670 0x7fc4900b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc4972b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900ced50 con 0x7fc4900cb180 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc4972b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900b3060 con 0x7fc4900b2670 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc4972b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015a310 con 0x7fc490159f30 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc496ab5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900b2670 0x7fc4900b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc496ab5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900b2670 0x7fc4900b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40254/0 (socket says 172.21.15.49:40254) 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc496ab5640 1 -- 172.21.15.49:0/1025475851 learned_addr learned my addr 172.21.15.49:0/1025475851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:50.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.738+0000 7fc4962b4640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc490159f30 0x7fc4900ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.739+0000 7fc496ab5640 1 -- 172.21.15.49:0/1025475851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc490159f30 msgr2=0x7fc4900ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:50.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.739+0000 7fc496ab5640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc490159f30 0x7fc4900ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.739+0000 7fc496ab5640 1 -- 172.21.15.49:0/1025475851 >> v1:172.21.15.115:6789/0 conn(0x7fc4900cb180 legacy=0x7fc4900ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.739+0000 7fc496ab5640 1 -- 172.21.15.49:0/1025475851 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900cc850 con 0x7fc4900b2670 2023-12-19T05:45:50.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.740+0000 7fc496ab5640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900b2670 0x7fc4900b2b20 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94966ef1ee71afb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.740+0000 7fc4952b2640 1 -- 172.21.15.49:0/1025475851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48802ca80 con 0x7fc4900b2670 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.740+0000 7fc4952b2640 1 -- 172.21.15.49:0/1025475851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48802cbe0 con 0x7fc4900b2670 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.740+0000 7fc4952b2640 1 -- 172.21.15.49:0/1025475851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4880343f0 con 0x7fc4900b2670 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 -- 172.21.15.49:0/1025475851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900b2670 msgr2=0x7fc4900b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900b2670 0x7fc4900b2b20 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48802bee0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 -- 172.21.15.49:0/1025475851 shutdown_connections 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900b2670 0x7fc4900b2b20 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1025475851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc490159f30 0x7fc4900ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 -- 172.21.15.49:0/1025475851 >> 172.21.15.49:0/1025475851 conn(0x7fc490065b80 msgr2=0x7fc4900b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 -- 172.21.15.49:0/1025475851 shutdown_connections 2023-12-19T05:45:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.741+0000 7fc4972b6640 1 -- 172.21.15.49:0/1025475851 wait complete. 2023-12-19T05:45:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.744+0000 7fc4972b6640 1 Processor -- start 2023-12-19T05:45:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.744+0000 7fc4972b6640 1 -- start start 2023-12-19T05:45:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4900b2670 0x7fc49013f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 0x7fc490150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015c5e0 con 0x7fc490153b50 2023-12-19T05:45:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015be30 con 0x7fc490159f30 2023-12-19T05:45:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.745+0000 7fc4972b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015b870 con 0x7fc4900b2670 2023-12-19T05:45:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40264/0 (socket says 172.21.15.49:40264) 2023-12-19T05:45:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 -- 172.21.15.49:0/1044584032 learned_addr learned my addr 172.21.15.49:0/1044584032 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc495ab3640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 0x7fc490150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc4962b4640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4900b2670 0x7fc49013f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 -- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4900b2670 msgr2=0x7fc49013f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4900b2670 0x7fc49013f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 -- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 msgr2=0x7fc490150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 0x7fc490150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc496ab5640 1 -- 172.21.15.49:0/1044584032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488009b30 con 0x7fc490153b50 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.746+0000 7fc495ab3640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 0x7fc490150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc496ab5640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc4880011e0 tx=0x7fc488004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488009510 con 0x7fc490153b50 2023-12-19T05:45:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48803e450 con 0x7fc490153b50 2023-12-19T05:45:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48803e7e0 con 0x7fc490153b50 2023-12-19T05:45:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49015bb50 con 0x7fc490153b50 2023-12-19T05:45:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.747+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc490151060 con 0x7fc490153b50 2023-12-19T05:45:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.748+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49015c720 con 0x7fc490153b50 2023-12-19T05:45:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.749+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc48802cd50 con 0x7fc490153b50 2023-12-19T05:45:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.750+0000 7fc486ffd640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 0x7fc47406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.750+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4880ab4c0 con 0x7fc490153b50 2023-12-19T05:45:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.751+0000 7fc4962b4640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 0x7fc47406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.752+0000 7fc4962b4640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 0x7fc47406c8f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.755+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc49015c720 con 0x7fc490153b50 2023-12-19T05:45:50.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.994+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc49015c720 con 0x7fc490153b50 2023-12-19T05:45:50.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.996+0000 7fc486ffd640 1 -- 172.21.15.49:0/1044584032 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fc49015c720 con 0x7fc490153b50 2023-12-19T05:45:50.997 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:50.998 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:50.998 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:51.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 msgr2=0x7fc47406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 0x7fc47406c8f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c008040 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 msgr2=0x7fc49013fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc4880011e0 tx=0x7fc488004a90 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 shutdown_connections 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc47406a430 0x7fc47406c8f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc490153b50 0x7fc49013fff0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc490159f30 0x7fc490150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 --2- 172.21.15.49:0/1044584032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4900b2670 0x7fc49013f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 >> 172.21.15.49:0/1044584032 conn(0x7fc490065b80 msgr2=0x7fc4901576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 shutdown_connections 2023-12-19T05:45:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:50.999+0000 7fc4972b6640 1 -- 172.21.15.49:0/1044584032 wait complete. 2023-12-19T05:45:51.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:45:51.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.243+0000 7fd660915640 1 Processor -- start 2023-12-19T05:45:51.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.243+0000 7fd660915640 1 -- start start 2023-12-19T05:45:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd660915640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd65c15e5a0 0x7fd65c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd660915640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c15f680 0x7fd65c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd660915640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c15ec30 con 0x7fd65c0cdbf0 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd660915640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c0b2cc0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd660915640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c15e980 con 0x7fd65c15f680 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd65b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd65c15e5a0 0x7fd65c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd65b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd65c15e5a0 0x7fd65c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40274/0 (socket says 172.21.15.49:40274) 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd65b7fe640 1 -- 172.21.15.49:0/3229551939 learned_addr learned my addr 172.21.15.49:0/3229551939 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd65bfff640 1 --1- 172.21.15.49:0/3229551939 >> v1:172.21.15.49:6789/0 conn(0x7fd65c0cdbf0 0x7fd65c06c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49886/0 (socket says 172.21.15.49:49886) 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.245+0000 7fd65affd640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c15f680 0x7fd65c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.246+0000 7fd65b7fe640 1 -- 172.21.15.49:0/3229551939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c15f680 msgr2=0x7fd65c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.246+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c15f680 0x7fd65c0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.246+0000 7fd65b7fe640 1 -- 172.21.15.49:0/3229551939 >> v1:172.21.15.49:6789/0 conn(0x7fd65c0cdbf0 legacy=0x7fd65c06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.246+0000 7fd65b7fe640 1 -- 172.21.15.49:0/3229551939 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0b2f90 con 0x7fd65c15e5a0 2023-12-19T05:45:51.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.247+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c0b2030 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009870 tx=0x7fd64c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc90ecd8ab2201d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.247+0000 7fd65a7fc640 1 -- 172.21.15.49:0/3229551939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c030840 con 0x7fd65c15e5a0 2023-12-19T05:45:51.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.247+0000 7fd65a7fc640 1 -- 172.21.15.49:0/3229551939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0309a0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.247+0000 7fd65a7fc640 1 -- 172.21.15.49:0/3229551939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c030d30 con 0x7fd65c15e5a0 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 -- 172.21.15.49:0/3229551939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 msgr2=0x7fd65c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c0b2030 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009870 tx=0x7fd64c02b980 comp rx=0 tx=0).stop 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 -- 172.21.15.49:0/3229551939 shutdown_connections 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c15f680 0x7fd65c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 --2- 172.21.15.49:0/3229551939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c0b2030 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 -- 172.21.15.49:0/3229551939 >> 172.21.15.49:0/3229551939 conn(0x7fd65c0b0100 msgr2=0x7fd65c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 -- 172.21.15.49:0/3229551939 shutdown_connections 2023-12-19T05:45:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.248+0000 7fd660915640 1 -- 172.21.15.49:0/3229551939 wait complete. 2023-12-19T05:45:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.250+0000 7fd660915640 1 Processor -- start 2023-12-19T05:45:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.250+0000 7fd660915640 1 -- start start 2023-12-19T05:45:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 0x7fd65c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 0x7fd65c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1f6550 con 0x7fd65c15e5a0 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c14bdb0 con 0x7fd65c15f680 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd660915640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c14c060 con 0x7fd65c0cdbf0 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd65affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd65affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40282/0 (socket says 172.21.15.49:40282) 2023-12-19T05:45:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd65affd640 1 -- 172.21.15.49:0/3941093750 learned_addr learned my addr 172.21.15.49:0/3941093750 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.251+0000 7fd65bfff640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 0x7fd65c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 0x7fd65c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 -- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 msgr2=0x7fd65c06d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 0x7fd65c06d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 -- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 msgr2=0x7fd65c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 0x7fd65c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 -- 172.21.15.49:0/3941093750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0094d0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 0x7fd65c06d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65bfff640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 0x7fd65c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd65affd640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d5f0 tx=0x7fd65000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500125f0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650012750 con 0x7fd65c15e5a0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650012b00 con 0x7fd65c15e5a0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.252+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c1f5c20 con 0x7fd65c15e5a0 2023-12-19T05:45:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.253+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c1f61e0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.254+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c1f63a0 con 0x7fd65c15e5a0 2023-12-19T05:45:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.255+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd650012c60 con 0x7fd65c15e5a0 2023-12-19T05:45:51.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.256+0000 7fd643fff640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 0x7fd64806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.256+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd650088d60 con 0x7fd65c15e5a0 2023-12-19T05:45:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.256+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 0x7fd64806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.257+0000 7fd65b7fe640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 0x7fd64806c8f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd64c036000 tx=0x7fd64c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.260+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd650054350 con 0x7fd65c15e5a0 2023-12-19T05:45:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.488+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd65c061910 con 0x7fd65c15e5a0 2023-12-19T05:45:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.489+0000 7fd643fff640 1 -- 172.21.15.49:0/3941093750 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fd650057970 con 0x7fd65c15e5a0 2023-12-19T05:45:51.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:51.490 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:45:09.226653+0000","modified":"2023-12-19T05:45:12.725224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3756494171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3756494171},{"type":"v1","addr":"172.21.15.115:6837","nonce":3756494171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T05:45:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 msgr2=0x7fd64806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 0x7fd64806c8f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd64c036000 tx=0x7fd64c03b040 comp rx=0 tx=0).stop 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 msgr2=0x7fd65c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d5f0 tx=0x7fd65000dab0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 shutdown_connections 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd64806a430 0x7fd64806c8f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd65c15f680 0x7fd65c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd65c15e5a0 0x7fd65c14b330 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 --2- 172.21.15.49:0/3941093750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd65c0cdbf0 0x7fd65c06d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.491+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 >> 172.21.15.49:0/3941093750 conn(0x7fd65c0b0100 msgr2=0x7fd65c159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.492+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 shutdown_connections 2023-12-19T05:45:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.492+0000 7fd660915640 1 -- 172.21.15.49:0/3941093750 wait complete. 2023-12-19T05:45:51.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:51.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.738+0000 7fae4759e640 1 Processor -- start 2023-12-19T05:45:51.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.738+0000 7fae4759e640 1 -- start start 2023-12-19T05:45:51.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4815e5a0 0x7fae480b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4815f680 0x7fae480b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 0x7fae480ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480ce5c0 con 0x7fae4815e5a0 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4815ec30 con 0x7fae480cdbf0 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.740+0000 7fae4759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae480b2cc0 con 0x7fae4815f680 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4815e5a0 0x7fae480b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4815e5a0 0x7fae480b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40288/0 (socket says 172.21.15.49:40288) 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 -- 172.21.15.49:0/1561469384 learned_addr learned my addr 172.21.15.49:0/1561469384 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae45d9b640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4815f680 0x7fae480b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae46d9d640 1 --2- 172.21.15.49:0/1561469384 >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 0x7fae480ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 -- 172.21.15.49:0/1561469384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4815f680 msgr2=0x7fae480b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4815f680 0x7fae480b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 -- 172.21.15.49:0/1561469384 >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 msgr2=0x7fae480ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 --2- 172.21.15.49:0/1561469384 >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 0x7fae480ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.741+0000 7fae4659c640 1 -- 172.21.15.49:0/1561469384 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4815e980 con 0x7fae4815e5a0 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.742+0000 7fae46d9d640 1 --2- 172.21.15.49:0/1561469384 >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 0x7fae480ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.743+0000 7fae4659c640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae480b2030 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fae4806b310 tx=0x7fae3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da341de23e5efb49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4559a640 1 -- 172.21.15.49:0/1561469384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38031870 con 0x7fae4815e5a0 2023-12-19T05:45:51.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4559a640 1 -- 172.21.15.49:0/1561469384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae380319d0 con 0x7fae4815e5a0 2023-12-19T05:45:51.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4559a640 1 -- 172.21.15.49:0/1561469384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38031d60 con 0x7fae4815e5a0 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 -- 172.21.15.49:0/1561469384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 msgr2=0x7fae480b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae480b2030 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fae4806b310 tx=0x7fae3802b910 comp rx=0 tx=0).stop 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 -- 172.21.15.49:0/1561469384 shutdown_connections 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 --2- 172.21.15.49:0/1561469384 >> v2:172.21.15.115:3300/0 conn(0x7fae480cdbf0 0x7fae480ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4815f680 0x7fae480b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 --2- 172.21.15.49:0/1561469384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae480b2030 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 -- 172.21.15.49:0/1561469384 >> 172.21.15.49:0/1561469384 conn(0x7fae480b0100 msgr2=0x7fae480b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 -- 172.21.15.49:0/1561469384 shutdown_connections 2023-12-19T05:45:51.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.744+0000 7fae4759e640 1 -- 172.21.15.49:0/1561469384 wait complete. 2023-12-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.746+0000 7fae4759e640 1 Processor -- start 2023-12-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.746+0000 7fae4759e640 1 -- start start 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae480cdbf0 0x7fae48140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4815f680 0x7fae481efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4813e2c0 con 0x7fae4815e5a0 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae481412a0 con 0x7fae4815f680 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae4759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48141cf0 con 0x7fae480cdbf0 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.747+0000 7fae45d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40296/0 (socket says 172.21.15.49:40296) 2023-12-19T05:45:51.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 -- 172.21.15.49:0/3663097734 learned_addr learned my addr 172.21.15.49:0/3663097734 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:51.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae46d9d640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4815f680 0x7fae481efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae4659c640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae480cdbf0 0x7fae48140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 -- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae480cdbf0 msgr2=0x7fae48140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae480cdbf0 0x7fae48140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 -- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4815f680 msgr2=0x7fae481efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4815f680 0x7fae481efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 -- 172.21.15.49:0/3663097734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae380094d0 con 0x7fae4815e5a0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.748+0000 7fae45d9b640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00d5f0 tx=0x7fae3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.749+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0125f0 con 0x7fae4815e5a0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.749+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c012750 con 0x7fae4815e5a0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.749+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c012b00 con 0x7fae4815e5a0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.749+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4813e4d0 con 0x7fae4815e5a0 2023-12-19T05:45:51.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.749+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4813ea90 con 0x7fae4815e5a0 2023-12-19T05:45:51.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.750+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae48061910 con 0x7fae4815e5a0 2023-12-19T05:45:51.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.751+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae3c012c60 con 0x7fae4815e5a0 2023-12-19T05:45:51.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.752+0000 7fae36ffd640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 0x7fae2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:51.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.752+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae3c088d90 con 0x7fae4815e5a0 2023-12-19T05:45:51.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.752+0000 7fae4659c640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 0x7fae2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:51.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.754+0000 7fae4659c640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 0x7fae2806c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fae38036000 tx=0x7fae3803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:51.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.756+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae3c0542e0 con 0x7fae4815e5a0 2023-12-19T05:45:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.949+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae480ce980 con 0x7fae4815e5a0 2023-12-19T05:45:51.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.952+0000 7fae36ffd640 1 -- 172.21.15.49:0/3663097734 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fae3c057900 con 0x7fae4815e5a0 2023-12-19T05:45:51.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:51.954 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:38.452289+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:45:07.124896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T05:45:08.260498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 msgr2=0x7fae2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 0x7fae2806c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fae38036000 tx=0x7fae3803c040 comp rx=0 tx=0).stop 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 msgr2=0x7fae481417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00d5f0 tx=0x7fae3c00dab0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 shutdown_connections 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2806a430 0x7fae2806c8f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4815f680 0x7fae481efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4815e5a0 0x7fae481417b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.956+0000 7fae4759e640 1 --2- 172.21.15.49:0/3663097734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae480cdbf0 0x7fae48140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:51.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.957+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 >> 172.21.15.49:0/3663097734 conn(0x7fae480b0100 msgr2=0x7fae4814f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:51.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.957+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 shutdown_connections 2023-12-19T05:45:51.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:51.957+0000 7fae4759e640 1 -- 172.21.15.49:0/3663097734 wait complete. 2023-12-19T05:45:51.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:45:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.207+0000 7fa74f59e640 1 Processor -- start 2023-12-19T05:45:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.207+0000 7fa74f59e640 1 -- start start 2023-12-19T05:45:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74f59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7500b7360 0x7fa7500b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7500b7d00 con 0x7fa750146c40 2023-12-19T05:45:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74f59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7500700c0 con 0x7fa7500b7360 2023-12-19T05:45:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75006f160 con 0x7fa7500cf8e0 2023-12-19T05:45:52.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74dd9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7500b7360 0x7fa7500b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74ed9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.209+0000 7fa74e59c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa750146c40 0x7fa750070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:55456/0 (socket says 172.21.15.49:55456) 2023-12-19T05:45:52.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74e59c640 1 -- 172.21.15.49:0/1890263608 learned_addr learned my addr 172.21.15.49:0/1890263608 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:52.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74dd9b640 1 -- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 msgr2=0x7fa7500cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:52.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74dd9b640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74dd9b640 1 -- 172.21.15.49:0/1890263608 >> v1:172.21.15.115:6789/0 conn(0x7fa750146c40 legacy=0x7fa750070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74dd9b640 1 -- 172.21.15.49:0/1890263608 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75006f440 con 0x7fa7500b7360 2023-12-19T05:45:52.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.210+0000 7fa74ed9d640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.212+0000 7fa74dd9b640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b77c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa7380097a0 tx=0x7fa73802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d3606dad72944d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.212+0000 7fa74d59a640 1 -- 172.21.15.49:0/1890263608 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73802d040 con 0x7fa7500b7360 2023-12-19T05:45:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.212+0000 7fa74d59a640 1 -- 172.21.15.49:0/1890263608 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738031810 con 0x7fa7500b7360 2023-12-19T05:45:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.212+0000 7fa74d59a640 1 -- 172.21.15.49:0/1890263608 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738031ba0 con 0x7fa7500b7360 2023-12-19T05:45:52.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 -- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 msgr2=0x7fa7500b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b77c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa7380097a0 tx=0x7fa73802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 -- 172.21.15.49:0/1890263608 shutdown_connections 2023-12-19T05:45:52.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 --2- 172.21.15.49:0/1890263608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b77c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 -- 172.21.15.49:0/1890263608 >> 172.21.15.49:0/1890263608 conn(0x7fa7500d31b0 msgr2=0x7fa7500d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 -- 172.21.15.49:0/1890263608 shutdown_connections 2023-12-19T05:45:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.213+0000 7fa74f59e640 1 -- 172.21.15.49:0/1890263608 wait complete. 2023-12-19T05:45:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.215+0000 7fa74f59e640 1 Processor -- start 2023-12-19T05:45:52.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.215+0000 7fa74f59e640 1 -- start start 2023-12-19T05:45:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501f2870 con 0x7fa750146c40 2023-12-19T05:45:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501f2aa0 con 0x7fa7500b7360 2023-12-19T05:45:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501f2d80 con 0x7fa7500cf8e0 2023-12-19T05:45:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40308/0 (socket says 172.21.15.49:40308) 2023-12-19T05:45:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 -- 172.21.15.49:0/2624882486 learned_addr learned my addr 172.21.15.49:0/2624882486 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74dd9b640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74e59c640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 -- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 msgr2=0x7fa7500c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 -- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 msgr2=0x7fa7500b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.217+0000 7fa74ed9d640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa74ed9d640 1 -- 172.21.15.49:0/2624882486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009400 con 0x7fa750146c40 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa74ed9d640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa74800e880 tx=0x7fa74800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748009660 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748004020 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480043b0 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738009400 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.218+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7501f3340 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.220+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750061910 con 0x7fa750146c40 2023-12-19T05:45:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.220+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa74800c940 con 0x7fa750146c40 2023-12-19T05:45:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.221+0000 7fa746ffd640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 0x7fa73006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.221+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7480887d0 con 0x7fa750146c40 2023-12-19T05:45:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.222+0000 7fa74e59c640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 0x7fa73006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.223+0000 7fa74e59c640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 0x7fa73006c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa740005c00 tx=0x7fa740009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.227+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa748053db0 con 0x7fa750146c40 2023-12-19T05:45:52.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.459+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa7500b8a50 con 0x7fa750146c40 2023-12-19T05:45:52.462 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:45:52.460+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:45:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.476+0000 7fa746ffd640 1 -- 172.21.15.49:0/2624882486 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa7480573d0 con 0x7fa750146c40 2023-12-19T05:45:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 msgr2=0x7fa73006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 0x7fa73006c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa740005c00 tx=0x7fa740009040 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 msgr2=0x7fa7500ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa74800e880 tx=0x7fa74800ed40 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 shutdown_connections 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa73006a430 0x7fa73006c8f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7500cf8e0 0x7fa7500c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa750146c40 0x7fa7500ce880 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 --2- 172.21.15.49:0/2624882486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7500b7360 0x7fa7500b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 >> 172.21.15.49:0/2624882486 conn(0x7fa7500d31b0 msgr2=0x7fa750145e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 shutdown_connections 2023-12-19T05:45:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.479+0000 7fa74f59e640 1 -- 172.21.15.49:0/2624882486 wait complete. 2023-12-19T05:45:52.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:45:52.602 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.728+0000 7f61937ab640 1 Processor -- start 2023-12-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.728+0000 7f61937ab640 1 -- start start 2023-12-19T05:45:52.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 0x7f618c0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c0b1610 0x7f618c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f618c15c660 0x7f618c0ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c15bd00 con 0x7f618c15c660 2023-12-19T05:45:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c0b1dd0 con 0x7f618c0adf00 2023-12-19T05:45:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f61937ab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0b20b0 con 0x7f618c0b1610 2023-12-19T05:45:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f6191d48640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f618c15c660 0x7f618c0ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f6191d48640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f618c15c660 0x7f618c0ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40318/0 (socket says 172.21.15.49:40318) 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.730+0000 7f6191d48640 1 -- 172.21.15.49:0/481923643 learned_addr learned my addr 172.21.15.49:0/481923643 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191547640 1 --2- 172.21.15.49:0/481923643 >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 0x7f618c0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6190d46640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c0b1610 0x7f618c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191d48640 1 -- 172.21.15.49:0/481923643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c0b1610 msgr2=0x7f618c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191d48640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c0b1610 0x7f618c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191d48640 1 -- 172.21.15.49:0/481923643 >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 msgr2=0x7f618c0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191d48640 1 --2- 172.21.15.49:0/481923643 >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 0x7f618c0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191d48640 1 -- 172.21.15.49:0/481923643 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0b2390 con 0x7f618c15c660 2023-12-19T05:45:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.731+0000 7f6191547640 1 --2- 172.21.15.49:0/481923643 >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 0x7f618c0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:45:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.732+0000 7f6191d48640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c15c660 0x7f618c0ae9c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f618c0cba50 tx=0x7f618402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e43dd5dd9e66e0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.732+0000 7f6183fff640 1 -- 172.21.15.49:0/481923643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618402ca70 con 0x7f618c15c660 2023-12-19T05:45:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f6183fff640 1 -- 172.21.15.49:0/481923643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618402cbd0 con 0x7f618c15c660 2023-12-19T05:45:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f6183fff640 1 -- 172.21.15.49:0/481923643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61840343f0 con 0x7f618c15c660 2023-12-19T05:45:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 -- 172.21.15.49:0/481923643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c15c660 msgr2=0x7f618c0ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c15c660 0x7f618c0ae9c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f618c0cba50 tx=0x7f618402bed0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 -- 172.21.15.49:0/481923643 shutdown_connections 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c15c660 0x7f618c0ae9c0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 --2- 172.21.15.49:0/481923643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c0b1610 0x7f618c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 --2- 172.21.15.49:0/481923643 >> v2:172.21.15.115:3300/0 conn(0x7f618c0adf00 0x7f618c0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 -- 172.21.15.49:0/481923643 >> 172.21.15.49:0/481923643 conn(0x7f618c066160 msgr2=0x7f618c0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.733+0000 7f61937ab640 1 -- 172.21.15.49:0/481923643 shutdown_connections 2023-12-19T05:45:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.734+0000 7f61937ab640 1 -- 172.21.15.49:0/481923643 wait complete. 2023-12-19T05:45:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.735+0000 7f61937ab640 1 Processor -- start 2023-12-19T05:45:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.735+0000 7f61937ab640 1 -- start start 2023-12-19T05:45:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c0b1610 0x7f618c14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c15c660 0x7f618c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c1533b0 con 0x7f618c0adf00 2023-12-19T05:45:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0ccdc0 con 0x7f618c0b1610 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.736+0000 7f61937ab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c1f6f30 con 0x7f618c15c660 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40330/0 (socket says 172.21.15.49:40330) 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 -- 172.21.15.49:0/67019802 learned_addr learned my addr 172.21.15.49:0/67019802 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191d48640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c15c660 0x7f618c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6190d46640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c0b1610 0x7f618c14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 -- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c15c660 msgr2=0x7f618c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c15c660 0x7f618c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 -- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c0b1610 msgr2=0x7f618c14fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c0b1610 0x7f618c14fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.737+0000 7f6191547640 1 -- 172.21.15.49:0/67019802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184009b30 con 0x7f618c0adf00 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f6191547640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f618800e810 tx=0x7f618800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188004030 con 0x7f618c0adf00 2023-12-19T05:45:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188004190 con 0x7f618c0adf00 2023-12-19T05:45:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188004520 con 0x7f618c0adf00 2023-12-19T05:45:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c1530d0 con 0x7f618c0adf00 2023-12-19T05:45:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.738+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c0cd360 con 0x7f618c0adf00 2023-12-19T05:45:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.739+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c061910 con 0x7f618c0adf00 2023-12-19T05:45:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.741+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f618800c6d0 con 0x7f618c0adf00 2023-12-19T05:45:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.742+0000 7f6181ffb640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 0x7f617006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.742+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f61880884a0 con 0x7f618c0adf00 2023-12-19T05:45:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.742+0000 7f6190d46640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 0x7f617006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.744+0000 7f6190d46640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 0x7f617006c940 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f618c070cf0 tx=0x7f617c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:52.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.746+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6188053aa0 con 0x7f618c0adf00 2023-12-19T05:45:52.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:52.976+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f618c0ae3d0 con 0x7f618c0adf00 2023-12-19T05:45:53.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.548+0000 7f6181ffb640 1 -- 172.21.15.49:0/67019802 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f61880570c0 con 0x7f618c0adf00 2023-12-19T05:45:53.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 msgr2=0x7f617006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 0x7f617006c940 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f618c070cf0 tx=0x7f617c008040 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 msgr2=0x7f618c1f69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f618800e810 tx=0x7f618800ecd0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 shutdown_connections 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f617006a480 0x7f617006c940 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618c15c660 0x7f618c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c0b1610 0x7f618c14fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 --2- 172.21.15.49:0/67019802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618c0adf00 0x7f618c1f69f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 >> 172.21.15.49:0/67019802 conn(0x7f618c066160 msgr2=0x7f618c158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 shutdown_connections 2023-12-19T05:45:53.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.553+0000 7f61937ab640 1 -- 172.21.15.49:0/67019802 wait complete. 2023-12-19T05:45:53.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:45:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.822+0000 7fc75359e640 1 Processor -- start 2023-12-19T05:45:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.822+0000 7fc75359e640 1 -- start start 2023-12-19T05:45:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.824+0000 7fc75359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc75406cf60 0x7fc7540ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.824+0000 7fc75359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.824+0000 7fc75359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7540cf370 con 0x7fc75415ac20 2023-12-19T05:45:53.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.824+0000 7fc75359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540b2190 con 0x7fc75406cf60 2023-12-19T05:45:53.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.824+0000 7fc75359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75406d340 con 0x7fc7540cef30 2023-12-19T05:45:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.825+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.825+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:45254/0 (socket says 172.21.15.49:45254) 2023-12-19T05:45:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.825+0000 7fc74bfff640 1 -- 172.21.15.49:0/819230098 learned_addr learned my addr 172.21.15.49:0/819230098 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.825+0000 7fc75259c640 1 --2- 172.21.15.49:0/819230098 >> v2:172.21.15.115:3300/0 conn(0x7fc75406cf60 0x7fc7540ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.826+0000 7fc74bfff640 1 -- 172.21.15.49:0/819230098 >> v2:172.21.15.115:3300/0 conn(0x7fc75406cf60 msgr2=0x7fc7540ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.826+0000 7fc74bfff640 1 --2- 172.21.15.49:0/819230098 >> v2:172.21.15.115:3300/0 conn(0x7fc75406cf60 0x7fc7540ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.826+0000 7fc74bfff640 1 -- 172.21.15.49:0/819230098 >> v1:172.21.15.115:6789/0 conn(0x7fc75415ac20 legacy=0x7fc75415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.826+0000 7fc74bfff640 1 -- 172.21.15.49:0/819230098 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75415b4a0 con 0x7fc7540cef30 2023-12-19T05:45:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.828+0000 7fc74bfff640 1 --2- 172.21.15.49:0/819230098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009870 tx=0x7fc73c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12986989de10749e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.828+0000 7fc751d9b640 1 -- 172.21.15.49:0/819230098 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c02f830 con 0x7fc7540cef30 2023-12-19T05:45:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.828+0000 7fc751d9b640 1 -- 172.21.15.49:0/819230098 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c02f990 con 0x7fc7540cef30 2023-12-19T05:45:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.828+0000 7fc751d9b640 1 -- 172.21.15.49:0/819230098 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c02fd20 con 0x7fc7540cef30 2023-12-19T05:45:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 -- 172.21.15.49:0/819230098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 msgr2=0x7fc75415a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 --2- 172.21.15.49:0/819230098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009870 tx=0x7fc73c02ba10 comp rx=0 tx=0).stop 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 -- 172.21.15.49:0/819230098 shutdown_connections 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 --2- 172.21.15.49:0/819230098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7540cef30 0x7fc75415a6e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 --2- 172.21.15.49:0/819230098 >> v2:172.21.15.115:3300/0 conn(0x7fc75406cf60 0x7fc7540ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 -- 172.21.15.49:0/819230098 >> 172.21.15.49:0/819230098 conn(0x7fc7540b4750 msgr2=0x7fc7540659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 -- 172.21.15.49:0/819230098 shutdown_connections 2023-12-19T05:45:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.829+0000 7fc75359e640 1 -- 172.21.15.49:0/819230098 wait complete. 2023-12-19T05:45:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.831+0000 7fc75359e640 1 Processor -- start 2023-12-19T05:45:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.831+0000 7fc75359e640 1 -- start start 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7540cef30 0x7fc754156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75415ac20 0x7fc7540ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc754155180 con 0x7fc75406cf60 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc754155460 con 0x7fc7540cef30 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.832+0000 7fc75359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc754155740 con 0x7fc75415ac20 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40336/0 (socket says 172.21.15.49:40336) 2023-12-19T05:45:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 -- 172.21.15.49:0/1253257331 learned_addr learned my addr 172.21.15.49:0/1253257331 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc74bfff640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7540cef30 0x7fc754156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc752d9d640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75415ac20 0x7fc7540ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 -- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75415ac20 msgr2=0x7fc7540ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75415ac20 0x7fc7540ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 -- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7540cef30 msgr2=0x7fc754156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7540cef30 0x7fc754156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 -- 172.21.15.49:0/1253257331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0094d0 con 0x7fc75406cf60 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.833+0000 7fc75259c640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e9b0 tx=0x7fc74400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.834+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744009670 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.834+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400c9a0 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.834+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400cd50 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.834+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc754155a20 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.834+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc754150b10 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.835+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754061910 con 0x7fc75406cf60 2023-12-19T05:45:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.836+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc744013470 con 0x7fc75406cf60 2023-12-19T05:45:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.837+0000 7fc74affd640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 0x7fc73406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.837+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc744088b70 con 0x7fc75406cf60 2023-12-19T05:45:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.838+0000 7fc74bfff640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 0x7fc73406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.839+0000 7fc74bfff640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 0x7fc73406c920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc73c036000 tx=0x7fc73c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:53.841+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc744054190 con 0x7fc75406cf60 2023-12-19T05:45:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.028+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7540b22f0 con 0x7fc75406cf60 2023-12-19T05:45:54.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.555+0000 7fc74affd640 1 -- 172.21.15.49:0/1253257331 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7440170d0 con 0x7fc75406cf60 2023-12-19T05:45:54.558 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 msgr2=0x7fc73406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 0x7fc73406c920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc73c036000 tx=0x7fc73c008030 comp rx=0 tx=0).stop 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 msgr2=0x7fc7541497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e9b0 tx=0x7fc74400ee70 comp rx=0 tx=0).stop 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 shutdown_connections 2023-12-19T05:45:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73406a460 0x7fc73406c920 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75415ac20 0x7fc7540ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7540cef30 0x7fc754156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 --2- 172.21.15.49:0/1253257331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc75406cf60 0x7fc7541497c0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.560+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 >> 172.21.15.49:0/1253257331 conn(0x7fc7540b4750 msgr2=0x7fc75406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.561+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 shutdown_connections 2023-12-19T05:45:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.561+0000 7fc75359e640 1 -- 172.21.15.49:0/1253257331 wait complete. 2023-12-19T05:45:54.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:45:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.802+0000 7fd5449ac640 1 Processor -- start 2023-12-19T05:45:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.802+0000 7fd5449ac640 1 -- start start 2023-12-19T05:45:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd5449ac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd5400cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd5449ac640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5400cc7f0 0x7fd5400b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd5449ac640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5400afd10 con 0x7fd540146080 2023-12-19T05:45:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd5449ac640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5400ccd80 con 0x7fd5400cc7f0 2023-12-19T05:45:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd5449ac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400cd060 con 0x7fd540145ca0 2023-12-19T05:45:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd53effd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd540146080 0x7fd5400af600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43032/0 (socket says 172.21.15.49:43032) 2023-12-19T05:45:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd53effd640 1 -- 172.21.15.49:0/2697886742 learned_addr learned my addr 172.21.15.49:0/2697886742 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.804+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439234505 0 0) 0x7fd5400afd10 con 0x7fd540146080 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd528003520 con 0x7fd540146080 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd5400cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53ffff640 1 --2- 172.21.15.49:0/2697886742 >> v2:172.21.15.115:3300/0 conn(0x7fd5400cc7f0 0x7fd5400b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 176426365 0 0) 0x7fd528003520 con 0x7fd540146080 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 msgr2=0x7fd5400cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd5400cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 >> v2:172.21.15.115:3300/0 conn(0x7fd5400cc7f0 msgr2=0x7fd5400b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 --2- 172.21.15.49:0/2697886742 >> v2:172.21.15.115:3300/0 conn(0x7fd5400cc7f0 0x7fd5400b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5400cd340 con 0x7fd540146080 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd5340017f0 con 0x7fd540146080 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd5400cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 >> v1:172.21.15.49:6789/0 conn(0x7fd540146080 legacy=0x7fd5400af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd528003970 0x7fd528003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5280047c0 0x7fd528004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd528005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400ccd80 con 0x7fd5280047c0 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400cd060 con 0x7fd528003970 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52800bae0 con 0x7fd540145ca0 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.805+0000 7fd53effd640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5280047c0 0x7fd528004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53ffff640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd528005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd528003970 0x7fd528003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53effd640 1 -- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 msgr2=0x7fd528005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53effd640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd540145ca0 0x7fd528005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53effd640 1 -- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd528003970 msgr2=0x7fd528003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53effd640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd528003970 0x7fd528003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53effd640 1 -- 172.21.15.49:0/2697886742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528003520 con 0x7fd5280047c0 2023-12-19T05:45:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.806+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd528003970 0x7fd528003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.807+0000 7fd53effd640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5280047c0 0x7fd528004c40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd534001eb0 tx=0x7fd5280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6303f2f6a47a0c90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.807+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534007270 con 0x7fd5280047c0 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.807+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5340073f0 con 0x7fd5280047c0 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.807+0000 7fd53e7fc640 1 -- 172.21.15.49:0/2697886742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53402c870 con 0x7fd5280047c0 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 -- 172.21.15.49:0/2697886742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5280047c0 msgr2=0x7fd528004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 --2- 172.21.15.49:0/2697886742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5280047c0 0x7fd528004c40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd534001eb0 tx=0x7fd5280057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd53ffff640 1 -- 172.21.15.49:0/2697886742 reap_dead start 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 -- 172.21.15.49:0/2697886742 shutdown_connections 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 -- 172.21.15.49:0/2697886742 >> 172.21.15.49:0/2697886742 conn(0x7fd5400659a0 msgr2=0x7fd540065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 -- 172.21.15.49:0/2697886742 shutdown_connections 2023-12-19T05:45:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.808+0000 7fd5449ac640 1 -- 172.21.15.49:0/2697886742 wait complete. 2023-12-19T05:45:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.810+0000 7fd5449ac640 1 Processor -- start 2023-12-19T05:45:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.810+0000 7fd5449ac640 1 -- start start 2023-12-19T05:45:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5280047c0 0x7fd5400cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54006fd30 0x7fd5400701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54006e050 con 0x7fd54015e1d0 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400706f0 con 0x7fd5280047c0 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd5449ac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54015eb90 con 0x7fd54006fd30 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52940/0 (socket says 172.21.15.49:52940) 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 -- 172.21.15.49:0/1958928570 learned_addr learned my addr 172.21.15.49:0/1958928570 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53effd640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54006fd30 0x7fd5400701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 -- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54006fd30 msgr2=0x7fd5400701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54006fd30 0x7fd5400701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 -- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5280047c0 msgr2=0x7fd5400cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5280047c0 0x7fd5400cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.811+0000 7fd53ffff640 1 -- 172.21.15.49:0/1958928570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540139ad0 con 0x7fd54015e1d0 2023-12-19T05:45:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd53ffff640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5400cbd70 tx=0x7fd53800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800fe00 con 0x7fd54015e1d0 2023-12-19T05:45:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380143f0 con 0x7fd54015e1d0 2023-12-19T05:45:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380147a0 con 0x7fd54015e1d0 2023-12-19T05:45:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54015ede0 con 0x7fd54015e1d0 2023-12-19T05:45:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.812+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54015f3a0 con 0x7fd54015e1d0 2023-12-19T05:45:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.813+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5400adf50 con 0x7fd54015e1d0 2023-12-19T05:45:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.814+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd538014900 con 0x7fd54015e1d0 2023-12-19T05:45:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.815+0000 7fd527fff640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 0x7fd52c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.815+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd5380890b0 con 0x7fd54015e1d0 2023-12-19T05:45:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.816+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 0x7fd52c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.817+0000 7fd53f7fe640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 0x7fd52c06c920 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd530006b10 tx=0x7fd530006d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:54.819+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5380547f0 con 0x7fd54015e1d0 2023-12-19T05:45:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.010+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd540061910 con 0x7fd54015e1d0 2023-12-19T05:45:55.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.567+0000 7fd527fff640 1 -- 172.21.15.49:0/1958928570 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd538057e10 con 0x7fd54015e1d0 2023-12-19T05:45:55.569 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.571+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 msgr2=0x7fd52c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.571+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 0x7fd52c06c920 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd530006b10 tx=0x7fd530006d80 comp rx=0 tx=0).stop 2023-12-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.571+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 msgr2=0x7fd54015e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.571+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5400cbd70 tx=0x7fd53800f520 comp rx=0 tx=0).stop 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 shutdown_connections 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd52c06a460 0x7fd52c06c920 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54006fd30 0x7fd5400701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54015e1d0 0x7fd54015e650 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 --2- 172.21.15.49:0/1958928570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5280047c0 0x7fd5400cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 >> 172.21.15.49:0/1958928570 conn(0x7fd5400659a0 msgr2=0x7fd54006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 shutdown_connections 2023-12-19T05:45:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.572+0000 7fd5449ac640 1 -- 172.21.15.49:0/1958928570 wait complete. 2023-12-19T05:45:55.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:45:55.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.830+0000 7f797685f640 1 Processor -- start 2023-12-19T05:45:55.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.831+0000 7f797685f640 1 -- start start 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.832+0000 7f797685f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79700cf990 0x7f7970161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f797685f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79701620b0 con 0x7f7970161850 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f797685f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797006d900 con 0x7f797015d490 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f797685f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797006dbe0 con 0x7f79700cf990 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79700cf990 0x7f7970161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79700cf990 0x7f7970161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52956/0 (socket says 172.21.15.49:52956) 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 -- 172.21.15.49:0/3960599301 learned_addr learned my addr 172.21.15.49:0/3960599301 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 -- 172.21.15.49:0/3960599301 >> v1:172.21.15.115:6789/0 conn(0x7f797015d490 legacy=0x7f79700cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 -- 172.21.15.49:0/3960599301 >> v1:172.21.15.49:6789/0 conn(0x7f7970161850 legacy=0x7f7970070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.833+0000 7f79677fe640 1 -- 172.21.15.49:0/3960599301 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797006dec0 con 0x7f79700cf990 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.835+0000 7f79677fe640 1 --2- 172.21.15.49:0/3960599301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79700cf990 0x7f7970161310 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7958009870 tx=0x7f795802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669bcf0ae3fdea07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.835+0000 7f796f7fe640 1 -- 172.21.15.49:0/3960599301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958031870 con 0x7f79700cf990 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.835+0000 7f796f7fe640 1 -- 172.21.15.49:0/3960599301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79580319d0 con 0x7f79700cf990 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.835+0000 7f796f7fe640 1 -- 172.21.15.49:0/3960599301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958031d60 con 0x7f79700cf990 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 -- 172.21.15.49:0/3960599301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79700cf990 msgr2=0x7f7970161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 --2- 172.21.15.49:0/3960599301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79700cf990 0x7f7970161310 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7958009870 tx=0x7f795802b910 comp rx=0 tx=0).stop 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 -- 172.21.15.49:0/3960599301 shutdown_connections 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 --2- 172.21.15.49:0/3960599301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79700cf990 0x7f7970161310 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 -- 172.21.15.49:0/3960599301 >> 172.21.15.49:0/3960599301 conn(0x7f797006a2e0 msgr2=0x7f797006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 -- 172.21.15.49:0/3960599301 shutdown_connections 2023-12-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.836+0000 7f797685f640 1 -- 172.21.15.49:0/3960599301 wait complete. 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.838+0000 7f797685f640 1 Processor -- start 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.838+0000 7f797685f640 1 -- start start 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 0x7f79700b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 0x7f79701f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b57d0 con 0x7f797015d490 2023-12-19T05:45:55.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b4bc0 con 0x7f79700cf990 2023-12-19T05:45:55.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f797685f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b4ea0 con 0x7f7970161850 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f79677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f79677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52960/0 (socket says 172.21.15.49:52960) 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f79677fe640 1 -- 172.21.15.49:0/1301095585 learned_addr learned my addr 172.21.15.49:0/1301095585 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f796ffff640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 0x7f79700b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.839+0000 7f7974dfc640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 0x7f79701f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 -- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 msgr2=0x7f79701f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 0x7f79701f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 -- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 msgr2=0x7f79700b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 0x7f79700b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 -- 172.21.15.49:0/1301095585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580094d0 con 0x7f797015d490 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f796ffff640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 0x7f79700b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f7974dfc640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 0x7f79701f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f79677fe640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7958009870 tx=0x7f79580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958031820 con 0x7f797015d490 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79580443f0 con 0x7f797015d490 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580447a0 con 0x7f797015d490 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.840+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797006e840 con 0x7f797015d490 2023-12-19T05:45:55.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.841+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700b5460 con 0x7f797015d490 2023-12-19T05:45:55.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.842+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7970061910 con 0x7f797015d490 2023-12-19T05:45:55.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.843+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f795804d450 con 0x7f797015d490 2023-12-19T05:45:55.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.844+0000 7f796d7fa640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 0x7f795006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:55.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.844+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f795802d040 con 0x7f797015d490 2023-12-19T05:45:55.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.844+0000 7f796ffff640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 0x7f795006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:55.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.846+0000 7f796ffff640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 0x7f795006c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7960003eb0 tx=0x7f7960009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:55.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:55.848+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7958076710 con 0x7f797015d490 2023-12-19T05:45:56.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.041+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7970061910 con 0x7f797015d490 2023-12-19T05:45:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.047+0000 7f796d7fa640 1 -- 172.21.15.49:0/1301095585 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7958079d30 con 0x7f797015d490 2023-12-19T05:45:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 msgr2=0x7f795006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 0x7f795006c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7960003eb0 tx=0x7f7960009040 comp rx=0 tx=0).stop 2023-12-19T05:45:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 msgr2=0x7f79701f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7958009870 tx=0x7f79580046c0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 shutdown_connections 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.050+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f795006a430 0x7f795006c8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7970161850 0x7f79701f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f797015d490 0x7f79701f3040 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 --2- 172.21.15.49:0/1301095585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79700cf990 0x7f79700b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 >> 172.21.15.49:0/1301095585 conn(0x7f797006a2e0 msgr2=0x7f79700b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 shutdown_connections 2023-12-19T05:45:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.051+0000 7f797685f640 1 -- 172.21.15.49:0/1301095585 wait complete. 2023-12-19T05:45:56.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-19T05:45:56.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.306+0000 7f5a46841640 1 Processor -- start 2023-12-19T05:45:56.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.306+0000 7f5a46841640 1 -- start start 2023-12-19T05:45:56.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a46841640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a400ae110 0x7f5a400b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a46841640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a400b0640 0x7f5a4006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a46841640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400b0a90 con 0x7f5a40157bf0 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a46841640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4006b8c0 con 0x7f5a400b0640 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a46841640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400ae640 con 0x7f5a400ae110 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a44dde640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a400b0640 0x7f5a4006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a44dde640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a400b0640 0x7f5a4006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52976/0 (socket says 172.21.15.49:52976) 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.308+0000 7f5a44dde640 1 -- 172.21.15.49:0/3714634234 learned_addr learned my addr 172.21.15.49:0/3714634234 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.309+0000 7f5a377fe640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a400ae110 0x7f5a400b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.309+0000 7f5a44dde640 1 -- 172.21.15.49:0/3714634234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a400ae110 msgr2=0x7f5a400b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:56.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.309+0000 7f5a44dde640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a400ae110 0x7f5a400b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.309+0000 7f5a44dde640 1 -- 172.21.15.49:0/3714634234 >> v1:172.21.15.115:6789/0 conn(0x7f5a40157bf0 legacy=0x7f5a4015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.309+0000 7f5a44dde640 1 -- 172.21.15.49:0/3714634234 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400ae920 con 0x7f5a400b0640 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.310+0000 7f5a44dde640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a4006d230 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570e3d49737bb3a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.310+0000 7f5a3f7fe640 1 -- 172.21.15.49:0/3714634234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38030840 con 0x7f5a400b0640 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.310+0000 7f5a3f7fe640 1 -- 172.21.15.49:0/3714634234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380309a0 con 0x7f5a400b0640 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.310+0000 7f5a3f7fe640 1 -- 172.21.15.49:0/3714634234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38030d30 con 0x7f5a400b0640 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 -- 172.21.15.49:0/3714634234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 msgr2=0x7f5a4006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a4006d230 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3802b980 comp rx=0 tx=0).stop 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 -- 172.21.15.49:0/3714634234 shutdown_connections 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a400ae110 0x7f5a400b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 --2- 172.21.15.49:0/3714634234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a4006d230 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 -- 172.21.15.49:0/3714634234 >> 172.21.15.49:0/3714634234 conn(0x7f5a400cbb70 msgr2=0x7f5a400cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 -- 172.21.15.49:0/3714634234 shutdown_connections 2023-12-19T05:45:56.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.311+0000 7f5a46841640 1 -- 172.21.15.49:0/3714634234 wait complete. 2023-12-19T05:45:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.313+0000 7f5a46841640 1 Processor -- start 2023-12-19T05:45:56.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.313+0000 7f5a46841640 1 -- start start 2023-12-19T05:45:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 0x7f5a401f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 0x7f5a40159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401f2a30 con 0x7f5a400b0640 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40149600 con 0x7f5a400ae110 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.314+0000 7f5a46841640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401469c0 con 0x7f5a40157bf0 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52980/0 (socket says 172.21.15.49:52980) 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 -- 172.21.15.49:0/1832535415 learned_addr learned my addr 172.21.15.49:0/1832535415 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a3ffff640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 0x7f5a401f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a44dde640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 0x7f5a40159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 -- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 msgr2=0x7f5a40159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 0x7f5a40159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 -- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 msgr2=0x7f5a401f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 0x7f5a401f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 -- 172.21.15.49:0/1832535415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380094d0 con 0x7f5a400b0640 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a44dde640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 0x7f5a40159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a3ffff640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 0x7f5a401f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.315+0000 7f5a377fe640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5a28007e30 tx=0x7f5a2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.316+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28014620 con 0x7f5a400b0640 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.316+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800ee90 con 0x7f5a400b0640 2023-12-19T05:45:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.316+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280149c0 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.316+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a40146ca0 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.316+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a40147260 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.317+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400aeec0 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.318+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a28014b20 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.319+0000 7f5a3d7fa640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 0x7f5a2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.319+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a28088f40 con 0x7f5a400b0640 2023-12-19T05:45:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.320+0000 7f5a3ffff640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 0x7f5a2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.321+0000 7f5a3ffff640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 0x7f5a2006c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5a30000f60 tx=0x7f5a30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.323+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a400aeec0 con 0x7f5a400b0640 2023-12-19T05:45:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:56.598+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f5a400aeec0 con 0x7f5a400b0640 2023-12-19T05:45:57.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:57.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:57.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.571+0000 7f5a3d7fa640 1 -- 172.21.15.49:0/1832535415 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v356) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5a400aeec0 con 0x7f5a400b0640 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 msgr2=0x7f5a2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 0x7f5a2006c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5a30000f60 tx=0x7f5a30009040 comp rx=0 tx=0).stop 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 msgr2=0x7f5a401490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5a28007e30 tx=0x7f5a2800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 shutdown_connections 2023-12-19T05:45:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5a2006a430 0x7f5a2006c8f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a40157bf0 0x7f5a40159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a400b0640 0x7f5a401490c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 --2- 172.21.15.49:0/1832535415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a400ae110 0x7f5a401f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.575+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 >> 172.21.15.49:0/1832535415 conn(0x7f5a400cbb70 msgr2=0x7f5a400b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.576+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 shutdown_connections 2023-12-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.576+0000 7f5a46841640 1 -- 172.21.15.49:0/1832535415 wait complete. 2023-12-19T05:45:57.600 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-19T05:45:57.600 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-19T05:45:57.600 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T05:45:57.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:45:57.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.837+0000 7fb053fff640 1 Processor -- start 2023-12-19T05:45:57.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.837+0000 7fb053fff640 1 -- start start 2023-12-19T05:45:57.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb053fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 0x7fb0540b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb053fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0540cdbf0 0x7fb0540ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb053fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05415ec30 con 0x7fb05415f680 2023-12-19T05:45:57.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb053fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540ce5c0 con 0x7fb0540cdbf0 2023-12-19T05:45:57.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb053fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415e980 con 0x7fb05415e5a0 2023-12-19T05:45:57.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb0527fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb05415f680 0x7fb0540b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43054/0 (socket says 172.21.15.49:43054) 2023-12-19T05:45:57.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.839+0000 7fb0527fc640 1 -- 172.21.15.49:0/2867589729 learned_addr learned my addr 172.21.15.49:0/2867589729 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb052ffd640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 0x7fb0540b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb0537fe640 1 --2- 172.21.15.49:0/2867589729 >> v2:172.21.15.115:3300/0 conn(0x7fb0540cdbf0 0x7fb0540ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376162100 0 0) 0x7fb05415ec30 con 0x7fb05415f680 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03c003520 con 0x7fb05415f680 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110670381 0 0) 0x7fb03c003520 con 0x7fb05415f680 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 msgr2=0x7fb0540b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 0x7fb0540b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 >> v2:172.21.15.115:3300/0 conn(0x7fb0540cdbf0 msgr2=0x7fb0540ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 --2- 172.21.15.49:0/2867589729 >> v2:172.21.15.115:3300/0 conn(0x7fb0540cdbf0 0x7fb0540ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540b2f90 con 0x7fb05415f680 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.840+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb048001670 con 0x7fb05415f680 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 >> v1:172.21.15.49:6789/0 conn(0x7fb05415f680 legacy=0x7fb0540b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 0x7fb03c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c003ef0 0x7fb03c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c004d00 0x7fb03c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540ce5c0 con 0x7fb03c004d00 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415e980 con 0x7fb03c003ef0 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c00b980 con 0x7fb05415e5a0 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c004d00 0x7fb03c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0527fc640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c003ef0 0x7fb03c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 -- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 msgr2=0x7fb03c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:57.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb05415e5a0 0x7fb03c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 -- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c003ef0 msgr2=0x7fb03c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:57.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c003ef0 0x7fb03c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0537fe640 1 -- 172.21.15.49:0/2867589729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c003520 con 0x7fb03c004d00 2023-12-19T05:45:57.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.841+0000 7fb0527fc640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c003ef0 0x7fb03c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.842+0000 7fb0537fe640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c004d00 0x7fb03c005180 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009ac0 tx=0x7fb03c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7019ba1391e70b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c02c6d0 con 0x7fb03c004d00 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c02c830 con 0x7fb03c004d00 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb051ffb640 1 -- 172.21.15.49:0/2867589729 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c02cbc0 con 0x7fb03c004d00 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb053fff640 1 -- 172.21.15.49:0/2867589729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c004d00 msgr2=0x7fb03c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb053fff640 1 --2- 172.21.15.49:0/2867589729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c004d00 0x7fb03c005180 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009ac0 tx=0x7fb03c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb0537fe640 1 -- 172.21.15.49:0/2867589729 reap_dead start 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb053fff640 1 -- 172.21.15.49:0/2867589729 shutdown_connections 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.843+0000 7fb053fff640 1 -- 172.21.15.49:0/2867589729 >> 172.21.15.49:0/2867589729 conn(0x7fb0540b0100 msgr2=0x7fb0540b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.844+0000 7fb053fff640 1 -- 172.21.15.49:0/2867589729 shutdown_connections 2023-12-19T05:45:57.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.844+0000 7fb053fff640 1 -- 172.21.15.49:0/2867589729 wait complete. 2023-12-19T05:45:57.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.845+0000 7fb053fff640 1 Processor -- start 2023-12-19T05:45:57.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.846+0000 7fb053fff640 1 -- start start 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c004d00 0x7fb054146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540c8c90 0x7fb0540c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540c9680 con 0x7fb0541e4a50 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541e5c40 con 0x7fb03c004d00 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb053fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541e4fc0 con 0x7fb0540c8c90 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53006/0 (socket says 172.21.15.49:53006) 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 -- 172.21.15.49:0/1798296475 learned_addr learned my addr 172.21.15.49:0/1798296475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb052ffd640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c004d00 0x7fb054146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 -- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540c8c90 msgr2=0x7fb0540c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540c8c90 0x7fb0540c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 -- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c004d00 msgr2=0x7fb054146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c004d00 0x7fb054146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.847+0000 7fb0527fc640 1 -- 172.21.15.49:0/1798296475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0541e52a0 con 0x7fb0541e4a50 2023-12-19T05:45:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb0527fc640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb04800da60 tx=0x7fb04800df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048004bf0 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048004d50 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480072d0 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0541e5580 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.848+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0540c8850 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.849+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054061910 con 0x7fb0541e4a50 2023-12-19T05:45:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.850+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb048007430 con 0x7fb0541e4a50 2023-12-19T05:45:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.851+0000 7fb03bfff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 0x7fb04006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.851+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb048088100 con 0x7fb0541e4a50 2023-12-19T05:45:57.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.852+0000 7fb052ffd640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 0x7fb04006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:57.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.853+0000 7fb052ffd640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 0x7fb04006c920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb044004b30 tx=0x7fb04400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:57.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:57.855+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0480539e0 con 0x7fb0541e4a50 2023-12-19T05:45:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.051+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0540ce980 con 0x7fb0541e4a50 2023-12-19T05:45:58.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.053+0000 7fb03bfff640 1 -- 172.21.15.49:0/1798296475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+12531 (secure 0 0 0) 0x7fb048057000 con 0x7fb0541e4a50 2023-12-19T05:45:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:45:58.055 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:45:55.550225+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6837/3756494171":"2023-12-20T05:45:52.461017+0000","172.21.15.115:6835/3756494171":"2023-12-20T05:45:52.461017+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:45:58.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 msgr2=0x7fb04006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 0x7fb04006c920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb044004b30 tx=0x7fb04400b040 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 msgr2=0x7fb0540c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb04800da60 tx=0x7fb04800df20 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 shutdown_connections 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb04006a460 0x7fb04006c920 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540c8c90 0x7fb0540c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0541e4a50 0x7fb0540c8310 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 --2- 172.21.15.49:0/1798296475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c004d00 0x7fb054146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 >> 172.21.15.49:0/1798296475 conn(0x7fb0540b0100 msgr2=0x7fb054157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 shutdown_connections 2023-12-19T05:45:58.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.056+0000 7fb053fff640 1 -- 172.21.15.49:0/1798296475 wait complete. 2023-12-19T05:45:58.077 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:45:58.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:45:58.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.309+0000 7fd90102d640 1 Processor -- start 2023-12-19T05:45:58.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.309+0000 7fd90102d640 1 -- start start 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.311+0000 7fd90102d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8fc15ae50 0x7fd8fc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.311+0000 7fd90102d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8fc0b2710 0x7fd8fc0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.311+0000 7fd90102d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0cd020 con 0x7fd8fc0ce750 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.311+0000 7fd90102d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cca30 con 0x7fd8fc15ae50 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.311+0000 7fd90102d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b2f20 con 0x7fd8fc0b2710 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8fc15ae50 0x7fd8fc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8fc15ae50 0x7fd8fc15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53016/0 (socket says 172.21.15.49:53016) 2023-12-19T05:45:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 -- 172.21.15.49:0/4207768784 learned_addr learned my addr 172.21.15.49:0/4207768784 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8f3fff640 1 --2- 172.21.15.49:0/4207768784 >> v2:172.21.15.115:3300/0 conn(0x7fd8fc0b2710 0x7fd8fc0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 -- 172.21.15.49:0/4207768784 >> v2:172.21.15.115:3300/0 conn(0x7fd8fc0b2710 msgr2=0x7fd8fc0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 --2- 172.21.15.49:0/4207768784 >> v2:172.21.15.115:3300/0 conn(0x7fd8fc0b2710 0x7fd8fc0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.312+0000 7fd8fbfff640 1 -- 172.21.15.49:0/4207768784 >> v1:172.21.15.115:6789/0 conn(0x7fd8fc0ce750 legacy=0x7fd8fc0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.313+0000 7fd8fbfff640 1 -- 172.21.15.49:0/4207768784 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0b3200 con 0x7fd8fc15ae50 2023-12-19T05:45:58.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.314+0000 7fd8fbfff640 1 --2- 172.21.15.49:0/4207768784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15e460 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ad000 tx=0x7fd8ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd14a0443602166 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.315+0000 7fd8fb7fe640 1 -- 172.21.15.49:0/4207768784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec030860 con 0x7fd8fc15ae50 2023-12-19T05:45:58.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.315+0000 7fd8fb7fe640 1 -- 172.21.15.49:0/4207768784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0309c0 con 0x7fd8fc15ae50 2023-12-19T05:45:58.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.315+0000 7fd8fb7fe640 1 -- 172.21.15.49:0/4207768784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec030d50 con 0x7fd8fc15ae50 2023-12-19T05:45:58.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.315+0000 7fd90102d640 1 -- 172.21.15.49:0/4207768784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc15ae50 msgr2=0x7fd8fc15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.315+0000 7fd90102d640 1 --2- 172.21.15.49:0/4207768784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15e460 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ad000 tx=0x7fd8ec02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 -- 172.21.15.49:0/4207768784 shutdown_connections 2023-12-19T05:45:58.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 --2- 172.21.15.49:0/4207768784 >> v2:172.21.15.115:3300/0 conn(0x7fd8fc0b2710 0x7fd8fc0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 --2- 172.21.15.49:0/4207768784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15e460 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 -- 172.21.15.49:0/4207768784 >> 172.21.15.49:0/4207768784 conn(0x7fd8fc06f630 msgr2=0x7fd8fc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:58.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 -- 172.21.15.49:0/4207768784 shutdown_connections 2023-12-19T05:45:58.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.316+0000 7fd90102d640 1 -- 172.21.15.49:0/4207768784 wait complete. 2023-12-19T05:45:58.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.318+0000 7fd90102d640 1 Processor -- start 2023-12-19T05:45:58.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.318+0000 7fd90102d640 1 -- start start 2023-12-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8fc0b2710 0x7fd8fc1f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc155ab0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15def0 con 0x7fd8fc15ae50 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd90102d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15e1d0 con 0x7fd8fc0b2710 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd8f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd8f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53020/0 (socket says 172.21.15.49:53020) 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.319+0000 7fd8f3fff640 1 -- 172.21.15.49:0/3199121871 learned_addr learned my addr 172.21.15.49:0/3199121871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 -- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8fc0b2710 msgr2=0x7fd8fc1f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8fbfff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8fc0b2710 0x7fd8fc1f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8fc0b2710 0x7fd8fc1f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 -- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc15ae50 msgr2=0x7fd8fc15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 -- 172.21.15.49:0/3199121871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0094d0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f3fff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400d800 tx=0x7fd8e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400b6c0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e400b820 con 0x7fd8fc0ce750 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc15e4b0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.320+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400bbb0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.321+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc15ea70 con 0x7fd8fc0ce750 2023-12-19T05:45:58.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.322+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc061910 con 0x7fd8fc0ce750 2023-12-19T05:45:58.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.323+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8e400bd10 con 0x7fd8fc0ce750 2023-12-19T05:45:58.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.324+0000 7fd8f97fa640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 0x7fd8dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.324+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8e4088c00 con 0x7fd8fc0ce750 2023-12-19T05:45:58.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.324+0000 7fd8fbfff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 0x7fd8dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.326+0000 7fd8fbfff640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 0x7fd8dc06c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec036000 tx=0x7fd8ec03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.328+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd8e4054450 con 0x7fd8fc0ce750 2023-12-19T05:45:58.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.520+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8fc0b03e0 con 0x7fd8fc0ce750 2023-12-19T05:45:58.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.521+0000 7fd8f97fa640 1 -- 172.21.15.49:0/3199121871 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8e4057a70 con 0x7fd8fc0ce750 2023-12-19T05:45:58.523 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 msgr2=0x7fd8dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 0x7fd8dc06c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec036000 tx=0x7fd8ec03b040 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 msgr2=0x7fd8fc15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400d800 tx=0x7fd8e400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 shutdown_connections 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8dc06a430 0x7fd8dc06c8f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc15ae50 0x7fd8fc15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8fc0ce750 0x7fd8fc15ef90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 --2- 172.21.15.49:0/3199121871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8fc0b2710 0x7fd8fc1f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 >> 172.21.15.49:0/3199121871 conn(0x7fd8fc06f630 msgr2=0x7fd8fc0cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 shutdown_connections 2023-12-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.524+0000 7fd90102d640 1 -- 172.21.15.49:0/3199121871 wait complete. 2023-12-19T05:45:58.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-19T05:45:58.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.779+0000 7fe1a26e5640 1 Processor -- start 2023-12-19T05:45:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.779+0000 7fe1a26e5640 1 -- start start 2023-12-19T05:45:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a26e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe19c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a26e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe19c0ae110 0x7fe19c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a26e5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c0b0a90 con 0x7fe19c0b0640 2023-12-19T05:45:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a26e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c06b8c0 con 0x7fe19c0ae110 2023-12-19T05:45:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a26e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c15b740 con 0x7fe19c157bf0 2023-12-19T05:45:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a0c82640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe19c0b0640 0x7fe19c15dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43066/0 (socket says 172.21.15.49:43066) 2023-12-19T05:45:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.781+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2857992796 learned_addr learned my addr 172.21.15.49:0/2857992796 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe19c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19b7fe640 1 --2- 172.21.15.49:0/2857992796 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0ae110 0x7fe19c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195580934 0 0) 0x7fe194001110 con 0x7fe19c0b0640 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe188003520 con 0x7fe19c0b0640 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188838816 0 0) 0x7fe188003520 con 0x7fe19c0b0640 2023-12-19T05:45:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 msgr2=0x7fe19c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe19c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0ae110 msgr2=0x7fe19c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 --2- 172.21.15.49:0/2857992796 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0ae110 0x7fe19c0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0ae640 con 0x7fe19c0b0640 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe194001800 con 0x7fe19c0b0640 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 >> v1:172.21.15.49:6789/0 conn(0x7fe19c0b0640 legacy=0x7fe19c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1880039e0 0x7fe188003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe1880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe188004d00 0x7fe188005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c06b8c0 con 0x7fe188004d00 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c15b740 con 0x7fe1880039e0 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.782+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18800dc10 con 0x7fe19c157bf0 2023-12-19T05:45:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe188004d00 0x7fe188005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1880039e0 0x7fe188003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 msgr2=0x7fe1880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe19b7fe640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe1880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c157bf0 0x7fe1880047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1880039e0 msgr2=0x7fe188003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1880039e0 0x7fe188003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2857992796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188003520 con 0x7fe188004d00 2023-12-19T05:45:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.783+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1880039e0 0x7fe188003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.784+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe188004d00 0x7fe188005180 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c210 tx=0x7fe1880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac70fbf3a9992cf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.784+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19402cae0 con 0x7fe188004d00 2023-12-19T05:45:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.784+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19402cc60 con 0x7fe188004d00 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.784+0000 7fe19affd640 1 -- 172.21.15.49:0/2857992796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940058d0 con 0x7fe188004d00 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2857992796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe188004d00 msgr2=0x7fe188005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2857992796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe188004d00 0x7fe188005180 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c210 tx=0x7fe1880057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2857992796 reap_dead start 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2857992796 shutdown_connections 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2857992796 >> 172.21.15.49:0/2857992796 conn(0x7fe19c0cbb70 msgr2=0x7fe19c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2857992796 shutdown_connections 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.785+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2857992796 wait complete. 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.787+0000 7fe1a26e5640 1 Processor -- start 2023-12-19T05:45:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.787+0000 7fe1a26e5640 1 -- start start 2023-12-19T05:45:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe188004d00 0x7fe19c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c1f3480 0x7fe19c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c15d820 con 0x7fe19c1f3900 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c15c4d0 con 0x7fe188004d00 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.788+0000 7fe1a26e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c15c7b0 con 0x7fe19c1f3480 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53046/0 (socket says 172.21.15.49:53046) 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2021755418 learned_addr learned my addr 172.21.15.49:0/2021755418 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe19b7fe640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c1f3480 0x7fe19c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe188004d00 0x7fe19c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c1f3480 msgr2=0x7fe19c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c1f3480 0x7fe19c151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe188004d00 msgr2=0x7fe19c1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe188004d00 0x7fe19c1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 -- 172.21.15.49:0/2021755418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c1f2c80 con 0x7fe19c1f3900 2023-12-19T05:45:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.789+0000 7fe1a0c82640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c210 tx=0x7fe194001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.790+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19403c040 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.790+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194004bf0 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.790+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c1f2f60 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.790+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194001110 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.790+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c0aca90 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.791+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c1f2ac0 con 0x7fe19c1f3900 2023-12-19T05:45:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.792+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe194032070 con 0x7fe19c1f3900 2023-12-19T05:45:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.793+0000 7fe198ff9640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.793+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1940a9410 con 0x7fe19c1f3900 2023-12-19T05:45:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.794+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.795+0000 7fe19bfff640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 0x7fe17c06c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0af300 tx=0x7fe184008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:58.798+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe194074cf0 con 0x7fe19c1f3900 2023-12-19T05:45:59.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.068+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fe19c0b0a90 con 0x7fe19c1f3900 2023-12-19T05:45:59.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.584+0000 7fe198ff9640 1 -- 172.21.15.49:0/2021755418 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v358) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe19c0b0a90 con 0x7fe19c1f3900 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 msgr2=0x7fe17c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 0x7fe17c06c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0af300 tx=0x7fe184008040 comp rx=0 tx=0).stop 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 msgr2=0x7fe19c152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c210 tx=0x7fe194001c00 comp rx=0 tx=0).stop 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 shutdown_connections 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c1f3480 0x7fe19c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c1f3900 0x7fe19c152480 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 --2- 172.21.15.49:0/2021755418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe188004d00 0x7fe19c1f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.588+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 >> 172.21.15.49:0/2021755418 conn(0x7fe19c0cbb70 msgr2=0x7fe19c15dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.589+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 shutdown_connections 2023-12-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.589+0000 7fe1a26e5640 1 -- 172.21.15.49:0/2021755418 wait complete. 2023-12-19T05:45:59.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:45:59.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.847+0000 7f843e7b5640 1 Processor -- start 2023-12-19T05:45:59.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.847+0000 7f843e7b5640 1 -- start start 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.849+0000 7f843e7b5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8438146cd0 0x7f84380b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.849+0000 7f843e7b5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f843806f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.849+0000 7f843e7b5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843806fe30 con 0x7f843806f9d0 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.849+0000 7f843e7b5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84381470b0 con 0x7f8438146cd0 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.849+0000 7f843e7b5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8438070260 con 0x7f84380b6890 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f843dfb4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f843806f9d0 0x7f8438160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43080/0 (socket says 172.21.15.49:43080) 2023-12-19T05:45:59.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f843dfb4640 1 -- 172.21.15.49:0/372347789 learned_addr learned my addr 172.21.15.49:0/372347789 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:45:59.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f843cfb2640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f843806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496482923 0 0) 0x7f843806fe30 con 0x7f843806f9d0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8424003520 con 0x7f843806f9d0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.850+0000 7f843d7b3640 1 --2- 172.21.15.49:0/372347789 >> v2:172.21.15.115:3300/0 conn(0x7f8438146cd0 0x7f84380b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 915687993 0 0) 0x7f8424003520 con 0x7f843806f9d0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 msgr2=0x7f843806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f843806f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 >> v2:172.21.15.115:3300/0 conn(0x7f8438146cd0 msgr2=0x7f84380b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 --2- 172.21.15.49:0/372347789 >> v2:172.21.15.115:3300/0 conn(0x7f8438146cd0 0x7f84380b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380b6ea0 con 0x7f843806f9d0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8430001670 con 0x7f843806f9d0 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 >> v1:172.21.15.49:6789/0 conn(0x7f843806f9d0 legacy=0x7f8438160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f8424003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f84240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424004d00 0x7f8424005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84381470b0 con 0x7f8424003f40 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438070260 con 0x7f8424004d00 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842400ba30 con 0x7f84380b6890 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.851+0000 7f843cfb2640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f84240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843d7b3640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f8424003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843cfb2640 1 -- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 msgr2=0x7f8424003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843cfb2640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f8424003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843dfb4640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424004d00 0x7f8424005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843cfb2640 1 -- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424004d00 msgr2=0x7f8424005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843cfb2640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424004d00 0x7f8424005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843cfb2640 1 -- 172.21.15.49:0/372347789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424003520 con 0x7f8424003f40 2023-12-19T05:45:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.852+0000 7f843d7b3640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b6890 0x7f8424003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:59.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.853+0000 7f843cfb2640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f84240047c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8428009ac0 tx=0x7f84240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8cc7138a924e23 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:59.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.853+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842802c6b0 con 0x7f8424003f40 2023-12-19T05:45:59.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.853+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842802c810 con 0x7f8424003f40 2023-12-19T05:45:59.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.853+0000 7f842ffff640 1 -- 172.21.15.49:0/372347789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842802cba0 con 0x7f8424003f40 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 -- 172.21.15.49:0/372347789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 msgr2=0x7f84240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 --2- 172.21.15.49:0/372347789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f84240047c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8428009ac0 tx=0x7f84240057f0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843dfb4640 1 -- 172.21.15.49:0/372347789 reap_dead start 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 -- 172.21.15.49:0/372347789 shutdown_connections 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 -- 172.21.15.49:0/372347789 >> 172.21.15.49:0/372347789 conn(0x7f84380d3200 msgr2=0x7f84380d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 -- 172.21.15.49:0/372347789 shutdown_connections 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.854+0000 7f843e7b5640 1 -- 172.21.15.49:0/372347789 wait complete. 2023-12-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.856+0000 7f843e7b5640 1 Processor -- start 2023-12-19T05:45:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.856+0000 7f843e7b5640 1 -- start start 2023-12-19T05:45:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380c9100 0x7f843813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438141400 0x7f843815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c8ce0 con 0x7f8424003f40 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843813f8e0 con 0x7f8438141400 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.857+0000 7f843e7b5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c8340 con 0x7f84380c9100 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53064/0 (socket says 172.21.15.49:53064) 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 -- 172.21.15.49:0/1068327468 learned_addr learned my addr 172.21.15.49:0/1068327468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843cfb2640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380c9100 0x7f843813f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843dfb4640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438141400 0x7f843815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 -- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380c9100 msgr2=0x7f843813f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380c9100 0x7f843813f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 -- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438141400 msgr2=0x7f843815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:59.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438141400 0x7f843815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:59.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 -- 172.21.15.49:0/1068327468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380c8620 con 0x7f8424003f40 2023-12-19T05:45:59.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.858+0000 7f843d7b3640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f843400f400 tx=0x7f843400f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:59.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.859+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843401a070 con 0x7f8424003f40 2023-12-19T05:45:59.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.859+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434003990 con 0x7f8424003f40 2023-12-19T05:45:59.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.859+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434003d00 con 0x7f8424003f40 2023-12-19T05:45:59.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.859+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84380c8900 con 0x7f8424003f40 2023-12-19T05:45:59.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.859+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438141a60 con 0x7f8424003f40 2023-12-19T05:45:59.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.860+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8438061910 con 0x7f8424003f40 2023-12-19T05:45:59.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.861+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8434004020 con 0x7f8424003f40 2023-12-19T05:45:59.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.862+0000 7f842dffb640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 0x7f841c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:59.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.862+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84340892d0 con 0x7f8424003f40 2023-12-19T05:45:59.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.862+0000 7f843cfb2640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 0x7f841c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:59.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.864+0000 7f843cfb2640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 0x7f841c06c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8428036000 tx=0x7f8428030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:59.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:45:59.866+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8434054bb0 con 0x7f8424003f40 2023-12-19T05:46:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.062+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84380b6670 con 0x7f8424003f40 2023-12-19T05:46:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.070+0000 7f842dffb640 1 -- 172.21.15.49:0/1068327468 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8434003e60 con 0x7f8424003f40 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 msgr2=0x7f841c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 0x7f841c06c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8428036000 tx=0x7f8428030000 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 msgr2=0x7f843815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f843400f400 tx=0x7f843400f8c0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 shutdown_connections 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841c06a430 0x7f841c06c8f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380c9100 0x7f843813f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438141400 0x7f843815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 --2- 172.21.15.49:0/1068327468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8424003f40 0x7f843815c9e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 >> 172.21.15.49:0/1068327468 conn(0x7f84380d3200 msgr2=0x7f8438143400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 shutdown_connections 2023-12-19T05:46:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.073+0000 7f843e7b5640 1 -- 172.21.15.49:0/1068327468 wait complete. 2023-12-19T05:46:00.093 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:46:00.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:00.219 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:00.338 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:46:00.338 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:00.338 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:00.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:46:00.403 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:00.403 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:00.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:46:00.465 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:00.465 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:00.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:46:00.530 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:00.530 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:00.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:46:00.593 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:46:00.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:00.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.839+0000 7f8069acc640 1 Processor -- start 2023-12-19T05:46:00.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.839+0000 7f8069acc640 1 -- start start 2023-12-19T05:46:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.840+0000 7f8069acc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f806415e5a0 0x7f80640b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8069acc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806415ec30 con 0x7f806415f680 2023-12-19T05:46:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8069acc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806415e980 con 0x7f80640cdbf0 2023-12-19T05:46:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8069acc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80640b2f90 con 0x7f806415e5a0 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8068aca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f806415e5a0 0x7f80640b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8068aca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f806415e5a0 0x7f80640b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53070/0 (socket says 172.21.15.49:53070) 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8063fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f806415f680 0x7f80640b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43094/0 (socket says 172.21.15.49:43094) 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.841+0000 7f8068aca640 1 -- 172.21.15.49:0/2157461021 learned_addr learned my addr 172.21.15.49:0/2157461021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.842+0000 7f8068aca640 1 -- 172.21.15.49:0/2157461021 >> v1:172.21.15.115:6789/0 conn(0x7f80640cdbf0 legacy=0x7f806406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.842+0000 7f8068aca640 1 -- 172.21.15.49:0/2157461021 >> v1:172.21.15.49:6789/0 conn(0x7f806415f680 legacy=0x7f80640b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.842+0000 7f8068aca640 1 -- 172.21.15.49:0/2157461021 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640b3270 con 0x7f806415e5a0 2023-12-19T05:46:00.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.843+0000 7f8068aca640 1 --2- 172.21.15.49:0/2157461021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f806415e5a0 0x7f80640b2030 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f80580098a0 tx=0x7f805802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25832500f41356f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:00.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.843+0000 7f80637fe640 1 -- 172.21.15.49:0/2157461021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058030840 con 0x7f806415e5a0 2023-12-19T05:46:00.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.843+0000 7f80637fe640 1 -- 172.21.15.49:0/2157461021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580309a0 con 0x7f806415e5a0 2023-12-19T05:46:00.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.843+0000 7f80637fe640 1 -- 172.21.15.49:0/2157461021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058030d30 con 0x7f806415e5a0 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 -- 172.21.15.49:0/2157461021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f806415e5a0 msgr2=0x7f80640b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 --2- 172.21.15.49:0/2157461021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f806415e5a0 0x7f80640b2030 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f80580098a0 tx=0x7f805802b980 comp rx=0 tx=0).stop 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 -- 172.21.15.49:0/2157461021 shutdown_connections 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 --2- 172.21.15.49:0/2157461021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f806415e5a0 0x7f80640b2030 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 -- 172.21.15.49:0/2157461021 >> 172.21.15.49:0/2157461021 conn(0x7f80640b0100 msgr2=0x7f80640b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 -- 172.21.15.49:0/2157461021 shutdown_connections 2023-12-19T05:46:00.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.844+0000 7f8069acc640 1 -- 172.21.15.49:0/2157461021 wait complete. 2023-12-19T05:46:00.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.846+0000 7f8069acc640 1 Processor -- start 2023-12-19T05:46:00.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.846+0000 7f8069acc640 1 -- start start 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f806415e5a0 0x7f80640c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 0x7f806406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c3fa0 con 0x7f80640cdbf0 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c4240 con 0x7f806415f680 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8069acc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c4520 con 0x7f806415e5a0 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8068aca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8068aca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53076/0 (socket says 172.21.15.49:53076) 2023-12-19T05:46:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.847+0000 7f8068aca640 1 -- 172.21.15.49:0/729880571 learned_addr learned my addr 172.21.15.49:0/729880571 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f80692cb640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 0x7f806406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 -- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f806415e5a0 msgr2=0x7f80640c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f806415e5a0 0x7f80640c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 -- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 msgr2=0x7f806406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 0x7f806406c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 -- 172.21.15.49:0/729880571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580094d0 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f80692cb640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 0x7f806406c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8068aca640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f80580098a0 tx=0x7f8058004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580307f0 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8058043400 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580437b0 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.848+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80640c4800 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.849+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8064155bf0 con 0x7f80640cdbf0 2023-12-19T05:46:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.850+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064061910 con 0x7f80640cdbf0 2023-12-19T05:46:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.851+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8058043910 con 0x7f80640cdbf0 2023-12-19T05:46:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.852+0000 7f80617fa640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 0x7f804806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.852+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f805803e070 con 0x7f80640cdbf0 2023-12-19T05:46:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.852+0000 7f8063fff640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 0x7f804806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.854+0000 7f8063fff640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 0x7f804806c920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8050000f60 tx=0x7f8050007a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:00.856+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8058077170 con 0x7f80640cdbf0 2023-12-19T05:46:01.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.085+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80640ce980 con 0x7f80640cdbf0 2023-12-19T05:46:01.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.086+0000 7f80617fa640 1 -- 172.21.15.49:0/729880571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8058034de0 con 0x7f80640cdbf0 2023-12-19T05:46:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:01.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1783174871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1783174871},{"type":"v1","addr":"172.21.15.115:6837","nonce":1783174871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":5845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1576670910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1576670910},{"type":"v1","addr":"172.21.15.49:6833","nonce":1576670910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/671749468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":671749468},{"type":"v1","addr":"172.21.15.49:6835","nonce":671749468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4272286957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4272286957},{"type":"v1","addr":"172.21.15.115:6836","nonce":4272286957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-12-19T05:46:01.088 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 50 2023-12-19T05:46:01.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 msgr2=0x7f804806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 0x7f804806c920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8050000f60 tx=0x7f8050007a00 comp rx=0 tx=0).stop 2023-12-19T05:46:01.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 msgr2=0x7f80641556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f80580098a0 tx=0x7f8058004730 comp rx=0 tx=0).stop 2023-12-19T05:46:01.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 shutdown_connections 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f804806a460 0x7f804806c920 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f806415e5a0 0x7f80640c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f806415f680 0x7f806406c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 --2- 172.21.15.49:0/729880571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80640cdbf0 0x7f80641556b0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.088+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 >> 172.21.15.49:0/729880571 conn(0x7f80640b0100 msgr2=0x7f806415a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.089+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 shutdown_connections 2023-12-19T05:46:01.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.089+0000 7f8069acc640 1 -- 172.21.15.49:0/729880571 wait complete. 2023-12-19T05:46:01.111 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:46:01.111 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:46:01.111 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:46:01.111 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:01.112 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:46:01.112 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:46:01.112 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:46:01.112 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:01.112 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:46:01.112 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:46:01.112 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:46:01.113 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:01.113 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:46:01.113 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:46:01.113 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:46:01.113 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:01.133 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:46:01.133 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:46:01.134 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:46:01.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:46:01.135 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:46:01.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:46:01.137 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:46:01.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:46:01.184 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:46:01.184 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:01.185 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:46:01.185 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:01.191 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:46:01.192 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:01.192 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:46:01.192 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:01.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:46:01.346 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:46:01.346 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:46:01.356 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:46:01.357 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:46:01.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.400+0000 7fd751857640 1 Processor -- start 2023-12-19T05:46:01.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.401+0000 7fd751857640 1 -- start start 2023-12-19T05:46:01.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.402+0000 7fd751857640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd74c0ce820 0x7fd74c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:01.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.402+0000 7fd751857640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c0cd840 con 0x7fd74c146e10 2023-12-19T05:46:01.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.402+0000 7fd751857640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c0b6e90 con 0x7fd74c0d2b00 2023-12-19T05:46:01.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.402+0000 7fd751857640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74c0d2430 con 0x7fd74c0ce820 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd74c146e10 0x7fd74c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43096/0 (socket says 172.21.15.49:43096) 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74affd640 1 -- 172.21.15.49:0/3462880833 learned_addr learned my addr 172.21.15.49:0/3462880833 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74b7fe640 1 --2- 172.21.15.49:0/3462880833 >> v2:172.21.15.49:3300/0 conn(0x7fd74c0ce820 0x7fd74c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460394008 0 0) 0x7fd74c0cd840 con 0x7fd74c146e10 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd738003520 con 0x7fd74c146e10 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682575895 0 0) 0x7fd74c0b6e90 con 0x7fd74c0d2b00 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd74c0cd840 con 0x7fd74c0d2b00 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74b7fe640 1 -- 172.21.15.49:0/3462880833 >> v1:172.21.15.115:6789/0 conn(0x7fd74c0d2b00 legacy=0x7fd74c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.403+0000 7fd74b7fe640 1 -- 172.21.15.49:0/3462880833 >> v1:172.21.15.49:6789/0 conn(0x7fd74c146e10 legacy=0x7fd74c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.404+0000 7fd74b7fe640 1 -- 172.21.15.49:0/3462880833 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c0d2620 con 0x7fd74c0ce820 2023-12-19T05:46:01.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd74b7fe640 1 --2- 172.21.15.49:0/3462880833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c0d1ef0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd744009d90 tx=0x7fd74402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94d9c46276d0e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:01.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74402cc60 con 0x7fd74c0ce820 2023-12-19T05:46:01.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74402cdc0 con 0x7fd74c0ce820 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd74a7fc640 1 -- 172.21.15.49:0/3462880833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744034660 con 0x7fd74c0ce820 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd751857640 1 -- 172.21.15.49:0/3462880833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 msgr2=0x7fd74c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.405+0000 7fd751857640 1 --2- 172.21.15.49:0/3462880833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c0d1ef0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd744009d90 tx=0x7fd74402beb0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.406+0000 7fd751857640 1 -- 172.21.15.49:0/3462880833 shutdown_connections 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.406+0000 7fd751857640 1 --2- 172.21.15.49:0/3462880833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c0d1ef0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.406+0000 7fd751857640 1 -- 172.21.15.49:0/3462880833 >> 172.21.15.49:0/3462880833 conn(0x7fd74c0b29c0 msgr2=0x7fd74c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:01.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.406+0000 7fd751857640 1 -- 172.21.15.49:0/3462880833 shutdown_connections 2023-12-19T05:46:01.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.406+0000 7fd751857640 1 -- 172.21.15.49:0/3462880833 wait complete. 2023-12-19T05:46:01.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.407+0000 7fd751857640 1 Processor -- start 2023-12-19T05:46:01.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.407+0000 7fd751857640 1 -- start start 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd74c0d2b00 0x7fd74c142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd74c146e10 0x7fd74c160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c140f80 con 0x7fd74c0ce820 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c143520 con 0x7fd74c0d2b00 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.408+0000 7fd751857640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c143750 con 0x7fd74c146e10 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53126/0 (socket says 172.21.15.49:53126) 2023-12-19T05:46:01.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 -- 172.21.15.49:0/494590199 learned_addr learned my addr 172.21.15.49:0/494590199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd743fff640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd74c0d2b00 0x7fd74c142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74b7fe640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd74c146e10 0x7fd74c160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 -- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd74c146e10 msgr2=0x7fd74c160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd74c146e10 0x7fd74c160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 -- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd74c0d2b00 msgr2=0x7fd74c142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd74c0d2b00 0x7fd74c142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.409+0000 7fd74affd640 1 -- 172.21.15.49:0/494590199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744009a70 con 0x7fd74c0ce820 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd74affd640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c440 tx=0x7fd73c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c005ce0 con 0x7fd74c0ce820 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c005e40 con 0x7fd74c0ce820 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c007270 con 0x7fd74c0ce820 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c143a30 con 0x7fd74c0ce820 2023-12-19T05:46:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.410+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c143ff0 con 0x7fd74c0ce820 2023-12-19T05:46:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.411+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c1410c0 con 0x7fd74c0ce820 2023-12-19T05:46:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.412+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd73c0073d0 con 0x7fd74c0ce820 2023-12-19T05:46:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.413+0000 7fd748ff9640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 0x7fd72c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.413+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd73c0879a0 con 0x7fd74c0ce820 2023-12-19T05:46:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.414+0000 7fd743fff640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 0x7fd72c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.414+0000 7fd743fff640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 0x7fd72c06c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd74c15eb90 tx=0x7fd734009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.417+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd74c1410c0 con 0x7fd74c0ce820 2023-12-19T05:46:01.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:01.619+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd74c1410c0 con 0x7fd74c0ce820 2023-12-19T05:46:02.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.607+0000 7fd748ff9640 1 -- 172.21.15.49:0/494590199 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v124) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd74c1410c0 con 0x7fd74c0ce820 2023-12-19T05:46:02.609 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 msgr2=0x7fd72c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 0x7fd72c06c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd74c15eb90 tx=0x7fd734009040 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 msgr2=0x7fd74c1f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c440 tx=0x7fd73c00c900 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 shutdown_connections 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd72c06a430 0x7fd72c06c8f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd74c146e10 0x7fd74c160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd74c0d2b00 0x7fd74c142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 --2- 172.21.15.49:0/494590199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd74c0ce820 0x7fd74c1f6c90 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 >> 172.21.15.49:0/494590199 conn(0x7fd74c0b29c0 msgr2=0x7fd74c1619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 shutdown_connections 2023-12-19T05:46:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.611+0000 7fd751857640 1 -- 172.21.15.49:0/494590199 wait complete. 2023-12-19T05:46:02.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:46:02.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.863+0000 7f7e79fb9640 1 Processor -- start 2023-12-19T05:46:02.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.863+0000 7f7e79fb9640 1 -- start start 2023-12-19T05:46:02.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.865+0000 7f7e79fb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 0x7f7e7406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:02.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.865+0000 7f7e79fb9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b2600 con 0x7f7e74157aa0 2023-12-19T05:46:02.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.865+0000 7f7e79fb9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b1d60 con 0x7f7e740b1710 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.865+0000 7f7e79fb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740b2040 con 0x7f7e7415e750 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.866+0000 7f7e737fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7e74157aa0 0x7f7e74161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43110/0 (socket says 172.21.15.49:43110) 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.866+0000 7f7e737fe640 1 -- 172.21.15.49:0/3217652033 learned_addr learned my addr 172.21.15.49:0/3217652033 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.866+0000 7f7e73fff640 1 --2- 172.21.15.49:0/3217652033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 0x7f7e7406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.866+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855934367 0 0) 0x7f7e740b2600 con 0x7f7e74157aa0 2023-12-19T05:46:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.866+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e60003520 con 0x7f7e74157aa0 2023-12-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.867+0000 7f7e73fff640 1 -- 172.21.15.49:0/3217652033 >> v1:172.21.15.115:6789/0 conn(0x7f7e740b1710 legacy=0x7f7e7415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.867+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072602314 0 0) 0x7f7e60003520 con 0x7f7e74157aa0 2023-12-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.867+0000 7f7e73fff640 1 -- 172.21.15.49:0/3217652033 >> v1:172.21.15.49:6789/0 conn(0x7f7e74157aa0 legacy=0x7f7e74161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.867+0000 7f7e73fff640 1 -- 172.21.15.49:0/3217652033 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740b2320 con 0x7f7e7415e750 2023-12-19T05:46:02.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.868+0000 7f7e73fff640 1 --2- 172.21.15.49:0/3217652033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 0x7f7e7406e410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009dc0 tx=0x7f7e6c02bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faed68c0853e9cab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64001670 con 0x7f7e7415e750 2023-12-19T05:46:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c02c910 con 0x7f7e7415e750 2023-12-19T05:46:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e72ffd640 1 -- 172.21.15.49:0/3217652033 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c02cca0 con 0x7f7e7415e750 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e79fb9640 1 -- 172.21.15.49:0/3217652033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 msgr2=0x7f7e7406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/3217652033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 0x7f7e7406e410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009dc0 tx=0x7f7e6c02bde0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e79fb9640 1 -- 172.21.15.49:0/3217652033 shutdown_connections 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/3217652033 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e7415e750 0x7f7e7406e410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.869+0000 7f7e79fb9640 1 -- 172.21.15.49:0/3217652033 >> 172.21.15.49:0/3217652033 conn(0x7f7e740cbb70 msgr2=0x7f7e740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.870+0000 7f7e79fb9640 1 -- 172.21.15.49:0/3217652033 shutdown_connections 2023-12-19T05:46:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.870+0000 7f7e79fb9640 1 -- 172.21.15.49:0/3217652033 wait complete. 2023-12-19T05:46:02.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.871+0000 7f7e79fb9640 1 Processor -- start 2023-12-19T05:46:02.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 -- start start 2023-12-19T05:46:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 0x7f7e741505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e74157aa0 0x7f7e740ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74151020 con 0x7f7e7415e750 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74150b30 con 0x7f7e740b1710 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.872+0000 7f7e79fb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7406d970 con 0x7f7e74157aa0 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53140/0 (socket says 172.21.15.49:53140) 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 -- 172.21.15.49:0/180490417 learned_addr learned my addr 172.21.15.49:0/180490417 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e737fe640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 0x7f7e741505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e6bfff640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e74157aa0 0x7f7e740ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 -- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e74157aa0 msgr2=0x7f7e740ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e74157aa0 0x7f7e740ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 -- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 msgr2=0x7f7e741505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 0x7f7e741505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e73fff640 1 -- 172.21.15.49:0/180490417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c009a70 con 0x7f7e7415e750 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.873+0000 7f7e737fe640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 0x7f7e741505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e73fff640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009ee0 tx=0x7f7e6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c009450 con 0x7f7e7415e750 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c03e410 con 0x7f7e7415e750 2023-12-19T05:46:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c03e7c0 con 0x7f7e7415e750 2023-12-19T05:46:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7406b490 con 0x7f7e7415e750 2023-12-19T05:46:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.874+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7406ba50 con 0x7f7e7415e750 2023-12-19T05:46:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.875+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e74061910 con 0x7f7e7415e750 2023-12-19T05:46:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.876+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e6c03b050 con 0x7f7e7415e750 2023-12-19T05:46:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.877+0000 7f7e70ff9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 0x7f7e5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.877+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e6c0aace0 con 0x7f7e7415e750 2023-12-19T05:46:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.878+0000 7f7e737fe640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 0x7f7e5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:02.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.879+0000 7f7e737fe640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 0x7f7e5406c8f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005880 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:02.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:02.882+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e6c0766a0 con 0x7f7e7415e750 2023-12-19T05:46:03.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.153+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7e74071ae0 con 0x7f7e7415e750 2023-12-19T05:46:03.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.154+0000 7f7e70ff9640 1 -- 172.21.15.49:0/180490417 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7e6c079cc0 con 0x7f7e7415e750 2023-12-19T05:46:03.155 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:46:03.156 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:46:03.158 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:46:03.161 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.162 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:46:03.163 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:46:03.164 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:03.165 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:46:03.166 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:03.167 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:46:03.168 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 msgr2=0x7f7e5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 0x7f7e5406c8f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005880 tx=0x7f7e64009040 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 msgr2=0x7f7e740ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009ee0 tx=0x7f7e6c004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 shutdown_connections 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7e5406a430 0x7f7e5406c8f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e74157aa0 0x7f7e740ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7415e750 0x7f7e740ae7c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 --2- 172.21.15.49:0/180490417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e740b1710 0x7f7e741505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 >> 172.21.15.49:0/180490417 conn(0x7f7e740cbb70 msgr2=0x7f7e7406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 shutdown_connections 2023-12-19T05:46:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.157+0000 7f7e79fb9640 1 -- 172.21.15.49:0/180490417 wait complete. 2023-12-19T05:46:03.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.406+0000 7fe6f6617640 1 Processor -- start 2023-12-19T05:46:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.407+0000 7fe6f6617640 1 -- start start 2023-12-19T05:46:03.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.408+0000 7fe6f6617640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6f006c6b0 0x7fe6f0166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.408+0000 7fe6f6617640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f006bb30 con 0x7fe6f00b0b50 2023-12-19T05:46:03.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.409+0000 7fe6f6617640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00b0070 con 0x7fe6f01449e0 2023-12-19T05:46:03.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.409+0000 7fe6f6617640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00b0350 con 0x7fe6f006c6b0 2023-12-19T05:46:03.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.409+0000 7fe6e7fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6f00b0b50 0x7fe6f006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43116/0 (socket says 172.21.15.49:43116) 2023-12-19T05:46:03.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.409+0000 7fe6e7fff640 1 -- 172.21.15.49:0/1202457198 learned_addr learned my addr 172.21.15.49:0/1202457198 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:03.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.409+0000 7fe6f4bb4640 1 --2- 172.21.15.49:0/1202457198 >> v2:172.21.15.115:3300/0 conn(0x7fe6f006c6b0 0x7fe6f0166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.410+0000 7fe6ef7fe640 1 -- 172.21.15.49:0/1202457198 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129032981 0 0) 0x7fe6f006bb30 con 0x7fe6f00b0b50 2023-12-19T05:46:03.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.410+0000 7fe6ef7fe640 1 -- 172.21.15.49:0/1202457198 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6dc003520 con 0x7fe6f00b0b50 2023-12-19T05:46:03.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.410+0000 7fe6f4bb4640 1 -- 172.21.15.49:0/1202457198 >> v1:172.21.15.115:6789/0 conn(0x7fe6f01449e0 legacy=0x7fe6f00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:03.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.410+0000 7fe6f4bb4640 1 -- 172.21.15.49:0/1202457198 >> v1:172.21.15.49:6789/0 conn(0x7fe6f00b0b50 legacy=0x7fe6f006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.410+0000 7fe6f4bb4640 1 -- 172.21.15.49:0/1202457198 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00b0630 con 0x7fe6f006c6b0 2023-12-19T05:46:03.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.411+0000 7fe6f4bb4640 1 --2- 172.21.15.49:0/1202457198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f006c6b0 0x7fe6f0166200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=596c5064c6744e85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.412+0000 7fe6ef7fe640 1 -- 172.21.15.49:0/1202457198 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e802cd00 con 0x7fe6f006c6b0 2023-12-19T05:46:03.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.412+0000 7fe6ef7fe640 1 -- 172.21.15.49:0/1202457198 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e802ce60 con 0x7fe6f006c6b0 2023-12-19T05:46:03.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.412+0000 7fe6ef7fe640 1 -- 172.21.15.49:0/1202457198 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8034660 con 0x7fe6f006c6b0 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.412+0000 7fe6f6617640 1 -- 172.21.15.49:0/1202457198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f006c6b0 msgr2=0x7fe6f0166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.412+0000 7fe6f6617640 1 --2- 172.21.15.49:0/1202457198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f006c6b0 0x7fe6f0166200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009d90 tx=0x7fe6e802bf50 comp rx=0 tx=0).stop 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.413+0000 7fe6f6617640 1 -- 172.21.15.49:0/1202457198 shutdown_connections 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.413+0000 7fe6f6617640 1 --2- 172.21.15.49:0/1202457198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f006c6b0 0x7fe6f0166200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.413+0000 7fe6f6617640 1 -- 172.21.15.49:0/1202457198 >> 172.21.15.49:0/1202457198 conn(0x7fe6f00cbb70 msgr2=0x7fe6f00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.413+0000 7fe6f6617640 1 -- 172.21.15.49:0/1202457198 shutdown_connections 2023-12-19T05:46:03.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.413+0000 7fe6f6617640 1 -- 172.21.15.49:0/1202457198 wait complete. 2023-12-19T05:46:03.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.415+0000 7fe6f6617640 1 Processor -- start 2023-12-19T05:46:03.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.415+0000 7fe6f6617640 1 -- start start 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6f00b0b50 0x7fe6f013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01449e0 0x7fe6f013ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f015d1c0 con 0x7fe6f006c6b0 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f015c5b0 con 0x7fe6f01449e0 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6f6617640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f015c890 con 0x7fe6f00b0b50 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53154/0 (socket says 172.21.15.49:53154) 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.417+0000 7fe6effff640 1 -- 172.21.15.49:0/4218675028 learned_addr learned my addr 172.21.15.49:0/4218675028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:03.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6f4bb4640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01449e0 0x7fe6f013ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6e7fff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6f00b0b50 0x7fe6f013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 -- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6f00b0b50 msgr2=0x7fe6f013a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6f00b0b50 0x7fe6f013a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 -- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01449e0 msgr2=0x7fe6f013ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01449e0 0x7fe6f013ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 -- 172.21.15.49:0/4218675028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8009a70 con 0x7fe6f006c6b0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.418+0000 7fe6effff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c400 tx=0x7fe6e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.419+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00052d0 con 0x7fe6f006c6b0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.419+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0005430 con 0x7fe6f006c6b0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.419+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0003830 con 0x7fe6f006c6b0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.419+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f015cb70 con 0x7fe6f006c6b0 2023-12-19T05:46:03.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.419+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f015e320 con 0x7fe6f006c6b0 2023-12-19T05:46:03.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.420+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f015e4e0 con 0x7fe6f006c6b0 2023-12-19T05:46:03.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.421+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6e0003990 con 0x7fe6f006c6b0 2023-12-19T05:46:03.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.422+0000 7fe6ed7fa640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 0x7fe6d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.422+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6e0087c00 con 0x7fe6f006c6b0 2023-12-19T05:46:03.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.423+0000 7fe6e7fff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 0x7fe6d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.424+0000 7fe6e7fff640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 0x7fe6d006c8f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00ae8c0 tx=0x7fe6d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.427+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6e00534a0 con 0x7fe6f006c6b0 2023-12-19T05:46:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.623+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f0061910 con 0x7fe6f006c6b0 2023-12-19T05:46:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.626+0000 7fe6ed7fa640 1 -- 172.21.15.49:0/4218675028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+12400 (secure 0 0 0) 0x7fe6e0056ac0 con 0x7fe6f006c6b0 2023-12-19T05:46:03.628 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:03.628 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:02.593163+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:03.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 msgr2=0x7fe6d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 0x7fe6d006c8f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00ae8c0 tx=0x7fe6d8009040 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 msgr2=0x7fe6f015dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c400 tx=0x7fe6e000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 shutdown_connections 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe6d006a430 0x7fe6d006c8f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6f00b0b50 0x7fe6f013a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01449e0 0x7fe6f013ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 --2- 172.21.15.49:0/4218675028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f006c6b0 0x7fe6f015dde0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 >> 172.21.15.49:0/4218675028 conn(0x7fe6f00cbb70 msgr2=0x7fe6f00b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 shutdown_connections 2023-12-19T05:46:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.629+0000 7fe6f6617640 1 -- 172.21.15.49:0/4218675028 wait complete. 2023-12-19T05:46:03.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:03.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:03.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.874+0000 7f977531c640 1 Processor -- start 2023-12-19T05:46:03.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.875+0000 7f977531c640 1 -- start start 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.876+0000 7f977531c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f97700b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.876+0000 7f977531c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f977006fba0 0x7f97700d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.876+0000 7f977531c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9770070260 con 0x7f97700b6890 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.876+0000 7f977531c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97701470b0 con 0x7f977006fba0 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.876+0000 7f977531c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700b6ea0 con 0x7f9770146cd0 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f976f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97700b6890 0x7f977006f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43120/0 (socket says 172.21.15.49:43120) 2023-12-19T05:46:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f976f7fe640 1 -- 172.21.15.49:0/3232214213 learned_addr learned my addr 172.21.15.49:0/3232214213 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:03.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f9774b1b640 1 --2- 172.21.15.49:0/3232214213 >> v2:172.21.15.115:3300/0 conn(0x7f977006fba0 0x7f97700d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f976ffff640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f97700b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494910165 0 0) 0x7f9770070260 con 0x7f97700b6890 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.877+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9758003520 con 0x7f97700b6890 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297026148 0 0) 0x7f9758003520 con 0x7f97700b6890 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 msgr2=0x7f97700b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f97700b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 >> v2:172.21.15.115:3300/0 conn(0x7f977006fba0 msgr2=0x7f97700d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 --2- 172.21.15.49:0/3232214213 >> v2:172.21.15.115:3300/0 conn(0x7f977006fba0 0x7f97700d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700b7180 con 0x7f97700b6890 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9764001670 con 0x7f97700b6890 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f9774b1b640 1 --2- 172.21.15.49:0/3232214213 >> v2:172.21.15.115:3300/0 conn(0x7f977006fba0 0x7f97700d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 >> v1:172.21.15.49:6789/0 conn(0x7f97700b6890 legacy=0x7f977006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f9758003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9758003f40 0x7f97580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758004d00 0x7f9758005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701470b0 con 0x7f9758003f40 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700b6ea0 con 0x7f9758004d00 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975800bae0 con 0x7f9770146cd0 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.878+0000 7f976f7fe640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9758003f40 0x7f97580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f9774b1b640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758004d00 0x7f9758005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976ffff640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f9758003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976f7fe640 1 -- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 msgr2=0x7f9758003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976f7fe640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f9758003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976f7fe640 1 -- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758004d00 msgr2=0x7f9758005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976f7fe640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758004d00 0x7f9758005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976f7fe640 1 -- 172.21.15.49:0/3232214213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758003520 con 0x7f9758003f40 2023-12-19T05:46:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.879+0000 7f976ffff640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770146cd0 0x7f9758003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.880+0000 7f976f7fe640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9758003f40 0x7f97580047c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f976400c110 tx=0x7f97580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fdfb9d5f2ec7c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.880+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764005ad0 con 0x7f9758003f40 2023-12-19T05:46:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.880+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764005c50 con 0x7f9758003f40 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.880+0000 7f976effd640 1 -- 172.21.15.49:0/3232214213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976402c830 con 0x7f9758003f40 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 -- 172.21.15.49:0/3232214213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9758003f40 msgr2=0x7f97580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 --2- 172.21.15.49:0/3232214213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9758003f40 0x7f97580047c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f976400c110 tx=0x7f97580057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f9774b1b640 1 -- 172.21.15.49:0/3232214213 reap_dead start 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 -- 172.21.15.49:0/3232214213 shutdown_connections 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 -- 172.21.15.49:0/3232214213 >> 172.21.15.49:0/3232214213 conn(0x7f97700d3200 msgr2=0x7f97700d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 -- 172.21.15.49:0/3232214213 shutdown_connections 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.881+0000 7f977531c640 1 -- 172.21.15.49:0/3232214213 wait complete. 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.883+0000 7f977531c640 1 Processor -- start 2023-12-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.883+0000 7f977531c640 1 -- start start 2023-12-19T05:46:03.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 0x7f9770139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 0x7f977013a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977013a5d0 con 0x7f97701f60a0 2023-12-19T05:46:03.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770139870 con 0x7f9758003f40 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f977531c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977013c590 con 0x7f9770139c10 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.884+0000 7f9774b1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53160/0 (socket says 172.21.15.49:53160) 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 -- 172.21.15.49:0/1562392285 learned_addr learned my addr 172.21.15.49:0/1562392285 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f976f7fe640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 0x7f977013a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f976ffff640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 0x7f9770139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 -- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 msgr2=0x7f977013a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 0x7f977013a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 -- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 msgr2=0x7f9770139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 0x7f9770139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 -- 172.21.15.49:0/1562392285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977013b980 con 0x7f97701f60a0 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f976f7fe640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 0x7f977013a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f976ffff640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 0x7f9770139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.885+0000 7f9774b1b640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f9770071a50 tx=0x7f97680108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.886+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768004440 con 0x7f97701f60a0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.886+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800c050 con 0x7f97701f60a0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.886+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768003850 con 0x7f97701f60a0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.886+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977013bc60 con 0x7f97701f60a0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.886+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977013c220 con 0x7f97701f60a0 2023-12-19T05:46:03.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.887+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770061910 con 0x7f97701f60a0 2023-12-19T05:46:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.888+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97680039b0 con 0x7f97701f60a0 2023-12-19T05:46:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.889+0000 7f976cff9640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 0x7f975c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.890+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97680880f0 con 0x7f97701f60a0 2023-12-19T05:46:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.890+0000 7f976ffff640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 0x7f975c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:03.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.891+0000 7f976ffff640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 0x7f975c06c970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9760007440 tx=0x7f976000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:03.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:03.894+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9768053aa0 con 0x7f97701f60a0 2023-12-19T05:46:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.092+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97700cf390 con 0x7f97701f60a0 2023-12-19T05:46:04.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.093+0000 7f976cff9640 1 -- 172.21.15.49:0/1562392285 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97680570c0 con 0x7f97701f60a0 2023-12-19T05:46:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 msgr2=0x7f975c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 0x7f975c06c970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9760007440 tx=0x7f976000d040 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 msgr2=0x7f97701f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f9770071a50 tx=0x7f97680108b0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 shutdown_connections 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f975c06a4b0 0x7f975c06c970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9770139c10 0x7f977013a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97701f60a0 0x7f97701f6520 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 --2- 172.21.15.49:0/1562392285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9758003f40 0x7f9770139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 >> 172.21.15.49:0/1562392285 conn(0x7f97700d3200 msgr2=0x7f97701606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 shutdown_connections 2023-12-19T05:46:04.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.096+0000 7f977531c640 1 -- 172.21.15.49:0/1562392285 wait complete. 2023-12-19T05:46:04.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:46:04.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.345+0000 7fcb8ebce640 1 Processor -- start 2023-12-19T05:46:04.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.345+0000 7fcb8ebce640 1 -- start start 2023-12-19T05:46:04.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.347+0000 7fcb8ebce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.347+0000 7fcb8ebce640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb8806d850 0x7fcb8806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.347+0000 7fcb8ebce640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb88070130 con 0x7fcb88158df0 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.347+0000 7fcb8ebce640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8806f6a0 con 0x7fcb8806d850 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.347+0000 7fcb8ebce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8815c910 con 0x7fcb8815c460 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.348+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.348+0000 7fcb8d16b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb8806d850 0x7fcb8806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.348+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41588/0 (socket says 172.21.15.49:41588) 2023-12-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.348+0000 7fcb87fff640 1 -- 172.21.15.49:0/2288188455 learned_addr learned my addr 172.21.15.49:0/2288188455 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:04.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.349+0000 7fcb87fff640 1 -- 172.21.15.49:0/2288188455 >> v2:172.21.15.115:3300/0 conn(0x7fcb8806d850 msgr2=0x7fcb8806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:04.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.349+0000 7fcb87fff640 1 --2- 172.21.15.49:0/2288188455 >> v2:172.21.15.115:3300/0 conn(0x7fcb8806d850 0x7fcb8806dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.349+0000 7fcb87fff640 1 -- 172.21.15.49:0/2288188455 >> v1:172.21.15.115:6789/0 conn(0x7fcb88158df0 legacy=0x7fcb880cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.349+0000 7fcb87fff640 1 -- 172.21.15.49:0/2288188455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8806e1c0 con 0x7fcb8815c460 2023-12-19T05:46:04.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.350+0000 7fcb87fff640 1 --2- 172.21.15.49:0/2288188455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009870 tx=0x7fcb7002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a848572b2986ed3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.350+0000 7fcb877fe640 1 -- 172.21.15.49:0/2288188455 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70031640 con 0x7fcb8815c460 2023-12-19T05:46:04.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.350+0000 7fcb877fe640 1 -- 172.21.15.49:0/2288188455 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700317a0 con 0x7fcb8815c460 2023-12-19T05:46:04.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.350+0000 7fcb877fe640 1 -- 172.21.15.49:0/2288188455 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70031b30 con 0x7fcb8815c460 2023-12-19T05:46:04.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 -- 172.21.15.49:0/2288188455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 msgr2=0x7fcb8806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/2288188455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009870 tx=0x7fcb7002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 -- 172.21.15.49:0/2288188455 shutdown_connections 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/2288188455 >> v2:172.21.15.115:3300/0 conn(0x7fcb8806d850 0x7fcb8806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/2288188455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb8806f160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 -- 172.21.15.49:0/2288188455 >> 172.21.15.49:0/2288188455 conn(0x7fcb880cf0b0 msgr2=0x7fcb880cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 -- 172.21.15.49:0/2288188455 shutdown_connections 2023-12-19T05:46:04.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.351+0000 7fcb8ebce640 1 -- 172.21.15.49:0/2288188455 wait complete. 2023-12-19T05:46:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.353+0000 7fcb8ebce640 1 Processor -- start 2023-12-19T05:46:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.353+0000 7fcb8ebce640 1 -- start start 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 0x7fcb8806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb881f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88147d10 con 0x7fcb88158df0 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8806cb70 con 0x7fcb8806d850 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb8ebce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880cc470 con 0x7fcb8815c460 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.354+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53168/0 (socket says 172.21.15.49:53168) 2023-12-19T05:46:04.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 -- 172.21.15.49:0/1060841975 learned_addr learned my addr 172.21.15.49:0/1060841975 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb8d16b640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb881f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb8c96a640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 0x7fcb8806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 -- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 msgr2=0x7fcb881f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb881f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 -- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 msgr2=0x7fcb8806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 0x7fcb8806bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 -- 172.21.15.49:0/1060841975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700094d0 con 0x7fcb88158df0 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb8c96a640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 0x7fcb8806bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.355+0000 7fcb87fff640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fcb700090b0 tx=0x7fcb700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.356+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7003b940 con 0x7fcb88158df0 2023-12-19T05:46:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.356+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7003bac0 con 0x7fcb88158df0 2023-12-19T05:46:04.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.356+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7003be70 con 0x7fcb88158df0 2023-12-19T05:46:04.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.356+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb88151810 con 0x7fcb88158df0 2023-12-19T05:46:04.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.356+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8806c800 con 0x7fcb88158df0 2023-12-19T05:46:04.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.357+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb88074770 con 0x7fcb88158df0 2023-12-19T05:46:04.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.358+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb7002f050 con 0x7fcb88158df0 2023-12-19T05:46:04.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.359+0000 7fcb857fa640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 0x7fcb6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.359+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb700aa480 con 0x7fcb88158df0 2023-12-19T05:46:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.360+0000 7fcb8c96a640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 0x7fcb6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.361+0000 7fcb8c96a640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 0x7fcb6806c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcb880cb460 tx=0x7fcb78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.363+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb70075d30 con 0x7fcb88158df0 2023-12-19T05:46:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.558+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcb8806cd20 con 0x7fcb88158df0 2023-12-19T05:46:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.559+0000 7fcb857fa640 1 -- 172.21.15.49:0/1060841975 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcb8806cd20 con 0x7fcb88158df0 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:04.561 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:46:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 msgr2=0x7fcb6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 0x7fcb6806c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcb880cb460 tx=0x7fcb78009040 comp rx=0 tx=0).stop 2023-12-19T05:46:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 msgr2=0x7fcb881f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fcb700090b0 tx=0x7fcb700046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 shutdown_connections 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcb6806a430 0x7fcb6806c8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb8815c460 0x7fcb881f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb88158df0 0x7fcb881f6210 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 --2- 172.21.15.49:0/1060841975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb8806d850 0x7fcb8806bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 >> 172.21.15.49:0/1060841975 conn(0x7fcb880cf0b0 msgr2=0x7fcb8815b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.562+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 shutdown_connections 2023-12-19T05:46:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.563+0000 7fcb8ebce640 1 -- 172.21.15.49:0/1060841975 wait complete. 2023-12-19T05:46:04.584 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:46:04.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:46:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.797+0000 7fb697a4c640 1 Processor -- start 2023-12-19T05:46:04.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.797+0000 7fb697a4c640 1 -- start start 2023-12-19T05:46:04.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb69013e200 0x7fb6900ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 0x7fb690140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 0x7fb69015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6901413e0 con 0x7fb69013e200 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900b1880 con 0x7fb690140f70 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb697a4c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900b26e0 con 0x7fb690141660 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb6957e8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb69013e200 0x7fb6900ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb6957e8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb69013e200 0x7fb6900ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53182/0 (socket says 172.21.15.49:53182) 2023-12-19T05:46:04.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.799+0000 7fb6957e8640 1 -- 172.21.15.49:0/2769489780 learned_addr learned my addr 172.21.15.49:0/2769489780 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb695fe9640 1 --2- 172.21.15.49:0/2769489780 >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 0x7fb69015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb6957e8640 1 -- 172.21.15.49:0/2769489780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 msgr2=0x7fb690140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb694fe7640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 0x7fb690140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb6957e8640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 0x7fb690140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb6957e8640 1 -- 172.21.15.49:0/2769489780 >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 msgr2=0x7fb69015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb6957e8640 1 --2- 172.21.15.49:0/2769489780 >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 0x7fb69015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb6957e8640 1 -- 172.21.15.49:0/2769489780 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900cf020 con 0x7fb69013e200 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb695fe9640 1 --2- 172.21.15.49:0/2769489780 >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 0x7fb69015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.800+0000 7fb694fe7640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 0x7fb690140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:04.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.801+0000 7fb6957e8640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69013e200 0x7fb6900ceae0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb69006e090 tx=0x7fb68c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebffb2c01065afb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.801+0000 7fb683fff640 1 -- 172.21.15.49:0/2769489780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c031880 con 0x7fb69013e200 2023-12-19T05:46:04.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb683fff640 1 -- 172.21.15.49:0/2769489780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0319e0 con 0x7fb69013e200 2023-12-19T05:46:04.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb683fff640 1 -- 172.21.15.49:0/2769489780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c031d70 con 0x7fb69013e200 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 -- 172.21.15.49:0/2769489780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69013e200 msgr2=0x7fb6900ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69013e200 0x7fb6900ceae0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb69006e090 tx=0x7fb68c02b920 comp rx=0 tx=0).stop 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 -- 172.21.15.49:0/2769489780 shutdown_connections 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 --2- 172.21.15.49:0/2769489780 >> v2:172.21.15.115:3300/0 conn(0x7fb690140f70 0x7fb69015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb690141660 0x7fb690140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 --2- 172.21.15.49:0/2769489780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69013e200 0x7fb6900ceae0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 -- 172.21.15.49:0/2769489780 >> 172.21.15.49:0/2769489780 conn(0x7fb6900cf230 msgr2=0x7fb6900cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 -- 172.21.15.49:0/2769489780 shutdown_connections 2023-12-19T05:46:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.802+0000 7fb697a4c640 1 -- 172.21.15.49:0/2769489780 wait complete. 2023-12-19T05:46:04.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.804+0000 7fb697a4c640 1 Processor -- start 2023-12-19T05:46:04.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.804+0000 7fb697a4c640 1 -- start start 2023-12-19T05:46:04.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb69013e200 0x7fb6900ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb690140f70 0x7fb6900afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900709e0 con 0x7fb690141660 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69006bb00 con 0x7fb690140f70 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.805+0000 7fb697a4c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb690071060 con 0x7fb69013e200 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53194/0 (socket says 172.21.15.49:53194) 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 -- 172.21.15.49:0/4293077001 learned_addr learned my addr 172.21.15.49:0/4293077001 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb694fe7640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb690140f70 0x7fb6900afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb6957e8640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb69013e200 0x7fb6900ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 -- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb69013e200 msgr2=0x7fb6900ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb69013e200 0x7fb6900ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 -- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb690140f70 msgr2=0x7fb6900afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb690140f70 0x7fb6900afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.806+0000 7fb695fe9640 1 -- 172.21.15.49:0/4293077001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c0094d0 con 0x7fb690141660 2023-12-19T05:46:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb695fe9640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cef0 tx=0x7fb68800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800d840 con 0x7fb690141660 2023-12-19T05:46:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800d9a0 con 0x7fb690141660 2023-12-19T05:46:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800dd50 con 0x7fb690141660 2023-12-19T05:46:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690071340 con 0x7fb690141660 2023-12-19T05:46:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.807+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900ae690 con 0x7fb690141660 2023-12-19T05:46:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.808+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690070ec0 con 0x7fb690141660 2023-12-19T05:46:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.809+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb68801e3b0 con 0x7fb690141660 2023-12-19T05:46:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.810+0000 7fb681ffb640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.810+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb688088ff0 con 0x7fb690141660 2023-12-19T05:46:04.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.811+0000 7fb6957e8640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.812+0000 7fb6957e8640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 0x7fb67406c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb68c036000 tx=0x7fb68c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:04.814+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb690070ec0 con 0x7fb690141660 2023-12-19T05:46:05.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.007+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb690070ec0 con 0x7fb690141660 2023-12-19T05:46:05.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.634+0000 7fb681ffb640 1 -- 172.21.15.49:0/4293077001 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v125) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb690070ec0 con 0x7fb690141660 2023-12-19T05:46:05.636 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:46:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.639+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 msgr2=0x7fb67406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.639+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 0x7fb67406c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb68c036000 tx=0x7fb68c03c040 comp rx=0 tx=0).stop 2023-12-19T05:46:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.639+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 msgr2=0x7fb69013ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.639+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cef0 tx=0x7fb68800a710 comp rx=0 tx=0).stop 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.640+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 shutdown_connections 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.640+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.640+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb690141660 0x7fb69013ac00 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.640+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb690140f70 0x7fb6900afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.640+0000 7fb697a4c640 1 --2- 172.21.15.49:0/4293077001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb69013e200 0x7fb6900ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.641+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 >> 172.21.15.49:0/4293077001 conn(0x7fb6900cf230 msgr2=0x7fb6900cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.641+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 shutdown_connections 2023-12-19T05:46:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.641+0000 7fb697a4c640 1 -- 172.21.15.49:0/4293077001 wait complete. 2023-12-19T05:46:05.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:46:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.897+0000 7fab5c877640 1 Processor -- start 2023-12-19T05:46:05.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.897+0000 7fab5c877640 1 -- start start 2023-12-19T05:46:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab5c877640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab58158df0 0x7fab5815c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab5c877640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab5806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab5c877640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab58070130 con 0x7fab5806f160 2023-12-19T05:46:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab5c877640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5806e1c0 con 0x7fab58158df0 2023-12-19T05:46:05.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab5c877640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5806f610 con 0x7fab5806d850 2023-12-19T05:46:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab4ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fab5806f160 0x7fab580cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60170/0 (socket says 172.21.15.49:60170) 2023-12-19T05:46:05.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.899+0000 7fab4ffff640 1 -- 172.21.15.49:0/1555609818 learned_addr learned my addr 172.21.15.49:0/1555609818 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab56d9d640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab5806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab5659c640 1 --2- 172.21.15.49:0/1555609818 >> v2:172.21.15.115:3300/0 conn(0x7fab58158df0 0x7fab5815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129804343 0 0) 0x7fab58070130 con 0x7fab5806f160 2023-12-19T05:46:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab44003520 con 0x7fab5806f160 2023-12-19T05:46:05.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455173112 0 0) 0x7fab44003520 con 0x7fab5806f160 2023-12-19T05:46:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 msgr2=0x7fab5806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab5806dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 >> v2:172.21.15.115:3300/0 conn(0x7fab58158df0 msgr2=0x7fab5815c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 --2- 172.21.15.49:0/1555609818 >> v2:172.21.15.115:3300/0 conn(0x7fab58158df0 0x7fab5815c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5806f890 con 0x7fab5806f160 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fab40001670 con 0x7fab5806f160 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.900+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 >> v1:172.21.15.49:6789/0 conn(0x7fab5806f160 legacy=0x7fab580cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab44003970 0x7fab44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5806e1c0 con 0x7fab44004d00 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5806f610 con 0x7fab44003970 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4400b980 con 0x7fab5806d850 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab56d9d640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab5659c640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab44003970 0x7fab44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab4ffff640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab56d9d640 1 -- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 msgr2=0x7fab440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab56d9d640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab5806d850 0x7fab440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab56d9d640 1 -- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab44003970 msgr2=0x7fab44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.901+0000 7fab56d9d640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab44003970 0x7fab44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.902+0000 7fab56d9d640 1 -- 172.21.15.49:0/1555609818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44003520 con 0x7fab44004d00 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.903+0000 7fab56d9d640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab44005180 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fab50009fc0 tx=0x7fab440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78bf836ae7db4f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.903+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5002cc20 con 0x7fab44004d00 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.903+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5000f040 con 0x7fab44004d00 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.903+0000 7fab55d9b640 1 -- 172.21.15.49:0/1555609818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50034440 con 0x7fab44004d00 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.903+0000 7fab5c877640 1 -- 172.21.15.49:0/1555609818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 msgr2=0x7fab44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab5c877640 1 --2- 172.21.15.49:0/1555609818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab44005180 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fab50009fc0 tx=0x7fab440057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab56d9d640 1 -- 172.21.15.49:0/1555609818 reap_dead start 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab5c877640 1 -- 172.21.15.49:0/1555609818 shutdown_connections 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab5c877640 1 -- 172.21.15.49:0/1555609818 >> 172.21.15.49:0/1555609818 conn(0x7fab580cf0b0 msgr2=0x7fab580cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:05.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab5c877640 1 -- 172.21.15.49:0/1555609818 shutdown_connections 2023-12-19T05:46:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.904+0000 7fab5c877640 1 -- 172.21.15.49:0/1555609818 wait complete. 2023-12-19T05:46:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.906+0000 7fab5c877640 1 Processor -- start 2023-12-19T05:46:05.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.906+0000 7fab5c877640 1 -- start start 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab58156820 0x7fab581e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab58156ca0 0x7fab581e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58147490 con 0x7fab44004d00 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5815a0c0 con 0x7fab58156ca0 2023-12-19T05:46:05.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5c877640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab581591d0 con 0x7fab58156820 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53218/0 (socket says 172.21.15.49:53218) 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.907+0000 7fab5659c640 1 -- 172.21.15.49:0/2541748284 learned_addr learned my addr 172.21.15.49:0/2541748284 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab56d9d640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab58156ca0 0x7fab581e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab4ffff640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab58156820 0x7fab581e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 -- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab58156820 msgr2=0x7fab581e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab58156820 0x7fab581e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 -- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab58156ca0 msgr2=0x7fab581e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab58156ca0 0x7fab581e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 -- 172.21.15.49:0/2541748284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab581594b0 con 0x7fab44004d00 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab5659c640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fab48011960 tx=0x7fab48011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.908+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4800fa90 con 0x7fab44004d00 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.909+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4800fbf0 con 0x7fab44004d00 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.909+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab58159790 con 0x7fab44004d00 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.909+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48014440 con 0x7fab44004d00 2023-12-19T05:46:05.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.909+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab58159d50 con 0x7fab44004d00 2023-12-19T05:46:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.910+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab58074770 con 0x7fab44004d00 2023-12-19T05:46:05.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.911+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab480145a0 con 0x7fab44004d00 2023-12-19T05:46:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.912+0000 7fab4effd640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 0x7fab3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:05.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.912+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fab48088f70 con 0x7fab44004d00 2023-12-19T05:46:05.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.913+0000 7fab4ffff640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 0x7fab3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.914+0000 7fab4ffff640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 0x7fab3806c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fab40001eb0 tx=0x7fab40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:05.917+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fab480bbc80 con 0x7fab44004d00 2023-12-19T05:46:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.112+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fab5815d340 con 0x7fab44004d00 2023-12-19T05:46:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.644+0000 7fab4effd640 1 -- 172.21.15.49:0/2541748284 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v126) v1 ==== 170+0+0 (secure 0 0 0) 0x7fab5815d340 con 0x7fab44004d00 2023-12-19T05:46:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.649+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 msgr2=0x7fab3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.649+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 0x7fab3806c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fab40001eb0 tx=0x7fab40009040 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.649+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 msgr2=0x7fab581f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.649+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fab48011960 tx=0x7fab48011e20 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 shutdown_connections 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fab3806a430 0x7fab3806c8f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab58156820 0x7fab581e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab58156ca0 0x7fab581e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 --2- 172.21.15.49:0/2541748284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab44004d00 0x7fab581f2890 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 >> 172.21.15.49:0/2541748284 conn(0x7fab580cf0b0 msgr2=0x7fab58070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 shutdown_connections 2023-12-19T05:46:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.655+0000 7fab5c877640 1 -- 172.21.15.49:0/2541748284 wait complete. 2023-12-19T05:46:06.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:46:06.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.881+0000 7f3e650e7640 1 Processor -- start 2023-12-19T05:46:06.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.881+0000 7f3e650e7640 1 -- start start 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e6015b1d0 0x7f3e600b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3e600b1ec0 0x7f3e6015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e600ceea0 0x7f3e600cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600cf870 con 0x7f3e600ceea0 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6015ef10 con 0x7f3e600b1ec0 2023-12-19T05:46:06.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.882+0000 7f3e650e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b2320 con 0x7f3e6015b1d0 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e600ceea0 0x7f3e600cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e600ceea0 0x7f3e600cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53228/0 (socket says 172.21.15.49:53228) 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 -- 172.21.15.49:0/2171445202 learned_addr learned my addr 172.21.15.49:0/2171445202 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5e59c640 1 --2- 172.21.15.49:0/2171445202 >> v2:172.21.15.115:3300/0 conn(0x7f3e600b1ec0 0x7f3e6015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5ed9d640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e6015b1d0 0x7f3e600b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 -- 172.21.15.49:0/2171445202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e6015b1d0 msgr2=0x7f3e600b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e6015b1d0 0x7f3e600b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 -- 172.21.15.49:0/2171445202 >> v2:172.21.15.115:3300/0 conn(0x7f3e600b1ec0 msgr2=0x7f3e6015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/2171445202 >> v2:172.21.15.115:3300/0 conn(0x7f3e600b1ec0 0x7f3e6015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.883+0000 7f3e5f59e640 1 -- 172.21.15.49:0/2171445202 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600b2e40 con 0x7f3e600ceea0 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.884+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e600ceea0 0x7f3e600cf330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3e600b11b0 tx=0x7f3e5802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957631ab2f9782ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.885+0000 7f3e5dd9b640 1 -- 172.21.15.49:0/2171445202 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5802ca70 con 0x7f3e600ceea0 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.885+0000 7f3e5dd9b640 1 -- 172.21.15.49:0/2171445202 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5802cbd0 con 0x7f3e600ceea0 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.885+0000 7f3e5dd9b640 1 -- 172.21.15.49:0/2171445202 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580343f0 con 0x7f3e600ceea0 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.885+0000 7f3e650e7640 1 -- 172.21.15.49:0/2171445202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e600ceea0 msgr2=0x7f3e600cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.885+0000 7f3e650e7640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e600ceea0 0x7f3e600cf330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3e600b11b0 tx=0x7f3e5802bed0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 -- 172.21.15.49:0/2171445202 shutdown_connections 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e600ceea0 0x7f3e600cf330 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 --2- 172.21.15.49:0/2171445202 >> v2:172.21.15.115:3300/0 conn(0x7f3e600b1ec0 0x7f3e6015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 --2- 172.21.15.49:0/2171445202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e6015b1d0 0x7f3e600b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 -- 172.21.15.49:0/2171445202 >> 172.21.15.49:0/2171445202 conn(0x7f3e60073150 msgr2=0x7f3e600659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 -- 172.21.15.49:0/2171445202 shutdown_connections 2023-12-19T05:46:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.886+0000 7f3e650e7640 1 -- 172.21.15.49:0/2171445202 wait complete. 2023-12-19T05:46:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.887+0000 7f3e650e7640 1 Processor -- start 2023-12-19T05:46:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.888+0000 7f3e650e7640 1 -- start start 2023-12-19T05:46:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e600b1ec0 0x7f3e6015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e600ceea0 0x7f3e60157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e601593a0 con 0x7f3e6015b1d0 2023-12-19T05:46:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60158790 con 0x7f3e600b1ec0 2023-12-19T05:46:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e650e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60158a70 con 0x7f3e600ceea0 2023-12-19T05:46:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53242/0 (socket says 172.21.15.49:53242) 2023-12-19T05:46:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 -- 172.21.15.49:0/422692987 learned_addr learned my addr 172.21.15.49:0/422692987 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5e59c640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e600ceea0 0x7f3e60157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5ed9d640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e600b1ec0 0x7f3e6015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 -- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e600ceea0 msgr2=0x7f3e60157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e600ceea0 0x7f3e60157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 -- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e600b1ec0 msgr2=0x7f3e6015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e600b1ec0 0x7f3e6015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.889+0000 7f3e5f59e640 1 -- 172.21.15.49:0/422692987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58009b30 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e5f59e640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3e58036040 tx=0x7f3e58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5803e450 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5803e5d0 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e60158d50 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5803e980 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.890+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e60159830 con 0x7f3e6015b1d0 2023-12-19T05:46:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.891+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e60159550 con 0x7f3e6015b1d0 2023-12-19T05:46:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.893+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e5803eae0 con 0x7f3e6015b1d0 2023-12-19T05:46:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.893+0000 7f3e477fe640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 0x7f3e4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.894+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3e580ab7a0 con 0x7f3e6015b1d0 2023-12-19T05:46:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.894+0000 7f3e5ed9d640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 0x7f3e4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.895+0000 7f3e5ed9d640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 0x7f3e4c06c8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000b7c0 tx=0x7f3e50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:06.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:06.898+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e58076de0 con 0x7f3e6015b1d0 2023-12-19T05:46:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.133+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e60061910 con 0x7f3e6015b1d0 2023-12-19T05:46:07.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.148+0000 7f3e477fe640 1 -- 172.21.15.49:0/422692987 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3e5807a400 con 0x7f3e6015b1d0 2023-12-19T05:46:07.151 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 14 and data pool 15 2023-12-19T05:46:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.154+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 msgr2=0x7f3e4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.154+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 0x7f3e4c06c8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000b7c0 tx=0x7f3e50008040 comp rx=0 tx=0).stop 2023-12-19T05:46:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.154+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 msgr2=0x7f3e600b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.154+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3e58036040 tx=0x7f3e58004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 shutdown_connections 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e4c06a430 0x7f3e4c06c8f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e600ceea0 0x7f3e60157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e6015b1d0 0x7f3e600b06a0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 --2- 172.21.15.49:0/422692987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e600b1ec0 0x7f3e6015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.155+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 >> 172.21.15.49:0/422692987 conn(0x7f3e60073150 msgr2=0x7f3e600cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.156+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 shutdown_connections 2023-12-19T05:46:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.156+0000 7f3e650e7640 1 -- 172.21.15.49:0/422692987 wait complete. 2023-12-19T05:46:07.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.378+0000 7f0e1027d640 1 Processor -- start 2023-12-19T05:46:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.378+0000 7f0e1027d640 1 -- start start 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e1027d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e080b1710 0x7f0e0806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e1027d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0e0815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e1027d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0815e9c0 con 0x7f0e08157aa0 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e1027d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080b2600 con 0x7f0e080b1710 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e1027d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b1d60 con 0x7f0e0815e040 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.380+0000 7f0e0e019640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e08157aa0 0x7f0e08161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60184/0 (socket says 172.21.15.49:60184) 2023-12-19T05:46:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.381+0000 7f0e0e019640 1 -- 172.21.15.49:0/2492932546 learned_addr learned my addr 172.21.15.49:0/2492932546 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:07.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.381+0000 7f0e0e81a640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0e0815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.381+0000 7f0e0d818640 1 --2- 172.21.15.49:0/2492932546 >> v2:172.21.15.115:3300/0 conn(0x7f0e080b1710 0x7f0e0806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.381+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024792315 0 0) 0x7f0e0815e9c0 con 0x7f0e08157aa0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.381+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df4003520 con 0x7f0e08157aa0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329410940 0 0) 0x7f0df4003520 con 0x7f0e08157aa0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 msgr2=0x7f0e0815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0e0815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 >> v2:172.21.15.115:3300/0 conn(0x7f0e080b1710 msgr2=0x7f0e0806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 --2- 172.21.15.49:0/2492932546 >> v2:172.21.15.115:3300/0 conn(0x7f0e080b1710 0x7f0e0806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080b2040 con 0x7f0e08157aa0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0e04001670 con 0x7f0e08157aa0 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 >> v1:172.21.15.49:6789/0 conn(0x7f0e08157aa0 legacy=0x7f0e08161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df40039e0 0x7f0df4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0df40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df4004d00 0x7f0df4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b2600 con 0x7f0df40039e0 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b1d60 con 0x7f0df4004d00 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df400b980 con 0x7f0e0815e040 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0e019640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df40039e0 0x7f0df4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.382+0000 7f0e0e81a640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df4004d00 0x7f0df4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0d818640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0df40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0e019640 1 -- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 msgr2=0x7f0df40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0e019640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815e040 0x7f0df40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0e019640 1 -- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df4004d00 msgr2=0x7f0df4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0e019640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df4004d00 0x7f0df4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.383+0000 7f0e0e019640 1 -- 172.21.15.49:0/2492932546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4003520 con 0x7f0df40039e0 2023-12-19T05:46:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.384+0000 7f0e0e019640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df40039e0 0x7f0df4003e00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400c110 tx=0x7f0df40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffe33d33402533c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.384+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04005ad0 con 0x7f0df40039e0 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.384+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04005c50 con 0x7f0df40039e0 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.384+0000 7f0e0d017640 1 -- 172.21.15.49:0/2492932546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0402c830 con 0x7f0df40039e0 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 -- 172.21.15.49:0/2492932546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df40039e0 msgr2=0x7f0df4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 --2- 172.21.15.49:0/2492932546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df40039e0 0x7f0df4003e00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400c110 tx=0x7f0df40057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e0e81a640 1 -- 172.21.15.49:0/2492932546 reap_dead start 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 -- 172.21.15.49:0/2492932546 shutdown_connections 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 -- 172.21.15.49:0/2492932546 >> 172.21.15.49:0/2492932546 conn(0x7f0e080cbb70 msgr2=0x7f0e080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 -- 172.21.15.49:0/2492932546 shutdown_connections 2023-12-19T05:46:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.385+0000 7f0e1027d640 1 -- 172.21.15.49:0/2492932546 wait complete. 2023-12-19T05:46:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.387+0000 7f0e1027d640 1 Processor -- start 2023-12-19T05:46:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.387+0000 7f0e1027d640 1 -- start start 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 0x7f0e081f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815ae40 0x7f0e08159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08159150 con 0x7f0e0815a9c0 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081f6790 con 0x7f0df40039e0 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e1027d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081f3930 con 0x7f0e0815ae40 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e0d818640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e0d818640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53264/0 (socket says 172.21.15.49:53264) 2023-12-19T05:46:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e0d818640 1 -- 172.21.15.49:0/160548614 learned_addr learned my addr 172.21.15.49:0/160548614 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:07.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e0e81a640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815ae40 0x7f0e08159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.388+0000 7f0e0e019640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 0x7f0e081f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 -- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815ae40 msgr2=0x7f0e08159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815ae40 0x7f0e08159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 -- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 msgr2=0x7f0e081f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 0x7f0e081f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 -- 172.21.15.49:0/160548614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e081581f0 con 0x7f0e0815a9c0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0e019640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 0x7f0e081f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e0d818640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0df80116d0 tx=0x7f0df8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800f9c0 con 0x7f0e0815a9c0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df800fb20 con 0x7f0e0815a9c0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800fe90 con 0x7f0e0815a9c0 2023-12-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.389+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e081584d0 con 0x7f0e0815a9c0 2023-12-19T05:46:07.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.390+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e08158a90 con 0x7f0e0815a9c0 2023-12-19T05:46:07.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.391+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e08061910 con 0x7f0e0815a9c0 2023-12-19T05:46:07.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.392+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0df8015460 con 0x7f0e0815a9c0 2023-12-19T05:46:07.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.393+0000 7f0dfeffd640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 0x7f0dec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.393+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df8088d40 con 0x7f0e0815a9c0 2023-12-19T05:46:07.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.394+0000 7f0e0e019640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 0x7f0dec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.395+0000 7f0e0e019640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 0x7f0dec06c920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e04034000 tx=0x7f0e04007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.398+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0df8054320 con 0x7f0e0815a9c0 2023-12-19T05:46:07.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.594+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e0815b410 con 0x7f0e0815a9c0 2023-12-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.597+0000 7f0dfeffd640 1 -- 172.21.15.49:0/160548614 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f0df8057940 con 0x7f0e0815a9c0 2023-12-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":127,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:07.136480+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 msgr2=0x7f0dec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 0x7f0dec06c920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e04034000 tx=0x7f0e04007000 comp rx=0 tx=0).stop 2023-12-19T05:46:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 msgr2=0x7f0e08159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0df80116d0 tx=0x7f0df8011b90 comp rx=0 tx=0).stop 2023-12-19T05:46:07.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 shutdown_connections 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dec06a460 0x7f0dec06c920 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e0815ae40 0x7f0e08159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e0815a9c0 0x7f0e08159570 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 --2- 172.21.15.49:0/160548614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0df40039e0 0x7f0e081f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 >> 172.21.15.49:0/160548614 conn(0x7f0e080cbb70 msgr2=0x7f0e080cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 shutdown_connections 2023-12-19T05:46:07.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.600+0000 7f0e1027d640 1 -- 172.21.15.49:0/160548614 wait complete. 2023-12-19T05:46:07.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.852+0000 7fc0dbfff640 1 Processor -- start 2023-12-19T05:46:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.853+0000 7fc0dbfff640 1 -- start start 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.854+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc146e30 0x7fc0dc0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.854+0000 7fc0dbfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0dc0b7ea0 0x7fc0dc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0dbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0dc0d0a90 0x7fc0dc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0dbfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc147210 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0dbfff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0d2370 con 0x7fc0dc0b7ea0 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0dbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b8300 con 0x7fc0dc146e30 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0db7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0dc0d0a90 0x7fc0dc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0db7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0dc0d0a90 0x7fc0dc06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53278/0 (socket says 172.21.15.49:53278) 2023-12-19T05:46:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0db7fe640 1 -- 172.21.15.49:0/890321969 learned_addr learned my addr 172.21.15.49:0/890321969 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0da7fc640 1 --2- 172.21.15.49:0/890321969 >> v2:172.21.15.115:3300/0 conn(0x7fc0dc0b7ea0 0x7fc0dc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.855+0000 7fc0daffd640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc146e30 0x7fc0dc0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.856+0000 7fc0db7fe640 1 -- 172.21.15.49:0/890321969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc146e30 msgr2=0x7fc0dc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.856+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc146e30 0x7fc0dc0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.856+0000 7fc0db7fe640 1 -- 172.21.15.49:0/890321969 >> v2:172.21.15.115:3300/0 conn(0x7fc0dc0b7ea0 msgr2=0x7fc0dc0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.856+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/890321969 >> v2:172.21.15.115:3300/0 conn(0x7fc0dc0b7ea0 0x7fc0dc0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.856+0000 7fc0db7fe640 1 -- 172.21.15.49:0/890321969 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0d12d0 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.857+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc06f160 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc066470 tx=0x7fc0d402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29722e7968ca496f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.857+0000 7fc0d9ffb640 1 -- 172.21.15.49:0/890321969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40317c0 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.857+0000 7fc0d9ffb640 1 -- 172.21.15.49:0/890321969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4031920 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.857+0000 7fc0d9ffb640 1 -- 172.21.15.49:0/890321969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4031cb0 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 -- 172.21.15.49:0/890321969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc0d0a90 msgr2=0x7fc0dc06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc06f160 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc066470 tx=0x7fc0d402b860 comp rx=0 tx=0).stop 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 -- 172.21.15.49:0/890321969 shutdown_connections 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc06f160 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/890321969 >> v2:172.21.15.115:3300/0 conn(0x7fc0dc0b7ea0 0x7fc0dc0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/890321969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc146e30 0x7fc0dc0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 -- 172.21.15.49:0/890321969 >> 172.21.15.49:0/890321969 conn(0x7fc0dc0b2990 msgr2=0x7fc0dc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 -- 172.21.15.49:0/890321969 shutdown_connections 2023-12-19T05:46:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.858+0000 7fc0dbfff640 1 -- 172.21.15.49:0/890321969 wait complete. 2023-12-19T05:46:07.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.860+0000 7fc0dbfff640 1 Processor -- start 2023-12-19T05:46:07.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.860+0000 7fc0dbfff640 1 -- start start 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc0b7ea0 0x7fc0dc142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc1e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1e4290 con 0x7fc0dc146e30 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1e31f0 con 0x7fc0dc0d0a90 2023-12-19T05:46:07.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.861+0000 7fc0dbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1e34d0 con 0x7fc0dc0b7ea0 2023-12-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53284/0 (socket says 172.21.15.49:53284) 2023-12-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 -- 172.21.15.49:0/1476412543 learned_addr learned my addr 172.21.15.49:0/1476412543 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0daffd640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc0b7ea0 0x7fc0dc142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0da7fc640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc1e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 -- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc0b7ea0 msgr2=0x7fc0dc142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc0b7ea0 0x7fc0dc142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 -- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0dc0d0a90 msgr2=0x7fc0dc1e2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc1e2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.862+0000 7fc0db7fe640 1 -- 172.21.15.49:0/1476412543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d40094d0 con 0x7fc0dc146e30 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0db7fe640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009870 tx=0x7fc0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4032860 con 0x7fc0dc146e30 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40329c0 con 0x7fc0dc146e30 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4032d70 con 0x7fc0dc146e30 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc1e37b0 con 0x7fc0dc146e30 2023-12-19T05:46:07.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.863+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc1e2dc0 con 0x7fc0dc146e30 2023-12-19T05:46:07.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.864+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc1e2fb0 con 0x7fc0dc146e30 2023-12-19T05:46:07.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.865+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0d404e450 con 0x7fc0dc146e30 2023-12-19T05:46:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.866+0000 7fc0c3fff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 0x7fc0c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.866+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0d40aaa50 con 0x7fc0dc146e30 2023-12-19T05:46:07.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.867+0000 7fc0daffd640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 0x7fc0c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:07.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.868+0000 7fc0daffd640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 0x7fc0c806c8f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc1f3860 tx=0x7fc0cc0098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:07.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:07.870+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0dc1e2fb0 con 0x7fc0dc146e30 2023-12-19T05:46:08.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.065+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0dc1e2fb0 con 0x7fc0dc146e30 2023-12-19T05:46:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.067+0000 7fc0c3fff640 1 -- 172.21.15.49:0/1476412543 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fc0dc1e2fb0 con 0x7fc0dc146e30 2023-12-19T05:46:08.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:08.070 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":127,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:07.136480+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:08.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 msgr2=0x7fc0c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:08.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 0x7fc0c806c8f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc1f3860 tx=0x7fc0cc0098d0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 msgr2=0x7fc0dc1e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:08.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009870 tx=0x7fc0d40046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 shutdown_connections 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc0c806a430 0x7fc0c806c8f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0dc146e30 0x7fc0dc1e1310 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0dc0d0a90 0x7fc0dc1e2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 --2- 172.21.15.49:0/1476412543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0dc0b7ea0 0x7fc0dc142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.070+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 >> 172.21.15.49:0/1476412543 conn(0x7fc0dc0b2990 msgr2=0x7fc0dc145e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.071+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 shutdown_connections 2023-12-19T05:46:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.071+0000 7fc0dbfff640 1 -- 172.21.15.49:0/1476412543 wait complete. 2023-12-19T05:46:08.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:46:08.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.324+0000 7f726cbc4640 1 Processor -- start 2023-12-19T05:46:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.324+0000 7f726cbc4640 1 -- start start 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f726cbc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 0x7f72680b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f726cbc4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f726806cc50 0x7f72680cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f726cbc4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726815c9c0 con 0x7f72680b0830 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f726cbc4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72680b0cb0 con 0x7f726806cc50 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f726cbc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726806d270 con 0x7f7268155460 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f7267fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f726806cc50 0x7f72680cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f7267fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f726806cc50 0x7f72680cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53292/0 (socket says 172.21.15.49:53292) 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f7267fff640 1 -- 172.21.15.49:0/1697442378 learned_addr learned my addr 172.21.15.49:0/1697442378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.326+0000 7f72677fe640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 0x7f72680b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.327+0000 7f7267fff640 1 -- 172.21.15.49:0/1697442378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 msgr2=0x7f72680b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.327+0000 7f7267fff640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 0x7f72680b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.327+0000 7f7267fff640 1 -- 172.21.15.49:0/1697442378 >> v1:172.21.15.115:6789/0 conn(0x7f72680b0830 legacy=0x7f726806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.327+0000 7f7267fff640 1 -- 172.21.15.49:0/1697442378 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726806d550 con 0x7f726806cc50 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.327+0000 7f72677fe640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 0x7f72680b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:08.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.328+0000 7f7267fff640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f726806cc50 0x7f72680cdcf0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7260009870 tx=0x7f726002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85440132527ee87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.328+0000 7f72667fc640 1 -- 172.21.15.49:0/1697442378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260031640 con 0x7f726806cc50 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.328+0000 7f72667fc640 1 -- 172.21.15.49:0/1697442378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72600317a0 con 0x7f726806cc50 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.328+0000 7f72667fc640 1 -- 172.21.15.49:0/1697442378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260031b30 con 0x7f726806cc50 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 -- 172.21.15.49:0/1697442378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f726806cc50 msgr2=0x7f72680cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f726806cc50 0x7f72680cdcf0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7260009870 tx=0x7f726002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 -- 172.21.15.49:0/1697442378 shutdown_connections 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f726806cc50 0x7f72680cdcf0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 --2- 172.21.15.49:0/1697442378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7268155460 0x7f72680b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 -- 172.21.15.49:0/1697442378 >> 172.21.15.49:0/1697442378 conn(0x7f72680659a0 msgr2=0x7f7268065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 -- 172.21.15.49:0/1697442378 shutdown_connections 2023-12-19T05:46:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.329+0000 7f726cbc4640 1 -- 172.21.15.49:0/1697442378 wait complete. 2023-12-19T05:46:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.331+0000 7f726cbc4640 1 Processor -- start 2023-12-19T05:46:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.331+0000 7f726cbc4640 1 -- start start 2023-12-19T05:46:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 0x7f7268157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72680b0830 0x7f72680b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680ace10 con 0x7f7268155460 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72681584a0 con 0x7f726806cc50 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f726cbc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268158780 con 0x7f72680b0830 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f7267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f7267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53296/0 (socket says 172.21.15.49:53296) 2023-12-19T05:46:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.332+0000 7f7267fff640 1 -- 172.21.15.49:0/3440512648 learned_addr learned my addr 172.21.15.49:0/3440512648 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7266ffd640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72680b0830 0x7f72680b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f72677fe640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 0x7f7268157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 -- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72680b0830 msgr2=0x7f72680b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72680b0830 0x7f72680b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 -- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 msgr2=0x7f7268157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 0x7f7268157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 -- 172.21.15.49:0/3440512648 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600094d0 con 0x7f7268155460 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f72677fe640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 0x7f7268157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f7267fff640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f726002b930 tx=0x7f72600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726003ac60 con 0x7f7268155460 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726003ade0 con 0x7f7268155460 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260044630 con 0x7f7268155460 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.333+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72680aca30 con 0x7f7268155460 2023-12-19T05:46:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.334+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7268159880 con 0x7f7268155460 2023-12-19T05:46:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.335+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72680674e0 con 0x7f7268155460 2023-12-19T05:46:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.336+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f726002f050 con 0x7f7268155460 2023-12-19T05:46:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.337+0000 7f725ffff640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.337+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72600aad80 con 0x7f7268155460 2023-12-19T05:46:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.338+0000 7f72677fe640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.339+0000 7f72677fe640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 0x7f724806c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7258006fd0 tx=0x7f7258008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:08.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.341+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f72600764e0 con 0x7f7268155460 2023-12-19T05:46:08.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:08.571+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7268061910 con 0x7f7268155460 2023-12-19T05:46:09.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.163+0000 7f725ffff640 1 -- 172.21.15.49:0/3440512648 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7260079b00 con 0x7f7268155460 2023-12-19T05:46:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.167+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 msgr2=0x7f724806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.167+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 0x7f724806c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7258006fd0 tx=0x7f7258008040 comp rx=0 tx=0).stop 2023-12-19T05:46:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.167+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 msgr2=0x7f72680ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.167+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f726002b930 tx=0x7f72600046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 shutdown_connections 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72680b0830 0x7f72680b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7268155460 0x7f72680ad230 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 --2- 172.21.15.49:0/3440512648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f726806cc50 0x7f7268157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 >> 172.21.15.49:0/3440512648 conn(0x7f72680659a0 msgr2=0x7f726806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 shutdown_connections 2023-12-19T05:46:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.168+0000 7f726cbc4640 1 -- 172.21.15.49:0/3440512648 wait complete. 2023-12-19T05:46:09.190 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:46:09.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:46:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.422+0000 7f4f7e88f640 1 Processor -- start 2023-12-19T05:46:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.422+0000 7f4f7e88f640 1 -- start start 2023-12-19T05:46:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.423+0000 7f4f7e88f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f780d2d00 0x7f4f780b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f7e88f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780b6e50 0x7f4f7806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f7e88f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78142bf0 con 0x7f4f780b8d60 2023-12-19T05:46:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f7e88f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f78142e40 con 0x7f4f780d2d00 2023-12-19T05:46:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f7e88f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78143120 con 0x7f4f780b6e50 2023-12-19T05:46:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f77fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f780d2d00 0x7f4f780b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f77fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f780d2d00 0x7f4f780b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53306/0 (socket says 172.21.15.49:53306) 2023-12-19T05:46:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f77fff640 1 -- 172.21.15.49:0/331431017 learned_addr learned my addr 172.21.15.49:0/331431017 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.424+0000 7f4f7ce2c640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780b6e50 0x7f4f7806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.425+0000 7f4f77fff640 1 -- 172.21.15.49:0/331431017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780b6e50 msgr2=0x7f4f7806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.425+0000 7f4f77fff640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780b6e50 0x7f4f7806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.425+0000 7f4f77fff640 1 -- 172.21.15.49:0/331431017 >> v1:172.21.15.115:6789/0 conn(0x7f4f780b8d60 legacy=0x7f4f780b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.425+0000 7f4f77fff640 1 -- 172.21.15.49:0/331431017 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78143400 con 0x7f4f780d2d00 2023-12-19T05:46:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.426+0000 7f4f77fff640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780d2d00 0x7f4f780b8820 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009e50 tx=0x7f4f6802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5823c47fda48f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.426+0000 7f4f76ffd640 1 -- 172.21.15.49:0/331431017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6802cb00 con 0x7f4f780d2d00 2023-12-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.426+0000 7f4f76ffd640 1 -- 172.21.15.49:0/331431017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6802cc60 con 0x7f4f780d2d00 2023-12-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.426+0000 7f4f76ffd640 1 -- 172.21.15.49:0/331431017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680343f0 con 0x7f4f780d2d00 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 -- 172.21.15.49:0/331431017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780d2d00 msgr2=0x7f4f780b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780d2d00 0x7f4f780b8820 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009e50 tx=0x7f4f6802bf60 comp rx=0 tx=0).stop 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 -- 172.21.15.49:0/331431017 shutdown_connections 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780b6e50 0x7f4f7806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/331431017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780d2d00 0x7f4f780b8820 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 -- 172.21.15.49:0/331431017 >> 172.21.15.49:0/331431017 conn(0x7f4f780cfe10 msgr2=0x7f4f780d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 -- 172.21.15.49:0/331431017 shutdown_connections 2023-12-19T05:46:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.427+0000 7f4f7e88f640 1 -- 172.21.15.49:0/331431017 wait complete. 2023-12-19T05:46:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.429+0000 7f4f7e88f640 1 Processor -- start 2023-12-19T05:46:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.429+0000 7f4f7e88f640 1 -- start start 2023-12-19T05:46:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f780b8d60 0x7f4f78160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780d2d00 0x7f4f7815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815fdf0 con 0x7f4f780b6e50 2023-12-19T05:46:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815f1e0 con 0x7f4f780b8d60 2023-12-19T05:46:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f7e88f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815f4c0 con 0x7f4f780d2d00 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53318/0 (socket says 172.21.15.49:53318) 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.430+0000 7f4f77fff640 1 -- 172.21.15.49:0/1208696892 learned_addr learned my addr 172.21.15.49:0/1208696892 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f7ce2c640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780d2d00 0x7f4f7815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f777fe640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f780b8d60 0x7f4f78160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 -- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780d2d00 msgr2=0x7f4f7815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780d2d00 0x7f4f7815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 -- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f780b8d60 msgr2=0x7f4f78160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f780b8d60 0x7f4f78160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 -- 172.21.15.49:0/1208696892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009b30 con 0x7f4f780b6e50 2023-12-19T05:46:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f77fff640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000f80 tx=0x7f4f68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68009510 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6803e450 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6803e800 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.431+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7815f7a0 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.432+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78156e70 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.433+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f78061910 con 0x7f4f780b6e50 2023-12-19T05:46:09.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.434+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f6803e960 con 0x7f4f780b6e50 2023-12-19T05:46:09.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.435+0000 7f4f74ff9640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:09.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.435+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f680ab700 con 0x7f4f780b6e50 2023-12-19T05:46:09.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.436+0000 7f4f777fe640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:09.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.437+0000 7f4f777fe640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 0x7f4f5806c8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4f78140060 tx=0x7f4f60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:09.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.440+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f68076cf0 con 0x7f4f780b6e50 2023-12-19T05:46:09.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:09.672+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4f78070790 con 0x7f4f780b6e50 2023-12-19T05:46:10.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.689+0000 7f4f74ff9640 1 -- 172.21.15.49:0/1208696892 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f6807a310 con 0x7f4f780b6e50 2023-12-19T05:46:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.692+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 msgr2=0x7f4f5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.692+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 0x7f4f5806c8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4f78140060 tx=0x7f4f60009040 comp rx=0 tx=0).stop 2023-12-19T05:46:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.692+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 msgr2=0x7f4f781614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.692+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000f80 tx=0x7f4f68004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 shutdown_connections 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f780d2d00 0x7f4f7815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f780b8d60 0x7f4f78160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 --2- 172.21.15.49:0/1208696892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f780b6e50 0x7f4f781614b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 >> 172.21.15.49:0/1208696892 conn(0x7f4f780cfe10 msgr2=0x7f4f7815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 shutdown_connections 2023-12-19T05:46:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.693+0000 7f4f7e88f640 1 -- 172.21.15.49:0/1208696892 wait complete. 2023-12-19T05:46:10.716 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:46:10.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.947+0000 7fa1f1d27640 1 Processor -- start 2023-12-19T05:46:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.947+0000 7fa1f1d27640 1 -- start start 2023-12-19T05:46:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1f1d27640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1ec06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1f1d27640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec0b2600 con 0x7fa1ec157aa0 2023-12-19T05:46:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1f1d27640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec0b1d60 con 0x7fa1ec0b1710 2023-12-19T05:46:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1f1d27640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0b2040 con 0x7fa1ec15e750 2023-12-19T05:46:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1eb7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1ec157aa0 0x7fa1ec161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60186/0 (socket says 172.21.15.49:60186) 2023-12-19T05:46:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.949+0000 7fa1eb7fe640 1 -- 172.21.15.49:0/4294211081 learned_addr learned my addr 172.21.15.49:0/4294211081 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ebfff640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1ec06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349387515 0 0) 0x7fa1ec0b2600 con 0x7fa1ec157aa0 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d8003520 con 0x7fa1ec157aa0 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878600368 0 0) 0x7fa1d8003520 con 0x7fa1ec157aa0 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 msgr2=0x7fa1ec06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1ec06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 >> v1:172.21.15.115:6789/0 conn(0x7fa1ec0b1710 legacy=0x7fa1ec15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0b2320 con 0x7fa1ec157aa0 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa1dc0019f0 con 0x7fa1ec157aa0 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 >> v1:172.21.15.49:6789/0 conn(0x7fa1ec157aa0 legacy=0x7fa1ec161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d8003a10 0x7fa1d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d80047c0 0x7fa1d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1d80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0b2040 con 0x7fa1d8003a10 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.950+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d800bb40 con 0x7fa1d80047c0 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d800bd00 con 0x7fa1ec15e750 2023-12-19T05:46:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d8003a10 0x7fa1d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eaffd640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d80047c0 0x7fa1d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 -- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 msgr2=0x7fa1d80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1ebfff640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1d80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1ec15e750 0x7fa1d80051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 -- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d80047c0 msgr2=0x7fa1d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d80047c0 0x7fa1d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eb7fe640 1 -- 172.21.15.49:0/4294211081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8003520 con 0x7fa1d8003a10 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.951+0000 7fa1eaffd640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d80047c0 0x7fa1d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.952+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d8003a10 0x7fa1d8003e30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00a760 tx=0x7fa1d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768bb989c45701bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc034630 con 0x7fa1d8003a10 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc02f070 con 0x7fa1d8003a10 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1ea7fc640 1 -- 172.21.15.49:0/4294211081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc034a10 con 0x7fa1d8003a10 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 -- 172.21.15.49:0/4294211081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d8003a10 msgr2=0x7fa1d8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/4294211081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1d8003a10 0x7fa1d8003e30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00a760 tx=0x7fa1d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1ebfff640 1 -- 172.21.15.49:0/4294211081 reap_dead start 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 -- 172.21.15.49:0/4294211081 shutdown_connections 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 -- 172.21.15.49:0/4294211081 >> 172.21.15.49:0/4294211081 conn(0x7fa1ec0cbb70 msgr2=0x7fa1ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 -- 172.21.15.49:0/4294211081 shutdown_connections 2023-12-19T05:46:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.953+0000 7fa1f1d27640 1 -- 172.21.15.49:0/4294211081 wait complete. 2023-12-19T05:46:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.955+0000 7fa1f1d27640 1 Processor -- start 2023-12-19T05:46:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.955+0000 7fa1f1d27640 1 -- start start 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d8003a10 0x7fa1ec1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1ec1e9770 0x7fa1ec0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0af150 con 0x7fa1ec143b20 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec151250 con 0x7fa1ec1e9770 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.956+0000 7fa1f1d27640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1e8710 con 0x7fa1d8003a10 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53344/0 (socket says 172.21.15.49:53344) 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 -- 172.21.15.49:0/2358811279 learned_addr learned my addr 172.21.15.49:0/2358811279 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1eaffd640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1ec1e9770 0x7fa1ec0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d8003a10 0x7fa1ec1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 -- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d8003a10 msgr2=0x7fa1ec1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d8003a10 0x7fa1ec1509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 -- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1ec1e9770 msgr2=0x7fa1ec0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1ec1e9770 0x7fa1ec0aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 -- 172.21.15.49:0/2358811279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec1e89b0 con 0x7fa1ec143b20 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.957+0000 7fa1ebfff640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0b1130 tx=0x7fa1e4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.958+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400e8d0 con 0x7fa1ec143b20 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.958+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400ea50 con 0x7fa1ec143b20 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.958+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400ee00 con 0x7fa1ec143b20 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.958+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec1e8c90 con 0x7fa1ec143b20 2023-12-19T05:46:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.958+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec1e9250 con 0x7fa1ec143b20 2023-12-19T05:46:10.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.959+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec1e9470 con 0x7fa1ec143b20 2023-12-19T05:46:10.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.960+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1e4021460 con 0x7fa1ec143b20 2023-12-19T05:46:10.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.961+0000 7fa1e3fff640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 0x7fa1cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:10.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.961+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1e40884b0 con 0x7fa1ec143b20 2023-12-19T05:46:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.962+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 0x7fa1cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:10.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.963+0000 7fa1eb7fe640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 0x7fa1cc06c920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc034000 tx=0x7fa1dc02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:10.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:10.965+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1e4053aa0 con 0x7fa1ec143b20 2023-12-19T05:46:11.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.198+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1ec0af360 con 0x7fa1ec143b20 2023-12-19T05:46:11.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.199+0000 7fa1e3fff640 1 -- 172.21.15.49:0/2358811279 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fa1e40570c0 con 0x7fa1ec143b20 2023-12-19T05:46:11.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:11.201 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:11.201 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 msgr2=0x7fa1cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 0x7fa1cc06c920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc034000 tx=0x7fa1dc02f000 comp rx=0 tx=0).stop 2023-12-19T05:46:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 msgr2=0x7fa1ec06c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0b1130 tx=0x7fa1e4010c20 comp rx=0 tx=0).stop 2023-12-19T05:46:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 shutdown_connections 2023-12-19T05:46:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1cc06a460 0x7fa1cc06c920 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1ec143b20 0x7fa1ec06c040 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1ec1e9770 0x7fa1ec0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 --2- 172.21.15.49:0/2358811279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1d8003a10 0x7fa1ec1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 >> 172.21.15.49:0/2358811279 conn(0x7fa1ec0cbb70 msgr2=0x7fa1ec0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:11.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.202+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 shutdown_connections 2023-12-19T05:46:11.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.203+0000 7fa1f1d27640 1 -- 172.21.15.49:0/2358811279 wait complete. 2023-12-19T05:46:11.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:11.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.460+0000 7fe6392ec640 1 Processor -- start 2023-12-19T05:46:11.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.460+0000 7fe6392ec640 1 -- start start 2023-12-19T05:46:11.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.462+0000 7fe6392ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe634146e30 0x7fe6340b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.462+0000 7fe6392ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6340d0c60 0x7fe63415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.462+0000 7fe6392ec640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340d1070 con 0x7fe6340b7ea0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.462+0000 7fe6392ec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe634147210 con 0x7fe634146e30 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.462+0000 7fe6392ec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340b8330 con 0x7fe6340d0c60 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe6337fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6340b7ea0 0x7fe6340d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60196/0 (socket says 172.21.15.49:60196) 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe6337fe640 1 -- 172.21.15.49:0/1647328349 learned_addr learned my addr 172.21.15.49:0/1647328349 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe633fff640 1 --2- 172.21.15.49:0/1647328349 >> v2:172.21.15.49:3300/0 conn(0x7fe634146e30 0x7fe6340b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe638aeb640 1 --2- 172.21.15.49:0/1647328349 >> v2:172.21.15.115:3300/0 conn(0x7fe6340d0c60 0x7fe63415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66876135 0 0) 0x7fe6340d1070 con 0x7fe6340b7ea0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe61c003520 con 0x7fe6340b7ea0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156393353 0 0) 0x7fe61c003520 con 0x7fe6340b7ea0 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 >> v2:172.21.15.115:3300/0 conn(0x7fe6340d0c60 msgr2=0x7fe63415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 --2- 172.21.15.49:0/1647328349 >> v2:172.21.15.115:3300/0 conn(0x7fe6340d0c60 0x7fe63415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 >> v2:172.21.15.49:3300/0 conn(0x7fe634146e30 msgr2=0x7fe6340b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 --2- 172.21.15.49:0/1647328349 >> v2:172.21.15.49:3300/0 conn(0x7fe634146e30 0x7fe6340b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340d12d0 con 0x7fe6340b7ea0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.463+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe628001670 con 0x7fe6340b7ea0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 >> v1:172.21.15.49:6789/0 conn(0x7fe6340b7ea0 legacy=0x7fe6340d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c003970 0x7fe61c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 0x7fe61c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe61c005180 0x7fe61c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe634147210 con 0x7fe61c0047c0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b8330 con 0x7fe61c003970 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c00bfc0 con 0x7fe61c005180 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe6337fe640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 0x7fe61c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.464+0000 7fe633fff640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c003970 0x7fe61c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe638aeb640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe61c005180 0x7fe61c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe6337fe640 1 -- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe61c005180 msgr2=0x7fe61c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:11.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe6337fe640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe61c005180 0x7fe61c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe6337fe640 1 -- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c003970 msgr2=0x7fe61c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe6337fe640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c003970 0x7fe61c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe6337fe640 1 -- 172.21.15.49:0/1647328349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c003520 con 0x7fe61c0047c0 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.465+0000 7fe638aeb640 1 -- 172.21.15.49:0/1647328349 reap_dead start 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.466+0000 7fe6337fe640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 0x7fe61c004c40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c290 tx=0x7fe61c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bde8ae76f6b08d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.466+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628005ad0 con 0x7fe61c0047c0 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.466+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628005c30 con 0x7fe61c0047c0 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.466+0000 7fe632ffd640 1 -- 172.21.15.49:0/1647328349 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628007070 con 0x7fe61c0047c0 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 -- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 msgr2=0x7fe61c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 0x7fe61c004c40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c290 tx=0x7fe61c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 -- 172.21.15.49:0/1647328349 shutdown_connections 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 --2- 172.21.15.49:0/1647328349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe61c0047c0 0x7fe61c004c40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 -- 172.21.15.49:0/1647328349 >> 172.21.15.49:0/1647328349 conn(0x7fe6340b2990 msgr2=0x7fe6340b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 -- 172.21.15.49:0/1647328349 shutdown_connections 2023-12-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.467+0000 7fe6392ec640 1 -- 172.21.15.49:0/1647328349 wait complete. 2023-12-19T05:46:11.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.469+0000 7fe6392ec640 1 Processor -- start 2023-12-19T05:46:11.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.469+0000 7fe6392ec640 1 -- start start 2023-12-19T05:46:11.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c0047c0 0x7fe6341deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 0x7fe634144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341e78c0 con 0x7fe6341d1b30 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341e53d0 con 0x7fe61c0047c0 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6392ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341e56b0 con 0x7fe6341e7120 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53368/0 (socket says 172.21.15.49:53368) 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.470+0000 7fe6337fe640 1 -- 172.21.15.49:0/2853324237 learned_addr learned my addr 172.21.15.49:0/2853324237 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe633fff640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c0047c0 0x7fe6341deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe638aeb640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 0x7fe634144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 -- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 msgr2=0x7fe634144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 0x7fe634144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 -- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c0047c0 msgr2=0x7fe6341deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c0047c0 0x7fe6341deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 -- 172.21.15.49:0/2853324237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6341e5990 con 0x7fe6341d1b30 2023-12-19T05:46:11.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe638aeb640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 0x7fe634144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6337fe640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fe62802c2a0 tx=0x7fe628001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62803c040 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628007580 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62802c700 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.471+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6341e5c70 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.472+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe634144dc0 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.473+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6341e5e30 con 0x7fe6341d1b30 2023-12-19T05:46:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.474+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe628032070 con 0x7fe6341d1b30 2023-12-19T05:46:11.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.475+0000 7fe630ff9640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.475+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6280a9c70 con 0x7fe6341d1b30 2023-12-19T05:46:11.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.476+0000 7fe633fff640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.477+0000 7fe633fff640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe624009a10 tx=0x7fe624008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.479+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6280751c0 con 0x7fe6341d1b30 2023-12-19T05:46:11.609 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-12-19T05:46:11.607+0000 7fa99dfc6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:46:11.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.675+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe634061910 con 0x7fe6341d1b30 2023-12-19T05:46:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.677+0000 7fe630ff9640 1 -- 172.21.15.49:0/2853324237 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fe6280787e0 con 0x7fe6341d1b30 2023-12-19T05:46:11.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:11.679 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":128,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:08.141070+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 msgr2=0x7fe62006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe624009a10 tx=0x7fe624008040 comp rx=0 tx=0).stop 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 msgr2=0x7fe6341e6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fe62802c2a0 tx=0x7fe628001a00 comp rx=0 tx=0).stop 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 shutdown_connections 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe62006a430 0x7fe62006c8f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6341e7120 0x7fe634144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6341d1b30 0x7fe6341e6190 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 --2- 172.21.15.49:0/2853324237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe61c0047c0 0x7fe6341deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 >> 172.21.15.49:0/2853324237 conn(0x7fe6340b2990 msgr2=0x7fe6341e3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 shutdown_connections 2023-12-19T05:46:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.680+0000 7fe6392ec640 1 -- 172.21.15.49:0/2853324237 wait complete. 2023-12-19T05:46:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:46:11.702 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:46:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.930+0000 7f8f4a6a8640 1 Processor -- start 2023-12-19T05:46:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.930+0000 7f8f4a6a8640 1 -- start start 2023-12-19T05:46:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f4a6a8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f440ce300 0x7f8f4415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f4a6a8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4415ec30 con 0x7f8f4415e5a0 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f4a6a8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4415fbc0 con 0x7f8f440b2030 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f4a6a8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4415e980 con 0x7f8f440ce300 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f496a6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f4415e5a0 0x7f8f440b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60206/0 (socket says 172.21.15.49:60206) 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f496a6640 1 -- 172.21.15.49:0/974048726 learned_addr learned my addr 172.21.15.49:0/974048726 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f49ea7640 1 --2- 172.21.15.49:0/974048726 >> v2:172.21.15.49:3300/0 conn(0x7f8f440ce300 0x7f8f4415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f3bfff640 1 -- 172.21.15.49:0/974048726 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975723303 0 0) 0x7f8f4415ec30 con 0x7f8f4415e5a0 2023-12-19T05:46:11.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.932+0000 7f8f49ea7640 1 -- 172.21.15.49:0/974048726 >> v1:172.21.15.115:6789/0 conn(0x7f8f440b2030 legacy=0x7f8f440cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:11.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.933+0000 7f8f49ea7640 1 -- 172.21.15.49:0/974048726 >> v1:172.21.15.49:6789/0 conn(0x7f8f4415e5a0 legacy=0x7f8f440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.933+0000 7f8f49ea7640 1 -- 172.21.15.49:0/974048726 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440b2f90 con 0x7f8f440ce300 2023-12-19T05:46:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f49ea7640 1 --2- 172.21.15.49:0/974048726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f4415f680 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009dc0 tx=0x7f8f3c02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aaa4d23dacbeec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f3bfff640 1 -- 172.21.15.49:0/974048726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c02cc40 con 0x7f8f440ce300 2023-12-19T05:46:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f3bfff640 1 -- 172.21.15.49:0/974048726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c02cda0 con 0x7f8f440ce300 2023-12-19T05:46:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f3bfff640 1 -- 172.21.15.49:0/974048726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c034660 con 0x7f8f440ce300 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/974048726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 msgr2=0x7f8f4415f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.934+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/974048726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f4415f680 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009dc0 tx=0x7f8f3c02be90 comp rx=0 tx=0).stop 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.935+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/974048726 shutdown_connections 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.935+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/974048726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f4415f680 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.935+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/974048726 >> 172.21.15.49:0/974048726 conn(0x7f8f440b0100 msgr2=0x7f8f440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.935+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/974048726 shutdown_connections 2023-12-19T05:46:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.935+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/974048726 wait complete. 2023-12-19T05:46:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.936+0000 7f8f4a6a8640 1 Processor -- start 2023-12-19T05:46:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.937+0000 7f8f4a6a8640 1 -- start start 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.937+0000 7f8f4a6a8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 0x7f8f44144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f4a6a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f4a6a8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f4415e5a0 0x7f8f440c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f4a6a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440c3f00 con 0x7f8f440ce300 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f4a6a8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44159670 con 0x7f8f440b2030 2023-12-19T05:46:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f4a6a8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44145510 con 0x7f8f4415e5a0 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53382/0 (socket says 172.21.15.49:53382) 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 -- 172.21.15.49:0/1856321653 learned_addr learned my addr 172.21.15.49:0/1856321653 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f496a6640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 0x7f8f44144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 -- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f4415e5a0 msgr2=0x7f8f440c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f49ea7640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f4415e5a0 0x7f8f440c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f4415e5a0 0x7f8f440c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 -- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 msgr2=0x7f8f44144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 0x7f8f44144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f48ea5640 1 -- 172.21.15.49:0/1856321653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009a70 con 0x7f8f440ce300 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.938+0000 7f8f496a6640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 0x7f8f44144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:46:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f48ea5640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c430 tx=0x7f8f3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011790 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340118f0 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011ce0 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f44158a60 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.939+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f44159020 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.940+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44061910 con 0x7f8f440ce300 2023-12-19T05:46:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.941+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f3401c460 con 0x7f8f440ce300 2023-12-19T05:46:11.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.943+0000 7f8f39ffb640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 0x7f8f2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:11.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.943+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f340888c0 con 0x7f8f440ce300 2023-12-19T05:46:11.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.944+0000 7f8f496a6640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 0x7f8f2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:11.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.945+0000 7f8f496a6640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 0x7f8f2806c920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f40007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:11.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:11.949+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f34053eb0 con 0x7f8f440ce300 2023-12-19T05:46:12.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.130+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f4415ee80 con 0x7f8f2806a460 2023-12-19T05:46:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.154+0000 7f8f39ffb640 1 -- 172.21.15.49:0/1856321653 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283110 (secure 0 0 0) 0x7f8f40005d40 con 0x7f8f2806a460 2023-12-19T05:46:12.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:12.164 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 msgr2=0x7f8f2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 0x7f8f2806c920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f40007cc0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 msgr2=0x7f8f44154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c430 tx=0x7f8f3400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 shutdown_connections 2023-12-19T05:46:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8f2806a460 0x7f8f2806c920 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f4415e5a0 0x7f8f440c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f440ce300 0x7f8f44154920 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 --2- 172.21.15.49:0/1856321653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f440b2030 0x7f8f44144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 >> 172.21.15.49:0/1856321653 conn(0x7f8f440b0100 msgr2=0x7f8f44157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.160+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 shutdown_connections 2023-12-19T05:46:12.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.161+0000 7f8f4a6a8640 1 -- 172.21.15.49:0/1856321653 wait complete. 2023-12-19T05:46:12.180 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2023-12-19T05:46:10.651363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555880,"statfs":{"total":1600000000,"available":1593221623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.021958"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.172672+0000","last_change":"2023-12-19T05:46:07.172466+0000","last_active":"2023-12-19T05:46:07.172672+0000","last_peered":"2023-12-19T05:46:07.172672+0000","last_clean":"2023-12-19T05:46:07.172672+0000","last_became_active":"2023-12-19T05:46:07.169337+0000","last_became_peered":"2023-12-19T05:46:07.169337+0000","last_unstale":"2023-12-19T05:46:07.172672+0000","last_undegraded":"2023-12-19T05:46:07.172672+0000","last_fullsized":"2023-12-19T05:46:07.172672+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168447+0000","last_change":"2023-12-19T05:46:07.168342+0000","last_active":"2023-12-19T05:46:07.168447+0000","last_peered":"2023-12-19T05:46:07.168447+0000","last_clean":"2023-12-19T05:46:07.168447+0000","last_became_active":"2023-12-19T05:46:07.167468+0000","last_became_peered":"2023-12-19T05:46:07.167468+0000","last_unstale":"2023-12-19T05:46:07.168447+0000","last_undegraded":"2023-12-19T05:46:07.168447+0000","last_fullsized":"2023-12-19T05:46:07.168447+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:00.152986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.180486+0000","last_change":"2023-12-19T05:46:07.179835+0000","last_active":"2023-12-19T05:46:07.180486+0000","last_peered":"2023-12-19T05:46:07.180486+0000","last_clean":"2023-12-19T05:46:07.180486+0000","last_became_active":"2023-12-19T05:46:07.175493+0000","last_became_peered":"2023-12-19T05:46:07.175493+0000","last_unstale":"2023-12-19T05:46:07.180486+0000","last_undegraded":"2023-12-19T05:46:07.180486+0000","last_fullsized":"2023-12-19T05:46:07.180486+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:53.958505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.182779+0000","last_change":"2023-12-19T05:46:07.181453+0000","last_active":"2023-12-19T05:46:07.182779+0000","last_peered":"2023-12-19T05:46:07.182779+0000","last_clean":"2023-12-19T05:46:07.182779+0000","last_became_active":"2023-12-19T05:46:07.181103+0000","last_became_peered":"2023-12-19T05:46:07.181103+0000","last_unstale":"2023-12-19T05:46:07.182779+0000","last_undegraded":"2023-12-19T05:46:07.182779+0000","last_fullsized":"2023-12-19T05:46:07.182779+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:43:43.319597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.165063+0000","last_change":"2023-12-19T05:46:07.164404+0000","last_active":"2023-12-19T05:46:07.165063+0000","last_peered":"2023-12-19T05:46:07.165063+0000","last_clean":"2023-12-19T05:46:07.165063+0000","last_became_active":"2023-12-19T05:46:07.164186+0000","last_became_peered":"2023-12-19T05:46:07.164186+0000","last_unstale":"2023-12-19T05:46:07.165063+0000","last_undegraded":"2023-12-19T05:46:07.165063+0000","last_fullsized":"2023-12-19T05:46:07.165063+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:12.890497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.154863+0000","last_change":"2023-12-19T05:46:07.154748+0000","last_active":"2023-12-19T05:46:07.154863+0000","last_peered":"2023-12-19T05:46:07.154863+0000","last_clean":"2023-12-19T05:46:07.154863+0000","last_became_active":"2023-12-19T05:46:07.154246+0000","last_became_peered":"2023-12-19T05:46:07.154246+0000","last_unstale":"2023-12-19T05:46:07.154863+0000","last_undegraded":"2023-12-19T05:46:07.154863+0000","last_fullsized":"2023-12-19T05:46:07.154863+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:12.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.158074+0000","last_change":"2023-12-19T05:46:07.157440+0000","last_active":"2023-12-19T05:46:07.158074+0000","last_peered":"2023-12-19T05:46:07.158074+0000","last_clean":"2023-12-19T05:46:07.158074+0000","last_became_active":"2023-12-19T05:46:07.157204+0000","last_became_peered":"2023-12-19T05:46:07.157204+0000","last_unstale":"2023-12-19T05:46:07.158074+0000","last_undegraded":"2023-12-19T05:46:07.158074+0000","last_fullsized":"2023-12-19T05:46:07.158074+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:24.013658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176682+0000","last_change":"2023-12-19T05:46:07.175726+0000","last_active":"2023-12-19T05:46:07.176682+0000","last_peered":"2023-12-19T05:46:07.176682+0000","last_clean":"2023-12-19T05:46:07.176682+0000","last_became_active":"2023-12-19T05:46:07.174963+0000","last_became_peered":"2023-12-19T05:46:07.174963+0000","last_unstale":"2023-12-19T05:46:07.176682+0000","last_undegraded":"2023-12-19T05:46:07.176682+0000","last_fullsized":"2023-12-19T05:46:07.176682+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.175994+0000","last_change":"2023-12-19T05:46:07.175898+0000","last_active":"2023-12-19T05:46:07.175994+0000","last_peered":"2023-12-19T05:46:07.175994+0000","last_clean":"2023-12-19T05:46:07.175994+0000","last_became_active":"2023-12-19T05:46:07.175609+0000","last_became_peered":"2023-12-19T05:46:07.175609+0000","last_unstale":"2023-12-19T05:46:07.175994+0000","last_undegraded":"2023-12-19T05:46:07.175994+0000","last_fullsized":"2023-12-19T05:46:07.175994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:53.511044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.169015+0000","last_change":"2023-12-19T05:46:07.168857+0000","last_active":"2023-12-19T05:46:07.169015+0000","last_peered":"2023-12-19T05:46:07.169015+0000","last_clean":"2023-12-19T05:46:07.169015+0000","last_became_active":"2023-12-19T05:46:07.168580+0000","last_became_peered":"2023-12-19T05:46:07.168580+0000","last_unstale":"2023-12-19T05:46:07.169015+0000","last_undegraded":"2023-12-19T05:46:07.169015+0000","last_fullsized":"2023-12-19T05:46:07.169015+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:15.617682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.154993+0000","last_change":"2023-12-19T05:46:07.154889+0000","last_active":"2023-12-19T05:46:07.154993+0000","last_peered":"2023-12-19T05:46:07.154993+0000","last_clean":"2023-12-19T05:46:07.154993+0000","last_became_active":"2023-12-19T05:46:07.154537+0000","last_became_peered":"2023-12-19T05:46:07.154537+0000","last_unstale":"2023-12-19T05:46:07.154993+0000","last_undegraded":"2023-12-19T05:46:07.154993+0000","last_fullsized":"2023-12-19T05:46:07.154993+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:01.042566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.169074+0000","last_change":"2023-12-19T05:46:07.168994+0000","last_active":"2023-12-19T05:46:07.169074+0000","last_peered":"2023-12-19T05:46:07.169074+0000","last_clean":"2023-12-19T05:46:07.169074+0000","last_became_active":"2023-12-19T05:46:07.168708+0000","last_became_peered":"2023-12-19T05:46:07.168708+0000","last_unstale":"2023-12-19T05:46:07.169074+0000","last_undegraded":"2023-12-19T05:46:07.169074+0000","last_fullsized":"2023-12-19T05:46:07.169074+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.926918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168592+0000","last_change":"2023-12-19T05:46:07.162486+0000","last_active":"2023-12-19T05:46:07.168592+0000","last_peered":"2023-12-19T05:46:07.168592+0000","last_clean":"2023-12-19T05:46:07.168592+0000","last_became_active":"2023-12-19T05:46:07.161948+0000","last_became_peered":"2023-12-19T05:46:07.161948+0000","last_unstale":"2023-12-19T05:46:07.168592+0000","last_undegraded":"2023-12-19T05:46:07.168592+0000","last_fullsized":"2023-12-19T05:46:07.168592+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:55:28.882125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.172705+0000","last_change":"2023-12-19T05:46:07.172629+0000","last_active":"2023-12-19T05:46:07.172705+0000","last_peered":"2023-12-19T05:46:07.172705+0000","last_clean":"2023-12-19T05:46:07.172705+0000","last_became_active":"2023-12-19T05:46:07.171944+0000","last_became_peered":"2023-12-19T05:46:07.171944+0000","last_unstale":"2023-12-19T05:46:07.172705+0000","last_undegraded":"2023-12-19T05:46:07.172705+0000","last_fullsized":"2023-12-19T05:46:07.172705+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:54.078482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.182642+0000","last_change":"2023-12-19T05:46:07.181104+0000","last_active":"2023-12-19T05:46:07.182642+0000","last_peered":"2023-12-19T05:46:07.182642+0000","last_clean":"2023-12-19T05:46:07.182642+0000","last_became_active":"2023-12-19T05:46:07.180745+0000","last_became_peered":"2023-12-19T05:46:07.180745+0000","last_unstale":"2023-12-19T05:46:07.182642+0000","last_undegraded":"2023-12-19T05:46:07.182642+0000","last_fullsized":"2023-12-19T05:46:07.182642+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:41.445878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163352+0000","last_change":"2023-12-19T05:46:07.163267+0000","last_active":"2023-12-19T05:46:07.163352+0000","last_peered":"2023-12-19T05:46:07.163352+0000","last_clean":"2023-12-19T05:46:07.163352+0000","last_became_active":"2023-12-19T05:46:07.163071+0000","last_became_peered":"2023-12-19T05:46:07.163071+0000","last_unstale":"2023-12-19T05:46:07.163352+0000","last_undegraded":"2023-12-19T05:46:07.163352+0000","last_fullsized":"2023-12-19T05:46:07.163352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:49.981680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.175000+0000","last_change":"2023-12-19T05:46:07.174382+0000","last_active":"2023-12-19T05:46:07.175000+0000","last_peered":"2023-12-19T05:46:07.175000+0000","last_clean":"2023-12-19T05:46:07.175000+0000","last_became_active":"2023-12-19T05:46:07.170827+0000","last_became_peered":"2023-12-19T05:46:07.170827+0000","last_unstale":"2023-12-19T05:46:07.175000+0000","last_undegraded":"2023-12-19T05:46:07.175000+0000","last_fullsized":"2023-12-19T05:46:07.175000+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:46.138174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.182662+0000","last_change":"2023-12-19T05:46:07.181981+0000","last_active":"2023-12-19T05:46:07.182662+0000","last_peered":"2023-12-19T05:46:07.182662+0000","last_clean":"2023-12-19T05:46:07.182662+0000","last_became_active":"2023-12-19T05:46:07.179840+0000","last_became_peered":"2023-12-19T05:46:07.179840+0000","last_unstale":"2023-12-19T05:46:07.182662+0000","last_undegraded":"2023-12-19T05:46:07.182662+0000","last_fullsized":"2023-12-19T05:46:07.182662+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:18.926393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.181345+0000","last_change":"2023-12-19T05:46:07.181276+0000","last_active":"2023-12-19T05:46:07.181345+0000","last_peered":"2023-12-19T05:46:07.181345+0000","last_clean":"2023-12-19T05:46:07.181345+0000","last_became_active":"2023-12-19T05:46:07.178449+0000","last_became_peered":"2023-12-19T05:46:07.178449+0000","last_unstale":"2023-12-19T05:46:07.181345+0000","last_undegraded":"2023-12-19T05:46:07.181345+0000","last_fullsized":"2023-12-19T05:46:07.181345+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:12.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.164861+0000","last_change":"2023-12-19T05:46:07.164635+0000","last_active":"2023-12-19T05:46:07.164861+0000","last_peered":"2023-12-19T05:46:07.164861+0000","last_clean":"2023-12-19T05:46:07.164861+0000","last_became_active":"2023-12-19T05:46:07.164406+0000","last_became_peered":"2023-12-19T05:46:07.164406+0000","last_unstale":"2023-12-19T05:46:07.164861+0000","last_undegraded":"2023-12-19T05:46:07.164861+0000","last_fullsized":"2023-12-19T05:46:07.164861+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:00.172606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176666+0000","last_change":"2023-12-19T05:46:07.174699+0000","last_active":"2023-12-19T05:46:07.176666+0000","last_peered":"2023-12-19T05:46:07.176666+0000","last_clean":"2023-12-19T05:46:07.176666+0000","last_became_active":"2023-12-19T05:46:07.174325+0000","last_became_peered":"2023-12-19T05:46:07.174325+0000","last_unstale":"2023-12-19T05:46:07.176666+0000","last_undegraded":"2023-12-19T05:46:07.176666+0000","last_fullsized":"2023-12-19T05:46:07.176666+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:18.361541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.170994+0000","last_change":"2023-12-19T05:46:07.164636+0000","last_active":"2023-12-19T05:46:07.170994+0000","last_peered":"2023-12-19T05:46:07.170994+0000","last_clean":"2023-12-19T05:46:07.170994+0000","last_became_active":"2023-12-19T05:46:07.164175+0000","last_became_peered":"2023-12-19T05:46:07.164175+0000","last_unstale":"2023-12-19T05:46:07.170994+0000","last_undegraded":"2023-12-19T05:46:07.170994+0000","last_fullsized":"2023-12-19T05:46:07.170994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.175363+0000","last_change":"2023-12-19T05:46:07.175252+0000","last_active":"2023-12-19T05:46:07.175363+0000","last_peered":"2023-12-19T05:46:07.175363+0000","last_clean":"2023-12-19T05:46:07.175363+0000","last_became_active":"2023-12-19T05:46:07.174476+0000","last_became_peered":"2023-12-19T05:46:07.174476+0000","last_unstale":"2023-12-19T05:46:07.175363+0000","last_undegraded":"2023-12-19T05:46:07.175363+0000","last_fullsized":"2023-12-19T05:46:07.175363+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:10.735495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.160331+0000","last_change":"2023-12-19T05:46:07.160006+0000","last_active":"2023-12-19T05:46:07.160331+0000","last_peered":"2023-12-19T05:46:07.160331+0000","last_clean":"2023-12-19T05:46:07.160331+0000","last_became_active":"2023-12-19T05:46:07.159721+0000","last_became_peered":"2023-12-19T05:46:07.159721+0000","last_unstale":"2023-12-19T05:46:07.160331+0000","last_undegraded":"2023-12-19T05:46:07.160331+0000","last_fullsized":"2023-12-19T05:46:07.160331+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:54.078482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176864+0000","last_change":"2023-12-19T05:46:07.176792+0000","last_active":"2023-12-19T05:46:07.176864+0000","last_peered":"2023-12-19T05:46:07.176864+0000","last_clean":"2023-12-19T05:46:07.176864+0000","last_became_active":"2023-12-19T05:46:07.175937+0000","last_became_peered":"2023-12-19T05:46:07.175937+0000","last_unstale":"2023-12-19T05:46:07.176864+0000","last_undegraded":"2023-12-19T05:46:07.176864+0000","last_fullsized":"2023-12-19T05:46:07.176864+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:39.555982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168668+0000","last_change":"2023-12-19T05:46:07.168111+0000","last_active":"2023-12-19T05:46:07.168668+0000","last_peered":"2023-12-19T05:46:07.168668+0000","last_clean":"2023-12-19T05:46:07.168668+0000","last_became_active":"2023-12-19T05:46:07.164202+0000","last_became_peered":"2023-12-19T05:46:07.164202+0000","last_unstale":"2023-12-19T05:46:07.168668+0000","last_undegraded":"2023-12-19T05:46:07.168668+0000","last_fullsized":"2023-12-19T05:46:07.168668+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:44:39.413695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163503+0000","last_change":"2023-12-19T05:46:07.163433+0000","last_active":"2023-12-19T05:46:07.163503+0000","last_peered":"2023-12-19T05:46:07.163503+0000","last_clean":"2023-12-19T05:46:07.163503+0000","last_became_active":"2023-12-19T05:46:07.162720+0000","last_became_peered":"2023-12-19T05:46:07.162720+0000","last_unstale":"2023-12-19T05:46:07.163503+0000","last_undegraded":"2023-12-19T05:46:07.163503+0000","last_fullsized":"2023-12-19T05:46:07.163503+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176809+0000","last_change":"2023-12-19T05:46:07.176725+0000","last_active":"2023-12-19T05:46:07.176809+0000","last_peered":"2023-12-19T05:46:07.176809+0000","last_clean":"2023-12-19T05:46:07.176809+0000","last_became_active":"2023-12-19T05:46:07.176455+0000","last_became_peered":"2023-12-19T05:46:07.176455+0000","last_unstale":"2023-12-19T05:46:07.176809+0000","last_undegraded":"2023-12-19T05:46:07.176809+0000","last_fullsized":"2023-12-19T05:46:07.176809+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:10.735495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.172328+0000","last_change":"2023-12-19T05:46:07.172156+0000","last_active":"2023-12-19T05:46:07.172328+0000","last_peered":"2023-12-19T05:46:07.172328+0000","last_clean":"2023-12-19T05:46:07.172328+0000","last_became_active":"2023-12-19T05:46:07.170020+0000","last_became_peered":"2023-12-19T05:46:07.170020+0000","last_unstale":"2023-12-19T05:46:07.172328+0000","last_undegraded":"2023-12-19T05:46:07.172328+0000","last_fullsized":"2023-12-19T05:46:07.172328+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:57:54.800144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.173987+0000","last_change":"2023-12-19T05:46:07.173912+0000","last_active":"2023-12-19T05:46:07.173987+0000","last_peered":"2023-12-19T05:46:07.173987+0000","last_clean":"2023-12-19T05:46:07.173987+0000","last_became_active":"2023-12-19T05:46:07.173629+0000","last_became_peered":"2023-12-19T05:46:07.173629+0000","last_unstale":"2023-12-19T05:46:07.173987+0000","last_undegraded":"2023-12-19T05:46:07.173987+0000","last_fullsized":"2023-12-19T05:46:07.173987+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:03.397333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176648+0000","last_change":"2023-12-19T05:46:07.174545+0000","last_active":"2023-12-19T05:46:07.176648+0000","last_peered":"2023-12-19T05:46:07.176648+0000","last_clean":"2023-12-19T05:46:07.176648+0000","last_became_active":"2023-12-19T05:46:07.174027+0000","last_became_peered":"2023-12-19T05:46:07.174027+0000","last_unstale":"2023-12-19T05:46:07.176648+0000","last_undegraded":"2023-12-19T05:46:07.176648+0000","last_fullsized":"2023-12-19T05:46:07.176648+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:43:43.319597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178632+0000","last_change":"2023-12-19T05:46:07.176637+0000","last_active":"2023-12-19T05:46:07.178632+0000","last_peered":"2023-12-19T05:46:07.178632+0000","last_clean":"2023-12-19T05:46:07.178632+0000","last_became_active":"2023-12-19T05:46:07.176368+0000","last_became_peered":"2023-12-19T05:46:07.176368+0000","last_unstale":"2023-12-19T05:46:07.178632+0000","last_undegraded":"2023-12-19T05:46:07.178632+0000","last_fullsized":"2023-12-19T05:46:07.178632+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.180264+0000","last_change":"2023-12-19T05:46:07.178683+0000","last_active":"2023-12-19T05:46:07.180264+0000","last_peered":"2023-12-19T05:46:07.180264+0000","last_clean":"2023-12-19T05:46:07.180264+0000","last_became_active":"2023-12-19T05:46:07.177834+0000","last_became_peered":"2023-12-19T05:46:07.177834+0000","last_unstale":"2023-12-19T05:46:07.180264+0000","last_undegraded":"2023-12-19T05:46:07.180264+0000","last_fullsized":"2023-12-19T05:46:07.180264+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:25:15.804317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"127'4","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178941+0000","last_change":"2023-12-19T05:46:06.663344+0000","last_active":"2023-12-19T05:46:07.178941+0000","last_peered":"2023-12-19T05:46:07.178941+0000","last_clean":"2023-12-19T05:46:07.178941+0000","last_became_active":"2023-12-19T05:46:06.663047+0000","last_became_peered":"2023-12-19T05:46:06.663047+0000","last_unstale":"2023-12-19T05:46:07.178941+0000","last_undegraded":"2023-12-19T05:46:07.178941+0000","last_fullsized":"2023-12-19T05:46:07.178941+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:01.558690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.172974+0000","last_change":"2023-12-19T05:46:07.172844+0000","last_active":"2023-12-19T05:46:07.172974+0000","last_peered":"2023-12-19T05:46:07.172974+0000","last_clean":"2023-12-19T05:46:07.172974+0000","last_became_active":"2023-12-19T05:46:07.171852+0000","last_became_peered":"2023-12-19T05:46:07.171852+0000","last_unstale":"2023-12-19T05:46:07.172974+0000","last_undegraded":"2023-12-19T05:46:07.172974+0000","last_fullsized":"2023-12-19T05:46:07.172974+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:26.666663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"127'1","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168370+0000","last_change":"2023-12-19T05:46:06.653122+0000","last_active":"2023-12-19T05:46:07.168370+0000","last_peered":"2023-12-19T05:46:07.168370+0000","last_clean":"2023-12-19T05:46:07.168370+0000","last_became_active":"2023-12-19T05:46:06.651538+0000","last_became_peered":"2023-12-19T05:46:06.651538+0000","last_unstale":"2023-12-19T05:46:07.168370+0000","last_undegraded":"2023-12-19T05:46:07.168370+0000","last_fullsized":"2023-12-19T05:46:07.168370+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:23.478843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.171632+0000","last_change":"2023-12-19T05:46:07.171361+0000","last_active":"2023-12-19T05:46:07.171632+0000","last_peered":"2023-12-19T05:46:07.171632+0000","last_clean":"2023-12-19T05:46:07.171632+0000","last_became_active":"2023-12-19T05:46:07.168208+0000","last_became_peered":"2023-12-19T05:46:07.168208+0000","last_unstale":"2023-12-19T05:46:07.171632+0000","last_undegraded":"2023-12-19T05:46:07.171632+0000","last_fullsized":"2023-12-19T05:46:07.171632+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:05.225514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.183245+0000","last_change":"2023-12-19T05:46:06.662587+0000","last_active":"2023-12-19T05:46:07.183245+0000","last_peered":"2023-12-19T05:46:07.183245+0000","last_clean":"2023-12-19T05:46:07.183245+0000","last_became_active":"2023-12-19T05:46:06.661344+0000","last_became_peered":"2023-12-19T05:46:06.661344+0000","last_unstale":"2023-12-19T05:46:07.183245+0000","last_undegraded":"2023-12-19T05:46:07.183245+0000","last_fullsized":"2023-12-19T05:46:07.183245+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:37:50.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.159966+0000","last_change":"2023-12-19T05:46:07.159863+0000","last_active":"2023-12-19T05:46:07.159966+0000","last_peered":"2023-12-19T05:46:07.159966+0000","last_clean":"2023-12-19T05:46:07.159966+0000","last_became_active":"2023-12-19T05:46:07.159561+0000","last_became_peered":"2023-12-19T05:46:07.159561+0000","last_unstale":"2023-12-19T05:46:07.159966+0000","last_undegraded":"2023-12-19T05:46:07.159966+0000","last_fullsized":"2023-12-19T05:46:07.159966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.926918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.180834+0000","last_change":"2023-12-19T05:46:06.665003+0000","last_active":"2023-12-19T05:46:07.180834+0000","last_peered":"2023-12-19T05:46:07.180834+0000","last_clean":"2023-12-19T05:46:07.180834+0000","last_became_active":"2023-12-19T05:46:06.663673+0000","last_became_peered":"2023-12-19T05:46:06.663673+0000","last_unstale":"2023-12-19T05:46:07.180834+0000","last_undegraded":"2023-12-19T05:46:07.180834+0000","last_fullsized":"2023-12-19T05:46:07.180834+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:33.917302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.157122+0000","last_change":"2023-12-19T05:46:07.155526+0000","last_active":"2023-12-19T05:46:07.157122+0000","last_peered":"2023-12-19T05:46:07.157122+0000","last_clean":"2023-12-19T05:46:07.157122+0000","last_became_active":"2023-12-19T05:46:07.155063+0000","last_became_peered":"2023-12-19T05:46:07.155063+0000","last_unstale":"2023-12-19T05:46:07.157122+0000","last_undegraded":"2023-12-19T05:46:07.157122+0000","last_fullsized":"2023-12-19T05:46:07.157122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:32.826049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"127'1","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.170669+0000","last_change":"2023-12-19T05:46:06.665972+0000","last_active":"2023-12-19T05:46:07.170669+0000","last_peered":"2023-12-19T05:46:07.170669+0000","last_clean":"2023-12-19T05:46:07.170669+0000","last_became_active":"2023-12-19T05:46:06.665746+0000","last_became_peered":"2023-12-19T05:46:06.665746+0000","last_unstale":"2023-12-19T05:46:07.170669+0000","last_undegraded":"2023-12-19T05:46:07.170669+0000","last_fullsized":"2023-12-19T05:46:07.170669+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:16.256168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.153461+0000","last_change":"2023-12-19T05:46:07.153347+0000","last_active":"2023-12-19T05:46:07.153461+0000","last_peered":"2023-12-19T05:46:07.153461+0000","last_clean":"2023-12-19T05:46:07.153461+0000","last_became_active":"2023-12-19T05:46:07.153128+0000","last_became_peered":"2023-12-19T05:46:07.153128+0000","last_unstale":"2023-12-19T05:46:07.153461+0000","last_undegraded":"2023-12-19T05:46:07.153461+0000","last_fullsized":"2023-12-19T05:46:07.153461+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:12.619343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"127'1","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.181932+0000","last_change":"2023-12-19T05:46:06.667793+0000","last_active":"2023-12-19T05:46:07.181932+0000","last_peered":"2023-12-19T05:46:07.181932+0000","last_clean":"2023-12-19T05:46:07.181932+0000","last_became_active":"2023-12-19T05:46:06.666625+0000","last_became_peered":"2023-12-19T05:46:06.666625+0000","last_unstale":"2023-12-19T05:46:07.181932+0000","last_undegraded":"2023-12-19T05:46:07.181932+0000","last_fullsized":"2023-12-19T05:46:07.181932+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:53.011995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.179464+0000","last_change":"2023-12-19T05:46:07.179378+0000","last_active":"2023-12-19T05:46:07.179464+0000","last_peered":"2023-12-19T05:46:07.179464+0000","last_clean":"2023-12-19T05:46:07.179464+0000","last_became_active":"2023-12-19T05:46:07.179127+0000","last_became_peered":"2023-12-19T05:46:07.179127+0000","last_unstale":"2023-12-19T05:46:07.179464+0000","last_undegraded":"2023-12-19T05:46:07.179464+0000","last_fullsized":"2023-12-19T05:46:07.179464+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:26:35.612401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.144927+0000","last_change":"2023-12-19T05:46:06.663945+0000","last_active":"2023-12-19T05:46:07.144927+0000","last_peered":"2023-12-19T05:46:07.144927+0000","last_clean":"2023-12-19T05:46:07.144927+0000","last_became_active":"2023-12-19T05:46:06.661796+0000","last_became_peered":"2023-12-19T05:46:06.661796+0000","last_unstale":"2023-12-19T05:46:07.144927+0000","last_undegraded":"2023-12-19T05:46:07.144927+0000","last_fullsized":"2023-12-19T05:46:07.144927+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:20:03.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.157070+0000","last_change":"2023-12-19T05:46:07.153860+0000","last_active":"2023-12-19T05:46:07.157070+0000","last_peered":"2023-12-19T05:46:07.157070+0000","last_clean":"2023-12-19T05:46:07.157070+0000","last_became_active":"2023-12-19T05:46:07.153634+0000","last_became_peered":"2023-12-19T05:46:07.153634+0000","last_unstale":"2023-12-19T05:46:07.157070+0000","last_undegraded":"2023-12-19T05:46:07.157070+0000","last_fullsized":"2023-12-19T05:46:07.157070+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:54.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.153494+0000","last_change":"2023-12-19T05:46:06.657114+0000","last_active":"2023-12-19T05:46:07.153494+0000","last_peered":"2023-12-19T05:46:07.153494+0000","last_clean":"2023-12-19T05:46:07.153494+0000","last_became_active":"2023-12-19T05:46:06.654659+0000","last_became_peered":"2023-12-19T05:46:06.654659+0000","last_unstale":"2023-12-19T05:46:07.153494+0000","last_undegraded":"2023-12-19T05:46:07.153494+0000","last_fullsized":"2023-12-19T05:46:07.153494+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:09.725879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178655+0000","last_change":"2023-12-19T05:46:07.177113+0000","last_active":"2023-12-19T05:46:07.178655+0000","last_peered":"2023-12-19T05:46:07.178655+0000","last_clean":"2023-12-19T05:46:07.178655+0000","last_became_active":"2023-12-19T05:46:07.176886+0000","last_became_peered":"2023-12-19T05:46:07.176886+0000","last_unstale":"2023-12-19T05:46:07.178655+0000","last_undegraded":"2023-12-19T05:46:07.178655+0000","last_fullsized":"2023-12-19T05:46:07.178655+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.167976+0000","last_change":"2023-12-19T05:46:06.667583+0000","last_active":"2023-12-19T05:46:07.167976+0000","last_peered":"2023-12-19T05:46:07.167976+0000","last_clean":"2023-12-19T05:46:07.167976+0000","last_became_active":"2023-12-19T05:46:06.667157+0000","last_became_peered":"2023-12-19T05:46:06.667157+0000","last_unstale":"2023-12-19T05:46:07.167976+0000","last_undegraded":"2023-12-19T05:46:07.167976+0000","last_fullsized":"2023-12-19T05:46:07.167976+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:14:26.939874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.159357+0000","last_change":"2023-12-19T05:46:07.159157+0000","last_active":"2023-12-19T05:46:07.159357+0000","last_peered":"2023-12-19T05:46:07.159357+0000","last_clean":"2023-12-19T05:46:07.159357+0000","last_became_active":"2023-12-19T05:46:07.158198+0000","last_became_peered":"2023-12-19T05:46:07.158198+0000","last_unstale":"2023-12-19T05:46:07.159357+0000","last_undegraded":"2023-12-19T05:46:07.159357+0000","last_fullsized":"2023-12-19T05:46:07.159357+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.166862+0000","last_change":"2023-12-19T05:46:06.663855+0000","last_active":"2023-12-19T05:46:07.166862+0000","last_peered":"2023-12-19T05:46:07.166862+0000","last_clean":"2023-12-19T05:46:07.166862+0000","last_became_active":"2023-12-19T05:46:06.663588+0000","last_became_peered":"2023-12-19T05:46:06.663588+0000","last_unstale":"2023-12-19T05:46:07.166862+0000","last_undegraded":"2023-12-19T05:46:07.166862+0000","last_fullsized":"2023-12-19T05:46:07.166862+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:42.604916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.160085+0000","last_change":"2023-12-19T05:46:07.160009+0000","last_active":"2023-12-19T05:46:07.160085+0000","last_peered":"2023-12-19T05:46:07.160085+0000","last_clean":"2023-12-19T05:46:07.160085+0000","last_became_active":"2023-12-19T05:46:07.159766+0000","last_became_peered":"2023-12-19T05:46:07.159766+0000","last_unstale":"2023-12-19T05:46:07.160085+0000","last_undegraded":"2023-12-19T05:46:07.160085+0000","last_fullsized":"2023-12-19T05:46:07.160085+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:28:29.205900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"127'3","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.167962+0000","last_change":"2023-12-19T05:46:06.659375+0000","last_active":"2023-12-19T05:46:07.167962+0000","last_peered":"2023-12-19T05:46:07.167962+0000","last_clean":"2023-12-19T05:46:07.167962+0000","last_became_active":"2023-12-19T05:46:06.658966+0000","last_became_peered":"2023-12-19T05:46:06.658966+0000","last_unstale":"2023-12-19T05:46:07.167962+0000","last_undegraded":"2023-12-19T05:46:07.167962+0000","last_fullsized":"2023-12-19T05:46:07.167962+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:41.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168448+0000","last_change":"2023-12-19T05:46:07.168008+0000","last_active":"2023-12-19T05:46:07.168448+0000","last_peered":"2023-12-19T05:46:07.168448+0000","last_clean":"2023-12-19T05:46:07.168448+0000","last_became_active":"2023-12-19T05:46:07.167692+0000","last_became_peered":"2023-12-19T05:46:07.167692+0000","last_unstale":"2023-12-19T05:46:07.168448+0000","last_undegraded":"2023-12-19T05:46:07.168448+0000","last_fullsized":"2023-12-19T05:46:07.168448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:34:57.506806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"127'6","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.182491+0000","last_change":"2023-12-19T05:46:06.665403+0000","last_active":"2023-12-19T05:46:07.182491+0000","last_peered":"2023-12-19T05:46:07.182491+0000","last_clean":"2023-12-19T05:46:07.182491+0000","last_became_active":"2023-12-19T05:46:06.665080+0000","last_became_peered":"2023-12-19T05:46:06.665080+0000","last_unstale":"2023-12-19T05:46:07.182491+0000","last_undegraded":"2023-12-19T05:46:07.182491+0000","last_fullsized":"2023-12-19T05:46:07.182491+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:34.901054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.172392+0000","last_change":"2023-12-19T05:46:07.171837+0000","last_active":"2023-12-19T05:46:07.172392+0000","last_peered":"2023-12-19T05:46:07.172392+0000","last_clean":"2023-12-19T05:46:07.172392+0000","last_became_active":"2023-12-19T05:46:07.168804+0000","last_became_peered":"2023-12-19T05:46:07.168804+0000","last_unstale":"2023-12-19T05:46:07.172392+0000","last_undegraded":"2023-12-19T05:46:07.172392+0000","last_fullsized":"2023-12-19T05:46:07.172392+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:25.272757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.181980+0000","last_change":"2023-12-19T05:46:06.645773+0000","last_active":"2023-12-19T05:46:07.181980+0000","last_peered":"2023-12-19T05:46:07.181980+0000","last_clean":"2023-12-19T05:46:07.181980+0000","last_became_active":"2023-12-19T05:46:06.645067+0000","last_became_peered":"2023-12-19T05:46:06.645067+0000","last_unstale":"2023-12-19T05:46:07.181980+0000","last_undegraded":"2023-12-19T05:46:07.181980+0000","last_fullsized":"2023-12-19T05:46:07.181980+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:49:39.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178440+0000","last_change":"2023-12-19T05:46:07.178367+0000","last_active":"2023-12-19T05:46:07.178440+0000","last_peered":"2023-12-19T05:46:07.178440+0000","last_clean":"2023-12-19T05:46:07.178440+0000","last_became_active":"2023-12-19T05:46:07.177632+0000","last_became_peered":"2023-12-19T05:46:07.177632+0000","last_unstale":"2023-12-19T05:46:07.178440+0000","last_undegraded":"2023-12-19T05:46:07.178440+0000","last_fullsized":"2023-12-19T05:46:07.178440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163121+0000","last_change":"2023-12-19T05:46:06.658991+0000","last_active":"2023-12-19T05:46:07.163121+0000","last_peered":"2023-12-19T05:46:07.163121+0000","last_clean":"2023-12-19T05:46:07.163121+0000","last_became_active":"2023-12-19T05:46:06.658639+0000","last_became_peered":"2023-12-19T05:46:06.658639+0000","last_unstale":"2023-12-19T05:46:07.163121+0000","last_undegraded":"2023-12-19T05:46:07.163121+0000","last_fullsized":"2023-12-19T05:46:07.163121+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:34.295254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.150629+0000","last_change":"2023-12-19T05:46:07.150498+0000","last_active":"2023-12-19T05:46:07.150629+0000","last_peered":"2023-12-19T05:46:07.150629+0000","last_clean":"2023-12-19T05:46:07.150629+0000","last_became_active":"2023-12-19T05:46:07.150278+0000","last_became_peered":"2023-12-19T05:46:07.150278+0000","last_unstale":"2023-12-19T05:46:07.150629+0000","last_undegraded":"2023-12-19T05:46:07.150629+0000","last_fullsized":"2023-12-19T05:46:07.150629+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.148396+0000","last_change":"2023-12-19T05:46:06.666716+0000","last_active":"2023-12-19T05:46:07.148396+0000","last_peered":"2023-12-19T05:46:07.148396+0000","last_clean":"2023-12-19T05:46:07.148396+0000","last_became_active":"2023-12-19T05:46:06.666237+0000","last_became_peered":"2023-12-19T05:46:06.666237+0000","last_unstale":"2023-12-19T05:46:07.148396+0000","last_undegraded":"2023-12-19T05:46:07.148396+0000","last_fullsized":"2023-12-19T05:46:07.148396+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:30.076016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.170974+0000","last_change":"2023-12-19T05:46:07.164474+0000","last_active":"2023-12-19T05:46:07.170974+0000","last_peered":"2023-12-19T05:46:07.170974+0000","last_clean":"2023-12-19T05:46:07.170974+0000","last_became_active":"2023-12-19T05:46:07.163798+0000","last_became_peered":"2023-12-19T05:46:07.163798+0000","last_unstale":"2023-12-19T05:46:07.170974+0000","last_undegraded":"2023-12-19T05:46:07.170974+0000","last_fullsized":"2023-12-19T05:46:07.170974+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:58.362285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"127'8","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.182411+0000","last_change":"2023-12-19T05:46:06.661489+0000","last_active":"2023-12-19T05:46:07.182411+0000","last_peered":"2023-12-19T05:46:07.182411+0000","last_clean":"2023-12-19T05:46:07.182411+0000","last_became_active":"2023-12-19T05:46:06.660725+0000","last_became_peered":"2023-12-19T05:46:06.660725+0000","last_unstale":"2023-12-19T05:46:07.182411+0000","last_undegraded":"2023-12-19T05:46:07.182411+0000","last_fullsized":"2023-12-19T05:46:07.182411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:48:05.052388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.150511+0000","last_change":"2023-12-19T05:46:07.150285+0000","last_active":"2023-12-19T05:46:07.150511+0000","last_peered":"2023-12-19T05:46:07.150511+0000","last_clean":"2023-12-19T05:46:07.150511+0000","last_became_active":"2023-12-19T05:46:07.150052+0000","last_became_peered":"2023-12-19T05:46:07.150052+0000","last_unstale":"2023-12-19T05:46:07.150511+0000","last_undegraded":"2023-12-19T05:46:07.150511+0000","last_fullsized":"2023-12-19T05:46:07.150511+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.175677+0000","last_change":"2023-12-19T05:46:06.665441+0000","last_active":"2023-12-19T05:46:07.175677+0000","last_peered":"2023-12-19T05:46:07.175677+0000","last_clean":"2023-12-19T05:46:07.175677+0000","last_became_active":"2023-12-19T05:46:06.664520+0000","last_became_peered":"2023-12-19T05:46:06.664520+0000","last_unstale":"2023-12-19T05:46:07.175677+0000","last_undegraded":"2023-12-19T05:46:07.175677+0000","last_fullsized":"2023-12-19T05:46:07.175677+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:29.396877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.152954+0000","last_change":"2023-12-19T05:46:07.152686+0000","last_active":"2023-12-19T05:46:07.152954+0000","last_peered":"2023-12-19T05:46:07.152954+0000","last_clean":"2023-12-19T05:46:07.152954+0000","last_became_active":"2023-12-19T05:46:07.152458+0000","last_became_peered":"2023-12-19T05:46:07.152458+0000","last_unstale":"2023-12-19T05:46:07.152954+0000","last_undegraded":"2023-12-19T05:46:07.152954+0000","last_fullsized":"2023-12-19T05:46:07.152954+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:05.225514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"127'1","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.167068+0000","last_change":"2023-12-19T05:46:06.666228+0000","last_active":"2023-12-19T05:46:07.167068+0000","last_peered":"2023-12-19T05:46:07.167068+0000","last_clean":"2023-12-19T05:46:07.167068+0000","last_became_active":"2023-12-19T05:46:06.665811+0000","last_became_peered":"2023-12-19T05:46:06.665811+0000","last_unstale":"2023-12-19T05:46:07.167068+0000","last_undegraded":"2023-12-19T05:46:07.167068+0000","last_fullsized":"2023-12-19T05:46:07.167068+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:48:10.702897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.158678+0000","last_change":"2023-12-19T05:46:07.158521+0000","last_active":"2023-12-19T05:46:07.158678+0000","last_peered":"2023-12-19T05:46:07.158678+0000","last_clean":"2023-12-19T05:46:07.158678+0000","last_became_active":"2023-12-19T05:46:07.158170+0000","last_became_peered":"2023-12-19T05:46:07.158170+0000","last_unstale":"2023-12-19T05:46:07.158678+0000","last_undegraded":"2023-12-19T05:46:07.158678+0000","last_fullsized":"2023-12-19T05:46:07.158678+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:25.412703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.154783+0000","last_change":"2023-12-19T05:46:06.651213+0000","last_active":"2023-12-19T05:46:07.154783+0000","last_peered":"2023-12-19T05:46:07.154783+0000","last_clean":"2023-12-19T05:46:07.154783+0000","last_became_active":"2023-12-19T05:46:06.648592+0000","last_became_peered":"2023-12-19T05:46:06.648592+0000","last_unstale":"2023-12-19T05:46:07.154783+0000","last_undegraded":"2023-12-19T05:46:07.154783+0000","last_fullsized":"2023-12-19T05:46:07.154783+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:34:56.497190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.180466+0000","last_change":"2023-12-19T05:46:07.180381+0000","last_active":"2023-12-19T05:46:07.180466+0000","last_peered":"2023-12-19T05:46:07.180466+0000","last_clean":"2023-12-19T05:46:07.180466+0000","last_became_active":"2023-12-19T05:46:07.178174+0000","last_became_peered":"2023-12-19T05:46:07.178174+0000","last_unstale":"2023-12-19T05:46:07.180466+0000","last_undegraded":"2023-12-19T05:46:07.180466+0000","last_fullsized":"2023-12-19T05:46:07.180466+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:22.258546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.183477+0000","last_change":"2023-12-19T05:46:06.661325+0000","last_active":"2023-12-19T05:46:07.183477+0000","last_peered":"2023-12-19T05:46:07.183477+0000","last_clean":"2023-12-19T05:46:07.183477+0000","last_became_active":"2023-12-19T05:46:06.660361+0000","last_became_peered":"2023-12-19T05:46:06.660361+0000","last_unstale":"2023-12-19T05:46:07.183477+0000","last_undegraded":"2023-12-19T05:46:07.183477+0000","last_fullsized":"2023-12-19T05:46:07.183477+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:14.608066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.180086+0000","last_change":"2023-12-19T05:46:07.180015+0000","last_active":"2023-12-19T05:46:07.180086+0000","last_peered":"2023-12-19T05:46:07.180086+0000","last_clean":"2023-12-19T05:46:07.180086+0000","last_became_active":"2023-12-19T05:46:07.179796+0000","last_became_peered":"2023-12-19T05:46:07.179796+0000","last_unstale":"2023-12-19T05:46:07.180086+0000","last_undegraded":"2023-12-19T05:46:07.180086+0000","last_fullsized":"2023-12-19T05:46:07.180086+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:03:27.352347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.146794+0000","last_change":"2023-12-19T05:46:06.663935+0000","last_active":"2023-12-19T05:46:07.146794+0000","last_peered":"2023-12-19T05:46:07.146794+0000","last_clean":"2023-12-19T05:46:07.146794+0000","last_became_active":"2023-12-19T05:46:06.663267+0000","last_became_peered":"2023-12-19T05:46:06.663267+0000","last_unstale":"2023-12-19T05:46:07.146794+0000","last_undegraded":"2023-12-19T05:46:07.146794+0000","last_fullsized":"2023-12-19T05:46:07.146794+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:53.011995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.174198+0000","last_change":"2023-12-19T05:46:07.174108+0000","last_active":"2023-12-19T05:46:07.174198+0000","last_peered":"2023-12-19T05:46:07.174198+0000","last_clean":"2023-12-19T05:46:07.174198+0000","last_became_active":"2023-12-19T05:46:07.173876+0000","last_became_peered":"2023-12-19T05:46:07.173876+0000","last_unstale":"2023-12-19T05:46:07.174198+0000","last_undegraded":"2023-12-19T05:46:07.174198+0000","last_fullsized":"2023-12-19T05:46:07.174198+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.153787+0000","last_change":"2023-12-19T05:46:06.663566+0000","last_active":"2023-12-19T05:46:07.153787+0000","last_peered":"2023-12-19T05:46:07.153787+0000","last_clean":"2023-12-19T05:46:07.153787+0000","last_became_active":"2023-12-19T05:46:06.662734+0000","last_became_peered":"2023-12-19T05:46:06.662734+0000","last_unstale":"2023-12-19T05:46:07.153787+0000","last_undegraded":"2023-12-19T05:46:07.153787+0000","last_fullsized":"2023-12-19T05:46:07.153787+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:26.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.177662+0000","last_change":"2023-12-19T05:46:07.177589+0000","last_active":"2023-12-19T05:46:07.177662+0000","last_peered":"2023-12-19T05:46:07.177662+0000","last_clean":"2023-12-19T05:46:07.177662+0000","last_became_active":"2023-12-19T05:46:07.177403+0000","last_became_peered":"2023-12-19T05:46:07.177403+0000","last_unstale":"2023-12-19T05:46:07.177662+0000","last_undegraded":"2023-12-19T05:46:07.177662+0000","last_fullsized":"2023-12-19T05:46:07.177662+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168099+0000","last_change":"2023-12-19T05:46:06.663518+0000","last_active":"2023-12-19T05:46:07.168099+0000","last_peered":"2023-12-19T05:46:07.168099+0000","last_clean":"2023-12-19T05:46:07.168099+0000","last_became_active":"2023-12-19T05:46:06.663301+0000","last_became_peered":"2023-12-19T05:46:06.663301+0000","last_unstale":"2023-12-19T05:46:07.168099+0000","last_undegraded":"2023-12-19T05:46:07.168099+0000","last_fullsized":"2023-12-19T05:46:07.168099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:47.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.175697+0000","last_change":"2023-12-19T05:46:07.171393+0000","last_active":"2023-12-19T05:46:07.175697+0000","last_peered":"2023-12-19T05:46:07.175697+0000","last_clean":"2023-12-19T05:46:07.175697+0000","last_became_active":"2023-12-19T05:46:07.170843+0000","last_became_peered":"2023-12-19T05:46:07.170843+0000","last_unstale":"2023-12-19T05:46:07.175697+0000","last_undegraded":"2023-12-19T05:46:07.175697+0000","last_fullsized":"2023-12-19T05:46:07.175697+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:53.958505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"127'2","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163566+0000","last_change":"2023-12-19T05:46:06.666473+0000","last_active":"2023-12-19T05:46:07.163566+0000","last_peered":"2023-12-19T05:46:07.163566+0000","last_clean":"2023-12-19T05:46:07.163566+0000","last_became_active":"2023-12-19T05:46:06.665774+0000","last_became_peered":"2023-12-19T05:46:06.665774+0000","last_unstale":"2023-12-19T05:46:07.163566+0000","last_undegraded":"2023-12-19T05:46:07.163566+0000","last_fullsized":"2023-12-19T05:46:07.163566+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:01.181337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.179009+0000","last_change":"2023-12-19T05:46:07.178302+0000","last_active":"2023-12-19T05:46:07.179009+0000","last_peered":"2023-12-19T05:46:07.179009+0000","last_clean":"2023-12-19T05:46:07.179009+0000","last_became_active":"2023-12-19T05:46:07.178045+0000","last_became_peered":"2023-12-19T05:46:07.178045+0000","last_unstale":"2023-12-19T05:46:07.179009+0000","last_undegraded":"2023-12-19T05:46:07.179009+0000","last_fullsized":"2023-12-19T05:46:07.179009+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:55.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163371+0000","last_change":"2023-12-19T05:46:06.659564+0000","last_active":"2023-12-19T05:46:07.163371+0000","last_peered":"2023-12-19T05:46:07.163371+0000","last_clean":"2023-12-19T05:46:07.163371+0000","last_became_active":"2023-12-19T05:46:06.659303+0000","last_became_peered":"2023-12-19T05:46:06.659303+0000","last_unstale":"2023-12-19T05:46:07.163371+0000","last_undegraded":"2023-12-19T05:46:07.163371+0000","last_fullsized":"2023-12-19T05:46:07.163371+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:59.143370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178053+0000","last_change":"2023-12-19T05:46:07.177958+0000","last_active":"2023-12-19T05:46:07.178053+0000","last_peered":"2023-12-19T05:46:07.178053+0000","last_clean":"2023-12-19T05:46:07.178053+0000","last_became_active":"2023-12-19T05:46:07.177014+0000","last_became_peered":"2023-12-19T05:46:07.177014+0000","last_unstale":"2023-12-19T05:46:07.178053+0000","last_undegraded":"2023-12-19T05:46:07.178053+0000","last_fullsized":"2023-12-19T05:46:07.178053+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:18.926393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.156230+0000","last_change":"2023-12-19T05:46:06.664117+0000","last_active":"2023-12-19T05:46:07.156230+0000","last_peered":"2023-12-19T05:46:07.156230+0000","last_clean":"2023-12-19T05:46:07.156230+0000","last_became_active":"2023-12-19T05:46:06.663692+0000","last_became_peered":"2023-12-19T05:46:06.663692+0000","last_unstale":"2023-12-19T05:46:07.156230+0000","last_undegraded":"2023-12-19T05:46:07.156230+0000","last_fullsized":"2023-12-19T05:46:07.156230+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:24.263141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.158110+0000","last_change":"2023-12-19T05:46:07.157549+0000","last_active":"2023-12-19T05:46:07.158110+0000","last_peered":"2023-12-19T05:46:07.158110+0000","last_clean":"2023-12-19T05:46:07.158110+0000","last_became_active":"2023-12-19T05:46:07.157333+0000","last_became_peered":"2023-12-19T05:46:07.157333+0000","last_unstale":"2023-12-19T05:46:07.158110+0000","last_undegraded":"2023-12-19T05:46:07.158110+0000","last_fullsized":"2023-12-19T05:46:07.158110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:40:19.850610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.146191+0000","last_change":"2023-12-19T05:46:06.661568+0000","last_active":"2023-12-19T05:46:07.146191+0000","last_peered":"2023-12-19T05:46:07.146191+0000","last_clean":"2023-12-19T05:46:07.146191+0000","last_became_active":"2023-12-19T05:46:06.661176+0000","last_became_peered":"2023-12-19T05:46:06.661176+0000","last_unstale":"2023-12-19T05:46:07.146191+0000","last_undegraded":"2023-12-19T05:46:07.146191+0000","last_fullsized":"2023-12-19T05:46:07.146191+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:31.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.169420+0000","last_change":"2023-12-19T05:46:07.168732+0000","last_active":"2023-12-19T05:46:07.169420+0000","last_peered":"2023-12-19T05:46:07.169420+0000","last_clean":"2023-12-19T05:46:07.169420+0000","last_became_active":"2023-12-19T05:46:07.167288+0000","last_became_peered":"2023-12-19T05:46:07.167288+0000","last_unstale":"2023-12-19T05:46:07.169420+0000","last_undegraded":"2023-12-19T05:46:07.169420+0000","last_fullsized":"2023-12-19T05:46:07.169420+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:35.349961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168196+0000","last_change":"2023-12-19T05:46:06.660133+0000","last_active":"2023-12-19T05:46:07.168196+0000","last_peered":"2023-12-19T05:46:07.168196+0000","last_clean":"2023-12-19T05:46:07.168196+0000","last_became_active":"2023-12-19T05:46:06.659916+0000","last_became_peered":"2023-12-19T05:46:06.659916+0000","last_unstale":"2023-12-19T05:46:07.168196+0000","last_undegraded":"2023-12-19T05:46:07.168196+0000","last_fullsized":"2023-12-19T05:46:07.168196+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:30:33.022327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.176341+0000","last_change":"2023-12-19T05:46:07.176272+0000","last_active":"2023-12-19T05:46:07.176341+0000","last_peered":"2023-12-19T05:46:07.176341+0000","last_clean":"2023-12-19T05:46:07.176341+0000","last_became_active":"2023-12-19T05:46:07.176030+0000","last_became_peered":"2023-12-19T05:46:07.176030+0000","last_unstale":"2023-12-19T05:46:07.176341+0000","last_undegraded":"2023-12-19T05:46:07.176341+0000","last_fullsized":"2023-12-19T05:46:07.176341+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:10:45.583387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.147365+0000","last_change":"2023-12-19T05:46:06.664333+0000","last_active":"2023-12-19T05:46:07.147365+0000","last_peered":"2023-12-19T05:46:07.147365+0000","last_clean":"2023-12-19T05:46:07.147365+0000","last_became_active":"2023-12-19T05:46:06.662577+0000","last_became_peered":"2023-12-19T05:46:06.662577+0000","last_unstale":"2023-12-19T05:46:07.147365+0000","last_undegraded":"2023-12-19T05:46:07.147365+0000","last_fullsized":"2023-12-19T05:46:07.147365+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:47.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.167691+0000","last_change":"2023-12-19T05:46:07.167596+0000","last_active":"2023-12-19T05:46:07.167691+0000","last_peered":"2023-12-19T05:46:07.167691+0000","last_clean":"2023-12-19T05:46:07.167691+0000","last_became_active":"2023-12-19T05:46:07.167170+0000","last_became_peered":"2023-12-19T05:46:07.167170+0000","last_unstale":"2023-12-19T05:46:07.167691+0000","last_undegraded":"2023-12-19T05:46:07.167691+0000","last_fullsized":"2023-12-19T05:46:07.167691+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:37:08.279067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.160248+0000","last_change":"2023-12-19T05:46:06.665445+0000","last_active":"2023-12-19T05:46:07.160248+0000","last_peered":"2023-12-19T05:46:07.160248+0000","last_clean":"2023-12-19T05:46:07.160248+0000","last_became_active":"2023-12-19T05:46:06.665196+0000","last_became_peered":"2023-12-19T05:46:06.665196+0000","last_unstale":"2023-12-19T05:46:07.160248+0000","last_undegraded":"2023-12-19T05:46:07.160248+0000","last_fullsized":"2023-12-19T05:46:07.160248+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:42:15.412261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.163593+0000","last_change":"2023-12-19T05:46:07.162823+0000","last_active":"2023-12-19T05:46:07.163593+0000","last_peered":"2023-12-19T05:46:07.163593+0000","last_clean":"2023-12-19T05:46:07.163593+0000","last_became_active":"2023-12-19T05:46:07.162573+0000","last_became_peered":"2023-12-19T05:46:07.162573+0000","last_unstale":"2023-12-19T05:46:07.163593+0000","last_undegraded":"2023-12-19T05:46:07.163593+0000","last_fullsized":"2023-12-19T05:46:07.163593+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:48.317013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.168387+0000","last_change":"2023-12-19T05:46:06.661881+0000","last_active":"2023-12-19T05:46:07.168387+0000","last_peered":"2023-12-19T05:46:07.168387+0000","last_clean":"2023-12-19T05:46:07.168387+0000","last_became_active":"2023-12-19T05:46:06.661661+0000","last_became_peered":"2023-12-19T05:46:06.661661+0000","last_unstale":"2023-12-19T05:46:07.168387+0000","last_undegraded":"2023-12-19T05:46:07.168387+0000","last_fullsized":"2023-12-19T05:46:07.168387+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:24.403087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.178189+0000","last_change":"2023-12-19T05:46:07.178116+0000","last_active":"2023-12-19T05:46:07.178189+0000","last_peered":"2023-12-19T05:46:07.178189+0000","last_clean":"2023-12-19T05:46:07.178189+0000","last_became_active":"2023-12-19T05:46:07.177274+0000","last_became_peered":"2023-12-19T05:46:07.177274+0000","last_unstale":"2023-12-19T05:46:07.178189+0000","last_undegraded":"2023-12-19T05:46:07.178189+0000","last_fullsized":"2023-12-19T05:46:07.178189+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"127'1","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.177866+0000","last_change":"2023-12-19T05:46:06.662724+0000","last_active":"2023-12-19T05:46:07.177866+0000","last_peered":"2023-12-19T05:46:07.177866+0000","last_clean":"2023-12-19T05:46:07.177866+0000","last_became_active":"2023-12-19T05:46:06.662377+0000","last_became_peered":"2023-12-19T05:46:06.662377+0000","last_unstale":"2023-12-19T05:46:07.177866+0000","last_undegraded":"2023-12-19T05:46:07.177866+0000","last_fullsized":"2023-12-19T05:46:07.177866+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:25:43.132805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":262,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-12-19T05:46:06.650513+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:46:06.650513+0000","last_peered":"2023-12-19T05:46:06.650513+0000","last_clean":"2023-12-19T05:46:06.650513+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:46:06.650513+0000","last_undegraded":"2023-12-19T05:46:06.650513+0000","last_fullsized":"2023-12-19T05:46:06.650513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":674,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194638,"statfs":{"total":200000000,"available":199309618,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.1739999999999999,"15min":1.0669999999999999},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":6.4429999999999996,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1639999999999999,"15min":1.0800000000000001},"min":{"1min":0.79000000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6259999999999999,"5min":3.976,"15min":3.976},"last":0.84099999999999997}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.218,"15min":1.1040000000000001},"min":{"1min":0.73199999999999998,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.83999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1720000000000002,"5min":4.25,"15min":4.25},"last":0.95099999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.738,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.036},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.349,"15min":1.1990000000000001},"min":{"1min":1.0129999999999999,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.4139999999999999,"15min":1.335},"min":{"1min":1.0249999999999999,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":2.327,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.113}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.171,"15min":1.0680000000000001},"min":{"1min":0.85599999999999998,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.653,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.141},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.3480000000000001,"15min":1.274},"min":{"1min":0.81699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.091}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3740000000000001,"15min":1.3280000000000001},"min":{"1min":0.75900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.952,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.202},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3220000000000001,"15min":1.25},"min":{"1min":0.77800000000000002,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":2.0550000000000002,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.238}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4730000000000001,"15min":1.357},"min":{"1min":0.89800000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.121,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.78,"5min":1.569,"15min":1.4279999999999999},"min":{"1min":1.1579999999999999,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":6.3369999999999997,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.272}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0309999999999999,"15min":1.2150000000000001},"min":{"1min":0.70299999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.044,"5min":1.05,"15min":1.036},"min":{"1min":0.752,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67600000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.214,"15min":1.1539999999999999},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.631,"5min":1.792,"15min":1.792},"last":1.361},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.214,"15min":1.3080000000000001},"min":{"1min":0.88600000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8120000000000001,"5min":1.851,"15min":3.4670000000000001},"last":1.3109999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1519999999999999,"15min":1.1859999999999999},"min":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.823,"5min":2,"15min":2},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.198,"15min":1.296},"min":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5980000000000001,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.054}]},{"osd":3,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.163,"15min":1.339},"min":{"1min":0.84999999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7050000000000001,"5min":1.857,"15min":4.5220000000000002},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.3620000000000001},"min":{"1min":0.89500000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0059999999999998,"5min":2.1579999999999999,"15min":4.452},"last":1.2450000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.206,"15min":1.3220000000000001},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7470000000000001,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.208,"15min":1.425},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.6930000000000001,"5min":2.7240000000000002,"15min":4.6689999999999996},"last":1.196}]},{"osd":5,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.369,"15min":1.5529999999999999},"min":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.726,"5min":2.5070000000000001,"15min":4.5670000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4430000000000001,"15min":1.706},"min":{"1min":0.871,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8700000000000001,"5min":2.21,"15min":3.681},"last":1.5069999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:45:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3779999999999999,"15min":1.51},"min":{"1min":0.73699999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.917,"5min":1.972,"15min":3.2719999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.534,"15min":1.6080000000000001},"min":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9099999999999999,"5min":2.4609999999999999,"15min":4.7480000000000002},"last":1.5369999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1265,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194047,"statfs":{"total":200000000,"available":198704580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1890000000000001,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9620000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":1.268},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1559999999999999,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.641},"last":1.099}]},{"osd":1,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2350000000000001,"15min":1.242},"min":{"1min":0.71599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3600000000000001,"15min":1.3680000000000001},"min":{"1min":0.80700000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":1.0249999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.69299999999999995},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.516},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.202,"15min":1.2210000000000001},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.2130000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.363,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.774,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3440000000000001,"15min":1.419},"min":{"1min":0.84899999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.4390000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.2889999999999999,"15min":1.454},"min":{"1min":0.94999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.2040000000000002,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.389,"15min":1.5580000000000001},"min":{"1min":0.877,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.0499999999999998,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":0.91400000000000003}]},{"osd":6,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.411,"15min":1.496},"min":{"1min":0.96299999999999997,"5min":0.68700000000000006,"15min":0.59099999999999997},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.405,"15min":1.6180000000000001},"min":{"1min":1.1739999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.0629999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5609999999999999,"15min":1.6899999999999999},"min":{"1min":0.94599999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":3.2639999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.5880000000000001,"15min":1.619},"min":{"1min":1.1559999999999999,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.5620000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.05,"15min":1.018},"min":{"1min":0.60799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.6060000000000001},"last":1},{"interface":"front","average":{"1min":1.179,"5min":1.1259999999999999,"15min":1.0740000000000001},"min":{"1min":0.80600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.6240000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.204,"15min":1.077},"min":{"1min":0.81100000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6659999999999999,"5min":1.954,"15min":1.954},"last":1.3660000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.216,"15min":1.2030000000000001},"min":{"1min":0.75700000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.704,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7809999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2390000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.216,"15min":1.099},"min":{"1min":0.78400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.3520000000000001,"15min":1.2989999999999999},"min":{"1min":0.89700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8400000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.327}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.3740000000000001,"15min":1.351},"min":{"1min":0.78900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.444},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4099999999999999,"15min":1.3080000000000001},"min":{"1min":0.66500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.2869999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.421,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.411},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4530000000000001,"15min":1.409},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9930000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.502}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.3740000000000001},"min":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.179},{"interface":"front","average":{"1min":1.589,"5min":1.5349999999999999,"15min":1.4750000000000001},"min":{"1min":0.871,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.544}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.872,"15min":0.82899999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3380000000000001,"5min":1.99,"15min":1.99},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3939999999999999,"5min":1.72,"15min":1.72},"last":0.93000000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.556,"5min":1.6060000000000001,"15min":2.702},"last":1.262},{"interface":"front","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.502,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.72999999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.0920000000000001,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.2090000000000001,"15min":1.0960000000000001},"min":{"1min":0.58599999999999997,"5min":0.46600000000000003,"15min":0.45600000000000002},"max":{"1min":1.7310000000000001,"5min":2.931,"15min":2.931},"last":1.5389999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1759999999999999,"15min":1.1579999999999999},"min":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.304,"15min":1.294},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.6559999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3759999999999999,"15min":1.3300000000000001},"min":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.391,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.399,"15min":1.357},"min":{"1min":0.85399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5449999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.702}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.431,"15min":1.3740000000000001},"min":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":2.427,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.821},{"interface":"front","average":{"1min":1.333,"5min":1.337,"15min":1.327},"min":{"1min":0.74199999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8480000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.589}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.389},"min":{"1min":0.85499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0550000000000002,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.4330000000000001,"15min":1.427},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.901}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.85499999999999998,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.47499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3109999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.2929999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.137,"15min":1.0600000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2609999999999999,"15min":1.167},"min":{"1min":0.65500000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.105}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98999999999999999,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.339,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":1.149},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.21,"15min":1.1020000000000001},"min":{"1min":0.65800000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.714,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2110000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.373,"15min":1.28},"min":{"1min":0.90100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.982,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.333,"15min":1.2470000000000001},"min":{"1min":0.89500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.736,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4470000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3859999999999999,"15min":1.2969999999999999},"min":{"1min":0.93300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.853,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.577},{"interface":"front","average":{"1min":1.304,"5min":1.3320000000000001,"15min":1.2969999999999999},"min":{"1min":0.90400000000000003,"5min":0.81499999999999995,"15min":0.72699999999999998},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3440000000000001,"15min":1.294},"min":{"1min":0.87,"5min":0.87,"15min":0.83599999999999997},"max":{"1min":1.704,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.25},{"interface":"front","average":{"1min":1.508,"5min":1.4670000000000001,"15min":1.3480000000000001},"min":{"1min":1.0589999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0430000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4770000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5089999999999999,"15min":1.4239999999999999},"min":{"1min":1.1200000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":1.78,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":2.0049999999999999},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.5369999999999999,"15min":1.4430000000000001},"min":{"1min":0.94899999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":9.5359999999999996,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.3819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1265,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194047,"statfs":{"total":200000000,"available":198704524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.89600000000000002,"15min":0.93400000000000005},"min":{"1min":0.375,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.1110000000000002,"15min":2.992},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.0369999999999999,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6799999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.995}]},{"osd":2,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92800000000000005,"15min":0.96499999999999997},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.577,"5min":1.742,"15min":2.2789999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.8580000000000001,"15min":1.3420000000000001},"min":{"1min":0.56000000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.63700000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.71399999999999997,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":2.0059999999999998,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.268,"15min":1.244},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":2.3580000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.073}]},{"osd":4,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.3480000000000001,"15min":1.228},"min":{"1min":0.86699999999999999,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":2.3969999999999998,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.643,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":0.85699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5960000000000001,"5min":4.306,"15min":4.306},"last":1.2010000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.4319999999999999,"15min":1.3640000000000001},"min":{"1min":0.88,"5min":0.82499999999999996,"15min":0.68400000000000005},"max":{"1min":2.5550000000000002,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.4490000000000001,"15min":1.3700000000000001},"min":{"1min":0.81899999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.464,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.5009999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.5309999999999999,"15min":1.4399999999999999},"min":{"1min":1.0409999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.8860000000000001,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.617,"5min":1.494,"15min":1.4319999999999999},"min":{"1min":0.93500000000000005,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.6899999999999999,"5min":3.75,"15min":3.75},"last":1.573}]},{"osd":7,"last update":"Tue Dec 19 05:45:04 2023","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6299999999999999,"15min":1.542},"min":{"1min":0.999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.5059999999999998,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.8859999999999999,"5min":1.6719999999999999,"15min":1.617},"min":{"1min":1.1559999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.7290000000000001,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.3009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.80200000000000005},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.89400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.306,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.105,"15min":1.0649999999999999},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6719999999999999,"5min":1.825,"15min":1.825},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.087,"5min":1.165,"15min":1.147},"min":{"1min":0.52800000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5109999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.88800000000000001},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.48199999999999998},"max":{"1min":1.304,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.155,"15min":1.0760000000000001},"min":{"1min":0.61399999999999999,"5min":0.53900000000000003,"15min":0.45900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.23,"15min":1.169},"min":{"1min":0.75700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7589999999999999,"5min":1.845,"15min":1.845},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3680000000000001,"15min":1.278},"min":{"1min":1.0069999999999999,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.3779999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3799999999999999,"15min":1.323},"min":{"1min":0.93200000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.885,"5min":2.173,"15min":2.173},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.292},"min":{"1min":0.90300000000000002,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8340000000000001,"5min":1.879,"15min":1.879},"last":1.6160000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4470000000000001,"15min":1.399},"min":{"1min":0.92300000000000004,"5min":0.85299999999999998,"15min":0.76300000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.365,"15min":1.2889999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8089999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.3919999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.484,"15min":1.427},"min":{"1min":1.022,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.964,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.446,"15min":1.3819999999999999},"min":{"1min":0.82999999999999996,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":1.8500000000000001,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.5369999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T05:46:12.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:46:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.455+0000 7f838359e640 1 Processor -- start 2023-12-19T05:46:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.455+0000 7f838359e640 1 -- start start 2023-12-19T05:46:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f83840b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f83840b2460 0x7f83840ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83840acdf0 0x7f8384160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840ad280 con 0x7f83840acdf0 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840b2fa0 con 0x7f83840b2460 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.457+0000 7f838359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838406f600 con 0x7f838415e3f0 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83840acdf0 0x7f8384160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83840acdf0 0x7f8384160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53388/0 (socket says 172.21.15.49:53388) 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 -- 172.21.15.49:0/1203913352 learned_addr learned my addr 172.21.15.49:0/1203913352 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f838259c640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f83840b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8381d9b640 1 --2- 172.21.15.49:0/1203913352 >> v2:172.21.15.115:3300/0 conn(0x7f83840b2460 0x7f83840ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 -- 172.21.15.49:0/1203913352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 msgr2=0x7f83840b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f83840b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 -- 172.21.15.49:0/1203913352 >> v2:172.21.15.115:3300/0 conn(0x7f83840b2460 msgr2=0x7f83840ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 --2- 172.21.15.49:0/1203913352 >> v2:172.21.15.115:3300/0 conn(0x7f83840b2460 0x7f83840ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.458+0000 7f8382d9d640 1 -- 172.21.15.49:0/1203913352 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838415e7d0 con 0x7f83840acdf0 2023-12-19T05:46:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.459+0000 7f8382d9d640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840acdf0 0x7f8384160e10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f83840cff10 tx=0x7f837c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa02717864c831e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838159a640 1 -- 172.21.15.49:0/1203913352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c02c9e0 con 0x7f83840acdf0 2023-12-19T05:46:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838159a640 1 -- 172.21.15.49:0/1203913352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c02cb40 con 0x7f83840acdf0 2023-12-19T05:46:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838159a640 1 -- 172.21.15.49:0/1203913352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0343f0 con 0x7f83840acdf0 2023-12-19T05:46:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 -- 172.21.15.49:0/1203913352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840acdf0 msgr2=0x7f8384160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840acdf0 0x7f8384160e10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f83840cff10 tx=0x7f837c02be40 comp rx=0 tx=0).stop 2023-12-19T05:46:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 -- 172.21.15.49:0/1203913352 shutdown_connections 2023-12-19T05:46:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840acdf0 0x7f8384160e10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 --2- 172.21.15.49:0/1203913352 >> v2:172.21.15.115:3300/0 conn(0x7f83840b2460 0x7f83840ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 --2- 172.21.15.49:0/1203913352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f83840b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.460+0000 7f838359e640 1 -- 172.21.15.49:0/1203913352 >> 172.21.15.49:0/1203913352 conn(0x7f83840b0100 msgr2=0x7f83840b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.461+0000 7f838359e640 1 -- 172.21.15.49:0/1203913352 shutdown_connections 2023-12-19T05:46:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.461+0000 7f838359e640 1 -- 172.21.15.49:0/1203913352 wait complete. 2023-12-19T05:46:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.462+0000 7f838359e640 1 Processor -- start 2023-12-19T05:46:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.463+0000 7f838359e640 1 -- start start 2023-12-19T05:46:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83840acdf0 0x7f8384149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f838406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838406cab0 con 0x7f83840b2460 2023-12-19T05:46:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8384158580 con 0x7f83840acdf0 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384158860 con 0x7f838415e3f0 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53392/0 (socket says 172.21.15.49:53392) 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 -- 172.21.15.49:0/3600920408 learned_addr learned my addr 172.21.15.49:0/3600920408 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f838259c640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83840acdf0 0x7f8384149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 -- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 msgr2=0x7f838406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f838406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 -- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83840acdf0 msgr2=0x7f8384149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83840acdf0 0x7f8384149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.464+0000 7f8381d9b640 1 -- 172.21.15.49:0/3600920408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009b30 con 0x7f83840b2460 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f8381d9b640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f837800d800 tx=0x7f837800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780096a0 con 0x7f83840b2460 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378009800 con 0x7f83840b2460 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378009990 con 0x7f83840b2460 2023-12-19T05:46:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8384158b40 con 0x7f83840b2460 2023-12-19T05:46:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.465+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8384149f70 con 0x7f83840b2460 2023-12-19T05:46:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.466+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838415d8c0 con 0x7f83840b2460 2023-12-19T05:46:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.467+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8378009af0 con 0x7f83840b2460 2023-12-19T05:46:12.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.468+0000 7f8372ffd640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:12.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.468+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8378088d90 con 0x7f83840b2460 2023-12-19T05:46:12.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.469+0000 7f838259c640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:12.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.470+0000 7f838259c640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 0x7f836406c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8374006fd0 tx=0x7f8374008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.473+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8378054370 con 0x7f83840b2460 2023-12-19T05:46:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.666+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83840b2cc0 con 0x7f836406a430 2023-12-19T05:46:12.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.689+0000 7f8372ffd640 1 -- 172.21.15.49:0/3600920408 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283259 (secure 0 0 0) 0x7f837400f860 con 0x7f836406a430 2023-12-19T05:46:12.696 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 msgr2=0x7f836406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 0x7f836406c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8374006fd0 tx=0x7f8374008040 comp rx=0 tx=0).stop 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 msgr2=0x7f838406c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f837800d800 tx=0x7f837800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 shutdown_connections 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f838415e3f0 0x7f838406cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83840b2460 0x7f838406c170 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 --2- 172.21.15.49:0/3600920408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83840acdf0 0x7f8384149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.694+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 >> 172.21.15.49:0/3600920408 conn(0x7f83840b0100 msgr2=0x7f838415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.695+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 shutdown_connections 2023-12-19T05:46:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:12.695+0000 7f838359e640 1 -- 172.21.15.49:0/3600920408 wait complete. 2023-12-19T05:46:12.717 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2023-12-19T05:46:12.651987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6702,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555797,"statfs":{"total":1600000000,"available":1593136684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.015979"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579131+0000","last_change":"2023-12-19T05:46:07.172466+0000","last_active":"2023-12-19T05:46:07.579131+0000","last_peered":"2023-12-19T05:46:07.579131+0000","last_clean":"2023-12-19T05:46:07.579131+0000","last_became_active":"2023-12-19T05:46:07.169337+0000","last_became_peered":"2023-12-19T05:46:07.169337+0000","last_unstale":"2023-12-19T05:46:07.579131+0000","last_undegraded":"2023-12-19T05:46:07.579131+0000","last_fullsized":"2023-12-19T05:46:07.579131+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579023+0000","last_change":"2023-12-19T05:46:07.168342+0000","last_active":"2023-12-19T05:46:07.579023+0000","last_peered":"2023-12-19T05:46:07.579023+0000","last_clean":"2023-12-19T05:46:07.579023+0000","last_became_active":"2023-12-19T05:46:07.167468+0000","last_became_peered":"2023-12-19T05:46:07.167468+0000","last_unstale":"2023-12-19T05:46:07.579023+0000","last_undegraded":"2023-12-19T05:46:07.579023+0000","last_fullsized":"2023-12-19T05:46:07.579023+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:00.152986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576052+0000","last_change":"2023-12-19T05:46:07.179835+0000","last_active":"2023-12-19T05:46:07.576052+0000","last_peered":"2023-12-19T05:46:07.576052+0000","last_clean":"2023-12-19T05:46:07.576052+0000","last_became_active":"2023-12-19T05:46:07.175493+0000","last_became_peered":"2023-12-19T05:46:07.175493+0000","last_unstale":"2023-12-19T05:46:07.576052+0000","last_undegraded":"2023-12-19T05:46:07.576052+0000","last_fullsized":"2023-12-19T05:46:07.576052+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:53.958505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578873+0000","last_change":"2023-12-19T05:46:07.181453+0000","last_active":"2023-12-19T05:46:07.578873+0000","last_peered":"2023-12-19T05:46:07.578873+0000","last_clean":"2023-12-19T05:46:07.578873+0000","last_became_active":"2023-12-19T05:46:07.181103+0000","last_became_peered":"2023-12-19T05:46:07.181103+0000","last_unstale":"2023-12-19T05:46:07.578873+0000","last_undegraded":"2023-12-19T05:46:07.578873+0000","last_fullsized":"2023-12-19T05:46:07.578873+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:43:43.319597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560794+0000","last_change":"2023-12-19T05:46:07.164404+0000","last_active":"2023-12-19T05:46:07.560794+0000","last_peered":"2023-12-19T05:46:07.560794+0000","last_clean":"2023-12-19T05:46:07.560794+0000","last_became_active":"2023-12-19T05:46:07.164186+0000","last_became_peered":"2023-12-19T05:46:07.164186+0000","last_unstale":"2023-12-19T05:46:07.560794+0000","last_undegraded":"2023-12-19T05:46:07.560794+0000","last_fullsized":"2023-12-19T05:46:07.560794+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:12.890497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560709+0000","last_change":"2023-12-19T05:46:07.154748+0000","last_active":"2023-12-19T05:46:07.560709+0000","last_peered":"2023-12-19T05:46:07.560709+0000","last_clean":"2023-12-19T05:46:07.560709+0000","last_became_active":"2023-12-19T05:46:07.154246+0000","last_became_peered":"2023-12-19T05:46:07.154246+0000","last_unstale":"2023-12-19T05:46:07.560709+0000","last_undegraded":"2023-12-19T05:46:07.560709+0000","last_fullsized":"2023-12-19T05:46:07.560709+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:12.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560692+0000","last_change":"2023-12-19T05:46:07.157440+0000","last_active":"2023-12-19T05:46:07.560692+0000","last_peered":"2023-12-19T05:46:07.560692+0000","last_clean":"2023-12-19T05:46:07.560692+0000","last_became_active":"2023-12-19T05:46:07.157204+0000","last_became_peered":"2023-12-19T05:46:07.157204+0000","last_unstale":"2023-12-19T05:46:07.560692+0000","last_undegraded":"2023-12-19T05:46:07.560692+0000","last_fullsized":"2023-12-19T05:46:07.560692+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:24.013658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576080+0000","last_change":"2023-12-19T05:46:07.175726+0000","last_active":"2023-12-19T05:46:07.576080+0000","last_peered":"2023-12-19T05:46:07.576080+0000","last_clean":"2023-12-19T05:46:07.576080+0000","last_became_active":"2023-12-19T05:46:07.174963+0000","last_became_peered":"2023-12-19T05:46:07.174963+0000","last_unstale":"2023-12-19T05:46:07.576080+0000","last_undegraded":"2023-12-19T05:46:07.576080+0000","last_fullsized":"2023-12-19T05:46:07.576080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560545+0000","last_change":"2023-12-19T05:46:07.175898+0000","last_active":"2023-12-19T05:46:07.560545+0000","last_peered":"2023-12-19T05:46:07.560545+0000","last_clean":"2023-12-19T05:46:07.560545+0000","last_became_active":"2023-12-19T05:46:07.175609+0000","last_became_peered":"2023-12-19T05:46:07.175609+0000","last_unstale":"2023-12-19T05:46:07.560545+0000","last_undegraded":"2023-12-19T05:46:07.560545+0000","last_fullsized":"2023-12-19T05:46:07.560545+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:53.511044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.577190+0000","last_change":"2023-12-19T05:46:07.168857+0000","last_active":"2023-12-19T05:46:07.577190+0000","last_peered":"2023-12-19T05:46:07.577190+0000","last_clean":"2023-12-19T05:46:07.577190+0000","last_became_active":"2023-12-19T05:46:07.168580+0000","last_became_peered":"2023-12-19T05:46:07.168580+0000","last_unstale":"2023-12-19T05:46:07.577190+0000","last_undegraded":"2023-12-19T05:46:07.577190+0000","last_fullsized":"2023-12-19T05:46:07.577190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:15.617682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560725+0000","last_change":"2023-12-19T05:46:07.154889+0000","last_active":"2023-12-19T05:46:07.560725+0000","last_peered":"2023-12-19T05:46:07.560725+0000","last_clean":"2023-12-19T05:46:07.560725+0000","last_became_active":"2023-12-19T05:46:07.154537+0000","last_became_peered":"2023-12-19T05:46:07.154537+0000","last_unstale":"2023-12-19T05:46:07.560725+0000","last_undegraded":"2023-12-19T05:46:07.560725+0000","last_fullsized":"2023-12-19T05:46:07.560725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:01.042566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570385+0000","last_change":"2023-12-19T05:46:07.168994+0000","last_active":"2023-12-19T05:46:07.570385+0000","last_peered":"2023-12-19T05:46:07.570385+0000","last_clean":"2023-12-19T05:46:07.570385+0000","last_became_active":"2023-12-19T05:46:07.168708+0000","last_became_peered":"2023-12-19T05:46:07.168708+0000","last_unstale":"2023-12-19T05:46:07.570385+0000","last_undegraded":"2023-12-19T05:46:07.570385+0000","last_fullsized":"2023-12-19T05:46:07.570385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.926918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578267+0000","last_change":"2023-12-19T05:46:07.162486+0000","last_active":"2023-12-19T05:46:07.578267+0000","last_peered":"2023-12-19T05:46:07.578267+0000","last_clean":"2023-12-19T05:46:07.578267+0000","last_became_active":"2023-12-19T05:46:07.161948+0000","last_became_peered":"2023-12-19T05:46:07.161948+0000","last_unstale":"2023-12-19T05:46:07.578267+0000","last_undegraded":"2023-12-19T05:46:07.578267+0000","last_fullsized":"2023-12-19T05:46:07.578267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:55:28.882125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578906+0000","last_change":"2023-12-19T05:46:07.172629+0000","last_active":"2023-12-19T05:46:07.578906+0000","last_peered":"2023-12-19T05:46:07.578906+0000","last_clean":"2023-12-19T05:46:07.578906+0000","last_became_active":"2023-12-19T05:46:07.171944+0000","last_became_peered":"2023-12-19T05:46:07.171944+0000","last_unstale":"2023-12-19T05:46:07.578906+0000","last_undegraded":"2023-12-19T05:46:07.578906+0000","last_fullsized":"2023-12-19T05:46:07.578906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:54.078482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579264+0000","last_change":"2023-12-19T05:46:07.181104+0000","last_active":"2023-12-19T05:46:07.579264+0000","last_peered":"2023-12-19T05:46:07.579264+0000","last_clean":"2023-12-19T05:46:07.579264+0000","last_became_active":"2023-12-19T05:46:07.180745+0000","last_became_peered":"2023-12-19T05:46:07.180745+0000","last_unstale":"2023-12-19T05:46:07.579264+0000","last_undegraded":"2023-12-19T05:46:07.579264+0000","last_fullsized":"2023-12-19T05:46:07.579264+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:41.445878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560742+0000","last_change":"2023-12-19T05:46:07.163267+0000","last_active":"2023-12-19T05:46:07.560742+0000","last_peered":"2023-12-19T05:46:07.560742+0000","last_clean":"2023-12-19T05:46:07.560742+0000","last_became_active":"2023-12-19T05:46:07.163071+0000","last_became_peered":"2023-12-19T05:46:07.163071+0000","last_unstale":"2023-12-19T05:46:07.560742+0000","last_undegraded":"2023-12-19T05:46:07.560742+0000","last_fullsized":"2023-12-19T05:46:07.560742+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:49.981680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576630+0000","last_change":"2023-12-19T05:46:07.174382+0000","last_active":"2023-12-19T05:46:07.576630+0000","last_peered":"2023-12-19T05:46:07.576630+0000","last_clean":"2023-12-19T05:46:07.576630+0000","last_became_active":"2023-12-19T05:46:07.170827+0000","last_became_peered":"2023-12-19T05:46:07.170827+0000","last_unstale":"2023-12-19T05:46:07.576630+0000","last_undegraded":"2023-12-19T05:46:07.576630+0000","last_fullsized":"2023-12-19T05:46:07.576630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:43:46.138174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578929+0000","last_change":"2023-12-19T05:46:07.181981+0000","last_active":"2023-12-19T05:46:07.578929+0000","last_peered":"2023-12-19T05:46:07.578929+0000","last_clean":"2023-12-19T05:46:07.578929+0000","last_became_active":"2023-12-19T05:46:07.179840+0000","last_became_peered":"2023-12-19T05:46:07.179840+0000","last_unstale":"2023-12-19T05:46:07.578929+0000","last_undegraded":"2023-12-19T05:46:07.578929+0000","last_fullsized":"2023-12-19T05:46:07.578929+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:18.926393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576295+0000","last_change":"2023-12-19T05:46:07.181276+0000","last_active":"2023-12-19T05:46:07.576295+0000","last_peered":"2023-12-19T05:46:07.576295+0000","last_clean":"2023-12-19T05:46:07.576295+0000","last_became_active":"2023-12-19T05:46:07.178449+0000","last_became_peered":"2023-12-19T05:46:07.178449+0000","last_unstale":"2023-12-19T05:46:07.576295+0000","last_undegraded":"2023-12-19T05:46:07.576295+0000","last_fullsized":"2023-12-19T05:46:07.576295+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:12.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570473+0000","last_change":"2023-12-19T05:46:07.164635+0000","last_active":"2023-12-19T05:46:07.570473+0000","last_peered":"2023-12-19T05:46:07.570473+0000","last_clean":"2023-12-19T05:46:07.570473+0000","last_became_active":"2023-12-19T05:46:07.164406+0000","last_became_peered":"2023-12-19T05:46:07.164406+0000","last_unstale":"2023-12-19T05:46:07.570473+0000","last_undegraded":"2023-12-19T05:46:07.570473+0000","last_fullsized":"2023-12-19T05:46:07.570473+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:46:00.172606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576172+0000","last_change":"2023-12-19T05:46:07.174699+0000","last_active":"2023-12-19T05:46:07.576172+0000","last_peered":"2023-12-19T05:46:07.576172+0000","last_clean":"2023-12-19T05:46:07.576172+0000","last_became_active":"2023-12-19T05:46:07.174325+0000","last_became_peered":"2023-12-19T05:46:07.174325+0000","last_unstale":"2023-12-19T05:46:07.576172+0000","last_undegraded":"2023-12-19T05:46:07.576172+0000","last_fullsized":"2023-12-19T05:46:07.576172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:18.361541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576152+0000","last_change":"2023-12-19T05:46:07.164636+0000","last_active":"2023-12-19T05:46:07.576152+0000","last_peered":"2023-12-19T05:46:07.576152+0000","last_clean":"2023-12-19T05:46:07.576152+0000","last_became_active":"2023-12-19T05:46:07.164175+0000","last_became_peered":"2023-12-19T05:46:07.164175+0000","last_unstale":"2023-12-19T05:46:07.576152+0000","last_undegraded":"2023-12-19T05:46:07.576152+0000","last_fullsized":"2023-12-19T05:46:07.576152+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578954+0000","last_change":"2023-12-19T05:46:07.175252+0000","last_active":"2023-12-19T05:46:07.578954+0000","last_peered":"2023-12-19T05:46:07.578954+0000","last_clean":"2023-12-19T05:46:07.578954+0000","last_became_active":"2023-12-19T05:46:07.174476+0000","last_became_peered":"2023-12-19T05:46:07.174476+0000","last_unstale":"2023-12-19T05:46:07.578954+0000","last_undegraded":"2023-12-19T05:46:07.578954+0000","last_fullsized":"2023-12-19T05:46:07.578954+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:10.735495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574250+0000","last_change":"2023-12-19T05:46:07.160006+0000","last_active":"2023-12-19T05:46:07.574250+0000","last_peered":"2023-12-19T05:46:07.574250+0000","last_clean":"2023-12-19T05:46:07.574250+0000","last_became_active":"2023-12-19T05:46:07.159721+0000","last_became_peered":"2023-12-19T05:46:07.159721+0000","last_unstale":"2023-12-19T05:46:07.574250+0000","last_undegraded":"2023-12-19T05:46:07.574250+0000","last_fullsized":"2023-12-19T05:46:07.574250+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:33:54.078482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.577160+0000","last_change":"2023-12-19T05:46:07.176792+0000","last_active":"2023-12-19T05:46:07.577160+0000","last_peered":"2023-12-19T05:46:07.577160+0000","last_clean":"2023-12-19T05:46:07.577160+0000","last_became_active":"2023-12-19T05:46:07.175937+0000","last_became_peered":"2023-12-19T05:46:07.175937+0000","last_unstale":"2023-12-19T05:46:07.577160+0000","last_undegraded":"2023-12-19T05:46:07.577160+0000","last_fullsized":"2023-12-19T05:46:07.577160+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:39.555982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578361+0000","last_change":"2023-12-19T05:46:07.168111+0000","last_active":"2023-12-19T05:46:07.578361+0000","last_peered":"2023-12-19T05:46:07.578361+0000","last_clean":"2023-12-19T05:46:07.578361+0000","last_became_active":"2023-12-19T05:46:07.164202+0000","last_became_peered":"2023-12-19T05:46:07.164202+0000","last_unstale":"2023-12-19T05:46:07.578361+0000","last_undegraded":"2023-12-19T05:46:07.578361+0000","last_fullsized":"2023-12-19T05:46:07.578361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:44:39.413695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574368+0000","last_change":"2023-12-19T05:46:07.163433+0000","last_active":"2023-12-19T05:46:07.574368+0000","last_peered":"2023-12-19T05:46:07.574368+0000","last_clean":"2023-12-19T05:46:07.574368+0000","last_became_active":"2023-12-19T05:46:07.162720+0000","last_became_peered":"2023-12-19T05:46:07.162720+0000","last_unstale":"2023-12-19T05:46:07.574368+0000","last_undegraded":"2023-12-19T05:46:07.574368+0000","last_fullsized":"2023-12-19T05:46:07.574368+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574326+0000","last_change":"2023-12-19T05:46:07.176725+0000","last_active":"2023-12-19T05:46:07.574326+0000","last_peered":"2023-12-19T05:46:07.574326+0000","last_clean":"2023-12-19T05:46:07.574326+0000","last_became_active":"2023-12-19T05:46:07.176455+0000","last_became_peered":"2023-12-19T05:46:07.176455+0000","last_unstale":"2023-12-19T05:46:07.574326+0000","last_undegraded":"2023-12-19T05:46:07.574326+0000","last_fullsized":"2023-12-19T05:46:07.574326+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:10.735495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578236+0000","last_change":"2023-12-19T05:46:07.172156+0000","last_active":"2023-12-19T05:46:07.578236+0000","last_peered":"2023-12-19T05:46:07.578236+0000","last_clean":"2023-12-19T05:46:07.578236+0000","last_became_active":"2023-12-19T05:46:07.170020+0000","last_became_peered":"2023-12-19T05:46:07.170020+0000","last_unstale":"2023-12-19T05:46:07.578236+0000","last_undegraded":"2023-12-19T05:46:07.578236+0000","last_fullsized":"2023-12-19T05:46:07.578236+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:57:54.800144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578382+0000","last_change":"2023-12-19T05:46:07.173912+0000","last_active":"2023-12-19T05:46:07.578382+0000","last_peered":"2023-12-19T05:46:07.578382+0000","last_clean":"2023-12-19T05:46:07.578382+0000","last_became_active":"2023-12-19T05:46:07.173629+0000","last_became_peered":"2023-12-19T05:46:07.173629+0000","last_unstale":"2023-12-19T05:46:07.578382+0000","last_undegraded":"2023-12-19T05:46:07.578382+0000","last_fullsized":"2023-12-19T05:46:07.578382+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:03.397333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576193+0000","last_change":"2023-12-19T05:46:07.174545+0000","last_active":"2023-12-19T05:46:07.576193+0000","last_peered":"2023-12-19T05:46:07.576193+0000","last_clean":"2023-12-19T05:46:07.576193+0000","last_became_active":"2023-12-19T05:46:07.174027+0000","last_became_peered":"2023-12-19T05:46:07.174027+0000","last_unstale":"2023-12-19T05:46:07.576193+0000","last_undegraded":"2023-12-19T05:46:07.576193+0000","last_fullsized":"2023-12-19T05:46:07.576193+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:43:43.319597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579064+0000","last_change":"2023-12-19T05:46:07.176637+0000","last_active":"2023-12-19T05:46:07.579064+0000","last_peered":"2023-12-19T05:46:07.579064+0000","last_clean":"2023-12-19T05:46:07.579064+0000","last_became_active":"2023-12-19T05:46:07.176368+0000","last_became_peered":"2023-12-19T05:46:07.176368+0000","last_unstale":"2023-12-19T05:46:07.579064+0000","last_undegraded":"2023-12-19T05:46:07.579064+0000","last_fullsized":"2023-12-19T05:46:07.579064+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:00:29.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576341+0000","last_change":"2023-12-19T05:46:07.178683+0000","last_active":"2023-12-19T05:46:07.576341+0000","last_peered":"2023-12-19T05:46:07.576341+0000","last_clean":"2023-12-19T05:46:07.576341+0000","last_became_active":"2023-12-19T05:46:07.177834+0000","last_became_peered":"2023-12-19T05:46:07.177834+0000","last_unstale":"2023-12-19T05:46:07.576341+0000","last_undegraded":"2023-12-19T05:46:07.576341+0000","last_fullsized":"2023-12-19T05:46:07.576341+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:25:15.804317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"127'4","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578314+0000","last_change":"2023-12-19T05:46:06.663344+0000","last_active":"2023-12-19T05:46:07.578314+0000","last_peered":"2023-12-19T05:46:07.578314+0000","last_clean":"2023-12-19T05:46:07.578314+0000","last_became_active":"2023-12-19T05:46:06.663047+0000","last_became_peered":"2023-12-19T05:46:06.663047+0000","last_unstale":"2023-12-19T05:46:07.578314+0000","last_undegraded":"2023-12-19T05:46:07.578314+0000","last_fullsized":"2023-12-19T05:46:07.578314+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:01.558690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578290+0000","last_change":"2023-12-19T05:46:07.172844+0000","last_active":"2023-12-19T05:46:07.578290+0000","last_peered":"2023-12-19T05:46:07.578290+0000","last_clean":"2023-12-19T05:46:07.578290+0000","last_became_active":"2023-12-19T05:46:07.171852+0000","last_became_peered":"2023-12-19T05:46:07.171852+0000","last_unstale":"2023-12-19T05:46:07.578290+0000","last_undegraded":"2023-12-19T05:46:07.578290+0000","last_fullsized":"2023-12-19T05:46:07.578290+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:34:26.666663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"127'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560588+0000","last_change":"2023-12-19T05:46:06.653122+0000","last_active":"2023-12-19T05:46:07.560588+0000","last_peered":"2023-12-19T05:46:07.560588+0000","last_clean":"2023-12-19T05:46:07.560588+0000","last_became_active":"2023-12-19T05:46:06.651538+0000","last_became_peered":"2023-12-19T05:46:06.651538+0000","last_unstale":"2023-12-19T05:46:07.560588+0000","last_undegraded":"2023-12-19T05:46:07.560588+0000","last_fullsized":"2023-12-19T05:46:07.560588+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:23.478843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579153+0000","last_change":"2023-12-19T05:46:07.171361+0000","last_active":"2023-12-19T05:46:07.579153+0000","last_peered":"2023-12-19T05:46:07.579153+0000","last_clean":"2023-12-19T05:46:07.579153+0000","last_became_active":"2023-12-19T05:46:07.168208+0000","last_became_peered":"2023-12-19T05:46:07.168208+0000","last_unstale":"2023-12-19T05:46:07.579153+0000","last_undegraded":"2023-12-19T05:46:07.579153+0000","last_fullsized":"2023-12-19T05:46:07.579153+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:05.225514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576482+0000","last_change":"2023-12-19T05:46:06.662587+0000","last_active":"2023-12-19T05:46:07.576482+0000","last_peered":"2023-12-19T05:46:07.576482+0000","last_clean":"2023-12-19T05:46:07.576482+0000","last_became_active":"2023-12-19T05:46:06.661344+0000","last_became_peered":"2023-12-19T05:46:06.661344+0000","last_unstale":"2023-12-19T05:46:07.576482+0000","last_undegraded":"2023-12-19T05:46:07.576482+0000","last_fullsized":"2023-12-19T05:46:07.576482+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:37:50.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.577213+0000","last_change":"2023-12-19T05:46:07.159863+0000","last_active":"2023-12-19T05:46:07.577213+0000","last_peered":"2023-12-19T05:46:07.577213+0000","last_clean":"2023-12-19T05:46:07.577213+0000","last_became_active":"2023-12-19T05:46:07.159561+0000","last_became_peered":"2023-12-19T05:46:07.159561+0000","last_unstale":"2023-12-19T05:46:07.577213+0000","last_undegraded":"2023-12-19T05:46:07.577213+0000","last_fullsized":"2023-12-19T05:46:07.577213+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:34.926918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579217+0000","last_change":"2023-12-19T05:46:06.665003+0000","last_active":"2023-12-19T05:46:07.579217+0000","last_peered":"2023-12-19T05:46:07.579217+0000","last_clean":"2023-12-19T05:46:07.579217+0000","last_became_active":"2023-12-19T05:46:06.663673+0000","last_became_peered":"2023-12-19T05:46:06.663673+0000","last_unstale":"2023-12-19T05:46:07.579217+0000","last_undegraded":"2023-12-19T05:46:07.579217+0000","last_fullsized":"2023-12-19T05:46:07.579217+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:43:33.917302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570332+0000","last_change":"2023-12-19T05:46:07.155526+0000","last_active":"2023-12-19T05:46:07.570332+0000","last_peered":"2023-12-19T05:46:07.570332+0000","last_clean":"2023-12-19T05:46:07.570332+0000","last_became_active":"2023-12-19T05:46:07.155063+0000","last_became_peered":"2023-12-19T05:46:07.155063+0000","last_unstale":"2023-12-19T05:46:07.570332+0000","last_undegraded":"2023-12-19T05:46:07.570332+0000","last_fullsized":"2023-12-19T05:46:07.570332+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:32.826049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"127'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579086+0000","last_change":"2023-12-19T05:46:06.665972+0000","last_active":"2023-12-19T05:46:07.579086+0000","last_peered":"2023-12-19T05:46:07.579086+0000","last_clean":"2023-12-19T05:46:07.579086+0000","last_became_active":"2023-12-19T05:46:06.665746+0000","last_became_peered":"2023-12-19T05:46:06.665746+0000","last_unstale":"2023-12-19T05:46:07.579086+0000","last_undegraded":"2023-12-19T05:46:07.579086+0000","last_fullsized":"2023-12-19T05:46:07.579086+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:30:16.256168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560675+0000","last_change":"2023-12-19T05:46:07.153347+0000","last_active":"2023-12-19T05:46:07.560675+0000","last_peered":"2023-12-19T05:46:07.560675+0000","last_clean":"2023-12-19T05:46:07.560675+0000","last_became_active":"2023-12-19T05:46:07.153128+0000","last_became_peered":"2023-12-19T05:46:07.153128+0000","last_unstale":"2023-12-19T05:46:07.560675+0000","last_undegraded":"2023-12-19T05:46:07.560675+0000","last_fullsized":"2023-12-19T05:46:07.560675+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:12.619343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"127'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576104+0000","last_change":"2023-12-19T05:46:06.667793+0000","last_active":"2023-12-19T05:46:07.576104+0000","last_peered":"2023-12-19T05:46:07.576104+0000","last_clean":"2023-12-19T05:46:07.576104+0000","last_became_active":"2023-12-19T05:46:06.666625+0000","last_became_peered":"2023-12-19T05:46:06.666625+0000","last_unstale":"2023-12-19T05:46:07.576104+0000","last_undegraded":"2023-12-19T05:46:07.576104+0000","last_fullsized":"2023-12-19T05:46:07.576104+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:53.011995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578404+0000","last_change":"2023-12-19T05:46:07.179378+0000","last_active":"2023-12-19T05:46:07.578404+0000","last_peered":"2023-12-19T05:46:07.578404+0000","last_clean":"2023-12-19T05:46:07.578404+0000","last_became_active":"2023-12-19T05:46:07.179127+0000","last_became_peered":"2023-12-19T05:46:07.179127+0000","last_unstale":"2023-12-19T05:46:07.578404+0000","last_undegraded":"2023-12-19T05:46:07.578404+0000","last_fullsized":"2023-12-19T05:46:07.578404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:26:35.612401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560622+0000","last_change":"2023-12-19T05:46:06.663945+0000","last_active":"2023-12-19T05:46:07.560622+0000","last_peered":"2023-12-19T05:46:07.560622+0000","last_clean":"2023-12-19T05:46:07.560622+0000","last_became_active":"2023-12-19T05:46:06.661796+0000","last_became_peered":"2023-12-19T05:46:06.661796+0000","last_unstale":"2023-12-19T05:46:07.560622+0000","last_undegraded":"2023-12-19T05:46:07.560622+0000","last_fullsized":"2023-12-19T05:46:07.560622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:20:03.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570228+0000","last_change":"2023-12-19T05:46:07.153860+0000","last_active":"2023-12-19T05:46:07.570228+0000","last_peered":"2023-12-19T05:46:07.570228+0000","last_clean":"2023-12-19T05:46:07.570228+0000","last_became_active":"2023-12-19T05:46:07.153634+0000","last_became_peered":"2023-12-19T05:46:07.153634+0000","last_unstale":"2023-12-19T05:46:07.570228+0000","last_undegraded":"2023-12-19T05:46:07.570228+0000","last_fullsized":"2023-12-19T05:46:07.570228+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:54.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576759+0000","last_change":"2023-12-19T05:46:06.657114+0000","last_active":"2023-12-19T05:46:07.576759+0000","last_peered":"2023-12-19T05:46:07.576759+0000","last_clean":"2023-12-19T05:46:07.576759+0000","last_became_active":"2023-12-19T05:46:06.654659+0000","last_became_peered":"2023-12-19T05:46:06.654659+0000","last_unstale":"2023-12-19T05:46:07.576759+0000","last_undegraded":"2023-12-19T05:46:07.576759+0000","last_fullsized":"2023-12-19T05:46:07.576759+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:09.725879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579043+0000","last_change":"2023-12-19T05:46:07.177113+0000","last_active":"2023-12-19T05:46:07.579043+0000","last_peered":"2023-12-19T05:46:07.579043+0000","last_clean":"2023-12-19T05:46:07.579043+0000","last_became_active":"2023-12-19T05:46:07.176886+0000","last_became_peered":"2023-12-19T05:46:07.176886+0000","last_unstale":"2023-12-19T05:46:07.579043+0000","last_undegraded":"2023-12-19T05:46:07.579043+0000","last_fullsized":"2023-12-19T05:46:07.579043+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576225+0000","last_change":"2023-12-19T05:46:06.667583+0000","last_active":"2023-12-19T05:46:07.576225+0000","last_peered":"2023-12-19T05:46:07.576225+0000","last_clean":"2023-12-19T05:46:07.576225+0000","last_became_active":"2023-12-19T05:46:06.667157+0000","last_became_peered":"2023-12-19T05:46:06.667157+0000","last_unstale":"2023-12-19T05:46:07.576225+0000","last_undegraded":"2023-12-19T05:46:07.576225+0000","last_fullsized":"2023-12-19T05:46:07.576225+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:14:26.939874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574431+0000","last_change":"2023-12-19T05:46:07.159157+0000","last_active":"2023-12-19T05:46:07.574431+0000","last_peered":"2023-12-19T05:46:07.574431+0000","last_clean":"2023-12-19T05:46:07.574431+0000","last_became_active":"2023-12-19T05:46:07.158198+0000","last_became_peered":"2023-12-19T05:46:07.158198+0000","last_unstale":"2023-12-19T05:46:07.574431+0000","last_undegraded":"2023-12-19T05:46:07.574431+0000","last_fullsized":"2023-12-19T05:46:07.574431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579110+0000","last_change":"2023-12-19T05:46:06.663855+0000","last_active":"2023-12-19T05:46:07.579110+0000","last_peered":"2023-12-19T05:46:07.579110+0000","last_clean":"2023-12-19T05:46:07.579110+0000","last_became_active":"2023-12-19T05:46:06.663588+0000","last_became_peered":"2023-12-19T05:46:06.663588+0000","last_unstale":"2023-12-19T05:46:07.579110+0000","last_undegraded":"2023-12-19T05:46:07.579110+0000","last_fullsized":"2023-12-19T05:46:07.579110+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:42.604916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560569+0000","last_change":"2023-12-19T05:46:07.160009+0000","last_active":"2023-12-19T05:46:07.560569+0000","last_peered":"2023-12-19T05:46:07.560569+0000","last_clean":"2023-12-19T05:46:07.560569+0000","last_became_active":"2023-12-19T05:46:07.159766+0000","last_became_peered":"2023-12-19T05:46:07.159766+0000","last_unstale":"2023-12-19T05:46:07.560569+0000","last_undegraded":"2023-12-19T05:46:07.560569+0000","last_fullsized":"2023-12-19T05:46:07.560569+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:28:29.205900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"127'3","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560657+0000","last_change":"2023-12-19T05:46:06.659375+0000","last_active":"2023-12-19T05:46:07.560657+0000","last_peered":"2023-12-19T05:46:07.560657+0000","last_clean":"2023-12-19T05:46:07.560657+0000","last_became_active":"2023-12-19T05:46:06.658966+0000","last_became_peered":"2023-12-19T05:46:06.658966+0000","last_unstale":"2023-12-19T05:46:07.560657+0000","last_undegraded":"2023-12-19T05:46:07.560657+0000","last_fullsized":"2023-12-19T05:46:07.560657+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:51:41.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574347+0000","last_change":"2023-12-19T05:46:07.168008+0000","last_active":"2023-12-19T05:46:07.574347+0000","last_peered":"2023-12-19T05:46:07.574347+0000","last_clean":"2023-12-19T05:46:07.574347+0000","last_became_active":"2023-12-19T05:46:07.167692+0000","last_became_peered":"2023-12-19T05:46:07.167692+0000","last_unstale":"2023-12-19T05:46:07.574347+0000","last_undegraded":"2023-12-19T05:46:07.574347+0000","last_fullsized":"2023-12-19T05:46:07.574347+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:34:57.506806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"127'6","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570261+0000","last_change":"2023-12-19T05:46:06.665403+0000","last_active":"2023-12-19T05:46:07.570261+0000","last_peered":"2023-12-19T05:46:07.570261+0000","last_clean":"2023-12-19T05:46:07.570261+0000","last_became_active":"2023-12-19T05:46:06.665080+0000","last_became_peered":"2023-12-19T05:46:06.665080+0000","last_unstale":"2023-12-19T05:46:07.570261+0000","last_undegraded":"2023-12-19T05:46:07.570261+0000","last_fullsized":"2023-12-19T05:46:07.570261+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:34.901054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579174+0000","last_change":"2023-12-19T05:46:07.171837+0000","last_active":"2023-12-19T05:46:07.579174+0000","last_peered":"2023-12-19T05:46:07.579174+0000","last_clean":"2023-12-19T05:46:07.579174+0000","last_became_active":"2023-12-19T05:46:07.168804+0000","last_became_peered":"2023-12-19T05:46:07.168804+0000","last_unstale":"2023-12-19T05:46:07.579174+0000","last_undegraded":"2023-12-19T05:46:07.579174+0000","last_fullsized":"2023-12-19T05:46:07.579174+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:25.272757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576782+0000","last_change":"2023-12-19T05:46:06.645773+0000","last_active":"2023-12-19T05:46:07.576782+0000","last_peered":"2023-12-19T05:46:07.576782+0000","last_clean":"2023-12-19T05:46:07.576782+0000","last_became_active":"2023-12-19T05:46:06.645067+0000","last_became_peered":"2023-12-19T05:46:06.645067+0000","last_unstale":"2023-12-19T05:46:07.576782+0000","last_undegraded":"2023-12-19T05:46:07.576782+0000","last_fullsized":"2023-12-19T05:46:07.576782+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:49:39.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576346+0000","last_change":"2023-12-19T05:46:07.178367+0000","last_active":"2023-12-19T05:46:07.576346+0000","last_peered":"2023-12-19T05:46:07.576346+0000","last_clean":"2023-12-19T05:46:07.576346+0000","last_became_active":"2023-12-19T05:46:07.177632+0000","last_became_peered":"2023-12-19T05:46:07.177632+0000","last_unstale":"2023-12-19T05:46:07.576346+0000","last_undegraded":"2023-12-19T05:46:07.576346+0000","last_fullsized":"2023-12-19T05:46:07.576346+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579239+0000","last_change":"2023-12-19T05:46:06.658991+0000","last_active":"2023-12-19T05:46:07.579239+0000","last_peered":"2023-12-19T05:46:07.579239+0000","last_clean":"2023-12-19T05:46:07.579239+0000","last_became_active":"2023-12-19T05:46:06.658639+0000","last_became_peered":"2023-12-19T05:46:06.658639+0000","last_unstale":"2023-12-19T05:46:07.579239+0000","last_undegraded":"2023-12-19T05:46:07.579239+0000","last_fullsized":"2023-12-19T05:46:07.579239+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:30:34.295254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560639+0000","last_change":"2023-12-19T05:46:07.150498+0000","last_active":"2023-12-19T05:46:07.560639+0000","last_peered":"2023-12-19T05:46:07.560639+0000","last_clean":"2023-12-19T05:46:07.560639+0000","last_became_active":"2023-12-19T05:46:07.150278+0000","last_became_peered":"2023-12-19T05:46:07.150278+0000","last_unstale":"2023-12-19T05:46:07.560639+0000","last_undegraded":"2023-12-19T05:46:07.560639+0000","last_fullsized":"2023-12-19T05:46:07.560639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:04:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570406+0000","last_change":"2023-12-19T05:46:06.666716+0000","last_active":"2023-12-19T05:46:07.570406+0000","last_peered":"2023-12-19T05:46:07.570406+0000","last_clean":"2023-12-19T05:46:07.570406+0000","last_became_active":"2023-12-19T05:46:06.666237+0000","last_became_peered":"2023-12-19T05:46:06.666237+0000","last_unstale":"2023-12-19T05:46:07.570406+0000","last_undegraded":"2023-12-19T05:46:07.570406+0000","last_fullsized":"2023-12-19T05:46:07.570406+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:30.076016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576131+0000","last_change":"2023-12-19T05:46:07.164474+0000","last_active":"2023-12-19T05:46:07.576131+0000","last_peered":"2023-12-19T05:46:07.576131+0000","last_clean":"2023-12-19T05:46:07.576131+0000","last_became_active":"2023-12-19T05:46:07.163798+0000","last_became_peered":"2023-12-19T05:46:07.163798+0000","last_unstale":"2023-12-19T05:46:07.576131+0000","last_undegraded":"2023-12-19T05:46:07.576131+0000","last_fullsized":"2023-12-19T05:46:07.576131+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:58.362285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"127'8","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578977+0000","last_change":"2023-12-19T05:46:06.661489+0000","last_active":"2023-12-19T05:46:07.578977+0000","last_peered":"2023-12-19T05:46:07.578977+0000","last_clean":"2023-12-19T05:46:07.578977+0000","last_became_active":"2023-12-19T05:46:06.660725+0000","last_became_peered":"2023-12-19T05:46:06.660725+0000","last_unstale":"2023-12-19T05:46:07.578977+0000","last_undegraded":"2023-12-19T05:46:07.578977+0000","last_fullsized":"2023-12-19T05:46:07.578977+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:48:05.052388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574281+0000","last_change":"2023-12-19T05:46:07.150285+0000","last_active":"2023-12-19T05:46:07.574281+0000","last_peered":"2023-12-19T05:46:07.574281+0000","last_clean":"2023-12-19T05:46:07.574281+0000","last_became_active":"2023-12-19T05:46:07.150052+0000","last_became_peered":"2023-12-19T05:46:07.150052+0000","last_unstale":"2023-12-19T05:46:07.574281+0000","last_undegraded":"2023-12-19T05:46:07.574281+0000","last_fullsized":"2023-12-19T05:46:07.574281+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:22.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570495+0000","last_change":"2023-12-19T05:46:06.665441+0000","last_active":"2023-12-19T05:46:07.570495+0000","last_peered":"2023-12-19T05:46:07.570495+0000","last_clean":"2023-12-19T05:46:07.570495+0000","last_became_active":"2023-12-19T05:46:06.664520+0000","last_became_peered":"2023-12-19T05:46:06.664520+0000","last_unstale":"2023-12-19T05:46:07.570495+0000","last_undegraded":"2023-12-19T05:46:07.570495+0000","last_fullsized":"2023-12-19T05:46:07.570495+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:56:29.396877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574389+0000","last_change":"2023-12-19T05:46:07.152686+0000","last_active":"2023-12-19T05:46:07.574389+0000","last_peered":"2023-12-19T05:46:07.574389+0000","last_clean":"2023-12-19T05:46:07.574389+0000","last_became_active":"2023-12-19T05:46:07.152458+0000","last_became_peered":"2023-12-19T05:46:07.152458+0000","last_unstale":"2023-12-19T05:46:07.574389+0000","last_undegraded":"2023-12-19T05:46:07.574389+0000","last_fullsized":"2023-12-19T05:46:07.574389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:05.225514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"127'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560777+0000","last_change":"2023-12-19T05:46:06.666228+0000","last_active":"2023-12-19T05:46:07.560777+0000","last_peered":"2023-12-19T05:46:07.560777+0000","last_clean":"2023-12-19T05:46:07.560777+0000","last_became_active":"2023-12-19T05:46:06.665811+0000","last_became_peered":"2023-12-19T05:46:06.665811+0000","last_unstale":"2023-12-19T05:46:07.560777+0000","last_undegraded":"2023-12-19T05:46:07.560777+0000","last_fullsized":"2023-12-19T05:46:07.560777+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:48:10.702897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570452+0000","last_change":"2023-12-19T05:46:07.158521+0000","last_active":"2023-12-19T05:46:07.570452+0000","last_peered":"2023-12-19T05:46:07.570452+0000","last_clean":"2023-12-19T05:46:07.570452+0000","last_became_active":"2023-12-19T05:46:07.158170+0000","last_became_peered":"2023-12-19T05:46:07.158170+0000","last_unstale":"2023-12-19T05:46:07.570452+0000","last_undegraded":"2023-12-19T05:46:07.570452+0000","last_fullsized":"2023-12-19T05:46:07.570452+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:25.412703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576736+0000","last_change":"2023-12-19T05:46:06.651213+0000","last_active":"2023-12-19T05:46:07.576736+0000","last_peered":"2023-12-19T05:46:07.576736+0000","last_clean":"2023-12-19T05:46:07.576736+0000","last_became_active":"2023-12-19T05:46:06.648592+0000","last_became_peered":"2023-12-19T05:46:06.648592+0000","last_unstale":"2023-12-19T05:46:07.576736+0000","last_undegraded":"2023-12-19T05:46:07.576736+0000","last_fullsized":"2023-12-19T05:46:07.576736+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:34:56.497190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576382+0000","last_change":"2023-12-19T05:46:07.180381+0000","last_active":"2023-12-19T05:46:07.576382+0000","last_peered":"2023-12-19T05:46:07.576382+0000","last_clean":"2023-12-19T05:46:07.576382+0000","last_became_active":"2023-12-19T05:46:07.178174+0000","last_became_peered":"2023-12-19T05:46:07.178174+0000","last_unstale":"2023-12-19T05:46:07.576382+0000","last_undegraded":"2023-12-19T05:46:07.576382+0000","last_fullsized":"2023-12-19T05:46:07.576382+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:22.258546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579001+0000","last_change":"2023-12-19T05:46:06.661325+0000","last_active":"2023-12-19T05:46:07.579001+0000","last_peered":"2023-12-19T05:46:07.579001+0000","last_clean":"2023-12-19T05:46:07.579001+0000","last_became_active":"2023-12-19T05:46:06.660361+0000","last_became_peered":"2023-12-19T05:46:06.660361+0000","last_unstale":"2023-12-19T05:46:07.579001+0000","last_undegraded":"2023-12-19T05:46:07.579001+0000","last_fullsized":"2023-12-19T05:46:07.579001+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:14.608066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576494+0000","last_change":"2023-12-19T05:46:07.180015+0000","last_active":"2023-12-19T05:46:07.576494+0000","last_peered":"2023-12-19T05:46:07.576494+0000","last_clean":"2023-12-19T05:46:07.576494+0000","last_became_active":"2023-12-19T05:46:07.179796+0000","last_became_peered":"2023-12-19T05:46:07.179796+0000","last_unstale":"2023-12-19T05:46:07.576494+0000","last_undegraded":"2023-12-19T05:46:07.576494+0000","last_fullsized":"2023-12-19T05:46:07.576494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:03:27.352347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574304+0000","last_change":"2023-12-19T05:46:06.663935+0000","last_active":"2023-12-19T05:46:07.574304+0000","last_peered":"2023-12-19T05:46:07.574304+0000","last_clean":"2023-12-19T05:46:07.574304+0000","last_became_active":"2023-12-19T05:46:06.663267+0000","last_became_peered":"2023-12-19T05:46:06.663267+0000","last_unstale":"2023-12-19T05:46:07.574304+0000","last_undegraded":"2023-12-19T05:46:07.574304+0000","last_fullsized":"2023-12-19T05:46:07.574304+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:09:53.011995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.579194+0000","last_change":"2023-12-19T05:46:07.174108+0000","last_active":"2023-12-19T05:46:07.579194+0000","last_peered":"2023-12-19T05:46:07.579194+0000","last_clean":"2023-12-19T05:46:07.579194+0000","last_became_active":"2023-12-19T05:46:07.173876+0000","last_became_peered":"2023-12-19T05:46:07.173876+0000","last_unstale":"2023-12-19T05:46:07.579194+0000","last_undegraded":"2023-12-19T05:46:07.579194+0000","last_fullsized":"2023-12-19T05:46:07.579194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:49.642599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.577234+0000","last_change":"2023-12-19T05:46:06.663566+0000","last_active":"2023-12-19T05:46:07.577234+0000","last_peered":"2023-12-19T05:46:07.577234+0000","last_clean":"2023-12-19T05:46:07.577234+0000","last_became_active":"2023-12-19T05:46:06.662734+0000","last_became_peered":"2023-12-19T05:46:06.662734+0000","last_unstale":"2023-12-19T05:46:07.577234+0000","last_undegraded":"2023-12-19T05:46:07.577234+0000","last_fullsized":"2023-12-19T05:46:07.577234+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:26.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574457+0000","last_change":"2023-12-19T05:46:07.177589+0000","last_active":"2023-12-19T05:46:07.574457+0000","last_peered":"2023-12-19T05:46:07.574457+0000","last_clean":"2023-12-19T05:46:07.574457+0000","last_became_active":"2023-12-19T05:46:07.177403+0000","last_became_peered":"2023-12-19T05:46:07.177403+0000","last_unstale":"2023-12-19T05:46:07.574457+0000","last_undegraded":"2023-12-19T05:46:07.574457+0000","last_fullsized":"2023-12-19T05:46:07.574457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576264+0000","last_change":"2023-12-19T05:46:06.663518+0000","last_active":"2023-12-19T05:46:07.576264+0000","last_peered":"2023-12-19T05:46:07.576264+0000","last_clean":"2023-12-19T05:46:07.576264+0000","last_became_active":"2023-12-19T05:46:06.663301+0000","last_became_peered":"2023-12-19T05:46:06.663301+0000","last_unstale":"2023-12-19T05:46:07.576264+0000","last_undegraded":"2023-12-19T05:46:07.576264+0000","last_fullsized":"2023-12-19T05:46:07.576264+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:47.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576515+0000","last_change":"2023-12-19T05:46:07.171393+0000","last_active":"2023-12-19T05:46:07.576515+0000","last_peered":"2023-12-19T05:46:07.576515+0000","last_clean":"2023-12-19T05:46:07.576515+0000","last_became_active":"2023-12-19T05:46:07.170843+0000","last_became_peered":"2023-12-19T05:46:07.170843+0000","last_unstale":"2023-12-19T05:46:07.576515+0000","last_undegraded":"2023-12-19T05:46:07.576515+0000","last_fullsized":"2023-12-19T05:46:07.576515+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:53.958505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"127'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570428+0000","last_change":"2023-12-19T05:46:06.666473+0000","last_active":"2023-12-19T05:46:07.570428+0000","last_peered":"2023-12-19T05:46:07.570428+0000","last_clean":"2023-12-19T05:46:07.570428+0000","last_became_active":"2023-12-19T05:46:06.665774+0000","last_became_peered":"2023-12-19T05:46:06.665774+0000","last_unstale":"2023-12-19T05:46:07.570428+0000","last_undegraded":"2023-12-19T05:46:07.570428+0000","last_fullsized":"2023-12-19T05:46:07.570428+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:16:01.181337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576672+0000","last_change":"2023-12-19T05:46:07.178302+0000","last_active":"2023-12-19T05:46:07.576672+0000","last_peered":"2023-12-19T05:46:07.576672+0000","last_clean":"2023-12-19T05:46:07.576672+0000","last_became_active":"2023-12-19T05:46:07.178045+0000","last_became_peered":"2023-12-19T05:46:07.178045+0000","last_unstale":"2023-12-19T05:46:07.576672+0000","last_undegraded":"2023-12-19T05:46:07.576672+0000","last_fullsized":"2023-12-19T05:46:07.576672+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:00:55.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T05:46:08.148348+0000","last_change":"2023-12-19T05:46:06.659564+0000","last_active":"2023-12-19T05:46:08.148348+0000","last_peered":"2023-12-19T05:46:08.148348+0000","last_clean":"2023-12-19T05:46:08.148348+0000","last_became_active":"2023-12-19T05:46:06.659303+0000","last_became_peered":"2023-12-19T05:46:06.659303+0000","last_unstale":"2023-12-19T05:46:08.148348+0000","last_undegraded":"2023-12-19T05:46:08.148348+0000","last_fullsized":"2023-12-19T05:46:08.148348+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:59.143370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576438+0000","last_change":"2023-12-19T05:46:07.177958+0000","last_active":"2023-12-19T05:46:07.576438+0000","last_peered":"2023-12-19T05:46:07.576438+0000","last_clean":"2023-12-19T05:46:07.576438+0000","last_became_active":"2023-12-19T05:46:07.177014+0000","last_became_peered":"2023-12-19T05:46:07.177014+0000","last_unstale":"2023-12-19T05:46:07.576438+0000","last_undegraded":"2023-12-19T05:46:07.576438+0000","last_fullsized":"2023-12-19T05:46:07.576438+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:18.926393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576462+0000","last_change":"2023-12-19T05:46:06.664117+0000","last_active":"2023-12-19T05:46:07.576462+0000","last_peered":"2023-12-19T05:46:07.576462+0000","last_clean":"2023-12-19T05:46:07.576462+0000","last_became_active":"2023-12-19T05:46:06.663692+0000","last_became_peered":"2023-12-19T05:46:06.663692+0000","last_unstale":"2023-12-19T05:46:07.576462+0000","last_undegraded":"2023-12-19T05:46:07.576462+0000","last_fullsized":"2023-12-19T05:46:07.576462+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:20:24.263141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560606+0000","last_change":"2023-12-19T05:46:07.157549+0000","last_active":"2023-12-19T05:46:07.560606+0000","last_peered":"2023-12-19T05:46:07.560606+0000","last_clean":"2023-12-19T05:46:07.560606+0000","last_became_active":"2023-12-19T05:46:07.157333+0000","last_became_peered":"2023-12-19T05:46:07.157333+0000","last_unstale":"2023-12-19T05:46:07.560606+0000","last_undegraded":"2023-12-19T05:46:07.560606+0000","last_fullsized":"2023-12-19T05:46:07.560606+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:40:19.850610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574478+0000","last_change":"2023-12-19T05:46:06.661568+0000","last_active":"2023-12-19T05:46:07.574478+0000","last_peered":"2023-12-19T05:46:07.574478+0000","last_clean":"2023-12-19T05:46:07.574478+0000","last_became_active":"2023-12-19T05:46:06.661176+0000","last_became_peered":"2023-12-19T05:46:06.661176+0000","last_unstale":"2023-12-19T05:46:07.574478+0000","last_undegraded":"2023-12-19T05:46:07.574478+0000","last_fullsized":"2023-12-19T05:46:07.574478+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:31.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576711+0000","last_change":"2023-12-19T05:46:07.168732+0000","last_active":"2023-12-19T05:46:07.576711+0000","last_peered":"2023-12-19T05:46:07.576711+0000","last_clean":"2023-12-19T05:46:07.576711+0000","last_became_active":"2023-12-19T05:46:07.167288+0000","last_became_peered":"2023-12-19T05:46:07.167288+0000","last_unstale":"2023-12-19T05:46:07.576711+0000","last_undegraded":"2023-12-19T05:46:07.576711+0000","last_fullsized":"2023-12-19T05:46:07.576711+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:35.349961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576305+0000","last_change":"2023-12-19T05:46:06.660133+0000","last_active":"2023-12-19T05:46:07.576305+0000","last_peered":"2023-12-19T05:46:07.576305+0000","last_clean":"2023-12-19T05:46:07.576305+0000","last_became_active":"2023-12-19T05:46:06.659916+0000","last_became_peered":"2023-12-19T05:46:06.659916+0000","last_unstale":"2023-12-19T05:46:07.576305+0000","last_undegraded":"2023-12-19T05:46:07.576305+0000","last_fullsized":"2023-12-19T05:46:07.576305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:30:33.022327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.560759+0000","last_change":"2023-12-19T05:46:07.176272+0000","last_active":"2023-12-19T05:46:07.560759+0000","last_peered":"2023-12-19T05:46:07.560759+0000","last_clean":"2023-12-19T05:46:07.560759+0000","last_became_active":"2023-12-19T05:46:07.176030+0000","last_became_peered":"2023-12-19T05:46:07.176030+0000","last_unstale":"2023-12-19T05:46:07.560759+0000","last_undegraded":"2023-12-19T05:46:07.560759+0000","last_fullsized":"2023-12-19T05:46:07.560759+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:10:45.583387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.574410+0000","last_change":"2023-12-19T05:46:06.664333+0000","last_active":"2023-12-19T05:46:07.574410+0000","last_peered":"2023-12-19T05:46:07.574410+0000","last_clean":"2023-12-19T05:46:07.574410+0000","last_became_active":"2023-12-19T05:46:06.662577+0000","last_became_peered":"2023-12-19T05:46:06.662577+0000","last_unstale":"2023-12-19T05:46:07.574410+0000","last_undegraded":"2023-12-19T05:46:07.574410+0000","last_fullsized":"2023-12-19T05:46:07.574410+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:47.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576422+0000","last_change":"2023-12-19T05:46:07.167596+0000","last_active":"2023-12-19T05:46:07.576422+0000","last_peered":"2023-12-19T05:46:07.576422+0000","last_clean":"2023-12-19T05:46:07.576422+0000","last_became_active":"2023-12-19T05:46:07.167170+0000","last_became_peered":"2023-12-19T05:46:07.167170+0000","last_unstale":"2023-12-19T05:46:07.576422+0000","last_undegraded":"2023-12-19T05:46:07.576422+0000","last_fullsized":"2023-12-19T05:46:07.576422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:37:08.279067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.578338+0000","last_change":"2023-12-19T05:46:06.665445+0000","last_active":"2023-12-19T05:46:07.578338+0000","last_peered":"2023-12-19T05:46:07.578338+0000","last_clean":"2023-12-19T05:46:07.578338+0000","last_became_active":"2023-12-19T05:46:06.665196+0000","last_became_peered":"2023-12-19T05:46:06.665196+0000","last_unstale":"2023-12-19T05:46:07.578338+0000","last_undegraded":"2023-12-19T05:46:07.578338+0000","last_fullsized":"2023-12-19T05:46:07.578338+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:42:15.412261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570363+0000","last_change":"2023-12-19T05:46:07.162823+0000","last_active":"2023-12-19T05:46:07.570363+0000","last_peered":"2023-12-19T05:46:07.570363+0000","last_clean":"2023-12-19T05:46:07.570363+0000","last_became_active":"2023-12-19T05:46:07.162573+0000","last_became_peered":"2023-12-19T05:46:07.162573+0000","last_unstale":"2023-12-19T05:46:07.570363+0000","last_undegraded":"2023-12-19T05:46:07.570363+0000","last_fullsized":"2023-12-19T05:46:07.570363+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:43:48.317013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576022+0000","last_change":"2023-12-19T05:46:06.661881+0000","last_active":"2023-12-19T05:46:07.576022+0000","last_peered":"2023-12-19T05:46:07.576022+0000","last_clean":"2023-12-19T05:46:07.576022+0000","last_became_active":"2023-12-19T05:46:06.661661+0000","last_became_peered":"2023-12-19T05:46:06.661661+0000","last_unstale":"2023-12-19T05:46:07.576022+0000","last_undegraded":"2023-12-19T05:46:07.576022+0000","last_fullsized":"2023-12-19T05:46:07.576022+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:24.403087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.576394+0000","last_change":"2023-12-19T05:46:07.178116+0000","last_active":"2023-12-19T05:46:07.576394+0000","last_peered":"2023-12-19T05:46:07.576394+0000","last_clean":"2023-12-19T05:46:07.576394+0000","last_became_active":"2023-12-19T05:46:07.177274+0000","last_became_peered":"2023-12-19T05:46:07.177274+0000","last_unstale":"2023-12-19T05:46:07.576394+0000","last_undegraded":"2023-12-19T05:46:07.576394+0000","last_fullsized":"2023-12-19T05:46:07.576394+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:06.626856+0000","last_clean_scrub_stamp":"2023-12-19T05:46:06.626856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:45.053870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"127'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.570287+0000","last_change":"2023-12-19T05:46:06.662724+0000","last_active":"2023-12-19T05:46:07.570287+0000","last_peered":"2023-12-19T05:46:07.570287+0000","last_clean":"2023-12-19T05:46:07.570287+0000","last_became_active":"2023-12-19T05:46:06.662377+0000","last_became_peered":"2023-12-19T05:46:06.662377+0000","last_unstale":"2023-12-19T05:46:07.570287+0000","last_undegraded":"2023-12-19T05:46:07.570287+0000","last_fullsized":"2023-12-19T05:46:07.570287+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:05.617240+0000","last_clean_scrub_stamp":"2023-12-19T05:46:05.617240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:25:43.132805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":263,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T05:46:07.148021+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:46:07.148021+0000","last_peered":"2023-12-19T05:46:07.148021+0000","last_clean":"2023-12-19T05:46:07.148021+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:46:07.148021+0000","last_undegraded":"2023-12-19T05:46:07.148021+0000","last_fullsized":"2023-12-19T05:46:07.148021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289686,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.1739999999999999,"15min":1.0669999999999999},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":6.4429999999999996,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1639999999999999,"15min":1.0800000000000001},"min":{"1min":0.79000000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6259999999999999,"5min":3.976,"15min":3.976},"last":1.23}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.218,"15min":1.1040000000000001},"min":{"1min":0.73199999999999998,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.83999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1720000000000002,"5min":4.25,"15min":4.25},"last":0.92600000000000005}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.738,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.069},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.349,"15min":1.1990000000000001},"min":{"1min":1.0129999999999999,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.2},{"interface":"front","average":{"1min":1.429,"5min":1.4139999999999999,"15min":1.335},"min":{"1min":1.0249999999999999,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":2.327,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.181}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.171,"15min":1.0680000000000001},"min":{"1min":0.85599999999999998,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.653,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.3480000000000001,"15min":1.274},"min":{"1min":0.81699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.1080000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3740000000000001,"15min":1.3280000000000001},"min":{"1min":0.75900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.952,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3220000000000001,"15min":1.25},"min":{"1min":0.77800000000000002,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":2.0550000000000002,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":0.996}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4730000000000001,"15min":1.357},"min":{"1min":0.89800000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.121,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.78,"5min":1.569,"15min":1.4279999999999999},"min":{"1min":1.1579999999999999,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":6.3369999999999997,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.2949999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.02,"15min":1.1910000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4850000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.054,"15min":1.034},"min":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.46500000000000002},"max":{"1min":1.3959999999999999,"5min":1.635,"15min":1.635},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1930000000000001,"15min":1.1539999999999999},"min":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.704,"5min":1.792,"15min":1.792},"last":1.423},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.202,"15min":1.294},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6339999999999999,"5min":1.8120000000000001,"15min":3.4670000000000001},"last":1.2390000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1339999999999999,"15min":1.1779999999999999},"min":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4350000000000001,"5min":1.823,"15min":2},"last":1.266},{"interface":"front","average":{"1min":1.165,"5min":1.1899999999999999,"15min":1.284},"min":{"1min":0.74399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.583,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.153,"15min":1.3180000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70799999999999996},"max":{"1min":1.534,"5min":1.7050000000000001,"15min":4.5220000000000002},"last":1.008},{"interface":"front","average":{"1min":1.171,"5min":1.2549999999999999,"15min":1.3460000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.617,"5min":2.0059999999999998,"15min":4.452},"last":1.079}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1910000000000001,"15min":1.3089999999999999},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48899999999999999},"max":{"1min":1.506,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2030000000000001,"15min":1.4039999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":4.6689999999999996},"last":1.3260000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.5329999999999999},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7629999999999999,"5min":2.1480000000000001,"15min":4.5670000000000002},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.427,"15min":1.6739999999999999},"min":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"max":{"1min":1.718,"5min":2.21,"15min":3.681},"last":1.387}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.389,"15min":1.5009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.972,"15min":3.2719999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4990000000000001,"15min":1.5940000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8080000000000001,"5min":2.02,"15min":4.7480000000000002},"last":1.806}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1271,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194041,"statfs":{"total":200000000,"available":198698280,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1890000000000001,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9620000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1559999999999999,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.641},"last":0.93300000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2350000000000001,"15min":1.242},"min":{"1min":0.71599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3600000000000001,"15min":1.3680000000000001},"min":{"1min":0.80700000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":0.81799999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.69299999999999995},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.202,"15min":1.2210000000000001},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.2090000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.363,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.774,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.133},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3440000000000001,"15min":1.419},"min":{"1min":0.84899999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.86599999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.2889999999999999,"15min":1.454},"min":{"1min":0.94999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.2040000000000002,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.389,"15min":1.5580000000000001},"min":{"1min":0.877,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.0499999999999998,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":0.90700000000000003}]},{"osd":6,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.411,"15min":1.496},"min":{"1min":0.96299999999999997,"5min":0.68700000000000006,"15min":0.59099999999999997},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.405,"15min":1.6180000000000001},"min":{"1min":1.1739999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.4690000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5609999999999999,"15min":1.6899999999999999},"min":{"1min":0.94599999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":3.2639999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.03},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.5880000000000001,"15min":1.619},"min":{"1min":1.1559999999999999,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.3069999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289686,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.05,"15min":1.018},"min":{"1min":0.60799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.6060000000000001},"last":1.2},{"interface":"front","average":{"1min":1.179,"5min":1.1259999999999999,"15min":1.0740000000000001},"min":{"1min":0.80600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.6240000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.466},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.204,"15min":1.077},"min":{"1min":0.81100000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6659999999999999,"5min":1.954,"15min":1.954},"last":1.351}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.216,"15min":1.2030000000000001},"min":{"1min":0.75700000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.704,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7809999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.4099999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.216,"15min":1.099},"min":{"1min":0.78400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.24},{"interface":"front","average":{"1min":1.393,"5min":1.3520000000000001,"15min":1.2989999999999999},"min":{"1min":0.89700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8400000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.282}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.3740000000000001,"15min":1.351},"min":{"1min":0.78900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4099999999999999,"15min":1.3080000000000001},"min":{"1min":0.66500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.3160000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.421,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.165},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4530000000000001,"15min":1.409},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9930000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.3740000000000001},"min":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.589,"5min":1.5349999999999999,"15min":1.4750000000000001},"min":{"1min":0.871,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.3779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.872,"15min":0.82899999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3380000000000001,"5min":1.99,"15min":1.99},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3939999999999999,"5min":1.72,"15min":1.72},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.556,"5min":1.6060000000000001,"15min":2.702},"last":0.748},{"interface":"front","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.502,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.0920000000000001,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.2090000000000001,"15min":1.0960000000000001},"min":{"1min":0.58599999999999997,"5min":0.46600000000000003,"15min":0.45600000000000002},"max":{"1min":1.7310000000000001,"5min":2.931,"15min":2.931},"last":0.81699999999999995}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1759999999999999,"15min":1.1579999999999999},"min":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.292},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.304,"15min":1.294},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.236}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3759999999999999,"15min":1.3300000000000001},"min":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.391,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.399,"15min":1.357},"min":{"1min":0.85399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5449999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.218}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.431,"15min":1.3740000000000001},"min":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":2.427,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.337,"15min":1.327},"min":{"1min":0.74199999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8480000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.3799999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.389},"min":{"1min":0.85499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0550000000000002,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.4330000000000001,"15min":1.427},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.3959999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290198,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.85499999999999998,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.47499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3109999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.254}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.137,"15min":1.0600000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2609999999999999,"15min":1.167},"min":{"1min":0.65500000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.5629999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98999999999999999,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.339,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.21,"15min":1.1020000000000001},"min":{"1min":0.65800000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.714,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.373,"15min":1.28},"min":{"1min":0.90100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.982,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.333,"15min":1.2470000000000001},"min":{"1min":0.89500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.736,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.157}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3859999999999999,"15min":1.2969999999999999},"min":{"1min":0.93300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.853,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.478},{"interface":"front","average":{"1min":1.304,"5min":1.3320000000000001,"15min":1.2969999999999999},"min":{"1min":0.90400000000000003,"5min":0.81499999999999995,"15min":0.72699999999999998},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.4419999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3440000000000001,"15min":1.294},"min":{"1min":0.87,"5min":0.87,"15min":0.83599999999999997},"max":{"1min":1.704,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.222},{"interface":"front","average":{"1min":1.508,"5min":1.4670000000000001,"15min":1.3480000000000001},"min":{"1min":1.0589999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0430000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.514}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5089999999999999,"15min":1.4239999999999999},"min":{"1min":1.1200000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":1.78,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.5369999999999999,"15min":1.4430000000000001},"min":{"1min":0.94899999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":9.5359999999999996,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.109}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1271,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194041,"statfs":{"total":200000000,"available":198698224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.59899999999999998,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.1839999999999999,"5min":2.1110000000000002,"15min":2.992},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0369999999999999},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2270000000000001,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.194,"5min":1.742,"15min":2.2789999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.859,"15min":1.337},"min":{"1min":0.60699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.488,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3540000000000001,"15min":1.3300000000000001},"min":{"1min":0.81999999999999995,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":1.663,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.87},{"interface":"front","average":{"1min":1.212,"5min":1.29,"15min":1.2430000000000001},"min":{"1min":0.71099999999999997,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":1.827,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.63100000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3839999999999999,"15min":1.238},"min":{"1min":0.874,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":1.893,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4550000000000001,"15min":1.395},"min":{"1min":0.91400000000000003,"5min":0.79700000000000004,"15min":0.78900000000000003},"max":{"1min":2.117,"5min":4.306,"15min":4.306},"last":1.238}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.3680000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68400000000000005},"max":{"1min":1.899,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.046},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.48,"15min":1.3779999999999999},"min":{"1min":0.86799999999999999,"5min":0.753,"15min":0.67900000000000005},"max":{"1min":2.2069999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5669999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.9359999999999999,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.534,"15min":1.4410000000000001},"min":{"1min":0.97699999999999998,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.3170000000000002,"5min":3.75,"15min":3.75},"last":1.008}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.6599999999999999,"15min":1.5449999999999999},"min":{"1min":1.0880000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.9850000000000001,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.702,"15min":1.617},"min":{"1min":0.89100000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.1019999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.80200000000000005},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.89400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.306,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.80900000000000005}]},{"osd":2,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.105,"15min":1.0649999999999999},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6719999999999999,"5min":1.825,"15min":1.825},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.165,"15min":1.147},"min":{"1min":0.52800000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5109999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.1379999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.88800000000000001},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.48199999999999998},"max":{"1min":1.304,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":1.218},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.155,"15min":1.0760000000000001},"min":{"1min":0.61399999999999999,"5min":0.53900000000000003,"15min":0.45900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.7210000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.23,"15min":1.169},"min":{"1min":0.75700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7589999999999999,"5min":1.845,"15min":1.845},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3680000000000001,"15min":1.278},"min":{"1min":1.0069999999999999,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.2849999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3799999999999999,"15min":1.323},"min":{"1min":0.93200000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.885,"5min":2.173,"15min":2.173},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.292},"min":{"1min":0.90300000000000002,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8340000000000001,"5min":1.879,"15min":1.879},"last":1.454}]},{"osd":6,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4470000000000001,"15min":1.399},"min":{"1min":0.92300000000000004,"5min":0.85299999999999998,"15min":0.76300000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.365,"15min":1.2889999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8089999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.6859999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.484,"15min":1.427},"min":{"1min":1.022,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.964,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.446,"15min":1.3819999999999999},"min":{"1min":0.82999999999999996,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":1.8500000000000001,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.7509999999999999}]}]}],"pool_statfs":[]}} 2023-12-19T05:46:12.722 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:46:12.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:46:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.004+0000 7f2459b39640 1 Processor -- start 2023-12-19T05:46:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.005+0000 7f2459b39640 1 -- start start 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2454144ef0 0x7f245406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f245415ba90 0x7f245406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245406f9b0 con 0x7f245415ba90 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245406bf90 con 0x7f2454144ef0 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.006+0000 7f2459b39640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245415bfe0 con 0x7f245406bb40 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.007+0000 7f244bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f245415ba90 0x7f245406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.007+0000 7f244bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f245415ba90 0x7f245406b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53394/0 (socket says 172.21.15.49:53394) 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.007+0000 7f244bfff640 1 -- 172.21.15.49:0/859193543 learned_addr learned my addr 172.21.15.49:0/859193543 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:13.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.007+0000 7f24537fe640 1 --2- 172.21.15.49:0/859193543 >> v2:172.21.15.115:3300/0 conn(0x7f2454144ef0 0x7f245406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.007+0000 7f2453fff640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.008+0000 7f244bfff640 1 -- 172.21.15.49:0/859193543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 msgr2=0x7f24540b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.008+0000 7f244bfff640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.008+0000 7f244bfff640 1 -- 172.21.15.49:0/859193543 >> v2:172.21.15.115:3300/0 conn(0x7f2454144ef0 msgr2=0x7f245406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.008+0000 7f244bfff640 1 --2- 172.21.15.49:0/859193543 >> v2:172.21.15.115:3300/0 conn(0x7f2454144ef0 0x7f245406d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.008+0000 7f244bfff640 1 -- 172.21.15.49:0/859193543 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245415c2c0 con 0x7f245415ba90 2023-12-19T05:46:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.009+0000 7f244bfff640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f245415ba90 0x7f245406b600 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f24540ceee0 tx=0x7f243c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a019ce1b7f359f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.009+0000 7f2452ffd640 1 -- 172.21.15.49:0/859193543 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c031860 con 0x7f245415ba90 2023-12-19T05:46:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.009+0000 7f2452ffd640 1 -- 172.21.15.49:0/859193543 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0319c0 con 0x7f245415ba90 2023-12-19T05:46:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.009+0000 7f2452ffd640 1 -- 172.21.15.49:0/859193543 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c031d50 con 0x7f245415ba90 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 -- 172.21.15.49:0/859193543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f245415ba90 msgr2=0x7f245406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f245415ba90 0x7f245406b600 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f24540ceee0 tx=0x7f243c02b900 comp rx=0 tx=0).stop 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 -- 172.21.15.49:0/859193543 shutdown_connections 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 --2- 172.21.15.49:0/859193543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f245415ba90 0x7f245406b600 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 --2- 172.21.15.49:0/859193543 >> v2:172.21.15.115:3300/0 conn(0x7f2454144ef0 0x7f245406d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 -- 172.21.15.49:0/859193543 >> 172.21.15.49:0/859193543 conn(0x7f24540659d0 msgr2=0x7f2454065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 -- 172.21.15.49:0/859193543 shutdown_connections 2023-12-19T05:46:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.010+0000 7f2459b39640 1 -- 172.21.15.49:0/859193543 wait complete. 2023-12-19T05:46:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.012+0000 7f2459b39640 1 Processor -- start 2023-12-19T05:46:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.013+0000 7f2459b39640 1 -- start start 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.013+0000 7f2459b39640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2459b39640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2459b39640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f245415ba90 0x7f24540aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2459b39640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540af6e0 con 0x7f2454144ef0 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2459b39640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540af9c0 con 0x7f245415ba90 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2459b39640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540afca0 con 0x7f245406bb40 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53396/0 (socket says 172.21.15.49:53396) 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 -- 172.21.15.49:0/280894764 learned_addr learned my addr 172.21.15.49:0/280894764 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f24537fe640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f2453fff640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f245415ba90 0x7f24540aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 -- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 msgr2=0x7f24540b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 -- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f245415ba90 msgr2=0x7f24540aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.014+0000 7f244bfff640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f245415ba90 0x7f24540aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f244bfff640 1 -- 172.21.15.49:0/280894764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0094d0 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f244bfff640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f243c02b940 tx=0x7f243c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c03ad30 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0443f0 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0447a0 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24540aff80 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.015+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540b0cc0 con 0x7f2454144ef0 2023-12-19T05:46:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.017+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24540b04a0 con 0x7f2454144ef0 2023-12-19T05:46:13.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.018+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f243c04d450 con 0x7f2454144ef0 2023-12-19T05:46:13.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.018+0000 7f2450ff9640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 0x7f243406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.019+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f243c0aaf10 con 0x7f2454144ef0 2023-12-19T05:46:13.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.019+0000 7f24537fe640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 0x7f243406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.020+0000 7f24537fe640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 0x7f243406c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2444006fd0 tx=0x7f2444008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.023+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f24540b04a0 con 0x7f2454144ef0 2023-12-19T05:46:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.289+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f24540b04a0 con 0x7f2454144ef0 2023-12-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.297+0000 7f2450ff9640 1 -- 172.21.15.49:0/280894764 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f24540b04a0 con 0x7f2454144ef0 2023-12-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 msgr2=0x7f243406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 0x7f243406c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2444006fd0 tx=0x7f2444008040 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 msgr2=0x7f245415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f243c02b940 tx=0x7f243c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 shutdown_connections 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f243406a430 0x7f243406c8f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f245415ba90 0x7f24540aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2454144ef0 0x7f245415abc0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 --2- 172.21.15.49:0/280894764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f245406bb40 0x7f24540b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 >> 172.21.15.49:0/280894764 conn(0x7f24540659d0 msgr2=0x7f245415e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.300+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 shutdown_connections 2023-12-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.301+0000 7f2459b39640 1 -- 172.21.15.49:0/280894764 wait complete. 2023-12-19T05:46:13.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.544+0000 7f02ecb0c640 1 Processor -- start 2023-12-19T05:46:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.544+0000 7f02ecb0c640 1 -- start start 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.546+0000 7f02ecb0c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e8159f80 0x7f02e806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.546+0000 7f02ecb0c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e806b520 con 0x7f02e815aa70 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.546+0000 7f02ecb0c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80b2b20 con 0x7f02e815b1e0 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.546+0000 7f02ecb0c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80b2fb0 con 0x7f02e8159f80 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e8159f80 0x7f02e806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e8159f80 0x7f02e806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53412/0 (socket says 172.21.15.49:53412) 2023-12-19T05:46:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 -- 172.21.15.49:0/714160027 learned_addr learned my addr 172.21.15.49:0/714160027 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e7fff640 1 --1- 172.21.15.49:0/714160027 >> v1:172.21.15.49:6789/0 conn(0x7f02e815aa70 0x7f02e815b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60216/0 (socket says 172.21.15.49:60216) 2023-12-19T05:46:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 -- 172.21.15.49:0/714160027 >> v1:172.21.15.115:6789/0 conn(0x7f02e815b1e0 legacy=0x7f02e815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 -- 172.21.15.49:0/714160027 >> v1:172.21.15.49:6789/0 conn(0x7f02e815aa70 legacy=0x7f02e815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.547+0000 7f02e77fe640 1 -- 172.21.15.49:0/714160027 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80b1f10 con 0x7f02e8159f80 2023-12-19T05:46:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.548+0000 7f02e77fe640 1 --2- 172.21.15.49:0/714160027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e8159f80 0x7f02e806f160 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009e50 tx=0x7f02d802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2d7bab7f6fe946 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.549+0000 7f02e67fc640 1 -- 172.21.15.49:0/714160027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d802cbb0 con 0x7f02e8159f80 2023-12-19T05:46:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.549+0000 7f02e67fc640 1 -- 172.21.15.49:0/714160027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d802cd10 con 0x7f02e8159f80 2023-12-19T05:46:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.549+0000 7f02e67fc640 1 -- 172.21.15.49:0/714160027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8034610 con 0x7f02e8159f80 2023-12-19T05:46:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 -- 172.21.15.49:0/714160027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e8159f80 msgr2=0x7f02e806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/714160027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e8159f80 0x7f02e806f160 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009e50 tx=0x7f02d802c010 comp rx=0 tx=0).stop 2023-12-19T05:46:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 -- 172.21.15.49:0/714160027 shutdown_connections 2023-12-19T05:46:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/714160027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e8159f80 0x7f02e806f160 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 -- 172.21.15.49:0/714160027 >> 172.21.15.49:0/714160027 conn(0x7f02e80b0100 msgr2=0x7f02e80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:13.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 -- 172.21.15.49:0/714160027 shutdown_connections 2023-12-19T05:46:13.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.550+0000 7f02ecb0c640 1 -- 172.21.15.49:0/714160027 wait complete. 2023-12-19T05:46:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.552+0000 7f02ecb0c640 1 Processor -- start 2023-12-19T05:46:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.552+0000 7f02ecb0c640 1 -- start start 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 0x7f02e81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 0x7f02e8158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8159630 con 0x7f02e815aa70 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8156670 con 0x7f02e8159f80 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02ecb0c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8159400 con 0x7f02e815b1e0 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.553+0000 7f02e6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53428/0 (socket says 172.21.15.49:53428) 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 -- 172.21.15.49:0/3697267030 learned_addr learned my addr 172.21.15.49:0/3697267030 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:13.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e77fe640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 0x7f02e81535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e7fff640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 0x7f02e8158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 -- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 msgr2=0x7f02e8158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 0x7f02e8158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 -- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 msgr2=0x7f02e81535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 0x7f02e81535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 -- 172.21.15.49:0/3697267030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009b30 con 0x7f02e815aa70 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e77fe640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 0x7f02e81535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e7fff640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 0x7f02e8158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.554+0000 7f02e6ffd640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b420 tx=0x7f02d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.555+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0011830 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.555+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0011990 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.555+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e8155cd0 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.555+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0011d40 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.555+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e8156290 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.556+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e81567b0 con 0x7f02e815aa70 2023-12-19T05:46:13.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.557+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02d001b460 con 0x7f02e815aa70 2023-12-19T05:46:13.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.558+0000 7f02dffff640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 0x7f02c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:13.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.558+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d0088570 con 0x7f02e815aa70 2023-12-19T05:46:13.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.559+0000 7f02e77fe640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 0x7f02c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:13.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.560+0000 7f02e77fe640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 0x7f02c806c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02d8035000 tx=0x7f02d8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:13.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.563+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02e81567b0 con 0x7f02e815aa70 2023-12-19T05:46:13.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.796+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e81567b0 con 0x7f02e815aa70 2023-12-19T05:46:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.797+0000 7f02dffff640 1 -- 172.21.15.49:0/3697267030 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f02e81567b0 con 0x7f02e815aa70 2023-12-19T05:46:13.799 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:13.799 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 msgr2=0x7f02c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 0x7f02c806c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02d8035000 tx=0x7f02d8030000 comp rx=0 tx=0).stop 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 msgr2=0x7f02e8156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b420 tx=0x7f02d000b8e0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 shutdown_connections 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f02c806a460 0x7f02c806c920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02e815b1e0 0x7f02e8158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e815aa70 0x7f02e8156a90 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 --2- 172.21.15.49:0/3697267030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02e8159f80 0x7f02e81535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 >> 172.21.15.49:0/3697267030 conn(0x7f02e80b0100 msgr2=0x7f02e8154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.800+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 shutdown_connections 2023-12-19T05:46:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:13.801+0000 7f02ecb0c640 1 -- 172.21.15.49:0/3697267030 wait complete. 2023-12-19T05:46:14.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:46:07.137327+0000', 'modified': '2023-12-19T05:46:10.674356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7215': {'gid': 7215, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/4232896600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 4232896600}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 4232896600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:46:14.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:46:14.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:46:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.462+0000 7f25c4a54640 1 Processor -- start 2023-12-19T05:46:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.462+0000 7f25c4a54640 1 -- start start 2023-12-19T05:46:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25c4a54640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25c0159e40 0x7f25c00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25c4a54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25c00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25c4a54640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c006b3a0 con 0x7f25c00b0830 2023-12-19T05:46:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25c4a54640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00b23e0 con 0x7f25c0159e40 2023-12-19T05:46:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25c4a54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00b0ca0 con 0x7f25c00cd430 2023-12-19T05:46:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25bffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25c00b0830 0x7f25c015da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53870/0 (socket says 172.21.15.49:53870) 2023-12-19T05:46:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25bffff640 1 -- 172.21.15.49:0/1999078423 learned_addr learned my addr 172.21.15.49:0/1999078423 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.464+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1999078423 >> v2:172.21.15.115:3300/0 conn(0x7f25c0159e40 0x7f25c00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25c00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199738125 0 0) 0x7f25c006b3a0 con 0x7f25c00b0830 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25ac003520 con 0x7f25c00b0830 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317231299 0 0) 0x7f25ac003520 con 0x7f25c00b0830 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 msgr2=0x7f25c00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25c00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 >> v2:172.21.15.115:3300/0 conn(0x7f25c0159e40 msgr2=0x7f25c00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 --2- 172.21.15.49:0/1999078423 >> v2:172.21.15.115:3300/0 conn(0x7f25c0159e40 0x7f25c00b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00cd8a0 con 0x7f25c00b0830 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f25b80019f0 con 0x7f25c00b0830 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 >> v1:172.21.15.49:6789/0 conn(0x7f25c00b0830 legacy=0x7f25c015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac003a10 0x7f25ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00b23e0 con 0x7f25ac0047c0 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00b0ca0 con 0x7f25ac003a10 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.465+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac00ba30 con 0x7f25c00cd430 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac003a10 0x7f25ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25bffff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 -- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 msgr2=0x7f25ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c00cd430 0x7f25ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 -- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac003a10 msgr2=0x7f25ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac003a10 0x7f25ac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.466+0000 7f25b7fff640 1 -- 172.21.15.49:0/1999078423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac003520 con 0x7f25ac0047c0 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25ac004c40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ac0 tx=0x7f25ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12817ed99d92c3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a802c6b0 con 0x7f25ac0047c0 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a802c810 con 0x7f25ac0047c0 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25beffd640 1 -- 172.21.15.49:0/1999078423 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a802cba0 con 0x7f25ac0047c0 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25c4a54640 1 -- 172.21.15.49:0/1999078423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 msgr2=0x7f25ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.468+0000 7f25c4a54640 1 --2- 172.21.15.49:0/1999078423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25ac004c40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ac0 tx=0x7f25ac0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.469+0000 7f25bffff640 1 -- 172.21.15.49:0/1999078423 reap_dead start 2023-12-19T05:46:14.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.469+0000 7f25c4a54640 1 -- 172.21.15.49:0/1999078423 shutdown_connections 2023-12-19T05:46:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.469+0000 7f25c4a54640 1 -- 172.21.15.49:0/1999078423 >> 172.21.15.49:0/1999078423 conn(0x7f25c00659a0 msgr2=0x7f25c0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.469+0000 7f25c4a54640 1 -- 172.21.15.49:0/1999078423 shutdown_connections 2023-12-19T05:46:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.469+0000 7f25c4a54640 1 -- 172.21.15.49:0/1999078423 wait complete. 2023-12-19T05:46:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.471+0000 7f25c4a54640 1 Processor -- start 2023-12-19T05:46:14.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.471+0000 7f25c4a54640 1 -- start start 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 0x7f25c006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c013be30 0x7f25c013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c013c7f0 con 0x7f25ac0047c0 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c006fba0 con 0x7f25c013be30 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25c4a54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c006fe80 con 0x7f25c006f100 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44622/0 (socket says 172.21.15.49:44622) 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25bf7fe640 1 -- 172.21.15.49:0/3419643038 learned_addr learned my addr 172.21.15.49:0/3419643038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.472+0000 7f25b7fff640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 0x7f25c006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bffff640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c013be30 0x7f25c013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 -- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 msgr2=0x7f25c006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 0x7f25c006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 -- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c013be30 msgr2=0x7f25c013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c013be30 0x7f25c013c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 -- 172.21.15.49:0/3419643038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0070160 con 0x7f25ac0047c0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25b7fff640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 0x7f25c006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f25b00116d0 tx=0x7f25b0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bcff9640 1 -- 172.21.15.49:0/3419643038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000f9c0 con 0x7f25ac0047c0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bcff9640 1 -- 172.21.15.49:0/3419643038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b000fb20 con 0x7f25ac0047c0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0070440 con 0x7f25ac0047c0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25bcff9640 1 -- 172.21.15.49:0/3419643038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000fe90 con 0x7f25ac0047c0 2023-12-19T05:46:14.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.473+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c01e51c0 con 0x7f25ac0047c0 2023-12-19T05:46:14.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.476+0000 7f25bcff9640 1 -- 172.21.15.49:0/3419643038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25b0015460 con 0x7f25ac0047c0 2023-12-19T05:46:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.476+0000 7f25bcff9640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 0x7f25a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.477+0000 7f25bcff9640 1 -- 172.21.15.49:0/3419643038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b00891a0 con 0x7f25ac0047c0 2023-12-19T05:46:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.477+0000 7f25b7fff640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 0x7f25a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.477+0000 7f25c8821740 1 Processor -- start 2023-12-19T05:46:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.478+0000 7f25c8821740 1 -- start start 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.478+0000 7f25b7fff640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 0x7f25a006c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f25a8036000 tx=0x7f25a8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x5620714202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 0x56207141d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207135ff80 con 0x5620713f3a90 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207135d710 con 0x5620713efe90 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x562071359000 con 0x56207141ff10 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44628/0 (socket says 172.21.15.49:44628) 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 -- 172.21.15.49:0/2561240929 learned_addr learned my addr 172.21.15.49:0/2561240929 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25b7fff640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 0x56207141d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 -- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 msgr2=0x5620714202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x5620714202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x5620714202f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 -- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 msgr2=0x56207141d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 0x56207141d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25bffff640 1 -- 172.21.15.49:0/2561240929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562071320690 con 0x5620713f3a90 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.479+0000 7f25b7fff640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 0x56207141d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.480+0000 7f25bffff640 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b0eb0 tx=0x7f25b8005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56679b947e9155a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.480+0000 7f25b57fa640 1 -- 172.21.15.49:0/2561240929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800d070 con 0x5620713f3a90 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.480+0000 7f25b57fa640 1 -- 172.21.15.49:0/2561240929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80078a0 con 0x5620713f3a90 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.480+0000 7f25b57fa640 1 -- 172.21.15.49:0/2561240929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8014430 con 0x5620713f3a90 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 -- 172.21.15.49:0/2561240929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 msgr2=0x56207141d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b0eb0 tx=0x7f25b8005f40 comp rx=0 tx=0).stop 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 -- 172.21.15.49:0/2561240929 shutdown_connections 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x56207141d6c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713efe90 0x56207141d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 --2- 172.21.15.49:0/2561240929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x5620714202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 -- 172.21.15.49:0/2561240929 >> 172.21.15.49:0/2561240929 conn(0x5620713f21a0 msgr2=0x56207143ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 -- 172.21.15.49:0/2561240929 shutdown_connections 2023-12-19T05:46:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.481+0000 7f25c8821740 1 -- 172.21.15.49:0/2561240929 wait complete. 2023-12-19T05:46:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.482+0000 7f25c8821740 1 -- start start 2023-12-19T05:46:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.482+0000 7f25c8821740 1 Processor -- start 2023-12-19T05:46:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207141af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207143d280 0x56207143d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620712fa7d0 con 0x5620713f3a90 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620712fa470 con 0x56207143d280 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620710c0f20 con 0x56207141ff10 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.483+0000 7f25c8821740 10 client.0 _ll_register_callbacks cb 0x5620713491b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44630/0 (socket says 172.21.15.49:44630) 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 -- 172.21.15.49:0/1919215647 learned_addr learned my addr 172.21.15.49:0/1919215647 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207141af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 -- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 msgr2=0x56207141af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207141af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 -- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207143d280 msgr2=0x56207143d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bffff640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207143d280 0x56207143d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207143d280 0x56207143d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 -- 172.21.15.49:0/1919215647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c00cd8a0 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f25b0087780 tx=0x7f25b0058d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a08a25fb1bc80f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.484+0000 7f259e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b006f070 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b00604c0 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562071383550 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b0060230 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 10 client.7347 fetch_fsmap learned FSMap version 56 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x562071357680 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562071383550 con 0x5620713f3a90 2023-12-19T05:46:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 56) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f25b001b020 con 0x5620713f3a90 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 10 client.7347 fetch_fsmap finished waiting for FSMap version 56 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 10 client.7347 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 20 client.7347 populate_metadata read hostname 'smithi049' 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x562071417740 0x562071417b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 4 client.7347 mds_command: new command op to 7215 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.485+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 --> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56207134bb50 con 0x562071417740 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.486+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x562071417740 0x562071417b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.486+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x562071417740 0x562071417b20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e9ba4b1be7006a server_cookie=c03e96d419496af7 in_seq=0 out_seq=0 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.486+0000 7f259e7fc640 10 client.7347 ms_handle_connect on v2:172.21.15.49:6833/4232896600 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.487+0000 7f259e7fc640 1 -- 172.21.15.49:0/1919215647 <== mds.0 v2:172.21.15.49:6833/4232896600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56207134bb50 con 0x562071417740 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.487+0000 7f259e7fc640 10 client.7347 handle_command_reply: tid=0 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.487+0000 7f25c8821740 1 client.7347 shutdown 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.487+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 msgr2=0x562071415550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.487+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f25b0087780 tx=0x7f25b0058d20 comp rx=0 tx=0).stop 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 shutdown_connections 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x562071417740 0x562071417b20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207141af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207143d280 0x56207143d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 --2- 172.21.15.49:0/1919215647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x562071415550 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 >> 172.21.15.49:0/1919215647 conn(0x5620713efe90 msgr2=0x562071423b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f259e7fc640 0 client.7347 ms_handle_reset on v2:172.21.15.49:6833/4232896600 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 shutdown_connections 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 1 -- 172.21.15.49:0/1919215647 wait complete. 2023-12-19T05:46:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.488+0000 7f25c8821740 20 client.7347 trim_cache size 0 max 16384 2023-12-19T05:46:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.507+0000 7f25c8821740 1 Processor -- start 2023-12-19T05:46:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.507+0000 7f25c8821740 1 -- start start 2023-12-19T05:46:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207141ff10 0x562071449440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207141da90 con 0x5620713f3a90 2023-12-19T05:46:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620713f6080 con 0x56207141ff10 2023-12-19T05:46:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.508+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56207144e1e0 con 0x56207143d280 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44644/0 (socket says 172.21.15.49:44644) 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 -- 172.21.15.49:0/51425582 learned_addr learned my addr 172.21.15.49:0/51425582 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 -- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207143d280 msgr2=0x562071423830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 -- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207141ff10 msgr2=0x562071449440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207141ff10 0x562071449440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 -- 172.21.15.49:0/51425582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620712f99e0 con 0x5620713f3a90 2023-12-19T05:46:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.509+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f25b0056830 tx=0x7f25b0089000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133f84559114569c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.510+0000 7f25b5ffb640 1 -- 172.21.15.49:0/51425582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b006f040 con 0x5620713f3a90 2023-12-19T05:46:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.510+0000 7f25b5ffb640 1 -- 172.21.15.49:0/51425582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b00604c0 con 0x5620713f3a90 2023-12-19T05:46:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.510+0000 7f25b5ffb640 1 -- 172.21.15.49:0/51425582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b005e410 con 0x5620713f3a90 2023-12-19T05:46:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.510+0000 7f25c8821740 1 -- 172.21.15.49:0/51425582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 msgr2=0x5620713f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.510+0000 7f25c8821740 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f25b0056830 tx=0x7f25b0089000 comp rx=0 tx=0).stop 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 -- 172.21.15.49:0/51425582 shutdown_connections 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56207141ff10 0x562071449440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 --2- 172.21.15.49:0/51425582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620713f3a90 0x5620713f4380 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 -- 172.21.15.49:0/51425582 >> 172.21.15.49:0/51425582 conn(0x5620713efe90 msgr2=0x5620713f0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 -- 172.21.15.49:0/51425582 shutdown_connections 2023-12-19T05:46:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 -- 172.21.15.49:0/51425582 wait complete. 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.511+0000 7f25c8821740 1 -- start start 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.512+0000 7f25c8821740 1 Processor -- start 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713f3a90 0x56207149fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207143cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207143c0d0 con 0x56207143d280 2023-12-19T05:46:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620714219b0 con 0x5620713f3a90 2023-12-19T05:46:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56207143d010 con 0x56207141ff10 2023-12-19T05:46:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25c8821740 10 client.0 _ll_register_callbacks cb 0x7f25b0011f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:46:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44656/0 (socket says 172.21.15.49:44656) 2023-12-19T05:46:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 -- 172.21.15.49:0/1981150673 learned_addr learned my addr 172.21.15.49:0/1981150673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25b7fff640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207143cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 -- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 msgr2=0x56207143cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713f3a90 0x56207149fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207143cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 -- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713f3a90 msgr2=0x56207149fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713f3a90 0x56207149fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.513+0000 7f25bffff640 1 -- 172.21.15.49:0/1981150673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562071357680 con 0x56207143d280 2023-12-19T05:46:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.514+0000 7f25bffff640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b3270 tx=0x7f25b8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e20122c1ebb6eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.514+0000 7f259e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:46:14.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.514+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800d040 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.514+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b8014b80 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.514+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25b80078a0 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b8014d40 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 10 client.7353 fetch_fsmap learned FSMap version 56 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x56207131eef0 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80078a0 con 0x56207143d280 2023-12-19T05:46:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 56) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f25b801f420 con 0x56207143d280 2023-12-19T05:46:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 10 client.7353 fetch_fsmap finished waiting for FSMap version 56 2023-12-19T05:46:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 10 client.7353 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:46:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 20 client.7353 populate_metadata read hostname 'smithi049' 2023-12-19T05:46:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x5620714184b0 0x562071418890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 4 client.7353 mds_command: new command op to 7215 tid=0[{"prefix": "status"}] 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 --> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562071352080 con 0x5620714184b0 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.515+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x5620714184b0 0x562071418890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25bf7fe640 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x5620714184b0 0x562071418890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c636f2d96aa3a4 server_cookie=c8c9782422ba84da in_seq=0 out_seq=0 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f259e7fc640 10 client.7353 ms_handle_connect on v2:172.21.15.49:6833/4232896600 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f259e7fc640 1 -- 172.21.15.49:0/1981150673 <== mds.0 v2:172.21.15.49:6833/4232896600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x562071352080 con 0x5620714184b0 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f259e7fc640 10 client.7353 handle_command_reply: tid=0 2023-12-19T05:46:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25c8821740 1 client.7353 shutdown 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 msgr2=0x562071423830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f25c00b3270 tx=0x7f25b8000f40 comp rx=0 tx=0).stop 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 shutdown_connections 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.516+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:6833/4232896600,v1:172.21.15.49:6834/4232896600] conn(0x5620714184b0 0x562071418890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56207141ff10 0x56207143cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56207143d280 0x562071423830 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 --2- 172.21.15.49:0/1981150673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620713f3a90 0x56207149fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f259e7fc640 0 client.7353 ms_handle_reset on v2:172.21.15.49:6833/4232896600 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 >> 172.21.15.49:0/1981150673 conn(0x5620713efe90 msgr2=0x562071417b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 shutdown_connections 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 1 -- 172.21.15.49:0/1981150673 wait complete. 2023-12-19T05:46:14.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c8821740 20 client.7353 trim_cache size 0 max 16384 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7215, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.374154538, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 56, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 128, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 128, 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.155992292000001 2023-12-19T05:46:14.527 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:46:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 msgr2=0x7f25a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 0x7f25a006c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f25a8036000 tx=0x7f25a8030000 comp rx=0 tx=0).stop 2023-12-19T05:46:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 msgr2=0x7f25c01e4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.517+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f25b00116d0 tx=0x7f25b0011b90 comp rx=0 tx=0).stop 2023-12-19T05:46:14.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 shutdown_connections 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25a006a430 0x7f25a006c8f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c006f100 0x7f25c006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c013be30 0x7f25c013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 --2- 172.21.15.49:0/3419643038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ac0047c0 0x7f25c01e4c80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 >> 172.21.15.49:0/3419643038 conn(0x7f25c00659a0 msgr2=0x7f25c01e4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 shutdown_connections 2023-12-19T05:46:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.518+0000 7f25c4a54640 1 -- 172.21.15.49:0/3419643038 wait complete. 2023-12-19T05:46:14.537 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:46:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.764+0000 7f415f59e640 1 Processor -- start 2023-12-19T05:46:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.764+0000 7f415f59e640 1 -- start start 2023-12-19T05:46:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f41600acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415f59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600ad250 con 0x7f416006fa90 2023-12-19T05:46:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b2fa0 con 0x7f416015e3f0 2023-12-19T05:46:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416006f600 con 0x7f41600ac8b0 2023-12-19T05:46:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415ed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f416006fa90 0x7f416006ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53880/0 (socket says 172.21.15.49:53880) 2023-12-19T05:46:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f415ed9d640 1 -- 172.21.15.49:0/704198054 learned_addr learned my addr 172.21.15.49:0/704198054 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.766+0000 7f4157fff640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f41600acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436884251 0 0) 0x7f41600ad250 con 0x7f416006fa90 2023-12-19T05:46:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c003520 con 0x7f416006fa90 2023-12-19T05:46:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482180759 0 0) 0x7f414c003520 con 0x7f416006fa90 2023-12-19T05:46:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 msgr2=0x7f41600acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f41600acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 >> v1:172.21.15.115:6789/0 conn(0x7f416015e3f0 legacy=0x7f41600b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416015e7d0 con 0x7f416006fa90 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f41580019f0 con 0x7f416006fa90 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 >> v1:172.21.15.49:6789/0 conn(0x7f416006fa90 legacy=0x7f416006ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f414c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f414c003f70 0x7f414c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f414c004d00 0x7f414c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416006f600 con 0x7f414c004d00 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00bb70 con 0x7f414c003f70 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.767+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00bd30 con 0x7f41600ac8b0 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f414c004d00 0x7f414c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415e59c640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f414c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f4157fff640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f414c003f70 0x7f414c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 -- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 msgr2=0x7f414c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600ac8b0 0x7f414c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 -- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f414c003f70 msgr2=0x7f414c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f414c003f70 0x7f414c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.768+0000 7f415ed9d640 1 -- 172.21.15.49:0/704198054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c003520 con 0x7f414c004d00 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.769+0000 7f415ed9d640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f414c004d00 0x7f414c005180 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f415800a760 tx=0x7f414c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb3fd2b0696edc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158034630 con 0x7f414c004d00 2023-12-19T05:46:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415802f070 con 0x7f414c004d00 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415dd9b640 1 -- 172.21.15.49:0/704198054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158034a50 con 0x7f414c004d00 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415f59e640 1 -- 172.21.15.49:0/704198054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f414c004d00 msgr2=0x7f414c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415f59e640 1 --2- 172.21.15.49:0/704198054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f414c004d00 0x7f414c005180 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f415800a760 tx=0x7f414c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415ed9d640 1 -- 172.21.15.49:0/704198054 reap_dead start 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415f59e640 1 -- 172.21.15.49:0/704198054 shutdown_connections 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.770+0000 7f415f59e640 1 -- 172.21.15.49:0/704198054 >> 172.21.15.49:0/704198054 conn(0x7f41600b0100 msgr2=0x7f41600b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.771+0000 7f415f59e640 1 -- 172.21.15.49:0/704198054 shutdown_connections 2023-12-19T05:46:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.771+0000 7f415f59e640 1 -- 172.21.15.49:0/704198054 wait complete. 2023-12-19T05:46:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.772+0000 7f415f59e640 1 Processor -- start 2023-12-19T05:46:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.773+0000 7f415f59e640 1 -- start start 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.773+0000 7f415f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f414c004d00 0x7f416006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.773+0000 7f415f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f416006fe70 0x7f41600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.773+0000 7f415f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600b25e0 con 0x7f41600b1bf0 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601f2980 con 0x7f416006fe70 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41601f2c60 con 0x7f414c004d00 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44672/0 (socket says 172.21.15.49:44672) 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 -- 172.21.15.49:0/317195319 learned_addr learned my addr 172.21.15.49:0/317195319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415e59c640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f414c004d00 0x7f416006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f4157fff640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f416006fe70 0x7f41600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 -- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f414c004d00 msgr2=0x7f416006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f414c004d00 0x7f416006dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 -- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f416006fe70 msgr2=0x7f41600702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f416006fe70 0x7f41600702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.774+0000 7f415ed9d640 1 -- 172.21.15.49:0/317195319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41601f2f40 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f415ed9d640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f415802cab0 tx=0x7f4158001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158034630 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4158034790 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158034b00 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41601f3220 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.775+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41601f3740 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.776+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41601f3410 con 0x7f41600b1bf0 2023-12-19T05:46:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.777+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4158031030 con 0x7f41600b1bf0 2023-12-19T05:46:14.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.778+0000 7f4156ffd640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:14.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.778+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41580aac00 con 0x7f41600b1bf0 2023-12-19T05:46:14.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.779+0000 7f415e59c640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:14.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.780+0000 7f415e59c640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41500035f0 tx=0x7f4150009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:14.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:14.782+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4158076270 con 0x7f41600b1bf0 2023-12-19T05:46:15.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.014+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41601f3410 con 0x7f41600b1bf0 2023-12-19T05:46:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.015+0000 7f4156ffd640 1 -- 172.21.15.49:0/317195319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f415803ee60 con 0x7f41600b1bf0 2023-12-19T05:46:15.016 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.017+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 msgr2=0x7f414006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.017+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41500035f0 tx=0x7f4150009040 comp rx=0 tx=0).stop 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.017+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 msgr2=0x7f41600b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.017+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f415802cab0 tx=0x7f4158001cb0 comp rx=0 tx=0).stop 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 shutdown_connections 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f414006a430 0x7f414006c8f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41600b1bf0 0x7f41600b20a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:15.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f416006fe70 0x7f41600702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:15.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 --2- 172.21.15.49:0/317195319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f414c004d00 0x7f416006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:15.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 >> 172.21.15.49:0/317195319 conn(0x7f41600b0100 msgr2=0x7f41600b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:15.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 shutdown_connections 2023-12-19T05:46:15.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:15.018+0000 7f415f59e640 1 -- 172.21.15.49:0/317195319 wait complete. 2023-12-19T05:46:15.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:46:15.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:46:15.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:46:15.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.040 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41918sec preferred_lft 41918sec 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:15.103 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:15.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.105 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:46:15.211 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:46:15.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.216 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:46:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:46:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:46:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:46:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:46:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:46:15.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:46:15.275 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:46:15.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.492 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:46:15.550 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:46:15.550 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:46:15.551 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:15.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:46:15.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:15.660 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:15.722 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:15.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:15.774 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:15.839 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:46:15.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:15.839 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:15.991 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:15.991 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:46:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:46:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:46:16.028 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:46:16.028 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:46:16.028 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:46:16.028 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:46:16.029 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:46:16.032 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:46:16.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:16.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.129 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:16.202 INFO:teuthology.orchestra.run.smithi049.stdout:client5705 2023-12-19T05:46:16.202 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:16.202 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:16.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:46:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.496+0000 7fe9a3fff640 1 Processor -- start 2023-12-19T05:46:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.497+0000 7fe9a3fff640 1 -- start start 2023-12-19T05:46:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.498+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 0x7fe9a40acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.498+0000 7fe9a3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe9a406fa90 0x7fe9a406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a3fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40ad250 con 0x7fe9a415e3f0 2023-12-19T05:46:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a3fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40b2fa0 con 0x7fe9a406fa90 2023-12-19T05:46:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a3fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a406f600 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe9a406fa90 0x7fe9a406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe9a406fa90 0x7fe9a406ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44676/0 (socket says 172.21.15.49:44676) 2023-12-19T05:46:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a37fe640 1 -- 172.21.15.49:0/1457670841 learned_addr learned my addr 172.21.15.49:0/1457670841 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe99bfff640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 0x7fe9a40acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.499+0000 7fe9a37fe640 1 -- 172.21.15.49:0/1457670841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 msgr2=0x7fe9a40acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.500+0000 7fe9a37fe640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 0x7fe9a40acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.500+0000 7fe9a37fe640 1 -- 172.21.15.49:0/1457670841 >> v1:172.21.15.115:6789/0 conn(0x7fe9a415e3f0 legacy=0x7fe9a40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.500+0000 7fe9a37fe640 1 -- 172.21.15.49:0/1457670841 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a415e7d0 con 0x7fe9a406fa90 2023-12-19T05:46:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.500+0000 7fe99bfff640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 0x7fe9a40acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.501+0000 7fe9a37fe640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a406fa90 0x7fe9a406ff20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e50 tx=0x7fe99c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54461723ba1b7973 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.502+0000 7fe9a27fc640 1 -- 172.21.15.49:0/1457670841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c02ca80 con 0x7fe9a406fa90 2023-12-19T05:46:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.502+0000 7fe9a27fc640 1 -- 172.21.15.49:0/1457670841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c02cbe0 con 0x7fe9a406fa90 2023-12-19T05:46:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.502+0000 7fe9a27fc640 1 -- 172.21.15.49:0/1457670841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0343f0 con 0x7fe9a406fa90 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.502+0000 7fe9a3fff640 1 -- 172.21.15.49:0/1457670841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a406fa90 msgr2=0x7fe9a406ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.502+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a406fa90 0x7fe9a406ff20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e50 tx=0x7fe99c02bee0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 -- 172.21.15.49:0/1457670841 shutdown_connections 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a40ac8b0 0x7fe9a40acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/1457670841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a406fa90 0x7fe9a406ff20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 -- 172.21.15.49:0/1457670841 >> 172.21.15.49:0/1457670841 conn(0x7fe9a40b0100 msgr2=0x7fe9a40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 -- 172.21.15.49:0/1457670841 shutdown_connections 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.503+0000 7fe9a3fff640 1 -- 172.21.15.49:0/1457670841 wait complete. 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.504+0000 7fe9a3fff640 1 Processor -- start 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.505+0000 7fe9a3fff640 1 -- start start 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 0x7fe9a406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a415e3f0 0x7fe9a415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a414b220 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41f2630 con 0x7fe9a415e3f0 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a3fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a406d350 con 0x7fe9a406fa90 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44688/0 (socket says 172.21.15.49:44688) 2023-12-19T05:46:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 -- 172.21.15.49:0/3625319617 learned_addr learned my addr 172.21.15.49:0/3625319617 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a37fe640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a415e3f0 0x7fe9a415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe9a2ffd640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 0x7fe9a406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 -- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 msgr2=0x7fe9a406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 0x7fe9a406ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 -- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a415e3f0 msgr2=0x7fe9a415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a415e3f0 0x7fe9a415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.506+0000 7fe99bfff640 1 -- 172.21.15.49:0/3625319617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009b30 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe9a2ffd640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 0x7fe9a406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe99bfff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00c7f0 tx=0x7fe98c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c007820 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c007980 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c007cf0 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a406d630 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.507+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a406dbf0 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.508+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a4061910 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.509+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe98c0113f0 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.510+0000 7fe99b7fe640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 0x7fe98406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.510+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe98c088ce0 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.511+0000 7fe9a2ffd640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 0x7fe98406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.512+0000 7fe9a2ffd640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 0x7fe98406c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe994000f60 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.515+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe98c054230 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.752+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9a40ad640 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.753+0000 7fe99b7fe640 1 -- 172.21.15.49:0/3625319617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe98c01f070 con 0x7fe9a40ac8b0 2023-12-19T05:46:16.754 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:46:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 msgr2=0x7fe98406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 0x7fe98406c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe994000f60 tx=0x7fe994009040 comp rx=0 tx=0).stop 2023-12-19T05:46:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 msgr2=0x7fe9a414ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00c7f0 tx=0x7fe98c00ccb0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 shutdown_connections 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98406a430 0x7fe98406c8f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a415e3f0 0x7fe9a415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a40ac8b0 0x7fe9a414ace0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 --2- 172.21.15.49:0/3625319617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9a406fa90 0x7fe9a406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 >> 172.21.15.49:0/3625319617 conn(0x7fe9a40b0100 msgr2=0x7fe9a415e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 shutdown_connections 2023-12-19T05:46:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:16.756+0000 7fe9a3fff640 1 -- 172.21.15.49:0/3625319617 wait complete. 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:46:16.779 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:46:16.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.779 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:46:16.838 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:46:16.838 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:46:16.839 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41933sec preferred_lft 41933sec 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.840 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:16.841 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:46:16.841 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:46:16.841 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:16.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.842 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:46:16.934 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:46:16.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.938 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:46:16.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:46:16.993 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:46:17.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:17.170 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:46:17.223 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:46:17.223 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:46:17.224 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:46:17.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:17.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:46:17.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:17.320 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:46:17.376 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:46:17.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:17.376 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:46:17.428 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:46:17.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:17.429 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:17.568 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:17.568 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:17.602 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:17.602 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:17.602 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:46:17.602 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:46:17.602 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:46:17.604 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:46:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:46:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:46:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:46:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:46:17.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:46:17.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:17.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:46:17.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:17.686 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:17.738 INFO:teuthology.orchestra.run.smithi115.stdout:client5708 2023-12-19T05:46:17.738 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:17.738 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:17.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:18.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.032+0000 7efd38a73640 1 Processor -- start 2023-12-19T05:46:18.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.033+0000 7efd38a73640 1 -- start start 2023-12-19T05:46:18.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.034+0000 7efd38a73640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd340b8070 0x7efd340d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.034+0000 7efd38a73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd3415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.034+0000 7efd38a73640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340d12d0 con 0x7efd34146e30 2023-12-19T05:46:18.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.034+0000 7efd38a73640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd34147210 con 0x7efd340b8070 2023-12-19T05:46:18.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.034+0000 7efd38a73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340d2370 con 0x7efd340d0a90 2023-12-19T05:46:18.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.035+0000 7efd2bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd340b8070 0x7efd340d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.035+0000 7efd337fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efd34146e30 0x7efd340b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:37118/0 (socket says 172.21.15.49:37118) 2023-12-19T05:46:18.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.035+0000 7efd33fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd3415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.035+0000 7efd337fe640 1 -- 172.21.15.49:0/3591250325 learned_addr learned my addr 172.21.15.49:0/3591250325 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.035+0000 7efd32ffd640 1 -- 172.21.15.49:0/3591250325 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498251522 0 0) 0x7efd340d12d0 con 0x7efd34146e30 2023-12-19T05:46:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.036+0000 7efd33fff640 1 -- 172.21.15.49:0/3591250325 >> v2:172.21.15.115:3300/0 conn(0x7efd340b8070 msgr2=0x7efd340d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.036+0000 7efd33fff640 1 --2- 172.21.15.49:0/3591250325 >> v2:172.21.15.115:3300/0 conn(0x7efd340b8070 0x7efd340d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.036+0000 7efd33fff640 1 -- 172.21.15.49:0/3591250325 >> v1:172.21.15.115:6789/0 conn(0x7efd34146e30 legacy=0x7efd340b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.036+0000 7efd33fff640 1 -- 172.21.15.49:0/3591250325 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340d15b0 con 0x7efd340d0a90 2023-12-19T05:46:18.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.037+0000 7efd33fff640 1 --2- 172.21.15.49:0/3591250325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd3415d870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a939ca797d7589b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.037+0000 7efd32ffd640 1 -- 172.21.15.49:0/3591250325 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c02cbc0 con 0x7efd340d0a90 2023-12-19T05:46:18.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd32ffd640 1 -- 172.21.15.49:0/3591250325 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c02cd20 con 0x7efd340d0a90 2023-12-19T05:46:18.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd32ffd640 1 -- 172.21.15.49:0/3591250325 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c034660 con 0x7efd340d0a90 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 -- 172.21.15.49:0/3591250325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 msgr2=0x7efd3415d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 --2- 172.21.15.49:0/3591250325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd3415d870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c02be10 comp rx=0 tx=0).stop 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 -- 172.21.15.49:0/3591250325 shutdown_connections 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 --2- 172.21.15.49:0/3591250325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd3415d870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 --2- 172.21.15.49:0/3591250325 >> v2:172.21.15.115:3300/0 conn(0x7efd340b8070 0x7efd340d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 -- 172.21.15.49:0/3591250325 >> 172.21.15.49:0/3591250325 conn(0x7efd340b2990 msgr2=0x7efd340b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 -- 172.21.15.49:0/3591250325 shutdown_connections 2023-12-19T05:46:18.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.038+0000 7efd38a73640 1 -- 172.21.15.49:0/3591250325 wait complete. 2023-12-19T05:46:18.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.040+0000 7efd38a73640 1 Processor -- start 2023-12-19T05:46:18.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.041+0000 7efd38a73640 1 -- start start 2023-12-19T05:46:18.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.041+0000 7efd38a73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 0x7efd341ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.041+0000 7efd38a73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd340b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd38a73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd38a73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3413ca40 con 0x7efd34146e30 2023-12-19T05:46:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd38a73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd341df300 con 0x7efd340b8070 2023-12-19T05:46:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd38a73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3413cc90 con 0x7efd340d0a90 2023-12-19T05:46:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44698/0 (socket says 172.21.15.49:44698) 2023-12-19T05:46:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 -- 172.21.15.49:0/1369722680 learned_addr learned my addr 172.21.15.49:0/1369722680 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:18.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd2bfff640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd340b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd337fe640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 0x7efd341ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 -- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 msgr2=0x7efd340b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd340b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 -- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 msgr2=0x7efd341ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 0x7efd341ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd33fff640 1 -- 172.21.15.49:0/1369722680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009a70 con 0x7efd34146e30 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.042+0000 7efd337fe640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 0x7efd341ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd2bfff640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd340b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd33fff640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c003b90 con 0x7efd34146e30 2023-12-19T05:46:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c02ce90 con 0x7efd34146e30 2023-12-19T05:46:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c009450 con 0x7efd34146e30 2023-12-19T05:46:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3413cf70 con 0x7efd34146e30 2023-12-19T05:46:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.043+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd340b6a70 con 0x7efd34146e30 2023-12-19T05:46:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.044+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3413d490 con 0x7efd34146e30 2023-12-19T05:46:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.045+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd2c03b050 con 0x7efd34146e30 2023-12-19T05:46:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.047+0000 7efd30ff9640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 0x7efd1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.047+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd2c0aad40 con 0x7efd34146e30 2023-12-19T05:46:18.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.048+0000 7efd337fe640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 0x7efd1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.049+0000 7efd337fe640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 0x7efd1406c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efd24000f60 tx=0x7efd24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.051+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd3413d490 con 0x7efd34146e30 2023-12-19T05:46:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.285+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd3413d490 con 0x7efd34146e30 2023-12-19T05:46:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.286+0000 7efd30ff9640 1 -- 172.21.15.49:0/1369722680 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7efd3413d490 con 0x7efd34146e30 2023-12-19T05:46:18.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:18.288 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 msgr2=0x7efd1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 0x7efd1406c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efd24000f60 tx=0x7efd24009040 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 msgr2=0x7efd341e1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 shutdown_connections 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efd1406a430 0x7efd1406c8f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd340d0a90 0x7efd340b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd34146e30 0x7efd341e1a00 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 --2- 172.21.15.49:0/1369722680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd340b8070 0x7efd341ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 >> 172.21.15.49:0/1369722680 conn(0x7efd340b2990 msgr2=0x7efd340b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 shutdown_connections 2023-12-19T05:46:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.289+0000 7efd38a73640 1 -- 172.21.15.49:0/1369722680 wait complete. 2023-12-19T05:46:18.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:46:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":7215,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.38977642,"mdsmap_epoch":56,"osdmap_epoch":128,"osdmap_epoch_barrier":128,"uptime":17.171628273} 2023-12-19T05:46:18.550 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 7215, "mdsmap_epoch": 56, "osdmap_epoch": 128, "osdmap_epoch_barrier": 128, "rank_uptime": 11.38977642, "state": "up:active", "uptime": 17.171628273, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:46:18.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T05:46:18.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.790+0000 7ff42f367640 1 Processor -- start 2023-12-19T05:46:18.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.790+0000 7ff42f367640 1 -- start start 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42f367640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff42815afd0 0x7ff4280ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42f367640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff42806d070 0x7ff4280afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42f367640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42815f920 con 0x7ff4280b02f0 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42f367640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280adc40 con 0x7ff42806d070 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42f367640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280b0720 con 0x7ff42815afd0 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.792+0000 7ff42db64640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff42806d070 0x7ff4280afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff42806d070 0x7ff4280afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44706/0 (socket says 172.21.15.49:44706) 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 -- 172.21.15.49:0/1394358556 learned_addr learned my addr 172.21.15.49:0/1394358556 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42e365640 1 --2- 172.21.15.49:0/1394358556 >> v2:172.21.15.115:3300/0 conn(0x7ff42815afd0 0x7ff4280ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 -- 172.21.15.49:0/1394358556 >> v2:172.21.15.115:3300/0 conn(0x7ff42815afd0 msgr2=0x7ff4280ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:18.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 --2- 172.21.15.49:0/1394358556 >> v2:172.21.15.115:3300/0 conn(0x7ff42815afd0 0x7ff4280ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 -- 172.21.15.49:0/1394358556 >> v1:172.21.15.115:6789/0 conn(0x7ff4280b02f0 legacy=0x7ff4280ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:18.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.793+0000 7ff42db64640 1 -- 172.21.15.49:0/1394358556 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42815ed10 con 0x7ff42806d070 2023-12-19T05:46:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.794+0000 7ff42db64640 1 --2- 172.21.15.49:0/1394358556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4280afdb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff4280cfd80 tx=0x7ff41c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3641e00c64b1e411 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42d363640 1 -- 172.21.15.49:0/1394358556 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c031870 con 0x7ff42806d070 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42d363640 1 -- 172.21.15.49:0/1394358556 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0319d0 con 0x7ff42806d070 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42d363640 1 -- 172.21.15.49:0/1394358556 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c031d60 con 0x7ff42806d070 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42f367640 1 -- 172.21.15.49:0/1394358556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 msgr2=0x7ff4280afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42f367640 1 --2- 172.21.15.49:0/1394358556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4280afdb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff4280cfd80 tx=0x7ff41c02b910 comp rx=0 tx=0).stop 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.795+0000 7ff42f367640 1 -- 172.21.15.49:0/1394358556 shutdown_connections 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.796+0000 7ff42f367640 1 --2- 172.21.15.49:0/1394358556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4280afdb0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.796+0000 7ff42f367640 1 --2- 172.21.15.49:0/1394358556 >> v2:172.21.15.115:3300/0 conn(0x7ff42815afd0 0x7ff4280ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.796+0000 7ff42f367640 1 -- 172.21.15.49:0/1394358556 >> 172.21.15.49:0/1394358556 conn(0x7ff4280b4750 msgr2=0x7ff4280659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.796+0000 7ff42f367640 1 -- 172.21.15.49:0/1394358556 shutdown_connections 2023-12-19T05:46:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.796+0000 7ff42f367640 1 -- 172.21.15.49:0/1394358556 wait complete. 2023-12-19T05:46:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.797+0000 7ff42f367640 1 Processor -- start 2023-12-19T05:46:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.798+0000 7ff42f367640 1 -- start start 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.798+0000 7ff42f367640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.798+0000 7ff42f367640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4280b02f0 0x7ff4280aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42f367640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff42815afd0 0x7ff4280af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42f367640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4281f6b70 con 0x7ff42806d070 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42f367640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4281f5b80 con 0x7ff4280b02f0 2023-12-19T05:46:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42f367640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4281f5f10 con 0x7ff42815afd0 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44722/0 (socket says 172.21.15.49:44722) 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 -- 172.21.15.49:0/1667750793 learned_addr learned my addr 172.21.15.49:0/1667750793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42db64640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4280b02f0 0x7ff4280aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 -- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff42815afd0 msgr2=0x7ff4280af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff42815afd0 0x7ff4280af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 -- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4280b02f0 msgr2=0x7ff4280aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4280b02f0 0x7ff4280aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.799+0000 7ff42e365640 1 -- 172.21.15.49:0/1667750793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0094d0 con 0x7ff42806d070 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff42e365640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d5f0 tx=0x7ff42400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4240125f0 con 0x7ff42806d070 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424012750 con 0x7ff42806d070 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424012b00 con 0x7ff42806d070 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4281f61d0 con 0x7ff42806d070 2023-12-19T05:46:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.800+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4281f6790 con 0x7ff42806d070 2023-12-19T05:46:18.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.801+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428061910 con 0x7ff42806d070 2023-12-19T05:46:18.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.802+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff424012c60 con 0x7ff42806d070 2023-12-19T05:46:18.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.803+0000 7ff41affd640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 0x7ff40c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.803+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff424088db0 con 0x7ff42806d070 2023-12-19T05:46:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.804+0000 7ff42db64640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 0x7ff40c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.805+0000 7ff42db64640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 0x7ff40c06c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff41c036000 tx=0x7ff41c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:18.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:18.808+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff42408d070 con 0x7ff42806d070 2023-12-19T05:46:19.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.007+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ff428066710 con 0x7ff42806d070 2023-12-19T05:46:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.750+0000 7ff41affd640 1 -- 172.21.15.49:0/1667750793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff424054300 con 0x7ff42806d070 2023-12-19T05:46:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T05:46:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 msgr2=0x7ff40c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 0x7ff40c06c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff41c036000 tx=0x7ff41c03c040 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 msgr2=0x7ff4281f5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d5f0 tx=0x7ff42400dab0 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 shutdown_connections 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff40c06a430 0x7ff40c06c8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff42815afd0 0x7ff4280af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4280b02f0 0x7ff4280aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 --2- 172.21.15.49:0/1667750793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff42806d070 0x7ff4281f5640 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 >> 172.21.15.49:0/1667750793 conn(0x7ff4280b4750 msgr2=0x7ff428157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 shutdown_connections 2023-12-19T05:46:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:19.754+0000 7ff42f367640 1 -- 172.21.15.49:0/1667750793 wait complete. 2023-12-19T05:46:19.777 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:46:19.777 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:46:19.777 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:46:19.778 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:46:19.778 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:46:19.778 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:46:19.778 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:46:20.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:20.110 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:20.221 INFO:teuthology.orchestra.run.smithi049.stdout:client5705 2023-12-19T05:46:20.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:20.221 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client5705/osdmap') 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 128 barrier 128 flags 0x588000 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:46:20.332 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:46:20.333 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:46:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:46:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:46:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:799 bytes copied, 0.000126671 s, 6.3 MB/s 2023-12-19T05:46:20.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-19T05:46:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.566+0000 7f80f61f0640 1 Processor -- start 2023-12-19T05:46:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.566+0000 7f80f61f0640 1 -- start start 2023-12-19T05:46:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80f61f0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80f00b0b50 0x7f80f006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80f61f0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f006bb30 con 0x7f80f006b590 2023-12-19T05:46:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80f61f0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00b0070 con 0x7f80f01449e0 2023-12-19T05:46:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80f61f0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00b0350 con 0x7f80f00b0b50 2023-12-19T05:46:20.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80effff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f80f006b590 0x7f80f00b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53886/0 (socket says 172.21.15.49:53886) 2023-12-19T05:46:20.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80effff640 1 -- 172.21.15.49:0/673312118 learned_addr learned my addr 172.21.15.49:0/673312118 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80e7fff640 1 --2- 172.21.15.49:0/673312118 >> v2:172.21.15.115:3300/0 conn(0x7f80f00b0b50 0x7f80f006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.568+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608042882 0 0) 0x7f80f006bb30 con 0x7f80f006b590 2023-12-19T05:46:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80dc003520 con 0x7f80f006b590 2023-12-19T05:46:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226887629 0 0) 0x7f80dc003520 con 0x7f80f006b590 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 >> v2:172.21.15.115:3300/0 conn(0x7f80f00b0b50 msgr2=0x7f80f006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 --2- 172.21.15.49:0/673312118 >> v2:172.21.15.115:3300/0 conn(0x7f80f00b0b50 0x7f80f006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 >> v1:172.21.15.115:6789/0 conn(0x7f80f01449e0 legacy=0x7f80f00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00b0630 con 0x7f80f006b590 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f80e80019f0 con 0x7f80f006b590 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 >> v1:172.21.15.49:6789/0 conn(0x7f80f006b590 legacy=0x7f80f00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0039e0 0x7f80dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 0x7f80dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80dc005180 0x7f80dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00b0350 con 0x7f80dc0047c0 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc00c0b0 con 0x7f80dc0039e0 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc00c270 con 0x7f80dc005180 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.569+0000 7f80e7fff640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 0x7f80dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80ef7fe640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0039e0 0x7f80dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80effff640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80dc005180 0x7f80dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80e7fff640 1 -- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80dc005180 msgr2=0x7f80dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80e7fff640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80dc005180 0x7f80dc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80e7fff640 1 -- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0039e0 msgr2=0x7f80dc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80e7fff640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0039e0 0x7f80dc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80e7fff640 1 -- 172.21.15.49:0/673312118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc003520 con 0x7f80dc0047c0 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80ef7fe640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0039e0 0x7f80dc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.570+0000 7f80effff640 1 -- 172.21.15.49:0/673312118 reap_dead start 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.571+0000 7f80e7fff640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 0x7f80dc004c40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009ac0 tx=0x7f80dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621106be8f611b67 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.571+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d802c6b0 con 0x7f80dc0047c0 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.571+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d802c810 con 0x7f80dc0047c0 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.571+0000 7f80eeffd640 1 -- 172.21.15.49:0/673312118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d802cba0 con 0x7f80dc0047c0 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 -- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 msgr2=0x7f80dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 0x7f80dc004c40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009ac0 tx=0x7f80dc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 -- 172.21.15.49:0/673312118 shutdown_connections 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 --2- 172.21.15.49:0/673312118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80dc0047c0 0x7f80dc004c40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 -- 172.21.15.49:0/673312118 >> 172.21.15.49:0/673312118 conn(0x7f80f00cbb70 msgr2=0x7f80f00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 -- 172.21.15.49:0/673312118 shutdown_connections 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.572+0000 7f80f61f0640 1 -- 172.21.15.49:0/673312118 wait complete. 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.574+0000 7f80f61f0640 1 Processor -- start 2023-12-19T05:46:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.574+0000 7f80f61f0640 1 -- start start 2023-12-19T05:46:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0047c0 0x7f80f00ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80f01f3c50 0x7f80f0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00adf80 con 0x7f80f00ad5c0 2023-12-19T05:46:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00acdf0 con 0x7f80dc0047c0 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.575+0000 7f80f61f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00abd50 con 0x7f80f01f3c50 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44740/0 (socket says 172.21.15.49:44740) 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 -- 172.21.15.49:0/1175858296 learned_addr learned my addr 172.21.15.49:0/1175858296 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80ef7fe640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0047c0 0x7f80f00ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80e7fff640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80f01f3c50 0x7f80f0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 -- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80f01f3c50 msgr2=0x7f80f0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80f01f3c50 0x7f80f0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 -- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0047c0 msgr2=0x7f80f00ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0047c0 0x7f80f00ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.576+0000 7f80effff640 1 -- 172.21.15.49:0/1175858296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00ac030 con 0x7f80f00ad5c0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80effff640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000f80 tx=0x7f80e800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004d60 con 0x7f80f00ad5c0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800bb80 con 0x7f80f00ad5c0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007070 con 0x7f80f00ad5c0 2023-12-19T05:46:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00ac310 con 0x7f80f00ad5c0 2023-12-19T05:46:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.577+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f00ac8d0 con 0x7f80f00ad5c0 2023-12-19T05:46:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.578+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f0061910 con 0x7f80f00ad5c0 2023-12-19T05:46:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.579+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80e80071d0 con 0x7f80f00ad5c0 2023-12-19T05:46:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.580+0000 7f80ecff9640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 0x7f80d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.580+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80e8088660 con 0x7f80f00ad5c0 2023-12-19T05:46:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.581+0000 7f80ef7fe640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 0x7f80d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.582+0000 7f80ef7fe640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 0x7f80d006c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ce8e0 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.585+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f80e8053c50 con 0x7f80f00ad5c0 2023-12-19T05:46:20.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:20.790+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f80f006bb20 con 0x7f80f00ad5c0 2023-12-19T05:46:21.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.768+0000 7f80ecff9640 1 -- 172.21.15.49:0/1175858296 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v130) v1 ==== 93+0+0 (secure 0 0 0) 0x7f80e8057270 con 0x7f80f00ad5c0 2023-12-19T05:46:21.770 INFO:teuthology.orchestra.run.smithi049.stderr:pauserd,pausewr is set 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.771+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 msgr2=0x7f80d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.771+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 0x7f80d006c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ce8e0 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.771+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 msgr2=0x7f80f00ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.771+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000f80 tx=0x7f80e800b4a0 comp rx=0 tx=0).stop 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 shutdown_connections 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f80d006a430 0x7f80d006c8f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80f01f3c50 0x7f80f0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80f00ad5c0 0x7f80f00ada40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 --2- 172.21.15.49:0/1175858296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80dc0047c0 0x7f80f00ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 >> 172.21.15.49:0/1175858296 conn(0x7f80f00cbb70 msgr2=0x7f80f015c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 shutdown_connections 2023-12-19T05:46:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:21.772+0000 7f80f61f0640 1 -- 172.21.15.49:0/1175858296 wait complete. 2023-12-19T05:46:21.798 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-19T05:46:22.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.030+0000 7f9fef59e640 1 Processor -- start 2023-12-19T05:46:22.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.030+0000 7f9fef59e640 1 -- start start 2023-12-19T05:46:22.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ff0157710 0x7f9ff00b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b2990 0x7f9ff00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ff00b0830 0x7f9ff00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00b0c80 con 0x7f9ff0157710 2023-12-19T05:46:22.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff015d7d0 con 0x7f9ff00b0830 2023-12-19T05:46:22.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.032+0000 7f9fef59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00b2ea0 con 0x7f9ff00b2990 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ff0157710 0x7f9ff00b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ff0157710 0x7f9ff00b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44752/0 (socket says 172.21.15.49:44752) 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 -- 172.21.15.49:0/2624271002 learned_addr learned my addr 172.21.15.49:0/2624271002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fedd9b640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b2990 0x7f9ff00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9feed9d640 1 --2- 172.21.15.49:0/2624271002 >> v2:172.21.15.115:3300/0 conn(0x7f9ff00b0830 0x7f9ff00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 -- 172.21.15.49:0/2624271002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b2990 msgr2=0x7f9ff00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b2990 0x7f9ff00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 -- 172.21.15.49:0/2624271002 >> v2:172.21.15.115:3300/0 conn(0x7f9ff00b0830 msgr2=0x7f9ff00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 --2- 172.21.15.49:0/2624271002 >> v2:172.21.15.115:3300/0 conn(0x7f9ff00b0830 0x7f9ff00ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.033+0000 7f9fee59c640 1 -- 172.21.15.49:0/2624271002 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff015da90 con 0x7f9ff0157710 2023-12-19T05:46:22.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.035+0000 7f9fee59c640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff00b2450 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00b0fb0 tx=0x7f9fe002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc12d3113f7d565 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:22.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fed59a640 1 -- 172.21.15.49:0/2624271002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0031750 con 0x7f9ff0157710 2023-12-19T05:46:22.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fed59a640 1 -- 172.21.15.49:0/2624271002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe00318b0 con 0x7f9ff0157710 2023-12-19T05:46:22.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fed59a640 1 -- 172.21.15.49:0/2624271002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0031c40 con 0x7f9ff0157710 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 -- 172.21.15.49:0/2624271002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 msgr2=0x7f9ff00b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff00b2450 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00b0fb0 tx=0x7f9fe002b7f0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 -- 172.21.15.49:0/2624271002 shutdown_connections 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 --2- 172.21.15.49:0/2624271002 >> v2:172.21.15.115:3300/0 conn(0x7f9ff00b0830 0x7f9ff00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b2990 0x7f9ff00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 --2- 172.21.15.49:0/2624271002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff00b2450 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.036+0000 7f9fef59e640 1 -- 172.21.15.49:0/2624271002 >> 172.21.15.49:0/2624271002 conn(0x7f9ff00659a0 msgr2=0x7f9ff0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.037+0000 7f9fef59e640 1 -- 172.21.15.49:0/2624271002 shutdown_connections 2023-12-19T05:46:22.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.037+0000 7f9fef59e640 1 -- 172.21.15.49:0/2624271002 wait complete. 2023-12-19T05:46:22.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.038+0000 7f9fef59e640 1 Processor -- start 2023-12-19T05:46:22.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.039+0000 7f9fef59e640 1 -- start start 2023-12-19T05:46:22.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b0830 0x7f9ff014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 0x7f9ff014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff014ec60 con 0x7f9ff0157710 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0151f20 con 0x7f9ff00b2990 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fef59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0152200 con 0x7f9ff00b0830 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9feed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9feed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44762/0 (socket says 172.21.15.49:44762) 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9feed9d640 1 -- 172.21.15.49:0/3707580525 learned_addr learned my addr 172.21.15.49:0/3707580525 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fedd9b640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 0x7f9ff014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.040+0000 7f9fee59c640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b0830 0x7f9ff014e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 -- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b0830 msgr2=0x7f9ff014e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b0830 0x7f9ff014e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 -- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 msgr2=0x7f9ff014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 0x7f9ff014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094d0 con 0x7f9ff0157710 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9fedd9b640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 0x7f9ff014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9feed9d640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800eed0 tx=0x7f9fe800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8010040 con 0x7f9ff0157710 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8014400 con 0x7f9ff0157710 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8009ea0 con 0x7f9ff0157710 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.041+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff01524e0 con 0x7f9ff0157710 2023-12-19T05:46:22.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.042+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff0151bd0 con 0x7f9ff0157710 2023-12-19T05:46:22.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.043+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0152a00 con 0x7f9ff0157710 2023-12-19T05:46:22.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.044+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fe80147b0 con 0x7f9ff0157710 2023-12-19T05:46:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.045+0000 7f9fe6ffd640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 0x7f9fd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.045+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fe80890c0 con 0x7f9ff0157710 2023-12-19T05:46:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.046+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=131+}) v3 -- 0x7f9fd0071f60 con 0x7f9ff0157710 2023-12-19T05:46:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.046+0000 7f9fee59c640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 0x7f9fd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.047+0000 7f9fee59c640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 0x7f9fd006c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0035000 tx=0x7f9fe0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.050+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fe80546a0 con 0x7f9ff0157710 2023-12-19T05:46:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.253+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f9ff0061910 con 0x7f9ff0157710 2023-12-19T05:46:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.775+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(131..131 src has 1..131) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9fe8058a60 con 0x7f9ff0157710 2023-12-19T05:46:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.775+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=132}) v3 -- 0x7f9fd0072810 con 0x7f9ff0157710 2023-12-19T05:46:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.781+0000 7f9fe6ffd640 1 -- 172.21.15.49:0/3707580525 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9fe8018030 con 0x7f9ff0157710 2023-12-19T05:46:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:pauserd,pausewr is unset 2023-12-19T05:46:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.785+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 msgr2=0x7f9fd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.785+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 0x7f9fd006c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0035000 tx=0x7f9fe0008030 comp rx=0 tx=0).stop 2023-12-19T05:46:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.785+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 msgr2=0x7f9ff0150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.785+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800eed0 tx=0x7f9fe800b480 comp rx=0 tx=0).stop 2023-12-19T05:46:22.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 shutdown_connections 2023-12-19T05:46:22.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fd006a430 0x7f9fd006c8f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ff0157710 0x7f9ff0150400 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ff00b2990 0x7f9ff014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 --2- 172.21.15.49:0/3707580525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ff00b0830 0x7f9ff014e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 >> 172.21.15.49:0/3707580525 conn(0x7f9ff00659a0 msgr2=0x7f9ff00b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 shutdown_connections 2023-12-19T05:46:22.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:22.786+0000 7f9fef59e640 1 -- 172.21.15.49:0/3707580525 wait complete. 2023-12-19T05:46:22.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:23.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.034+0000 7f2614238640 1 Processor -- start 2023-12-19T05:46:23.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.034+0000 7f2614238640 1 -- start start 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.036+0000 7f2614238640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f260c166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.036+0000 7f2614238640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c06bb30 con 0x7f260c1449e0 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.036+0000 7f2614238640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0b0070 con 0x7f260c0b0b50 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.036+0000 7f2614238640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b0350 con 0x7f260c06c6b0 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.036+0000 7f2611fd4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f260c1449e0 0x7f260c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53892/0 (socket says 172.21.15.49:53892) 2023-12-19T05:46:23.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2611fd4640 1 -- 172.21.15.49:0/676420606 learned_addr learned my addr 172.21.15.49:0/676420606 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f26127d5640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f260c166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683427277 0 0) 0x7f260c06bb30 con 0x7f260c1449e0 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f8003520 con 0x7f260c1449e0 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637395628 0 0) 0x7f25f8003520 con 0x7f260c1449e0 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 msgr2=0x7f260c166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f260c166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 >> v1:172.21.15.115:6789/0 conn(0x7f260c0b0b50 legacy=0x7f260c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0b0630 con 0x7f260c1449e0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.037+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f2608001670 con 0x7f260c1449e0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 >> v1:172.21.15.49:6789/0 conn(0x7f260c1449e0 legacy=0x7f260c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f8003a10 0x7f25f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f25f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f8004d00 0x7f25f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b0350 con 0x7f25f8004d00 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f800ff20 con 0x7f25f8003a10 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80100e0 con 0x7f260c06c6b0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f26127d5640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f8004d00 0x7f25f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f2611fd4640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f8003a10 0x7f25f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.038+0000 7f26117d3640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f25f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.039+0000 7f26127d5640 1 -- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 msgr2=0x7f25f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:23.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.039+0000 7f26127d5640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260c06c6b0 0x7f25f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.039+0000 7f26127d5640 1 -- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f8003a10 msgr2=0x7f25f8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.039+0000 7f26127d5640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f8003a10 0x7f25f8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.039+0000 7f26127d5640 1 -- 172.21.15.49:0/676420606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8003520 con 0x7f25f8004d00 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.040+0000 7f26127d5640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f8004d00 0x7f25f8005180 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2604009f90 tx=0x7f25f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f85f63229b56416 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.040+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260402cbd0 con 0x7f25f8004d00 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.040+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260400f040 con 0x7f25f8004d00 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.040+0000 7f2610fd2640 1 -- 172.21.15.49:0/676420606 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604034440 con 0x7f25f8004d00 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 -- 172.21.15.49:0/676420606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f8004d00 msgr2=0x7f25f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 --2- 172.21.15.49:0/676420606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f8004d00 0x7f25f8005180 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2604009f90 tx=0x7f25f80057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f26127d5640 1 -- 172.21.15.49:0/676420606 reap_dead start 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 -- 172.21.15.49:0/676420606 shutdown_connections 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 -- 172.21.15.49:0/676420606 >> 172.21.15.49:0/676420606 conn(0x7f260c0cbb70 msgr2=0x7f260c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 -- 172.21.15.49:0/676420606 shutdown_connections 2023-12-19T05:46:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.041+0000 7f2614238640 1 -- 172.21.15.49:0/676420606 wait complete. 2023-12-19T05:46:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.043+0000 7f2614238640 1 Processor -- start 2023-12-19T05:46:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.043+0000 7f2614238640 1 -- start start 2023-12-19T05:46:23.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f8004d00 0x7f260c1ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 0x7f260c1432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c1f27a0 con 0x7f260c1f1de0 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c140860 con 0x7f260c142e50 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f2614238640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c13f9b0 con 0x7f25f8004d00 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f26127d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f26127d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44782/0 (socket says 172.21.15.49:44782) 2023-12-19T05:46:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.044+0000 7f26127d5640 1 -- 172.21.15.49:0/2486706649 learned_addr learned my addr 172.21.15.49:0/2486706649 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f2611fd4640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f8004d00 0x7f260c1ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26117d3640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 0x7f260c1432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 -- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f8004d00 msgr2=0x7f260c1ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f8004d00 0x7f260c1ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 -- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 msgr2=0x7f260c1432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 0x7f260c1432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 -- 172.21.15.49:0/2486706649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c13fc90 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26117d3640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 0x7f260c1432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26127d5640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2604037040 tx=0x7f2604009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604034cd0 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604034e30 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604003b90 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.045+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c13ff70 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.046+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c1ee630 con 0x7f260c1f1de0 2023-12-19T05:46:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.047+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c061910 con 0x7f260c1f1de0 2023-12-19T05:46:23.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.048+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f260403b050 con 0x7f260c1f1de0 2023-12-19T05:46:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.049+0000 7f26027fc640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 0x7f25f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.049+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26040aa910 con 0x7f260c1f1de0 2023-12-19T05:46:23.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.050+0000 7f2611fd4640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 0x7f25f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:23.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.051+0000 7f2611fd4640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 0x7f25f006c8f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2608001050 tx=0x7f2608009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:23.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.054+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2604075ef0 con 0x7f260c1f1de0 2023-12-19T05:46:23.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.258+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f260c15e9e0 con 0x7f260c1f1de0 2023-12-19T05:46:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.260+0000 7f26027fc640 1 -- 172.21.15.49:0/2486706649 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f2604039020 con 0x7f260c1f1de0 2023-12-19T05:46:23.262 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:23.262 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 msgr2=0x7f25f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 0x7f25f006c8f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2608001050 tx=0x7f2608009040 comp rx=0 tx=0).stop 2023-12-19T05:46:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 msgr2=0x7f260c1f2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2604037040 tx=0x7f2604009750 comp rx=0 tx=0).stop 2023-12-19T05:46:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 shutdown_connections 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f006a430 0x7f25f006c8f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1f1de0 0x7f260c1f2260 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c142e50 0x7f260c1432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.263+0000 7f2614238640 1 --2- 172.21.15.49:0/2486706649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f8004d00 0x7f260c1ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.264+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 >> 172.21.15.49:0/2486706649 conn(0x7f260c0cbb70 msgr2=0x7f260c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.264+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 shutdown_connections 2023-12-19T05:46:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:23.264+0000 7f2614238640 1 -- 172.21.15.49:0/2486706649 wait complete. 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:46:23.286 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:46:23.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:23.616 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:23.727 INFO:teuthology.orchestra.run.smithi049.stdout:client5705 2023-12-19T05:46:23.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:23.728 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client5705/osdmap') 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 128 barrier 128 flags 0x588000 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:46:23.831 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:46:23.832 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:46:23.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:46:23.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:46:23.832 INFO:teuthology.orchestra.run.smithi049.stderr:799 bytes copied, 0.000104399 s, 7.7 MB/s 2023-12-19T05:46:23.835 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:24.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.070+0000 7f7da1f63640 1 Processor -- start 2023-12-19T05:46:24.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.070+0000 7f7da1f63640 1 -- start start 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 0x7f7d9c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c06b590 0x7f7d9c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c0afb10 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c06bb30 con 0x7f7d9c1449e0 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7da1f63640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0b0070 con 0x7f7d9c06b590 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.072+0000 7f7d92ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34138/0 (socket says 172.21.15.49:34138) 2023-12-19T05:46:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 -- 172.21.15.49:0/2422343314 learned_addr learned my addr 172.21.15.49:0/2422343314 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d9bfff640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c06b590 0x7f7d9c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d9b7fe640 1 --2- 172.21.15.49:0/2422343314 >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 0x7f7d9c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 -- 172.21.15.49:0/2422343314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c06b590 msgr2=0x7f7d9c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c06b590 0x7f7d9c06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 -- 172.21.15.49:0/2422343314 >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 msgr2=0x7f7d9c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/2422343314 >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 0x7f7d9c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d92ffd640 1 -- 172.21.15.49:0/2422343314 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0b0350 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.073+0000 7f7d9b7fe640 1 --2- 172.21.15.49:0/2422343314 >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 0x7f7d9c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.074+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c071cd0 tx=0x7f7d8402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422f5539da4c599b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.075+0000 7f7d9affd640 1 -- 172.21.15.49:0/2422343314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031860 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.075+0000 7f7d9affd640 1 -- 172.21.15.49:0/2422343314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840319c0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.075+0000 7f7d9affd640 1 -- 172.21.15.49:0/2422343314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031d50 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.075+0000 7f7da1f63640 1 -- 172.21.15.49:0/2422343314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 msgr2=0x7f7d9c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.075+0000 7f7da1f63640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c071cd0 tx=0x7f7d8402b900 comp rx=0 tx=0).stop 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 -- 172.21.15.49:0/2422343314 shutdown_connections 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c06b590 0x7f7d9c06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 --2- 172.21.15.49:0/2422343314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c06bfa0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 --2- 172.21.15.49:0/2422343314 >> v2:172.21.15.115:3300/0 conn(0x7f7d9c1449e0 0x7f7d9c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 -- 172.21.15.49:0/2422343314 >> 172.21.15.49:0/2422343314 conn(0x7f7d9c0cbb70 msgr2=0x7f7d9c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 -- 172.21.15.49:0/2422343314 shutdown_connections 2023-12-19T05:46:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.076+0000 7f7da1f63640 1 -- 172.21.15.49:0/2422343314 wait complete. 2023-12-19T05:46:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.078+0000 7f7da1f63640 1 Processor -- start 2023-12-19T05:46:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.078+0000 7f7da1f63640 1 -- start start 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.079+0000 7f7da1f63640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d9c06b590 0x7f7d9c13ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.079+0000 7f7da1f63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7da1f63640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c1449e0 0x7f7d9c1f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7da1f63640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c13b040 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7da1f63640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c1f2ba0 con 0x7f7d9c06b590 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7da1f63640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c1f6610 con 0x7f7d9c1449e0 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34140/0 (socket says 172.21.15.49:34140) 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 -- 172.21.15.49:0/4097129745 learned_addr learned my addr 172.21.15.49:0/4097129745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d9b7fe640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d9c06b590 0x7f7d9c13ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d9bfff640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c1449e0 0x7f7d9c1f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 -- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c1449e0 msgr2=0x7f7d9c1f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c1449e0 0x7f7d9c1f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 -- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d9c06b590 msgr2=0x7f7d9c13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:24.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d9c06b590 0x7f7d9c13ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.080+0000 7f7d92ffd640 1 -- 172.21.15.49:0/4097129745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840094d0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7d92ffd640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7d8402b940 tx=0x7f7d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8403ad30 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840443f0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840447a0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c1f68f0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.081+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c1f6bd0 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.082+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c0b0610 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.083+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d8404d450 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.084+0000 7f7d98ff9640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:24.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.084+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d840aaf40 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.085+0000 7f7d9b7fe640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:24.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.086+0000 7f7d9b7fe640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0075b0 tx=0x7f7d8c007540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:24.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.088+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d9c0b0610 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.320+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d9c0b0610 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.321+0000 7f7d98ff9640 1 -- 172.21.15.49:0/4097129745 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f7d9c0b0610 con 0x7f7d9c0b0b50 2023-12-19T05:46:24.323 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:24.324 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:24.325 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.323+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 msgr2=0x7f7d7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.323+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0075b0 tx=0x7f7d8c007540 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.323+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 msgr2=0x7f7d9c1f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.323+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7d8402b940 tx=0x7f7d840046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 shutdown_connections 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d9c1449e0 0x7f7d9c1f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c0b0b50 0x7f7d9c1f5d10 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 --2- 172.21.15.49:0/4097129745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d9c06b590 0x7f7d9c13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 >> 172.21.15.49:0/4097129745 conn(0x7f7d9c0cbb70 msgr2=0x7f7d9c1434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 shutdown_connections 2023-12-19T05:46:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:24.324+0000 7f7da1f63640 1 -- 172.21.15.49:0/4097129745 wait complete. 2023-12-19T05:46:24.344 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 131 2023-12-19T05:46:24.604 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> os.fchmod(fd, 0O666) 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(fd) 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> os.close(fd) 2023-12-19T05:46:24.605 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:46:24.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:24.937 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:25.049 INFO:teuthology.orchestra.run.smithi049.stdout:client5705 2023-12-19T05:46:25.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:25.049 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client5705/osdmap') 2023-12-19T05:46:25.157 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 131 barrier 131 flags 0x588000 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:46:25.158 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:46:25.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:46:25.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:46:25.159 INFO:teuthology.orchestra.run.smithi049.stderr:799 bytes copied, 0.000107257 s, 7.4 MB/s 2023-12-19T05:46:25.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:25.163 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:46:25.228 INFO:teuthology.orchestra.run.smithi049.stdout:client5705 2023-12-19T05:46:25.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:25.228 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e805799f-455a-49b9-9f36-8f2074fd7be4.client5705/osdmap') 2023-12-19T05:46:25.338 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 131 barrier 131 flags 0x588000 2023-12-19T05:46:25.338 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.338 INFO:teuthology.orchestra.run.smithi049.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.338 INFO:teuthology.orchestra.run.smithi049.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-19T05:46:25.338 INFO:teuthology.orchestra.run.smithi049.stdout:osd0 (2)172.21.15.49:6800 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd1 (2)172.21.15.49:6822 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd2 (2)172.21.15.49:6808 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd3 (2)172.21.15.49:6809 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd4 (2)172.21.15.115:6800 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd5 (2)172.21.15.115:6805 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd6 (2)172.21.15.115:6814 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stdout:osd7 (2)172.21.15.115:6824 100% (exists, up) 100% -1 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records in 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+1 records out 2023-12-19T05:46:25.339 INFO:teuthology.orchestra.run.smithi049.stderr:799 bytes copied, 9.013e-05 s, 8.9 MB/s 2023-12-19T05:46:25.343 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:46:25.343 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:46:25.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:25.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:25.600 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:46:25.600 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:25.601 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:25.665 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:25.665 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:25.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.960+0000 7fbd2e626640 1 Processor -- start 2023-12-19T05:46:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.960+0000 7fbd2e626640 1 -- start start 2023-12-19T05:46:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd2e626640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd2815d490 0x7fbd280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd2e626640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd280cf7c0 0x7fbd28161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd2e626640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280cfc20 con 0x7fbd28161850 2023-12-19T05:46:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd2e626640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd281620b0 con 0x7fbd280cf7c0 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd2e626640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2806d900 con 0x7fbd2815d490 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd277fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd280cf7c0 0x7fbd28161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd277fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd280cf7c0 0x7fbd28161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34150/0 (socket says 172.21.15.49:34150) 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd277fe640 1 -- 172.21.15.49:0/2285120416 learned_addr learned my addr 172.21.15.49:0/2285120416 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.962+0000 7fbd27fff640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd2815d490 0x7fbd280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.963+0000 7fbd277fe640 1 -- 172.21.15.49:0/2285120416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd2815d490 msgr2=0x7fbd280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.963+0000 7fbd277fe640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd2815d490 0x7fbd280cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.963+0000 7fbd277fe640 1 -- 172.21.15.49:0/2285120416 >> v1:172.21.15.49:6789/0 conn(0x7fbd28161850 legacy=0x7fbd280ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.963+0000 7fbd277fe640 1 -- 172.21.15.49:0/2285120416 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2806dbe0 con 0x7fbd280cf7c0 2023-12-19T05:46:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.964+0000 7fbd277fe640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280cf7c0 0x7fbd28161310 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009870 tx=0x7fbd1002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0d2ebce6bcf541 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.964+0000 7fbd26ffd640 1 -- 172.21.15.49:0/2285120416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10030840 con 0x7fbd280cf7c0 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.964+0000 7fbd26ffd640 1 -- 172.21.15.49:0/2285120416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100309a0 con 0x7fbd280cf7c0 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.964+0000 7fbd26ffd640 1 -- 172.21.15.49:0/2285120416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10030d30 con 0x7fbd280cf7c0 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 -- 172.21.15.49:0/2285120416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280cf7c0 msgr2=0x7fbd28161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280cf7c0 0x7fbd28161310 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009870 tx=0x7fbd1002b980 comp rx=0 tx=0).stop 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 -- 172.21.15.49:0/2285120416 shutdown_connections 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280cf7c0 0x7fbd28161310 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2285120416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd2815d490 0x7fbd280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 -- 172.21.15.49:0/2285120416 >> 172.21.15.49:0/2285120416 conn(0x7fbd2806a2e0 msgr2=0x7fbd2806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 -- 172.21.15.49:0/2285120416 shutdown_connections 2023-12-19T05:46:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.965+0000 7fbd2e626640 1 -- 172.21.15.49:0/2285120416 wait complete. 2023-12-19T05:46:25.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.967+0000 7fbd2e626640 1 Processor -- start 2023-12-19T05:46:25.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.967+0000 7fbd2e626640 1 -- start start 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd280cf7c0 0x7fbd281f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd2815d490 0x7fbd280cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd281f3ff0 con 0x7fbd28161850 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280cd110 con 0x7fbd2815d490 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2e626640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd281f3470 con 0x7fbd280cf7c0 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2cbc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2cbc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34166/0 (socket says 172.21.15.49:34166) 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.968+0000 7fbd2cbc3640 1 -- 172.21.15.49:0/2566153479 learned_addr learned my addr 172.21.15.49:0/2566153479 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd277fe640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd2815d490 0x7fbd280cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd27fff640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd280cf7c0 0x7fbd281f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 -- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd280cf7c0 msgr2=0x7fbd281f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:25.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd280cf7c0 0x7fbd281f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 -- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd2815d490 msgr2=0x7fbd280cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd2815d490 0x7fbd280cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 -- 172.21.15.49:0/2566153479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100094d0 con 0x7fbd28161850 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.969+0000 7fbd2cbc3640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c390 tx=0x7fbd2000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.970+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200052d0 con 0x7fbd28161850 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.970+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20005430 con 0x7fbd28161850 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.970+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003810 con 0x7fbd28161850 2023-12-19T05:46:25.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.970+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd281f3750 con 0x7fbd28161850 2023-12-19T05:46:25.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.970+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281f3d10 con 0x7fbd28161850 2023-12-19T05:46:25.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.971+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28061910 con 0x7fbd28161850 2023-12-19T05:46:25.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.972+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd20003970 con 0x7fbd28161850 2023-12-19T05:46:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.974+0000 7fbd24ff9640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 0x7fbd0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.974+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd20087d60 con 0x7fbd28161850 2023-12-19T05:46:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.974+0000 7fbd27fff640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 0x7fbd0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.976+0000 7fbd27fff640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 0x7fbd0806c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbd28158ad0 tx=0x7fbd180039b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:25.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:25.979+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd200533e0 con 0x7fbd28161850 2023-12-19T05:46:26.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.178+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd2815d900 con 0x7fbd28161850 2023-12-19T05:46:26.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.180+0000 7fbd24ff9640 1 -- 172.21.15.49:0/2566153479 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7fbd20056a00 con 0x7fbd28161850 2023-12-19T05:46:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:26.182 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 msgr2=0x7fbd0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 0x7fbd0806c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbd28158ad0 tx=0x7fbd180039b0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 msgr2=0x7fbd2815f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c390 tx=0x7fbd2000c850 comp rx=0 tx=0).stop 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 shutdown_connections 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbd0806a460 0x7fbd0806c920 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd28161850 0x7fbd2815f880 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd2815d490 0x7fbd280cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 --2- 172.21.15.49:0/2566153479 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd280cf7c0 0x7fbd281f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.182+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 >> 172.21.15.49:0/2566153479 conn(0x7fbd2806a2e0 msgr2=0x7fbd280cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:26.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.183+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 shutdown_connections 2023-12-19T05:46:26.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.183+0000 7fbd2e626640 1 -- 172.21.15.49:0/2566153479 wait complete. 2023-12-19T05:46:26.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:05.075551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:06.182867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:26.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:26.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.443+0000 7faa6af31640 1 Processor -- start 2023-12-19T05:46:26.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.443+0000 7faa6af31640 1 -- start start 2023-12-19T05:46:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.445+0000 7faa6af31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa640cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.445+0000 7faa6af31640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa640b1830 0x7faa640b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.445+0000 7faa6af31640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640cc530 con 0x7faa640b21b0 2023-12-19T05:46:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.445+0000 7faa6af31640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64166300 con 0x7faa640b1830 2023-12-19T05:46:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.445+0000 7faa6af31640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640cb920 con 0x7faa64161700 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa694ce640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faa640b21b0 0x7faa640b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44552/0 (socket says 172.21.15.49:44552) 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa694ce640 1 -- 172.21.15.49:0/931970075 learned_addr learned my addr 172.21.15.49:0/931970075 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa68ccd640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa640cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa63fff640 1 --2- 172.21.15.49:0/931970075 >> v2:172.21.15.115:3300/0 conn(0x7faa640b1830 0x7faa640b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435456934 0 0) 0x7faa640cc530 con 0x7faa640b21b0 2023-12-19T05:46:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.446+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa54003520 con 0x7faa640b21b0 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58373902 0 0) 0x7faa54003520 con 0x7faa640b21b0 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 msgr2=0x7faa640cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa640cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 >> v2:172.21.15.115:3300/0 conn(0x7faa640b1830 msgr2=0x7faa640b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 --2- 172.21.15.49:0/931970075 >> v2:172.21.15.115:3300/0 conn(0x7faa640b1830 0x7faa640b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640cbc00 con 0x7faa640b21b0 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7faa5c0019f0 con 0x7faa640b21b0 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 >> v1:172.21.15.49:6789/0 conn(0x7faa640b21b0 legacy=0x7faa640b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa540039e0 0x7faa54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54004d00 0x7faa54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640cb920 con 0x7faa540039e0 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5400b980 con 0x7faa54004d00 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.447+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5400bac0 con 0x7faa64161700 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa540039e0 0x7faa54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa63fff640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa694ce640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54004d00 0x7faa54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 -- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 msgr2=0x7faa540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa64161700 0x7faa540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 -- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54004d00 msgr2=0x7faa54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54004d00 0x7faa54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.448+0000 7faa68ccd640 1 -- 172.21.15.49:0/931970075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54003520 con 0x7faa540039e0 2023-12-19T05:46:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.450+0000 7faa68ccd640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa540039e0 0x7faa54003e00 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7faa58009ac0 tx=0x7faa540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9b5a0dce0001ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.450+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5802c6b0 con 0x7faa540039e0 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.450+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5802c810 con 0x7faa540039e0 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.450+0000 7faa637fe640 1 -- 172.21.15.49:0/931970075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5802cba0 con 0x7faa540039e0 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 -- 172.21.15.49:0/931970075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa540039e0 msgr2=0x7faa54003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 --2- 172.21.15.49:0/931970075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa540039e0 0x7faa54003e00 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7faa58009ac0 tx=0x7faa540057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa694ce640 1 -- 172.21.15.49:0/931970075 reap_dead start 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 -- 172.21.15.49:0/931970075 shutdown_connections 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 -- 172.21.15.49:0/931970075 >> 172.21.15.49:0/931970075 conn(0x7faa64073150 msgr2=0x7faa640659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 -- 172.21.15.49:0/931970075 shutdown_connections 2023-12-19T05:46:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.451+0000 7faa6af31640 1 -- 172.21.15.49:0/931970075 wait complete. 2023-12-19T05:46:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.453+0000 7faa6af31640 1 Processor -- start 2023-12-19T05:46:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.454+0000 7faa6af31640 1 -- start start 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.454+0000 7faa6af31640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa540039e0 0x7faa64154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa6af31640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 0x7faa6406da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa6af31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa6af31640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64152ba0 con 0x7faa6406df80 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa6af31640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6415fca0 con 0x7faa540039e0 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa6af31640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6415ee40 con 0x7faa6406b3e0 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34182/0 (socket says 172.21.15.49:34182) 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 -- 172.21.15.49:0/2711997727 learned_addr learned my addr 172.21.15.49:0/2711997727 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa68ccd640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa540039e0 0x7faa64154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa63fff640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 0x7faa6406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 -- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 msgr2=0x7faa6406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 0x7faa6406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 -- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa540039e0 msgr2=0x7faa64154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa540039e0 0x7faa64154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa694ce640 1 -- 172.21.15.49:0/2711997727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6415f120 con 0x7faa6406df80 2023-12-19T05:46:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.455+0000 7faa63fff640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 0x7faa6406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa694ce640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0013d0 tx=0x7faa5c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ec10 con 0x7faa6406df80 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00ed90 con 0x7faa6406df80 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c013660 con 0x7faa6406df80 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6415f400 con 0x7faa6406df80 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.456+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa641550f0 con 0x7faa6406df80 2023-12-19T05:46:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.457+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64153030 con 0x7faa6406df80 2023-12-19T05:46:26.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.458+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa5c0137c0 con 0x7faa6406df80 2023-12-19T05:46:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.459+0000 7faa617fa640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.460+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa5c088d10 con 0x7faa6406df80 2023-12-19T05:46:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.460+0000 7faa68ccd640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.461+0000 7faa68ccd640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 0x7faa4806c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa58036000 tx=0x7faa58030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.464+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faa64153030 con 0x7faa6406df80 2023-12-19T05:46:26.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.658+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa64153030 con 0x7faa6406df80 2023-12-19T05:46:26.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.659+0000 7faa617fa640 1 -- 172.21.15.49:0/2711997727 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa64153030 con 0x7faa6406df80 2023-12-19T05:46:26.661 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 msgr2=0x7faa4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 0x7faa4806c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa58036000 tx=0x7faa58030000 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 msgr2=0x7faa64151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0013d0 tx=0x7faa5c00e530 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 shutdown_connections 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6406b3e0 0x7faa6406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6406df80 0x7faa64151d50 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 --2- 172.21.15.49:0/2711997727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa540039e0 0x7faa64154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 >> 172.21.15.49:0/2711997727 conn(0x7faa64073150 msgr2=0x7faa64162070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 shutdown_connections 2023-12-19T05:46:26.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.662+0000 7faa6af31640 1 -- 172.21.15.49:0/2711997727 wait complete. 2023-12-19T05:46:26.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:46:26.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.919+0000 7faf91c65640 1 Processor -- start 2023-12-19T05:46:26.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.920+0000 7faf91c65640 1 -- start start 2023-12-19T05:46:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 0x7faf8c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf8c0b7360 0x7faf8c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c160ee0 0x7faf8c161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c0700c0 con 0x7faf8c0b7360 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c0b7d00 con 0x7faf8c146c40 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf91c65640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c06f160 con 0x7faf8c160ee0 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf8bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf8c0b7360 0x7faf8c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf8bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf8c0b7360 0x7faf8c0b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34198/0 (socket says 172.21.15.49:34198) 2023-12-19T05:46:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf8bfff640 1 -- 172.21.15.49:0/1218985364 learned_addr learned my addr 172.21.15.49:0/1218985364 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf90c63640 1 --2- 172.21.15.49:0/1218985364 >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 0x7faf8c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.922+0000 7faf8bfff640 1 -- 172.21.15.49:0/1218985364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c160ee0 msgr2=0x7faf8c161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.923+0000 7faf8bfff640 1 --2- 172.21.15.49:0/1218985364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c160ee0 0x7faf8c161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.923+0000 7faf8bfff640 1 -- 172.21.15.49:0/1218985364 >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 msgr2=0x7faf8c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.923+0000 7faf8bfff640 1 --2- 172.21.15.49:0/1218985364 >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 0x7faf8c070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.923+0000 7faf8bfff640 1 -- 172.21.15.49:0/1218985364 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c06f440 con 0x7faf8c0b7360 2023-12-19T05:46:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.923+0000 7faf90c63640 1 --2- 172.21.15.49:0/1218985364 >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 0x7faf8c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:26.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.924+0000 7faf8bfff640 1 --2- 172.21.15.49:0/1218985364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c0b7360 0x7faf8c0b77c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0b85b0 tx=0x7faf8002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d93165bf0fd293 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.924+0000 7faf8b7fe640 1 -- 172.21.15.49:0/1218985364 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80031860 con 0x7faf8c0b7360 2023-12-19T05:46:26.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.924+0000 7faf8b7fe640 1 -- 172.21.15.49:0/1218985364 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800319c0 con 0x7faf8c0b7360 2023-12-19T05:46:26.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.924+0000 7faf8b7fe640 1 -- 172.21.15.49:0/1218985364 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80031d50 con 0x7faf8c0b7360 2023-12-19T05:46:26.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 -- 172.21.15.49:0/1218985364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c0b7360 msgr2=0x7faf8c0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 --2- 172.21.15.49:0/1218985364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c0b7360 0x7faf8c0b77c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0b85b0 tx=0x7faf8002b900 comp rx=0 tx=0).stop 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 -- 172.21.15.49:0/1218985364 shutdown_connections 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 --2- 172.21.15.49:0/1218985364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c160ee0 0x7faf8c161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 --2- 172.21.15.49:0/1218985364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c0b7360 0x7faf8c0b77c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 --2- 172.21.15.49:0/1218985364 >> v2:172.21.15.115:3300/0 conn(0x7faf8c146c40 0x7faf8c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 -- 172.21.15.49:0/1218985364 >> 172.21.15.49:0/1218985364 conn(0x7faf8c0d31b0 msgr2=0x7faf8c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 -- 172.21.15.49:0/1218985364 shutdown_connections 2023-12-19T05:46:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.925+0000 7faf91c65640 1 -- 172.21.15.49:0/1218985364 wait complete. 2023-12-19T05:46:26.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.927+0000 7faf91c65640 1 Processor -- start 2023-12-19T05:46:26.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.927+0000 7faf91c65640 1 -- start start 2023-12-19T05:46:26.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c0b7360 0x7faf8c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf8c160ee0 0x7faf8c13c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b6350 con 0x7faf8c146c40 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c15a090 con 0x7faf8c160ee0 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf91c65640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b5740 con 0x7faf8c0b7360 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34200/0 (socket says 172.21.15.49:34200) 2023-12-19T05:46:26.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.928+0000 7faf8bfff640 1 -- 172.21.15.49:0/344019656 learned_addr learned my addr 172.21.15.49:0/344019656 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:26.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf90c63640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c0b7360 0x7faf8c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 -- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c0b7360 msgr2=0x7faf8c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c0b7360 0x7faf8c159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 -- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf8c160ee0 msgr2=0x7faf8c13c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:26.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf8c160ee0 0x7faf8c13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 -- 172.21.15.49:0/344019656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800094d0 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf8bfff640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7faf8002b940 tx=0x7faf800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80031850 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800443f0 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800447a0 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.929+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c0b5a20 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.930+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c0b5fe0 con 0x7faf8c146c40 2023-12-19T05:46:26.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.931+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c0d1950 con 0x7faf8c146c40 2023-12-19T05:46:26.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.932+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf8004d450 con 0x7faf8c146c40 2023-12-19T05:46:26.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.933+0000 7faf897fa640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 0x7faf7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:26.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.933+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf800ab100 con 0x7faf8c146c40 2023-12-19T05:46:26.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.933+0000 7faf90c63640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 0x7faf7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.934+0000 7faf90c63640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 0x7faf7806c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00a950 tx=0x7faf7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:26.937+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf80076650 con 0x7faf8c146c40 2023-12-19T05:46:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.130+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf8c061910 con 0x7faf8c146c40 2023-12-19T05:46:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.131+0000 7faf897fa640 1 -- 172.21.15.49:0/344019656 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf80079c70 con 0x7faf8c146c40 2023-12-19T05:46:27.133 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:46:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 msgr2=0x7faf7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 0x7faf7806c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00a950 tx=0x7faf7c008040 comp rx=0 tx=0).stop 2023-12-19T05:46:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 msgr2=0x7faf8c0b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7faf8002b940 tx=0x7faf800046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 shutdown_connections 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a430 0x7faf7806c8f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf8c160ee0 0x7faf8c13c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c146c40 0x7faf8c0b67e0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 --2- 172.21.15.49:0/344019656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf8c0b7360 0x7faf8c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 >> 172.21.15.49:0/344019656 conn(0x7faf8c0d31b0 msgr2=0x7faf8c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 shutdown_connections 2023-12-19T05:46:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.134+0000 7faf91c65640 1 -- 172.21.15.49:0/344019656 wait complete. 2023-12-19T05:46:27.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:46:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.395+0000 7f3442cf3640 1 Processor -- start 2023-12-19T05:46:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.395+0000 7f3442cf3640 1 -- start start 2023-12-19T05:46:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.396+0000 7f3442cf3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f343c0cd4e0 0x7f343c15e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f3442cf3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0b0470 0x7f343c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f3442cf3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c15dae0 con 0x7f343c15a4f0 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f3442cf3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c15b000 con 0x7f343c0b0470 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f3442cf3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c15b2e0 con 0x7f343c0cd4e0 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f34424f2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0b0470 0x7f343c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f34424f2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f343c0b0470 0x7f343c15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34210/0 (socket says 172.21.15.49:34210) 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f34424f2640 1 -- 172.21.15.49:0/2930419347 learned_addr learned my addr 172.21.15.49:0/2930419347 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.397+0000 7f3441cf1640 1 --2- 172.21.15.49:0/2930419347 >> v2:172.21.15.115:3300/0 conn(0x7f343c0cd4e0 0x7f343c15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.398+0000 7f34424f2640 1 -- 172.21.15.49:0/2930419347 >> v2:172.21.15.115:3300/0 conn(0x7f343c0cd4e0 msgr2=0x7f343c15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.398+0000 7f34424f2640 1 --2- 172.21.15.49:0/2930419347 >> v2:172.21.15.115:3300/0 conn(0x7f343c0cd4e0 0x7f343c15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.398+0000 7f34424f2640 1 -- 172.21.15.49:0/2930419347 >> v1:172.21.15.115:6789/0 conn(0x7f343c15a4f0 legacy=0x7f343c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.398+0000 7f34424f2640 1 -- 172.21.15.49:0/2930419347 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c15dd80 con 0x7f343c0b0470 2023-12-19T05:46:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.399+0000 7f34424f2640 1 --2- 172.21.15.49:0/2930419347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0b0470 0x7f343c15a9a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f343c0ccbc0 tx=0x7f343402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf57714fae45d4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.399+0000 7f3440cef640 1 -- 172.21.15.49:0/2930419347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343402ca80 con 0x7f343c0b0470 2023-12-19T05:46:27.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.399+0000 7f3440cef640 1 -- 172.21.15.49:0/2930419347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343402cbe0 con 0x7f343c0b0470 2023-12-19T05:46:27.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.399+0000 7f3440cef640 1 -- 172.21.15.49:0/2930419347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34340343f0 con 0x7f343c0b0470 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 -- 172.21.15.49:0/2930419347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0b0470 msgr2=0x7f343c15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 --2- 172.21.15.49:0/2930419347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0b0470 0x7f343c15a9a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f343c0ccbc0 tx=0x7f343402bee0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 -- 172.21.15.49:0/2930419347 shutdown_connections 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 --2- 172.21.15.49:0/2930419347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c0b0470 0x7f343c15a9a0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 --2- 172.21.15.49:0/2930419347 >> v2:172.21.15.115:3300/0 conn(0x7f343c0cd4e0 0x7f343c15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 -- 172.21.15.49:0/2930419347 >> 172.21.15.49:0/2930419347 conn(0x7f343c06f630 msgr2=0x7f343c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 -- 172.21.15.49:0/2930419347 shutdown_connections 2023-12-19T05:46:27.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.400+0000 7f3442cf3640 1 -- 172.21.15.49:0/2930419347 wait complete. 2023-12-19T05:46:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.402+0000 7f3442cf3640 1 Processor -- start 2023-12-19T05:46:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.402+0000 7f3442cf3640 1 -- start start 2023-12-19T05:46:27.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f343c0b0470 0x7f343c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 0x7f343c150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c06c870 con 0x7f343c15a4f0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c06cb50 con 0x7f343c0cd4e0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f3442cf3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c06ce30 con 0x7f343c0b0470 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f34424f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f34424f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34218/0 (socket says 172.21.15.49:34218) 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.403+0000 7f34424f2640 1 -- 172.21.15.49:0/3938640905 learned_addr learned my addr 172.21.15.49:0/3938640905 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 -- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f343c0b0470 msgr2=0x7f343c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f3441cf1640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f343c0b0470 0x7f343c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34414f0640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 0x7f343c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f343c0b0470 0x7f343c06d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 -- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 msgr2=0x7f343c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 0x7f343c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 -- 172.21.15.49:0/3938640905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434009b30 con 0x7f343c15a4f0 2023-12-19T05:46:27.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34414f0640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 0x7f343c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:27.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.404+0000 7f34424f2640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3434036040 tx=0x7f3434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.405+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434009510 con 0x7f343c15a4f0 2023-12-19T05:46:27.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.405+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343403e450 con 0x7f343c15a4f0 2023-12-19T05:46:27.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.405+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c0add20 con 0x7f343c15a4f0 2023-12-19T05:46:27.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.405+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343403e7e0 con 0x7f343c15a4f0 2023-12-19T05:46:27.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.405+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c14f5a0 con 0x7f343c15a4f0 2023-12-19T05:46:27.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.406+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c0ae240 con 0x7f343c15a4f0 2023-12-19T05:46:27.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.407+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f343402cd50 con 0x7f343c15a4f0 2023-12-19T05:46:27.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.408+0000 7f34327fc640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 0x7f342006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.408+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34340ab4d0 con 0x7f343c15a4f0 2023-12-19T05:46:27.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.409+0000 7f3441cf1640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 0x7f342006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.410+0000 7f3441cf1640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 0x7f342006c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.412+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3434076a20 con 0x7f343c15a4f0 2023-12-19T05:46:27.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:27.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.609+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f343c061910 con 0x7f343c15a4f0 2023-12-19T05:46:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.609+0000 7f34327fc640 1 -- 172.21.15.49:0/3938640905 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7f343407a040 con 0x7f343c15a4f0 2023-12-19T05:46:27.611 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 msgr2=0x7f342006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 0x7f342006c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 msgr2=0x7f343c13ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3434036040 tx=0x7f3434004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 shutdown_connections 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f342006a430 0x7f342006c8f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f343c15a4f0 0x7f343c13ae00 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c0cd4e0 0x7f343c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 --2- 172.21.15.49:0/3938640905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f343c0b0470 0x7f343c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 >> 172.21.15.49:0/3938640905 conn(0x7f343c06f630 msgr2=0x7f343c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 shutdown_connections 2023-12-19T05:46:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.612+0000 7f3442cf3640 1 -- 172.21.15.49:0/3938640905 wait complete. 2023-12-19T05:46:27.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:46:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.857+0000 7f27fbf18640 1 Processor -- start 2023-12-19T05:46:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.858+0000 7f27fbf18640 1 -- start start 2023-12-19T05:46:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.859+0000 7f27fbf18640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27f4146e10 0x7f27f40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.859+0000 7f27fbf18640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.859+0000 7f27fbf18640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f40cd840 con 0x7f27f40ce110 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.859+0000 7f27fbf18640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f40d2430 con 0x7f27f4146e10 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.859+0000 7f27fbf18640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40d2620 con 0x7f27f40d2b00 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27fa4b5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f27f40ce110 0x7f27f40b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44558/0 (socket says 172.21.15.49:44558) 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27fa4b5640 1 -- 172.21.15.49:0/573956912 learned_addr learned my addr 172.21.15.49:0/573956912 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/573956912 >> v2:172.21.15.49:3300/0 conn(0x7f27f4146e10 0x7f27f40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f94b3640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f8cb2640 1 -- 172.21.15.49:0/573956912 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243638659 0 0) 0x7f27f40cd840 con 0x7f27f40ce110 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f8cb2640 1 -- 172.21.15.49:0/573956912 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e4003520 con 0x7f27f40ce110 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f9cb4640 1 -- 172.21.15.49:0/573956912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 msgr2=0x7f27f40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f40b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f9cb4640 1 -- 172.21.15.49:0/573956912 >> v1:172.21.15.49:6789/0 conn(0x7f27f40ce110 legacy=0x7f27f40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.860+0000 7f27f9cb4640 1 -- 172.21.15.49:0/573956912 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40b41c0 con 0x7f27f4146e10 2023-12-19T05:46:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f40d1ef0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c95b4109e6c87f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27f8cb2640 1 -- 172.21.15.49:0/573956912 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e802cc50 con 0x7f27f4146e10 2023-12-19T05:46:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27f8cb2640 1 -- 172.21.15.49:0/573956912 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e802cdb0 con 0x7f27f4146e10 2023-12-19T05:46:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27f8cb2640 1 -- 172.21.15.49:0/573956912 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8034660 con 0x7f27f4146e10 2023-12-19T05:46:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27fbf18640 1 -- 172.21.15.49:0/573956912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 msgr2=0x7f27f40d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.862+0000 7f27fbf18640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f40d1ef0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802bea0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 -- 172.21.15.49:0/573956912 shutdown_connections 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 --2- 172.21.15.49:0/573956912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f40d1ef0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 -- 172.21.15.49:0/573956912 >> 172.21.15.49:0/573956912 conn(0x7f27f40b29c0 msgr2=0x7f27f40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 -- 172.21.15.49:0/573956912 shutdown_connections 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.863+0000 7f27fbf18640 1 -- 172.21.15.49:0/573956912 wait complete. 2023-12-19T05:46:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.865+0000 7f27fbf18640 1 Processor -- start 2023-12-19T05:46:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.865+0000 7f27fbf18640 1 -- start start 2023-12-19T05:46:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 0x7f27f4145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41537f0 con 0x7f27f4146e10 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4153ad0 con 0x7f27f40ce110 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fbf18640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4153db0 con 0x7f27f40d2b00 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fa4b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fa4b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34234/0 (socket says 172.21.15.49:34234) 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.866+0000 7f27fa4b5640 1 -- 172.21.15.49:0/3949977962 learned_addr learned my addr 172.21.15.49:0/3949977962 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f94b3640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 0x7f27f4145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 -- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 msgr2=0x7f27f4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 -- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 msgr2=0x7f27f4145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 0x7f27f4145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 -- 172.21.15.49:0/3949977962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009a70 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 0x7f27f4145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fa4b5640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00c430 tx=0x7f27ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec005ce0 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec005e40 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec007310 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.867+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f4154090 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.868+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4153480 con 0x7f27f4146e10 2023-12-19T05:46:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.869+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f4061910 con 0x7f27f4146e10 2023-12-19T05:46:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.870+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27ec007470 con 0x7f27f4146e10 2023-12-19T05:46:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.871+0000 7f27f27fc640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 0x7f27d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.871+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27ec087f90 con 0x7f27f4146e10 2023-12-19T05:46:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.871+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 0x7f27d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:27.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.872+0000 7f27f9cb4640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 0x7f27d806c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27e8036000 tx=0x7f27e8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:27.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:27.875+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27ec0bac80 con 0x7f27f4146e10 2023-12-19T05:46:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.089+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27f41441a0 con 0x7f27f4146e10 2023-12-19T05:46:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.090+0000 7f27f27fc640 1 -- 172.21.15.49:0/3949977962 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v131) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27ec057010 con 0x7f27f4146e10 2023-12-19T05:46:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:46:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.093+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 msgr2=0x7f27d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.093+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 0x7f27d806c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27e8036000 tx=0x7f27e8030000 comp rx=0 tx=0).stop 2023-12-19T05:46:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.093+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 msgr2=0x7f27f4158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.093+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00c430 tx=0x7f27ec00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 shutdown_connections 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27d806a430 0x7f27d806c8f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27f40d2b00 0x7f27f4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f4146e10 0x7f27f4158740 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 --2- 172.21.15.49:0/3949977962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27f40ce110 0x7f27f4145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 >> 172.21.15.49:0/3949977962 conn(0x7f27f40b29c0 msgr2=0x7f27f415b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 shutdown_connections 2023-12-19T05:46:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.094+0000 7f27fbf18640 1 -- 172.21.15.49:0/3949977962 wait complete. 2023-12-19T05:46:28.116 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:46:28.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:28.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:28.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:46:28.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:28.256 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:46:28.307 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:28.307 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:28.350 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:28.350 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:28.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:28.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.685+0000 7fa7cdc15640 1 Processor -- start 2023-12-19T05:46:28.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.686+0000 7fa7cdc15640 1 -- start start 2023-12-19T05:46:28.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.687+0000 7fa7cdc15640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7c80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.687+0000 7fa7cdc15640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c80b22b0 con 0x7fa7c806f160 2023-12-19T05:46:28.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.687+0000 7fa7cdc15640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c80b2830 con 0x7fa7c8161810 2023-12-19T05:46:28.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.687+0000 7fa7cdc15640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8161bf0 con 0x7fa7c80cdf50 2023-12-19T05:46:28.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.688+0000 7fa7cd414640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7c806f160 0x7fa7c806f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44566/0 (socket says 172.21.15.49:44566) 2023-12-19T05:46:28.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.688+0000 7fa7cd414640 1 -- 172.21.15.49:0/2788889951 learned_addr learned my addr 172.21.15.49:0/2788889951 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:28.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.688+0000 7fa7c7fff640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7c80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.688+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014140627 0 0) 0x7fa7c80b22b0 con 0x7fa7c806f160 2023-12-19T05:46:28.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.688+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b8003520 con 0x7fa7c806f160 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159556890 0 0) 0x7fa7b8003520 con 0x7fa7c806f160 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 msgr2=0x7fa7c80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7c80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 >> v1:172.21.15.115:6789/0 conn(0x7fa7c8161810 legacy=0x7fa7c80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80b2550 con 0x7fa7c806f160 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa7c00019f0 con 0x7fa7c806f160 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 >> v1:172.21.15.49:6789/0 conn(0x7fa7c806f160 legacy=0x7fa7c806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b80039a0 0x7fa7b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8004d00 0x7fa7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8161bf0 con 0x7fa7b8004d00 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b800bb10 con 0x7fa7b80039a0 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b800bcd0 con 0x7fa7c80cdf50 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.689+0000 7fa7cd414640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8004d00 0x7fa7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7ccc13640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b80039a0 0x7fa7b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7c7fff640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7cd414640 1 -- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 msgr2=0x7fa7b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7cd414640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7c80cdf50 0x7fa7b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7cd414640 1 -- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b80039a0 msgr2=0x7fa7b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7cd414640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b80039a0 0x7fa7b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.690+0000 7fa7cd414640 1 -- 172.21.15.49:0/2788889951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8003520 con 0x7fa7b8004d00 2023-12-19T05:46:28.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.692+0000 7fa7cd414640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8004d00 0x7fa7b8005180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000a760 tx=0x7fa7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db2dcb41ca59063 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:28.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.692+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0034630 con 0x7fa7b8004d00 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.692+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c002f070 con 0x7fa7b8004d00 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.692+0000 7fa7c77fe640 1 -- 172.21.15.49:0/2788889951 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0034a10 con 0x7fa7b8004d00 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2788889951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8004d00 msgr2=0x7fa7b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2788889951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8004d00 0x7fa7b8005180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000a760 tx=0x7fa7b80057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cd414640 1 -- 172.21.15.49:0/2788889951 reap_dead start 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2788889951 shutdown_connections 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2788889951 >> 172.21.15.49:0/2788889951 conn(0x7fa7c80b0100 msgr2=0x7fa7c80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2788889951 shutdown_connections 2023-12-19T05:46:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.693+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2788889951 wait complete. 2023-12-19T05:46:28.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.695+0000 7fa7cdc15640 1 Processor -- start 2023-12-19T05:46:28.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.695+0000 7fa7cdc15640 1 -- start start 2023-12-19T05:46:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7b8004d00 0x7fa7c81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7c806f540 0x7fa7c806f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c806ff00 con 0x7fa7c815d6d0 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8153e10 con 0x7fa7c806f540 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7cdc15640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c815e240 con 0x7fa7b8004d00 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.696+0000 7fa7c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34256/0 (socket says 172.21.15.49:34256) 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 -- 172.21.15.49:0/2081822491 learned_addr learned my addr 172.21.15.49:0/2081822491 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7ccc13640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7b8004d00 0x7fa7c81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7cd414640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7c806f540 0x7fa7c806f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 -- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7b8004d00 msgr2=0x7fa7c81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7b8004d00 0x7fa7c81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 -- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7c806f540 msgr2=0x7fa7c806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7c806f540 0x7fa7c806f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 -- 172.21.15.49:0/2081822491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c815e520 con 0x7fa7c815d6d0 2023-12-19T05:46:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.697+0000 7fa7c7fff640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4011600 tx=0x7fa7b4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.698+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400f920 con 0x7fa7c815d6d0 2023-12-19T05:46:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.698+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400fa80 con 0x7fa7c815d6d0 2023-12-19T05:46:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.698+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400fdf0 con 0x7fa7c815d6d0 2023-12-19T05:46:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.698+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c815e800 con 0x7fa7c815d6d0 2023-12-19T05:46:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.698+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c815edc0 con 0x7fa7c815d6d0 2023-12-19T05:46:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.699+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c815ef80 con 0x7fa7c815d6d0 2023-12-19T05:46:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.700+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7b4015460 con 0x7fa7c815d6d0 2023-12-19T05:46:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.701+0000 7fa7c57fa640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 0x7fa7ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:28.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.701+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7b4088e80 con 0x7fa7c815d6d0 2023-12-19T05:46:28.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.702+0000 7fa7ccc13640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 0x7fa7ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.703+0000 7fa7ccc13640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 0x7fa7ac06c920 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000c00 tx=0x7fa7bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.705+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7b40543d0 con 0x7fa7c815d6d0 2023-12-19T05:46:28.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.902+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7c8061910 con 0x7fa7c815d6d0 2023-12-19T05:46:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.905+0000 7fa7c57fa640 1 -- 172.21.15.49:0/2081822491 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7fa7b40579f0 con 0x7fa7c815d6d0 2023-12-19T05:46:28.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:28.907 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 msgr2=0x7fa7ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 0x7fa7ac06c920 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000c00 tx=0x7fa7bc009040 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 msgr2=0x7fa7c815db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4011600 tx=0x7fa7b4011ac0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 shutdown_connections 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa7ac06a460 0x7fa7ac06c920 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7c806f540 0x7fa7c806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c815d6d0 0x7fa7c815db50 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 --2- 172.21.15.49:0/2081822491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7b8004d00 0x7fa7c81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:28.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 >> 172.21.15.49:0/2081822491 conn(0x7fa7c80b0100 msgr2=0x7fa7c8161d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 shutdown_connections 2023-12-19T05:46:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:28.908+0000 7fa7cdc15640 1 -- 172.21.15.49:0/2081822491 wait complete. 2023-12-19T05:46:28.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:05.075551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:06.182867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:28.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:29.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.159+0000 7fcc1359e640 1 Processor -- start 2023-12-19T05:46:29.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.159+0000 7fcc1359e640 1 -- start start 2023-12-19T05:46:29.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.160+0000 7fcc1359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc1406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc1359e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1406e220 con 0x7fcc14141900 2023-12-19T05:46:29.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc1359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140cbea0 con 0x7fcc1406da30 2023-12-19T05:46:29.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc1359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140cc180 con 0x7fcc140b0470 2023-12-19T05:46:29.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc1259c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc14141900 0x7fcc140afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44570/0 (socket says 172.21.15.49:44570) 2023-12-19T05:46:29.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc1259c640 1 -- 172.21.15.49:0/4088935911 learned_addr learned my addr 172.21.15.49:0/4088935911 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466693674 0 0) 0x7fcc1406e220 con 0x7fcc14141900 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00003520 con 0x7fcc14141900 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.161+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc1406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348303785 0 0) 0x7fcc00003520 con 0x7fcc14141900 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 msgr2=0x7fcc1406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc1406d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 >> v1:172.21.15.115:6789/0 conn(0x7fcc1406da30 legacy=0x7fcc140ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140cc460 con 0x7fcc14141900 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fcc04001670 con 0x7fcc14141900 2023-12-19T05:46:29.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 >> v1:172.21.15.49:6789/0 conn(0x7fcc14141900 legacy=0x7fcc140afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc00004000 0x7fcc000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc00004d00 0x7fcc00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140cc180 con 0x7fcc00004000 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000bb70 con 0x7fcc00004d00 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000bd30 con 0x7fcc140b0470 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc00004000 0x7fcc000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.162+0000 7fcc1259c640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc12d9d640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc00004d00 0x7fcc00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc0bfff640 1 -- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 msgr2=0x7fcc000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc000039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc0bfff640 1 -- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc00004d00 msgr2=0x7fcc00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc00004d00 0x7fcc00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc0bfff640 1 -- 172.21.15.49:0/4088935911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00003520 con 0x7fcc00004000 2023-12-19T05:46:29.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc1259c640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc140b0470 0x7fcc000039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:29.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.163+0000 7fcc12d9d640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc00004d00 0x7fcc00005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:29.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.164+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc00004000 0x7fcc000047c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00ba30 tx=0x7fcc000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d79ca0db79aa678 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.164+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032640 con 0x7fcc00004000 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.164+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0327a0 con 0x7fcc00004000 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.164+0000 7fcc11d9b640 1 -- 172.21.15.49:0/4088935911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032b30 con 0x7fcc00004000 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 -- 172.21.15.49:0/4088935911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc00004000 msgr2=0x7fcc000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 --2- 172.21.15.49:0/4088935911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc00004000 0x7fcc000047c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00ba30 tx=0x7fcc000057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc12d9d640 1 -- 172.21.15.49:0/4088935911 reap_dead start 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 -- 172.21.15.49:0/4088935911 shutdown_connections 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 -- 172.21.15.49:0/4088935911 >> 172.21.15.49:0/4088935911 conn(0x7fcc1406f630 msgr2=0x7fcc1406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 -- 172.21.15.49:0/4088935911 shutdown_connections 2023-12-19T05:46:29.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.165+0000 7fcc1359e640 1 -- 172.21.15.49:0/4088935911 wait complete. 2023-12-19T05:46:29.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.167+0000 7fcc1359e640 1 Processor -- start 2023-12-19T05:46:29.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.167+0000 7fcc1359e640 1 -- start start 2023-12-19T05:46:29.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc00004000 0x7fcc1415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc140cead0 0x7fcc140cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140cf490 con 0x7fcc141338f0 2023-12-19T05:46:29.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140a84a0 con 0x7fcc140cead0 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc1359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14130f00 con 0x7fcc00004000 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34280/0 (socket says 172.21.15.49:34280) 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.168+0000 7fcc0bfff640 1 -- 172.21.15.49:0/2478922346 learned_addr learned my addr 172.21.15.49:0/2478922346 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 -- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc00004000 msgr2=0x7fcc1415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc1259c640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc00004000 0x7fcc1415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc00004000 0x7fcc1415ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 -- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc140cead0 msgr2=0x7fcc140cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc140cead0 0x7fcc140cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 -- 172.21.15.49:0/2478922346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140acbe0 con 0x7fcc141338f0 2023-12-19T05:46:29.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0bfff640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00bb50 tx=0x7fcbfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc03ba70 con 0x7fcc141338f0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc03bbf0 con 0x7fcc141338f0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc030410 con 0x7fcc141338f0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.169+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140acec0 con 0x7fcc141338f0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.170+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc140a86f0 con 0x7fcc141338f0 2023-12-19T05:46:29.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.171+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc14061910 con 0x7fcc141338f0 2023-12-19T05:46:29.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.171+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbfc030570 con 0x7fcc141338f0 2023-12-19T05:46:29.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.172+0000 7fcc0affd640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 0x7fcbf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.172+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbfc0aae50 con 0x7fcc141338f0 2023-12-19T05:46:29.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.173+0000 7fcc1259c640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 0x7fcbf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.174+0000 7fcc1259c640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 0x7fcbf406c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007930 tx=0x7fcc04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.176+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbfc079e30 con 0x7fcc141338f0 2023-12-19T05:46:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.369+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc140717d0 con 0x7fcc141338f0 2023-12-19T05:46:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.370+0000 7fcc0affd640 1 -- 172.21.15.49:0/2478922346 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbfc036020 con 0x7fcc141338f0 2023-12-19T05:46:29.372 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 msgr2=0x7fcbf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 0x7fcbf406c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007930 tx=0x7fcc04009040 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 msgr2=0x7fcc140ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00bb50 tx=0x7fcbfc004730 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 shutdown_connections 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcbf406a430 0x7fcbf406c8f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc140cead0 0x7fcc140cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc141338f0 0x7fcc140ac300 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 --2- 172.21.15.49:0/2478922346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc00004000 0x7fcc1415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 >> 172.21.15.49:0/2478922346 conn(0x7fcc1406f630 msgr2=0x7fcc1415c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 shutdown_connections 2023-12-19T05:46:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.373+0000 7fcc1359e640 1 -- 172.21.15.49:0/2478922346 wait complete. 2023-12-19T05:46:29.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:46:29.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.632+0000 7f8ada05b640 1 Processor -- start 2023-12-19T05:46:29.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.633+0000 7f8ada05b640 1 -- start start 2023-12-19T05:46:29.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.634+0000 7f8ada05b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.634+0000 7f8ada05b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.634+0000 7f8ada05b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad4140740 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.634+0000 7f8ada05b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad4143990 con 0x7f8ad40b6130 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.634+0000 7f8ada05b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b8610 con 0x7f8ad4140360 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.635+0000 7f8ad9059640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.635+0000 7f8ad985a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.635+0000 7f8ad985a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:43862/0 (socket says 172.21.15.49:43862) 2023-12-19T05:46:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.635+0000 7f8ad985a640 1 -- 172.21.15.49:0/289678319 learned_addr learned my addr 172.21.15.49:0/289678319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:29.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.636+0000 7f8ad9059640 1 -- 172.21.15.49:0/289678319 >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 msgr2=0x7f8ad4161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:29.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.636+0000 7f8ad9059640 1 --2- 172.21.15.49:0/289678319 >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.636+0000 7f8ad9059640 1 -- 172.21.15.49:0/289678319 >> v1:172.21.15.115:6789/0 conn(0x7f8ad40b5cd0 legacy=0x7f8ad4160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.636+0000 7f8ad9059640 1 -- 172.21.15.49:0/289678319 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4142e10 con 0x7f8ad4140360 2023-12-19T05:46:29.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.636+0000 7f8ad985a640 1 --2- 172.21.15.49:0/289678319 >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:46:29.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.638+0000 7f8ad9059640 1 --2- 172.21.15.49:0/289678319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad40b80d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097a0 tx=0x7f8ad002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe0d12482032885 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.638+0000 7f8acbfff640 1 -- 172.21.15.49:0/289678319 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0031780 con 0x7f8ad4140360 2023-12-19T05:46:29.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.638+0000 7f8acbfff640 1 -- 172.21.15.49:0/289678319 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00318e0 con 0x7f8ad4140360 2023-12-19T05:46:29.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.638+0000 7f8acbfff640 1 -- 172.21.15.49:0/289678319 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0031c70 con 0x7f8ad4140360 2023-12-19T05:46:29.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 -- 172.21.15.49:0/289678319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 msgr2=0x7f8ad40b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 --2- 172.21.15.49:0/289678319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad40b80d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097a0 tx=0x7f8ad002b820 comp rx=0 tx=0).stop 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 -- 172.21.15.49:0/289678319 shutdown_connections 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 --2- 172.21.15.49:0/289678319 >> v2:172.21.15.115:3300/0 conn(0x7f8ad40b6130 0x7f8ad4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 --2- 172.21.15.49:0/289678319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad40b80d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 -- 172.21.15.49:0/289678319 >> 172.21.15.49:0/289678319 conn(0x7f8ad4065dc0 msgr2=0x7f8ad40b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 -- 172.21.15.49:0/289678319 shutdown_connections 2023-12-19T05:46:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.639+0000 7f8ada05b640 1 -- 172.21.15.49:0/289678319 wait complete. 2023-12-19T05:46:29.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.642+0000 7f8ada05b640 1 Processor -- start 2023-12-19T05:46:29.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.642+0000 7f8ada05b640 1 -- start start 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.643+0000 7f8ada05b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.643+0000 7f8ada05b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad40b6130 0x7f8ad41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ada05b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad4152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ada05b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41f6c50 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ada05b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41f6f30 con 0x7f8ad40b6130 2023-12-19T05:46:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ada05b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41f7210 con 0x7f8ad4140360 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ad9059640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ad9059640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34288/0 (socket says 172.21.15.49:34288) 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ad9059640 1 -- 172.21.15.49:0/10431187 learned_addr learned my addr 172.21.15.49:0/10431187 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ad8858640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad40b6130 0x7f8ad41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.644+0000 7f8ad985a640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad4152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 -- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 msgr2=0x7f8ad4152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad4152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 -- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad40b6130 msgr2=0x7f8ad41417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad40b6130 0x7f8ad41417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 -- 172.21.15.49:0/10431187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc009b30 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad985a640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ad9059640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000c00 tx=0x7f8ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0032820 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00329a0 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0032d50 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.645+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0009400 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.646+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad40cece0 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.647+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad40ce860 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.648+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ad004e450 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.649+0000 7f8ac9ffb640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 0x7f8ab806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.649+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ad00aaa30 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.650+0000 7f8ad8858640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 0x7f8ab806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.651+0000 7f8ad8858640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 0x7f8ab806c8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4142470 tx=0x7f8ac4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.653+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ad40ce860 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.847+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ad40ce860 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.848+0000 7f8ac9ffb640 1 -- 172.21.15.49:0/10431187 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ad40ce860 con 0x7f8ad40b5cd0 2023-12-19T05:46:29.850 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:46:29.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 msgr2=0x7f8ab806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 0x7f8ab806c8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4142470 tx=0x7f8ac4009040 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 msgr2=0x7f8ad41f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000c00 tx=0x7f8ad00046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 shutdown_connections 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab806a430 0x7f8ab806c8f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ad4140360 0x7f8ad4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad40b6130 0x7f8ad41417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 --2- 172.21.15.49:0/10431187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ad40b5cd0 0x7f8ad41f6350 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 >> 172.21.15.49:0/10431187 conn(0x7f8ad4065dc0 msgr2=0x7f8ad40d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 shutdown_connections 2023-12-19T05:46:29.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:29.851+0000 7f8ada05b640 1 -- 172.21.15.49:0/10431187 wait complete. 2023-12-19T05:46:29.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:46:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.109+0000 7fea8ed4c640 1 Processor -- start 2023-12-19T05:46:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.109+0000 7fea8ed4c640 1 -- start start 2023-12-19T05:46:30.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8ed4c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea88141900 0x7fea880afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8ed4c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea8806dc00 0x7fea880ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8ed4c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8806e220 con 0x7fea880b02a0 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8ed4c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880b0730 con 0x7fea8806dc00 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8ed4c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880cbea0 con 0x7fea88141900 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8e54b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea8806dc00 0x7fea880ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8e54b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea8806dc00 0x7fea880ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34304/0 (socket says 172.21.15.49:34304) 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8e54b640 1 -- 172.21.15.49:0/1376889040 learned_addr learned my addr 172.21.15.49:0/1376889040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:30.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.111+0000 7fea8dd4a640 1 --2- 172.21.15.49:0/1376889040 >> v2:172.21.15.115:3300/0 conn(0x7fea88141900 0x7fea880afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.112+0000 7fea8e54b640 1 -- 172.21.15.49:0/1376889040 >> v2:172.21.15.115:3300/0 conn(0x7fea88141900 msgr2=0x7fea880afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.112+0000 7fea8e54b640 1 --2- 172.21.15.49:0/1376889040 >> v2:172.21.15.115:3300/0 conn(0x7fea88141900 0x7fea880afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.112+0000 7fea8e54b640 1 -- 172.21.15.49:0/1376889040 >> v1:172.21.15.115:6789/0 conn(0x7fea880b02a0 legacy=0x7fea8806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.112+0000 7fea8e54b640 1 -- 172.21.15.49:0/1376889040 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880cc180 con 0x7fea8806dc00 2023-12-19T05:46:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.113+0000 7fea8e54b640 1 --2- 172.21.15.49:0/1376889040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806dc00 0x7fea880ccc60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fea88067480 tx=0x7fea8002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf17e6f2f819ec72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.113+0000 7fea8cd48640 1 -- 172.21.15.49:0/1376889040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8002ca80 con 0x7fea8806dc00 2023-12-19T05:46:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.113+0000 7fea8cd48640 1 -- 172.21.15.49:0/1376889040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8002cbe0 con 0x7fea8806dc00 2023-12-19T05:46:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.113+0000 7fea8cd48640 1 -- 172.21.15.49:0/1376889040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800343f0 con 0x7fea8806dc00 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 -- 172.21.15.49:0/1376889040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806dc00 msgr2=0x7fea880ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/1376889040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806dc00 0x7fea880ccc60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fea88067480 tx=0x7fea8002bee0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 -- 172.21.15.49:0/1376889040 shutdown_connections 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/1376889040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8806dc00 0x7fea880ccc60 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/1376889040 >> v2:172.21.15.115:3300/0 conn(0x7fea88141900 0x7fea880afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 -- 172.21.15.49:0/1376889040 >> 172.21.15.49:0/1376889040 conn(0x7fea8806f630 msgr2=0x7fea8806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 -- 172.21.15.49:0/1376889040 shutdown_connections 2023-12-19T05:46:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.114+0000 7fea8ed4c640 1 -- 172.21.15.49:0/1376889040 wait complete. 2023-12-19T05:46:30.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.116+0000 7fea8ed4c640 1 Processor -- start 2023-12-19T05:46:30.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.116+0000 7fea8ed4c640 1 -- start start 2023-12-19T05:46:30.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 0x7fea880a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea880b02a0 0x7fea880aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea881f4fb0 con 0x7fea88141900 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880ab2d0 con 0x7fea8806dc00 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.117+0000 7fea8ed4c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea881f4430 con 0x7fea880b02a0 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34310/0 (socket says 172.21.15.49:34310) 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 -- 172.21.15.49:0/2448038527 learned_addr learned my addr 172.21.15.49:0/2448038527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8dd4a640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 0x7fea880a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8d549640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea880b02a0 0x7fea880aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 -- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea880b02a0 msgr2=0x7fea880aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea880b02a0 0x7fea880aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 -- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 msgr2=0x7fea880a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 0x7fea880a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 -- 172.21.15.49:0/2448038527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80009b30 con 0x7fea88141900 2023-12-19T05:46:30.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8dd4a640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 0x7fea880a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:30.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.118+0000 7fea8e54b640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fea80036040 tx=0x7fea80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.119+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80009510 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.119+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8003e450 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.119+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8003e7e0 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.119+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea881f4710 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.119+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea881f4cd0 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.120+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea880cd150 con 0x7fea88141900 2023-12-19T05:46:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.121+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea8002cd50 con 0x7fea88141900 2023-12-19T05:46:30.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.122+0000 7fea7e7fc640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.122+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea800ab3a0 con 0x7fea88141900 2023-12-19T05:46:30.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.123+0000 7fea8dd4a640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.124+0000 7fea8dd4a640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.126+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea80076a20 con 0x7fea88141900 2023-12-19T05:46:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.325+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea8806c5d0 con 0x7fea88141900 2023-12-19T05:46:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.326+0000 7fea7e7fc640 1 -- 172.21.15.49:0/2448038527 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea8007a040 con 0x7fea88141900 2023-12-19T05:46:30.327 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 msgr2=0x7fea6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84008040 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 msgr2=0x7fea880acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fea80036040 tx=0x7fea80004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 shutdown_connections 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fea6c06a430 0x7fea6c06c8f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea880b02a0 0x7fea880aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea88141900 0x7fea880acaa0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 --2- 172.21.15.49:0/2448038527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea8806dc00 0x7fea880a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 >> 172.21.15.49:0/2448038527 conn(0x7fea8806f630 msgr2=0x7fea8815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 shutdown_connections 2023-12-19T05:46:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.329+0000 7fea8ed4c640 1 -- 172.21.15.49:0/2448038527 wait complete. 2023-12-19T05:46:30.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:46:30.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.569+0000 7fb436139640 1 Processor -- start 2023-12-19T05:46:30.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.570+0000 7fb436139640 1 -- start start 2023-12-19T05:46:30.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4301449e0 0x7fb4300af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4300b0b50 0x7fb43006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4300afb10 con 0x7fb4300b0b50 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43006bb30 con 0x7fb4301449e0 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.571+0000 7fb436139640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300b0070 con 0x7fb43006b590 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.572+0000 7fb427fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4300b0b50 0x7fb43006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.572+0000 7fb427fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4300b0b50 0x7fb43006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34318/0 (socket says 172.21.15.49:34318) 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.572+0000 7fb427fff640 1 -- 172.21.15.49:0/245183802 learned_addr learned my addr 172.21.15.49:0/245183802 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.572+0000 7fb42f7fe640 1 --2- 172.21.15.49:0/245183802 >> v2:172.21.15.115:3300/0 conn(0x7fb4301449e0 0x7fb4300af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.572+0000 7fb42ffff640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.573+0000 7fb427fff640 1 -- 172.21.15.49:0/245183802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 msgr2=0x7fb43006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.573+0000 7fb427fff640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.573+0000 7fb427fff640 1 -- 172.21.15.49:0/245183802 >> v2:172.21.15.115:3300/0 conn(0x7fb4301449e0 msgr2=0x7fb4300af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.573+0000 7fb427fff640 1 --2- 172.21.15.49:0/245183802 >> v2:172.21.15.115:3300/0 conn(0x7fb4301449e0 0x7fb4300af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.573+0000 7fb427fff640 1 -- 172.21.15.49:0/245183802 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300b0350 con 0x7fb4300b0b50 2023-12-19T05:46:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.574+0000 7fb427fff640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb43006bfa0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb430071cd0 tx=0x7fb41802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba803ac8872863f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.574+0000 7fb42effd640 1 -- 172.21.15.49:0/245183802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418031870 con 0x7fb4300b0b50 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.574+0000 7fb42effd640 1 -- 172.21.15.49:0/245183802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4180319d0 con 0x7fb4300b0b50 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.574+0000 7fb42effd640 1 -- 172.21.15.49:0/245183802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418031d60 con 0x7fb4300b0b50 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 -- 172.21.15.49:0/245183802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 msgr2=0x7fb43006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb43006bfa0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb430071cd0 tx=0x7fb41802b910 comp rx=0 tx=0).stop 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 -- 172.21.15.49:0/245183802 shutdown_connections 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 --2- 172.21.15.49:0/245183802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb43006bfa0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 --2- 172.21.15.49:0/245183802 >> v2:172.21.15.115:3300/0 conn(0x7fb4301449e0 0x7fb4300af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 -- 172.21.15.49:0/245183802 >> 172.21.15.49:0/245183802 conn(0x7fb4300cbb70 msgr2=0x7fb4300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 -- 172.21.15.49:0/245183802 shutdown_connections 2023-12-19T05:46:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.575+0000 7fb436139640 1 -- 172.21.15.49:0/245183802 wait complete. 2023-12-19T05:46:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.577+0000 7fb436139640 1 Processor -- start 2023-12-19T05:46:30.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.577+0000 7fb436139640 1 -- start start 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43013d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 0x7fb43013a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43013b8b0 con 0x7fb4300b0b50 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43013bb90 con 0x7fb4301449e0 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb436139640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43013be70 con 0x7fb43006b590 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.578+0000 7fb427fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34334/0 (socket says 172.21.15.49:34334) 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 -- 172.21.15.49:0/2520246663 learned_addr learned my addr 172.21.15.49:0/2520246663 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb42f7fe640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43013d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb42ffff640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 0x7fb43013a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 -- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 msgr2=0x7fb43013d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43013d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 -- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 msgr2=0x7fb43013a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 0x7fb43013a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 -- 172.21.15.49:0/2520246663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180094d0 con 0x7fb4300b0b50 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb42ffff640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 0x7fb43013a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.579+0000 7fb427fff640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb41802b950 tx=0x7fb4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.580+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41803ad30 con 0x7fb4300b0b50 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.580+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4180443f0 con 0x7fb4300b0b50 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.580+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180447a0 con 0x7fb4300b0b50 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.580+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43013c150 con 0x7fb4300b0b50 2023-12-19T05:46:30.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.580+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43013b4d0 con 0x7fb4300b0b50 2023-12-19T05:46:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.581+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43013c670 con 0x7fb4300b0b50 2023-12-19T05:46:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.582+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb41804d450 con 0x7fb4300b0b50 2023-12-19T05:46:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.584+0000 7fb42cff9640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 0x7fb41006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.584+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb41802d040 con 0x7fb4300b0b50 2023-12-19T05:46:30.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.584+0000 7fb42f7fe640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 0x7fb41006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.585+0000 7fb42f7fe640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 0x7fb41006c920 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb420006fd0 tx=0x7fb420008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.589+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb43013c670 con 0x7fb4300b0b50 2023-12-19T05:46:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.796+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb43013c670 con 0x7fb4300b0b50 2023-12-19T05:46:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.797+0000 7fb42cff9640 1 -- 172.21.15.49:0/2520246663 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v131) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb43013c670 con 0x7fb4300b0b50 2023-12-19T05:46:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 msgr2=0x7fb41006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 0x7fb41006c920 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb420006fd0 tx=0x7fb420008040 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 msgr2=0x7fb4300ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb41802b950 tx=0x7fb4180046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 shutdown_connections 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb41006a460 0x7fb41006c920 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4301449e0 0x7fb43013a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4300b0b50 0x7fb4300ce020 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 --2- 172.21.15.49:0/2520246663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb43006b590 0x7fb43013d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 >> 172.21.15.49:0/2520246663 conn(0x7fb4300cbb70 msgr2=0x7fb4300af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 shutdown_connections 2023-12-19T05:46:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:30.800+0000 7fb436139640 1 -- 172.21.15.49:0/2520246663 wait complete. 2023-12-19T05:46:30.819 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:46:30.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:30.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:46:30.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:46:30.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:30.934 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:46:30.989 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:30.990 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:31.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:46:31.053 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:31.054 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:31.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:46:31.113 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.342+0000 7fd0ad238640 1 Processor -- start 2023-12-19T05:46:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.343+0000 7fd0ad238640 1 -- start start 2023-12-19T05:46:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0ad238640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0a8146e10 0x7fd0a80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0ad238640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 0x7fd0a80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0ad238640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80cd840 con 0x7fd0a80ce110 2023-12-19T05:46:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0ad238640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80d2430 con 0x7fd0a8146e10 2023-12-19T05:46:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0ad238640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80d2620 con 0x7fd0a80d2b00 2023-12-19T05:46:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0a759e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0a80ce110 0x7fd0a80b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44584/0 (socket says 172.21.15.49:44584) 2023-12-19T05:46:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.344+0000 7fd0a759e640 1 -- 172.21.15.49:0/3162323926 learned_addr learned my addr 172.21.15.49:0/3162323926 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/3162323926 >> v2:172.21.15.115:3300/0 conn(0x7fd0a8146e10 0x7fd0a80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a659c640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 0x7fd0a80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925817086 0 0) 0x7fd0a80cd840 con 0x7fd0a80ce110 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd094003520 con 0x7fd0a80ce110 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3446170583 0 0) 0x7fd094003520 con 0x7fd0a80ce110 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 msgr2=0x7fd0a80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 0x7fd0a80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 >> v2:172.21.15.115:3300/0 conn(0x7fd0a8146e10 msgr2=0x7fd0a80d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 --2- 172.21.15.49:0/3162323926 >> v2:172.21.15.115:3300/0 conn(0x7fd0a8146e10 0x7fd0a80d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80b41c0 con 0x7fd0a80ce110 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd0a0001670 con 0x7fd0a80ce110 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 >> v1:172.21.15.49:6789/0 conn(0x7fd0a80ce110 legacy=0x7fd0a80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0940039e0 0x7fd094003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 0x7fd094005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80d2620 con 0x7fd0940039e0 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09400b980 con 0x7fd0940047c0 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.345+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09400bac0 con 0x7fd0a80d2b00 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0940039e0 0x7fd094003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 -- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 msgr2=0x7fd094005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d2b00 0x7fd094005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 -- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940047c0 msgr2=0x7fd094004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.346+0000 7fd0a6d9d640 1 -- 172.21.15.49:0/3162323926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094003520 con 0x7fd0940039e0 2023-12-19T05:46:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.347+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0940039e0 0x7fd094003e00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e170 tx=0x7fd0940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d5047b92e02bd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.347+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09802cc20 con 0x7fd0940039e0 2023-12-19T05:46:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.347+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800f040 con 0x7fd0940039e0 2023-12-19T05:46:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.347+0000 7fd0a5d9b640 1 -- 172.21.15.49:0/3162323926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098034440 con 0x7fd0940039e0 2023-12-19T05:46:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 -- 172.21.15.49:0/3162323926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0940039e0 msgr2=0x7fd094003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 --2- 172.21.15.49:0/3162323926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0940039e0 0x7fd094003e00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e170 tx=0x7fd0940057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0a759e640 1 -- 172.21.15.49:0/3162323926 reap_dead start 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 -- 172.21.15.49:0/3162323926 shutdown_connections 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 -- 172.21.15.49:0/3162323926 >> 172.21.15.49:0/3162323926 conn(0x7fd0a80b29c0 msgr2=0x7fd0a80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 -- 172.21.15.49:0/3162323926 shutdown_connections 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.348+0000 7fd0ad238640 1 -- 172.21.15.49:0/3162323926 wait complete. 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.350+0000 7fd0ad238640 1 Processor -- start 2023-12-19T05:46:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.350+0000 7fd0ad238640 1 -- start start 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940039e0 0x7fd0a80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 0x7fd0a81f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81603c0 con 0x7fd0a815fa00 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815ecd0 con 0x7fd0940039e0 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0ad238640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815efb0 con 0x7fd0a815e4e0 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0a759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0a759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34356/0 (socket says 172.21.15.49:34356) 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.351+0000 7fd0a759e640 1 -- 172.21.15.49:0/556463132 learned_addr learned my addr 172.21.15.49:0/556463132 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940039e0 0x7fd0a80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a659c640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 0x7fd0a81f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 -- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 msgr2=0x7fd0a81f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 0x7fd0a81f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 -- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940039e0 msgr2=0x7fd0a80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940039e0 0x7fd0a80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 -- 172.21.15.49:0/556463132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a815f290 con 0x7fd0a815fa00 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a659c640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 0x7fd0a81f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd0a759e640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0001050 tx=0x7fd0a000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0007440 con 0x7fd0a815fa00 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00075c0 con 0x7fd0a815fa00 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.352+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0004a20 con 0x7fd0a815fa00 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.353+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a815f570 con 0x7fd0a815fa00 2023-12-19T05:46:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.353+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a815e940 con 0x7fd0a815fa00 2023-12-19T05:46:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.354+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a815f700 con 0x7fd0a815fa00 2023-12-19T05:46:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.355+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0a0004b80 con 0x7fd0a815fa00 2023-12-19T05:46:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.356+0000 7fd09f7fe640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 0x7fd08806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.356+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0a0087df0 con 0x7fd0a815fa00 2023-12-19T05:46:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.357+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 0x7fd08806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.358+0000 7fd0a6d9d640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 0x7fd08806c920 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd098036000 tx=0x7fd09802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.361+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0a00533c0 con 0x7fd0a815fa00 2023-12-19T05:46:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.582+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a8061910 con 0x7fd0a815fa00 2023-12-19T05:46:31.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.583+0000 7fd09f7fe640 1 -- 172.21.15.49:0/556463132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fd0a001a020 con 0x7fd0a815fa00 2023-12-19T05:46:31.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:31.585 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:31.585 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 msgr2=0x7fd08806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 0x7fd08806c920 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd098036000 tx=0x7fd09802e000 comp rx=0 tx=0).stop 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 msgr2=0x7fd0a815fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0001050 tx=0x7fd0a000c930 comp rx=0 tx=0).stop 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 shutdown_connections 2023-12-19T05:46:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd08806a460 0x7fd08806c920 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a815e4e0 0x7fd0a81f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a815fa00 0x7fd0a815fe80 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 --2- 172.21.15.49:0/556463132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0940039e0 0x7fd0a80ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.585+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 >> 172.21.15.49:0/556463132 conn(0x7fd0a80b29c0 msgr2=0x7fd0a815cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.586+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 shutdown_connections 2023-12-19T05:46:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.586+0000 7fd0ad238640 1 -- 172.21.15.49:0/556463132 wait complete. 2023-12-19T05:46:31.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:31.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.829+0000 7f33f4500640 1 Processor -- start 2023-12-19T05:46:31.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.829+0000 7f33f4500640 1 -- start start 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f4500640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 0x7f33ec15e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f4500640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f33ec15b500 0x7f33ec06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f4500640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec15bd70 con 0x7f33ec06cbf0 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f4500640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec06d080 con 0x7f33ec15b500 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f4500640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec15e650 con 0x7f33ec143d00 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.830+0000 7f33f1a9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f33ec15b500 0x7f33ec06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f33ec15b500 0x7f33ec06c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34358/0 (socket says 172.21.15.49:34358) 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 -- 172.21.15.49:0/1341520927 learned_addr learned my addr 172.21.15.49:0/1341520927 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f229c640 1 --2- 172.21.15.49:0/1341520927 >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 0x7f33ec15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 -- 172.21.15.49:0/1341520927 >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 msgr2=0x7f33ec15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 --2- 172.21.15.49:0/1341520927 >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 0x7f33ec15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 -- 172.21.15.49:0/1341520927 >> v1:172.21.15.115:6789/0 conn(0x7f33ec06cbf0 legacy=0x7f33ec070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f1a9b640 1 -- 172.21.15.49:0/1341520927 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec15e930 con 0x7f33ec15b500 2023-12-19T05:46:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.831+0000 7f33f229c640 1 --2- 172.21.15.49:0/1341520927 >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 0x7f33ec15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.832+0000 7f33f1a9b640 1 --2- 172.21.15.49:0/1341520927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec15b500 0x7f33ec06c6b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f33ec06ea50 tx=0x7f33dc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e0454c6e4d9562 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.832+0000 7f33f129a640 1 -- 172.21.15.49:0/1341520927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0317e0 con 0x7f33ec15b500 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f129a640 1 -- 172.21.15.49:0/1341520927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc031940 con 0x7f33ec15b500 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f129a640 1 -- 172.21.15.49:0/1341520927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc031cd0 con 0x7f33ec15b500 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 -- 172.21.15.49:0/1341520927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec15b500 msgr2=0x7f33ec06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 --2- 172.21.15.49:0/1341520927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec15b500 0x7f33ec06c6b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f33ec06ea50 tx=0x7f33dc02b880 comp rx=0 tx=0).stop 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 -- 172.21.15.49:0/1341520927 shutdown_connections 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 --2- 172.21.15.49:0/1341520927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec15b500 0x7f33ec06c6b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 --2- 172.21.15.49:0/1341520927 >> v2:172.21.15.115:3300/0 conn(0x7f33ec143d00 0x7f33ec15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 -- 172.21.15.49:0/1341520927 >> 172.21.15.49:0/1341520927 conn(0x7f33ec0d01a0 msgr2=0x7f33ec0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:31.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 -- 172.21.15.49:0/1341520927 shutdown_connections 2023-12-19T05:46:31.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.833+0000 7f33f4500640 1 -- 172.21.15.49:0/1341520927 wait complete. 2023-12-19T05:46:31.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.835+0000 7f33f4500640 1 Processor -- start 2023-12-19T05:46:31.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.835+0000 7f33f4500640 1 -- start start 2023-12-19T05:46:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec06cbf0 0x7f33ec13f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec15b500 0x7f33ec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1f3d60 con 0x7f33ec143d00 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1f6390 con 0x7f33ec15b500 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.836+0000 7f33f4500640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1f65e0 con 0x7f33ec06cbf0 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34370/0 (socket says 172.21.15.49:34370) 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 -- 172.21.15.49:0/2172821618 learned_addr learned my addr 172.21.15.49:0/2172821618 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f229c640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec06cbf0 0x7f33ec13f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f2a9d640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec15b500 0x7f33ec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 -- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec06cbf0 msgr2=0x7f33ec13f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec06cbf0 0x7f33ec13f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 -- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec15b500 msgr2=0x7f33ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec15b500 0x7f33ec15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.837+0000 7f33f1a9b640 1 -- 172.21.15.49:0/2172821618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0094d0 con 0x7f33ec143d00 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33f1a9b640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000c00 tx=0x7f33dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc032980 con 0x7f33ec143d00 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc032ae0 con 0x7f33ec143d00 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc032e90 con 0x7f33ec143d00 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec1f68c0 con 0x7f33ec143d00 2023-12-19T05:46:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.838+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec1f6e80 con 0x7f33ec143d00 2023-12-19T05:46:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.839+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec1f7070 con 0x7f33ec143d00 2023-12-19T05:46:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.840+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33dc04d3f0 con 0x7f33ec143d00 2023-12-19T05:46:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.841+0000 7f33e2ffd640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 0x7f33d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.841+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33dc0aa870 con 0x7f33ec143d00 2023-12-19T05:46:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.842+0000 7f33f229c640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 0x7f33d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:31.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.843+0000 7f33f229c640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 0x7f33d006c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f33ec141b40 tx=0x7f33e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:31.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:31.845+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f33dc075fa0 con 0x7f33ec143d00 2023-12-19T05:46:32.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.045+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33ec061910 con 0x7f33ec143d00 2023-12-19T05:46:32.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.047+0000 7f33e2ffd640 1 -- 172.21.15.49:0/2172821618 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f33dc0795c0 con 0x7f33ec143d00 2023-12-19T05:46:32.049 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:32.049 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:32.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 msgr2=0x7f33d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 0x7f33d006c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f33ec141b40 tx=0x7f33e8008040 comp rx=0 tx=0).stop 2023-12-19T05:46:32.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 msgr2=0x7f33ec15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000c00 tx=0x7f33dc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 shutdown_connections 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f33d006a430 0x7f33d006c8f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec15b500 0x7f33ec15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec143d00 0x7f33ec15d090 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 --2- 172.21.15.49:0/2172821618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec06cbf0 0x7f33ec13f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 >> 172.21.15.49:0/2172821618 conn(0x7f33ec0d01a0 msgr2=0x7f33ec0d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 shutdown_connections 2023-12-19T05:46:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.050+0000 7f33f4500640 1 -- 172.21.15.49:0/2172821618 wait complete. 2023-12-19T05:46:32.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:05.075551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:06.182867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:32.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.302+0000 7fe9a5527640 1 Processor -- start 2023-12-19T05:46:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.303+0000 7fe9a5527640 1 -- start start 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.304+0000 7fe9a5527640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe9a00b6430 0x7fe9a00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.304+0000 7fe9a5527640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a0161e70 con 0x7fe9a006fc40 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.304+0000 7fe9a5527640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a0161260 con 0x7fe9a0146ff0 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.304+0000 7fe9a5527640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a0161080 con 0x7fe9a00b6430 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.305+0000 7fe99e7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe9a006fc40 0x7fe9a015dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44588/0 (socket says 172.21.15.49:44588) 2023-12-19T05:46:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.305+0000 7fe99e7fc640 1 -- 172.21.15.49:0/3690452086 learned_addr learned my addr 172.21.15.49:0/3690452086 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.305+0000 7fe99f7fe640 1 --2- 172.21.15.49:0/3690452086 >> v2:172.21.15.115:3300/0 conn(0x7fe9a00b6430 0x7fe9a00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.305+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310538877 0 0) 0x7fe9a0161e70 con 0x7fe9a006fc40 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.305+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe98c003520 con 0x7fe9a006fc40 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628496077 0 0) 0x7fe98c003520 con 0x7fe9a006fc40 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 >> v2:172.21.15.115:3300/0 conn(0x7fe9a00b6430 msgr2=0x7fe9a00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 --2- 172.21.15.49:0/3690452086 >> v2:172.21.15.115:3300/0 conn(0x7fe9a00b6430 0x7fe9a00d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 >> v1:172.21.15.115:6789/0 conn(0x7fe9a0146ff0 legacy=0x7fe9a006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0161540 con 0x7fe9a006fc40 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe988001670 con 0x7fe9a006fc40 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 >> v1:172.21.15.49:6789/0 conn(0x7fe9a006fc40 legacy=0x7fe9a015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 0x7fe98c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c0047c0 0x7fe98c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0051d0 0x7fe98c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0161080 con 0x7fe98c003a30 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c00c100 con 0x7fe98c0051d0 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c00c2c0 con 0x7fe98c0047c0 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.306+0000 7fe99effd640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 0x7fe98c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99f7fe640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0051d0 0x7fe98c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99e7fc640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c0047c0 0x7fe98c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99effd640 1 -- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c0047c0 msgr2=0x7fe98c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99effd640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c0047c0 0x7fe98c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99effd640 1 -- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0051d0 msgr2=0x7fe98c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99effd640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0051d0 0x7fe98c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99effd640 1 -- 172.21.15.49:0/3690452086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c003520 con 0x7fe98c003a30 2023-12-19T05:46:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.307+0000 7fe99f7fe640 1 -- 172.21.15.49:0/3690452086 reap_dead start 2023-12-19T05:46:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.308+0000 7fe99effd640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 0x7fe98c003e50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe990001e50 tx=0x7fe98c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b1cf0a5658927e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.308+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990003b70 con 0x7fe98c003a30 2023-12-19T05:46:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.308+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990003cd0 con 0x7fe98c003a30 2023-12-19T05:46:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.308+0000 7fe99dffb640 1 -- 172.21.15.49:0/3690452086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990005310 con 0x7fe98c003a30 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 -- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 msgr2=0x7fe98c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 0x7fe98c003e50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe990001e50 tx=0x7fe98c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 -- 172.21.15.49:0/3690452086 shutdown_connections 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3690452086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c003a30 0x7fe98c003e50 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 -- 172.21.15.49:0/3690452086 >> 172.21.15.49:0/3690452086 conn(0x7fe9a00d3520 msgr2=0x7fe9a00d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 -- 172.21.15.49:0/3690452086 shutdown_connections 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.309+0000 7fe9a5527640 1 -- 172.21.15.49:0/3690452086 wait complete. 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.311+0000 7fe9a5527640 1 Processor -- start 2023-12-19T05:46:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.311+0000 7fe9a5527640 1 -- start start 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c003a30 0x7fe9a013c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a013d920 0x7fe9a013b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a01f37a0 con 0x7fe9a015ce30 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a013be40 con 0x7fe9a013d920 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe9a5527640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a01f2b20 con 0x7fe98c003a30 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe99f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe99f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34390/0 (socket says 172.21.15.49:34390) 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe99f7fe640 1 -- 172.21.15.49:0/3864949872 learned_addr learned my addr 172.21.15.49:0/3864949872 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.312+0000 7fe99effd640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c003a30 0x7fe9a013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99e7fc640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a013d920 0x7fe9a013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 -- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c003a30 msgr2=0x7fe9a013c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c003a30 0x7fe9a013c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 -- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a013d920 msgr2=0x7fe9a013b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a013d920 0x7fe9a013b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 -- 172.21.15.49:0/3864949872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a01f2e00 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe99f7fe640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe9a01620c0 tx=0x7fe998011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998004440 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998003610 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980039c0 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.313+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a01f30e0 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.314+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a015d2b0 con 0x7fe9a015ce30 2023-12-19T05:46:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.315+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a01f38e0 con 0x7fe9a015ce30 2023-12-19T05:46:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.316+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe998003b20 con 0x7fe9a015ce30 2023-12-19T05:46:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.317+0000 7fe9977fe640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 0x7fe98006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.317+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe998088c80 con 0x7fe9a015ce30 2023-12-19T05:46:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.317+0000 7fe99effd640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 0x7fe98006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.319+0000 7fe99effd640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 0x7fe98006c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe990034000 tx=0x7fe990009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.321+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe998054300 con 0x7fe9a015ce30 2023-12-19T05:46:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.514+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9a0061910 con 0x7fe9a015ce30 2023-12-19T05:46:32.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.515+0000 7fe9977fe640 1 -- 172.21.15.49:0/3864949872 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe998057920 con 0x7fe9a015ce30 2023-12-19T05:46:32.516 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:32.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 msgr2=0x7fe98006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 0x7fe98006c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe990034000 tx=0x7fe990009030 comp rx=0 tx=0).stop 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 msgr2=0x7fe9a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe9a01620c0 tx=0x7fe998011920 comp rx=0 tx=0).stop 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 shutdown_connections 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe98006a430 0x7fe98006c8f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9a015ce30 0x7fe9a0071210 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a013d920 0x7fe9a013b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 --2- 172.21.15.49:0/3864949872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c003a30 0x7fe9a013c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 >> 172.21.15.49:0/3864949872 conn(0x7fe9a00d3520 msgr2=0x7fe9a006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.517+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 shutdown_connections 2023-12-19T05:46:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.518+0000 7fe9a5527640 1 -- 172.21.15.49:0/3864949872 wait complete. 2023-12-19T05:46:32.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:46:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.778+0000 7f86ab349640 1 Processor -- start 2023-12-19T05:46:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.778+0000 7f86ab349640 1 -- start start 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86ab349640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a40b0a00 0x7f86a40b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86ab349640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86a40cd430 0x7f86a406b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86ab349640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a406b3a0 con 0x7f86a4159e40 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86ab349640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40b23e0 con 0x7f86a40cd430 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86ab349640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40cd8a0 con 0x7f86a40b0a00 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86aa347640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f86a4159e40 0x7f86a40b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44598/0 (socket says 172.21.15.49:44598) 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86aa347640 1 -- 172.21.15.49:0/2976432280 learned_addr learned my addr 172.21.15.49:0/2976432280 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.780+0000 7f86aab48640 1 --2- 172.21.15.49:0/2976432280 >> v2:172.21.15.49:3300/0 conn(0x7f86a40cd430 0x7f86a406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86a9b46640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a40b0a00 0x7f86a40b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86a9345640 1 -- 172.21.15.49:0/2976432280 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932390936 0 0) 0x7f86a406b3a0 con 0x7f86a4159e40 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86a9345640 1 -- 172.21.15.49:0/2976432280 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003520 con 0x7f86a4159e40 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86aab48640 1 -- 172.21.15.49:0/2976432280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a40b0a00 msgr2=0x7f86a40b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86aab48640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a40b0a00 0x7f86a40b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86aab48640 1 -- 172.21.15.49:0/2976432280 >> v1:172.21.15.49:6789/0 conn(0x7f86a4159e40 legacy=0x7f86a40b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.781+0000 7f86aab48640 1 -- 172.21.15.49:0/2976432280 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40b1860 con 0x7f86a40cd430 2023-12-19T05:46:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.782+0000 7f86aab48640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a406b810 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097a0 tx=0x7f869c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5401927f166cb27a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86a9345640 1 -- 172.21.15.49:0/2976432280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c030800 con 0x7f86a40cd430 2023-12-19T05:46:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86a9345640 1 -- 172.21.15.49:0/2976432280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c030960 con 0x7f86a40cd430 2023-12-19T05:46:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86a9345640 1 -- 172.21.15.49:0/2976432280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c030cf0 con 0x7f86a40cd430 2023-12-19T05:46:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 -- 172.21.15.49:0/2976432280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 msgr2=0x7f86a406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a406b810 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097a0 tx=0x7f869c02b940 comp rx=0 tx=0).stop 2023-12-19T05:46:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 -- 172.21.15.49:0/2976432280 shutdown_connections 2023-12-19T05:46:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a406b810 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 --2- 172.21.15.49:0/2976432280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a40b0a00 0x7f86a40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.783+0000 7f86ab349640 1 -- 172.21.15.49:0/2976432280 >> 172.21.15.49:0/2976432280 conn(0x7f86a40659a0 msgr2=0x7f86a4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:32.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.784+0000 7f86ab349640 1 -- 172.21.15.49:0/2976432280 shutdown_connections 2023-12-19T05:46:32.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.784+0000 7f86ab349640 1 -- 172.21.15.49:0/2976432280 wait complete. 2023-12-19T05:46:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.785+0000 7f86ab349640 1 Processor -- start 2023-12-19T05:46:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.785+0000 7f86ab349640 1 -- start start 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86a40b0a00 0x7f86a415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a4159e40 0x7f86a41f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4156790 con 0x7f86a40cd430 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40a98b0 con 0x7f86a40b0a00 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.786+0000 7f86ab349640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40a9420 con 0x7f86a4159e40 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34410/0 (socket says 172.21.15.49:34410) 2023-12-19T05:46:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 -- 172.21.15.49:0/1260610538 learned_addr learned my addr 172.21.15.49:0/1260610538 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86aa347640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86a40b0a00 0x7f86a415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86aab48640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a4159e40 0x7f86a41f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 -- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a4159e40 msgr2=0x7f86a41f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a4159e40 0x7f86a41f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 -- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86a40b0a00 msgr2=0x7f86a415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86a40b0a00 0x7f86a415ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.787+0000 7f86a9b46640 1 -- 172.21.15.49:0/1260610538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c009400 con 0x7f86a40cd430 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86a9b46640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f869800e870 tx=0x7f869800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980094f0 con 0x7f86a40cd430 2023-12-19T05:46:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800c940 con 0x7f86a40cd430 2023-12-19T05:46:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800ccf0 con 0x7f86a40cd430 2023-12-19T05:46:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a40a8810 con 0x7f86a40cd430 2023-12-19T05:46:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.788+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a40a8dd0 con 0x7f86a40cd430 2023-12-19T05:46:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.789+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a4061910 con 0x7f86a40cd430 2023-12-19T05:46:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.790+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8698013470 con 0x7f86a40cd430 2023-12-19T05:46:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.791+0000 7f86a2ffd640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 0x7f869006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.791+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8698088af0 con 0x7f86a40cd430 2023-12-19T05:46:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.792+0000 7f86aa347640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 0x7f869006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.793+0000 7f86aa347640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 0x7f869006c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8694001560 tx=0x7f8694009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.795+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8698054040 con 0x7f86a40cd430 2023-12-19T05:46:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.987+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86a4073430 con 0x7f86a40cd430 2023-12-19T05:46:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.988+0000 7f86a2ffd640 1 -- 172.21.15.49:0/1260610538 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8698017020 con 0x7f86a40cd430 2023-12-19T05:46:32.989 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 msgr2=0x7f869006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 0x7f869006c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8694001560 tx=0x7f8694009040 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 msgr2=0x7f86a41f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f869800e870 tx=0x7f869800ed30 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 shutdown_connections 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f869006a430 0x7f869006c8f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86a4159e40 0x7f86a41f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86a40cd430 0x7f86a41f3a80 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 --2- 172.21.15.49:0/1260610538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86a40b0a00 0x7f86a415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 >> 172.21.15.49:0/1260610538 conn(0x7f86a40659a0 msgr2=0x7f86a40ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 shutdown_connections 2023-12-19T05:46:32.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:32.991+0000 7f86ab349640 1 -- 172.21.15.49:0/1260610538 wait complete. 2023-12-19T05:46:33.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:46:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.227+0000 7f0ef1ce5640 1 Processor -- start 2023-12-19T05:46:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.228+0000 7f0ef1ce5640 1 -- start start 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef1ce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec06f490 0x7f0eec06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef1ce5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0eec0d1670 0x7f0eec0d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef1ce5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec06fe30 con 0x7f0eec146cd0 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef1ce5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec1470b0 con 0x7f0eec0d1670 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef1ce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec070260 con 0x7f0eec06f490 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef14e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0eec0d1670 0x7f0eec0d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef14e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0eec0d1670 0x7f0eec0d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34422/0 (socket says 172.21.15.49:34422) 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.230+0000 7f0ef14e4640 1 -- 172.21.15.49:0/4270192405 learned_addr learned my addr 172.21.15.49:0/4270192405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.231+0000 7f0eebfff640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec06f490 0x7f0eec06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.231+0000 7f0ef14e4640 1 -- 172.21.15.49:0/4270192405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec06f490 msgr2=0x7f0eec06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:33.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.231+0000 7f0ef14e4640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec06f490 0x7f0eec06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.231+0000 7f0ef14e4640 1 -- 172.21.15.49:0/4270192405 >> v1:172.21.15.115:6789/0 conn(0x7f0eec146cd0 legacy=0x7f0eec0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:33.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.231+0000 7f0ef14e4640 1 -- 172.21.15.49:0/4270192405 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0b6ea0 con 0x7f0eec0d1670 2023-12-19T05:46:33.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.232+0000 7f0ef14e4640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec0d1670 0x7f0eec0d1ad0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009e50 tx=0x7f0ee402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dfd34be5d6027 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.232+0000 7f0eeb7fe640 1 -- 172.21.15.49:0/4270192405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee402ca70 con 0x7f0eec0d1670 2023-12-19T05:46:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.232+0000 7f0eeb7fe640 1 -- 172.21.15.49:0/4270192405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee402cbd0 con 0x7f0eec0d1670 2023-12-19T05:46:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0eeb7fe640 1 -- 172.21.15.49:0/4270192405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40343f0 con 0x7f0eec0d1670 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/4270192405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec0d1670 msgr2=0x7f0eec0d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec0d1670 0x7f0eec0d1ad0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009e50 tx=0x7f0ee402bed0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/4270192405 shutdown_connections 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec06f490 0x7f0eec06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/4270192405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec0d1670 0x7f0eec0d1ad0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.233+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/4270192405 >> 172.21.15.49:0/4270192405 conn(0x7f0eec0d3200 msgr2=0x7f0eec0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.234+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/4270192405 shutdown_connections 2023-12-19T05:46:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.234+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/4270192405 wait complete. 2023-12-19T05:46:33.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.235+0000 7f0ef1ce5640 1 Processor -- start 2023-12-19T05:46:33.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.236+0000 7f0ef1ce5640 1 -- start start 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eec0d1670 0x7f0eec15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec146cd0 0x7f0eec1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13efc0 con 0x7f0eec06f490 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13f2a0 con 0x7f0eec0d1670 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef1ce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13f580 con 0x7f0eec146cd0 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34438/0 (socket says 172.21.15.49:34438) 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 -- 172.21.15.49:0/3649021209 learned_addr learned my addr 172.21.15.49:0/3649021209 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 -- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec146cd0 msgr2=0x7f0eec1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec146cd0 0x7f0eec1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 -- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eec0d1670 msgr2=0x7f0eec15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eec0d1670 0x7f0eec15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.237+0000 7f0ef0ce3640 1 -- 172.21.15.49:0/3649021209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4009b30 con 0x7f0eec06f490 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ef0ce3640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c400 tx=0x7f0ee000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00052d0 con 0x7f0eec06f490 2023-12-19T05:46:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0005430 con 0x7f0eec06f490 2023-12-19T05:46:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec13f860 con 0x7f0eec06f490 2023-12-19T05:46:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0003830 con 0x7f0eec06f490 2023-12-19T05:46:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.238+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec159170 con 0x7f0eec06f490 2023-12-19T05:46:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.240+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec13fd80 con 0x7f0eec06f490 2023-12-19T05:46:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.240+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ee0003990 con 0x7f0eec06f490 2023-12-19T05:46:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.241+0000 7f0ee97fa640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 0x7f0ed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.242+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee0087ed0 con 0x7f0eec06f490 2023-12-19T05:46:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.242+0000 7f0eebfff640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 0x7f0ed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.243+0000 7f0eebfff640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 0x7f0ed006c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0eec15a3d0 tx=0x7f0ed8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.246+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0eec13fd80 con 0x7f0eec06f490 2023-12-19T05:46:33.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.438+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eec13fd80 con 0x7f0eec06f490 2023-12-19T05:46:33.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.439+0000 7f0ee97fa640 1 -- 172.21.15.49:0/3649021209 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ee0017020 con 0x7f0eec06f490 2023-12-19T05:46:33.441 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 msgr2=0x7f0ed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 0x7f0ed006c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0eec15a3d0 tx=0x7f0ed8008040 comp rx=0 tx=0).stop 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 msgr2=0x7f0eec158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c400 tx=0x7f0ee000c8c0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 shutdown_connections 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0ed006a430 0x7f0ed006c8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0eec146cd0 0x7f0eec1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0eec0d1670 0x7f0eec15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 --2- 172.21.15.49:0/3649021209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0eec06f490 0x7f0eec158c30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.442+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 >> 172.21.15.49:0/3649021209 conn(0x7f0eec0d3200 msgr2=0x7f0eec145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:33.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.443+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 shutdown_connections 2023-12-19T05:46:33.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.443+0000 7f0ef1ce5640 1 -- 172.21.15.49:0/3649021209 wait complete. 2023-12-19T05:46:33.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.698+0000 7f260ea7d640 1 Processor -- start 2023-12-19T05:46:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.699+0000 7f260ea7d640 1 -- start start 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.700+0000 7f260ea7d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26080d2b00 0x7f26080d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f260ea7d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26080cd840 con 0x7f26080ce110 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f260ea7d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26080b6e90 con 0x7f2608146e10 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f260ea7d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26080d2430 con 0x7f26080d2b00 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f260d01a640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f26080ce110 0x7f26080b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44612/0 (socket says 172.21.15.49:44612) 2023-12-19T05:46:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f260d01a640 1 -- 172.21.15.49:0/1178738067 learned_addr learned my addr 172.21.15.49:0/1178738067 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f2607fff640 1 --2- 172.21.15.49:0/1178738067 >> v2:172.21.15.115:3300/0 conn(0x7f26080d2b00 0x7f26080d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.701+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751212185 0 0) 0x7f26080cd840 con 0x7f26080ce110 2023-12-19T05:46:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f0003520 con 0x7f26080ce110 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978751329 0 0) 0x7f25f0003520 con 0x7f26080ce110 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 >> v2:172.21.15.115:3300/0 conn(0x7f26080d2b00 msgr2=0x7f26080d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 --2- 172.21.15.49:0/1178738067 >> v2:172.21.15.115:3300/0 conn(0x7f26080d2b00 0x7f26080d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 >> v1:172.21.15.115:6789/0 conn(0x7f2608146e10 legacy=0x7f26080b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080d2620 con 0x7f26080ce110 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f2600001670 con 0x7f26080ce110 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 >> v1:172.21.15.49:6789/0 conn(0x7f26080ce110 legacy=0x7f26080b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f00039e0 0x7f25f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 0x7f25f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00051f0 0x7f25f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f000c120 con 0x7f25f00047c0 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f000c290 con 0x7f25f00051f0 2023-12-19T05:46:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f000c450 con 0x7f25f00039e0 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.702+0000 7f2607fff640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 0x7f25f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f260d01a640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00051f0 0x7f25f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f260c819640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f00039e0 0x7f25f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f2607fff640 1 -- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f00039e0 msgr2=0x7f25f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f2607fff640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25f00039e0 0x7f25f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f2607fff640 1 -- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00051f0 msgr2=0x7f25f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f2607fff640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00051f0 0x7f25f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f2607fff640 1 -- 172.21.15.49:0/1178738067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0003520 con 0x7f25f00047c0 2023-12-19T05:46:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.703+0000 7f260d01a640 1 -- 172.21.15.49:0/1178738067 reap_dead start 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.704+0000 7f2607fff640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 0x7f25f0004c40 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009ac0 tx=0x7f25f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f022b84d2e5c75b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.704+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc02c6b0 con 0x7f25f00047c0 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc02c810 con 0x7f25f00047c0 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f26077fe640 1 -- 172.21.15.49:0/1178738067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc02cba0 con 0x7f25f00047c0 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 -- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 msgr2=0x7f25f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 0x7f25f0004c40 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009ac0 tx=0x7f25f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 -- 172.21.15.49:0/1178738067 shutdown_connections 2023-12-19T05:46:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 --2- 172.21.15.49:0/1178738067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25f00047c0 0x7f25f0004c40 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 -- 172.21.15.49:0/1178738067 >> 172.21.15.49:0/1178738067 conn(0x7f26080b29c0 msgr2=0x7f26080b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 -- 172.21.15.49:0/1178738067 shutdown_connections 2023-12-19T05:46:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.705+0000 7f260ea7d640 1 -- 172.21.15.49:0/1178738067 wait complete. 2023-12-19T05:46:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.707+0000 7f260ea7d640 1 Processor -- start 2023-12-19T05:46:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.707+0000 7f260ea7d640 1 -- start start 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00047c0 0x7f260814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260815ce60 0x7f26081417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608142860 con 0x7f26081e2ed0 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260814fc50 con 0x7f25f00047c0 2023-12-19T05:46:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.708+0000 7f260ea7d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26081e2a40 con 0x7f260815ce60 2023-12-19T05:46:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260c819640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00047c0 0x7f260814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34454/0 (socket says 172.21.15.49:34454) 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 -- 172.21.15.49:0/2980438914 learned_addr learned my addr 172.21.15.49:0/2980438914 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f2607fff640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260815ce60 0x7f26081417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 -- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260815ce60 msgr2=0x7f26081417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260815ce60 0x7f26081417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 -- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00047c0 msgr2=0x7f260814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00047c0 0x7f260814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.709+0000 7f260d01a640 1 -- 172.21.15.49:0/2980438914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608141d20 con 0x7f26081e2ed0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f260d01a640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f2600000c00 tx=0x7f2600007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000f680 con 0x7f26081e2ed0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000f820 con 0x7f26081e2ed0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000fbd0 con 0x7f26081e2ed0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2608141fc0 con 0x7f26081e2ed0 2023-12-19T05:46:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.710+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2608142580 con 0x7f26081e2ed0 2023-12-19T05:46:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.711+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26081e2bb0 con 0x7f26081e2ed0 2023-12-19T05:46:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.712+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f260000fd30 con 0x7f26081e2ed0 2023-12-19T05:46:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.713+0000 7f26057fa640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 0x7f25f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.713+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2600088780 con 0x7f26081e2ed0 2023-12-19T05:46:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.714+0000 7f260c819640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 0x7f25f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.715+0000 7f260c819640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 0x7f25f406c8f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000f80 tx=0x7f25f8001510 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.718+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2600053cd0 con 0x7f26081e2ed0 2023-12-19T05:46:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.952+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2608061910 con 0x7f26081e2ed0 2023-12-19T05:46:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.953+0000 7f26057fa640 1 -- 172.21.15.49:0/2980438914 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f26000572f0 con 0x7f26081e2ed0 2023-12-19T05:46:33.955 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:33.955 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.955+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 msgr2=0x7f25f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 0x7f25f406c8f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000f80 tx=0x7f25f8001510 comp rx=0 tx=0).stop 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 msgr2=0x7f26081e3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f2600000c00 tx=0x7f2600007430 comp rx=0 tx=0).stop 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 shutdown_connections 2023-12-19T05:46:33.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f25f406a430 0x7f25f406c8f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f260815ce60 0x7f26081417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26081e2ed0 0x7f26081e3350 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 --2- 172.21.15.49:0/2980438914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25f00047c0 0x7f260814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 >> 172.21.15.49:0/2980438914 conn(0x7f26080b29c0 msgr2=0x7f260813bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 shutdown_connections 2023-12-19T05:46:33.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:33.956+0000 7f260ea7d640 1 -- 172.21.15.49:0/2980438914 wait complete. 2023-12-19T05:46:33.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.211+0000 7fb349a50640 1 Processor -- start 2023-12-19T05:46:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.211+0000 7fb349a50640 1 -- start start 2023-12-19T05:46:34.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.213+0000 7fb349a50640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 0x7fb3440b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.213+0000 7fb349a50640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 0x7fb3440b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.213+0000 7fb349a50640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3440cdbf0 0x7fb3440ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb349a50640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440ce5c0 con 0x7fb3440cdbf0 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb349a50640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34415ec30 con 0x7fb34415e5a0 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb349a50640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440b2cc0 con 0x7fb34415f680 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb34924f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3440cdbf0 0x7fb3440ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb34924f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3440cdbf0 0x7fb3440ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33578/0 (socket says 172.21.15.49:33578) 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb34924f640 1 -- 172.21.15.49:0/280789388 learned_addr learned my addr 172.21.15.49:0/280789388 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb348a4e640 1 --2- 172.21.15.49:0/280789388 >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 0x7fb3440b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.214+0000 7fb343fff640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 0x7fb3440b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb34924f640 1 -- 172.21.15.49:0/280789388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 msgr2=0x7fb3440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb34924f640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 0x7fb3440b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb34924f640 1 -- 172.21.15.49:0/280789388 >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 msgr2=0x7fb3440b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb34924f640 1 --2- 172.21.15.49:0/280789388 >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 0x7fb3440b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb34924f640 1 -- 172.21.15.49:0/280789388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34415e980 con 0x7fb3440cdbf0 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb343fff640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 0x7fb3440b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.215+0000 7fb348a4e640 1 --2- 172.21.15.49:0/280789388 >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 0x7fb3440b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.216+0000 7fb34924f640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3440cdbf0 0x7fb3440ce080 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b5200 tx=0x7fb33c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ece4b88585406b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.216+0000 7fb3437fe640 1 -- 172.21.15.49:0/280789388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c02ca80 con 0x7fb3440cdbf0 2023-12-19T05:46:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.216+0000 7fb3437fe640 1 -- 172.21.15.49:0/280789388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c02cbe0 con 0x7fb3440cdbf0 2023-12-19T05:46:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.216+0000 7fb3437fe640 1 -- 172.21.15.49:0/280789388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0343f0 con 0x7fb3440cdbf0 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 -- 172.21.15.49:0/280789388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3440cdbf0 msgr2=0x7fb3440ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3440cdbf0 0x7fb3440ce080 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b5200 tx=0x7fb33c02bee0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 -- 172.21.15.49:0/280789388 shutdown_connections 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3440cdbf0 0x7fb3440ce080 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 --2- 172.21.15.49:0/280789388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb34415f680 0x7fb3440b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 --2- 172.21.15.49:0/280789388 >> v2:172.21.15.115:3300/0 conn(0x7fb34415e5a0 0x7fb3440b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 -- 172.21.15.49:0/280789388 >> 172.21.15.49:0/280789388 conn(0x7fb3440b0100 msgr2=0x7fb3440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 -- 172.21.15.49:0/280789388 shutdown_connections 2023-12-19T05:46:34.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.217+0000 7fb349a50640 1 -- 172.21.15.49:0/280789388 wait complete. 2023-12-19T05:46:34.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.219+0000 7fb349a50640 1 Processor -- start 2023-12-19T05:46:34.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.219+0000 7fb349a50640 1 -- start start 2023-12-19T05:46:34.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3440cdbf0 0x7fb34414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb34415f680 0x7fb34415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344150b90 con 0x7fb34415e5a0 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344150e50 con 0x7fb34415f680 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb349a50640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb344151130 con 0x7fb3440cdbf0 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb343fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb343fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33580/0 (socket says 172.21.15.49:33580) 2023-12-19T05:46:34.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb343fff640 1 -- 172.21.15.49:0/977221591 learned_addr learned my addr 172.21.15.49:0/977221591 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.220+0000 7fb34924f640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb34415f680 0x7fb34415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb348a4e640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3440cdbf0 0x7fb34414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 -- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3440cdbf0 msgr2=0x7fb34414ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3440cdbf0 0x7fb34414ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 -- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb34415f680 msgr2=0x7fb34415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb34415f680 0x7fb34415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 -- 172.21.15.49:0/977221591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c009b30 con 0x7fb34415e5a0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb343fff640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c7f0 tx=0x7fb33000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330007820 con 0x7fb34415e5a0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330007980 con 0x7fb34415e5a0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330007cf0 con 0x7fb34415e5a0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.221+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb344151410 con 0x7fb34415e5a0 2023-12-19T05:46:34.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.222+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3441544e0 con 0x7fb34415e5a0 2023-12-19T05:46:34.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.223+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344061910 con 0x7fb34415e5a0 2023-12-19T05:46:34.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.224+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3300113f0 con 0x7fb34415e5a0 2023-12-19T05:46:34.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.225+0000 7fb3417fa640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 0x7fb32806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.225+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb330088ca0 con 0x7fb34415e5a0 2023-12-19T05:46:34.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.225+0000 7fb348a4e640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 0x7fb32806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.227+0000 7fb348a4e640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 0x7fb32806c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb33800a990 tx=0x7fb338008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.229+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb3300541f0 con 0x7fb34415e5a0 2023-12-19T05:46:34.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.425+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3440ce980 con 0x7fb34415e5a0 2023-12-19T05:46:34.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.426+0000 7fb3417fa640 1 -- 172.21.15.49:0/977221591 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7fb33001f090 con 0x7fb34415e5a0 2023-12-19T05:46:34.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:34.428 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 msgr2=0x7fb32806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 0x7fb32806c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb33800a990 tx=0x7fb338008040 comp rx=0 tx=0).stop 2023-12-19T05:46:34.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 msgr2=0x7fb344153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c7f0 tx=0x7fb33000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 shutdown_connections 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb32806a430 0x7fb32806c8f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb34415f680 0x7fb34415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb34415e5a0 0x7fb344153fa0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 --2- 172.21.15.49:0/977221591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3440cdbf0 0x7fb34414ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 >> 172.21.15.49:0/977221591 conn(0x7fb3440b0100 msgr2=0x7fb3441591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 shutdown_connections 2023-12-19T05:46:34.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.429+0000 7fb349a50640 1 -- 172.21.15.49:0/977221591 wait complete. 2023-12-19T05:46:34.449 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:46:34.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.676+0000 7f8d1f15c640 1 Processor -- start 2023-12-19T05:46:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.676+0000 7f8d1f15c640 1 -- start start 2023-12-19T05:46:34.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d1f15c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d180af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d1f15c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d1806c6b0 0x7f8d180b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d1f15c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180afb10 con 0x7f8d180b0b50 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d1f15c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1806bb30 con 0x7f8d1806c6b0 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d1f15c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180b0070 con 0x7f8d181449e0 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d17fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8d180b0b50 0x7f8d1806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39284/0 (socket says 172.21.15.49:39284) 2023-12-19T05:46:34.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.678+0000 7f8d17fff640 1 -- 172.21.15.49:0/3143582354 learned_addr learned my addr 172.21.15.49:0/3143582354 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d1cef8640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d180af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3143582354 >> v2:172.21.15.115:3300/0 conn(0x7f8d1806c6b0 0x7f8d180b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566837303 0 0) 0x7f8d180afb10 con 0x7f8d180b0b50 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d08003520 con 0x7f8d180b0b50 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150425987 0 0) 0x7f8d08003520 con 0x7f8d180b0b50 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 msgr2=0x7f8d180af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d180af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 >> v2:172.21.15.115:3300/0 conn(0x7f8d1806c6b0 msgr2=0x7f8d180b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 --2- 172.21.15.49:0/3143582354 >> v2:172.21.15.115:3300/0 conn(0x7f8d1806c6b0 0x7f8d180b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180b0350 con 0x7f8d180b0b50 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8d04001670 con 0x7f8d180b0b50 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 >> v1:172.21.15.49:6789/0 conn(0x7f8d180b0b50 legacy=0x7f8d1806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d08003fb0 0x7f8d080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1806bb30 con 0x7f8d08003fb0 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180b0070 con 0x7f8d08004d00 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.679+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0800ba00 con 0x7f8d181449e0 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d08003fb0 0x7f8d080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d1cef8640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 -- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 msgr2=0x7f8d080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d181449e0 0x7f8d080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 -- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d08004d00 msgr2=0x7f8d08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:34.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d17fff640 1 -- 172.21.15.49:0/3143582354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08003520 con 0x7f8d08003fb0 2023-12-19T05:46:34.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.680+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:34.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.681+0000 7f8d17fff640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d08003fb0 0x7f8d080047c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c110 tx=0x7f8d080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b625daea250a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04005ad0 con 0x7f8d08003fb0 2023-12-19T05:46:34.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04005c50 con 0x7f8d08003fb0 2023-12-19T05:46:34.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d177fe640 1 -- 172.21.15.49:0/3143582354 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0402c830 con 0x7f8d08003fb0 2023-12-19T05:46:34.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3143582354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d08003fb0 msgr2=0x7f8d080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3143582354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d08003fb0 0x7f8d080047c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c110 tx=0x7f8d080057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d1d6f9640 1 -- 172.21.15.49:0/3143582354 reap_dead start 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3143582354 shutdown_connections 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.682+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3143582354 >> 172.21.15.49:0/3143582354 conn(0x7f8d180cbb70 msgr2=0x7f8d180cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.683+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3143582354 shutdown_connections 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.683+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3143582354 wait complete. 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.685+0000 7f8d1f15c640 1 Processor -- start 2023-12-19T05:46:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.685+0000 7f8d1f15c640 1 -- start start 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d08003fb0 0x7f8d1815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d18141140 0x7f8d181421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1815cde0 con 0x7f8d181426f0 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d181415d0 con 0x7f8d18141140 2023-12-19T05:46:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1f15c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d181418b0 con 0x7f8d08003fb0 2023-12-19T05:46:34.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1d6f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1d6f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33610/0 (socket says 172.21.15.49:33610) 2023-12-19T05:46:34.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1d6f9640 1 -- 172.21.15.49:0/3993208184 learned_addr learned my addr 172.21.15.49:0/3993208184 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:34.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d1cef8640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d08003fb0 0x7f8d1815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.686+0000 7f8d17fff640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d18141140 0x7f8d181421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 -- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d08003fb0 msgr2=0x7f8d1815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d08003fb0 0x7f8d1815adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 -- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d18141140 msgr2=0x7f8d181421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d18141140 0x7f8d181421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 -- 172.21.15.49:0/3993208184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18141b90 con 0x7f8d181426f0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1d6f9640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8d180b01b0 tx=0x7f8d1000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10016620 con 0x7f8d181426f0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10016780 con 0x7f8d181426f0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10016b10 con 0x7f8d181426f0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.687+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1815ca70 con 0x7f8d181426f0 2023-12-19T05:46:34.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.688+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d180adf70 con 0x7f8d181426f0 2023-12-19T05:46:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.689+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1815cf50 con 0x7f8d181426f0 2023-12-19T05:46:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.690+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d10016c70 con 0x7f8d181426f0 2023-12-19T05:46:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.691+0000 7f8d157fa640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 0x7f8cfc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:34.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.691+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d10089650 con 0x7f8d181426f0 2023-12-19T05:46:34.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.691+0000 7f8d1cef8640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 0x7f8cfc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:34.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.692+0000 7f8d1cef8640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 0x7f8cfc06c920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009930 tx=0x7f8d0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.695+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d10054c30 con 0x7f8d181426f0 2023-12-19T05:46:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.926+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d18061910 con 0x7f8d181426f0 2023-12-19T05:46:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.927+0000 7f8d157fa640 1 -- 172.21.15.49:0/3993208184 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f8d10058250 con 0x7f8d181426f0 2023-12-19T05:46:34.929 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:34.929 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.929+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 msgr2=0x7f8cfc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.929+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 0x7f8cfc06c920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009930 tx=0x7f8d0c008040 comp rx=0 tx=0).stop 2023-12-19T05:46:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.929+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 msgr2=0x7f8d180ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.929+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8d180b01b0 tx=0x7f8d1000f520 comp rx=0 tx=0).stop 2023-12-19T05:46:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 shutdown_connections 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cfc06a460 0x7f8cfc06c920 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d181426f0 0x7f8d180ada30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d18141140 0x7f8d181421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 --2- 172.21.15.49:0/3993208184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d08003fb0 0x7f8d1815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 >> 172.21.15.49:0/3993208184 conn(0x7f8d180cbb70 msgr2=0x7f8d180b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 shutdown_connections 2023-12-19T05:46:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:34.930+0000 7f8d1f15c640 1 -- 172.21.15.49:0/3993208184 wait complete. 2023-12-19T05:46:34.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.168+0000 7f5f6c5f0640 1 Processor -- start 2023-12-19T05:46:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.168+0000 7f5f6c5f0640 1 -- start start 2023-12-19T05:46:35.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5f641599c0 0x7f5f6415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f6406e190 0x7f5f640cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f640af540 0x7f5f640af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6415daa0 con 0x7f5f640af540 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640aff30 con 0x7f5f641599c0 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6c5f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415e400 con 0x7f5f6406e190 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6ab8d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f640af540 0x7f5f640af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6ab8d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f640af540 0x7f5f640af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33622/0 (socket says 172.21.15.49:33622) 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.170+0000 7f5f6ab8d640 1 -- 172.21.15.49:0/1903800468 learned_addr learned my addr 172.21.15.49:0/1903800468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f69b8b640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f6406e190 0x7f5f640cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6a38c640 1 --2- 172.21.15.49:0/1903800468 >> v2:172.21.15.115:3300/0 conn(0x7f5f641599c0 0x7f5f6415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6ab8d640 1 -- 172.21.15.49:0/1903800468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f6406e190 msgr2=0x7f5f640cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6ab8d640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f6406e190 0x7f5f640cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6ab8d640 1 -- 172.21.15.49:0/1903800468 >> v2:172.21.15.115:3300/0 conn(0x7f5f641599c0 msgr2=0x7f5f6415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6ab8d640 1 --2- 172.21.15.49:0/1903800468 >> v2:172.21.15.115:3300/0 conn(0x7f5f641599c0 0x7f5f6415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.171+0000 7f5f6ab8d640 1 -- 172.21.15.49:0/1903800468 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640ce780 con 0x7f5f640af540 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.172+0000 7f5f6ab8d640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f640af540 0x7f5f640af9f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5f640b0e40 tx=0x7f5f5c02dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9342d6c3c57789f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6938a640 1 -- 172.21.15.49:0/1903800468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c02e970 con 0x7f5f640af540 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6938a640 1 -- 172.21.15.49:0/1903800468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c02ead0 con 0x7f5f640af540 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6938a640 1 -- 172.21.15.49:0/1903800468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c02ee60 con 0x7f5f640af540 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1903800468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f640af540 msgr2=0x7f5f640af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f640af540 0x7f5f640af9f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5f640b0e40 tx=0x7f5f5c02dfd0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1903800468 shutdown_connections 2023-12-19T05:46:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f640af540 0x7f5f640af9f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1903800468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f6406e190 0x7f5f640cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1903800468 >> v2:172.21.15.115:3300/0 conn(0x7f5f641599c0 0x7f5f6415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1903800468 >> 172.21.15.49:0/1903800468 conn(0x7f5f640cbb70 msgr2=0x7f5f640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1903800468 shutdown_connections 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.173+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1903800468 wait complete. 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.175+0000 7f5f6c5f0640 1 Processor -- start 2023-12-19T05:46:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.175+0000 7f5f6c5f0640 1 -- start start 2023-12-19T05:46:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f640af540 0x7f5f6415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f641599c0 0x7f5f640ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64155da0 con 0x7f5f6406e190 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640aa1a0 con 0x7f5f640af540 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.176+0000 7f5f6c5f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640a84a0 con 0x7f5f641599c0 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33626/0 (socket says 172.21.15.49:33626) 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 -- 172.21.15.49:0/1040591362 learned_addr learned my addr 172.21.15.49:0/1040591362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6ab8d640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f641599c0 0x7f5f640ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f69b8b640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f640af540 0x7f5f6415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 -- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f641599c0 msgr2=0x7f5f640ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f641599c0 0x7f5f640ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 -- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f640af540 msgr2=0x7f5f6415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f640af540 0x7f5f6415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 -- 172.21.15.49:0/1040591362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c00bd40 con 0x7f5f6406e190 2023-12-19T05:46:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.177+0000 7f5f6a38c640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d5f0 tx=0x7f5f6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.178+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600125f0 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.178+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60012750 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.178+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60012b00 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.178+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f640a9620 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.178+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f640a9be0 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.179+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f64061910 con 0x7f5f6406e190 2023-12-19T05:46:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.180+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f60012c60 con 0x7f5f6406e190 2023-12-19T05:46:35.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.181+0000 7f5f5affd640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 0x7f5f4806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.181+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f60088ca0 con 0x7f5f6406e190 2023-12-19T05:46:35.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.182+0000 7f5f69b8b640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 0x7f5f4806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.183+0000 7f5f69b8b640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 0x7f5f4806c940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006fd0 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.185+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f6008d070 con 0x7f5f6406e190 2023-12-19T05:46:35.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.420+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f640b1140 con 0x7f5f6406e190 2023-12-19T05:46:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.420+0000 7f5f5affd640 1 -- 172.21.15.49:0/1040591362 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f5f60054370 con 0x7f5f6406e190 2023-12-19T05:46:35.422 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:35.422 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:07.137327+0000","modified":"2023-12-19T05:46:10.674356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4232896600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4232896600},{"type":"v1","addr":"172.21.15.49:6834","nonce":4232896600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T05:46:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 msgr2=0x7f5f4806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 0x7f5f4806c940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006fd0 tx=0x7f5f54008040 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 msgr2=0x7f5f64155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d5f0 tx=0x7f5f6000dab0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 shutdown_connections 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4806a480 0x7f5f4806c940 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f641599c0 0x7f5f640ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f640af540 0x7f5f6415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 --2- 172.21.15.49:0/1040591362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f6406e190 0x7f5f64155860 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.423+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 >> 172.21.15.49:0/1040591362 conn(0x7f5f640cbb70 msgr2=0x7f5f640ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.424+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 shutdown_connections 2023-12-19T05:46:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.424+0000 7f5f6c5f0640 1 -- 172.21.15.49:0/1040591362 wait complete. 2023-12-19T05:46:35.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:35.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.662+0000 7f70b8f1b640 1 Processor -- start 2023-12-19T05:46:35.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.663+0000 7f70b8f1b640 1 -- start start 2023-12-19T05:46:35.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.664+0000 7f70b8f1b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70b4159f80 0x7f70b406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.664+0000 7f70b8f1b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70b415aa70 0x7f70b415b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.664+0000 7f70b8f1b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b406b520 con 0x7f70b415b1e0 2023-12-19T05:46:35.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.664+0000 7f70b8f1b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40b2b20 con 0x7f70b4159f80 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b8f1b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40b2fb0 con 0x7f70b415aa70 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70b4159f80 0x7f70b406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70b4159f80 0x7f70b406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33638/0 (socket says 172.21.15.49:33638) 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 -- 172.21.15.49:0/1732356398 learned_addr learned my addr 172.21.15.49:0/1732356398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b3fff640 1 --2- 172.21.15.49:0/1732356398 >> v2:172.21.15.115:3300/0 conn(0x7f70b415aa70 0x7f70b415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 -- 172.21.15.49:0/1732356398 >> v2:172.21.15.115:3300/0 conn(0x7f70b415aa70 msgr2=0x7f70b415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:35.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 --2- 172.21.15.49:0/1732356398 >> v2:172.21.15.115:3300/0 conn(0x7f70b415aa70 0x7f70b415b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 -- 172.21.15.49:0/1732356398 >> v1:172.21.15.115:6789/0 conn(0x7f70b415b1e0 legacy=0x7f70b415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:35.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.665+0000 7f70b37fe640 1 -- 172.21.15.49:0/1732356398 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40b1f10 con 0x7f70b4159f80 2023-12-19T05:46:35.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b37fe640 1 --2- 172.21.15.49:0/1732356398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b4159f80 0x7f70b406f160 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f70b40ae020 tx=0x7f70a402e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7805be71221ee4ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b2ffd640 1 -- 172.21.15.49:0/1732356398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4036440 con 0x7f70b4159f80 2023-12-19T05:46:35.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b2ffd640 1 -- 172.21.15.49:0/1732356398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a40365a0 con 0x7f70b4159f80 2023-12-19T05:46:35.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b2ffd640 1 -- 172.21.15.49:0/1732356398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4036930 con 0x7f70b4159f80 2023-12-19T05:46:35.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b8f1b640 1 -- 172.21.15.49:0/1732356398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b4159f80 msgr2=0x7f70b406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.667+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/1732356398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b4159f80 0x7f70b406f160 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f70b40ae020 tx=0x7f70a402e180 comp rx=0 tx=0).stop 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 -- 172.21.15.49:0/1732356398 shutdown_connections 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/1732356398 >> v2:172.21.15.115:3300/0 conn(0x7f70b415aa70 0x7f70b415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/1732356398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b4159f80 0x7f70b406f160 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 -- 172.21.15.49:0/1732356398 >> 172.21.15.49:0/1732356398 conn(0x7f70b40b0100 msgr2=0x7f70b40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 -- 172.21.15.49:0/1732356398 shutdown_connections 2023-12-19T05:46:35.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.668+0000 7f70b8f1b640 1 -- 172.21.15.49:0/1732356398 wait complete. 2023-12-19T05:46:35.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.670+0000 7f70b8f1b640 1 Processor -- start 2023-12-19T05:46:35.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.670+0000 7f70b8f1b640 1 -- start start 2023-12-19T05:46:35.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b4159f80 0x7f70b406b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b415aa70 0x7f70b4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41574c0 con 0x7f70b415b1e0 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b406bbf0 con 0x7f70b4159f80 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b8f1b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b406be20 con 0x7f70b415aa70 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33654/0 (socket says 172.21.15.49:33654) 2023-12-19T05:46:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b3fff640 1 -- 172.21.15.49:0/3102143266 learned_addr learned my addr 172.21.15.49:0/3102143266 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.671+0000 7f70b37fe640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b4159f80 0x7f70b406b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70abfff640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b415aa70 0x7f70b4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 -- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b415aa70 msgr2=0x7f70b4156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b415aa70 0x7f70b4156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 -- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b4159f80 msgr2=0x7f70b406b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b4159f80 0x7f70b406b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 -- 172.21.15.49:0/3102143266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a400b770 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b3fff640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00cd70 tx=0x7f70ac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac003b90 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac003cf0 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b406c100 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.672+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac004240 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.673+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b406c6c0 con 0x7f70b415b1e0 2023-12-19T05:46:35.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.674+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b4061910 con 0x7f70b415b1e0 2023-12-19T05:46:35.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.675+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70ac0043a0 con 0x7f70b415b1e0 2023-12-19T05:46:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.675+0000 7f70b0ff9640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 0x7f709406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.676+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70ac012070 con 0x7f70b415b1e0 2023-12-19T05:46:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.676+0000 7f70b37fe640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 0x7f709406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.677+0000 7f70b37fe640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 0x7f709406c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f70a4038000 tx=0x7f70a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.680+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70ac054920 con 0x7f70b415b1e0 2023-12-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.875+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b40b0f70 con 0x7f70b415b1e0 2023-12-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.878+0000 7f70b0ff9640 1 -- 172.21.15.49:0/3102143266 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f70ac057f40 con 0x7f70b415b1e0 2023-12-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:22.764461+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:05.075551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:06.182867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 msgr2=0x7f709406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 0x7f709406c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f70a4038000 tx=0x7f70a4008040 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 msgr2=0x7f70b40af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00cd70 tx=0x7f70ac00a660 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 shutdown_connections 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709406a430 0x7f709406c8f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b415aa70 0x7f70b4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b415b1e0 0x7f70b40af3c0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 --2- 172.21.15.49:0/3102143266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b4159f80 0x7f70b406b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 >> 172.21.15.49:0/3102143266 conn(0x7f70b40b0100 msgr2=0x7f70b40ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.880+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 shutdown_connections 2023-12-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:35.881+0000 7f70b8f1b640 1 -- 172.21.15.49:0/3102143266 wait complete. 2023-12-19T05:46:35.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:46:36.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.137+0000 7fd04b59e640 1 Processor -- start 2023-12-19T05:46:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.137+0000 7fd04b59e640 1 -- start start 2023-12-19T05:46:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04b59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd04c0d08f0 0x7fd04c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04b59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0b7d00 con 0x7fd04c0b7360 2023-12-19T05:46:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04b59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0700c0 con 0x7fd04c0d08f0 2023-12-19T05:46:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c06f160 con 0x7fd04c146c40 2023-12-19T05:46:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd049d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd04c0b7360 0x7fd04c160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39286/0 (socket says 172.21.15.49:39286) 2023-12-19T05:46:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd049d9b640 1 -- 172.21.15.49:0/2823851407 learned_addr learned my addr 172.21.15.49:0/2823851407 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04ad9d640 1 --2- 172.21.15.49:0/2823851407 >> v2:172.21.15.49:3300/0 conn(0x7fd04c0d08f0 0x7fd04c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.139+0000 7fd04a59c640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04959a640 1 -- 172.21.15.49:0/2823851407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953300199 0 0) 0x7fd04c0b7d00 con 0x7fd04c0b7360 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04959a640 1 -- 172.21.15.49:0/2823851407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd038003520 con 0x7fd04c0b7360 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04ad9d640 1 -- 172.21.15.49:0/2823851407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 msgr2=0x7fd04c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04ad9d640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04ad9d640 1 -- 172.21.15.49:0/2823851407 >> v1:172.21.15.49:6789/0 conn(0x7fd04c0b7360 legacy=0x7fd04c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.140+0000 7fd04ad9d640 1 -- 172.21.15.49:0/2823851407 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c06f440 con 0x7fd04c0d08f0 2023-12-19T05:46:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.141+0000 7fd04ad9d640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0d08f0 0x7fd04c0b77c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097a0 tx=0x7fd04402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1b10d55773938e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.141+0000 7fd04959a640 1 -- 172.21.15.49:0/2823851407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04402d040 con 0x7fd04c0d08f0 2023-12-19T05:46:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.141+0000 7fd04959a640 1 -- 172.21.15.49:0/2823851407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044031810 con 0x7fd04c0d08f0 2023-12-19T05:46:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.141+0000 7fd04959a640 1 -- 172.21.15.49:0/2823851407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044031ba0 con 0x7fd04c0d08f0 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 -- 172.21.15.49:0/2823851407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0d08f0 msgr2=0x7fd04c0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0d08f0 0x7fd04c0b77c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097a0 tx=0x7fd04402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 -- 172.21.15.49:0/2823851407 shutdown_connections 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0d08f0 0x7fd04c0b77c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 --2- 172.21.15.49:0/2823851407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 -- 172.21.15.49:0/2823851407 >> 172.21.15.49:0/2823851407 conn(0x7fd04c0d31b0 msgr2=0x7fd04c0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 -- 172.21.15.49:0/2823851407 shutdown_connections 2023-12-19T05:46:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.142+0000 7fd04b59e640 1 -- 172.21.15.49:0/2823851407 wait complete. 2023-12-19T05:46:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.144+0000 7fd04b59e640 1 Processor -- start 2023-12-19T05:46:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.144+0000 7fd04b59e640 1 -- start start 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 0x7fd04c13be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0b53b0 con 0x7fd04c0b7360 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c13d9b0 con 0x7fd04c0d08f0 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c13cd80 con 0x7fd04c146c40 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.145+0000 7fd04a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33682/0 (socket says 172.21.15.49:33682) 2023-12-19T05:46:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 -- 172.21.15.49:0/4140124401 learned_addr learned my addr 172.21.15.49:0/4140124401 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd049d9b640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 0x7fd04c13be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04ad9d640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 -- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 msgr2=0x7fd04c1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c1f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 -- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 msgr2=0x7fd04c13be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 0x7fd04c13be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 -- 172.21.15.49:0/4140124401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009400 con 0x7fd04c0b7360 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04ad9d640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd049d9b640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 0x7fd04c13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.146+0000 7fd04a59c640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00efc0 tx=0x7fd03c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.147+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c014480 con 0x7fd04c0b7360 2023-12-19T05:46:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.147+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00f040 con 0x7fd04c0b7360 2023-12-19T05:46:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.147+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c014800 con 0x7fd04c0b7360 2023-12-19T05:46:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.147+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c13c4e0 con 0x7fd04c0b7360 2023-12-19T05:46:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.147+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c13caa0 con 0x7fd04c0b7360 2023-12-19T05:46:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.148+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c0b5620 con 0x7fd04c0b7360 2023-12-19T05:46:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.149+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd03c014960 con 0x7fd04c0b7360 2023-12-19T05:46:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.150+0000 7fd042ffd640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.150+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd03c0898f0 con 0x7fd04c0b7360 2023-12-19T05:46:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.151+0000 7fd049d9b640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.152+0000 7fd049d9b640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 0x7fd02c06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd04c15f9e0 tx=0x7fd034009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.154+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd03c054e40 con 0x7fd04c0b7360 2023-12-19T05:46:36.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.391+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd04c061910 con 0x7fd04c0b7360 2023-12-19T05:46:36.393 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:46:36.392+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:46:36.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.414+0000 7fd042ffd640 1 -- 172.21.15.49:0/4140124401 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd03c058460 con 0x7fd04c0b7360 2023-12-19T05:46:36.415 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:46:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 msgr2=0x7fd02c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 0x7fd02c06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd04c15f9e0 tx=0x7fd034009040 comp rx=0 tx=0).stop 2023-12-19T05:46:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 msgr2=0x7fd04c13b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00efc0 tx=0x7fd03c00c490 comp rx=0 tx=0).stop 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 shutdown_connections 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd04c146c40 0x7fd04c1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04c0d08f0 0x7fd04c13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 --2- 172.21.15.49:0/4140124401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd04c0b7360 0x7fd04c13b900 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 >> 172.21.15.49:0/4140124401 conn(0x7fd04c0d31b0 msgr2=0x7fd04c15c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 shutdown_connections 2023-12-19T05:46:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.417+0000 7fd04b59e640 1 -- 172.21.15.49:0/4140124401 wait complete. 2023-12-19T05:46:36.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:46:36.442 INFO:tasks.ceph.mds.c.smithi049.stderr: -4994> 2023-12-19T05:46:11.607+0000 7fa99dfc6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:46:36.526 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:46:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.644+0000 7f5694f73640 1 Processor -- start 2023-12-19T05:46:36.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.644+0000 7f5694f73640 1 -- start start 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.645+0000 7f5694f73640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f56900ca120 0x7f56900cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.645+0000 7f5694f73640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900cb650 con 0x7f56900cdc50 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.645+0000 7f5694f73640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900aedc0 con 0x7f569006e030 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.645+0000 7f5694f73640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569006e410 con 0x7f56900ca120 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f568ed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f56900cdc50 0x7f56900afb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39294/0 (socket says 172.21.15.49:39294) 2023-12-19T05:46:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f568ed9d640 1 -- 172.21.15.49:0/1825230442 learned_addr learned my addr 172.21.15.49:0/1825230442 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:36.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f5687fff640 1 --2- 172.21.15.49:0/1825230442 >> v2:172.21.15.115:3300/0 conn(0x7f56900ca120 0x7f56900cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827918125 0 0) 0x7f56900cb650 con 0x7f56900cdc50 2023-12-19T05:46:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f567c003520 con 0x7f56900cdc50 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.646+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851896790 0 0) 0x7f567c003520 con 0x7f56900cdc50 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 >> v2:172.21.15.115:3300/0 conn(0x7f56900ca120 msgr2=0x7f56900cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 --2- 172.21.15.49:0/1825230442 >> v2:172.21.15.115:3300/0 conn(0x7f56900ca120 0x7f56900cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 >> v1:172.21.15.115:6789/0 conn(0x7f569006e030 legacy=0x7f56900caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900af0a0 con 0x7f56900cdc50 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f56880019f0 con 0x7f56900cdc50 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 >> v1:172.21.15.49:6789/0 conn(0x7f56900cdc50 legacy=0x7f56900afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f567c0039e0 0x7f567c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0047c0 0x7f567c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 0x7f567c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569006e410 con 0x7f567c0051f0 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c00c150 con 0x7f567c0039e0 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c00c310 con 0x7f567c0047c0 2023-12-19T05:46:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568ed9d640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 0x7f567c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f5687fff640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0047c0 0x7f567c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568ed9d640 1 -- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0047c0 msgr2=0x7f567c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.647+0000 7f568e59c640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f567c0039e0 0x7f567c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.648+0000 7f568ed9d640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0047c0 0x7f567c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.648+0000 7f568ed9d640 1 -- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f567c0039e0 msgr2=0x7f567c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.648+0000 7f568ed9d640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f567c0039e0 0x7f567c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.648+0000 7f568ed9d640 1 -- 172.21.15.49:0/1825230442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c003520 con 0x7f567c0051f0 2023-12-19T05:46:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.648+0000 7f568e59c640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f567c0039e0 0x7f567c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f568ed9d640 1 -- 172.21.15.49:0/1825230442 reap_dead start 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f568ed9d640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 0x7f567c00b980 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f568800a830 tx=0x7f567c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a2091a5782fd34 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880072d0 con 0x7f567c0051f0 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568802f070 con 0x7f567c0051f0 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f568dd9b640 1 -- 172.21.15.49:0/1825230442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880076b0 con 0x7f567c0051f0 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f5694f73640 1 -- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 msgr2=0x7f567c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.649+0000 7f5694f73640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 0x7f567c00b980 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f568800a830 tx=0x7f567c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.650+0000 7f5694f73640 1 -- 172.21.15.49:0/1825230442 shutdown_connections 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.650+0000 7f5694f73640 1 --2- 172.21.15.49:0/1825230442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f567c0051f0 0x7f567c00b980 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.650+0000 7f5694f73640 1 -- 172.21.15.49:0/1825230442 >> 172.21.15.49:0/1825230442 conn(0x7f5690066160 msgr2=0x7f56900cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.650+0000 7f5694f73640 1 -- 172.21.15.49:0/1825230442 shutdown_connections 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.650+0000 7f5694f73640 1 -- 172.21.15.49:0/1825230442 wait complete. 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.652+0000 7f5694f73640 1 Processor -- start 2023-12-19T05:46:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.652+0000 7f5694f73640 1 -- start start 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0051f0 0x7f569015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5690164480 0x7f5690156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900ce100 con 0x7f56901648e0 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900af760 con 0x7f5690164480 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f5694f73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5690157760 con 0x7f567c0051f0 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f568ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f568ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33720/0 (socket says 172.21.15.49:33720) 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f568ed9d640 1 -- 172.21.15.49:0/3642953172 learned_addr learned my addr 172.21.15.49:0/3642953172 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.653+0000 7f568e59c640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0051f0 0x7f569015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f5687fff640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5690164480 0x7f5690156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 -- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0051f0 msgr2=0x7f569015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0051f0 0x7f569015bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 -- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5690164480 msgr2=0x7f5690156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5690164480 0x7f5690156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 -- 172.21.15.49:0/3642953172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56901fb5b0 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f568ed9d640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f568800a890 tx=0x7f5688001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880019f0 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688004b60 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880070d0 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.654+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5690161fa0 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.655+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5690162560 con 0x7f56901648e0 2023-12-19T05:46:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.656+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5690061910 con 0x7f56901648e0 2023-12-19T05:46:36.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.657+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5688031030 con 0x7f56901648e0 2023-12-19T05:46:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.658+0000 7f5686ffd640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 0x7f567006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.658+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f56880aa430 con 0x7f56901648e0 2023-12-19T05:46:36.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.659+0000 7f568e59c640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 0x7f567006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:36.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.660+0000 7f568e59c640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 0x7f567006c920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5680000f60 tx=0x7f5680009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:36.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.662+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5688075920 con 0x7f56901648e0 2023-12-19T05:46:36.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:36.901+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5690061910 con 0x7f56901648e0 2023-12-19T05:46:37.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.419+0000 7f5686ffd640 1 -- 172.21.15.49:0/3642953172 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5688007230 con 0x7f56901648e0 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 msgr2=0x7f567006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 0x7f567006c920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5680000f60 tx=0x7f5680009040 comp rx=0 tx=0).stop 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 msgr2=0x7f5690157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f568800a890 tx=0x7f5688001d80 comp rx=0 tx=0).stop 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 shutdown_connections 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f567006a460 0x7f567006c920 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56901648e0 0x7f5690157220 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5690164480 0x7f5690156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 --2- 172.21.15.49:0/3642953172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567c0051f0 0x7f569015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 >> 172.21.15.49:0/3642953172 conn(0x7f5690066160 msgr2=0x7f56900b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 shutdown_connections 2023-12-19T05:46:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.422+0000 7f5694f73640 1 -- 172.21.15.49:0/3642953172 wait complete. 2023-12-19T05:46:37.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:46:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.681+0000 7fa18c977640 1 Processor -- start 2023-12-19T05:46:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.681+0000 7fa18c977640 1 -- start start 2023-12-19T05:46:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa18c977640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa18815afd0 0x7fa1880ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa18c977640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18815f920 con 0x7fa18806d070 2023-12-19T05:46:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa18c977640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18815ed10 con 0x7fa1880b04c0 2023-12-19T05:46:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa18c977640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880adc40 con 0x7fa18815afd0 2023-12-19T05:46:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa186ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa18806d070 0x7fa1880afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39308/0 (socket says 172.21.15.49:39308) 2023-12-19T05:46:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.683+0000 7fa186ffd640 1 -- 172.21.15.49:0/3703877604 learned_addr learned my addr 172.21.15.49:0/3703877604 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.684+0000 7fa1877fe640 1 --2- 172.21.15.49:0/3703877604 >> v2:172.21.15.115:3300/0 conn(0x7fa18815afd0 0x7fa1880ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.684+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177331046 0 0) 0x7fa18815f920 con 0x7fa18806d070 2023-12-19T05:46:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.684+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa170003520 con 0x7fa18806d070 2023-12-19T05:46:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.684+0000 7fa1877fe640 1 -- 172.21.15.49:0/3703877604 >> v1:172.21.15.115:6789/0 conn(0x7fa1880b04c0 legacy=0x7fa18806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.684+0000 7fa1877fe640 1 -- 172.21.15.49:0/3703877604 >> v1:172.21.15.49:6789/0 conn(0x7fa18806d070 legacy=0x7fa1880afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.685+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136521535 0 0) 0x7fa170003520 con 0x7fa18806d070 2023-12-19T05:46:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.685+0000 7fa1877fe640 1 -- 172.21.15.49:0/3703877604 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18815eff0 con 0x7fa18815afd0 2023-12-19T05:46:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.686+0000 7fa1877fe640 1 --2- 172.21.15.49:0/3703877604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ad700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa1780097a0 tx=0x7fa17802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eccf33a27b65431 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.686+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17802f050 con 0x7fa18815afd0 2023-12-19T05:46:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178031500 con 0x7fa18815afd0 2023-12-19T05:46:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa1867fc640 1 -- 172.21.15.49:0/3703877604 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c001670 con 0x7fa18815afd0 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 -- 172.21.15.49:0/3703877604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 msgr2=0x7fa1880ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 --2- 172.21.15.49:0/3703877604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ad700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa1780097a0 tx=0x7fa17802b820 comp rx=0 tx=0).stop 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 -- 172.21.15.49:0/3703877604 shutdown_connections 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 --2- 172.21.15.49:0/3703877604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ad700 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 -- 172.21.15.49:0/3703877604 >> 172.21.15.49:0/3703877604 conn(0x7fa1880b4750 msgr2=0x7fa1880659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 -- 172.21.15.49:0/3703877604 shutdown_connections 2023-12-19T05:46:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.687+0000 7fa18c977640 1 -- 172.21.15.49:0/3703877604 wait complete. 2023-12-19T05:46:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.689+0000 7fa18c977640 1 Processor -- start 2023-12-19T05:46:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.689+0000 7fa18c977640 1 -- start start 2023-12-19T05:46:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.690+0000 7fa18c977640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa18806d070 0x7fa18814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa18c977640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa18c977640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa18c977640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18814a830 con 0x7fa1880b04c0 2023-12-19T05:46:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa18c977640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18814f750 con 0x7fa18815afd0 2023-12-19T05:46:37.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa18c977640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880b2650 con 0x7fa18806d070 2023-12-19T05:46:37.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:37.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33722/0 (socket says 172.21.15.49:33722) 2023-12-19T05:46:37.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 -- 172.21.15.49:0/2730758888 learned_addr learned my addr 172.21.15.49:0/2730758888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 -- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa18806d070 msgr2=0x7fa18814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa18806d070 0x7fa18814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 -- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 msgr2=0x7fa1880ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa187fff640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.691+0000 7fa186ffd640 1 -- 172.21.15.49:0/2730758888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178009400 con 0x7fa1880b04c0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa186ffd640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00c790 tx=0x7fa17c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c005ad0 con 0x7fa1880b04c0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c005c30 con 0x7fa1880b04c0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c007070 con 0x7fa1880b04c0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188147af0 con 0x7fa1880b04c0 2023-12-19T05:46:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.692+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18814f470 con 0x7fa1880b04c0 2023-12-19T05:46:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.694+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188147950 con 0x7fa1880b04c0 2023-12-19T05:46:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.695+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa17c0071d0 con 0x7fa1880b04c0 2023-12-19T05:46:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.696+0000 7fa16ffff640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 0x7fa17406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.696+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa17c088760 con 0x7fa1880b04c0 2023-12-19T05:46:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.696+0000 7fa1877fe640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 0x7fa17406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.697+0000 7fa1877fe640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 0x7fa17406c8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa178035000 tx=0x7fa178030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.700+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa188147950 con 0x7fa1880b04c0 2023-12-19T05:46:37.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:37.894+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa188147950 con 0x7fa1880b04c0 2023-12-19T05:46:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.424+0000 7fa16ffff640 1 -- 172.21.15.49:0/2730758888 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa188147950 con 0x7fa1880b04c0 2023-12-19T05:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 msgr2=0x7fa17406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 0x7fa17406c8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa178035000 tx=0x7fa178030000 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 msgr2=0x7fa1881491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00c790 tx=0x7fa17c00cc50 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 shutdown_connections 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa17406a430 0x7fa17406c8f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa18815afd0 0x7fa1880ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1880b04c0 0x7fa1881491a0 secure :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00c790 tx=0x7fa17c00cc50 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 --2- 172.21.15.49:0/2730758888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa18806d070 0x7fa18814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.429+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 >> 172.21.15.49:0/2730758888 conn(0x7fa1880b4750 msgr2=0x7fa1880b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:38.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.430+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 shutdown_connections 2023-12-19T05:46:38.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.430+0000 7fa18c977640 1 -- 172.21.15.49:0/2730758888 wait complete. 2023-12-19T05:46:38.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:46:38.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.681+0000 7faf9759e640 1 Processor -- start 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.682+0000 7faf9759e640 1 -- start start 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.683+0000 7faf9759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf980b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.683+0000 7faf9759e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf980b5540 0x7faf980b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.683+0000 7faf9759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980b6640 con 0x7faf98145f00 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.683+0000 7faf9759e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf98146f50 con 0x7faf980b5540 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.683+0000 7faf9759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980b5ef0 con 0x7faf98146af0 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf9659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf98145f00 0x7faf980cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39312/0 (socket says 172.21.15.49:39312) 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf9659c640 1 -- 172.21.15.49:0/2831580955 learned_addr learned my addr 172.21.15.49:0/2831580955 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333174052 0 0) 0x7faf980b6640 con 0x7faf98145f00 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf95d9b640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf980b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2831580955 >> v2:172.21.15.115:3300/0 conn(0x7faf980b5540 0x7faf980b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.684+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf80003520 con 0x7faf98145f00 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735727250 0 0) 0x7faf80003520 con 0x7faf98145f00 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 msgr2=0x7faf980b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf980b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 >> v2:172.21.15.115:3300/0 conn(0x7faf980b5540 msgr2=0x7faf980b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 --2- 172.21.15.49:0/2831580955 >> v2:172.21.15.115:3300/0 conn(0x7faf980b5540 0x7faf980b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980b7140 con 0x7faf98145f00 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7faf88001670 con 0x7faf98145f00 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 >> v1:172.21.15.49:6789/0 conn(0x7faf98145f00 legacy=0x7faf980cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf80003970 0x7faf80003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf80004d00 0x7faf80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98146f50 con 0x7faf80004d00 2023-12-19T05:46:38.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980b5ef0 con 0x7faf80003970 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8000b9b0 con 0x7faf98146af0 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.685+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf80004d00 0x7faf80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf9659c640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf80003970 0x7faf80003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf95d9b640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf96d9d640 1 -- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 msgr2=0x7faf800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf98146af0 0x7faf800047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf96d9d640 1 -- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf80003970 msgr2=0x7faf80003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf80003970 0x7faf80003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.686+0000 7faf96d9d640 1 -- 172.21.15.49:0/2831580955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80003520 con 0x7faf80004d00 2023-12-19T05:46:38.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.687+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf80004d00 0x7faf80005180 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faf90009ac0 tx=0x7faf800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179cd50c945b54fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.687+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9002c710 con 0x7faf80004d00 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.687+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9002c870 con 0x7faf80004d00 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.687+0000 7faf9559a640 1 -- 172.21.15.49:0/2831580955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9002cc00 con 0x7faf80004d00 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 -- 172.21.15.49:0/2831580955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf80004d00 msgr2=0x7faf80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 --2- 172.21.15.49:0/2831580955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf80004d00 0x7faf80005180 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faf90009ac0 tx=0x7faf800057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf96d9d640 1 -- 172.21.15.49:0/2831580955 reap_dead start 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 -- 172.21.15.49:0/2831580955 shutdown_connections 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 -- 172.21.15.49:0/2831580955 >> 172.21.15.49:0/2831580955 conn(0x7faf980b4120 msgr2=0x7faf98071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 -- 172.21.15.49:0/2831580955 shutdown_connections 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.688+0000 7faf9759e640 1 -- 172.21.15.49:0/2831580955 wait complete. 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.690+0000 7faf9759e640 1 Processor -- start 2023-12-19T05:46:38.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.690+0000 7faf9759e640 1 -- start start 2023-12-19T05:46:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf80004d00 0x7faf9813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf981f5f10 0x7faf9815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981f2920 con 0x7faf981409f0 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981f63f0 con 0x7faf981f5f10 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf9759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf981f66d0 con 0x7faf80004d00 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf96d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf96d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33742/0 (socket says 172.21.15.49:33742) 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.691+0000 7faf96d9d640 1 -- 172.21.15.49:0/2771248081 learned_addr learned my addr 172.21.15.49:0/2771248081 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf9659c640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf80004d00 0x7faf9813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf95d9b640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf981f5f10 0x7faf9815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 -- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf80004d00 msgr2=0x7faf9813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf80004d00 0x7faf9813a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 -- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf981f5f10 msgr2=0x7faf9815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf981f5f10 0x7faf9815fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 -- 172.21.15.49:0/2771248081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf981f69b0 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf96d9d640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faf90009ac0 tx=0x7faf90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90003810 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf90003970 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.692+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90003d20 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.693+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf981f6c90 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.693+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf98160400 con 0x7faf981409f0 2023-12-19T05:46:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.694+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf981f6e80 con 0x7faf981409f0 2023-12-19T05:46:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.695+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf9003e440 con 0x7faf981409f0 2023-12-19T05:46:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.696+0000 7faf86ffd640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 0x7faf7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.696+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5357+0+0 (secure 0 0 0) 0x7faf900a9fe0 con 0x7faf981409f0 2023-12-19T05:46:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.696+0000 7faf9659c640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 0x7faf7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.698+0000 7faf9659c640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 0x7faf7806c920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf88000c00 tx=0x7faf88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:38.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.700+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf900757c0 con 0x7faf981409f0 2023-12-19T05:46:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:38.893+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf98061910 con 0x7faf981409f0 2023-12-19T05:46:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.435+0000 7faf86ffd640 1 -- 172.21.15.49:0/2771248081 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 169+0+0 (secure 0 0 0) 0x7faf90078de0 con 0x7faf981409f0 2023-12-19T05:46:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:46:39.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.439+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 msgr2=0x7faf7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.439+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 0x7faf7806c920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf88000c00 tx=0x7faf88009040 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.439+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 msgr2=0x7faf980d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.439+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faf90009ac0 tx=0x7faf90004730 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 shutdown_connections 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faf7806a460 0x7faf7806c920 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf981409f0 0x7faf980d0c90 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf981f5f10 0x7faf9815fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 --2- 172.21.15.49:0/2771248081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf80004d00 0x7faf9813a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 >> 172.21.15.49:0/2771248081 conn(0x7faf980b4120 msgr2=0x7faf980d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 shutdown_connections 2023-12-19T05:46:39.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.440+0000 7faf9759e640 1 -- 172.21.15.49:0/2771248081 wait complete. 2023-12-19T05:46:39.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:46:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.701+0000 7f519cf11640 1 Processor -- start 2023-12-19T05:46:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.701+0000 7f519cf11640 1 -- start start 2023-12-19T05:46:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f519cf11640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 0x7f51980cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f519cf11640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51980d1640 0x7f519806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f519cf11640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519815fd20 con 0x7f51980cf830 2023-12-19T05:46:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f519cf11640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980cec40 con 0x7f51980d1640 2023-12-19T05:46:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f519cf11640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519815f1a0 con 0x7f51980ce860 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f5197fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51980d1640 0x7f519806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f5197fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51980d1640 0x7f519806d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33750/0 (socket says 172.21.15.49:33750) 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.703+0000 7f5197fff640 1 -- 172.21.15.49:0/3402585851 learned_addr learned my addr 172.21.15.49:0/3402585851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f51977fe640 1 --2- 172.21.15.49:0/3402585851 >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 0x7f51980cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f5197fff640 1 -- 172.21.15.49:0/3402585851 >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 msgr2=0x7f51980cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f5197fff640 1 --2- 172.21.15.49:0/3402585851 >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 0x7f51980cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f5197fff640 1 -- 172.21.15.49:0/3402585851 >> v1:172.21.15.115:6789/0 conn(0x7f51980cf830 legacy=0x7f51980d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f5197fff640 1 -- 172.21.15.49:0/3402585851 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519815f480 con 0x7f51980d1640 2023-12-19T05:46:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.704+0000 7f51977fe640 1 --2- 172.21.15.49:0/3402585851 >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 0x7f51980cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.705+0000 7f5197fff640 1 --2- 172.21.15.49:0/3402585851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980d1640 0x7f519806d890 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f519806ac50 tx=0x7f519002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260aec9a966fa9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.705+0000 7f51967fc640 1 -- 172.21.15.49:0/3402585851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900317e0 con 0x7f51980d1640 2023-12-19T05:46:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.705+0000 7f51967fc640 1 -- 172.21.15.49:0/3402585851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190031940 con 0x7f51980d1640 2023-12-19T05:46:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.705+0000 7f51967fc640 1 -- 172.21.15.49:0/3402585851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190031cd0 con 0x7f51980d1640 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 -- 172.21.15.49:0/3402585851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980d1640 msgr2=0x7f519806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 --2- 172.21.15.49:0/3402585851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980d1640 0x7f519806d890 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f519806ac50 tx=0x7f519002b880 comp rx=0 tx=0).stop 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 -- 172.21.15.49:0/3402585851 shutdown_connections 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 --2- 172.21.15.49:0/3402585851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980d1640 0x7f519806d890 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 --2- 172.21.15.49:0/3402585851 >> v2:172.21.15.115:3300/0 conn(0x7f51980ce860 0x7f51980cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 -- 172.21.15.49:0/3402585851 >> 172.21.15.49:0/3402585851 conn(0x7f519806f160 msgr2=0x7f519806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 -- 172.21.15.49:0/3402585851 shutdown_connections 2023-12-19T05:46:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.706+0000 7f519cf11640 1 -- 172.21.15.49:0/3402585851 wait complete. 2023-12-19T05:46:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.708+0000 7f519cf11640 1 Processor -- start 2023-12-19T05:46:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.708+0000 7f519cf11640 1 -- start start 2023-12-19T05:46:39.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 0x7f51980719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 0x7f5198071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980cb160 con 0x7f51980ce860 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5198070c00 con 0x7f51980cf830 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.709+0000 7f519cf11640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5198070ee0 con 0x7f51980d1640 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33764/0 (socket says 172.21.15.49:33764) 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 -- 172.21.15.49:0/4191628387 learned_addr learned my addr 172.21.15.49:0/4191628387 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f5196ffd640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 0x7f51980719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f5197fff640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 0x7f5198071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 -- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 msgr2=0x7f5198071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 0x7f5198071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 -- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 msgr2=0x7f51980719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 0x7f51980719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f51977fe640 1 -- 172.21.15.49:0/4191628387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094d0 con 0x7f51980ce860 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f5196ffd640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 0x7f51980719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.710+0000 7f5197fff640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 0x7f5198071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f51977fe640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f518800c7f0 tx=0x7f518800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188007a30 con 0x7f51980ce860 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188007b90 con 0x7f51980ce860 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800ce40 con 0x7f51980ce860 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51980711c0 con 0x7f51980ce860 2023-12-19T05:46:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.711+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980cbe80 con 0x7f51980ce860 2023-12-19T05:46:39.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.712+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5198066a60 con 0x7f51980ce860 2023-12-19T05:46:39.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.713+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51880113f0 con 0x7f51980ce860 2023-12-19T05:46:39.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.714+0000 7f518ffff640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 0x7f517806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:39.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.714+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51880887e0 con 0x7f51980ce860 2023-12-19T05:46:39.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.715+0000 7f5196ffd640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 0x7f517806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:39.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.716+0000 7f5196ffd640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 0x7f517806c920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f51980703d0 tx=0x7f5180009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.718+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5188054030 con 0x7f51980ce860 2023-12-19T05:46:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.922+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f51980716e0 con 0x7f51980ce860 2023-12-19T05:46:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.930+0000 7f518ffff640 1 -- 172.21.15.49:0/4191628387 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51980716e0 con 0x7f51980ce860 2023-12-19T05:46:39.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 msgr2=0x7f517806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 0x7f517806c920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f51980703d0 tx=0x7f5180009040 comp rx=0 tx=0).stop 2023-12-19T05:46:39.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 msgr2=0x7f51980cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:39.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f518800c7f0 tx=0x7f518800cbf0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 shutdown_connections 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f517806a460 0x7f517806c920 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51980d1640 0x7f5198071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51980cf830 0x7f51980719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 --2- 172.21.15.49:0/4191628387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51980ce860 0x7f51980cb940 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.933+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 >> 172.21.15.49:0/4191628387 conn(0x7f519806f160 msgr2=0x7f5198150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.934+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 shutdown_connections 2023-12-19T05:46:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:39.934+0000 7f519cf11640 1 -- 172.21.15.49:0/4191628387 wait complete. 2023-12-19T05:46:39.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-19T05:46:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.181+0000 7fd4d4a30640 1 Processor -- start 2023-12-19T05:46:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.181+0000 7fd4d4a30640 1 -- start start 2023-12-19T05:46:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4d4a30640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd4d00b6710 0x7fd4d0161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4d4a30640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d00d2a50 con 0x7fd4d01616d0 2023-12-19T05:46:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4d4a30640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d00cebb0 con 0x7fd4d0146ef0 2023-12-19T05:46:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4d4a30640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d00cda90 con 0x7fd4d00b6710 2023-12-19T05:46:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4ced9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd4d01616d0 0x7fd4d00b4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39322/0 (socket says 172.21.15.49:39322) 2023-12-19T05:46:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2573393524 learned_addr learned my addr 172.21.15.49:0/2573393524 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.183+0000 7fd4c5d9b640 1 --2- 172.21.15.49:0/2573393524 >> v2:172.21.15.115:3300/0 conn(0x7fd4d00b6710 0x7fd4d0161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137207637 0 0) 0x7fd4d00d2a50 con 0x7fd4d01616d0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4bc003520 con 0x7fd4d01616d0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1047653177 0 0) 0x7fd4bc003520 con 0x7fd4d01616d0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 >> v2:172.21.15.115:3300/0 conn(0x7fd4d00b6710 msgr2=0x7fd4d0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 --2- 172.21.15.49:0/2573393524 >> v2:172.21.15.115:3300/0 conn(0x7fd4d00b6710 0x7fd4d0161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 >> v1:172.21.15.115:6789/0 conn(0x7fd4d0146ef0 legacy=0x7fd4d00ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00cdca0 con 0x7fd4d01616d0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd4c8001670 con 0x7fd4d01616d0 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 >> v1:172.21.15.49:6789/0 conn(0x7fd4d01616d0 legacy=0x7fd4d00b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 0x7fd4bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.184+0000 7fd4cdd9b640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4bc0047c0 0x7fd4bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4cdd9b640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc005280 0x7fd4bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d00cda90 con 0x7fd4bc0039e0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc00c1c0 con 0x7fd4bc0047c0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc00c380 con 0x7fd4bc005280 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 0x7fd4bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4c5d9b640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4bc0047c0 0x7fd4bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ced9d640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc005280 0x7fd4bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 -- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc005280 msgr2=0x7fd4bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc005280 0x7fd4bc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 -- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4bc0047c0 msgr2=0x7fd4bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4bc0047c0 0x7fd4bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ce59c640 1 -- 172.21.15.49:0/2573393524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc003520 con 0x7fd4bc0039e0 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4c5d9b640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4bc0047c0 0x7fd4bc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:40.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.185+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2573393524 reap_dead start 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.187+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 0x7fd4bc003e00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0001e50 tx=0x7fd4bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2afaf722d936524 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.187+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0003b70 con 0x7fd4bc0039e0 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.187+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c0003cd0 con 0x7fd4bc0039e0 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.187+0000 7fd4cdd9b640 1 -- 172.21.15.49:0/2573393524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0005310 con 0x7fd4bc0039e0 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 msgr2=0x7fd4bc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 0x7fd4bc003e00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0001e50 tx=0x7fd4bc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2573393524 shutdown_connections 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2573393524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4bc0039e0 0x7fd4bc003e00 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2573393524 >> 172.21.15.49:0/2573393524 conn(0x7fd4d00b29c0 msgr2=0x7fd4d00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2573393524 shutdown_connections 2023-12-19T05:46:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.188+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2573393524 wait complete. 2023-12-19T05:46:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.190+0000 7fd4d4a30640 1 Processor -- start 2023-12-19T05:46:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.190+0000 7fd4d4a30640 1 -- start start 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc0039e0 0x7fd4d00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 0x7fd4d00b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d00b5600 con 0x7fd4d00b5180 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0145d20 con 0x7fd4d01458a0 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4d4a30640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0144800 con 0x7fd4bc0039e0 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4ced9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4ced9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33784/0 (socket says 172.21.15.49:33784) 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.191+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2955177336 learned_addr learned my addr 172.21.15.49:0/2955177336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4c5d9b640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 0x7fd4d00b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc0039e0 0x7fd4d00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc0039e0 msgr2=0x7fd4d00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc0039e0 0x7fd4d00ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 msgr2=0x7fd4d00b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 0x7fd4d00b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 -- 172.21.15.49:0/2955177336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0144ae0 con 0x7fd4d00b5180 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4c5d9b640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 0x7fd4d00b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.192+0000 7fd4ced9d640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001200 tx=0x7fd4c800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.193+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80075a0 con 0x7fd4d00b5180 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.193+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c80047e0 con 0x7fd4d00b5180 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.193+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8004b90 con 0x7fd4d00b5180 2023-12-19T05:46:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.193+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d0144dc0 con 0x7fd4d00b5180 2023-12-19T05:46:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.193+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d0145380 con 0x7fd4d00b5180 2023-12-19T05:46:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.194+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d0061910 con 0x7fd4d00b5180 2023-12-19T05:46:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.195+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd4c8004cf0 con 0x7fd4d00b5180 2023-12-19T05:46:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.196+0000 7fd4c77fe640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 0x7fd4b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.196+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd4c8088100 con 0x7fd4d00b5180 2023-12-19T05:46:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.197+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 0x7fd4b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:40.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.198+0000 7fd4ce59c640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 0x7fd4b006c920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0034000 tx=0x7fd4c0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:40.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.200+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd4c80539e0 con 0x7fd4d00b5180 2023-12-19T05:46:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:40.468+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fd4d00cf640 con 0x7fd4d00b5180 2023-12-19T05:46:41.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.446+0000 7fd4c77fe640 1 -- 172.21.15.49:0/2955177336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v398) v1 ==== 128+0+0 (secure 0 0 0) 0x7fd4c8057000 con 0x7fd4d00b5180 2023-12-19T05:46:41.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.449+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 msgr2=0x7fd4b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.449+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 0x7fd4b006c920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0034000 tx=0x7fd4c0009030 comp rx=0 tx=0).stop 2023-12-19T05:46:41.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.449+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 msgr2=0x7fd4d0143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.449+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8001200 tx=0x7fd4c800d950 comp rx=0 tx=0).stop 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 shutdown_connections 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4b006a460 0x7fd4b006c920 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d00b5180 0x7fd4d0143a90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d01458a0 0x7fd4d00b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 --2- 172.21.15.49:0/2955177336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4bc0039e0 0x7fd4d00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 >> 172.21.15.49:0/2955177336 conn(0x7fd4d00b29c0 msgr2=0x7fd4d0141990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 shutdown_connections 2023-12-19T05:46:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.450+0000 7fd4d4a30640 1 -- 172.21.15.49:0/2955177336 wait complete. 2023-12-19T05:46:41.474 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-19T05:46:41.474 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T05:46:41.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.707+0000 7f4f4afb9640 1 Processor -- start 2023-12-19T05:46:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.708+0000 7f4f4afb9640 1 -- start start 2023-12-19T05:46:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.709+0000 7f4f4afb9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f440b0b50 0x7f4f4406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.709+0000 7f4f4afb9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f4406b590 0x7f4f4406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.709+0000 7f4f4afb9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4406bb30 con 0x7f4f441449e0 2023-12-19T05:46:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.709+0000 7f4f4afb9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440b0070 con 0x7f4f4406b590 2023-12-19T05:46:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.709+0000 7f4f4afb9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440b0350 con 0x7f4f440b0b50 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f4406b590 0x7f4f4406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f4406b590 0x7f4f4406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33788/0 (socket says 172.21.15.49:33788) 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f43fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f440b0b50 0x7f4f4406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 -- 172.21.15.49:0/2138941141 learned_addr learned my addr 172.21.15.49:0/2138941141 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 -- 172.21.15.49:0/2138941141 >> v2:172.21.15.115:3300/0 conn(0x7f4f440b0b50 msgr2=0x7f4f4406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 --2- 172.21.15.49:0/2138941141 >> v2:172.21.15.115:3300/0 conn(0x7f4f440b0b50 0x7f4f4406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 -- 172.21.15.49:0/2138941141 >> v1:172.21.15.115:6789/0 conn(0x7f4f441449e0 legacy=0x7f4f440af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.710+0000 7f4f49556640 1 -- 172.21.15.49:0/2138941141 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440b0630 con 0x7f4f4406b590 2023-12-19T05:46:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.712+0000 7f4f49556640 1 --2- 172.21.15.49:0/2138941141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4406c4e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4f44071c80 tx=0x7f4f3c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e3923ddda01221 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.712+0000 7f4f437fe640 1 -- 172.21.15.49:0/2138941141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c02cb20 con 0x7f4f4406b590 2023-12-19T05:46:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.712+0000 7f4f437fe640 1 -- 172.21.15.49:0/2138941141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c02cc80 con 0x7f4f4406b590 2023-12-19T05:46:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.712+0000 7f4f437fe640 1 -- 172.21.15.49:0/2138941141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0343f0 con 0x7f4f4406b590 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 -- 172.21.15.49:0/2138941141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 msgr2=0x7f4f4406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/2138941141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4406c4e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4f44071c80 tx=0x7f4f3c02bf80 comp rx=0 tx=0).stop 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 -- 172.21.15.49:0/2138941141 shutdown_connections 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/2138941141 >> v2:172.21.15.115:3300/0 conn(0x7f4f440b0b50 0x7f4f4406bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/2138941141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4406c4e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 -- 172.21.15.49:0/2138941141 >> 172.21.15.49:0/2138941141 conn(0x7f4f440cbb70 msgr2=0x7f4f440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 -- 172.21.15.49:0/2138941141 shutdown_connections 2023-12-19T05:46:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.713+0000 7f4f4afb9640 1 -- 172.21.15.49:0/2138941141 wait complete. 2023-12-19T05:46:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.715+0000 7f4f4afb9640 1 Processor -- start 2023-12-19T05:46:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.715+0000 7f4f4afb9640 1 -- start start 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f440b0b50 0x7f4f4415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f441449e0 0x7f4f4415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4413e300 con 0x7f4f4406b590 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4415e550 con 0x7f4f440b0b50 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f4afb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4413b000 con 0x7f4f441449e0 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f48d55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f48d55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33792/0 (socket says 172.21.15.49:33792) 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.716+0000 7f4f48d55640 1 -- 172.21.15.49:0/956626174 learned_addr learned my addr 172.21.15.49:0/956626174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f49556640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f441449e0 0x7f4f4415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 -- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f441449e0 msgr2=0x7f4f4415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f441449e0 0x7f4f4415e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 -- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f440b0b50 msgr2=0x7f4f4415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f43fff640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f440b0b50 0x7f4f4415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f440b0b50 0x7f4f4415dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 -- 172.21.15.49:0/956626174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009b30 con 0x7f4f4406b590 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f48d55640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c400 tx=0x7f4f3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380052d0 con 0x7f4f4406b590 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38005430 con 0x7f4f4406b590 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.717+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38003830 con 0x7f4f4406b590 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.718+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4413d3e0 con 0x7f4f4406b590 2023-12-19T05:46:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.718+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4413d960 con 0x7f4f4406b590 2023-12-19T05:46:41.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.719+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f44061910 con 0x7f4f4406b590 2023-12-19T05:46:41.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.720+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f38003990 con 0x7f4f4406b590 2023-12-19T05:46:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.721+0000 7f4f417fa640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 0x7f4f2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.721+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f38087c40 con 0x7f4f4406b590 2023-12-19T05:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.722+0000 7f4f43fff640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 0x7f4f2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.723+0000 7f4f43fff640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 0x7f4f2806c8f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f4415b030 tx=0x7f4f30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:41.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.725+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f38053490 con 0x7f4f4406b590 2023-12-19T05:46:41.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.921+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f440b1470 con 0x7f4f4406b590 2023-12-19T05:46:41.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.922+0000 7f4f417fa640 1 -- 172.21.15.49:0/956626174 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12529 (secure 0 0 0) 0x7f4f38056ab0 con 0x7f4f4406b590 2023-12-19T05:46:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:41.924 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:39.420064+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/4232896600":"2023-12-20T05:46:36.392694+0000","172.21.15.49:6833/4232896600":"2023-12-20T05:46:36.392694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 msgr2=0x7f4f2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 0x7f4f2806c8f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f4415b030 tx=0x7f4f30008040 comp rx=0 tx=0).stop 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 msgr2=0x7f4f4413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c400 tx=0x7f4f3800c8c0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 shutdown_connections 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4f2806a430 0x7f4f2806c8f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f441449e0 0x7f4f4415e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f440b0b50 0x7f4f4415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 --2- 172.21.15.49:0/956626174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4406b590 0x7f4f4413b740 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:41.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.925+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 >> 172.21.15.49:0/956626174 conn(0x7f4f440cbb70 msgr2=0x7f4f4406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:41.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.926+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 shutdown_connections 2023-12-19T05:46:41.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:41.926+0000 7f4f4afb9640 1 -- 172.21.15.49:0/956626174 wait complete. 2023-12-19T05:46:41.947 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:41.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:42.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.184+0000 7f206d0ec640 1 Processor -- start 2023-12-19T05:46:42.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.184+0000 7f206d0ec640 1 -- start start 2023-12-19T05:46:42.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206d0ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f206806f490 0x7f206806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206d0ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20680d1670 0x7f20680d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206d0ec640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206806fe30 con 0x7f2068146cd0 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206d0ec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20681470b0 con 0x7f20680d1670 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206d0ec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2068070260 con 0x7f206806f490 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f2067fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2068146cd0 0x7f20680b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39336/0 (socket says 172.21.15.49:39336) 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f2067fff640 1 -- 172.21.15.49:0/463624397 learned_addr learned my addr 172.21.15.49:0/463624397 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:42.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f206c8eb640 1 --2- 172.21.15.49:0/463624397 >> v2:172.21.15.49:3300/0 conn(0x7f20680d1670 0x7f20680d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.186+0000 7f20677fe640 1 --2- 172.21.15.49:0/463624397 >> v2:172.21.15.115:3300/0 conn(0x7f206806f490 0x7f206806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f2066ffd640 1 -- 172.21.15.49:0/463624397 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259851603 0 0) 0x7f206806fe30 con 0x7f2068146cd0 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f2066ffd640 1 -- 172.21.15.49:0/463624397 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2054003520 con 0x7f2068146cd0 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f206c8eb640 1 -- 172.21.15.49:0/463624397 >> v2:172.21.15.115:3300/0 conn(0x7f206806f490 msgr2=0x7f206806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f206c8eb640 1 --2- 172.21.15.49:0/463624397 >> v2:172.21.15.115:3300/0 conn(0x7f206806f490 0x7f206806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f206c8eb640 1 -- 172.21.15.49:0/463624397 >> v1:172.21.15.49:6789/0 conn(0x7f2068146cd0 legacy=0x7f20680b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.187+0000 7f206c8eb640 1 -- 172.21.15.49:0/463624397 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680b6ea0 con 0x7f20680d1670 2023-12-19T05:46:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.188+0000 7f206c8eb640 1 --2- 172.21.15.49:0/463624397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20680d1670 0x7f20680d1b00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f20680724b0 tx=0x7f206002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5018262983e5d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.188+0000 7f2066ffd640 1 -- 172.21.15.49:0/463624397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206002e070 con 0x7f20680d1670 2023-12-19T05:46:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.188+0000 7f2066ffd640 1 -- 172.21.15.49:0/463624397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20600315a0 con 0x7f20680d1670 2023-12-19T05:46:42.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.188+0000 7f2066ffd640 1 -- 172.21.15.49:0/463624397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060031910 con 0x7f20680d1670 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 -- 172.21.15.49:0/463624397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20680d1670 msgr2=0x7f20680d1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 --2- 172.21.15.49:0/463624397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20680d1670 0x7f20680d1b00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f20680724b0 tx=0x7f206002b840 comp rx=0 tx=0).stop 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 -- 172.21.15.49:0/463624397 shutdown_connections 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 --2- 172.21.15.49:0/463624397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20680d1670 0x7f20680d1b00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 --2- 172.21.15.49:0/463624397 >> v2:172.21.15.115:3300/0 conn(0x7f206806f490 0x7f206806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 -- 172.21.15.49:0/463624397 >> 172.21.15.49:0/463624397 conn(0x7f20680d3200 msgr2=0x7f20680d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 -- 172.21.15.49:0/463624397 shutdown_connections 2023-12-19T05:46:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.189+0000 7f206d0ec640 1 -- 172.21.15.49:0/463624397 wait complete. 2023-12-19T05:46:42.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.191+0000 7f206d0ec640 1 Processor -- start 2023-12-19T05:46:42.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.191+0000 7f206d0ec640 1 -- start start 2023-12-19T05:46:42.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f206806f490 0x7f2068141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20680d1670 0x7f20681e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680b4240 con 0x7f2068146cd0 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681e78f0 con 0x7f20680d1670 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.192+0000 7f206d0ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20681416c0 con 0x7f206806f490 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33820/0 (socket says 172.21.15.49:33820) 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 -- 172.21.15.49:0/251379451 learned_addr learned my addr 172.21.15.49:0/251379451 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f2067fff640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f206806f490 0x7f2068141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f20677fe640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20680d1670 0x7f20681e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 -- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f206806f490 msgr2=0x7f2068141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f206806f490 0x7f2068141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 -- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20680d1670 msgr2=0x7f20681e73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20680d1670 0x7f20681e73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.193+0000 7f206c8eb640 1 -- 172.21.15.49:0/251379451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060009400 con 0x7f2068146cd0 2023-12-19T05:46:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f206c8eb640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2060034040 tx=0x7f20600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060032630 con 0x7f2068146cd0 2023-12-19T05:46:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060032790 con 0x7f2068146cd0 2023-12-19T05:46:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060032b20 con 0x7f2068146cd0 2023-12-19T05:46:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20681419a0 con 0x7f2068146cd0 2023-12-19T05:46:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.194+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2068141f60 con 0x7f2068146cd0 2023-12-19T05:46:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.195+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20680b43b0 con 0x7f2068146cd0 2023-12-19T05:46:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.196+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2060032c80 con 0x7f2068146cd0 2023-12-19T05:46:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.197+0000 7f2064ff9640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 0x7f204806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.197+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f20600aa4c0 con 0x7f2068146cd0 2023-12-19T05:46:42.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.198+0000 7f2067fff640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 0x7f204806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.199+0000 7f2067fff640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 0x7f204806c920 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2050005880 tx=0x7f2050009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.202+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2060075e40 con 0x7f2068146cd0 2023-12-19T05:46:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.398+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2068061910 con 0x7f2068146cd0 2023-12-19T05:46:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.399+0000 7f2064ff9640 1 -- 172.21.15.49:0/251379451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2060079460 con 0x7f2068146cd0 2023-12-19T05:46:42.401 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 msgr2=0x7f204806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 0x7f204806c920 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2050005880 tx=0x7f2050009040 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 msgr2=0x7f206813c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2060034040 tx=0x7f20600046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 shutdown_connections 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f204806a460 0x7f204806c920 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068146cd0 0x7f206813c920 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20680d1670 0x7f20681e73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 --2- 172.21.15.49:0/251379451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f206806f490 0x7f2068141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 >> 172.21.15.49:0/251379451 conn(0x7f20680d3200 msgr2=0x7f2068145230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 shutdown_connections 2023-12-19T05:46:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.402+0000 7f206d0ec640 1 -- 172.21.15.49:0/251379451 wait complete. 2023-12-19T05:46:42.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-19T05:46:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.650+0000 7f2b9888a640 1 Processor -- start 2023-12-19T05:46:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.651+0000 7f2b9888a640 1 -- start start 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.652+0000 7f2b9888a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 0x7f2b940b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.652+0000 7f2b9888a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b940b7ea0 0x7f2b940d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.652+0000 7f2b9888a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b940b8300 con 0x7f2b940d0a90 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.652+0000 7f2b9888a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b94147210 con 0x7f2b940b7ea0 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.652+0000 7f2b9888a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b940d2370 con 0x7f2b94146e30 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b940b7ea0 0x7f2b940d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b940b7ea0 0x7f2b940d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33824/0 (socket says 172.21.15.49:33824) 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 -- 172.21.15.49:0/4000611134 learned_addr learned my addr 172.21.15.49:0/4000611134 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b92d9d640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 0x7f2b940b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 -- 172.21.15.49:0/4000611134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 msgr2=0x7f2b940b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 0x7f2b940b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 -- 172.21.15.49:0/4000611134 >> v1:172.21.15.115:6789/0 conn(0x7f2b940d0a90 legacy=0x7f2b9406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b9259c640 1 -- 172.21.15.49:0/4000611134 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940d12d0 con 0x7f2b940b7ea0 2023-12-19T05:46:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.653+0000 7f2b92d9d640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 0x7f2b940b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b9259c640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b940b7ea0 0x7f2b940d0550 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b8802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6535bdb9c1a0742e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b91d9b640 1 -- 172.21.15.49:0/4000611134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880317c0 con 0x7f2b940b7ea0 2023-12-19T05:46:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b91d9b640 1 -- 172.21.15.49:0/4000611134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88031920 con 0x7f2b940b7ea0 2023-12-19T05:46:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b91d9b640 1 -- 172.21.15.49:0/4000611134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88031cb0 con 0x7f2b940b7ea0 2023-12-19T05:46:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b9888a640 1 -- 172.21.15.49:0/4000611134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b940b7ea0 msgr2=0x7f2b940d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.655+0000 7f2b9888a640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b940b7ea0 0x7f2b940d0550 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b8802b860 comp rx=0 tx=0).stop 2023-12-19T05:46:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 -- 172.21.15.49:0/4000611134 shutdown_connections 2023-12-19T05:46:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b940b7ea0 0x7f2b940d0550 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 --2- 172.21.15.49:0/4000611134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b94146e30 0x7f2b940b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 -- 172.21.15.49:0/4000611134 >> 172.21.15.49:0/4000611134 conn(0x7f2b940b2990 msgr2=0x7f2b940b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 -- 172.21.15.49:0/4000611134 shutdown_connections 2023-12-19T05:46:42.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.656+0000 7f2b9888a640 1 -- 172.21.15.49:0/4000611134 wait complete. 2023-12-19T05:46:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.658+0000 7f2b9888a640 1 Processor -- start 2023-12-19T05:46:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.658+0000 7f2b9888a640 1 -- start start 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b940b7ea0 0x7f2b9413dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b940d0a90 0x7f2b941e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9413ebd0 con 0x7f2b94146e30 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941e5f20 con 0x7f2b940b7ea0 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9888a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941410c0 con 0x7f2b940d0a90 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33840/0 (socket says 172.21.15.49:33840) 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9359e640 1 -- 172.21.15.49:0/1752010336 learned_addr learned my addr 172.21.15.49:0/1752010336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b92d9d640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b940b7ea0 0x7f2b9413dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.659+0000 7f2b9259c640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b940d0a90 0x7f2b941e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 -- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b940d0a90 msgr2=0x7f2b941e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b940d0a90 0x7f2b941e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 -- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b940b7ea0 msgr2=0x7f2b9413dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b940b7ea0 0x7f2b9413dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:42.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 -- 172.21.15.49:0/1752010336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880094d0 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9359e640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c440 tx=0x7f2b8c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011790 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0118f0 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011ca0 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.660+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b941e5680 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.661+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b941e5c40 con 0x7f2b94146e30 2023-12-19T05:46:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.662+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9413e930 con 0x7f2b94146e30 2023-12-19T05:46:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.663+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b8c01c460 con 0x7f2b94146e30 2023-12-19T05:46:42.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.664+0000 7f2b7b7fe640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 0x7f2b8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:42.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.664+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2b8c088490 con 0x7f2b94146e30 2023-12-19T05:46:42.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.664+0000 7f2b92d9d640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 0x7f2b8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:42.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.665+0000 7f2b92d9d640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 0x7f2b8006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2b840075b0 tx=0x7f2b84007540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:42.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.668+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2b9413e930 con 0x7f2b94146e30 2023-12-19T05:46:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:42.932+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f2b940d1870 con 0x7f2b94146e30 2023-12-19T05:46:43.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.457+0000 7f2b7b7fe640 1 -- 172.21.15.49:0/1752010336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v400) v1 ==== 143+0+0 (secure 0 0 0) 0x7f2b940d1870 con 0x7f2b94146e30 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 msgr2=0x7f2b8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 0x7f2b8006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2b840075b0 tx=0x7f2b84007540 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 msgr2=0x7f2b941e4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c440 tx=0x7f2b8c00c900 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 shutdown_connections 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2b8006a430 0x7f2b8006c8f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b940d0a90 0x7f2b941e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b94146e30 0x7f2b941e4fe0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 --2- 172.21.15.49:0/1752010336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b940b7ea0 0x7f2b9413dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 >> 172.21.15.49:0/1752010336 conn(0x7f2b940b2990 msgr2=0x7f2b941e3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 shutdown_connections 2023-12-19T05:46:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.461+0000 7f2b9888a640 1 -- 172.21.15.49:0/1752010336 wait complete. 2023-12-19T05:46:43.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:46:43.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.711+0000 7fecfb5d9640 1 Processor -- start 2023-12-19T05:46:43.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.711+0000 7fecfb5d9640 1 -- start start 2023-12-19T05:46:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.713+0000 7fecfb5d9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecf415b1d0 0x7fecf40b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.713+0000 7fecfb5d9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf415fde0 con 0x7fecf40ceea0 2023-12-19T05:46:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.713+0000 7fecfb5d9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf415ef10 con 0x7fecf40b1ec0 2023-12-19T05:46:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.713+0000 7fecfb5d9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf40b2320 con 0x7fecf415b1d0 2023-12-19T05:46:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecf9b76640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fecf40ceea0 0x7fecf406c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39340/0 (socket says 172.21.15.49:39340) 2023-12-19T05:46:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecf9b76640 1 -- 172.21.15.49:0/1660834534 learned_addr learned my addr 172.21.15.49:0/1660834534 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecf9375640 1 --2- 172.21.15.49:0/1660834534 >> v2:172.21.15.115:3300/0 conn(0x7fecf415b1d0 0x7fecf40b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460507488 0 0) 0x7fecf415fde0 con 0x7fecf40ceea0 2023-12-19T05:46:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece0003520 con 0x7fecf40ceea0 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215689689 0 0) 0x7fece0003520 con 0x7fecf40ceea0 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 >> v2:172.21.15.115:3300/0 conn(0x7fecf415b1d0 msgr2=0x7fecf40b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 --2- 172.21.15.49:0/1660834534 >> v2:172.21.15.115:3300/0 conn(0x7fecf415b1d0 0x7fecf40b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 >> v1:172.21.15.115:6789/0 conn(0x7fecf40b1ec0 legacy=0x7fecf415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40b2e40 con 0x7fecf40ceea0 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.714+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fecec0019f0 con 0x7fecf40ceea0 2023-12-19T05:46:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 >> v1:172.21.15.49:6789/0 conn(0x7fecf40ceea0 legacy=0x7fecf406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece00039e0 0x7fece0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fece0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fece0005180 0x7fece000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40b2320 con 0x7fece00047c0 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece000c0b0 con 0x7fece00039e0 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece000c270 con 0x7fece0005180 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fece0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf9375640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece00039e0 0x7fece0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 -- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fece0005180 msgr2=0x7fece000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fece0005180 0x7fece000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 -- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece00039e0 msgr2=0x7fece0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece00039e0 0x7fece0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.715+0000 7fecf8b74640 1 -- 172.21.15.49:0/1660834534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0003520 con 0x7fece00047c0 2023-12-19T05:46:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.716+0000 7fecf9375640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece00039e0 0x7fece0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.716+0000 7fecf9b76640 1 -- 172.21.15.49:0/1660834534 reap_dead start 2023-12-19T05:46:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fece0004c40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fece4001750 tx=0x7fece00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24483ccef400295a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40052d0 con 0x7fece00047c0 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece402e050 con 0x7fece00047c0 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecebfff640 1 -- 172.21.15.49:0/1660834534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4003830 con 0x7fece00047c0 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 msgr2=0x7fece0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.717+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fece0004c40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fece4001750 tx=0x7fece00057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.718+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1660834534 shutdown_connections 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.718+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1660834534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fece0004c40 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.718+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1660834534 >> 172.21.15.49:0/1660834534 conn(0x7fecf4073150 msgr2=0x7fecf40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.718+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1660834534 shutdown_connections 2023-12-19T05:46:43.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.718+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1660834534 wait complete. 2023-12-19T05:46:43.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.719+0000 7fecfb5d9640 1 Processor -- start 2023-12-19T05:46:43.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.720+0000 7fecfb5d9640 1 -- start start 2023-12-19T05:46:43.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf406d8e0 0x7fecf406dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf40c4050 0x7fecf40c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf406e2a0 con 0x7fece00047c0 2023-12-19T05:46:43.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40c4a10 con 0x7fecf406d8e0 2023-12-19T05:46:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecfb5d9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4148b90 con 0x7fecf40c4050 2023-12-19T05:46:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9375640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9375640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33862/0 (socket says 172.21.15.49:33862) 2023-12-19T05:46:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9375640 1 -- 172.21.15.49:0/1903681149 learned_addr learned my addr 172.21.15.49:0/1903681149 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9b76640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf40c4050 0x7fecf40c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf406d8e0 0x7fecf406dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9375640 1 -- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf40c4050 msgr2=0x7fecf40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.721+0000 7fecf9375640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf40c4050 0x7fecf40c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecf9375640 1 -- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf406d8e0 msgr2=0x7fecf406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecf9375640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf406d8e0 0x7fecf406dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecf9375640 1 -- 172.21.15.49:0/1903681149 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4148e70 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecf9375640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fecf00107f0 tx=0x7fecf0010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000eb60 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf000ecc0 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf001c400 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf4149150 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.722+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf4149710 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.724+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf41498d0 con 0x7fece00047c0 2023-12-19T05:46:43.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.724+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecf001c580 con 0x7fece00047c0 2023-12-19T05:46:43.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.725+0000 7fece9ffb640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 0x7fecd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:43.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.726+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fecf0088b70 con 0x7fece00047c0 2023-12-19T05:46:43.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.726+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 0x7fecd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:43.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.727+0000 7fecf8b74640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 0x7fecd806c920 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fece4033000 tx=0x7fece4009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:43.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.729+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecf0054470 con 0x7fece00047c0 2023-12-19T05:46:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.918+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fecf4061910 con 0x7fece00047c0 2023-12-19T05:46:43.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.926+0000 7fece9ffb640 1 -- 172.21.15.49:0/1903681149 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fecf0057a90 con 0x7fece00047c0 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 msgr2=0x7fecd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 0x7fecd806c920 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fece4033000 tx=0x7fece4009030 comp rx=0 tx=0).stop 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 msgr2=0x7fecf4147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fecf00107f0 tx=0x7fecf0010cb0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 shutdown_connections 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fecd806a460 0x7fecd806c920 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf40c4050 0x7fecf40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf406d8e0 0x7fecf406dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 --2- 172.21.15.49:0/1903681149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece00047c0 0x7fecf4147890 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:43.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 >> 172.21.15.49:0/1903681149 conn(0x7fecf4073150 msgr2=0x7fecf4159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:43.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 shutdown_connections 2023-12-19T05:46:43.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:43.930+0000 7fecfb5d9640 1 -- 172.21.15.49:0/1903681149 wait complete. 2023-12-19T05:46:43.950 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:46:43.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:44.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:46:44.183 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:46:44.184 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:44.184 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:44.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:46:44.246 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:44.246 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:44.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:46:44.306 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:46:44.306 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:44.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:46:44.372 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:46:44.372 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:46:44.431 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:46:44.431 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:46:44.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.672+0000 7f8d9c1d9640 1 Processor -- start 2023-12-19T05:46:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.672+0000 7f8d9c1d9640 1 -- start start 2023-12-19T05:46:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9c1d9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d940af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9c1d9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d940afb10 con 0x7f8d9406c6b0 2023-12-19T05:46:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9c1d9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9406bb30 con 0x7f8d940b0b50 2023-12-19T05:46:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9c1d9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940b0070 con 0x7f8d941449e0 2023-12-19T05:46:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9a776640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8d9406c6b0 0x7f8d940b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51398/0 (socket says 172.21.15.49:51398) 2023-12-19T05:46:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.674+0000 7f8d9a776640 1 -- 172.21.15.49:0/2017209162 learned_addr learned my addr 172.21.15.49:0/2017209162 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d99f75640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d940af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629604241 0 0) 0x7f8d940afb10 con 0x7f8d9406c6b0 2023-12-19T05:46:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d80003520 con 0x7f8d9406c6b0 2023-12-19T05:46:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937013320 0 0) 0x7f8d80003520 con 0x7f8d9406c6b0 2023-12-19T05:46:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 msgr2=0x7f8d940af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d940af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 >> v1:172.21.15.115:6789/0 conn(0x7f8d940b0b50 legacy=0x7f8d9406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940b0350 con 0x7f8d9406c6b0 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8d8c0019f0 con 0x7f8d9406c6b0 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 >> v1:172.21.15.49:6789/0 conn(0x7f8d9406c6b0 legacy=0x7f8d940b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d80003a10 0x7f8d80003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d800047c0 0x7f8d80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d800051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940b0070 con 0x7f8d800047c0 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8000bb40 con 0x7f8d80003a10 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.675+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8000bd00 con 0x7f8d941449e0 2023-12-19T05:46:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d800047c0 0x7f8d80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99f75640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d80003a10 0x7f8d80003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d9a776640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d800051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 -- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 msgr2=0x7f8d800051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d800051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 -- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d80003a10 msgr2=0x7f8d80003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d80003a10 0x7f8d80003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d99774640 1 -- 172.21.15.49:0/2017209162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80003520 con 0x7f8d800047c0 2023-12-19T05:46:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.676+0000 7f8d9a776640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941449e0 0x7f8d800051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.677+0000 7f8d99774640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d800047c0 0x7f8d80004c40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8d84001750 tx=0x7f8d800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129b3362cc28d85b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840052d0 con 0x7f8d800047c0 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8402e050 con 0x7f8d800047c0 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d98f73640 1 -- 172.21.15.49:0/2017209162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840035f0 con 0x7f8d800047c0 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2017209162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d800047c0 msgr2=0x7f8d80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2017209162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d800047c0 0x7f8d80004c40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8d84001750 tx=0x7f8d800057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9a776640 1 -- 172.21.15.49:0/2017209162 reap_dead start 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2017209162 shutdown_connections 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2017209162 >> 172.21.15.49:0/2017209162 conn(0x7f8d940cbb70 msgr2=0x7f8d940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2017209162 shutdown_connections 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.678+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2017209162 wait complete. 2023-12-19T05:46:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.680+0000 7f8d9c1d9640 1 Processor -- start 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.680+0000 7f8d9c1d9640 1 -- start start 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d800047c0 0x7f8d940cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941f2250 0x7f8d94142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94142160 con 0x7f8d941f26b0 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94141500 con 0x7f8d800047c0 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.681+0000 7f8d9c1d9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d941417c0 con 0x7f8d941f2250 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37292/0 (socket says 172.21.15.49:37292) 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 -- 172.21.15.49:0/2596970171 learned_addr learned my addr 172.21.15.49:0/2596970171 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d99774640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941f2250 0x7f8d94142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d99f75640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d800047c0 0x7f8d940cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 -- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941f2250 msgr2=0x7f8d94142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941f2250 0x7f8d94142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 -- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d800047c0 msgr2=0x7f8d940cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d800047c0 0x7f8d940cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.682+0000 7f8d9a776640 1 -- 172.21.15.49:0/2596970171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94141aa0 con 0x7f8d941f26b0 2023-12-19T05:46:44.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d9a776640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8d94071cd0 tx=0x7f8d8c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c004d60 con 0x7f8d941f26b0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00bb80 con 0x7f8d941f26b0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d94141d80 con 0x7f8d941f26b0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c007110 con 0x7f8d941f26b0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.683+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d94143c50 con 0x7f8d941f26b0 2023-12-19T05:46:44.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.684+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d94143e70 con 0x7f8d941f26b0 2023-12-19T05:46:44.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.685+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d8c007270 con 0x7f8d941f26b0 2023-12-19T05:46:44.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.686+0000 7f8d8a7fc640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 0x7f8d7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:44.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.686+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d8c088a50 con 0x7f8d941f26b0 2023-12-19T05:46:44.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.687+0000 7f8d99f75640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 0x7f8d7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:44.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.688+0000 7f8d99f75640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 0x7f8d7806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009a10 tx=0x7f8d90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.690+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d8c054330 con 0x7f8d941f26b0 2023-12-19T05:46:44.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.926+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d941422a0 con 0x7f8d941f26b0 2023-12-19T05:46:44.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.927+0000 7f8d8a7fc640 1 -- 172.21.15.49:0/2596970171 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8d941422a0 con 0x7f8d941f26b0 2023-12-19T05:46:44.930 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:44.930 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2699994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2699994685},{"type":"v1","addr":"172.21.15.115:6836","nonce":2699994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3129544500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3129544500},{"type":"v1","addr":"172.21.15.115:6837","nonce":3129544500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/472089536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":472089536},{"type":"v1","addr":"172.21.15.49:6835","nonce":472089536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1386340673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1386340673},{"type":"v1","addr":"172.21.15.49:6834","nonce":1386340673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-12-19T05:46:44.930 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 58 2023-12-19T05:46:44.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 msgr2=0x7f8d7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 0x7f8d7806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009a10 tx=0x7f8d90008040 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 msgr2=0x7f8d94143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8d94071cd0 tx=0x7f8d8c00b4a0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 shutdown_connections 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d7806a430 0x7f8d7806c8f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d941f2250 0x7f8d94142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d941f26b0 0x7f8d94143530 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 --2- 172.21.15.49:0/2596970171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d800047c0 0x7f8d940cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 >> 172.21.15.49:0/2596970171 conn(0x7f8d940cbb70 msgr2=0x7f8d940ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 shutdown_connections 2023-12-19T05:46:44.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:44.930+0000 7f8d9c1d9640 1 -- 172.21.15.49:0/2596970171 wait complete. 2023-12-19T05:46:44.952 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:46:44.952 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:46:44.952 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:46:44.953 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:44.953 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:46:44.953 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:46:44.953 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:46:44.953 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:44.953 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:46:44.953 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:46:44.954 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:46:44.954 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:44.954 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:46:44.954 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:46:44.954 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:46:44.954 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:46:44.973 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:46:44.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:46:44.974 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:46:44.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:46:44.977 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:46:44.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:46:44.978 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:46:44.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:46:45.025 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:46:45.025 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:45.026 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:46:45.026 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:45.032 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:46:45.032 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:45.034 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:46:45.034 DEBUG:teuthology.parallel:result is None 2023-12-19T05:46:45.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:46:45.183 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:46:45.189 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:46:45.198 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:46:45.199 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:46:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.235+0000 7f008f6a0640 1 Processor -- start 2023-12-19T05:46:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.235+0000 7f008f6a0640 1 -- start start 2023-12-19T05:46:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.236+0000 7f008f6a0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0088146e10 0x7f00880d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.236+0000 7f008f6a0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00880d2b00 0x7f00880b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008f6a0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00880cd840 con 0x7f00880ce110 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008f6a0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880d2430 con 0x7f00880d2b00 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008f6a0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880d2620 con 0x7f0088146e10 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008cc3b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00880d2b00 0x7f00880b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008dc3d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f00880ce110 0x7f00880b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51424/0 (socket says 172.21.15.49:51424) 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008dc3d640 1 -- 172.21.15.49:0/3157374480 learned_addr learned my addr 172.21.15.49:0/3157374480 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008d43c640 1 --2- 172.21.15.49:0/3157374480 >> v2:172.21.15.115:3300/0 conn(0x7f0088146e10 0x7f00880d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008cc3b640 1 -- 172.21.15.49:0/3157374480 >> v2:172.21.15.115:3300/0 conn(0x7f0088146e10 msgr2=0x7f00880d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008cc3b640 1 --2- 172.21.15.49:0/3157374480 >> v2:172.21.15.115:3300/0 conn(0x7f0088146e10 0x7f00880d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:45.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008cc3b640 1 -- 172.21.15.49:0/3157374480 >> v1:172.21.15.49:6789/0 conn(0x7f00880ce110 legacy=0x7f00880b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:45.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.237+0000 7f008cc3b640 1 -- 172.21.15.49:0/3157374480 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880b41c0 con 0x7f00880d2b00 2023-12-19T05:46:45.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.238+0000 7f008cc3b640 1 --2- 172.21.15.49:0/3157374480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880d2b00 0x7f00880b6780 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f00880d0720 tx=0x7f007802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d0d60ea01eb7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.239+0000 7f007ffff640 1 -- 172.21.15.49:0/3157374480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802e070 con 0x7f00880d2b00 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.239+0000 7f007ffff640 1 -- 172.21.15.49:0/3157374480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780315a0 con 0x7f00880d2b00 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.239+0000 7f007ffff640 1 -- 172.21.15.49:0/3157374480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078031930 con 0x7f00880d2b00 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.239+0000 7f008f6a0640 1 -- 172.21.15.49:0/3157374480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880d2b00 msgr2=0x7f00880b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.239+0000 7f008f6a0640 1 --2- 172.21.15.49:0/3157374480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880d2b00 0x7f00880b6780 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f00880d0720 tx=0x7f007802b840 comp rx=0 tx=0).stop 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 -- 172.21.15.49:0/3157374480 shutdown_connections 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 --2- 172.21.15.49:0/3157374480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880d2b00 0x7f00880b6780 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 --2- 172.21.15.49:0/3157374480 >> v2:172.21.15.115:3300/0 conn(0x7f0088146e10 0x7f00880d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 -- 172.21.15.49:0/3157374480 >> 172.21.15.49:0/3157374480 conn(0x7f00880b29c0 msgr2=0x7f00880b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 -- 172.21.15.49:0/3157374480 shutdown_connections 2023-12-19T05:46:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.240+0000 7f008f6a0640 1 -- 172.21.15.49:0/3157374480 wait complete. 2023-12-19T05:46:45.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.241+0000 7f008f6a0640 1 Processor -- start 2023-12-19T05:46:45.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.242+0000 7f008f6a0640 1 -- start start 2023-12-19T05:46:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00880d2b00 0x7f0088159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0088146e10 0x7f008815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008815f060 con 0x7f00880ce110 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881413c0 con 0x7f0088146e10 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008f6a0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008815a3b0 con 0x7f00880d2b00 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37336/0 (socket says 172.21.15.49:37336) 2023-12-19T05:46:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 -- 172.21.15.49:0/1443755378 learned_addr learned my addr 172.21.15.49:0/1443755378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 -- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00880d2b00 msgr2=0x7f0088159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00880d2b00 0x7f0088159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 -- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0088146e10 msgr2=0x7f008815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0088146e10 0x7f008815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.243+0000 7f008d43c640 1 -- 172.21.15.49:0/1443755378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009400 con 0x7f00880ce110 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f008d43c640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f008400d5f0 tx=0x7f008400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840125f0 con 0x7f00880ce110 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084012750 con 0x7f00880ce110 2023-12-19T05:46:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084012b00 con 0x7f00880ce110 2023-12-19T05:46:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0088141660 con 0x7f00880ce110 2023-12-19T05:46:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.244+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088141c20 con 0x7f00880ce110 2023-12-19T05:46:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.245+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088061910 con 0x7f00880ce110 2023-12-19T05:46:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.246+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0084012c60 con 0x7f00880ce110 2023-12-19T05:46:45.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.248+0000 7f007dffb640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 0x7f006c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:45.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.248+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0084088aa0 con 0x7f00880ce110 2023-12-19T05:46:45.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.248+0000 7f008cc3b640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 0x7f006c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:45.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.249+0000 7f008cc3b640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 0x7f006c06c8f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0078036000 tx=0x7f0078030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.252+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0084054390 con 0x7f00880ce110 2023-12-19T05:46:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:45.456+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f00880d4090 con 0x7f00880ce110 2023-12-19T05:46:46.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.340+0000 7f007dffb640 1 -- 172.21.15.49:0/1443755378 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v139) v1 ==== 97+0+0 (secure 0 0 0) 0x7f00840579b0 con 0x7f00880ce110 2023-12-19T05:46:46.343 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 msgr2=0x7f006c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 0x7f006c06c8f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0078036000 tx=0x7f0078030000 comp rx=0 tx=0).stop 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 msgr2=0x7f0088140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f008400d5f0 tx=0x7f008400dab0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 shutdown_connections 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f006c06a430 0x7f006c06c8f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00880d2b00 0x7f0088159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0088146e10 0x7f008815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 --2- 172.21.15.49:0/1443755378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00880ce110 0x7f0088140e80 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 >> 172.21.15.49:0/1443755378 conn(0x7f00880b29c0 msgr2=0x7f0088160ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 shutdown_connections 2023-12-19T05:46:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.344+0000 7f008f6a0640 1 -- 172.21.15.49:0/1443755378 wait complete. 2023-12-19T05:46:46.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:46:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.603+0000 7f08cb988640 1 Processor -- start 2023-12-19T05:46:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.603+0000 7f08cb988640 1 -- start start 2023-12-19T05:46:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08cb988640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08c415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08cb988640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40d0720 con 0x7f08c415c0f0 2023-12-19T05:46:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08cb988640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c415c950 con 0x7f08c415d080 2023-12-19T05:46:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08cb988640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c406be10 con 0x7f08c415c4d0 2023-12-19T05:46:46.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08c9724640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08c415c0f0 0x7f08c40d0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51438/0 (socket says 172.21.15.49:51438) 2023-12-19T05:46:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08c9724640 1 -- 172.21.15.49:0/3730274638 learned_addr learned my addr 172.21.15.49:0/3730274638 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052276145 0 0) 0x7f08c40d0720 con 0x7f08c415c0f0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b0003520 con 0x7f08c415c0f0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.604+0000 7f08c8f23640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08c415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303643329 0 0) 0x7f08b0003520 con 0x7f08c415c0f0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 msgr2=0x7f08c415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08c415cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 >> v1:172.21.15.115:6789/0 conn(0x7f08c415d080 legacy=0x7f08c40cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c406c0f0 con 0x7f08c415c0f0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f08c0001670 con 0x7f08c415c0f0 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 >> v1:172.21.15.49:6789/0 conn(0x7f08c415c0f0 legacy=0x7f08c40d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08b0003a10 0x7f08b0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b0004d70 0x7f08b00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c406be10 con 0x7f08b0003a10 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b000bb90 con 0x7f08b0004d70 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b000bd50 con 0x7f08c415c4d0 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.605+0000 7f08c9724640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08b0003a10 0x7f08b0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c8f23640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9f25640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b0004d70 0x7f08b00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9724640 1 -- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 msgr2=0x7f08b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9724640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08c415c4d0 0x7f08b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9724640 1 -- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b0004d70 msgr2=0x7f08b00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9724640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b0004d70 0x7f08b00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9724640 1 -- 172.21.15.49:0/3730274638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0003520 con 0x7f08b0003a10 2023-12-19T05:46:46.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.606+0000 7f08c9f25640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b0004d70 0x7f08b00051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.607+0000 7f08c9724640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08b0003a10 0x7f08b0003e30 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001eb0 tx=0x7f08b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4489cc7455e56c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:46.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.607+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0005ad0 con 0x7f08b0003a10 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.607+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0005c30 con 0x7f08b0003a10 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.607+0000 7f08bbfff640 1 -- 172.21.15.49:0/3730274638 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0007070 con 0x7f08b0003a10 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 -- 172.21.15.49:0/3730274638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08b0003a10 msgr2=0x7f08b0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 --2- 172.21.15.49:0/3730274638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08b0003a10 0x7f08b0003e30 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001eb0 tx=0x7f08b00057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08c9f25640 1 -- 172.21.15.49:0/3730274638 reap_dead start 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 -- 172.21.15.49:0/3730274638 shutdown_connections 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 -- 172.21.15.49:0/3730274638 >> 172.21.15.49:0/3730274638 conn(0x7f08c40b11d0 msgr2=0x7f08c40cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 -- 172.21.15.49:0/3730274638 shutdown_connections 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.608+0000 7f08cb988640 1 -- 172.21.15.49:0/3730274638 wait complete. 2023-12-19T05:46:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.610+0000 7f08cb988640 1 Processor -- start 2023-12-19T05:46:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.610+0000 7f08cb988640 1 -- start start 2023-12-19T05:46:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 0x7f08c4158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 0x7f08c4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41546e0 con 0x7f08c40afe00 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40b07c0 con 0x7f08c4153920 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08cb988640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40aca50 con 0x7f08b0003a10 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08c8f23640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08c8f23640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37362/0 (socket says 172.21.15.49:37362) 2023-12-19T05:46:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.611+0000 7f08c8f23640 1 -- 172.21.15.49:0/2980430515 learned_addr learned my addr 172.21.15.49:0/2980430515 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c9724640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 0x7f08c4158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c9f25640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 0x7f08c4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 -- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 msgr2=0x7f08c4158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 0x7f08c4158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 -- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 msgr2=0x7f08c4153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 0x7f08c4153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 -- 172.21.15.49:0/2980430515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40acd30 con 0x7f08c40afe00 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c9724640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 0x7f08c4158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c9f25640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 0x7f08c4153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08c8f23640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f08b400f580 tx=0x7f08b400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4014870 con 0x7f08c40afe00 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40149d0 con 0x7f08c40afe00 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.612+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c40ad010 con 0x7f08c40afe00 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.613+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4014d80 con 0x7f08c40afe00 2023-12-19T05:46:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.613+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c4159010 con 0x7f08c40afe00 2023-12-19T05:46:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.614+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c4074770 con 0x7f08c40afe00 2023-12-19T05:46:46.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.615+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f08b4015410 con 0x7f08c40afe00 2023-12-19T05:46:46.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.616+0000 7f08b9ffb640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 0x7f08a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:46.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.616+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08b4088ed0 con 0x7f08c40afe00 2023-12-19T05:46:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.617+0000 7f08c9724640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 0x7f08a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.618+0000 7f08c9724640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 0x7f08a806c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08c0034000 tx=0x7f08c0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.621+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f08b4054820 con 0x7f08c40afe00 2023-12-19T05:46:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.882+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08c4061910 con 0x7f08c40afe00 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.883+0000 7f08b9ffb640 1 -- 172.21.15.49:0/2980430515 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f08b4057e40 con 0x7f08c40afe00 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:46:46.885 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:46:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.889 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.890 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:46:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.892 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:46.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:46:46.894 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:46:46.896 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:46:46.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:46.897 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:46:46.897 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 msgr2=0x7f08a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 0x7f08a806c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08c0034000 tx=0x7f08c0009030 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 msgr2=0x7f08c40b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f08b400f580 tx=0x7f08b400fa40 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 shutdown_connections 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f08a806a430 0x7f08a806c8f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08c4153920 0x7f08c4153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c40afe00 0x7f08c40b0280 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 --2- 172.21.15.49:0/2980430515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08b0003a10 0x7f08c4158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 >> 172.21.15.49:0/2980430515 conn(0x7f08c40b11d0 msgr2=0x7f08c4141250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 shutdown_connections 2023-12-19T05:46:46.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:46.886+0000 7f08cb988640 1 -- 172.21.15.49:0/2980430515 wait complete. 2023-12-19T05:46:46.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:47.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.137+0000 7f9f11181640 1 Processor -- start 2023-12-19T05:46:47.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.138+0000 7f9f11181640 1 -- start start 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.139+0000 7f9f11181640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f0c146e10 0x7f9f0c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.139+0000 7f9f11181640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f0c0ce110 0x7f9f0c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.139+0000 7f9f11181640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0cd840 con 0x7f9f0c0d2b00 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.139+0000 7f9f11181640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0d2430 con 0x7f9f0c146e10 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.139+0000 7f9f11181640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ceac0 con 0x7f9f0c0ce110 2023-12-19T05:46:47.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f03fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9f0c0d2b00 0x7f9f0c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51444/0 (socket says 172.21.15.49:51444) 2023-12-19T05:46:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f03fff640 1 -- 172.21.15.49:0/1116376858 learned_addr learned my addr 172.21.15.49:0/1116376858 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f0c146e10 0x7f9f0c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0b59e640 1 --2- 172.21.15.49:0/1116376858 >> v2:172.21.15.115:3300/0 conn(0x7f9f0c0ce110 0x7f9f0c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0a59c640 1 -- 172.21.15.49:0/1116376858 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003763304 0 0) 0x7f9f0c0cd840 con 0x7f9f0c0d2b00 2023-12-19T05:46:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0a59c640 1 -- 172.21.15.49:0/1116376858 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8003520 con 0x7f9f0c0d2b00 2023-12-19T05:46:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1116376858 >> v2:172.21.15.115:3300/0 conn(0x7f9f0c0ce110 msgr2=0x7f9f0c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0ad9d640 1 --2- 172.21.15.49:0/1116376858 >> v2:172.21.15.115:3300/0 conn(0x7f9f0c0ce110 0x7f9f0c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1116376858 >> v1:172.21.15.49:6789/0 conn(0x7f9f0c0d2b00 legacy=0x7f9f0c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.140+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1116376858 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0b6e90 con 0x7f9f0c146e10 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.141+0000 7f9f0ad9d640 1 --2- 172.21.15.49:0/1116376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0d1ef0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0cedb0 tx=0x7f9efc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668047b445c7876a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.142+0000 7f9f0a59c640 1 -- 172.21.15.49:0/1116376858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc02e070 con 0x7f9f0c146e10 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.142+0000 7f9f0a59c640 1 -- 172.21.15.49:0/1116376858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0315a0 con 0x7f9f0c146e10 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.142+0000 7f9f0a59c640 1 -- 172.21.15.49:0/1116376858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc031910 con 0x7f9f0c146e10 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.142+0000 7f9f11181640 1 -- 172.21.15.49:0/1116376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c146e10 msgr2=0x7f9f0c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.142+0000 7f9f11181640 1 --2- 172.21.15.49:0/1116376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0d1ef0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0cedb0 tx=0x7f9efc02b840 comp rx=0 tx=0).stop 2023-12-19T05:46:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 -- 172.21.15.49:0/1116376858 shutdown_connections 2023-12-19T05:46:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 --2- 172.21.15.49:0/1116376858 >> v2:172.21.15.115:3300/0 conn(0x7f9f0c0ce110 0x7f9f0c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 --2- 172.21.15.49:0/1116376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0d1ef0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 -- 172.21.15.49:0/1116376858 >> 172.21.15.49:0/1116376858 conn(0x7f9f0c0b29c0 msgr2=0x7f9f0c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 -- 172.21.15.49:0/1116376858 shutdown_connections 2023-12-19T05:46:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.143+0000 7f9f11181640 1 -- 172.21.15.49:0/1116376858 wait complete. 2023-12-19T05:46:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.145+0000 7f9f11181640 1 Processor -- start 2023-12-19T05:46:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.145+0000 7f9f11181640 1 -- start start 2023-12-19T05:46:47.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f0c0d2b00 0x7f9f0c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0c8540 con 0x7f9f0c0ce110 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0cd360 con 0x7f9f0c146e10 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.146+0000 7f9f11181640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ccac0 con 0x7f9f0c0d2b00 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37384/0 (socket says 172.21.15.49:37384) 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1936373875 learned_addr learned my addr 172.21.15.49:0/1936373875 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f0c0d2b00 msgr2=0x7f9f0c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f0c0d2b00 0x7f9f0c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f0c146e10 msgr2=0x7f9f0c0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 -- 172.21.15.49:0/1936373875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009400 con 0x7f9f0c0ce110 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.147+0000 7f9f0ad9d640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f9efc02b880 tx=0x7f9efc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.148+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc032840 con 0x7f9f0c0ce110 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.148+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0329c0 con 0x7f9f0c0ce110 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.148+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc032d70 con 0x7f9f0c0ce110 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.148+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0ccda0 con 0x7f9f0c0ce110 2023-12-19T05:46:47.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.148+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c1603d0 con 0x7f9f0c0ce110 2023-12-19T05:46:47.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.149+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c0c8680 con 0x7f9f0c0ce110 2023-12-19T05:46:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.150+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9efc03b3f0 con 0x7f9f0c0ce110 2023-12-19T05:46:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.152+0000 7f9f037fe640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 0x7f9eec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.152+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9efc0aa530 con 0x7f9f0c0ce110 2023-12-19T05:46:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.153+0000 7f9f03fff640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 0x7f9eec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.154+0000 7f9f03fff640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 0x7f9eec06c8f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000f60 tx=0x7f9ef40078f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.157+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f0c0c8680 con 0x7f9f0c0ce110 2023-12-19T05:46:47.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.353+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0c0c8680 con 0x7f9f0c0ce110 2023-12-19T05:46:47.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.355+0000 7f9f037fe640 1 -- 172.21.15.49:0/1936373875 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+12400 (secure 0 0 0) 0x7f9f0c0c8680 con 0x7f9f0c0ce110 2023-12-19T05:46:47.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:47.357 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":139,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:46.333980+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 msgr2=0x7f9eec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 0x7f9eec06c8f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000f60 tx=0x7f9ef40078f0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 msgr2=0x7f9f0c1f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f9efc02b880 tx=0x7f9efc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 shutdown_connections 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9eec06a430 0x7f9eec06c8f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f0c0d2b00 0x7f9f0c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f0c146e10 0x7f9f0c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 --2- 172.21.15.49:0/1936373875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f0c0ce110 0x7f9f0c1f2770 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.357+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 >> 172.21.15.49:0/1936373875 conn(0x7f9f0c0b29c0 msgr2=0x7f9f0c15ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.358+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 shutdown_connections 2023-12-19T05:46:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.358+0000 7f9f11181640 1 -- 172.21.15.49:0/1936373875 wait complete. 2023-12-19T05:46:47.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:46:47.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:46:47.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.619+0000 7f267a78e640 1 Processor -- start 2023-12-19T05:46:47.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.619+0000 7f267a78e640 1 -- start start 2023-12-19T05:46:47.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.620+0000 7f267a78e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f267415a010 0x7f26740adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f267a78e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f267415dbd0 0x7f26740cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f267a78e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26740c9bc0 con 0x7f26740cda90 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f267a78e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740cdee0 con 0x7f267415dbd0 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f267a78e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740c9e80 con 0x7f267415a010 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f2678f8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f267415dbd0 0x7f26740cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f2678f8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f267415dbd0 0x7f26740cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37390/0 (socket says 172.21.15.49:37390) 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f2678f8b640 1 -- 172.21.15.49:0/4283527607 learned_addr learned my addr 172.21.15.49:0/4283527607 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.621+0000 7f267978c640 1 --2- 172.21.15.49:0/4283527607 >> v2:172.21.15.115:3300/0 conn(0x7f267415a010 0x7f26740adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.622+0000 7f2678f8b640 1 -- 172.21.15.49:0/4283527607 >> v2:172.21.15.115:3300/0 conn(0x7f267415a010 msgr2=0x7f26740adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.622+0000 7f2678f8b640 1 --2- 172.21.15.49:0/4283527607 >> v2:172.21.15.115:3300/0 conn(0x7f267415a010 0x7f26740adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.622+0000 7f2678f8b640 1 -- 172.21.15.49:0/4283527607 >> v1:172.21.15.115:6789/0 conn(0x7f26740cda90 legacy=0x7f26740b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.622+0000 7f2678f8b640 1 -- 172.21.15.49:0/4283527607 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740cb320 con 0x7f267415dbd0 2023-12-19T05:46:47.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.623+0000 7f2678f8b640 1 --2- 172.21.15.49:0/4283527607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740cd550 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f26740b3630 tx=0x7f266802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd094aaf05ec93a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.623+0000 7f2673fff640 1 -- 172.21.15.49:0/4283527607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668031870 con 0x7f267415dbd0 2023-12-19T05:46:47.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f2673fff640 1 -- 172.21.15.49:0/4283527607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680319d0 con 0x7f267415dbd0 2023-12-19T05:46:47.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f2673fff640 1 -- 172.21.15.49:0/4283527607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668031d60 con 0x7f267415dbd0 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 -- 172.21.15.49:0/4283527607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 msgr2=0x7f26740cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 --2- 172.21.15.49:0/4283527607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740cd550 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f26740b3630 tx=0x7f266802b910 comp rx=0 tx=0).stop 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 -- 172.21.15.49:0/4283527607 shutdown_connections 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 --2- 172.21.15.49:0/4283527607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740cd550 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 --2- 172.21.15.49:0/4283527607 >> v2:172.21.15.115:3300/0 conn(0x7f267415a010 0x7f26740adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 -- 172.21.15.49:0/4283527607 >> 172.21.15.49:0/4283527607 conn(0x7f26740b30d0 msgr2=0x7f26740659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 -- 172.21.15.49:0/4283527607 shutdown_connections 2023-12-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.624+0000 7f267a78e640 1 -- 172.21.15.49:0/4283527607 wait complete. 2023-12-19T05:46:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.626+0000 7f267a78e640 1 Processor -- start 2023-12-19T05:46:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.626+0000 7f267a78e640 1 -- start start 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.627+0000 7f267a78e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26740cda90 0x7f267415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.627+0000 7f267a78e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f267415a010 0x7f26740c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f267a78e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f267a78e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740c4440 con 0x7f267415dbd0 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f267a78e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267415a3f0 con 0x7f26740cda90 2023-12-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f267a78e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740c8da0 con 0x7f267415a010 2023-12-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37396/0 (socket says 172.21.15.49:37396) 2023-12-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 -- 172.21.15.49:0/610905065 learned_addr learned my addr 172.21.15.49:0/610905065 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2678f8b640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f267415a010 0x7f26740c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f267978c640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26740cda90 0x7f267415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 -- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f267415a010 msgr2=0x7f26740c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f267415a010 0x7f26740c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 -- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26740cda90 msgr2=0x7f267415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26740cda90 0x7f267415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.628+0000 7f2679f8d640 1 -- 172.21.15.49:0/610905065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680094d0 con 0x7f267415dbd0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f2679f8d640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c440 tx=0x7f266c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011790 con 0x7f267415dbd0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c0118f0 con 0x7f267415dbd0 2023-12-19T05:46:47.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011ca0 con 0x7f267415dbd0 2023-12-19T05:46:47.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267415e030 con 0x7f267415dbd0 2023-12-19T05:46:47.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.629+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26740c3a30 con 0x7f267415dbd0 2023-12-19T05:46:47.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.630+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26740c4580 con 0x7f267415dbd0 2023-12-19T05:46:47.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.632+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f266c01c460 con 0x7f267415dbd0 2023-12-19T05:46:47.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.633+0000 7f2671ffb640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 0x7f266006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:47.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.633+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f266c088430 con 0x7f267415dbd0 2023-12-19T05:46:47.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.633+0000 7f267978c640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 0x7f266006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:47.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.635+0000 7f267978c640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 0x7f266006c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2664009a60 tx=0x7f2664003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:47.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.637+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f266c053e00 con 0x7f267415dbd0 2023-12-19T05:46:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.828+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2674061910 con 0x7f267415dbd0 2023-12-19T05:46:47.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.829+0000 7f2671ffb640 1 -- 172.21.15.49:0/610905065 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7f266c057420 con 0x7f267415dbd0 2023-12-19T05:46:47.831 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:46:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 msgr2=0x7f266006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 0x7f266006c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2664009a60 tx=0x7f2664003990 comp rx=0 tx=0).stop 2023-12-19T05:46:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 msgr2=0x7f26740c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c440 tx=0x7f266c00c900 comp rx=0 tx=0).stop 2023-12-19T05:46:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 shutdown_connections 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f266006a430 0x7f266006c8f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f267415a010 0x7f26740c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267415dbd0 0x7f26740c3120 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 --2- 172.21.15.49:0/610905065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26740cda90 0x7f267415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 >> 172.21.15.49:0/610905065 conn(0x7f26740b30d0 msgr2=0x7f26740b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.832+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 shutdown_connections 2023-12-19T05:46:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:47.833+0000 7f267a78e640 1 -- 172.21.15.49:0/610905065 wait complete. 2023-12-19T05:46:47.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:46:48.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.073+0000 7f3460cfa640 1 Processor -- start 2023-12-19T05:46:48.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.073+0000 7f3460cfa640 1 -- start start 2023-12-19T05:46:48.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.075+0000 7f3460cfa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f345c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.075+0000 7f3460cfa640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c15e730 con 0x7f345c0d2a60 2023-12-19T05:46:48.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.075+0000 7f3460cfa640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c142df0 con 0x7f345c0b86e0 2023-12-19T05:46:48.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.075+0000 7f3460cfa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1430d0 con 0x7f345c15e2d0 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f345c0d2a60 0x7f345c0b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51446/0 (socket says 172.21.15.49:51446) 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345bfff640 1 -- 172.21.15.49:0/3150173825 learned_addr learned my addr 172.21.15.49:0/3150173825 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345affd640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f345c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308393793 0 0) 0x7f345c15e730 con 0x7f345c0d2a60 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3444003520 con 0x7f345c0d2a60 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080914816 0 0) 0x7f3444003520 con 0x7f345c0d2a60 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 msgr2=0x7f345c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f345c0d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 >> v1:172.21.15.115:6789/0 conn(0x7f345c0b86e0 legacy=0x7f345c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.076+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c1433b0 con 0x7f345c0d2a60 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f34540019f0 con 0x7f345c0d2a60 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 >> v1:172.21.15.49:6789/0 conn(0x7f345c0d2a60 legacy=0x7f345c0b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440039a0 0x7f3444003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34440047c0 0x7f3444004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f34440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1430d0 con 0x7f34440047c0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344400bab0 con 0x7f34440039a0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344400bc70 con 0x7f345c15e2d0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345affd640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34440047c0 0x7f3444004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345b7fe640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440039a0 0x7f3444003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345bfff640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f34440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.077+0000 7f345affd640 1 -- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 msgr2=0x7f34440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.078+0000 7f345affd640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f34440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.078+0000 7f345affd640 1 -- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440039a0 msgr2=0x7f3444003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.078+0000 7f345affd640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440039a0 0x7f3444003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.078+0000 7f345affd640 1 -- 172.21.15.49:0/3150173825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444003520 con 0x7f34440047c0 2023-12-19T05:46:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.078+0000 7f345bfff640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15e2d0 0x7f34440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f345affd640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34440047c0 0x7f3444004c40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3450009ac0 tx=0x7f34440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ddb394cefef76e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345002c6b0 con 0x7f34440047c0 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345002c810 con 0x7f34440047c0 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f345a7fc640 1 -- 172.21.15.49:0/3150173825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345002cba0 con 0x7f34440047c0 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f3460cfa640 1 -- 172.21.15.49:0/3150173825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34440047c0 msgr2=0x7f3444004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f3460cfa640 1 --2- 172.21.15.49:0/3150173825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34440047c0 0x7f3444004c40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3450009ac0 tx=0x7f34440057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.079+0000 7f345bfff640 1 -- 172.21.15.49:0/3150173825 reap_dead start 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.080+0000 7f3460cfa640 1 -- 172.21.15.49:0/3150173825 shutdown_connections 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.080+0000 7f3460cfa640 1 -- 172.21.15.49:0/3150173825 >> 172.21.15.49:0/3150173825 conn(0x7f345c0d3230 msgr2=0x7f345c0d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.080+0000 7f3460cfa640 1 -- 172.21.15.49:0/3150173825 shutdown_connections 2023-12-19T05:46:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.080+0000 7f3460cfa640 1 -- 172.21.15.49:0/3150173825 wait complete. 2023-12-19T05:46:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.082+0000 7f3460cfa640 1 Processor -- start 2023-12-19T05:46:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.082+0000 7f3460cfa640 1 -- start start 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440047c0 0x7f345c15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15fc10 0x7f345c160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c12e670 con 0x7f345c1310c0 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1605d0 con 0x7f34440047c0 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f3460cfa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c12c200 con 0x7f345c15fc10 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37424/0 (socket says 172.21.15.49:37424) 2023-12-19T05:46:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 -- 172.21.15.49:0/2690660870 learned_addr learned my addr 172.21.15.49:0/2690660870 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345b7fe640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440047c0 0x7f345c15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 -- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15fc10 msgr2=0x7f345c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15fc10 0x7f345c160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 -- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440047c0 msgr2=0x7f345c15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440047c0 0x7f345c15c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.083+0000 7f345affd640 1 -- 172.21.15.49:0/2690660870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c15cbe0 con 0x7f345c1310c0 2023-12-19T05:46:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f345affd640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f345002c250 tx=0x7f3450004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450003810 con 0x7f345c1310c0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450003970 con 0x7f345c1310c0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c12e880 con 0x7f345c1310c0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450003ce0 con 0x7f345c1310c0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.084+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c12ee40 con 0x7f345c1310c0 2023-12-19T05:46:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.086+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c12f000 con 0x7f345c1310c0 2023-12-19T05:46:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.086+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3450034440 con 0x7f345c1310c0 2023-12-19T05:46:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.087+0000 7f3443fff640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 0x7f344806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.088+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34500aa860 con 0x7f345c1310c0 2023-12-19T05:46:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.088+0000 7f345b7fe640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 0x7f344806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.089+0000 7f345b7fe640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 0x7f344806c920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f344c007fd0 tx=0x7f344c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.092+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3450076250 con 0x7f345c1310c0 2023-12-19T05:46:48.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.288+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f345c061910 con 0x7f345c1310c0 2023-12-19T05:46:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.289+0000 7f3443fff640 1 -- 172.21.15.49:0/2690660870 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+65 (secure 0 0 0) 0x7f345004c090 con 0x7f345c1310c0 2023-12-19T05:46:48.290 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:48.290 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:46:48.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:46:48.291 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:46:48.291 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:46:48.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:46:48.291 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 msgr2=0x7f344806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 0x7f344806c920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f344c007fd0 tx=0x7f344c009040 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 msgr2=0x7f345c157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f345002c250 tx=0x7f3450004730 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 shutdown_connections 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f344806a460 0x7f344806c920 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f345c15fc10 0x7f345c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f345c1310c0 0x7f345c157100 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 --2- 172.21.15.49:0/2690660870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34440047c0 0x7f345c15c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 >> 172.21.15.49:0/2690660870 conn(0x7f345c0d3230 msgr2=0x7f345c0b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 shutdown_connections 2023-12-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.292+0000 7f3460cfa640 1 -- 172.21.15.49:0/2690660870 wait complete. 2023-12-19T05:46:48.313 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:46:48.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:46:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.549+0000 7f1faa8da640 1 Processor -- start 2023-12-19T05:46:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.549+0000 7f1faa8da640 1 -- start start 2023-12-19T05:46:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa8da640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 0x7f1fa40ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa8da640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fa415adf0 0x7f1fa40b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa8da640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa40cf370 con 0x7f1fa40cef30 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa8da640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa415b280 con 0x7f1fa415adf0 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa8da640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa406d340 con 0x7f1fa406cf60 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa0d9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fa415adf0 0x7f1fa40b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa0d9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fa415adf0 0x7f1fa40b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37440/0 (socket says 172.21.15.49:37440) 2023-12-19T05:46:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa0d9640 1 -- 172.21.15.49:0/3835061472 learned_addr learned my addr 172.21.15.49:0/3835061472 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1fa98d8640 1 --2- 172.21.15.49:0/3835061472 >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 0x7f1fa40ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa0d9640 1 -- 172.21.15.49:0/3835061472 >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 msgr2=0x7f1fa40ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.551+0000 7f1faa0d9640 1 --2- 172.21.15.49:0/3835061472 >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 0x7f1fa40ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.552+0000 7f1faa0d9640 1 -- 172.21.15.49:0/3835061472 >> v1:172.21.15.115:6789/0 conn(0x7f1fa40cef30 legacy=0x7f1fa415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.552+0000 7f1faa0d9640 1 -- 172.21.15.49:0/3835061472 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa415b4a0 con 0x7f1fa415adf0 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.552+0000 7f1fa98d8640 1 --2- 172.21.15.49:0/3835061472 >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 0x7f1fa40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.553+0000 7f1faa0d9640 1 --2- 172.21.15.49:0/3835061472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa40b1180 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40b50d0 tx=0x7f1f9c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b16375092e590c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.553+0000 7f1fa88d6640 1 -- 172.21.15.49:0/3835061472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c02cb10 con 0x7f1fa415adf0 2023-12-19T05:46:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.553+0000 7f1fa88d6640 1 -- 172.21.15.49:0/3835061472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c02cc70 con 0x7f1fa415adf0 2023-12-19T05:46:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.553+0000 7f1fa88d6640 1 -- 172.21.15.49:0/3835061472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0343f0 con 0x7f1fa415adf0 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 -- 172.21.15.49:0/3835061472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 msgr2=0x7f1fa40b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 --2- 172.21.15.49:0/3835061472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa40b1180 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40b50d0 tx=0x7f1f9c02bf70 comp rx=0 tx=0).stop 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 -- 172.21.15.49:0/3835061472 shutdown_connections 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 --2- 172.21.15.49:0/3835061472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa40b1180 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 --2- 172.21.15.49:0/3835061472 >> v2:172.21.15.115:3300/0 conn(0x7f1fa406cf60 0x7f1fa40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 -- 172.21.15.49:0/3835061472 >> 172.21.15.49:0/3835061472 conn(0x7f1fa40b4750 msgr2=0x7f1fa40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 -- 172.21.15.49:0/3835061472 shutdown_connections 2023-12-19T05:46:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.554+0000 7f1faa8da640 1 -- 172.21.15.49:0/3835061472 wait complete. 2023-12-19T05:46:48.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.555+0000 7f1faa8da640 1 Processor -- start 2023-12-19T05:46:48.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 -- start start 2023-12-19T05:46:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fa406cf60 0x7f1fa4144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fa40cef30 0x7f1fa4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4166c30 con 0x7f1fa415adf0 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4166f10 con 0x7f1fa406cf60 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.556+0000 7f1faa8da640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41671f0 con 0x7f1fa40cef30 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37452/0 (socket says 172.21.15.49:37452) 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 -- 172.21.15.49:0/4126395063 learned_addr learned my addr 172.21.15.49:0/4126395063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 -- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fa40cef30 msgr2=0x7f1fa4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fa40cef30 0x7f1fa4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 -- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fa406cf60 msgr2=0x7f1fa4144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1fa98d8640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fa406cf60 0x7f1fa4144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fa406cf60 0x7f1fa4144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.557+0000 7f1faa0d9640 1 -- 172.21.15.49:0/4126395063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009b30 con 0x7f1fa415adf0 2023-12-19T05:46:48.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1faa0d9640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c036040 tx=0x7f1f9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c009510 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c03e450 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c03e800 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa41674d0 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.558+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa4144960 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.559+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40adbd0 con 0x7f1fa415adf0 2023-12-19T05:46:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.560+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1f9c03e960 con 0x7f1fa415adf0 2023-12-19T05:46:48.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.561+0000 7f1f9a7fc640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 0x7f1f8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:48.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.561+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f9c0ab320 con 0x7f1fa415adf0 2023-12-19T05:46:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.562+0000 7f1fa98d8640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 0x7f1f8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:48.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.563+0000 7f1fa98d8640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 0x7f1f8806c8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0008850 tx=0x7f1fa0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:48.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.565+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1fa40adbd0 con 0x7f1fa415adf0 2023-12-19T05:46:48.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:48.757+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1fa40adbd0 con 0x7f1fa415adf0 2023-12-19T05:46:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.503+0000 7f1f9a7fc640 1 -- 172.21.15.49:0/4126395063 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1fa40adbd0 con 0x7f1fa415adf0 2023-12-19T05:46:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:46:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.509+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 msgr2=0x7f1f8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.509+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 0x7f1f8806c8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0008850 tx=0x7f1fa0008040 comp rx=0 tx=0).stop 2023-12-19T05:46:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.509+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 msgr2=0x7f1fa41491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c036040 tx=0x7f1f9c004a40 comp rx=0 tx=0).stop 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 shutdown_connections 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1f8806a430 0x7f1f8806c8f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fa40cef30 0x7f1fa4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fa415adf0 0x7f1fa41491b0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 --2- 172.21.15.49:0/4126395063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fa406cf60 0x7f1fa4144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 >> 172.21.15.49:0/4126395063 conn(0x7f1fa40b4750 msgr2=0x7f1fa406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 shutdown_connections 2023-12-19T05:46:49.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.510+0000 7f1faa8da640 1 -- 172.21.15.49:0/4126395063 wait complete. 2023-12-19T05:46:49.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:46:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.771+0000 7f229f118640 1 Processor -- start 2023-12-19T05:46:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.772+0000 7f229f118640 1 -- start start 2023-12-19T05:46:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.773+0000 7f229f118640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2298158df0 0x7f229815c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.773+0000 7f229f118640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2298070130 con 0x7f229806f160 2023-12-19T05:46:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f229f118640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229806f610 con 0x7f229806d850 2023-12-19T05:46:49.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f229f118640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229806f890 con 0x7f2298158df0 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f229ceb4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2298158df0 0x7f229815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f2297fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f229806f160 0x7f22980cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51456/0 (socket says 172.21.15.49:51456) 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f2297fff640 1 -- 172.21.15.49:0/4073282560 learned_addr learned my addr 172.21.15.49:0/4073282560 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f229ceb4640 1 -- 172.21.15.49:0/4073282560 >> v1:172.21.15.115:6789/0 conn(0x7f229806d850 legacy=0x7f229806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.774+0000 7f229ceb4640 1 -- 172.21.15.49:0/4073282560 >> v1:172.21.15.49:6789/0 conn(0x7f229806f160 legacy=0x7f22980cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.775+0000 7f229ceb4640 1 -- 172.21.15.49:0/4073282560 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229806fb70 con 0x7f2298158df0 2023-12-19T05:46:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.775+0000 7f22977fe640 1 -- 172.21.15.49:0/4073282560 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786287748 0 0) 0x7f2298070130 con 0x7f229806f160 2023-12-19T05:46:49.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.776+0000 7f229ceb4640 1 --2- 172.21.15.49:0/4073282560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2298158df0 0x7f229815c460 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f2288009d90 tx=0x7f228802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70db1774bc8f089 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.776+0000 7f22977fe640 1 -- 172.21.15.49:0/4073282560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228802cbd0 con 0x7f2298158df0 2023-12-19T05:46:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.776+0000 7f22977fe640 1 -- 172.21.15.49:0/4073282560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228802cd30 con 0x7f2298158df0 2023-12-19T05:46:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.776+0000 7f22977fe640 1 -- 172.21.15.49:0/4073282560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228802cea0 con 0x7f2298158df0 2023-12-19T05:46:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 -- 172.21.15.49:0/4073282560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2298158df0 msgr2=0x7f229815c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 --2- 172.21.15.49:0/4073282560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2298158df0 0x7f229815c460 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f2288009d90 tx=0x7f228802be20 comp rx=0 tx=0).stop 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 -- 172.21.15.49:0/4073282560 shutdown_connections 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 --2- 172.21.15.49:0/4073282560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2298158df0 0x7f229815c460 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 -- 172.21.15.49:0/4073282560 >> 172.21.15.49:0/4073282560 conn(0x7f22980cf0b0 msgr2=0x7f22980cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 -- 172.21.15.49:0/4073282560 shutdown_connections 2023-12-19T05:46:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.777+0000 7f229f118640 1 -- 172.21.15.49:0/4073282560 wait complete. 2023-12-19T05:46:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.779+0000 7f229f118640 1 Processor -- start 2023-12-19T05:46:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.779+0000 7f229f118640 1 -- start start 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229806d850 0x7f22981e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 0x7f229806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981562e0 con 0x7f229806f160 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298155660 con 0x7f229806d850 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f229f118640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298155940 con 0x7f2298158df0 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.780+0000 7f2297fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37482/0 (socket says 172.21.15.49:37482) 2023-12-19T05:46:49.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 -- 172.21.15.49:0/1827449559 learned_addr learned my addr 172.21.15.49:0/1827449559 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f229ceb4640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229806d850 0x7f22981e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f229d6b5640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 0x7f229806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 -- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 msgr2=0x7f229806cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 0x7f229806cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 -- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229806d850 msgr2=0x7f22981e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229806d850 0x7f22981e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 -- 172.21.15.49:0/1827449559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288009a70 con 0x7f229806f160 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f229d6b5640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 0x7f229806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.781+0000 7f2297fff640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f228000c4d0 tx=0x7f228000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.782+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800074e0 con 0x7f229806f160 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.782+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280007660 con 0x7f229806f160 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.782+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280004a20 con 0x7f229806f160 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.782+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2298155c20 con 0x7f229806f160 2023-12-19T05:46:49.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.782+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22981e7760 con 0x7f229806f160 2023-12-19T05:46:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.783+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2298074770 con 0x7f229806f160 2023-12-19T05:46:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.784+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f228001b360 con 0x7f229806f160 2023-12-19T05:46:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.785+0000 7f22957fa640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.785+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2280087c60 con 0x7f229806f160 2023-12-19T05:46:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.786+0000 7f229ceb4640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:49.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.787+0000 7f229ceb4640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 0x7f227806c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.789+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2280053410 con 0x7f229806f160 2023-12-19T05:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:49.984+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2298061910 con 0x7f229806f160 2023-12-19T05:46:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.517+0000 7f22957fa640 1 -- 172.21.15.49:0/1827449559 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) v1 ==== 170+0+0 (secure 0 0 0) 0x7f22800180d0 con 0x7f229806f160 2023-12-19T05:46:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:46:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.524+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 msgr2=0x7f227806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.524+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 0x7f227806c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288030000 comp rx=0 tx=0).stop 2023-12-19T05:46:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.524+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 msgr2=0x7f229806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.524+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f228000c4d0 tx=0x7f228000c990 comp rx=0 tx=0).stop 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 shutdown_connections 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2298158df0 0x7f229806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229806f160 0x7f229806c7c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 --2- 172.21.15.49:0/1827449559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229806d850 0x7f22981e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.529+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 >> 172.21.15.49:0/1827449559 conn(0x7f22980cf0b0 msgr2=0x7f22980cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:50.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.530+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 shutdown_connections 2023-12-19T05:46:50.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.530+0000 7f229f118640 1 -- 172.21.15.49:0/1827449559 wait complete. 2023-12-19T05:46:50.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:46:50.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.761+0000 7f222c177640 1 Processor -- start 2023-12-19T05:46:50.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.761+0000 7f222c177640 1 -- start start 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222c177640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22240b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222c177640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22240cc530 con 0x7f22240ce230 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222c177640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22240cce00 con 0x7f2224161700 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222c177640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2224166300 con 0x7f22240cc9c0 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222a714640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22240ce230 0x7f22240ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51468/0 (socket says 172.21.15.49:51468) 2023-12-19T05:46:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f222a714640 1 -- 172.21.15.49:0/2196917411 learned_addr learned my addr 172.21.15.49:0/2196917411 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.763+0000 7f2229712640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22240b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266190198 0 0) 0x7f22240cc530 con 0x7f22240ce230 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2210003520 con 0x7f22240ce230 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862500859 0 0) 0x7f2210003520 con 0x7f22240ce230 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 msgr2=0x7f22240b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22240b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 >> v1:172.21.15.115:6789/0 conn(0x7f2224161700 legacy=0x7f22240b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240cb920 con 0x7f22240ce230 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f221c0019f0 con 0x7f22240ce230 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 >> v1:172.21.15.49:6789/0 conn(0x7f22240ce230 legacy=0x7f22240ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2210003a10 0x7f2210003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210004d00 0x7f2210005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221000bb10 con 0x7f2210003a10 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221000bc50 con 0x7f2210004d00 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.764+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221000bde0 con 0x7f22240cc9c0 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2210003a10 0x7f2210003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f222a714640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210004d00 0x7f2210005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229712640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 -- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 msgr2=0x7f22100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22240cc9c0 0x7f22100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 -- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210004d00 msgr2=0x7f2210005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210004d00 0x7f2210005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f2229f13640 1 -- 172.21.15.49:0/2196917411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210003520 con 0x7f2210003a10 2023-12-19T05:46:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.765+0000 7f222a714640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210004d00 0x7f2210005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.766+0000 7f2229f13640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2210003a10 0x7f2210003e30 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f2220001750 tx=0x7f22100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d2ade685e70a85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.766+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22200052d0 con 0x7f2210003a10 2023-12-19T05:46:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.766+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222002e050 con 0x7f2210003a10 2023-12-19T05:46:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.766+0000 7f2228f11640 1 -- 172.21.15.49:0/2196917411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22200035f0 con 0x7f2210003a10 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 -- 172.21.15.49:0/2196917411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2210003a10 msgr2=0x7f2210003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 --2- 172.21.15.49:0/2196917411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2210003a10 0x7f2210003e30 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f2220001750 tx=0x7f22100057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222a714640 1 -- 172.21.15.49:0/2196917411 reap_dead start 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 -- 172.21.15.49:0/2196917411 shutdown_connections 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 -- 172.21.15.49:0/2196917411 >> 172.21.15.49:0/2196917411 conn(0x7f2224073150 msgr2=0x7f22240659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 -- 172.21.15.49:0/2196917411 shutdown_connections 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.767+0000 7f222c177640 1 -- 172.21.15.49:0/2196917411 wait complete. 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.769+0000 7f222c177640 1 Processor -- start 2023-12-19T05:46:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.769+0000 7f222c177640 1 -- start start 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210003a10 0x7f2224162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 0x7f222415f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222414ec90 con 0x7f2224152e80 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222415d610 con 0x7f2210003a10 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.770+0000 7f222c177640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222415dbd0 con 0x7f2224155190 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37500/0 (socket says 172.21.15.49:37500) 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 -- 172.21.15.49:0/44507756 learned_addr learned my addr 172.21.15.49:0/44507756 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229f13640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210003a10 0x7f2224162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f222a714640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 0x7f222415f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 -- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 msgr2=0x7f222415f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 0x7f222415f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 -- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210003a10 msgr2=0x7f2224162bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210003a10 0x7f2224162bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f2229712640 1 -- 172.21.15.49:0/44507756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224155ac0 con 0x7f2224152e80 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.771+0000 7f222a714640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 0x7f222415f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f2229712640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2214010890 tx=0x7f2214010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214009610 con 0x7f2224152e80 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400eb60 con 0x7f2224152e80 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221401c400 con 0x7f2224152e80 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2224155da0 con 0x7f2224152e80 2023-12-19T05:46:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.772+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2224155610 con 0x7f2224152e80 2023-12-19T05:46:50.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.773+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2224155890 con 0x7f2224152e80 2023-12-19T05:46:50.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.775+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f221401c560 con 0x7f2224152e80 2023-12-19T05:46:50.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.776+0000 7f221a7fc640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 0x7f220806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:50.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.776+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2214088f50 con 0x7f2224152e80 2023-12-19T05:46:50.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.777+0000 7f2229f13640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 0x7f220806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:50.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.778+0000 7f2229f13640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 0x7f220806c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2220033000 tx=0x7f2220009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:50.780+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22140546c0 con 0x7f2224152e80 2023-12-19T05:46:51.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.011+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2224061910 con 0x7f2224152e80 2023-12-19T05:46:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.024+0000 7f221a7fc640 1 -- 172.21.15.49:0/44507756 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2214057ce0 con 0x7f2224152e80 2023-12-19T05:46:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 16 and data pool 17 2023-12-19T05:46:51.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 msgr2=0x7f220806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 0x7f220806c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2220033000 tx=0x7f2220009030 comp rx=0 tx=0).stop 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 msgr2=0x7f2224164860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2214010890 tx=0x7f2214010d50 comp rx=0 tx=0).stop 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 shutdown_connections 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f220806a430 0x7f220806c8f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2224155190 0x7f222415f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2224152e80 0x7f2224164860 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 --2- 172.21.15.49:0/44507756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2210003a10 0x7f2224162bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.028+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 >> 172.21.15.49:0/44507756 conn(0x7f2224073150 msgr2=0x7f222406cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:51.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.029+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 shutdown_connections 2023-12-19T05:46:51.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.029+0000 7f222c177640 1 -- 172.21.15.49:0/44507756 wait complete. 2023-12-19T05:46:51.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:51.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.248+0000 7f70fbe1a640 1 Processor -- start 2023-12-19T05:46:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.248+0000 7f70fbe1a640 1 -- start start 2023-12-19T05:46:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70fbe1a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70f40ae110 0x7f70f40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70fbe1a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40b0a60 con 0x7f70f4157bf0 2023-12-19T05:46:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70fbe1a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40ae640 con 0x7f70f40b0640 2023-12-19T05:46:51.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70fbe1a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f406b8c0 con 0x7f70f40ae110 2023-12-19T05:46:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70f9bb6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f70f4157bf0 0x7f70f415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51476/0 (socket says 172.21.15.49:51476) 2023-12-19T05:46:51.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70f9bb6640 1 -- 172.21.15.49:0/2682688830 learned_addr learned my addr 172.21.15.49:0/2682688830 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130915913 0 0) 0x7f70f40b0a60 con 0x7f70f4157bf0 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003520 con 0x7f70f4157bf0 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.250+0000 7f70f93b5640 1 --2- 172.21.15.49:0/2682688830 >> v2:172.21.15.115:3300/0 conn(0x7f70f40ae110 0x7f70f40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 324220942 0 0) 0x7f70e0003520 con 0x7f70f4157bf0 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 >> v2:172.21.15.115:3300/0 conn(0x7f70f40ae110 msgr2=0x7f70f40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 --2- 172.21.15.49:0/2682688830 >> v2:172.21.15.115:3300/0 conn(0x7f70f40ae110 0x7f70f40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 >> v1:172.21.15.115:6789/0 conn(0x7f70f40b0640 legacy=0x7f70f406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40ae920 con 0x7f70f4157bf0 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f70f0001670 con 0x7f70f4157bf0 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 >> v1:172.21.15.49:6789/0 conn(0x7f70f4157bf0 legacy=0x7f70f415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00047c0 0x7f70e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e0005180 0x7f70e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f406b8c0 con 0x7f70e00039e0 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000c0b0 con 0x7f70e0005180 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000c270 con 0x7f70e00047c0 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.251+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70f9bb6640 1 -- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00047c0 msgr2=0x7f70e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00047c0 0x7f70e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70f9bb6640 1 -- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e0005180 msgr2=0x7f70e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70fa3b7640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e0005180 0x7f70e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e0005180 0x7f70e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70f9bb6640 1 -- 172.21.15.49:0/2682688830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0003520 con 0x7f70e00039e0 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70fa3b7640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e0005180 0x7f70e000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.252+0000 7f70fa3b7640 1 -- 172.21.15.49:0/2682688830 reap_dead start 2023-12-19T05:46:51.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.253+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70e0003e00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c240 tx=0x7f70e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59f27efd173d0ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.253+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0005ad0 con 0x7f70e00039e0 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.253+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0005c30 con 0x7f70e00039e0 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.253+0000 7f70f8bb4640 1 -- 172.21.15.49:0/2682688830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f002caf0 con 0x7f70e00039e0 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 -- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 msgr2=0x7f70e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70e0003e00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c240 tx=0x7f70e00057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 -- 172.21.15.49:0/2682688830 shutdown_connections 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/2682688830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70e0003e00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 -- 172.21.15.49:0/2682688830 >> 172.21.15.49:0/2682688830 conn(0x7f70f40cbb70 msgr2=0x7f70f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 -- 172.21.15.49:0/2682688830 shutdown_connections 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.254+0000 7f70fbe1a640 1 -- 172.21.15.49:0/2682688830 wait complete. 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.256+0000 7f70fbe1a640 1 Processor -- start 2023-12-19T05:46:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.256+0000 7f70fbe1a640 1 -- start start 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f40a9550 0x7f70f40ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 0x7f70f4146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f415c720 con 0x7f70e00039e0 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40a99d0 con 0x7f70f4159300 2023-12-19T05:46:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70fbe1a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40a9ca0 con 0x7f70f40a9550 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70f9bb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70f9bb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37522/0 (socket says 172.21.15.49:37522) 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.257+0000 7f70f9bb6640 1 -- 172.21.15.49:0/922361786 learned_addr learned my addr 172.21.15.49:0/922361786 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f93b5640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f40a9550 0x7f70f40ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70fa3b7640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 0x7f70f4146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 -- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f40a9550 msgr2=0x7f70f40ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f40a9550 0x7f70f40ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 -- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 msgr2=0x7f70f4146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 0x7f70f4146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 -- 172.21.15.49:0/922361786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40a9f80 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70fa3b7640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 0x7f70f4146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70f9bb6640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001930 tx=0x7f70f002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f003c040 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f002ce00 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.258+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00072b0 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.259+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f415c0d0 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.259+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f40abac0 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.260+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f4061910 con 0x7f70e00039e0 2023-12-19T05:46:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.261+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70f0032070 con 0x7f70e00039e0 2023-12-19T05:46:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.262+0000 7f70ea7fc640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 0x7f70d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.262+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70f00a9f20 con 0x7f70e00039e0 2023-12-19T05:46:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.262+0000 7f70f93b5640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 0x7f70d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.264+0000 7f70f93b5640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 0x7f70d806c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f70f40734d0 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.267+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70f0075510 con 0x7f70e00039e0 2023-12-19T05:46:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.462+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70f40cedc0 con 0x7f70e00039e0 2023-12-19T05:46:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.464+0000 7f70ea7fc640 1 -- 172.21.15.49:0/922361786 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16129 (secure 0 0 0) 0x7f70f0078b30 con 0x7f70e00039e0 2023-12-19T05:46:51.466 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:51.466 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:51.013648+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 msgr2=0x7f70d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 0x7f70d806c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f70f40734d0 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 msgr2=0x7f70f415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001930 tx=0x7f70f002e070 comp rx=0 tx=0).stop 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 shutdown_connections 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70d806a430 0x7f70d806c8f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70f40a9550 0x7f70f40ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f4159300 0x7f70f4146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 --2- 172.21.15.49:0/922361786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00039e0 0x7f70f415b390 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 >> 172.21.15.49:0/922361786 conn(0x7f70f40cbb70 msgr2=0x7f70f40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 shutdown_connections 2023-12-19T05:46:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.467+0000 7f70fbe1a640 1 -- 172.21.15.49:0/922361786 wait complete. 2023-12-19T05:46:51.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.697+0000 7f4423315640 1 Processor -- start 2023-12-19T05:46:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.698+0000 7f4423315640 1 -- start start 2023-12-19T05:46:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.699+0000 7f4423315640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.699+0000 7f4423315640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f441c0cdbf0 0x7f441c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.699+0000 7f4423315640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c15ec30 con 0x7f441c15e5a0 2023-12-19T05:46:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.699+0000 7f4423315640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0ce5c0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.699+0000 7f4423315640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15fbc0 con 0x7f441c0b2030 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f441c0cdbf0 0x7f441c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422313640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f441c15e5a0 0x7f441c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51490/0 (socket says 172.21.15.49:51490) 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f441c0cdbf0 0x7f441c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37534/0 (socket says 172.21.15.49:37534) 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422313640 1 -- 172.21.15.49:0/3759960340 learned_addr learned my addr 172.21.15.49:0/3759960340 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4421b12640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 -- 172.21.15.49:0/3759960340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 msgr2=0x7f441c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 -- 172.21.15.49:0/3759960340 >> v1:172.21.15.49:6789/0 conn(0x7f441c15e5a0 legacy=0x7f441c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.700+0000 7f4422b14640 1 -- 172.21.15.49:0/3759960340 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c15e980 con 0x7f441c0cdbf0 2023-12-19T05:46:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.702+0000 7f4422b14640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0ce080 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f4414009d90 tx=0x7f441402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421a8bdd313fcf49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.702+0000 7f4421311640 1 -- 172.21.15.49:0/3759960340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441402cc50 con 0x7f441c0cdbf0 2023-12-19T05:46:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.702+0000 7f4421311640 1 -- 172.21.15.49:0/3759960340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441402cdb0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.702+0000 7f4421311640 1 -- 172.21.15.49:0/3759960340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414034660 con 0x7f441c0cdbf0 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 -- 172.21.15.49:0/3759960340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 msgr2=0x7f441c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0ce080 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f4414009d90 tx=0x7f441402bea0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 -- 172.21.15.49:0/3759960340 shutdown_connections 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0ce080 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 --2- 172.21.15.49:0/3759960340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 -- 172.21.15.49:0/3759960340 >> 172.21.15.49:0/3759960340 conn(0x7f441c0b0100 msgr2=0x7f441c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 -- 172.21.15.49:0/3759960340 shutdown_connections 2023-12-19T05:46:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.703+0000 7f4423315640 1 -- 172.21.15.49:0/3759960340 wait complete. 2023-12-19T05:46:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.705+0000 7f4423315640 1 Processor -- start 2023-12-19T05:46:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.706+0000 7f4423315640 1 -- start start 2023-12-19T05:46:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 0x7f441c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15b240 con 0x7f441c0cdbf0 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15b520 con 0x7f441c15e5a0 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4423315640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15b800 con 0x7f441c0b2030 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4421b12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4421b12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37548/0 (socket says 172.21.15.49:37548) 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.707+0000 7f4421b12640 1 -- 172.21.15.49:0/1267430812 learned_addr learned my addr 172.21.15.49:0/1267430812 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4422313640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4422b14640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 0x7f441c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 -- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 msgr2=0x7f441c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 -- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 msgr2=0x7f441c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 0x7f441c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 -- 172.21.15.49:0/1267430812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009a70 con 0x7f441c0cdbf0 2023-12-19T05:46:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4422b14640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 0x7f441c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4421b12640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d800 tx=0x7f440c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.708+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00b6c0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.709+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00b820 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.709+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00bbb0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.709+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c15bae0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.709+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c15aef0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.710+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c1554a0 con 0x7f441c0cdbf0 2023-12-19T05:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.711+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f440c00bd10 con 0x7f441c0cdbf0 2023-12-19T05:46:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.712+0000 7f4412ffd640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 0x7f440006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.712+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f440c088d90 con 0x7f441c0cdbf0 2023-12-19T05:46:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.712+0000 7f4422313640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 0x7f440006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.714+0000 7f4422313640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 0x7f440006c920 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4418005880 tx=0x7f4418009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.716+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f440c054410 con 0x7f441c0cdbf0 2023-12-19T05:46:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.908+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f441c061910 con 0x7f441c0cdbf0 2023-12-19T05:46:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.911+0000 7f4412ffd640 1 -- 172.21.15.49:0/1267430812 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16129 (secure 0 0 0) 0x7f440c057a30 con 0x7f441c0cdbf0 2023-12-19T05:46:51.913 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:51.913 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:51.013648+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 msgr2=0x7f440006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 0x7f440006c920 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4418005880 tx=0x7f4418009040 comp rx=0 tx=0).stop 2023-12-19T05:46:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 msgr2=0x7f441c0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d800 tx=0x7f440c00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 shutdown_connections 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f440006a460 0x7f440006c920 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441c15e5a0 0x7f441c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f441c0cdbf0 0x7f441c0cd1f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 --2- 172.21.15.49:0/1267430812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f441c0b2030 0x7f441c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 >> 172.21.15.49:0/1267430812 conn(0x7f441c0b0100 msgr2=0x7f441c158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 shutdown_connections 2023-12-19T05:46:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:51.914+0000 7f4423315640 1 -- 172.21.15.49:0/1267430812 wait complete. 2023-12-19T05:46:51.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:46:52.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.174+0000 7f14fd823640 1 Processor -- start 2023-12-19T05:46:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.174+0000 7f14fd823640 1 -- start start 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.176+0000 7f14fd823640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14f80d2b00 0x7f14f80d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.176+0000 7f14fd823640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80cd840 con 0x7f14f8146e10 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.176+0000 7f14fd823640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80b6e90 con 0x7f14f80ce110 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.176+0000 7f14fd823640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f80d2430 con 0x7f14f80d2b00 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.176+0000 7f14f67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14f80d2b00 0x7f14f80d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.177+0000 7f14f67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14f80d2b00 0x7f14f80d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37562/0 (socket says 172.21.15.49:37562) 2023-12-19T05:46:52.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.177+0000 7f14f67fc640 1 -- 172.21.15.49:0/2983692107 learned_addr learned my addr 172.21.15.49:0/2983692107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.177+0000 7f14f67fc640 1 -- 172.21.15.49:0/2983692107 >> v1:172.21.15.115:6789/0 conn(0x7f14f80ce110 legacy=0x7f14f80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.177+0000 7f14f67fc640 1 -- 172.21.15.49:0/2983692107 >> v1:172.21.15.49:6789/0 conn(0x7f14f8146e10 legacy=0x7f14f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.177+0000 7f14f67fc640 1 -- 172.21.15.49:0/2983692107 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80d2620 con 0x7f14f80d2b00 2023-12-19T05:46:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.178+0000 7f14f67fc640 1 --2- 172.21.15.49:0/2983692107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f80d2b00 0x7f14f80d1ef0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009870 tx=0x7f14ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52204eb0459c6b5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.179+0000 7f14f5ffb640 1 -- 172.21.15.49:0/2983692107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0317e0 con 0x7f14f80d2b00 2023-12-19T05:46:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.179+0000 7f14f5ffb640 1 -- 172.21.15.49:0/2983692107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec031940 con 0x7f14f80d2b00 2023-12-19T05:46:52.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.179+0000 7f14f5ffb640 1 -- 172.21.15.49:0/2983692107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec031cd0 con 0x7f14f80d2b00 2023-12-19T05:46:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 -- 172.21.15.49:0/2983692107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f80d2b00 msgr2=0x7f14f80d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 --2- 172.21.15.49:0/2983692107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f80d2b00 0x7f14f80d1ef0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009870 tx=0x7f14ec02b880 comp rx=0 tx=0).stop 2023-12-19T05:46:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 -- 172.21.15.49:0/2983692107 shutdown_connections 2023-12-19T05:46:52.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 --2- 172.21.15.49:0/2983692107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f80d2b00 0x7f14f80d1ef0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 -- 172.21.15.49:0/2983692107 >> 172.21.15.49:0/2983692107 conn(0x7f14f80b29c0 msgr2=0x7f14f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 -- 172.21.15.49:0/2983692107 shutdown_connections 2023-12-19T05:46:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.180+0000 7f14fd823640 1 -- 172.21.15.49:0/2983692107 wait complete. 2023-12-19T05:46:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.182+0000 7f14fd823640 1 Processor -- start 2023-12-19T05:46:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.183+0000 7f14fd823640 1 -- start start 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f80ce110 0x7f14f8159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f80d2b00 0x7f14f813d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f813de40 con 0x7f14f8146e10 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80d2110 con 0x7f14f80ce110 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14fd823640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81f6460 con 0x7f14f80d2b00 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.184+0000 7f14f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37570/0 (socket says 172.21.15.49:37570) 2023-12-19T05:46:52.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 -- 172.21.15.49:0/3808022572 learned_addr learned my addr 172.21.15.49:0/3808022572 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f6ffd640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f80ce110 0x7f14f8159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:52.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f67fc640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f80d2b00 0x7f14f813d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 -- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f80d2b00 msgr2=0x7f14f813d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f80d2b00 0x7f14f813d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 -- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f80ce110 msgr2=0x7f14f8159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f80ce110 0x7f14f8159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.185+0000 7f14f77fe640 1 -- 172.21.15.49:0/3808022572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0094d0 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14f77fe640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c780 tx=0x7f14f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0004b60 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000ce90 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000a850 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f813e070 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.186+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81f60f0 con 0x7f14f8146e10 2023-12-19T05:46:52.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.188+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f81f65d0 con 0x7f14f8146e10 2023-12-19T05:46:52.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.189+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14f000a9b0 con 0x7f14f8146e10 2023-12-19T05:46:52.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.189+0000 7f14dffff640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 0x7f14e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:52.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.190+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14f0088a70 con 0x7f14f8146e10 2023-12-19T05:46:52.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.190+0000 7f14f6ffd640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 0x7f14e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:52.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.191+0000 7f14f6ffd640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 0x7f14e406c8f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f14e8006fd0 tx=0x7f14e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.194+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14f0054060 con 0x7f14f8146e10 2023-12-19T05:46:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:52.427+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f14f8061910 con 0x7f14f8146e10 2023-12-19T05:46:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.046+0000 7f14dffff640 1 -- 172.21.15.49:0/3808022572 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7f14f0057680 con 0x7f14f8146e10 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 msgr2=0x7f14e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 0x7f14e406c8f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f14e8006fd0 tx=0x7f14e8008040 comp rx=0 tx=0).stop 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 msgr2=0x7f14f81f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c780 tx=0x7f14f000cc40 comp rx=0 tx=0).stop 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 shutdown_connections 2023-12-19T05:46:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14e406a430 0x7f14e406c8f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f80d2b00 0x7f14f813d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f8146e10 0x7f14f81f68f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 --2- 172.21.15.49:0/3808022572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f80ce110 0x7f14f8159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.049+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 >> 172.21.15.49:0/3808022572 conn(0x7f14f80b29c0 msgr2=0x7f14f80b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.050+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 shutdown_connections 2023-12-19T05:46:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.050+0000 7f14fd823640 1 -- 172.21.15.49:0/3808022572 wait complete. 2023-12-19T05:46:53.074 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:46:53.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:46:53.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.309+0000 7f88d67b9640 1 Processor -- start 2023-12-19T05:46:53.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.309+0000 7f88d67b9640 1 -- start start 2023-12-19T05:46:53.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d00d2d00 0x7f88d00b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00b8d60 0x7f88d00b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88d00b6c80 0x7f88d0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d0142bf0 con 0x7f88d00d2d00 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d0142e40 con 0x7f88d00b6c80 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88d67b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0143120 con 0x7f88d00b8d60 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88cffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d00d2d00 0x7f88d00b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88cffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d00d2d00 0x7f88d00b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37574/0 (socket says 172.21.15.49:37574) 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88cffff640 1 -- 172.21.15.49:0/968374569 learned_addr learned my addr 172.21.15.49:0/968374569 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.311+0000 7f88cffff640 1 -- 172.21.15.49:0/968374569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00b8d60 msgr2=0x7f88d00b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.312+0000 7f88cffff640 1 --2- 172.21.15.49:0/968374569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00b8d60 0x7f88d00b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.312+0000 7f88cffff640 1 -- 172.21.15.49:0/968374569 >> v2:172.21.15.115:3300/0 conn(0x7f88d00b6c80 msgr2=0x7f88d0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.312+0000 7f88cffff640 1 --2- 172.21.15.49:0/968374569 >> v2:172.21.15.115:3300/0 conn(0x7f88d00b6c80 0x7f88d0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.312+0000 7f88cffff640 1 -- 172.21.15.49:0/968374569 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0143400 con 0x7f88d00d2d00 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.313+0000 7f88cffff640 1 --2- 172.21.15.49:0/968374569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00d2d00 0x7f88d00b8820 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f88d00b6450 tx=0x7f88c002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840445fdd90f46bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.313+0000 7f88ceffd640 1 -- 172.21.15.49:0/968374569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0031860 con 0x7f88d00d2d00 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.313+0000 7f88ceffd640 1 -- 172.21.15.49:0/968374569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00319c0 con 0x7f88d00d2d00 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.313+0000 7f88ceffd640 1 -- 172.21.15.49:0/968374569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0031d50 con 0x7f88d00d2d00 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 -- 172.21.15.49:0/968374569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00d2d00 msgr2=0x7f88d00b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 --2- 172.21.15.49:0/968374569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00d2d00 0x7f88d00b8820 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f88d00b6450 tx=0x7f88c002b900 comp rx=0 tx=0).stop 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 -- 172.21.15.49:0/968374569 shutdown_connections 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 --2- 172.21.15.49:0/968374569 >> v2:172.21.15.115:3300/0 conn(0x7f88d00b6c80 0x7f88d0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 --2- 172.21.15.49:0/968374569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00b8d60 0x7f88d00b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 --2- 172.21.15.49:0/968374569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00d2d00 0x7f88d00b8820 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 -- 172.21.15.49:0/968374569 >> 172.21.15.49:0/968374569 conn(0x7f88d00cfe10 msgr2=0x7f88d00d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 -- 172.21.15.49:0/968374569 shutdown_connections 2023-12-19T05:46:53.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.314+0000 7f88d67b9640 1 -- 172.21.15.49:0/968374569 wait complete. 2023-12-19T05:46:53.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.316+0000 7f88d67b9640 1 Processor -- start 2023-12-19T05:46:53.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.316+0000 7f88d67b9640 1 -- start start 2023-12-19T05:46:53.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d00b8d60 0x7f88d015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00d2d00 0x7f88d0144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0145230 con 0x7f88d00b6c80 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0159260 con 0x7f88d00b8d60 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.317+0000 7f88d67b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0159540 con 0x7f88d00d2d00 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37584/0 (socket says 172.21.15.49:37584) 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 -- 172.21.15.49:0/3513813528 learned_addr learned my addr 172.21.15.49:0/3513813528 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cf7fe640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d00b8d60 0x7f88d015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88d4d56640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00d2d00 0x7f88d0144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 -- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00d2d00 msgr2=0x7f88d0144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00d2d00 0x7f88d0144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 -- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d00b8d60 msgr2=0x7f88d015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d00b8d60 0x7f88d015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 -- 172.21.15.49:0/3513813528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00094d0 con 0x7f88d00b6c80 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.318+0000 7f88cffff640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000c00 tx=0x7f88c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.319+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c003ad10 con 0x7f88d00b6c80 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.319+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c003ae70 con 0x7f88d00b6c80 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.319+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0044610 con 0x7f88d00b6c80 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.319+0000 7f88d67b9640 1 -- 172.21.15.49:0/3513813528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d0159820 con 0x7f88d00b6c80 2023-12-19T05:46:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.319+0000 7f88d67b9640 1 -- 172.21.15.49:0/3513813528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d0146bb0 con 0x7f88d00b6c80 2023-12-19T05:46:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.320+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0159d40 con 0x7f88d00b6c80 2023-12-19T05:46:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.321+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88c004d450 con 0x7f88d00b6c80 2023-12-19T05:46:53.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.322+0000 7f88ccff9640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 0x7f88bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:53.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.322+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c00ab0d0 con 0x7f88d00b6c80 2023-12-19T05:46:53.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.323+0000 7f88cf7fe640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 0x7f88bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:53.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.324+0000 7f88cf7fe640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 0x7f88bc06c8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88d013d810 tx=0x7f88c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.326+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88d0159d40 con 0x7f88d00b6c80 2023-12-19T05:46:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:53.559+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88d0159d40 con 0x7f88d00b6c80 2023-12-19T05:46:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.536+0000 7f88ccff9640 1 -- 172.21.15.49:0/3513813528 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f88d0159d40 con 0x7f88d00b6c80 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 msgr2=0x7f88bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 0x7f88bc06c8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88d013d810 tx=0x7f88c4008040 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 msgr2=0x7f88d0143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000c00 tx=0x7f88c00046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 shutdown_connections 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f88bc06a430 0x7f88bc06c8f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d00d2d00 0x7f88d0144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d00b8d60 0x7f88d015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 --2- 172.21.15.49:0/3513813528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d00b6c80 0x7f88d0143c90 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 >> 172.21.15.49:0/3513813528 conn(0x7f88d00cfe10 msgr2=0x7f88d00b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.540+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 shutdown_connections 2023-12-19T05:46:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.541+0000 7f88b6ffd640 1 -- 172.21.15.49:0/3513813528 wait complete. 2023-12-19T05:46:54.568 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:46:54.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.806+0000 7f7b3660e640 1 Processor -- start 2023-12-19T05:46:54.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.806+0000 7f7b3660e640 1 -- start start 2023-12-19T05:46:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.808+0000 7f7b3660e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b3015e5a0 0x7f7b300b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.808+0000 7f7b3660e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3015ec30 con 0x7f7b3015f680 2023-12-19T05:46:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.808+0000 7f7b3660e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3015e980 con 0x7f7b300cdbf0 2023-12-19T05:46:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.808+0000 7f7b3660e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300b2f90 con 0x7f7b3015e5a0 2023-12-19T05:46:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b34e0b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b3015f680 0x7f7b300b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34542/0 (socket says 172.21.15.49:34542) 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b34e0b640 1 -- 172.21.15.49:0/160474929 learned_addr learned my addr 172.21.15.49:0/160474929 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b3560c640 1 --2- 172.21.15.49:0/160474929 >> v2:172.21.15.115:3300/0 conn(0x7f7b3015e5a0 0x7f7b300b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760243262 0 0) 0x7f7b3015ec30 con 0x7f7b3015f680 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003520 con 0x7f7b3015f680 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046248942 0 0) 0x7f7b1c003520 con 0x7f7b3015f680 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 >> v2:172.21.15.115:3300/0 conn(0x7f7b3015e5a0 msgr2=0x7f7b300b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 --2- 172.21.15.49:0/160474929 >> v2:172.21.15.115:3300/0 conn(0x7f7b3015e5a0 0x7f7b300b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 >> v1:172.21.15.115:6789/0 conn(0x7f7b300cdbf0 legacy=0x7f7b3006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300b3270 con 0x7f7b3015f680 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.809+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f7b20001670 con 0x7f7b3015f680 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 >> v1:172.21.15.49:6789/0 conn(0x7f7b3015f680 legacy=0x7f7b300b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c0039c0 0x7f7b1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b1c0047c0 0x7f7b1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 0x7f7b1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b2f90 con 0x7f7b1c005180 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c080 con 0x7f7b1c0047c0 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c240 con 0x7f7b1c0039c0 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 0x7f7b1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b34e0b640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b1c0047c0 0x7f7b1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.810+0000 7f7b3560c640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c0039c0 0x7f7b1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b35e0d640 1 -- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c0039c0 msgr2=0x7f7b1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c0039c0 0x7f7b1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b35e0d640 1 -- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b1c0047c0 msgr2=0x7f7b1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b1c0047c0 0x7f7b1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b35e0d640 1 -- 172.21.15.49:0/160474929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c003520 con 0x7f7b1c005180 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.811+0000 7f7b34e0b640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b1c0047c0 0x7f7b1c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.812+0000 7f7b35e0d640 1 -- 172.21.15.49:0/160474929 reap_dead start 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.812+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 0x7f7b1c00b980 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7b28001e50 tx=0x7f7b1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c974c7ccfe1cac4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.812+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28003b70 con 0x7f7b1c005180 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.812+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28003d10 con 0x7f7b1c005180 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.812+0000 7f7b27fff640 1 -- 172.21.15.49:0/160474929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28005310 con 0x7f7b1c005180 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 -- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 msgr2=0x7f7b1c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 0x7f7b1c00b980 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7b28001e50 tx=0x7f7b1c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 -- 172.21.15.49:0/160474929 shutdown_connections 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 --2- 172.21.15.49:0/160474929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b1c005180 0x7f7b1c00b980 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 -- 172.21.15.49:0/160474929 >> 172.21.15.49:0/160474929 conn(0x7f7b300b0100 msgr2=0x7f7b300b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 -- 172.21.15.49:0/160474929 shutdown_connections 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.813+0000 7f7b3660e640 1 -- 172.21.15.49:0/160474929 wait complete. 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.815+0000 7f7b3660e640 1 Processor -- start 2023-12-19T05:46:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.815+0000 7f7b3660e640 1 -- start start 2023-12-19T05:46:54.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c005180 0x7f7b300b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 0x7f7b30143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015b4d0 con 0x7f7b3015a9d0 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015b7b0 con 0x7f7b30143640 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b3660e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015ba90 con 0x7f7b1c005180 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b34e0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b34e0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52086/0 (socket says 172.21.15.49:52086) 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.816+0000 7f7b34e0b640 1 -- 172.21.15.49:0/1975812597 learned_addr learned my addr 172.21.15.49:0/1975812597 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 0x7f7b30143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 -- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c005180 msgr2=0x7f7b300b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b3560c640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c005180 0x7f7b300b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c005180 0x7f7b300b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 -- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 msgr2=0x7f7b30143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:54.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 0x7f7b30143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 -- 172.21.15.49:0/1975812597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3015bd70 con 0x7f7b3015a9d0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b35e0d640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 0x7f7b30143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b34e0b640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e780 tx=0x7f7b2000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000c660 con 0x7f7b3015a9d0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000c7c0 con 0x7f7b3015a9d0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000cb30 con 0x7f7b3015a9d0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.817+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3015c050 con 0x7f7b3015a9d0 2023-12-19T05:46:54.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.818+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3015da10 con 0x7f7b3015a9d0 2023-12-19T05:46:54.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.819+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b300cffd0 con 0x7f7b3015a9d0 2023-12-19T05:46:54.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.820+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b2000cc90 con 0x7f7b3015a9d0 2023-12-19T05:46:54.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.821+0000 7f7b25ffb640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:54.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.821+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f7b200887b0 con 0x7f7b3015a9d0 2023-12-19T05:46:54.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.821+0000 7f7b3560c640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:54.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.823+0000 7f7b3560c640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 0x7f7b1406c8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0098d0 tx=0x7f7b2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:54.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:54.825+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7b20053d30 con 0x7f7b3015a9d0 2023-12-19T05:46:55.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.057+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b30061910 con 0x7f7b3015a9d0 2023-12-19T05:46:55.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.058+0000 7f7b25ffb640 1 -- 172.21.15.49:0/1975812597 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f7b20057350 con 0x7f7b3015a9d0 2023-12-19T05:46:55.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:55.060 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:46:55.060 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:46:55.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 msgr2=0x7f7b1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 0x7f7b1406c8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0098d0 tx=0x7f7b2c008040 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 msgr2=0x7f7b3015ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e780 tx=0x7f7b2000ec40 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 shutdown_connections 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b30143640 0x7f7b30143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b3015a9d0 0x7f7b3015ae50 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 --2- 172.21.15.49:0/1975812597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b1c005180 0x7f7b300b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.061+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 >> 172.21.15.49:0/1975812597 conn(0x7f7b300b0100 msgr2=0x7f7b30157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:55.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.062+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 shutdown_connections 2023-12-19T05:46:55.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.062+0000 7f7b3660e640 1 -- 172.21.15.49:0/1975812597 wait complete. 2023-12-19T05:46:55.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:46:55.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.311+0000 7f23f4322640 1 Processor -- start 2023-12-19T05:46:55.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.311+0000 7f23f4322640 1 -- start start 2023-12-19T05:46:55.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.313+0000 7f23f4322640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.313+0000 7f23f4322640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.313+0000 7f23f4322640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0afb10 con 0x7f23ec0b0b50 2023-12-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.313+0000 7f23f4322640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec06bb30 con 0x7f23ec06c6b0 2023-12-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.313+0000 7f23f4322640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0b0070 con 0x7f23ec1449e0 2023-12-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f28bf640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f20be640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f20be640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:51972/0 (socket says 172.21.15.49:51972) 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f20be640 1 -- 172.21.15.49:0/2997715530 learned_addr learned my addr 172.21.15.49:0/2997715530 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f28bf640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:33604/0 (socket says 172.21.15.49:33604) 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.314+0000 7f23f18bd640 1 --1- 172.21.15.49:0/2997715530 >> v1:172.21.15.115:6789/0 conn(0x7f23ec0b0b50 0x7f23ec06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:42380/0 (socket says 172.21.15.49:42380) 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.315+0000 7f23f20be640 1 -- 172.21.15.49:0/2997715530 >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 msgr2=0x7f23ec0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.315+0000 7f23f20be640 1 --2- 172.21.15.49:0/2997715530 >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.315+0000 7f23f20be640 1 -- 172.21.15.49:0/2997715530 >> v1:172.21.15.115:6789/0 conn(0x7f23ec0b0b50 legacy=0x7f23ec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.315+0000 7f23f20be640 1 -- 172.21.15.49:0/2997715530 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0b0350 con 0x7f23ec1449e0 2023-12-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.315+0000 7f23f28bf640 1 --2- 172.21.15.49:0/2997715530 >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.317+0000 7f23f20be640 1 --2- 172.21.15.49:0/2997715530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009870 tx=0x7f23e802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130203e90695b180 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.317+0000 7f23f10bc640 1 -- 172.21.15.49:0/2997715530 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8030840 con 0x7f23ec1449e0 2023-12-19T05:46:55.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.317+0000 7f23f10bc640 1 -- 172.21.15.49:0/2997715530 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e80309a0 con 0x7f23ec1449e0 2023-12-19T05:46:55.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.317+0000 7f23f10bc640 1 -- 172.21.15.49:0/2997715530 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8030d30 con 0x7f23ec1449e0 2023-12-19T05:46:55.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 -- 172.21.15.49:0/2997715530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 msgr2=0x7f23ec0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 --2- 172.21.15.49:0/2997715530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009870 tx=0x7f23e802b980 comp rx=0 tx=0).stop 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 -- 172.21.15.49:0/2997715530 shutdown_connections 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 --2- 172.21.15.49:0/2997715530 >> v2:172.21.15.115:3300/0 conn(0x7f23ec06c6b0 0x7f23ec0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 --2- 172.21.15.49:0/2997715530 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec1449e0 0x7f23ec0af5d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 -- 172.21.15.49:0/2997715530 >> 172.21.15.49:0/2997715530 conn(0x7f23ec0cbb70 msgr2=0x7f23ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 -- 172.21.15.49:0/2997715530 shutdown_connections 2023-12-19T05:46:55.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.318+0000 7f23f4322640 1 -- 172.21.15.49:0/2997715530 wait complete. 2023-12-19T05:46:55.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.320+0000 7f23f4322640 1 Processor -- start 2023-12-19T05:46:55.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.320+0000 7f23f4322640 1 -- start start 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec06c6b0 0x7f23ec1e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 0x7f23ec0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec1e55b0 con 0x7f23ec1449e0 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec1e49a0 con 0x7f23ec0b0b50 2023-12-19T05:46:55.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.321+0000 7f23f4322640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec1e4c80 con 0x7f23ec06c6b0 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52096/0 (socket says 172.21.15.49:52096) 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 -- 172.21.15.49:0/3495864643 learned_addr learned my addr 172.21.15.49:0/3495864643 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f18bd640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 0x7f23ec0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 -- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec06c6b0 msgr2=0x7f23ec1e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f20be640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec06c6b0 0x7f23ec1e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec06c6b0 0x7f23ec1e5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 -- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 msgr2=0x7f23ec0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 0x7f23ec0700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.322+0000 7f23f28bf640 1 -- 172.21.15.49:0/3495864643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009a70 con 0x7f23ec1449e0 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23f18bd640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 0x7f23ec0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:55.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23f28bf640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4009d70 con 0x7f23ec1449e0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e400f040 con 0x7f23ec1449e0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4003990 con 0x7f23ec1449e0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80094d0 con 0x7f23ec1449e0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.323+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec1e5240 con 0x7f23ec1449e0 2023-12-19T05:46:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.325+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec1e5760 con 0x7f23ec1449e0 2023-12-19T05:46:55.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.325+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23e40144a0 con 0x7f23ec1449e0 2023-12-19T05:46:55.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.326+0000 7f23e2ffd640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.327+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f23e4089600 con 0x7f23ec1449e0 2023-12-19T05:46:55.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.327+0000 7f23f20be640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.328+0000 7f23f20be640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 0x7f23d006c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f23e8036000 tx=0x7f23e803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.331+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23ec1e5760 con 0x7f23ec1449e0 2023-12-19T05:46:55.472 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-12-19T05:46:55.470+0000 7f1bb7930640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:46:55.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.527+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ec061910 con 0x7f23ec1449e0 2023-12-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.530+0000 7f23e2ffd640 1 -- 172.21.15.49:0/3495864643 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16249 (secure 0 0 0) 0x7f23e4054b90 con 0x7f23ec1449e0 2023-12-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:46:55.058060+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.532+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 msgr2=0x7f23d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.532+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 0x7f23d006c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f23e8036000 tx=0x7f23e803b040 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 msgr2=0x7f23ec1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e4009f90 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 shutdown_connections 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23ec1449e0 0x7f23ec1592e0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ec0b0b50 0x7f23ec0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 --2- 172.21.15.49:0/3495864643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23ec06c6b0 0x7f23ec1e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 >> 172.21.15.49:0/3495864643 conn(0x7f23ec0cbb70 msgr2=0x7f23ec06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 shutdown_connections 2023-12-19T05:46:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.533+0000 7f23f4322640 1 -- 172.21.15.49:0/3495864643 wait complete. 2023-12-19T05:46:55.555 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:46:55.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.783+0000 7f757a3d6640 1 Processor -- start 2023-12-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.783+0000 7f757a3d6640 1 -- start start 2023-12-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574146bc0 0x7f75740b7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f757415d700 0x7f75740b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740b6350 0x7f75740b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7574146fa0 con 0x7f75740b6350 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740b7080 con 0x7f757415d700 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.785+0000 7f757a3d6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740b7360 con 0x7f7574146bc0 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740b6350 0x7f75740b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740b6350 0x7f75740b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52112/0 (socket says 172.21.15.49:52112) 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 -- 172.21.15.49:0/2008419032 learned_addr learned my addr 172.21.15.49:0/2008419032 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f75793d4640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574146bc0 0x7f75740b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7578bd3640 1 --2- 172.21.15.49:0/2008419032 >> v2:172.21.15.115:3300/0 conn(0x7f757415d700 0x7f75740b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 -- 172.21.15.49:0/2008419032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574146bc0 msgr2=0x7f75740b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574146bc0 0x7f75740b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 -- 172.21.15.49:0/2008419032 >> v2:172.21.15.115:3300/0 conn(0x7f757415d700 msgr2=0x7f75740b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 --2- 172.21.15.49:0/2008419032 >> v2:172.21.15.115:3300/0 conn(0x7f757415d700 0x7f75740b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.786+0000 7f7579bd5640 1 -- 172.21.15.49:0/2008419032 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757406f200 con 0x7f75740b6350 2023-12-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.788+0000 7f7579bd5640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740b6350 0x7f75740b67e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f75740d0ee0 tx=0x7f756c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544b9de48fa8ee9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.788+0000 7f7573fff640 1 -- 172.21.15.49:0/2008419032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c031870 con 0x7f75740b6350 2023-12-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.788+0000 7f7573fff640 1 -- 172.21.15.49:0/2008419032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0319d0 con 0x7f75740b6350 2023-12-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.788+0000 7f7573fff640 1 -- 172.21.15.49:0/2008419032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c031d60 con 0x7f75740b6350 2023-12-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 -- 172.21.15.49:0/2008419032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740b6350 msgr2=0x7f75740b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740b6350 0x7f75740b67e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f75740d0ee0 tx=0x7f756c02b910 comp rx=0 tx=0).stop 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 -- 172.21.15.49:0/2008419032 shutdown_connections 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740b6350 0x7f75740b67e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 --2- 172.21.15.49:0/2008419032 >> v2:172.21.15.115:3300/0 conn(0x7f757415d700 0x7f75740b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 --2- 172.21.15.49:0/2008419032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574146bc0 0x7f75740b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 -- 172.21.15.49:0/2008419032 >> 172.21.15.49:0/2008419032 conn(0x7f75740b2370 msgr2=0x7f75740b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 -- 172.21.15.49:0/2008419032 shutdown_connections 2023-12-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.789+0000 7f757a3d6640 1 -- 172.21.15.49:0/2008419032 wait complete. 2023-12-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.791+0000 7f757a3d6640 1 Processor -- start 2023-12-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.791+0000 7f757a3d6640 1 -- start start 2023-12-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75740b6350 0x7f757413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f757415d700 0x7f757413f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757413dbf0 con 0x7f7574146bc0 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741423e0 con 0x7f75740b6350 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f757a3d6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574142100 con 0x7f757415d700 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.792+0000 7f7578bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52118/0 (socket says 172.21.15.49:52118) 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 -- 172.21.15.49:0/1047455551 learned_addr learned my addr 172.21.15.49:0/1047455551 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f75793d4640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75740b6350 0x7f757413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7579bd5640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f757415d700 0x7f757413f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 -- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f757415d700 msgr2=0x7f757413f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f757415d700 0x7f757413f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 -- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75740b6350 msgr2=0x7f757413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75740b6350 0x7f757413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 -- 172.21.15.49:0/1047455551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0094d0 con 0x7f7574146bc0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.793+0000 7f7578bd3640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756800d5f0 tx=0x7f756800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.794+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680125f0 con 0x7f7574146bc0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.794+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568012750 con 0x7f7574146bc0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.794+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568012b00 con 0x7f7574146bc0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.794+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574144250 con 0x7f7574146bc0 2023-12-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.794+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574144810 con 0x7f7574146bc0 2023-12-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.795+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574061910 con 0x7f7574146bc0 2023-12-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.796+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7568012c60 con 0x7f7574146bc0 2023-12-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.797+0000 7f7571ffb640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 0x7f756006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.797+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f7568088d50 con 0x7f7574146bc0 2023-12-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.798+0000 7f75793d4640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 0x7f756006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.799+0000 7f75793d4640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 0x7f756006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7564009a60 tx=0x7f7564003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.802+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f756808c030 con 0x7f7574146bc0 2023-12-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:55.992+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f757406f7c0 con 0x7f756006a430 2023-12-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.015+0000 7f7571ffb640 1 -- 172.21.15.49:0/1047455551 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283199 (secure 0 0 0) 0x7f7564004780 con 0x7f756006a430 2023-12-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 msgr2=0x7f756006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 0x7f756006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7564009a60 tx=0x7f7564003990 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 msgr2=0x7f7574157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756800d5f0 tx=0x7f756800dab0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 shutdown_connections 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f756006a430 0x7f756006c8f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f757415d700 0x7f757413f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574146bc0 0x7f7574157b60 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 --2- 172.21.15.49:0/1047455551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75740b6350 0x7f757413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.021+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 >> 172.21.15.49:0/1047455551 conn(0x7f75740b2370 msgr2=0x7f757415cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.022+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 shutdown_connections 2023-12-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.022+0000 7f757a3d6640 1 -- 172.21.15.49:0/1047455551 wait complete. 2023-12-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2023-12-19T05:46:55.070669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555157,"statfs":{"total":1600000000,"available":1592481420,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.405617"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453271+0000","last_change":"2023-12-19T05:46:51.050712+0000","last_active":"2023-12-19T05:46:52.453271+0000","last_peered":"2023-12-19T05:46:52.453271+0000","last_clean":"2023-12-19T05:46:52.453271+0000","last_became_active":"2023-12-19T05:46:51.047340+0000","last_became_peered":"2023-12-19T05:46:51.047340+0000","last_unstale":"2023-12-19T05:46:52.453271+0000","last_undegraded":"2023-12-19T05:46:52.453271+0000","last_fullsized":"2023-12-19T05:46:52.453271+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:20.832863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.058341+0000","last_change":"2023-12-19T05:46:51.058279+0000","last_active":"2023-12-19T05:46:51.058341+0000","last_peered":"2023-12-19T05:46:51.058341+0000","last_clean":"2023-12-19T05:46:51.058341+0000","last_became_active":"2023-12-19T05:46:51.058090+0000","last_became_peered":"2023-12-19T05:46:51.058090+0000","last_unstale":"2023-12-19T05:46:51.058341+0000","last_undegraded":"2023-12-19T05:46:51.058341+0000","last_fullsized":"2023-12-19T05:46:51.058341+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:55.529858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451323+0000","last_change":"2023-12-19T05:46:51.045311+0000","last_active":"2023-12-19T05:46:52.451323+0000","last_peered":"2023-12-19T05:46:52.451323+0000","last_clean":"2023-12-19T05:46:52.451323+0000","last_became_active":"2023-12-19T05:46:51.045030+0000","last_became_peered":"2023-12-19T05:46:51.045030+0000","last_unstale":"2023-12-19T05:46:52.451323+0000","last_undegraded":"2023-12-19T05:46:52.451323+0000","last_fullsized":"2023-12-19T05:46:52.451323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:29:13.077036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412780+0000","last_change":"2023-12-19T05:46:51.057339+0000","last_active":"2023-12-19T05:46:52.412780+0000","last_peered":"2023-12-19T05:46:52.412780+0000","last_clean":"2023-12-19T05:46:52.412780+0000","last_became_active":"2023-12-19T05:46:51.055883+0000","last_became_peered":"2023-12-19T05:46:51.055883+0000","last_unstale":"2023-12-19T05:46:52.412780+0000","last_undegraded":"2023-12-19T05:46:52.412780+0000","last_fullsized":"2023-12-19T05:46:52.412780+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:57.575936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454829+0000","last_change":"2023-12-19T05:46:51.057205+0000","last_active":"2023-12-19T05:46:52.454829+0000","last_peered":"2023-12-19T05:46:52.454829+0000","last_clean":"2023-12-19T05:46:52.454829+0000","last_became_active":"2023-12-19T05:46:51.055075+0000","last_became_peered":"2023-12-19T05:46:51.055075+0000","last_unstale":"2023-12-19T05:46:52.454829+0000","last_undegraded":"2023-12-19T05:46:52.454829+0000","last_fullsized":"2023-12-19T05:46:52.454829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:54:46.282806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029634+0000","last_change":"2023-12-19T05:46:51.053144+0000","last_active":"2023-12-19T05:46:52.029634+0000","last_peered":"2023-12-19T05:46:52.029634+0000","last_clean":"2023-12-19T05:46:52.029634+0000","last_became_active":"2023-12-19T05:46:51.052897+0000","last_became_peered":"2023-12-19T05:46:51.052897+0000","last_unstale":"2023-12-19T05:46:52.029634+0000","last_undegraded":"2023-12-19T05:46:52.029634+0000","last_fullsized":"2023-12-19T05:46:52.029634+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:46.839874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027794+0000","last_change":"2023-12-19T05:46:51.039124+0000","last_active":"2023-12-19T05:46:52.027794+0000","last_peered":"2023-12-19T05:46:52.027794+0000","last_clean":"2023-12-19T05:46:52.027794+0000","last_became_active":"2023-12-19T05:46:51.038736+0000","last_became_peered":"2023-12-19T05:46:51.038736+0000","last_unstale":"2023-12-19T05:46:52.027794+0000","last_undegraded":"2023-12-19T05:46:52.027794+0000","last_fullsized":"2023-12-19T05:46:52.027794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:12.848699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027521+0000","last_change":"2023-12-19T05:46:51.035607+0000","last_active":"2023-12-19T05:46:52.027521+0000","last_peered":"2023-12-19T05:46:52.027521+0000","last_clean":"2023-12-19T05:46:52.027521+0000","last_became_active":"2023-12-19T05:46:51.034315+0000","last_became_peered":"2023-12-19T05:46:51.034315+0000","last_unstale":"2023-12-19T05:46:52.027521+0000","last_undegraded":"2023-12-19T05:46:52.027521+0000","last_fullsized":"2023-12-19T05:46:52.027521+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:15.276915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452159+0000","last_change":"2023-12-19T05:46:51.059409+0000","last_active":"2023-12-19T05:46:52.452159+0000","last_peered":"2023-12-19T05:46:52.452159+0000","last_clean":"2023-12-19T05:46:52.452159+0000","last_became_active":"2023-12-19T05:46:51.059109+0000","last_became_peered":"2023-12-19T05:46:51.059109+0000","last_unstale":"2023-12-19T05:46:52.452159+0000","last_undegraded":"2023-12-19T05:46:52.452159+0000","last_fullsized":"2023-12-19T05:46:52.452159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:26.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453741+0000","last_change":"2023-12-19T05:46:51.054853+0000","last_active":"2023-12-19T05:46:52.453741+0000","last_peered":"2023-12-19T05:46:52.453741+0000","last_clean":"2023-12-19T05:46:52.453741+0000","last_became_active":"2023-12-19T05:46:51.052223+0000","last_became_peered":"2023-12-19T05:46:51.052223+0000","last_unstale":"2023-12-19T05:46:52.453741+0000","last_undegraded":"2023-12-19T05:46:52.453741+0000","last_fullsized":"2023-12-19T05:46:52.453741+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:23.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027709+0000","last_change":"2023-12-19T05:46:51.038895+0000","last_active":"2023-12-19T05:46:52.027709+0000","last_peered":"2023-12-19T05:46:52.027709+0000","last_clean":"2023-12-19T05:46:52.027709+0000","last_became_active":"2023-12-19T05:46:51.038665+0000","last_became_peered":"2023-12-19T05:46:51.038665+0000","last_unstale":"2023-12-19T05:46:52.027709+0000","last_undegraded":"2023-12-19T05:46:52.027709+0000","last_fullsized":"2023-12-19T05:46:52.027709+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:34:17.181485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453785+0000","last_change":"2023-12-19T05:46:51.051132+0000","last_active":"2023-12-19T05:46:52.453785+0000","last_peered":"2023-12-19T05:46:52.453785+0000","last_clean":"2023-12-19T05:46:52.453785+0000","last_became_active":"2023-12-19T05:46:51.050897+0000","last_became_peered":"2023-12-19T05:46:51.050897+0000","last_unstale":"2023-12-19T05:46:52.453785+0000","last_undegraded":"2023-12-19T05:46:52.453785+0000","last_fullsized":"2023-12-19T05:46:52.453785+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:33.168747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.040775+0000","last_change":"2023-12-19T05:46:51.040691+0000","last_active":"2023-12-19T05:46:51.040775+0000","last_peered":"2023-12-19T05:46:51.040775+0000","last_clean":"2023-12-19T05:46:51.040775+0000","last_became_active":"2023-12-19T05:46:51.039976+0000","last_became_peered":"2023-12-19T05:46:51.039976+0000","last_unstale":"2023-12-19T05:46:51.040775+0000","last_undegraded":"2023-12-19T05:46:51.040775+0000","last_fullsized":"2023-12-19T05:46:51.040775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:21.036765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029102+0000","last_change":"2023-12-19T05:46:51.041821+0000","last_active":"2023-12-19T05:46:52.029102+0000","last_peered":"2023-12-19T05:46:52.029102+0000","last_clean":"2023-12-19T05:46:52.029102+0000","last_became_active":"2023-12-19T05:46:51.041352+0000","last_became_peered":"2023-12-19T05:46:51.041352+0000","last_unstale":"2023-12-19T05:46:52.029102+0000","last_undegraded":"2023-12-19T05:46:52.029102+0000","last_fullsized":"2023-12-19T05:46:52.029102+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:10:37.382180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453968+0000","last_change":"2023-12-19T05:46:51.059364+0000","last_active":"2023-12-19T05:46:52.453968+0000","last_peered":"2023-12-19T05:46:52.453968+0000","last_clean":"2023-12-19T05:46:52.453968+0000","last_became_active":"2023-12-19T05:46:51.059077+0000","last_became_peered":"2023-12-19T05:46:51.059077+0000","last_unstale":"2023-12-19T05:46:52.453968+0000","last_undegraded":"2023-12-19T05:46:52.453968+0000","last_fullsized":"2023-12-19T05:46:52.453968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:01:24.051241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453215+0000","last_change":"2023-12-19T05:46:51.038916+0000","last_active":"2023-12-19T05:46:52.453215+0000","last_peered":"2023-12-19T05:46:52.453215+0000","last_clean":"2023-12-19T05:46:52.453215+0000","last_became_active":"2023-12-19T05:46:51.035125+0000","last_became_peered":"2023-12-19T05:46:51.035125+0000","last_unstale":"2023-12-19T05:46:52.453215+0000","last_undegraded":"2023-12-19T05:46:52.453215+0000","last_fullsized":"2023-12-19T05:46:52.453215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:48.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.450696+0000","last_change":"2023-12-19T05:46:51.041987+0000","last_active":"2023-12-19T05:46:52.450696+0000","last_peered":"2023-12-19T05:46:52.450696+0000","last_clean":"2023-12-19T05:46:52.450696+0000","last_became_active":"2023-12-19T05:46:51.040902+0000","last_became_peered":"2023-12-19T05:46:51.040902+0000","last_unstale":"2023-12-19T05:46:52.450696+0000","last_undegraded":"2023-12-19T05:46:52.450696+0000","last_fullsized":"2023-12-19T05:46:52.450696+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:07.884794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027700+0000","last_change":"2023-12-19T05:46:51.046467+0000","last_active":"2023-12-19T05:46:52.027700+0000","last_peered":"2023-12-19T05:46:52.027700+0000","last_clean":"2023-12-19T05:46:52.027700+0000","last_became_active":"2023-12-19T05:46:51.046246+0000","last_became_peered":"2023-12-19T05:46:51.046246+0000","last_unstale":"2023-12-19T05:46:52.027700+0000","last_undegraded":"2023-12-19T05:46:52.027700+0000","last_fullsized":"2023-12-19T05:46:52.027700+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:07.431107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.450885+0000","last_change":"2023-12-19T05:46:51.048997+0000","last_active":"2023-12-19T05:46:52.450885+0000","last_peered":"2023-12-19T05:46:52.450885+0000","last_clean":"2023-12-19T05:46:52.450885+0000","last_became_active":"2023-12-19T05:46:51.048743+0000","last_became_peered":"2023-12-19T05:46:51.048743+0000","last_unstale":"2023-12-19T05:46:52.450885+0000","last_undegraded":"2023-12-19T05:46:52.450885+0000","last_fullsized":"2023-12-19T05:46:52.450885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:56.490480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451652+0000","last_change":"2023-12-19T05:46:51.049297+0000","last_active":"2023-12-19T05:46:52.451652+0000","last_peered":"2023-12-19T05:46:52.451652+0000","last_clean":"2023-12-19T05:46:52.451652+0000","last_became_active":"2023-12-19T05:46:51.049029+0000","last_became_peered":"2023-12-19T05:46:51.049029+0000","last_unstale":"2023-12-19T05:46:52.451652+0000","last_undegraded":"2023-12-19T05:46:52.451652+0000","last_fullsized":"2023-12-19T05:46:52.451652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:33.852816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027856+0000","last_change":"2023-12-19T05:46:51.054190+0000","last_active":"2023-12-19T05:46:52.027856+0000","last_peered":"2023-12-19T05:46:52.027856+0000","last_clean":"2023-12-19T05:46:52.027856+0000","last_became_active":"2023-12-19T05:46:51.053970+0000","last_became_peered":"2023-12-19T05:46:51.053970+0000","last_unstale":"2023-12-19T05:46:52.027856+0000","last_undegraded":"2023-12-19T05:46:52.027856+0000","last_fullsized":"2023-12-19T05:46:52.027856+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:06.951988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029531+0000","last_change":"2023-12-19T05:46:51.042301+0000","last_active":"2023-12-19T05:46:52.029531+0000","last_peered":"2023-12-19T05:46:52.029531+0000","last_clean":"2023-12-19T05:46:52.029531+0000","last_became_active":"2023-12-19T05:46:51.037013+0000","last_became_peered":"2023-12-19T05:46:51.037013+0000","last_unstale":"2023-12-19T05:46:52.029531+0000","last_undegraded":"2023-12-19T05:46:52.029531+0000","last_fullsized":"2023-12-19T05:46:52.029531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:14.810265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029281+0000","last_change":"2023-12-19T05:46:51.037108+0000","last_active":"2023-12-19T05:46:52.029281+0000","last_peered":"2023-12-19T05:46:52.029281+0000","last_clean":"2023-12-19T05:46:52.029281+0000","last_became_active":"2023-12-19T05:46:51.036719+0000","last_became_peered":"2023-12-19T05:46:51.036719+0000","last_unstale":"2023-12-19T05:46:52.029281+0000","last_undegraded":"2023-12-19T05:46:52.029281+0000","last_fullsized":"2023-12-19T05:46:52.029281+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:03.721747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413031+0000","last_change":"2023-12-19T05:46:51.057192+0000","last_active":"2023-12-19T05:46:52.413031+0000","last_peered":"2023-12-19T05:46:52.413031+0000","last_clean":"2023-12-19T05:46:52.413031+0000","last_became_active":"2023-12-19T05:46:51.055531+0000","last_became_peered":"2023-12-19T05:46:51.055531+0000","last_unstale":"2023-12-19T05:46:52.413031+0000","last_undegraded":"2023-12-19T05:46:52.413031+0000","last_fullsized":"2023-12-19T05:46:52.413031+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:38.393960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027510+0000","last_change":"2023-12-19T05:46:51.035758+0000","last_active":"2023-12-19T05:46:52.027510+0000","last_peered":"2023-12-19T05:46:52.027510+0000","last_clean":"2023-12-19T05:46:52.027510+0000","last_became_active":"2023-12-19T05:46:51.035520+0000","last_became_peered":"2023-12-19T05:46:51.035520+0000","last_unstale":"2023-12-19T05:46:52.027510+0000","last_undegraded":"2023-12-19T05:46:52.027510+0000","last_fullsized":"2023-12-19T05:46:52.027510+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:06:39.075988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030303+0000","last_change":"2023-12-19T05:46:51.043810+0000","last_active":"2023-12-19T05:46:52.030303+0000","last_peered":"2023-12-19T05:46:52.030303+0000","last_clean":"2023-12-19T05:46:52.030303+0000","last_became_active":"2023-12-19T05:46:51.043427+0000","last_became_peered":"2023-12-19T05:46:51.043427+0000","last_unstale":"2023-12-19T05:46:52.030303+0000","last_undegraded":"2023-12-19T05:46:52.030303+0000","last_fullsized":"2023-12-19T05:46:52.030303+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:10.691769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413018+0000","last_change":"2023-12-19T05:46:51.058493+0000","last_active":"2023-12-19T05:46:52.413018+0000","last_peered":"2023-12-19T05:46:52.413018+0000","last_clean":"2023-12-19T05:46:52.413018+0000","last_became_active":"2023-12-19T05:46:51.057624+0000","last_became_peered":"2023-12-19T05:46:51.057624+0000","last_unstale":"2023-12-19T05:46:52.413018+0000","last_undegraded":"2023-12-19T05:46:52.413018+0000","last_fullsized":"2023-12-19T05:46:52.413018+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:14.810265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029495+0000","last_change":"2023-12-19T05:46:51.052856+0000","last_active":"2023-12-19T05:46:52.029495+0000","last_peered":"2023-12-19T05:46:52.029495+0000","last_clean":"2023-12-19T05:46:52.029495+0000","last_became_active":"2023-12-19T05:46:51.049633+0000","last_became_peered":"2023-12-19T05:46:51.049633+0000","last_unstale":"2023-12-19T05:46:52.029495+0000","last_undegraded":"2023-12-19T05:46:52.029495+0000","last_fullsized":"2023-12-19T05:46:52.029495+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:57.575936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029226+0000","last_change":"2023-12-19T05:46:51.041668+0000","last_active":"2023-12-19T05:46:52.029226+0000","last_peered":"2023-12-19T05:46:52.029226+0000","last_clean":"2023-12-19T05:46:52.029226+0000","last_became_active":"2023-12-19T05:46:51.041033+0000","last_became_peered":"2023-12-19T05:46:51.041033+0000","last_unstale":"2023-12-19T05:46:52.029226+0000","last_undegraded":"2023-12-19T05:46:52.029226+0000","last_fullsized":"2023-12-19T05:46:52.029226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:11:29.454524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027657+0000","last_change":"2023-12-19T05:46:51.038341+0000","last_active":"2023-12-19T05:46:52.027657+0000","last_peered":"2023-12-19T05:46:52.027657+0000","last_clean":"2023-12-19T05:46:52.027657+0000","last_became_active":"2023-12-19T05:46:51.038132+0000","last_became_peered":"2023-12-19T05:46:51.038132+0000","last_unstale":"2023-12-19T05:46:52.027657+0000","last_undegraded":"2023-12-19T05:46:52.027657+0000","last_fullsized":"2023-12-19T05:46:52.027657+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:54.665623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453494+0000","last_change":"2023-12-19T05:46:51.047630+0000","last_active":"2023-12-19T05:46:52.453494+0000","last_peered":"2023-12-19T05:46:52.453494+0000","last_clean":"2023-12-19T05:46:52.453494+0000","last_became_active":"2023-12-19T05:46:51.045311+0000","last_became_peered":"2023-12-19T05:46:51.045311+0000","last_unstale":"2023-12-19T05:46:52.453494+0000","last_undegraded":"2023-12-19T05:46:52.453494+0000","last_fullsized":"2023-12-19T05:46:52.453494+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:34.888971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454396+0000","last_change":"2023-12-19T05:46:51.039652+0000","last_active":"2023-12-19T05:46:52.454396+0000","last_peered":"2023-12-19T05:46:52.454396+0000","last_clean":"2023-12-19T05:46:52.454396+0000","last_became_active":"2023-12-19T05:46:51.038953+0000","last_became_peered":"2023-12-19T05:46:51.038953+0000","last_unstale":"2023-12-19T05:46:52.454396+0000","last_undegraded":"2023-12-19T05:46:52.454396+0000","last_fullsized":"2023-12-19T05:46:52.454396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:08.918098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452422+0000","last_change":"2023-12-19T05:46:51.058764+0000","last_active":"2023-12-19T05:46:52.452422+0000","last_peered":"2023-12-19T05:46:52.452422+0000","last_clean":"2023-12-19T05:46:52.452422+0000","last_became_active":"2023-12-19T05:46:51.058200+0000","last_became_peered":"2023-12-19T05:46:51.058200+0000","last_unstale":"2023-12-19T05:46:52.452422+0000","last_undegraded":"2023-12-19T05:46:52.452422+0000","last_fullsized":"2023-12-19T05:46:52.452422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:57.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029962+0000","last_change":"2023-12-19T05:46:50.527653+0000","last_active":"2023-12-19T05:46:52.029962+0000","last_peered":"2023-12-19T05:46:52.029962+0000","last_clean":"2023-12-19T05:46:52.029962+0000","last_became_active":"2023-12-19T05:46:50.527426+0000","last_became_peered":"2023-12-19T05:46:50.527426+0000","last_unstale":"2023-12-19T05:46:52.029962+0000","last_undegraded":"2023-12-19T05:46:52.029962+0000","last_fullsized":"2023-12-19T05:46:52.029962+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:07.903887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029485+0000","last_change":"2023-12-19T05:46:51.036959+0000","last_active":"2023-12-19T05:46:52.029485+0000","last_peered":"2023-12-19T05:46:52.029485+0000","last_clean":"2023-12-19T05:46:52.029485+0000","last_became_active":"2023-12-19T05:46:51.036425+0000","last_became_peered":"2023-12-19T05:46:51.036425+0000","last_unstale":"2023-12-19T05:46:52.029485+0000","last_undegraded":"2023-12-19T05:46:52.029485+0000","last_fullsized":"2023-12-19T05:46:52.029485+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:07.884794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.037517+0000","last_change":"2023-12-19T05:46:50.528741+0000","last_active":"2023-12-19T05:46:51.037517+0000","last_peered":"2023-12-19T05:46:51.037517+0000","last_clean":"2023-12-19T05:46:51.037517+0000","last_became_active":"2023-12-19T05:46:50.527578+0000","last_became_peered":"2023-12-19T05:46:50.527578+0000","last_unstale":"2023-12-19T05:46:51.037517+0000","last_undegraded":"2023-12-19T05:46:51.037517+0000","last_fullsized":"2023-12-19T05:46:51.037517+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:02.707536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029886+0000","last_change":"2023-12-19T05:46:51.052485+0000","last_active":"2023-12-19T05:46:52.029886+0000","last_peered":"2023-12-19T05:46:52.029886+0000","last_clean":"2023-12-19T05:46:52.029886+0000","last_became_active":"2023-12-19T05:46:51.052263+0000","last_became_peered":"2023-12-19T05:46:51.052263+0000","last_unstale":"2023-12-19T05:46:52.029886+0000","last_undegraded":"2023-12-19T05:46:52.029886+0000","last_fullsized":"2023-12-19T05:46:52.029886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:21:30.420094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413598+0000","last_change":"2023-12-19T05:46:50.542624+0000","last_active":"2023-12-19T05:46:52.413598+0000","last_peered":"2023-12-19T05:46:52.413598+0000","last_clean":"2023-12-19T05:46:52.413598+0000","last_became_active":"2023-12-19T05:46:50.541297+0000","last_became_peered":"2023-12-19T05:46:50.541297+0000","last_unstale":"2023-12-19T05:46:52.413598+0000","last_undegraded":"2023-12-19T05:46:52.413598+0000","last_fullsized":"2023-12-19T05:46:52.413598+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:16.773410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451835+0000","last_change":"2023-12-19T05:46:51.054573+0000","last_active":"2023-12-19T05:46:52.451835+0000","last_peered":"2023-12-19T05:46:52.451835+0000","last_clean":"2023-12-19T05:46:52.451835+0000","last_became_active":"2023-12-19T05:46:51.054342+0000","last_became_peered":"2023-12-19T05:46:51.054342+0000","last_unstale":"2023-12-19T05:46:52.451835+0000","last_undegraded":"2023-12-19T05:46:52.451835+0000","last_fullsized":"2023-12-19T05:46:52.451835+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:44.913703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413173+0000","last_change":"2023-12-19T05:46:50.539895+0000","last_active":"2023-12-19T05:46:52.413173+0000","last_peered":"2023-12-19T05:46:52.413173+0000","last_clean":"2023-12-19T05:46:52.413173+0000","last_became_active":"2023-12-19T05:46:50.539598+0000","last_became_peered":"2023-12-19T05:46:50.539598+0000","last_unstale":"2023-12-19T05:46:52.413173+0000","last_undegraded":"2023-12-19T05:46:52.413173+0000","last_fullsized":"2023-12-19T05:46:52.413173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:57.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412327+0000","last_change":"2023-12-19T05:46:51.056578+0000","last_active":"2023-12-19T05:46:52.412327+0000","last_peered":"2023-12-19T05:46:52.412327+0000","last_clean":"2023-12-19T05:46:52.412327+0000","last_became_active":"2023-12-19T05:46:51.056028+0000","last_became_peered":"2023-12-19T05:46:51.056028+0000","last_unstale":"2023-12-19T05:46:52.412327+0000","last_undegraded":"2023-12-19T05:46:52.412327+0000","last_fullsized":"2023-12-19T05:46:52.412327+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:09.647836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451387+0000","last_change":"2023-12-19T05:46:50.537353+0000","last_active":"2023-12-19T05:46:52.451387+0000","last_peered":"2023-12-19T05:46:52.451387+0000","last_clean":"2023-12-19T05:46:52.451387+0000","last_became_active":"2023-12-19T05:46:50.537097+0000","last_became_peered":"2023-12-19T05:46:50.537097+0000","last_unstale":"2023-12-19T05:46:52.451387+0000","last_undegraded":"2023-12-19T05:46:52.451387+0000","last_fullsized":"2023-12-19T05:46:52.451387+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:32.154536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028076+0000","last_change":"2023-12-19T05:46:51.029954+0000","last_active":"2023-12-19T05:46:52.028076+0000","last_peered":"2023-12-19T05:46:52.028076+0000","last_clean":"2023-12-19T05:46:52.028076+0000","last_became_active":"2023-12-19T05:46:51.029631+0000","last_became_peered":"2023-12-19T05:46:51.029631+0000","last_unstale":"2023-12-19T05:46:52.028076+0000","last_undegraded":"2023-12-19T05:46:52.028076+0000","last_fullsized":"2023-12-19T05:46:52.028076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:30:16.980537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452906+0000","last_change":"2023-12-19T05:46:50.541043+0000","last_active":"2023-12-19T05:46:52.452906+0000","last_peered":"2023-12-19T05:46:52.452906+0000","last_clean":"2023-12-19T05:46:52.452906+0000","last_became_active":"2023-12-19T05:46:50.540430+0000","last_became_peered":"2023-12-19T05:46:50.540430+0000","last_unstale":"2023-12-19T05:46:52.452906+0000","last_undegraded":"2023-12-19T05:46:52.452906+0000","last_fullsized":"2023-12-19T05:46:52.452906+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:20.022554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453987+0000","last_change":"2023-12-19T05:46:51.056697+0000","last_active":"2023-12-19T05:46:52.453987+0000","last_peered":"2023-12-19T05:46:52.453987+0000","last_clean":"2023-12-19T05:46:52.453987+0000","last_became_active":"2023-12-19T05:46:51.052606+0000","last_became_peered":"2023-12-19T05:46:51.052606+0000","last_unstale":"2023-12-19T05:46:52.453987+0000","last_undegraded":"2023-12-19T05:46:52.453987+0000","last_fullsized":"2023-12-19T05:46:52.453987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:04:24.036364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028765+0000","last_change":"2023-12-19T05:46:50.530309+0000","last_active":"2023-12-19T05:46:52.028765+0000","last_peered":"2023-12-19T05:46:52.028765+0000","last_clean":"2023-12-19T05:46:52.028765+0000","last_became_active":"2023-12-19T05:46:50.530007+0000","last_became_peered":"2023-12-19T05:46:50.530007+0000","last_unstale":"2023-12-19T05:46:52.028765+0000","last_undegraded":"2023-12-19T05:46:52.028765+0000","last_fullsized":"2023-12-19T05:46:52.028765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:05.013117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028488+0000","last_change":"2023-12-19T05:46:51.037500+0000","last_active":"2023-12-19T05:46:52.028488+0000","last_peered":"2023-12-19T05:46:52.028488+0000","last_clean":"2023-12-19T05:46:52.028488+0000","last_became_active":"2023-12-19T05:46:51.037282+0000","last_became_peered":"2023-12-19T05:46:51.037282+0000","last_unstale":"2023-12-19T05:46:52.028488+0000","last_undegraded":"2023-12-19T05:46:52.028488+0000","last_fullsized":"2023-12-19T05:46:52.028488+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:41.558173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454668+0000","last_change":"2023-12-19T05:46:50.532369+0000","last_active":"2023-12-19T05:46:52.454668+0000","last_peered":"2023-12-19T05:46:52.454668+0000","last_clean":"2023-12-19T05:46:52.454668+0000","last_became_active":"2023-12-19T05:46:50.531685+0000","last_became_peered":"2023-12-19T05:46:50.531685+0000","last_unstale":"2023-12-19T05:46:52.454668+0000","last_undegraded":"2023-12-19T05:46:52.454668+0000","last_fullsized":"2023-12-19T05:46:52.454668+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:39:11.053511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.046432+0000","last_change":"2023-12-19T05:46:51.045704+0000","last_active":"2023-12-19T05:46:51.046432+0000","last_peered":"2023-12-19T05:46:51.046432+0000","last_clean":"2023-12-19T05:46:51.046432+0000","last_became_active":"2023-12-19T05:46:51.045445+0000","last_became_peered":"2023-12-19T05:46:51.045445+0000","last_unstale":"2023-12-19T05:46:51.046432+0000","last_undegraded":"2023-12-19T05:46:51.046432+0000","last_fullsized":"2023-12-19T05:46:51.046432+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:52:16.081609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413656+0000","last_change":"2023-12-19T05:46:50.537765+0000","last_active":"2023-12-19T05:46:52.413656+0000","last_peered":"2023-12-19T05:46:52.413656+0000","last_clean":"2023-12-19T05:46:52.413656+0000","last_became_active":"2023-12-19T05:46:50.536506+0000","last_became_peered":"2023-12-19T05:46:50.536506+0000","last_unstale":"2023-12-19T05:46:52.413656+0000","last_undegraded":"2023-12-19T05:46:52.413656+0000","last_fullsized":"2023-12-19T05:46:52.413656+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:34:31.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.044897+0000","last_change":"2023-12-19T05:46:51.044520+0000","last_active":"2023-12-19T05:46:51.044897+0000","last_peered":"2023-12-19T05:46:51.044897+0000","last_clean":"2023-12-19T05:46:51.044897+0000","last_became_active":"2023-12-19T05:46:51.043754+0000","last_became_peered":"2023-12-19T05:46:51.043754+0000","last_unstale":"2023-12-19T05:46:51.044897+0000","last_undegraded":"2023-12-19T05:46:51.044897+0000","last_fullsized":"2023-12-19T05:46:51.044897+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:50.444220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454632+0000","last_change":"2023-12-19T05:46:50.531048+0000","last_active":"2023-12-19T05:46:52.454632+0000","last_peered":"2023-12-19T05:46:52.454632+0000","last_clean":"2023-12-19T05:46:52.454632+0000","last_became_active":"2023-12-19T05:46:50.529319+0000","last_became_peered":"2023-12-19T05:46:50.529319+0000","last_unstale":"2023-12-19T05:46:52.454632+0000","last_undegraded":"2023-12-19T05:46:52.454632+0000","last_fullsized":"2023-12-19T05:46:52.454632+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:18:59.150757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029489+0000","last_change":"2023-12-19T05:46:51.037003+0000","last_active":"2023-12-19T05:46:52.029489+0000","last_peered":"2023-12-19T05:46:52.029489+0000","last_clean":"2023-12-19T05:46:52.029489+0000","last_became_active":"2023-12-19T05:46:51.036293+0000","last_became_peered":"2023-12-19T05:46:51.036293+0000","last_unstale":"2023-12-19T05:46:52.029489+0000","last_undegraded":"2023-12-19T05:46:52.029489+0000","last_fullsized":"2023-12-19T05:46:52.029489+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:20:35.853753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452681+0000","last_change":"2023-12-19T05:46:50.538937+0000","last_active":"2023-12-19T05:46:52.452681+0000","last_peered":"2023-12-19T05:46:52.452681+0000","last_clean":"2023-12-19T05:46:52.452681+0000","last_became_active":"2023-12-19T05:46:50.538661+0000","last_became_peered":"2023-12-19T05:46:50.538661+0000","last_unstale":"2023-12-19T05:46:52.452681+0000","last_undegraded":"2023-12-19T05:46:52.452681+0000","last_fullsized":"2023-12-19T05:46:52.452681+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:32:12.454873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027854+0000","last_change":"2023-12-19T05:46:51.043161+0000","last_active":"2023-12-19T05:46:52.027854+0000","last_peered":"2023-12-19T05:46:52.027854+0000","last_clean":"2023-12-19T05:46:52.027854+0000","last_became_active":"2023-12-19T05:46:51.042942+0000","last_became_peered":"2023-12-19T05:46:51.042942+0000","last_unstale":"2023-12-19T05:46:52.027854+0000","last_undegraded":"2023-12-19T05:46:52.027854+0000","last_fullsized":"2023-12-19T05:46:52.027854+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:50:41.034934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413467+0000","last_change":"2023-12-19T05:46:50.543008+0000","last_active":"2023-12-19T05:46:52.413467+0000","last_peered":"2023-12-19T05:46:52.413467+0000","last_clean":"2023-12-19T05:46:52.413467+0000","last_became_active":"2023-12-19T05:46:50.542467+0000","last_became_peered":"2023-12-19T05:46:50.542467+0000","last_unstale":"2023-12-19T05:46:52.413467+0000","last_undegraded":"2023-12-19T05:46:52.413467+0000","last_fullsized":"2023-12-19T05:46:52.413467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:03.192720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453434+0000","last_change":"2023-12-19T05:46:51.040162+0000","last_active":"2023-12-19T05:46:52.453434+0000","last_peered":"2023-12-19T05:46:52.453434+0000","last_clean":"2023-12-19T05:46:52.453434+0000","last_became_active":"2023-12-19T05:46:51.035909+0000","last_became_peered":"2023-12-19T05:46:51.035909+0000","last_unstale":"2023-12-19T05:46:52.453434+0000","last_undegraded":"2023-12-19T05:46:52.453434+0000","last_fullsized":"2023-12-19T05:46:52.453434+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:39:57.235860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454947+0000","last_change":"2023-12-19T05:46:50.531259+0000","last_active":"2023-12-19T05:46:52.454947+0000","last_peered":"2023-12-19T05:46:52.454947+0000","last_clean":"2023-12-19T05:46:52.454947+0000","last_became_active":"2023-12-19T05:46:50.527292+0000","last_became_peered":"2023-12-19T05:46:50.527292+0000","last_unstale":"2023-12-19T05:46:52.454947+0000","last_undegraded":"2023-12-19T05:46:52.454947+0000","last_fullsized":"2023-12-19T05:46:52.454947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:54:27.378457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413321+0000","last_change":"2023-12-19T05:46:51.048355+0000","last_active":"2023-12-19T05:46:52.413321+0000","last_peered":"2023-12-19T05:46:52.413321+0000","last_clean":"2023-12-19T05:46:52.413321+0000","last_became_active":"2023-12-19T05:46:51.047813+0000","last_became_peered":"2023-12-19T05:46:51.047813+0000","last_unstale":"2023-12-19T05:46:52.413321+0000","last_undegraded":"2023-12-19T05:46:52.413321+0000","last_fullsized":"2023-12-19T05:46:52.413321+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:46.839874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451320+0000","last_change":"2023-12-19T05:46:50.540942+0000","last_active":"2023-12-19T05:46:52.451320+0000","last_peered":"2023-12-19T05:46:52.451320+0000","last_clean":"2023-12-19T05:46:52.451320+0000","last_became_active":"2023-12-19T05:46:50.540600+0000","last_became_peered":"2023-12-19T05:46:50.540600+0000","last_unstale":"2023-12-19T05:46:52.451320+0000","last_undegraded":"2023-12-19T05:46:52.451320+0000","last_fullsized":"2023-12-19T05:46:52.451320+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:54:45.268595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413278+0000","last_change":"2023-12-19T05:46:51.058225+0000","last_active":"2023-12-19T05:46:52.413278+0000","last_peered":"2023-12-19T05:46:52.413278+0000","last_clean":"2023-12-19T05:46:52.413278+0000","last_became_active":"2023-12-19T05:46:51.057256+0000","last_became_peered":"2023-12-19T05:46:51.057256+0000","last_unstale":"2023-12-19T05:46:52.413278+0000","last_undegraded":"2023-12-19T05:46:52.413278+0000","last_fullsized":"2023-12-19T05:46:52.413278+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:57.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"142'8","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453203+0000","last_change":"2023-12-19T05:46:50.540888+0000","last_active":"2023-12-19T05:46:52.453203+0000","last_peered":"2023-12-19T05:46:52.453203+0000","last_clean":"2023-12-19T05:46:52.453203+0000","last_became_active":"2023-12-19T05:46:50.540169+0000","last_became_peered":"2023-12-19T05:46:50.540169+0000","last_unstale":"2023-12-19T05:46:52.453203+0000","last_undegraded":"2023-12-19T05:46:52.453203+0000","last_fullsized":"2023-12-19T05:46:52.453203+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:49.430010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454227+0000","last_change":"2023-12-19T05:46:51.050236+0000","last_active":"2023-12-19T05:46:52.454227+0000","last_peered":"2023-12-19T05:46:52.454227+0000","last_clean":"2023-12-19T05:46:52.454227+0000","last_became_active":"2023-12-19T05:46:51.049995+0000","last_became_peered":"2023-12-19T05:46:51.049995+0000","last_unstale":"2023-12-19T05:46:52.454227+0000","last_undegraded":"2023-12-19T05:46:52.454227+0000","last_fullsized":"2023-12-19T05:46:52.454227+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:14.840396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029807+0000","last_change":"2023-12-19T05:46:50.531621+0000","last_active":"2023-12-19T05:46:52.029807+0000","last_peered":"2023-12-19T05:46:52.029807+0000","last_clean":"2023-12-19T05:46:52.029807+0000","last_became_active":"2023-12-19T05:46:50.531204+0000","last_became_peered":"2023-12-19T05:46:50.531204+0000","last_unstale":"2023-12-19T05:46:52.029807+0000","last_undegraded":"2023-12-19T05:46:52.029807+0000","last_fullsized":"2023-12-19T05:46:52.029807+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:03.192720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452708+0000","last_change":"2023-12-19T05:46:51.058482+0000","last_active":"2023-12-19T05:46:52.452708+0000","last_peered":"2023-12-19T05:46:52.452708+0000","last_clean":"2023-12-19T05:46:52.452708+0000","last_became_active":"2023-12-19T05:46:51.057873+0000","last_became_peered":"2023-12-19T05:46:51.057873+0000","last_unstale":"2023-12-19T05:46:52.452708+0000","last_undegraded":"2023-12-19T05:46:52.452708+0000","last_fullsized":"2023-12-19T05:46:52.452708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:48:18.466951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.455071+0000","last_change":"2023-12-19T05:46:50.532126+0000","last_active":"2023-12-19T05:46:52.455071+0000","last_peered":"2023-12-19T05:46:52.455071+0000","last_clean":"2023-12-19T05:46:52.455071+0000","last_became_active":"2023-12-19T05:46:50.529669+0000","last_became_peered":"2023-12-19T05:46:50.529669+0000","last_unstale":"2023-12-19T05:46:52.455071+0000","last_undegraded":"2023-12-19T05:46:52.455071+0000","last_fullsized":"2023-12-19T05:46:52.455071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:40.128513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028325+0000","last_change":"2023-12-19T05:46:51.045350+0000","last_active":"2023-12-19T05:46:52.028325+0000","last_peered":"2023-12-19T05:46:52.028325+0000","last_clean":"2023-12-19T05:46:52.028325+0000","last_became_active":"2023-12-19T05:46:51.045081+0000","last_became_peered":"2023-12-19T05:46:51.045081+0000","last_unstale":"2023-12-19T05:46:52.028325+0000","last_undegraded":"2023-12-19T05:46:52.028325+0000","last_fullsized":"2023-12-19T05:46:52.028325+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:37:31.797992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030085+0000","last_change":"2023-12-19T05:46:50.538404+0000","last_active":"2023-12-19T05:46:52.030085+0000","last_peered":"2023-12-19T05:46:52.030085+0000","last_clean":"2023-12-19T05:46:52.030085+0000","last_became_active":"2023-12-19T05:46:50.538118+0000","last_became_peered":"2023-12-19T05:46:50.538118+0000","last_unstale":"2023-12-19T05:46:52.030085+0000","last_undegraded":"2023-12-19T05:46:52.030085+0000","last_fullsized":"2023-12-19T05:46:52.030085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:39:56.221650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029735+0000","last_change":"2023-12-19T05:46:51.042994+0000","last_active":"2023-12-19T05:46:52.029735+0000","last_peered":"2023-12-19T05:46:52.029735+0000","last_clean":"2023-12-19T05:46:52.029735+0000","last_became_active":"2023-12-19T05:46:51.042603+0000","last_became_peered":"2023-12-19T05:46:51.042603+0000","last_unstale":"2023-12-19T05:46:52.029735+0000","last_undegraded":"2023-12-19T05:46:52.029735+0000","last_fullsized":"2023-12-19T05:46:52.029735+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:27.690050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030228+0000","last_change":"2023-12-19T05:46:50.542415+0000","last_active":"2023-12-19T05:46:52.030228+0000","last_peered":"2023-12-19T05:46:52.030228+0000","last_clean":"2023-12-19T05:46:52.030228+0000","last_became_active":"2023-12-19T05:46:50.541901+0000","last_became_peered":"2023-12-19T05:46:50.541901+0000","last_unstale":"2023-12-19T05:46:52.030228+0000","last_undegraded":"2023-12-19T05:46:52.030228+0000","last_fullsized":"2023-12-19T05:46:52.030228+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:32.154536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451387+0000","last_change":"2023-12-19T05:46:51.045052+0000","last_active":"2023-12-19T05:46:52.451387+0000","last_peered":"2023-12-19T05:46:52.451387+0000","last_clean":"2023-12-19T05:46:52.451387+0000","last_became_active":"2023-12-19T05:46:51.044815+0000","last_became_peered":"2023-12-19T05:46:51.044815+0000","last_unstale":"2023-12-19T05:46:52.451387+0000","last_undegraded":"2023-12-19T05:46:52.451387+0000","last_fullsized":"2023-12-19T05:46:52.451387+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:55.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452920+0000","last_change":"2023-12-19T05:46:50.526702+0000","last_active":"2023-12-19T05:46:52.452920+0000","last_peered":"2023-12-19T05:46:52.452920+0000","last_clean":"2023-12-19T05:46:52.452920+0000","last_became_active":"2023-12-19T05:46:50.525795+0000","last_became_peered":"2023-12-19T05:46:50.525795+0000","last_unstale":"2023-12-19T05:46:52.452920+0000","last_undegraded":"2023-12-19T05:46:52.452920+0000","last_fullsized":"2023-12-19T05:46:52.452920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:52.676866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453080+0000","last_change":"2023-12-19T05:46:51.046726+0000","last_active":"2023-12-19T05:46:52.453080+0000","last_peered":"2023-12-19T05:46:52.453080+0000","last_clean":"2023-12-19T05:46:52.453080+0000","last_became_active":"2023-12-19T05:46:51.046304+0000","last_became_peered":"2023-12-19T05:46:51.046304+0000","last_unstale":"2023-12-19T05:46:52.453080+0000","last_undegraded":"2023-12-19T05:46:52.453080+0000","last_fullsized":"2023-12-19T05:46:52.453080+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:49.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452926+0000","last_change":"2023-12-19T05:46:50.543531+0000","last_active":"2023-12-19T05:46:52.452926+0000","last_peered":"2023-12-19T05:46:52.452926+0000","last_clean":"2023-12-19T05:46:52.452926+0000","last_became_active":"2023-12-19T05:46:50.543291+0000","last_became_peered":"2023-12-19T05:46:50.543291+0000","last_unstale":"2023-12-19T05:46:52.452926+0000","last_undegraded":"2023-12-19T05:46:52.452926+0000","last_fullsized":"2023-12-19T05:46:52.452926+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:52:15.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029871+0000","last_change":"2023-12-19T05:46:51.045227+0000","last_active":"2023-12-19T05:46:52.029871+0000","last_peered":"2023-12-19T05:46:52.029871+0000","last_clean":"2023-12-19T05:46:52.029871+0000","last_became_active":"2023-12-19T05:46:51.045005+0000","last_became_peered":"2023-12-19T05:46:51.045005+0000","last_unstale":"2023-12-19T05:46:52.029871+0000","last_undegraded":"2023-12-19T05:46:52.029871+0000","last_fullsized":"2023-12-19T05:46:52.029871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:23.342150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413790+0000","last_change":"2023-12-19T05:46:50.542416+0000","last_active":"2023-12-19T05:46:52.413790+0000","last_peered":"2023-12-19T05:46:52.413790+0000","last_clean":"2023-12-19T05:46:52.413790+0000","last_became_active":"2023-12-19T05:46:50.540733+0000","last_became_peered":"2023-12-19T05:46:50.540733+0000","last_unstale":"2023-12-19T05:46:52.413790+0000","last_undegraded":"2023-12-19T05:46:52.413790+0000","last_fullsized":"2023-12-19T05:46:52.413790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:52:04.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454259+0000","last_change":"2023-12-19T05:46:51.056867+0000","last_active":"2023-12-19T05:46:52.454259+0000","last_peered":"2023-12-19T05:46:52.454259+0000","last_clean":"2023-12-19T05:46:52.454259+0000","last_became_active":"2023-12-19T05:46:51.053356+0000","last_became_peered":"2023-12-19T05:46:51.053356+0000","last_unstale":"2023-12-19T05:46:52.454259+0000","last_undegraded":"2023-12-19T05:46:52.454259+0000","last_fullsized":"2023-12-19T05:46:52.454259+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:40:54.139887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413413+0000","last_change":"2023-12-19T05:46:50.537986+0000","last_active":"2023-12-19T05:46:52.413413+0000","last_peered":"2023-12-19T05:46:52.413413+0000","last_clean":"2023-12-19T05:46:52.413413+0000","last_became_active":"2023-12-19T05:46:50.537244+0000","last_became_peered":"2023-12-19T05:46:50.537244+0000","last_unstale":"2023-12-19T05:46:52.413413+0000","last_undegraded":"2023-12-19T05:46:52.413413+0000","last_fullsized":"2023-12-19T05:46:52.413413+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:36.374064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029729+0000","last_change":"2023-12-19T05:46:51.050159+0000","last_active":"2023-12-19T05:46:52.029729+0000","last_peered":"2023-12-19T05:46:52.029729+0000","last_clean":"2023-12-19T05:46:52.029729+0000","last_became_active":"2023-12-19T05:46:51.049944+0000","last_became_peered":"2023-12-19T05:46:51.049944+0000","last_unstale":"2023-12-19T05:46:52.029729+0000","last_undegraded":"2023-12-19T05:46:52.029729+0000","last_fullsized":"2023-12-19T05:46:52.029729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:18:14.081668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413709+0000","last_change":"2023-12-19T05:46:50.540380+0000","last_active":"2023-12-19T05:46:52.413709+0000","last_peered":"2023-12-19T05:46:52.413709+0000","last_clean":"2023-12-19T05:46:52.413709+0000","last_became_active":"2023-12-19T05:46:50.540038+0000","last_became_peered":"2023-12-19T05:46:50.540038+0000","last_unstale":"2023-12-19T05:46:52.413709+0000","last_undegraded":"2023-12-19T05:46:52.413709+0000","last_fullsized":"2023-12-19T05:46:52.413709+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:40.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029837+0000","last_change":"2023-12-19T05:46:51.048128+0000","last_active":"2023-12-19T05:46:52.029837+0000","last_peered":"2023-12-19T05:46:52.029837+0000","last_clean":"2023-12-19T05:46:52.029837+0000","last_became_active":"2023-12-19T05:46:51.045622+0000","last_became_peered":"2023-12-19T05:46:51.045622+0000","last_unstale":"2023-12-19T05:46:52.029837+0000","last_undegraded":"2023-12-19T05:46:52.029837+0000","last_fullsized":"2023-12-19T05:46:52.029837+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:09.647836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028063+0000","last_change":"2023-12-19T05:46:50.529676+0000","last_active":"2023-12-19T05:46:52.028063+0000","last_peered":"2023-12-19T05:46:52.028063+0000","last_clean":"2023-12-19T05:46:52.028063+0000","last_became_active":"2023-12-19T05:46:50.529448+0000","last_became_peered":"2023-12-19T05:46:50.529448+0000","last_unstale":"2023-12-19T05:46:52.028063+0000","last_undegraded":"2023-12-19T05:46:52.028063+0000","last_fullsized":"2023-12-19T05:46:52.028063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:51.801576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454465+0000","last_change":"2023-12-19T05:46:51.055781+0000","last_active":"2023-12-19T05:46:52.454465+0000","last_peered":"2023-12-19T05:46:52.454465+0000","last_clean":"2023-12-19T05:46:52.454465+0000","last_became_active":"2023-12-19T05:46:51.055414+0000","last_became_peered":"2023-12-19T05:46:51.055414+0000","last_unstale":"2023-12-19T05:46:52.454465+0000","last_undegraded":"2023-12-19T05:46:52.454465+0000","last_fullsized":"2023-12-19T05:46:52.454465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:15.503012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413700+0000","last_change":"2023-12-19T05:46:50.542768+0000","last_active":"2023-12-19T05:46:52.413700+0000","last_peered":"2023-12-19T05:46:52.413700+0000","last_clean":"2023-12-19T05:46:52.413700+0000","last_became_active":"2023-12-19T05:46:50.539600+0000","last_became_peered":"2023-12-19T05:46:50.539600+0000","last_unstale":"2023-12-19T05:46:52.413700+0000","last_undegraded":"2023-12-19T05:46:52.413700+0000","last_fullsized":"2023-12-19T05:46:52.413700+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:01.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029338+0000","last_change":"2023-12-19T05:46:51.057059+0000","last_active":"2023-12-19T05:46:52.029338+0000","last_peered":"2023-12-19T05:46:52.029338+0000","last_clean":"2023-12-19T05:46:52.029338+0000","last_became_active":"2023-12-19T05:46:51.056764+0000","last_became_peered":"2023-12-19T05:46:51.056764+0000","last_unstale":"2023-12-19T05:46:52.029338+0000","last_undegraded":"2023-12-19T05:46:52.029338+0000","last_fullsized":"2023-12-19T05:46:52.029338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:29:58.220005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413895+0000","last_change":"2023-12-19T05:46:50.541528+0000","last_active":"2023-12-19T05:46:52.413895+0000","last_peered":"2023-12-19T05:46:52.413895+0000","last_clean":"2023-12-19T05:46:52.413895+0000","last_became_active":"2023-12-19T05:46:50.539567+0000","last_became_peered":"2023-12-19T05:46:50.539567+0000","last_unstale":"2023-12-19T05:46:52.413895+0000","last_undegraded":"2023-12-19T05:46:52.413895+0000","last_fullsized":"2023-12-19T05:46:52.413895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:48.560691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451196+0000","last_change":"2023-12-19T05:46:51.057390+0000","last_active":"2023-12-19T05:46:52.451196+0000","last_peered":"2023-12-19T05:46:52.451196+0000","last_clean":"2023-12-19T05:46:52.451196+0000","last_became_active":"2023-12-19T05:46:51.057249+0000","last_became_peered":"2023-12-19T05:46:51.057249+0000","last_unstale":"2023-12-19T05:46:52.451196+0000","last_undegraded":"2023-12-19T05:46:52.451196+0000","last_fullsized":"2023-12-19T05:46:52.451196+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:03.721747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028160+0000","last_change":"2023-12-19T05:46:50.530709+0000","last_active":"2023-12-19T05:46:52.028160+0000","last_peered":"2023-12-19T05:46:52.028160+0000","last_clean":"2023-12-19T05:46:52.028160+0000","last_became_active":"2023-12-19T05:46:50.527762+0000","last_became_peered":"2023-12-19T05:46:50.527762+0000","last_unstale":"2023-12-19T05:46:52.028160+0000","last_undegraded":"2023-12-19T05:46:52.028160+0000","last_fullsized":"2023-12-19T05:46:52.028160+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:40.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029991+0000","last_change":"2023-12-19T05:46:51.052772+0000","last_active":"2023-12-19T05:46:52.029991+0000","last_peered":"2023-12-19T05:46:52.029991+0000","last_clean":"2023-12-19T05:46:52.029991+0000","last_became_active":"2023-12-19T05:46:51.052605+0000","last_became_peered":"2023-12-19T05:46:51.052605+0000","last_unstale":"2023-12-19T05:46:52.029991+0000","last_undegraded":"2023-12-19T05:46:52.029991+0000","last_fullsized":"2023-12-19T05:46:52.029991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:33.852816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030456+0000","last_change":"2023-12-19T05:46:50.538962+0000","last_active":"2023-12-19T05:46:52.030456+0000","last_peered":"2023-12-19T05:46:52.030456+0000","last_clean":"2023-12-19T05:46:52.030456+0000","last_became_active":"2023-12-19T05:46:50.538647+0000","last_became_peered":"2023-12-19T05:46:50.538647+0000","last_unstale":"2023-12-19T05:46:52.030456+0000","last_undegraded":"2023-12-19T05:46:52.030456+0000","last_fullsized":"2023-12-19T05:46:52.030456+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:47.415206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029464+0000","last_change":"2023-12-19T05:46:51.037081+0000","last_active":"2023-12-19T05:46:52.029464+0000","last_peered":"2023-12-19T05:46:52.029464+0000","last_clean":"2023-12-19T05:46:52.029464+0000","last_became_active":"2023-12-19T05:46:51.036845+0000","last_became_peered":"2023-12-19T05:46:51.036845+0000","last_unstale":"2023-12-19T05:46:52.029464+0000","last_undegraded":"2023-12-19T05:46:52.029464+0000","last_fullsized":"2023-12-19T05:46:52.029464+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:55.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453312+0000","last_change":"2023-12-19T05:46:50.540712+0000","last_active":"2023-12-19T05:46:52.453312+0000","last_peered":"2023-12-19T05:46:52.453312+0000","last_clean":"2023-12-19T05:46:52.453312+0000","last_became_active":"2023-12-19T05:46:50.539906+0000","last_became_peered":"2023-12-19T05:46:50.539906+0000","last_unstale":"2023-12-19T05:46:52.453312+0000","last_undegraded":"2023-12-19T05:46:52.453312+0000","last_fullsized":"2023-12-19T05:46:52.453312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:29:57.205794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029808+0000","last_change":"2023-12-19T05:46:51.049860+0000","last_active":"2023-12-19T05:46:52.029808+0000","last_peered":"2023-12-19T05:46:52.029808+0000","last_clean":"2023-12-19T05:46:52.029808+0000","last_became_active":"2023-12-19T05:46:51.049274+0000","last_became_peered":"2023-12-19T05:46:51.049274+0000","last_unstale":"2023-12-19T05:46:52.029808+0000","last_undegraded":"2023-12-19T05:46:52.029808+0000","last_fullsized":"2023-12-19T05:46:52.029808+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:38.393960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030035+0000","last_change":"2023-12-19T05:46:50.531445+0000","last_active":"2023-12-19T05:46:52.030035+0000","last_peered":"2023-12-19T05:46:52.030035+0000","last_clean":"2023-12-19T05:46:52.030035+0000","last_became_active":"2023-12-19T05:46:50.530922+0000","last_became_peered":"2023-12-19T05:46:50.530922+0000","last_unstale":"2023-12-19T05:46:52.030035+0000","last_undegraded":"2023-12-19T05:46:52.030035+0000","last_fullsized":"2023-12-19T05:46:52.030035+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:52:04.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412829+0000","last_change":"2023-12-19T05:46:51.050370+0000","last_active":"2023-12-19T05:46:52.412829+0000","last_peered":"2023-12-19T05:46:52.412829+0000","last_clean":"2023-12-19T05:46:52.412829+0000","last_became_active":"2023-12-19T05:46:51.046750+0000","last_became_peered":"2023-12-19T05:46:51.046750+0000","last_unstale":"2023-12-19T05:46:52.412829+0000","last_undegraded":"2023-12-19T05:46:52.412829+0000","last_fullsized":"2023-12-19T05:46:52.412829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:10.691769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.032613+0000","last_change":"2023-12-19T05:46:50.541076+0000","last_active":"2023-12-19T05:46:51.032613+0000","last_peered":"2023-12-19T05:46:51.032613+0000","last_clean":"2023-12-19T05:46:51.032613+0000","last_became_active":"2023-12-19T05:46:50.540721+0000","last_became_peered":"2023-12-19T05:46:50.540721+0000","last_unstale":"2023-12-19T05:46:51.032613+0000","last_undegraded":"2023-12-19T05:46:51.032613+0000","last_fullsized":"2023-12-19T05:46:51.032613+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:32.838606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":277,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.040401+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:46:51.040401+0000","last_peered":"2023-12-19T05:46:51.040401+0000","last_clean":"2023-12-19T05:46:51.040401+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:46:51.040401+0000","last_undegraded":"2023-12-19T05:46:51.040401+0000","last_fullsized":"2023-12-19T05:46:51.040401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.1739999999999999,"15min":1.0669999999999999},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":6.4429999999999996,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1639999999999999,"15min":1.0800000000000001},"min":{"1min":0.79000000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6259999999999999,"5min":3.976,"15min":3.976},"last":1.4119999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.218,"15min":1.1040000000000001},"min":{"1min":0.73199999999999998,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.83999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1720000000000002,"5min":4.25,"15min":4.25},"last":1.1459999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.738,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.3640000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.349,"15min":1.1990000000000001},"min":{"1min":1.0129999999999999,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.4139999999999999,"15min":1.335},"min":{"1min":1.0249999999999999,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":2.327,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.298}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.171,"15min":1.0680000000000001},"min":{"1min":0.85599999999999998,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.653,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.3480000000000001,"15min":1.274},"min":{"1min":0.81699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.2290000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3740000000000001,"15min":1.3280000000000001},"min":{"1min":0.75900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.952,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3220000000000001,"15min":1.25},"min":{"1min":0.77800000000000002,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":2.0550000000000002,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.46}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4730000000000001,"15min":1.357},"min":{"1min":0.89800000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.121,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.569},{"interface":"front","average":{"1min":1.78,"5min":1.569,"15min":1.4279999999999999},"min":{"1min":1.1579999999999999,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":6.3369999999999997,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.77}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.02,"15min":1.1910000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4850000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":1.496},{"interface":"front","average":{"1min":1.004,"5min":1.054,"15min":1.034},"min":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.46500000000000002},"max":{"1min":1.3959999999999999,"5min":1.635,"15min":1.635},"last":1.216}]},{"osd":1,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1930000000000001,"15min":1.1539999999999999},"min":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.704,"5min":1.792,"15min":1.792},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.202,"15min":1.294},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6339999999999999,"5min":1.8120000000000001,"15min":3.4670000000000001},"last":1.625}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1339999999999999,"15min":1.1779999999999999},"min":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4350000000000001,"5min":1.823,"15min":2},"last":1},{"interface":"front","average":{"1min":1.165,"5min":1.1899999999999999,"15min":1.284},"min":{"1min":0.74399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.583,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.2709999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.153,"15min":1.3180000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70799999999999996},"max":{"1min":1.534,"5min":1.7050000000000001,"15min":4.5220000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2549999999999999,"15min":1.3460000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.617,"5min":2.0059999999999998,"15min":4.452},"last":1.1699999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1910000000000001,"15min":1.3089999999999999},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48899999999999999},"max":{"1min":1.506,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2030000000000001,"15min":1.4039999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":4.6689999999999996},"last":1.458}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.5329999999999999},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7629999999999999,"5min":2.1480000000000001,"15min":4.5670000000000002},"last":1.423},{"interface":"front","average":{"1min":1.367,"5min":1.427,"15min":1.6739999999999999},"min":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"max":{"1min":1.718,"5min":2.21,"15min":3.681},"last":1.6739999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.389,"15min":1.5009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.972,"15min":3.2719999999999998},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4990000000000001,"15min":1.5940000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8080000000000001,"5min":2.02,"15min":4.7480000000000002},"last":1.5289999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193958,"statfs":{"total":200000000,"available":198613175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1890000000000001,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9620000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1559999999999999,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.641},"last":1.024}]},{"osd":1,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2350000000000001,"15min":1.242},"min":{"1min":0.71599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3600000000000001,"15min":1.3680000000000001},"min":{"1min":0.80700000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":0.874}]},{"osd":2,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.69299999999999995},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.202,"15min":1.2210000000000001},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":0.77900000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.363,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.774,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3440000000000001,"15min":1.419},"min":{"1min":0.84899999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.2889999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.2889999999999999,"15min":1.454},"min":{"1min":0.94999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.2040000000000002,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.2},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.389,"15min":1.5580000000000001},"min":{"1min":0.877,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.0499999999999998,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.258}]},{"osd":6,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.411,"15min":1.496},"min":{"1min":0.96299999999999997,"5min":0.68700000000000006,"15min":0.59099999999999997},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.405,"15min":1.6180000000000001},"min":{"1min":1.1739999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.3500000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5609999999999999,"15min":1.6899999999999999},"min":{"1min":0.94599999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":3.2639999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.5880000000000001,"15min":1.619},"min":{"1min":1.1559999999999999,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.5169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208281,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.05,"15min":1.018},"min":{"1min":0.60799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.6060000000000001},"last":1.095},{"interface":"front","average":{"1min":1.179,"5min":1.1259999999999999,"15min":1.0740000000000001},"min":{"1min":0.80600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.6240000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.204,"15min":1.077},"min":{"1min":0.81100000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6659999999999999,"5min":1.954,"15min":1.954},"last":1.5329999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.216,"15min":1.2030000000000001},"min":{"1min":0.75700000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.704,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7809999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.6399999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.216,"15min":1.099},"min":{"1min":0.78400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.3520000000000001,"15min":1.2989999999999999},"min":{"1min":0.89700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8400000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.3740000000000001,"15min":1.351},"min":{"1min":0.78900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.825},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4099999999999999,"15min":1.3080000000000001},"min":{"1min":0.66500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5880000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.421,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.339},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4530000000000001,"15min":1.409},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9930000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.76}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.3740000000000001},"min":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.589,"5min":1.5349999999999999,"15min":1.4750000000000001},"min":{"1min":0.871,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.431}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203635,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.872,"15min":0.82899999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3380000000000001,"5min":1.99,"15min":1.99},"last":0.628},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3939999999999999,"5min":1.72,"15min":1.72},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.556,"5min":1.6060000000000001,"15min":2.702},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.502,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.0920000000000001,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.2090000000000001,"15min":1.0960000000000001},"min":{"1min":0.58599999999999997,"5min":0.46600000000000003,"15min":0.45600000000000002},"max":{"1min":1.7310000000000001,"5min":2.931,"15min":2.931},"last":1.2390000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1759999999999999,"15min":1.1579999999999999},"min":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.304,"15min":1.294},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.1579999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3759999999999999,"15min":1.3300000000000001},"min":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.391,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.399,"15min":1.357},"min":{"1min":0.85399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5449999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.51}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.431,"15min":1.3740000000000001},"min":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":2.427,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.645},{"interface":"front","average":{"1min":1.333,"5min":1.337,"15min":1.327},"min":{"1min":0.74199999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8480000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.6919999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.389},"min":{"1min":0.85499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0550000000000002,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.4330000000000001,"15min":1.427},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.4710000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209297,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.85499999999999998,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.47499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3109999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.137,"15min":1.0600000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.872},{"interface":"front","average":{"1min":1.222,"5min":1.2609999999999999,"15min":1.167},"min":{"1min":0.65500000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98999999999999999,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.339,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.21,"15min":1.1020000000000001},"min":{"1min":0.65800000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.714,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5960000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.373,"15min":1.28},"min":{"1min":0.90100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.982,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.298},{"interface":"front","average":{"1min":1.224,"5min":1.333,"15min":1.2470000000000001},"min":{"1min":0.89500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.736,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.71}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3859999999999999,"15min":1.2969999999999999},"min":{"1min":0.93300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.853,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.3320000000000001,"15min":1.2969999999999999},"min":{"1min":0.90400000000000003,"5min":0.81499999999999995,"15min":0.72699999999999998},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.093}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3440000000000001,"15min":1.294},"min":{"1min":0.87,"5min":0.87,"15min":0.83599999999999997},"max":{"1min":1.704,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.339},{"interface":"front","average":{"1min":1.508,"5min":1.4670000000000001,"15min":1.3480000000000001},"min":{"1min":1.0589999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0430000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.6859999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5089999999999999,"15min":1.4239999999999999},"min":{"1min":1.1200000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":1.78,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.629},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.5369999999999999,"15min":1.4430000000000001},"min":{"1min":0.94899999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":9.5359999999999996,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.401}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193964,"statfs":{"total":200000000,"available":198619567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.59899999999999998,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.1839999999999999,"5min":2.1110000000000002,"15min":2.992},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0369999999999999},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2270000000000001,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.194,"5min":1.742,"15min":2.2789999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.859,"15min":1.337},"min":{"1min":0.60699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.488,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3540000000000001,"15min":1.3300000000000001},"min":{"1min":0.81999999999999995,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":1.663,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.29,"15min":1.2430000000000001},"min":{"1min":0.71099999999999997,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":1.827,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.306}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3839999999999999,"15min":1.238},"min":{"1min":0.874,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":1.893,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.002},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4550000000000001,"15min":1.395},"min":{"1min":0.91400000000000003,"5min":0.79700000000000004,"15min":0.78900000000000003},"max":{"1min":2.117,"5min":4.306,"15min":4.306},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.3680000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68400000000000005},"max":{"1min":1.899,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.46},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.48,"15min":1.3779999999999999},"min":{"1min":0.86799999999999999,"5min":0.753,"15min":0.67900000000000005},"max":{"1min":2.2069999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.339}]},{"osd":6,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5669999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.9359999999999999,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.53},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.534,"15min":1.4410000000000001},"min":{"1min":0.97699999999999998,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.3170000000000002,"5min":3.75,"15min":3.75},"last":1.2789999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.6599999999999999,"15min":1.5449999999999999},"min":{"1min":1.0880000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.9850000000000001,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.583,"5min":1.702,"15min":1.617},"min":{"1min":0.89100000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.1019999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.788}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.80200000000000005},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.89400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.306,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84399999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.105,"15min":1.0649999999999999},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6719999999999999,"5min":1.825,"15min":1.825},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.165,"15min":1.147},"min":{"1min":0.52800000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5109999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3129999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.88800000000000001},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.48199999999999998},"max":{"1min":1.304,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.155,"15min":1.0760000000000001},"min":{"1min":0.61399999999999999,"5min":0.53900000000000003,"15min":0.45900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2609999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.23,"15min":1.169},"min":{"1min":0.75700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7589999999999999,"5min":1.845,"15min":1.845},"last":1.083},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3680000000000001,"15min":1.278},"min":{"1min":1.0069999999999999,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.4730000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3799999999999999,"15min":1.323},"min":{"1min":0.93200000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.885,"5min":2.173,"15min":2.173},"last":1.202},{"interface":"front","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.292},"min":{"1min":0.90300000000000002,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8340000000000001,"5min":1.879,"15min":1.879},"last":1.181}]},{"osd":6,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4470000000000001,"15min":1.399},"min":{"1min":0.92300000000000004,"5min":0.85299999999999998,"15min":0.76300000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.756},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.365,"15min":1.2889999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8089999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.5129999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.484,"15min":1.427},"min":{"1min":1.022,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.964,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.446,"15min":1.3819999999999999},"min":{"1min":0.82999999999999996,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":1.8500000000000001,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.375}]}]}],"pool_statfs":[]}} 2023-12-19T05:46:56.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.322+0000 7f22e359e640 1 Processor -- start 2023-12-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.322+0000 7f22e359e640 1 -- start start 2023-12-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22e415e5a0 0x7f22e40b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e359e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e415ec30 con 0x7f22e40cdbf0 2023-12-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e415e980 con 0x7f22e415f680 2023-12-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40b2f90 con 0x7f22e415e5a0 2023-12-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e2d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22e40cdbf0 0x7f22e406c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34554/0 (socket says 172.21.15.49:34554) 2023-12-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.324+0000 7f22e2d9d640 1 -- 172.21.15.49:0/2930292413 learned_addr learned my addr 172.21.15.49:0/2930292413 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e259c640 1 --2- 172.21.15.49:0/2930292413 >> v2:172.21.15.115:3300/0 conn(0x7f22e415e5a0 0x7f22e40b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856249797 0 0) 0x7f22e415ec30 con 0x7f22e40cdbf0 2023-12-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d0003520 con 0x7f22e40cdbf0 2023-12-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3341824394 0 0) 0x7f22d0003520 con 0x7f22e40cdbf0 2023-12-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 >> v2:172.21.15.115:3300/0 conn(0x7f22e415e5a0 msgr2=0x7f22e40b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 --2- 172.21.15.49:0/2930292413 >> v2:172.21.15.115:3300/0 conn(0x7f22e415e5a0 0x7f22e40b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 >> v1:172.21.15.115:6789/0 conn(0x7f22e415f680 legacy=0x7f22e40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40b3270 con 0x7f22e40cdbf0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f22dc001670 con 0x7f22e40cdbf0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.325+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 >> v1:172.21.15.49:6789/0 conn(0x7f22e40cdbf0 legacy=0x7f22e406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d0003970 0x7f22d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d00047c0 0x7f22d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 0x7f22d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40b2f90 con 0x7f22d0005180 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d000c020 con 0x7f22d0003970 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d000c1e0 con 0x7f22d00047c0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e2d9d640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 0x7f22d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e259c640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d0003970 0x7f22d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.326+0000 7f22e1d9b640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d00047c0 0x7f22d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e2d9d640 1 -- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d00047c0 msgr2=0x7f22d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e2d9d640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d00047c0 0x7f22d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e2d9d640 1 -- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d0003970 msgr2=0x7f22d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e2d9d640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d0003970 0x7f22d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e2d9d640 1 -- 172.21.15.49:0/2930292413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0003520 con 0x7f22d0005180 2023-12-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.327+0000 7f22e1d9b640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d00047c0 0x7f22d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.328+0000 7f22e2d9d640 1 -- 172.21.15.49:0/2930292413 reap_dead start 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.328+0000 7f22e2d9d640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 0x7f22d000b980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c240 tx=0x7f22d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2595003a9c30aa42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.328+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc005ad0 con 0x7f22d0005180 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.328+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc005c70 con 0x7f22d0005180 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.328+0000 7f22e159a640 1 -- 172.21.15.49:0/2930292413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc02c8b0 con 0x7f22d0005180 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 -- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 msgr2=0x7f22d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 0x7f22d000b980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c240 tx=0x7f22d00057f0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 -- 172.21.15.49:0/2930292413 shutdown_connections 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 --2- 172.21.15.49:0/2930292413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22d0005180 0x7f22d000b980 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 -- 172.21.15.49:0/2930292413 >> 172.21.15.49:0/2930292413 conn(0x7f22e40b0100 msgr2=0x7f22e40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 -- 172.21.15.49:0/2930292413 shutdown_connections 2023-12-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.329+0000 7f22e359e640 1 -- 172.21.15.49:0/2930292413 wait complete. 2023-12-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.331+0000 7f22e359e640 1 Processor -- start 2023-12-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.331+0000 7f22e359e640 1 -- start start 2023-12-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d0005180 0x7f22e41f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22e413d5f0 0x7f22e413da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e413dfb0 con 0x7f22e41532f0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e41f0590 con 0x7f22e413d5f0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4153db0 con 0x7f22d0005180 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e1d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52132/0 (socket says 172.21.15.49:52132) 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.332+0000 7f22e1d9b640 1 -- 172.21.15.49:0/2779859932 learned_addr learned my addr 172.21.15.49:0/2779859932 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e259c640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d0005180 0x7f22e41f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e2d9d640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22e413d5f0 0x7f22e413da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 -- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d0005180 msgr2=0x7f22e41f0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d0005180 0x7f22e41f0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 -- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22e413d5f0 msgr2=0x7f22e413da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22e413d5f0 0x7f22e413da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 -- 172.21.15.49:0/2779859932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4154090 con 0x7f22e41532f0 2023-12-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e1d9b640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00d770 tx=0x7f22cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc005270 con 0x7f22e41532f0 2023-12-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc0053d0 con 0x7f22e41532f0 2023-12-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00b8f0 con 0x7f22e41532f0 2023-12-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.333+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4154370 con 0x7f22e41532f0 2023-12-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.334+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e4154930 con 0x7f22e41532f0 2023-12-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.335+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e4154af0 con 0x7f22e41532f0 2023-12-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.336+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22cc00ba50 con 0x7f22e41532f0 2023-12-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.337+0000 7f22daffd640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 0x7f22c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.337+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f22cc088830 con 0x7f22e41532f0 2023-12-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.337+0000 7f22e259c640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 0x7f22c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.339+0000 7f22e259c640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 0x7f22c406c920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009fd0 tx=0x7f22d400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.341+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22cc053e50 con 0x7f22e41532f0 2023-12-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.534+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22e415f160 con 0x7f22c406a460 2023-12-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.558+0000 7f22daffd640 1 -- 172.21.15.49:0/2779859932 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283199 (secure 0 0 0) 0x7f22d4003990 con 0x7f22c406a460 2023-12-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 msgr2=0x7f22c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 0x7f22c406c920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009fd0 tx=0x7f22d400b040 comp rx=0 tx=0).stop 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 msgr2=0x7f22e4153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00d770 tx=0x7f22cc00dc30 comp rx=0 tx=0).stop 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 shutdown_connections 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f22c406a460 0x7f22c406c920 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22e413d5f0 0x7f22e413da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22e41532f0 0x7f22e4153770 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 --2- 172.21.15.49:0/2779859932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22d0005180 0x7f22e41f0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 >> 172.21.15.49:0/2779859932 conn(0x7f22e40b0100 msgr2=0x7f22e40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 shutdown_connections 2023-12-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.565+0000 7f22e359e640 1 -- 172.21.15.49:0/2779859932 wait complete. 2023-12-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2023-12-19T05:46:55.070669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555157,"statfs":{"total":1600000000,"available":1592481420,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.405617"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453271+0000","last_change":"2023-12-19T05:46:51.050712+0000","last_active":"2023-12-19T05:46:52.453271+0000","last_peered":"2023-12-19T05:46:52.453271+0000","last_clean":"2023-12-19T05:46:52.453271+0000","last_became_active":"2023-12-19T05:46:51.047340+0000","last_became_peered":"2023-12-19T05:46:51.047340+0000","last_unstale":"2023-12-19T05:46:52.453271+0000","last_undegraded":"2023-12-19T05:46:52.453271+0000","last_fullsized":"2023-12-19T05:46:52.453271+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:20.832863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.058341+0000","last_change":"2023-12-19T05:46:51.058279+0000","last_active":"2023-12-19T05:46:51.058341+0000","last_peered":"2023-12-19T05:46:51.058341+0000","last_clean":"2023-12-19T05:46:51.058341+0000","last_became_active":"2023-12-19T05:46:51.058090+0000","last_became_peered":"2023-12-19T05:46:51.058090+0000","last_unstale":"2023-12-19T05:46:51.058341+0000","last_undegraded":"2023-12-19T05:46:51.058341+0000","last_fullsized":"2023-12-19T05:46:51.058341+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:55.529858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451323+0000","last_change":"2023-12-19T05:46:51.045311+0000","last_active":"2023-12-19T05:46:52.451323+0000","last_peered":"2023-12-19T05:46:52.451323+0000","last_clean":"2023-12-19T05:46:52.451323+0000","last_became_active":"2023-12-19T05:46:51.045030+0000","last_became_peered":"2023-12-19T05:46:51.045030+0000","last_unstale":"2023-12-19T05:46:52.451323+0000","last_undegraded":"2023-12-19T05:46:52.451323+0000","last_fullsized":"2023-12-19T05:46:52.451323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:29:13.077036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412780+0000","last_change":"2023-12-19T05:46:51.057339+0000","last_active":"2023-12-19T05:46:52.412780+0000","last_peered":"2023-12-19T05:46:52.412780+0000","last_clean":"2023-12-19T05:46:52.412780+0000","last_became_active":"2023-12-19T05:46:51.055883+0000","last_became_peered":"2023-12-19T05:46:51.055883+0000","last_unstale":"2023-12-19T05:46:52.412780+0000","last_undegraded":"2023-12-19T05:46:52.412780+0000","last_fullsized":"2023-12-19T05:46:52.412780+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:57.575936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454829+0000","last_change":"2023-12-19T05:46:51.057205+0000","last_active":"2023-12-19T05:46:52.454829+0000","last_peered":"2023-12-19T05:46:52.454829+0000","last_clean":"2023-12-19T05:46:52.454829+0000","last_became_active":"2023-12-19T05:46:51.055075+0000","last_became_peered":"2023-12-19T05:46:51.055075+0000","last_unstale":"2023-12-19T05:46:52.454829+0000","last_undegraded":"2023-12-19T05:46:52.454829+0000","last_fullsized":"2023-12-19T05:46:52.454829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:54:46.282806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029634+0000","last_change":"2023-12-19T05:46:51.053144+0000","last_active":"2023-12-19T05:46:52.029634+0000","last_peered":"2023-12-19T05:46:52.029634+0000","last_clean":"2023-12-19T05:46:52.029634+0000","last_became_active":"2023-12-19T05:46:51.052897+0000","last_became_peered":"2023-12-19T05:46:51.052897+0000","last_unstale":"2023-12-19T05:46:52.029634+0000","last_undegraded":"2023-12-19T05:46:52.029634+0000","last_fullsized":"2023-12-19T05:46:52.029634+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:46.839874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027794+0000","last_change":"2023-12-19T05:46:51.039124+0000","last_active":"2023-12-19T05:46:52.027794+0000","last_peered":"2023-12-19T05:46:52.027794+0000","last_clean":"2023-12-19T05:46:52.027794+0000","last_became_active":"2023-12-19T05:46:51.038736+0000","last_became_peered":"2023-12-19T05:46:51.038736+0000","last_unstale":"2023-12-19T05:46:52.027794+0000","last_undegraded":"2023-12-19T05:46:52.027794+0000","last_fullsized":"2023-12-19T05:46:52.027794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:12.848699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027521+0000","last_change":"2023-12-19T05:46:51.035607+0000","last_active":"2023-12-19T05:46:52.027521+0000","last_peered":"2023-12-19T05:46:52.027521+0000","last_clean":"2023-12-19T05:46:52.027521+0000","last_became_active":"2023-12-19T05:46:51.034315+0000","last_became_peered":"2023-12-19T05:46:51.034315+0000","last_unstale":"2023-12-19T05:46:52.027521+0000","last_undegraded":"2023-12-19T05:46:52.027521+0000","last_fullsized":"2023-12-19T05:46:52.027521+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:15.276915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452159+0000","last_change":"2023-12-19T05:46:51.059409+0000","last_active":"2023-12-19T05:46:52.452159+0000","last_peered":"2023-12-19T05:46:52.452159+0000","last_clean":"2023-12-19T05:46:52.452159+0000","last_became_active":"2023-12-19T05:46:51.059109+0000","last_became_peered":"2023-12-19T05:46:51.059109+0000","last_unstale":"2023-12-19T05:46:52.452159+0000","last_undegraded":"2023-12-19T05:46:52.452159+0000","last_fullsized":"2023-12-19T05:46:52.452159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:26.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453741+0000","last_change":"2023-12-19T05:46:51.054853+0000","last_active":"2023-12-19T05:46:52.453741+0000","last_peered":"2023-12-19T05:46:52.453741+0000","last_clean":"2023-12-19T05:46:52.453741+0000","last_became_active":"2023-12-19T05:46:51.052223+0000","last_became_peered":"2023-12-19T05:46:51.052223+0000","last_unstale":"2023-12-19T05:46:52.453741+0000","last_undegraded":"2023-12-19T05:46:52.453741+0000","last_fullsized":"2023-12-19T05:46:52.453741+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:48:23.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027709+0000","last_change":"2023-12-19T05:46:51.038895+0000","last_active":"2023-12-19T05:46:52.027709+0000","last_peered":"2023-12-19T05:46:52.027709+0000","last_clean":"2023-12-19T05:46:52.027709+0000","last_became_active":"2023-12-19T05:46:51.038665+0000","last_became_peered":"2023-12-19T05:46:51.038665+0000","last_unstale":"2023-12-19T05:46:52.027709+0000","last_undegraded":"2023-12-19T05:46:52.027709+0000","last_fullsized":"2023-12-19T05:46:52.027709+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:34:17.181485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453785+0000","last_change":"2023-12-19T05:46:51.051132+0000","last_active":"2023-12-19T05:46:52.453785+0000","last_peered":"2023-12-19T05:46:52.453785+0000","last_clean":"2023-12-19T05:46:52.453785+0000","last_became_active":"2023-12-19T05:46:51.050897+0000","last_became_peered":"2023-12-19T05:46:51.050897+0000","last_unstale":"2023-12-19T05:46:52.453785+0000","last_undegraded":"2023-12-19T05:46:52.453785+0000","last_fullsized":"2023-12-19T05:46:52.453785+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:33.168747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.040775+0000","last_change":"2023-12-19T05:46:51.040691+0000","last_active":"2023-12-19T05:46:51.040775+0000","last_peered":"2023-12-19T05:46:51.040775+0000","last_clean":"2023-12-19T05:46:51.040775+0000","last_became_active":"2023-12-19T05:46:51.039976+0000","last_became_peered":"2023-12-19T05:46:51.039976+0000","last_unstale":"2023-12-19T05:46:51.040775+0000","last_undegraded":"2023-12-19T05:46:51.040775+0000","last_fullsized":"2023-12-19T05:46:51.040775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:21.036765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029102+0000","last_change":"2023-12-19T05:46:51.041821+0000","last_active":"2023-12-19T05:46:52.029102+0000","last_peered":"2023-12-19T05:46:52.029102+0000","last_clean":"2023-12-19T05:46:52.029102+0000","last_became_active":"2023-12-19T05:46:51.041352+0000","last_became_peered":"2023-12-19T05:46:51.041352+0000","last_unstale":"2023-12-19T05:46:52.029102+0000","last_undegraded":"2023-12-19T05:46:52.029102+0000","last_fullsized":"2023-12-19T05:46:52.029102+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:10:37.382180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453968+0000","last_change":"2023-12-19T05:46:51.059364+0000","last_active":"2023-12-19T05:46:52.453968+0000","last_peered":"2023-12-19T05:46:52.453968+0000","last_clean":"2023-12-19T05:46:52.453968+0000","last_became_active":"2023-12-19T05:46:51.059077+0000","last_became_peered":"2023-12-19T05:46:51.059077+0000","last_unstale":"2023-12-19T05:46:52.453968+0000","last_undegraded":"2023-12-19T05:46:52.453968+0000","last_fullsized":"2023-12-19T05:46:52.453968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:01:24.051241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453215+0000","last_change":"2023-12-19T05:46:51.038916+0000","last_active":"2023-12-19T05:46:52.453215+0000","last_peered":"2023-12-19T05:46:52.453215+0000","last_clean":"2023-12-19T05:46:52.453215+0000","last_became_active":"2023-12-19T05:46:51.035125+0000","last_became_peered":"2023-12-19T05:46:51.035125+0000","last_unstale":"2023-12-19T05:46:52.453215+0000","last_undegraded":"2023-12-19T05:46:52.453215+0000","last_fullsized":"2023-12-19T05:46:52.453215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:48.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.450696+0000","last_change":"2023-12-19T05:46:51.041987+0000","last_active":"2023-12-19T05:46:52.450696+0000","last_peered":"2023-12-19T05:46:52.450696+0000","last_clean":"2023-12-19T05:46:52.450696+0000","last_became_active":"2023-12-19T05:46:51.040902+0000","last_became_peered":"2023-12-19T05:46:51.040902+0000","last_unstale":"2023-12-19T05:46:52.450696+0000","last_undegraded":"2023-12-19T05:46:52.450696+0000","last_fullsized":"2023-12-19T05:46:52.450696+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:07.884794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027700+0000","last_change":"2023-12-19T05:46:51.046467+0000","last_active":"2023-12-19T05:46:52.027700+0000","last_peered":"2023-12-19T05:46:52.027700+0000","last_clean":"2023-12-19T05:46:52.027700+0000","last_became_active":"2023-12-19T05:46:51.046246+0000","last_became_peered":"2023-12-19T05:46:51.046246+0000","last_unstale":"2023-12-19T05:46:52.027700+0000","last_undegraded":"2023-12-19T05:46:52.027700+0000","last_fullsized":"2023-12-19T05:46:52.027700+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:36:07.431107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.450885+0000","last_change":"2023-12-19T05:46:51.048997+0000","last_active":"2023-12-19T05:46:52.450885+0000","last_peered":"2023-12-19T05:46:52.450885+0000","last_clean":"2023-12-19T05:46:52.450885+0000","last_became_active":"2023-12-19T05:46:51.048743+0000","last_became_peered":"2023-12-19T05:46:51.048743+0000","last_unstale":"2023-12-19T05:46:52.450885+0000","last_undegraded":"2023-12-19T05:46:52.450885+0000","last_fullsized":"2023-12-19T05:46:52.450885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:46:56.490480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451652+0000","last_change":"2023-12-19T05:46:51.049297+0000","last_active":"2023-12-19T05:46:52.451652+0000","last_peered":"2023-12-19T05:46:52.451652+0000","last_clean":"2023-12-19T05:46:52.451652+0000","last_became_active":"2023-12-19T05:46:51.049029+0000","last_became_peered":"2023-12-19T05:46:51.049029+0000","last_unstale":"2023-12-19T05:46:52.451652+0000","last_undegraded":"2023-12-19T05:46:52.451652+0000","last_fullsized":"2023-12-19T05:46:52.451652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:33.852816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027856+0000","last_change":"2023-12-19T05:46:51.054190+0000","last_active":"2023-12-19T05:46:52.027856+0000","last_peered":"2023-12-19T05:46:52.027856+0000","last_clean":"2023-12-19T05:46:52.027856+0000","last_became_active":"2023-12-19T05:46:51.053970+0000","last_became_peered":"2023-12-19T05:46:51.053970+0000","last_unstale":"2023-12-19T05:46:52.027856+0000","last_undegraded":"2023-12-19T05:46:52.027856+0000","last_fullsized":"2023-12-19T05:46:52.027856+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:34:06.951988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029531+0000","last_change":"2023-12-19T05:46:51.042301+0000","last_active":"2023-12-19T05:46:52.029531+0000","last_peered":"2023-12-19T05:46:52.029531+0000","last_clean":"2023-12-19T05:46:52.029531+0000","last_became_active":"2023-12-19T05:46:51.037013+0000","last_became_peered":"2023-12-19T05:46:51.037013+0000","last_unstale":"2023-12-19T05:46:52.029531+0000","last_undegraded":"2023-12-19T05:46:52.029531+0000","last_fullsized":"2023-12-19T05:46:52.029531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:14.810265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029281+0000","last_change":"2023-12-19T05:46:51.037108+0000","last_active":"2023-12-19T05:46:52.029281+0000","last_peered":"2023-12-19T05:46:52.029281+0000","last_clean":"2023-12-19T05:46:52.029281+0000","last_became_active":"2023-12-19T05:46:51.036719+0000","last_became_peered":"2023-12-19T05:46:51.036719+0000","last_unstale":"2023-12-19T05:46:52.029281+0000","last_undegraded":"2023-12-19T05:46:52.029281+0000","last_fullsized":"2023-12-19T05:46:52.029281+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:03.721747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413031+0000","last_change":"2023-12-19T05:46:51.057192+0000","last_active":"2023-12-19T05:46:52.413031+0000","last_peered":"2023-12-19T05:46:52.413031+0000","last_clean":"2023-12-19T05:46:52.413031+0000","last_became_active":"2023-12-19T05:46:51.055531+0000","last_became_peered":"2023-12-19T05:46:51.055531+0000","last_unstale":"2023-12-19T05:46:52.413031+0000","last_undegraded":"2023-12-19T05:46:52.413031+0000","last_fullsized":"2023-12-19T05:46:52.413031+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:38.393960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027510+0000","last_change":"2023-12-19T05:46:51.035758+0000","last_active":"2023-12-19T05:46:52.027510+0000","last_peered":"2023-12-19T05:46:52.027510+0000","last_clean":"2023-12-19T05:46:52.027510+0000","last_became_active":"2023-12-19T05:46:51.035520+0000","last_became_peered":"2023-12-19T05:46:51.035520+0000","last_unstale":"2023-12-19T05:46:52.027510+0000","last_undegraded":"2023-12-19T05:46:52.027510+0000","last_fullsized":"2023-12-19T05:46:52.027510+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:06:39.075988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030303+0000","last_change":"2023-12-19T05:46:51.043810+0000","last_active":"2023-12-19T05:46:52.030303+0000","last_peered":"2023-12-19T05:46:52.030303+0000","last_clean":"2023-12-19T05:46:52.030303+0000","last_became_active":"2023-12-19T05:46:51.043427+0000","last_became_peered":"2023-12-19T05:46:51.043427+0000","last_unstale":"2023-12-19T05:46:52.030303+0000","last_undegraded":"2023-12-19T05:46:52.030303+0000","last_fullsized":"2023-12-19T05:46:52.030303+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:10.691769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413018+0000","last_change":"2023-12-19T05:46:51.058493+0000","last_active":"2023-12-19T05:46:52.413018+0000","last_peered":"2023-12-19T05:46:52.413018+0000","last_clean":"2023-12-19T05:46:52.413018+0000","last_became_active":"2023-12-19T05:46:51.057624+0000","last_became_peered":"2023-12-19T05:46:51.057624+0000","last_unstale":"2023-12-19T05:46:52.413018+0000","last_undegraded":"2023-12-19T05:46:52.413018+0000","last_fullsized":"2023-12-19T05:46:52.413018+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:14.810265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029495+0000","last_change":"2023-12-19T05:46:51.052856+0000","last_active":"2023-12-19T05:46:52.029495+0000","last_peered":"2023-12-19T05:46:52.029495+0000","last_clean":"2023-12-19T05:46:52.029495+0000","last_became_active":"2023-12-19T05:46:51.049633+0000","last_became_peered":"2023-12-19T05:46:51.049633+0000","last_unstale":"2023-12-19T05:46:52.029495+0000","last_undegraded":"2023-12-19T05:46:52.029495+0000","last_fullsized":"2023-12-19T05:46:52.029495+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:57.575936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029226+0000","last_change":"2023-12-19T05:46:51.041668+0000","last_active":"2023-12-19T05:46:52.029226+0000","last_peered":"2023-12-19T05:46:52.029226+0000","last_clean":"2023-12-19T05:46:52.029226+0000","last_became_active":"2023-12-19T05:46:51.041033+0000","last_became_peered":"2023-12-19T05:46:51.041033+0000","last_unstale":"2023-12-19T05:46:52.029226+0000","last_undegraded":"2023-12-19T05:46:52.029226+0000","last_fullsized":"2023-12-19T05:46:52.029226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:11:29.454524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027657+0000","last_change":"2023-12-19T05:46:51.038341+0000","last_active":"2023-12-19T05:46:52.027657+0000","last_peered":"2023-12-19T05:46:52.027657+0000","last_clean":"2023-12-19T05:46:52.027657+0000","last_became_active":"2023-12-19T05:46:51.038132+0000","last_became_peered":"2023-12-19T05:46:51.038132+0000","last_unstale":"2023-12-19T05:46:52.027657+0000","last_undegraded":"2023-12-19T05:46:52.027657+0000","last_fullsized":"2023-12-19T05:46:52.027657+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:35:54.665623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453494+0000","last_change":"2023-12-19T05:46:51.047630+0000","last_active":"2023-12-19T05:46:52.453494+0000","last_peered":"2023-12-19T05:46:52.453494+0000","last_clean":"2023-12-19T05:46:52.453494+0000","last_became_active":"2023-12-19T05:46:51.045311+0000","last_became_peered":"2023-12-19T05:46:51.045311+0000","last_unstale":"2023-12-19T05:46:52.453494+0000","last_undegraded":"2023-12-19T05:46:52.453494+0000","last_fullsized":"2023-12-19T05:46:52.453494+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:34.888971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454396+0000","last_change":"2023-12-19T05:46:51.039652+0000","last_active":"2023-12-19T05:46:52.454396+0000","last_peered":"2023-12-19T05:46:52.454396+0000","last_clean":"2023-12-19T05:46:52.454396+0000","last_became_active":"2023-12-19T05:46:51.038953+0000","last_became_peered":"2023-12-19T05:46:51.038953+0000","last_unstale":"2023-12-19T05:46:52.454396+0000","last_undegraded":"2023-12-19T05:46:52.454396+0000","last_fullsized":"2023-12-19T05:46:52.454396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:08.918098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452422+0000","last_change":"2023-12-19T05:46:51.058764+0000","last_active":"2023-12-19T05:46:52.452422+0000","last_peered":"2023-12-19T05:46:52.452422+0000","last_clean":"2023-12-19T05:46:52.452422+0000","last_became_active":"2023-12-19T05:46:51.058200+0000","last_became_peered":"2023-12-19T05:46:51.058200+0000","last_unstale":"2023-12-19T05:46:52.452422+0000","last_undegraded":"2023-12-19T05:46:52.452422+0000","last_fullsized":"2023-12-19T05:46:52.452422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:57.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029962+0000","last_change":"2023-12-19T05:46:50.527653+0000","last_active":"2023-12-19T05:46:52.029962+0000","last_peered":"2023-12-19T05:46:52.029962+0000","last_clean":"2023-12-19T05:46:52.029962+0000","last_became_active":"2023-12-19T05:46:50.527426+0000","last_became_peered":"2023-12-19T05:46:50.527426+0000","last_unstale":"2023-12-19T05:46:52.029962+0000","last_undegraded":"2023-12-19T05:46:52.029962+0000","last_fullsized":"2023-12-19T05:46:52.029962+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:07.903887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029485+0000","last_change":"2023-12-19T05:46:51.036959+0000","last_active":"2023-12-19T05:46:52.029485+0000","last_peered":"2023-12-19T05:46:52.029485+0000","last_clean":"2023-12-19T05:46:52.029485+0000","last_became_active":"2023-12-19T05:46:51.036425+0000","last_became_peered":"2023-12-19T05:46:51.036425+0000","last_unstale":"2023-12-19T05:46:52.029485+0000","last_undegraded":"2023-12-19T05:46:52.029485+0000","last_fullsized":"2023-12-19T05:46:52.029485+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:07.884794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.037517+0000","last_change":"2023-12-19T05:46:50.528741+0000","last_active":"2023-12-19T05:46:51.037517+0000","last_peered":"2023-12-19T05:46:51.037517+0000","last_clean":"2023-12-19T05:46:51.037517+0000","last_became_active":"2023-12-19T05:46:50.527578+0000","last_became_peered":"2023-12-19T05:46:50.527578+0000","last_unstale":"2023-12-19T05:46:51.037517+0000","last_undegraded":"2023-12-19T05:46:51.037517+0000","last_fullsized":"2023-12-19T05:46:51.037517+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:02.707536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029886+0000","last_change":"2023-12-19T05:46:51.052485+0000","last_active":"2023-12-19T05:46:52.029886+0000","last_peered":"2023-12-19T05:46:52.029886+0000","last_clean":"2023-12-19T05:46:52.029886+0000","last_became_active":"2023-12-19T05:46:51.052263+0000","last_became_peered":"2023-12-19T05:46:51.052263+0000","last_unstale":"2023-12-19T05:46:52.029886+0000","last_undegraded":"2023-12-19T05:46:52.029886+0000","last_fullsized":"2023-12-19T05:46:52.029886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:21:30.420094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413598+0000","last_change":"2023-12-19T05:46:50.542624+0000","last_active":"2023-12-19T05:46:52.413598+0000","last_peered":"2023-12-19T05:46:52.413598+0000","last_clean":"2023-12-19T05:46:52.413598+0000","last_became_active":"2023-12-19T05:46:50.541297+0000","last_became_peered":"2023-12-19T05:46:50.541297+0000","last_unstale":"2023-12-19T05:46:52.413598+0000","last_undegraded":"2023-12-19T05:46:52.413598+0000","last_fullsized":"2023-12-19T05:46:52.413598+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:16.773410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451835+0000","last_change":"2023-12-19T05:46:51.054573+0000","last_active":"2023-12-19T05:46:52.451835+0000","last_peered":"2023-12-19T05:46:52.451835+0000","last_clean":"2023-12-19T05:46:52.451835+0000","last_became_active":"2023-12-19T05:46:51.054342+0000","last_became_peered":"2023-12-19T05:46:51.054342+0000","last_unstale":"2023-12-19T05:46:52.451835+0000","last_undegraded":"2023-12-19T05:46:52.451835+0000","last_fullsized":"2023-12-19T05:46:52.451835+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:33:44.913703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413173+0000","last_change":"2023-12-19T05:46:50.539895+0000","last_active":"2023-12-19T05:46:52.413173+0000","last_peered":"2023-12-19T05:46:52.413173+0000","last_clean":"2023-12-19T05:46:52.413173+0000","last_became_active":"2023-12-19T05:46:50.539598+0000","last_became_peered":"2023-12-19T05:46:50.539598+0000","last_unstale":"2023-12-19T05:46:52.413173+0000","last_undegraded":"2023-12-19T05:46:52.413173+0000","last_fullsized":"2023-12-19T05:46:52.413173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:26:57.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412327+0000","last_change":"2023-12-19T05:46:51.056578+0000","last_active":"2023-12-19T05:46:52.412327+0000","last_peered":"2023-12-19T05:46:52.412327+0000","last_clean":"2023-12-19T05:46:52.412327+0000","last_became_active":"2023-12-19T05:46:51.056028+0000","last_became_peered":"2023-12-19T05:46:51.056028+0000","last_unstale":"2023-12-19T05:46:52.412327+0000","last_undegraded":"2023-12-19T05:46:52.412327+0000","last_fullsized":"2023-12-19T05:46:52.412327+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:09.647836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451387+0000","last_change":"2023-12-19T05:46:50.537353+0000","last_active":"2023-12-19T05:46:52.451387+0000","last_peered":"2023-12-19T05:46:52.451387+0000","last_clean":"2023-12-19T05:46:52.451387+0000","last_became_active":"2023-12-19T05:46:50.537097+0000","last_became_peered":"2023-12-19T05:46:50.537097+0000","last_unstale":"2023-12-19T05:46:52.451387+0000","last_undegraded":"2023-12-19T05:46:52.451387+0000","last_fullsized":"2023-12-19T05:46:52.451387+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:32.154536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028076+0000","last_change":"2023-12-19T05:46:51.029954+0000","last_active":"2023-12-19T05:46:52.028076+0000","last_peered":"2023-12-19T05:46:52.028076+0000","last_clean":"2023-12-19T05:46:52.028076+0000","last_became_active":"2023-12-19T05:46:51.029631+0000","last_became_peered":"2023-12-19T05:46:51.029631+0000","last_unstale":"2023-12-19T05:46:52.028076+0000","last_undegraded":"2023-12-19T05:46:52.028076+0000","last_fullsized":"2023-12-19T05:46:52.028076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:30:16.980537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452906+0000","last_change":"2023-12-19T05:46:50.541043+0000","last_active":"2023-12-19T05:46:52.452906+0000","last_peered":"2023-12-19T05:46:52.452906+0000","last_clean":"2023-12-19T05:46:52.452906+0000","last_became_active":"2023-12-19T05:46:50.540430+0000","last_became_peered":"2023-12-19T05:46:50.540430+0000","last_unstale":"2023-12-19T05:46:52.452906+0000","last_undegraded":"2023-12-19T05:46:52.452906+0000","last_fullsized":"2023-12-19T05:46:52.452906+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:45:20.022554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453987+0000","last_change":"2023-12-19T05:46:51.056697+0000","last_active":"2023-12-19T05:46:52.453987+0000","last_peered":"2023-12-19T05:46:52.453987+0000","last_clean":"2023-12-19T05:46:52.453987+0000","last_became_active":"2023-12-19T05:46:51.052606+0000","last_became_peered":"2023-12-19T05:46:51.052606+0000","last_unstale":"2023-12-19T05:46:52.453987+0000","last_undegraded":"2023-12-19T05:46:52.453987+0000","last_fullsized":"2023-12-19T05:46:52.453987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:04:24.036364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028765+0000","last_change":"2023-12-19T05:46:50.530309+0000","last_active":"2023-12-19T05:46:52.028765+0000","last_peered":"2023-12-19T05:46:52.028765+0000","last_clean":"2023-12-19T05:46:52.028765+0000","last_became_active":"2023-12-19T05:46:50.530007+0000","last_became_peered":"2023-12-19T05:46:50.530007+0000","last_unstale":"2023-12-19T05:46:52.028765+0000","last_undegraded":"2023-12-19T05:46:52.028765+0000","last_fullsized":"2023-12-19T05:46:52.028765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:05.013117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028488+0000","last_change":"2023-12-19T05:46:51.037500+0000","last_active":"2023-12-19T05:46:52.028488+0000","last_peered":"2023-12-19T05:46:52.028488+0000","last_clean":"2023-12-19T05:46:52.028488+0000","last_became_active":"2023-12-19T05:46:51.037282+0000","last_became_peered":"2023-12-19T05:46:51.037282+0000","last_unstale":"2023-12-19T05:46:52.028488+0000","last_undegraded":"2023-12-19T05:46:52.028488+0000","last_fullsized":"2023-12-19T05:46:52.028488+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:41.558173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454668+0000","last_change":"2023-12-19T05:46:50.532369+0000","last_active":"2023-12-19T05:46:52.454668+0000","last_peered":"2023-12-19T05:46:52.454668+0000","last_clean":"2023-12-19T05:46:52.454668+0000","last_became_active":"2023-12-19T05:46:50.531685+0000","last_became_peered":"2023-12-19T05:46:50.531685+0000","last_unstale":"2023-12-19T05:46:52.454668+0000","last_undegraded":"2023-12-19T05:46:52.454668+0000","last_fullsized":"2023-12-19T05:46:52.454668+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:39:11.053511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.046432+0000","last_change":"2023-12-19T05:46:51.045704+0000","last_active":"2023-12-19T05:46:51.046432+0000","last_peered":"2023-12-19T05:46:51.046432+0000","last_clean":"2023-12-19T05:46:51.046432+0000","last_became_active":"2023-12-19T05:46:51.045445+0000","last_became_peered":"2023-12-19T05:46:51.045445+0000","last_unstale":"2023-12-19T05:46:51.046432+0000","last_undegraded":"2023-12-19T05:46:51.046432+0000","last_fullsized":"2023-12-19T05:46:51.046432+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:52:16.081609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413656+0000","last_change":"2023-12-19T05:46:50.537765+0000","last_active":"2023-12-19T05:46:52.413656+0000","last_peered":"2023-12-19T05:46:52.413656+0000","last_clean":"2023-12-19T05:46:52.413656+0000","last_became_active":"2023-12-19T05:46:50.536506+0000","last_became_peered":"2023-12-19T05:46:50.536506+0000","last_unstale":"2023-12-19T05:46:52.413656+0000","last_undegraded":"2023-12-19T05:46:52.413656+0000","last_fullsized":"2023-12-19T05:46:52.413656+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:34:31.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.044897+0000","last_change":"2023-12-19T05:46:51.044520+0000","last_active":"2023-12-19T05:46:51.044897+0000","last_peered":"2023-12-19T05:46:51.044897+0000","last_clean":"2023-12-19T05:46:51.044897+0000","last_became_active":"2023-12-19T05:46:51.043754+0000","last_became_peered":"2023-12-19T05:46:51.043754+0000","last_unstale":"2023-12-19T05:46:51.044897+0000","last_undegraded":"2023-12-19T05:46:51.044897+0000","last_fullsized":"2023-12-19T05:46:51.044897+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:50.444220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454632+0000","last_change":"2023-12-19T05:46:50.531048+0000","last_active":"2023-12-19T05:46:52.454632+0000","last_peered":"2023-12-19T05:46:52.454632+0000","last_clean":"2023-12-19T05:46:52.454632+0000","last_became_active":"2023-12-19T05:46:50.529319+0000","last_became_peered":"2023-12-19T05:46:50.529319+0000","last_unstale":"2023-12-19T05:46:52.454632+0000","last_undegraded":"2023-12-19T05:46:52.454632+0000","last_fullsized":"2023-12-19T05:46:52.454632+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:18:59.150757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029489+0000","last_change":"2023-12-19T05:46:51.037003+0000","last_active":"2023-12-19T05:46:52.029489+0000","last_peered":"2023-12-19T05:46:52.029489+0000","last_clean":"2023-12-19T05:46:52.029489+0000","last_became_active":"2023-12-19T05:46:51.036293+0000","last_became_peered":"2023-12-19T05:46:51.036293+0000","last_unstale":"2023-12-19T05:46:52.029489+0000","last_undegraded":"2023-12-19T05:46:52.029489+0000","last_fullsized":"2023-12-19T05:46:52.029489+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:20:35.853753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452681+0000","last_change":"2023-12-19T05:46:50.538937+0000","last_active":"2023-12-19T05:46:52.452681+0000","last_peered":"2023-12-19T05:46:52.452681+0000","last_clean":"2023-12-19T05:46:52.452681+0000","last_became_active":"2023-12-19T05:46:50.538661+0000","last_became_peered":"2023-12-19T05:46:50.538661+0000","last_unstale":"2023-12-19T05:46:52.452681+0000","last_undegraded":"2023-12-19T05:46:52.452681+0000","last_fullsized":"2023-12-19T05:46:52.452681+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:32:12.454873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.027854+0000","last_change":"2023-12-19T05:46:51.043161+0000","last_active":"2023-12-19T05:46:52.027854+0000","last_peered":"2023-12-19T05:46:52.027854+0000","last_clean":"2023-12-19T05:46:52.027854+0000","last_became_active":"2023-12-19T05:46:51.042942+0000","last_became_peered":"2023-12-19T05:46:51.042942+0000","last_unstale":"2023-12-19T05:46:52.027854+0000","last_undegraded":"2023-12-19T05:46:52.027854+0000","last_fullsized":"2023-12-19T05:46:52.027854+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:50:41.034934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413467+0000","last_change":"2023-12-19T05:46:50.543008+0000","last_active":"2023-12-19T05:46:52.413467+0000","last_peered":"2023-12-19T05:46:52.413467+0000","last_clean":"2023-12-19T05:46:52.413467+0000","last_became_active":"2023-12-19T05:46:50.542467+0000","last_became_peered":"2023-12-19T05:46:50.542467+0000","last_unstale":"2023-12-19T05:46:52.413467+0000","last_undegraded":"2023-12-19T05:46:52.413467+0000","last_fullsized":"2023-12-19T05:46:52.413467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:03.192720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453434+0000","last_change":"2023-12-19T05:46:51.040162+0000","last_active":"2023-12-19T05:46:52.453434+0000","last_peered":"2023-12-19T05:46:52.453434+0000","last_clean":"2023-12-19T05:46:52.453434+0000","last_became_active":"2023-12-19T05:46:51.035909+0000","last_became_peered":"2023-12-19T05:46:51.035909+0000","last_unstale":"2023-12-19T05:46:52.453434+0000","last_undegraded":"2023-12-19T05:46:52.453434+0000","last_fullsized":"2023-12-19T05:46:52.453434+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:39:57.235860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454947+0000","last_change":"2023-12-19T05:46:50.531259+0000","last_active":"2023-12-19T05:46:52.454947+0000","last_peered":"2023-12-19T05:46:52.454947+0000","last_clean":"2023-12-19T05:46:52.454947+0000","last_became_active":"2023-12-19T05:46:50.527292+0000","last_became_peered":"2023-12-19T05:46:50.527292+0000","last_unstale":"2023-12-19T05:46:52.454947+0000","last_undegraded":"2023-12-19T05:46:52.454947+0000","last_fullsized":"2023-12-19T05:46:52.454947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:54:27.378457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413321+0000","last_change":"2023-12-19T05:46:51.048355+0000","last_active":"2023-12-19T05:46:52.413321+0000","last_peered":"2023-12-19T05:46:52.413321+0000","last_clean":"2023-12-19T05:46:52.413321+0000","last_became_active":"2023-12-19T05:46:51.047813+0000","last_became_peered":"2023-12-19T05:46:51.047813+0000","last_unstale":"2023-12-19T05:46:52.413321+0000","last_undegraded":"2023-12-19T05:46:52.413321+0000","last_fullsized":"2023-12-19T05:46:52.413321+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:46.839874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451320+0000","last_change":"2023-12-19T05:46:50.540942+0000","last_active":"2023-12-19T05:46:52.451320+0000","last_peered":"2023-12-19T05:46:52.451320+0000","last_clean":"2023-12-19T05:46:52.451320+0000","last_became_active":"2023-12-19T05:46:50.540600+0000","last_became_peered":"2023-12-19T05:46:50.540600+0000","last_unstale":"2023-12-19T05:46:52.451320+0000","last_undegraded":"2023-12-19T05:46:52.451320+0000","last_fullsized":"2023-12-19T05:46:52.451320+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:54:45.268595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413278+0000","last_change":"2023-12-19T05:46:51.058225+0000","last_active":"2023-12-19T05:46:52.413278+0000","last_peered":"2023-12-19T05:46:52.413278+0000","last_clean":"2023-12-19T05:46:52.413278+0000","last_became_active":"2023-12-19T05:46:51.057256+0000","last_became_peered":"2023-12-19T05:46:51.057256+0000","last_unstale":"2023-12-19T05:46:52.413278+0000","last_undegraded":"2023-12-19T05:46:52.413278+0000","last_fullsized":"2023-12-19T05:46:52.413278+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:57.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"142'8","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453203+0000","last_change":"2023-12-19T05:46:50.540888+0000","last_active":"2023-12-19T05:46:52.453203+0000","last_peered":"2023-12-19T05:46:52.453203+0000","last_clean":"2023-12-19T05:46:52.453203+0000","last_became_active":"2023-12-19T05:46:50.540169+0000","last_became_peered":"2023-12-19T05:46:50.540169+0000","last_unstale":"2023-12-19T05:46:52.453203+0000","last_undegraded":"2023-12-19T05:46:52.453203+0000","last_fullsized":"2023-12-19T05:46:52.453203+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:49.430010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454227+0000","last_change":"2023-12-19T05:46:51.050236+0000","last_active":"2023-12-19T05:46:52.454227+0000","last_peered":"2023-12-19T05:46:52.454227+0000","last_clean":"2023-12-19T05:46:52.454227+0000","last_became_active":"2023-12-19T05:46:51.049995+0000","last_became_peered":"2023-12-19T05:46:51.049995+0000","last_unstale":"2023-12-19T05:46:52.454227+0000","last_undegraded":"2023-12-19T05:46:52.454227+0000","last_fullsized":"2023-12-19T05:46:52.454227+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:14.840396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029807+0000","last_change":"2023-12-19T05:46:50.531621+0000","last_active":"2023-12-19T05:46:52.029807+0000","last_peered":"2023-12-19T05:46:52.029807+0000","last_clean":"2023-12-19T05:46:52.029807+0000","last_became_active":"2023-12-19T05:46:50.531204+0000","last_became_peered":"2023-12-19T05:46:50.531204+0000","last_unstale":"2023-12-19T05:46:52.029807+0000","last_undegraded":"2023-12-19T05:46:52.029807+0000","last_fullsized":"2023-12-19T05:46:52.029807+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:03.192720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452708+0000","last_change":"2023-12-19T05:46:51.058482+0000","last_active":"2023-12-19T05:46:52.452708+0000","last_peered":"2023-12-19T05:46:52.452708+0000","last_clean":"2023-12-19T05:46:52.452708+0000","last_became_active":"2023-12-19T05:46:51.057873+0000","last_became_peered":"2023-12-19T05:46:51.057873+0000","last_unstale":"2023-12-19T05:46:52.452708+0000","last_undegraded":"2023-12-19T05:46:52.452708+0000","last_fullsized":"2023-12-19T05:46:52.452708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:48:18.466951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.455071+0000","last_change":"2023-12-19T05:46:50.532126+0000","last_active":"2023-12-19T05:46:52.455071+0000","last_peered":"2023-12-19T05:46:52.455071+0000","last_clean":"2023-12-19T05:46:52.455071+0000","last_became_active":"2023-12-19T05:46:50.529669+0000","last_became_peered":"2023-12-19T05:46:50.529669+0000","last_unstale":"2023-12-19T05:46:52.455071+0000","last_undegraded":"2023-12-19T05:46:52.455071+0000","last_fullsized":"2023-12-19T05:46:52.455071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:58:40.128513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028325+0000","last_change":"2023-12-19T05:46:51.045350+0000","last_active":"2023-12-19T05:46:52.028325+0000","last_peered":"2023-12-19T05:46:52.028325+0000","last_clean":"2023-12-19T05:46:52.028325+0000","last_became_active":"2023-12-19T05:46:51.045081+0000","last_became_peered":"2023-12-19T05:46:51.045081+0000","last_unstale":"2023-12-19T05:46:52.028325+0000","last_undegraded":"2023-12-19T05:46:52.028325+0000","last_fullsized":"2023-12-19T05:46:52.028325+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:37:31.797992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030085+0000","last_change":"2023-12-19T05:46:50.538404+0000","last_active":"2023-12-19T05:46:52.030085+0000","last_peered":"2023-12-19T05:46:52.030085+0000","last_clean":"2023-12-19T05:46:52.030085+0000","last_became_active":"2023-12-19T05:46:50.538118+0000","last_became_peered":"2023-12-19T05:46:50.538118+0000","last_unstale":"2023-12-19T05:46:52.030085+0000","last_undegraded":"2023-12-19T05:46:52.030085+0000","last_fullsized":"2023-12-19T05:46:52.030085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:39:56.221650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029735+0000","last_change":"2023-12-19T05:46:51.042994+0000","last_active":"2023-12-19T05:46:52.029735+0000","last_peered":"2023-12-19T05:46:52.029735+0000","last_clean":"2023-12-19T05:46:52.029735+0000","last_became_active":"2023-12-19T05:46:51.042603+0000","last_became_peered":"2023-12-19T05:46:51.042603+0000","last_unstale":"2023-12-19T05:46:52.029735+0000","last_undegraded":"2023-12-19T05:46:52.029735+0000","last_fullsized":"2023-12-19T05:46:52.029735+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:27.690050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030228+0000","last_change":"2023-12-19T05:46:50.542415+0000","last_active":"2023-12-19T05:46:52.030228+0000","last_peered":"2023-12-19T05:46:52.030228+0000","last_clean":"2023-12-19T05:46:52.030228+0000","last_became_active":"2023-12-19T05:46:50.541901+0000","last_became_peered":"2023-12-19T05:46:50.541901+0000","last_unstale":"2023-12-19T05:46:52.030228+0000","last_undegraded":"2023-12-19T05:46:52.030228+0000","last_fullsized":"2023-12-19T05:46:52.030228+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:27:32.154536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451387+0000","last_change":"2023-12-19T05:46:51.045052+0000","last_active":"2023-12-19T05:46:52.451387+0000","last_peered":"2023-12-19T05:46:52.451387+0000","last_clean":"2023-12-19T05:46:52.451387+0000","last_became_active":"2023-12-19T05:46:51.044815+0000","last_became_peered":"2023-12-19T05:46:51.044815+0000","last_unstale":"2023-12-19T05:46:52.451387+0000","last_undegraded":"2023-12-19T05:46:52.451387+0000","last_fullsized":"2023-12-19T05:46:52.451387+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:55.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452920+0000","last_change":"2023-12-19T05:46:50.526702+0000","last_active":"2023-12-19T05:46:52.452920+0000","last_peered":"2023-12-19T05:46:52.452920+0000","last_clean":"2023-12-19T05:46:52.452920+0000","last_became_active":"2023-12-19T05:46:50.525795+0000","last_became_peered":"2023-12-19T05:46:50.525795+0000","last_unstale":"2023-12-19T05:46:52.452920+0000","last_undegraded":"2023-12-19T05:46:52.452920+0000","last_fullsized":"2023-12-19T05:46:52.452920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:10:52.676866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453080+0000","last_change":"2023-12-19T05:46:51.046726+0000","last_active":"2023-12-19T05:46:52.453080+0000","last_peered":"2023-12-19T05:46:52.453080+0000","last_clean":"2023-12-19T05:46:52.453080+0000","last_became_active":"2023-12-19T05:46:51.046304+0000","last_became_peered":"2023-12-19T05:46:51.046304+0000","last_unstale":"2023-12-19T05:46:52.453080+0000","last_undegraded":"2023-12-19T05:46:52.453080+0000","last_fullsized":"2023-12-19T05:46:52.453080+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:49.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.452926+0000","last_change":"2023-12-19T05:46:50.543531+0000","last_active":"2023-12-19T05:46:52.452926+0000","last_peered":"2023-12-19T05:46:52.452926+0000","last_clean":"2023-12-19T05:46:52.452926+0000","last_became_active":"2023-12-19T05:46:50.543291+0000","last_became_peered":"2023-12-19T05:46:50.543291+0000","last_unstale":"2023-12-19T05:46:52.452926+0000","last_undegraded":"2023-12-19T05:46:52.452926+0000","last_fullsized":"2023-12-19T05:46:52.452926+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:52:15.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029871+0000","last_change":"2023-12-19T05:46:51.045227+0000","last_active":"2023-12-19T05:46:52.029871+0000","last_peered":"2023-12-19T05:46:52.029871+0000","last_clean":"2023-12-19T05:46:52.029871+0000","last_became_active":"2023-12-19T05:46:51.045005+0000","last_became_peered":"2023-12-19T05:46:51.045005+0000","last_unstale":"2023-12-19T05:46:52.029871+0000","last_undegraded":"2023-12-19T05:46:52.029871+0000","last_fullsized":"2023-12-19T05:46:52.029871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:11:23.342150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413790+0000","last_change":"2023-12-19T05:46:50.542416+0000","last_active":"2023-12-19T05:46:52.413790+0000","last_peered":"2023-12-19T05:46:52.413790+0000","last_clean":"2023-12-19T05:46:52.413790+0000","last_became_active":"2023-12-19T05:46:50.540733+0000","last_became_peered":"2023-12-19T05:46:50.540733+0000","last_unstale":"2023-12-19T05:46:52.413790+0000","last_undegraded":"2023-12-19T05:46:52.413790+0000","last_fullsized":"2023-12-19T05:46:52.413790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:52:04.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454259+0000","last_change":"2023-12-19T05:46:51.056867+0000","last_active":"2023-12-19T05:46:52.454259+0000","last_peered":"2023-12-19T05:46:52.454259+0000","last_clean":"2023-12-19T05:46:52.454259+0000","last_became_active":"2023-12-19T05:46:51.053356+0000","last_became_peered":"2023-12-19T05:46:51.053356+0000","last_unstale":"2023-12-19T05:46:52.454259+0000","last_undegraded":"2023-12-19T05:46:52.454259+0000","last_fullsized":"2023-12-19T05:46:52.454259+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:40:54.139887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413413+0000","last_change":"2023-12-19T05:46:50.537986+0000","last_active":"2023-12-19T05:46:52.413413+0000","last_peered":"2023-12-19T05:46:52.413413+0000","last_clean":"2023-12-19T05:46:52.413413+0000","last_became_active":"2023-12-19T05:46:50.537244+0000","last_became_peered":"2023-12-19T05:46:50.537244+0000","last_unstale":"2023-12-19T05:46:52.413413+0000","last_undegraded":"2023-12-19T05:46:52.413413+0000","last_fullsized":"2023-12-19T05:46:52.413413+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:25:36.374064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029729+0000","last_change":"2023-12-19T05:46:51.050159+0000","last_active":"2023-12-19T05:46:52.029729+0000","last_peered":"2023-12-19T05:46:52.029729+0000","last_clean":"2023-12-19T05:46:52.029729+0000","last_became_active":"2023-12-19T05:46:51.049944+0000","last_became_peered":"2023-12-19T05:46:51.049944+0000","last_unstale":"2023-12-19T05:46:52.029729+0000","last_undegraded":"2023-12-19T05:46:52.029729+0000","last_fullsized":"2023-12-19T05:46:52.029729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:18:14.081668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413709+0000","last_change":"2023-12-19T05:46:50.540380+0000","last_active":"2023-12-19T05:46:52.413709+0000","last_peered":"2023-12-19T05:46:52.413709+0000","last_clean":"2023-12-19T05:46:52.413709+0000","last_became_active":"2023-12-19T05:46:50.540038+0000","last_became_peered":"2023-12-19T05:46:50.540038+0000","last_unstale":"2023-12-19T05:46:52.413709+0000","last_undegraded":"2023-12-19T05:46:52.413709+0000","last_fullsized":"2023-12-19T05:46:52.413709+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:40.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029837+0000","last_change":"2023-12-19T05:46:51.048128+0000","last_active":"2023-12-19T05:46:52.029837+0000","last_peered":"2023-12-19T05:46:52.029837+0000","last_clean":"2023-12-19T05:46:52.029837+0000","last_became_active":"2023-12-19T05:46:51.045622+0000","last_became_peered":"2023-12-19T05:46:51.045622+0000","last_unstale":"2023-12-19T05:46:52.029837+0000","last_undegraded":"2023-12-19T05:46:52.029837+0000","last_fullsized":"2023-12-19T05:46:52.029837+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:09.647836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028063+0000","last_change":"2023-12-19T05:46:50.529676+0000","last_active":"2023-12-19T05:46:52.028063+0000","last_peered":"2023-12-19T05:46:52.028063+0000","last_clean":"2023-12-19T05:46:52.028063+0000","last_became_active":"2023-12-19T05:46:50.529448+0000","last_became_peered":"2023-12-19T05:46:50.529448+0000","last_unstale":"2023-12-19T05:46:52.028063+0000","last_undegraded":"2023-12-19T05:46:52.028063+0000","last_fullsized":"2023-12-19T05:46:52.028063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:51.801576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.454465+0000","last_change":"2023-12-19T05:46:51.055781+0000","last_active":"2023-12-19T05:46:52.454465+0000","last_peered":"2023-12-19T05:46:52.454465+0000","last_clean":"2023-12-19T05:46:52.454465+0000","last_became_active":"2023-12-19T05:46:51.055414+0000","last_became_peered":"2023-12-19T05:46:51.055414+0000","last_unstale":"2023-12-19T05:46:52.454465+0000","last_undegraded":"2023-12-19T05:46:52.454465+0000","last_fullsized":"2023-12-19T05:46:52.454465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:38:15.503012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413700+0000","last_change":"2023-12-19T05:46:50.542768+0000","last_active":"2023-12-19T05:46:52.413700+0000","last_peered":"2023-12-19T05:46:52.413700+0000","last_clean":"2023-12-19T05:46:52.413700+0000","last_became_active":"2023-12-19T05:46:50.539600+0000","last_became_peered":"2023-12-19T05:46:50.539600+0000","last_unstale":"2023-12-19T05:46:52.413700+0000","last_undegraded":"2023-12-19T05:46:52.413700+0000","last_fullsized":"2023-12-19T05:46:52.413700+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:19:01.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029338+0000","last_change":"2023-12-19T05:46:51.057059+0000","last_active":"2023-12-19T05:46:52.029338+0000","last_peered":"2023-12-19T05:46:52.029338+0000","last_clean":"2023-12-19T05:46:52.029338+0000","last_became_active":"2023-12-19T05:46:51.056764+0000","last_became_peered":"2023-12-19T05:46:51.056764+0000","last_unstale":"2023-12-19T05:46:52.029338+0000","last_undegraded":"2023-12-19T05:46:52.029338+0000","last_fullsized":"2023-12-19T05:46:52.029338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:29:58.220005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.413895+0000","last_change":"2023-12-19T05:46:50.541528+0000","last_active":"2023-12-19T05:46:52.413895+0000","last_peered":"2023-12-19T05:46:52.413895+0000","last_clean":"2023-12-19T05:46:52.413895+0000","last_became_active":"2023-12-19T05:46:50.539567+0000","last_became_peered":"2023-12-19T05:46:50.539567+0000","last_unstale":"2023-12-19T05:46:52.413895+0000","last_undegraded":"2023-12-19T05:46:52.413895+0000","last_fullsized":"2023-12-19T05:46:52.413895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:53:48.560691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.451196+0000","last_change":"2023-12-19T05:46:51.057390+0000","last_active":"2023-12-19T05:46:52.451196+0000","last_peered":"2023-12-19T05:46:52.451196+0000","last_clean":"2023-12-19T05:46:52.451196+0000","last_became_active":"2023-12-19T05:46:51.057249+0000","last_became_peered":"2023-12-19T05:46:51.057249+0000","last_unstale":"2023-12-19T05:46:52.451196+0000","last_undegraded":"2023-12-19T05:46:52.451196+0000","last_fullsized":"2023-12-19T05:46:52.451196+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:03.721747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.028160+0000","last_change":"2023-12-19T05:46:50.530709+0000","last_active":"2023-12-19T05:46:52.028160+0000","last_peered":"2023-12-19T05:46:52.028160+0000","last_clean":"2023-12-19T05:46:52.028160+0000","last_became_active":"2023-12-19T05:46:50.527762+0000","last_became_peered":"2023-12-19T05:46:50.527762+0000","last_unstale":"2023-12-19T05:46:52.028160+0000","last_undegraded":"2023-12-19T05:46:52.028160+0000","last_fullsized":"2023-12-19T05:46:52.028160+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:27:40.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029991+0000","last_change":"2023-12-19T05:46:51.052772+0000","last_active":"2023-12-19T05:46:52.029991+0000","last_peered":"2023-12-19T05:46:52.029991+0000","last_clean":"2023-12-19T05:46:52.029991+0000","last_became_active":"2023-12-19T05:46:51.052605+0000","last_became_peered":"2023-12-19T05:46:51.052605+0000","last_unstale":"2023-12-19T05:46:52.029991+0000","last_undegraded":"2023-12-19T05:46:52.029991+0000","last_fullsized":"2023-12-19T05:46:52.029991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:33.852816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030456+0000","last_change":"2023-12-19T05:46:50.538962+0000","last_active":"2023-12-19T05:46:52.030456+0000","last_peered":"2023-12-19T05:46:52.030456+0000","last_clean":"2023-12-19T05:46:52.030456+0000","last_became_active":"2023-12-19T05:46:50.538647+0000","last_became_peered":"2023-12-19T05:46:50.538647+0000","last_unstale":"2023-12-19T05:46:52.030456+0000","last_undegraded":"2023-12-19T05:46:52.030456+0000","last_fullsized":"2023-12-19T05:46:52.030456+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:35:47.415206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029464+0000","last_change":"2023-12-19T05:46:51.037081+0000","last_active":"2023-12-19T05:46:52.029464+0000","last_peered":"2023-12-19T05:46:52.029464+0000","last_clean":"2023-12-19T05:46:52.029464+0000","last_became_active":"2023-12-19T05:46:51.036845+0000","last_became_peered":"2023-12-19T05:46:51.036845+0000","last_unstale":"2023-12-19T05:46:52.029464+0000","last_undegraded":"2023-12-19T05:46:52.029464+0000","last_fullsized":"2023-12-19T05:46:52.029464+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:55.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.453312+0000","last_change":"2023-12-19T05:46:50.540712+0000","last_active":"2023-12-19T05:46:52.453312+0000","last_peered":"2023-12-19T05:46:52.453312+0000","last_clean":"2023-12-19T05:46:52.453312+0000","last_became_active":"2023-12-19T05:46:50.539906+0000","last_became_peered":"2023-12-19T05:46:50.539906+0000","last_unstale":"2023-12-19T05:46:52.453312+0000","last_undegraded":"2023-12-19T05:46:52.453312+0000","last_fullsized":"2023-12-19T05:46:52.453312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:29:57.205794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.029808+0000","last_change":"2023-12-19T05:46:51.049860+0000","last_active":"2023-12-19T05:46:52.029808+0000","last_peered":"2023-12-19T05:46:52.029808+0000","last_clean":"2023-12-19T05:46:52.029808+0000","last_became_active":"2023-12-19T05:46:51.049274+0000","last_became_peered":"2023-12-19T05:46:51.049274+0000","last_unstale":"2023-12-19T05:46:52.029808+0000","last_undegraded":"2023-12-19T05:46:52.029808+0000","last_fullsized":"2023-12-19T05:46:52.029808+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:38.393960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.030035+0000","last_change":"2023-12-19T05:46:50.531445+0000","last_active":"2023-12-19T05:46:52.030035+0000","last_peered":"2023-12-19T05:46:52.030035+0000","last_clean":"2023-12-19T05:46:52.030035+0000","last_became_active":"2023-12-19T05:46:50.530922+0000","last_became_peered":"2023-12-19T05:46:50.530922+0000","last_unstale":"2023-12-19T05:46:52.030035+0000","last_undegraded":"2023-12-19T05:46:52.030035+0000","last_fullsized":"2023-12-19T05:46:52.030035+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:52:04.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-12-19T05:46:52.412829+0000","last_change":"2023-12-19T05:46:51.050370+0000","last_active":"2023-12-19T05:46:52.412829+0000","last_peered":"2023-12-19T05:46:52.412829+0000","last_clean":"2023-12-19T05:46:52.412829+0000","last_became_active":"2023-12-19T05:46:51.046750+0000","last_became_peered":"2023-12-19T05:46:51.046750+0000","last_unstale":"2023-12-19T05:46:52.412829+0000","last_undegraded":"2023-12-19T05:46:52.412829+0000","last_fullsized":"2023-12-19T05:46:52.412829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:50.497992+0000","last_clean_scrub_stamp":"2023-12-19T05:46:50.497992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:10.691769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.032613+0000","last_change":"2023-12-19T05:46:50.541076+0000","last_active":"2023-12-19T05:46:51.032613+0000","last_peered":"2023-12-19T05:46:51.032613+0000","last_clean":"2023-12-19T05:46:51.032613+0000","last_became_active":"2023-12-19T05:46:50.540721+0000","last_became_peered":"2023-12-19T05:46:50.540721+0000","last_unstale":"2023-12-19T05:46:51.032613+0000","last_undegraded":"2023-12-19T05:46:51.032613+0000","last_fullsized":"2023-12-19T05:46:51.032613+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:46:49.483782+0000","last_clean_scrub_stamp":"2023-12-19T05:46:49.483782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:32.838606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":277,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-19T05:46:51.040401+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:46:51.040401+0000","last_peered":"2023-12-19T05:46:51.040401+0000","last_clean":"2023-12-19T05:46:51.040401+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:46:51.040401+0000","last_undegraded":"2023-12-19T05:46:51.040401+0000","last_fullsized":"2023-12-19T05:46:51.040401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.1739999999999999,"15min":1.0669999999999999},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":6.4429999999999996,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1639999999999999,"15min":1.0800000000000001},"min":{"1min":0.79000000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6259999999999999,"5min":3.976,"15min":3.976},"last":1.4119999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.218,"15min":1.1040000000000001},"min":{"1min":0.73199999999999998,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.83999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1720000000000002,"5min":4.25,"15min":4.25},"last":1.1459999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.738,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.3640000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.349,"15min":1.1990000000000001},"min":{"1min":1.0129999999999999,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.4139999999999999,"15min":1.335},"min":{"1min":1.0249999999999999,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":2.327,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.298}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.171,"15min":1.0680000000000001},"min":{"1min":0.85599999999999998,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.653,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.3480000000000001,"15min":1.274},"min":{"1min":0.81699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.2290000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3740000000000001,"15min":1.3280000000000001},"min":{"1min":0.75900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.952,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3220000000000001,"15min":1.25},"min":{"1min":0.77800000000000002,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":2.0550000000000002,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.46}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4730000000000001,"15min":1.357},"min":{"1min":0.89800000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.121,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.569},{"interface":"front","average":{"1min":1.78,"5min":1.569,"15min":1.4279999999999999},"min":{"1min":1.1579999999999999,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":6.3369999999999997,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.77}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.02,"15min":1.1910000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4850000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":1.496},{"interface":"front","average":{"1min":1.004,"5min":1.054,"15min":1.034},"min":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.46500000000000002},"max":{"1min":1.3959999999999999,"5min":1.635,"15min":1.635},"last":1.216}]},{"osd":1,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1930000000000001,"15min":1.1539999999999999},"min":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.704,"5min":1.792,"15min":1.792},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.202,"15min":1.294},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6339999999999999,"5min":1.8120000000000001,"15min":3.4670000000000001},"last":1.625}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1339999999999999,"15min":1.1779999999999999},"min":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4350000000000001,"5min":1.823,"15min":2},"last":1},{"interface":"front","average":{"1min":1.165,"5min":1.1899999999999999,"15min":1.284},"min":{"1min":0.74399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.583,"5min":1.9490000000000001,"15min":3.5859999999999999},"last":1.2709999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.153,"15min":1.3180000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70799999999999996},"max":{"1min":1.534,"5min":1.7050000000000001,"15min":4.5220000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2549999999999999,"15min":1.3460000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.617,"5min":2.0059999999999998,"15min":4.452},"last":1.1699999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1910000000000001,"15min":1.3089999999999999},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48899999999999999},"max":{"1min":1.506,"5min":2.0720000000000001,"15min":2.7130000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2030000000000001,"15min":1.4039999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":4.6689999999999996},"last":1.458}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.5329999999999999},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7629999999999999,"5min":2.1480000000000001,"15min":4.5670000000000002},"last":1.423},{"interface":"front","average":{"1min":1.367,"5min":1.427,"15min":1.6739999999999999},"min":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"max":{"1min":1.718,"5min":2.21,"15min":3.681},"last":1.6739999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.389,"15min":1.5009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.972,"15min":3.2719999999999998},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4990000000000001,"15min":1.5940000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8080000000000001,"5min":2.02,"15min":4.7480000000000002},"last":1.5289999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193958,"statfs":{"total":200000000,"available":198613175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1890000000000001,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9620000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1559999999999999,"15min":1.1180000000000001},"min":{"1min":0.65200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.641},"last":1.024}]},{"osd":1,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2350000000000001,"15min":1.242},"min":{"1min":0.71599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3600000000000001,"15min":1.3680000000000001},"min":{"1min":0.80700000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":6.8700000000000001,"15min":6.8700000000000001},"last":0.874}]},{"osd":2,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.69299999999999995},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.202,"15min":1.2210000000000001},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":0.77900000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.363,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.774,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3440000000000001,"15min":1.419},"min":{"1min":0.84899999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.2889999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.2889999999999999,"15min":1.454},"min":{"1min":0.94999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.2040000000000002,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":1.2},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.389,"15min":1.5580000000000001},"min":{"1min":0.877,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.0499999999999998,"5min":7.0469999999999997,"15min":7.0469999999999997},"last":1.258}]},{"osd":6,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.411,"15min":1.496},"min":{"1min":0.96299999999999997,"5min":0.68700000000000006,"15min":0.59099999999999997},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.405,"15min":1.6180000000000001},"min":{"1min":1.1739999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.3500000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5609999999999999,"15min":1.6899999999999999},"min":{"1min":0.94599999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":3.2639999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.5880000000000001,"15min":1.619},"min":{"1min":1.1559999999999999,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.5169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208281,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.05,"15min":1.018},"min":{"1min":0.60799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.6060000000000001},"last":1.095},{"interface":"front","average":{"1min":1.179,"5min":1.1259999999999999,"15min":1.0740000000000001},"min":{"1min":0.80600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.6240000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.204,"15min":1.077},"min":{"1min":0.81100000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6659999999999999,"5min":1.954,"15min":1.954},"last":1.5329999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.216,"15min":1.2030000000000001},"min":{"1min":0.75700000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.704,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7809999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.6399999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.216,"15min":1.099},"min":{"1min":0.78400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.3520000000000001,"15min":1.2989999999999999},"min":{"1min":0.89700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8400000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.3740000000000001,"15min":1.351},"min":{"1min":0.78900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.825},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4099999999999999,"15min":1.3080000000000001},"min":{"1min":0.66500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5880000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.421,"15min":1.379},"min":{"1min":0.80500000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.339},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4530000000000001,"15min":1.409},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9930000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.76}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.3740000000000001},"min":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.589,"5min":1.5349999999999999,"15min":1.4750000000000001},"min":{"1min":0.871,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.431}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203635,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.872,"15min":0.82899999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3380000000000001,"5min":1.99,"15min":1.99},"last":0.628},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3939999999999999,"5min":1.72,"15min":1.72},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.556,"5min":1.6060000000000001,"15min":2.702},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.502,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.0920000000000001,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.2090000000000001,"15min":1.0960000000000001},"min":{"1min":0.58599999999999997,"5min":0.46600000000000003,"15min":0.45600000000000002},"max":{"1min":1.7310000000000001,"5min":2.931,"15min":2.931},"last":1.2390000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1759999999999999,"15min":1.1579999999999999},"min":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.304,"15min":1.294},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.1579999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3759999999999999,"15min":1.3300000000000001},"min":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.391,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.399,"15min":1.357},"min":{"1min":0.85399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5449999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.51}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.431,"15min":1.3740000000000001},"min":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":2.427,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.645},{"interface":"front","average":{"1min":1.333,"5min":1.337,"15min":1.327},"min":{"1min":0.74199999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8480000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.6919999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.389},"min":{"1min":0.85499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0550000000000002,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.4330000000000001,"15min":1.427},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.4710000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209297,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.85499999999999998,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.47499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3109999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.137,"15min":1.0600000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.872},{"interface":"front","average":{"1min":1.222,"5min":1.2609999999999999,"15min":1.167},"min":{"1min":0.65500000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98999999999999999,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.339,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.21,"15min":1.1020000000000001},"min":{"1min":0.65800000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.714,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5960000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.373,"15min":1.28},"min":{"1min":0.90100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.982,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.298},{"interface":"front","average":{"1min":1.224,"5min":1.333,"15min":1.2470000000000001},"min":{"1min":0.89500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.736,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.71}]},{"osd":5,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3859999999999999,"15min":1.2969999999999999},"min":{"1min":0.93300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.853,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.3320000000000001,"15min":1.2969999999999999},"min":{"1min":0.90400000000000003,"5min":0.81499999999999995,"15min":0.72699999999999998},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.093}]},{"osd":6,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3440000000000001,"15min":1.294},"min":{"1min":0.87,"5min":0.87,"15min":0.83599999999999997},"max":{"1min":1.704,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.339},{"interface":"front","average":{"1min":1.508,"5min":1.4670000000000001,"15min":1.3480000000000001},"min":{"1min":1.0589999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0430000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.6859999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:03 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5089999999999999,"15min":1.4239999999999999},"min":{"1min":1.1200000000000001,"5min":0.92100000000000004,"15min":0.84799999999999998},"max":{"1min":1.78,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.629},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.5369999999999999,"15min":1.4430000000000001},"min":{"1min":0.94899999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":9.5359999999999996,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.401}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193964,"statfs":{"total":200000000,"available":198619567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.59899999999999998,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.1839999999999999,"5min":2.1110000000000002,"15min":2.992},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0369999999999999},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2270000000000001,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.194,"5min":1.742,"15min":2.2789999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.859,"15min":1.337},"min":{"1min":0.60699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.488,"5min":70.206000000000003,"15min":70.206000000000003},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3540000000000001,"15min":1.3300000000000001},"min":{"1min":0.81999999999999995,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":1.663,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.29,"15min":1.2430000000000001},"min":{"1min":0.71099999999999997,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":1.827,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.306}]},{"osd":4,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3839999999999999,"15min":1.238},"min":{"1min":0.874,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":1.893,"5min":5.3860000000000001,"15min":5.3860000000000001},"last":1.002},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4550000000000001,"15min":1.395},"min":{"1min":0.91400000000000003,"5min":0.79700000000000004,"15min":0.78900000000000003},"max":{"1min":2.117,"5min":4.306,"15min":4.306},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.3680000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68400000000000005},"max":{"1min":1.899,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1.46},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.48,"15min":1.3779999999999999},"min":{"1min":0.86799999999999999,"5min":0.753,"15min":0.67900000000000005},"max":{"1min":2.2069999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":1.339}]},{"osd":6,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5669999999999999,"15min":1.446},"min":{"1min":0.85299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.9359999999999999,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":1.53},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.534,"15min":1.4410000000000001},"min":{"1min":0.97699999999999998,"5min":0.83999999999999997,"15min":0.70199999999999996},"max":{"1min":2.3170000000000002,"5min":3.75,"15min":3.75},"last":1.2789999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.6599999999999999,"15min":1.5449999999999999},"min":{"1min":1.0880000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.9850000000000001,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.583,"5min":1.702,"15min":1.617},"min":{"1min":0.89100000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.1019999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.788}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.80200000000000005},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.95799999999999996,"15min":0.89400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.306,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84399999999999997}]},{"osd":2,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.105,"15min":1.0649999999999999},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6719999999999999,"5min":1.825,"15min":1.825},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.165,"15min":1.147},"min":{"1min":0.52800000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5109999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3129999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.88800000000000001},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.48199999999999998},"max":{"1min":1.304,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.155,"15min":1.0760000000000001},"min":{"1min":0.61399999999999999,"5min":0.53900000000000003,"15min":0.45900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2609999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.23,"15min":1.169},"min":{"1min":0.75700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7589999999999999,"5min":1.845,"15min":1.845},"last":1.083},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3680000000000001,"15min":1.278},"min":{"1min":1.0069999999999999,"5min":0.69499999999999995,"15min":0.68400000000000005},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.4730000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3799999999999999,"15min":1.323},"min":{"1min":0.93200000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.885,"5min":2.173,"15min":2.173},"last":1.202},{"interface":"front","average":{"1min":1.345,"5min":1.3620000000000001,"15min":1.292},"min":{"1min":0.90300000000000002,"5min":0.82199999999999995,"15min":0.71599999999999997},"max":{"1min":1.8340000000000001,"5min":1.879,"15min":1.879},"last":1.181}]},{"osd":6,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4470000000000001,"15min":1.399},"min":{"1min":0.92300000000000004,"5min":0.85299999999999998,"15min":0.76300000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.756},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.365,"15min":1.2889999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8089999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.5129999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:46:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.484,"15min":1.427},"min":{"1min":1.022,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.964,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.446,"15min":1.3819999999999999},"min":{"1min":0.82999999999999996,"5min":0.78700000000000003,"15min":0.76700000000000002},"max":{"1min":1.8500000000000001,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.375}]}]}],"pool_statfs":[]}} 2023-12-19T05:46:56.592 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:46:56.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.878+0000 7ff5bad55640 1 Processor -- start 2023-12-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.878+0000 7ff5bad55640 1 -- start start 2023-12-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5b413df70 0x7ff5b4141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5b40659d0 0x7ff5b4065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b40cee90 0x7ff5b40cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40663c0 con 0x7ff5b40659d0 2023-12-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b41417c0 con 0x7ff5b413df70 2023-12-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5bad55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415bb10 con 0x7ff5b40cee90 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5abfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5b40659d0 0x7ff5b4065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5abfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5b40659d0 0x7ff5b4065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52138/0 (socket says 172.21.15.49:52138) 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.880+0000 7ff5abfff640 1 -- 172.21.15.49:0/806392943 learned_addr learned my addr 172.21.15.49:0/806392943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5b92f2640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b40cee90 0x7ff5b40cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5b8af1640 1 --2- 172.21.15.49:0/806392943 >> v2:172.21.15.115:3300/0 conn(0x7ff5b413df70 0x7ff5b4141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5abfff640 1 -- 172.21.15.49:0/806392943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b40cee90 msgr2=0x7ff5b40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5abfff640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b40cee90 0x7ff5b40cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5abfff640 1 -- 172.21.15.49:0/806392943 >> v2:172.21.15.115:3300/0 conn(0x7ff5b413df70 msgr2=0x7ff5b4141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5abfff640 1 --2- 172.21.15.49:0/806392943 >> v2:172.21.15.115:3300/0 conn(0x7ff5b413df70 0x7ff5b4141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.881+0000 7ff5abfff640 1 -- 172.21.15.49:0/806392943 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b415bdf0 con 0x7ff5b40659d0 2023-12-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.882+0000 7ff5abfff640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40659d0 0x7ff5b4065e80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40cfec0 tx=0x7ff5a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa6a117f89c431d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.882+0000 7ff5ab7fe640 1 -- 172.21.15.49:0/806392943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4031870 con 0x7ff5b40659d0 2023-12-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.882+0000 7ff5ab7fe640 1 -- 172.21.15.49:0/806392943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40319d0 con 0x7ff5b40659d0 2023-12-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.882+0000 7ff5ab7fe640 1 -- 172.21.15.49:0/806392943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4031d60 con 0x7ff5b40659d0 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 -- 172.21.15.49:0/806392943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40659d0 msgr2=0x7ff5b4065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40659d0 0x7ff5b4065e80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40cfec0 tx=0x7ff5a402b910 comp rx=0 tx=0).stop 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 -- 172.21.15.49:0/806392943 shutdown_connections 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b40cee90 0x7ff5b40cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 --2- 172.21.15.49:0/806392943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40659d0 0x7ff5b4065e80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 --2- 172.21.15.49:0/806392943 >> v2:172.21.15.115:3300/0 conn(0x7ff5b413df70 0x7ff5b4141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 -- 172.21.15.49:0/806392943 >> 172.21.15.49:0/806392943 conn(0x7ff5b406f160 msgr2=0x7ff5b406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 -- 172.21.15.49:0/806392943 shutdown_connections 2023-12-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.883+0000 7ff5bad55640 1 -- 172.21.15.49:0/806392943 wait complete. 2023-12-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.885+0000 7ff5bad55640 1 Processor -- start 2023-12-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.885+0000 7ff5bad55640 1 -- start start 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 0x7ff5b4140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b413df70 0x7ff5b413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b413f880 con 0x7ff5b40cee90 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b413fb60 con 0x7ff5b40659d0 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5bad55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b413fe40 con 0x7ff5b413df70 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.886+0000 7ff5abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52154/0 (socket says 172.21.15.49:52154) 2023-12-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 -- 172.21.15.49:0/3722210762 learned_addr learned my addr 172.21.15.49:0/3722210762 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5b8af1640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 0x7ff5b4140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5b92f2640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b413df70 0x7ff5b413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 -- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b413df70 msgr2=0x7ff5b413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b413df70 0x7ff5b413ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 -- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 msgr2=0x7ff5b4140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 0x7ff5b4140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 -- 172.21.15.49:0/3722210762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40094d0 con 0x7ff5b40cee90 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5b8af1640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 0x7ff5b4140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.887+0000 7ff5abfff640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402b950 tx=0x7ff5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.888+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a403ad30 con 0x7ff5b40cee90 2023-12-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.888+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40443f0 con 0x7ff5b40cee90 2023-12-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.888+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40447a0 con 0x7ff5b40cee90 2023-12-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.888+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4140120 con 0x7ff5b40cee90 2023-12-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.888+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b4155da0 con 0x7ff5b40cee90 2023-12-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.889+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4061910 con 0x7ff5b40cee90 2023-12-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.890+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5a404d450 con 0x7ff5b40cee90 2023-12-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.891+0000 7ff5a97fa640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.892+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7ff5a402d040 con 0x7ff5b40cee90 2023-12-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.892+0000 7ff5b8af1640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:56.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.893+0000 7ff5b8af1640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 0x7ff5a006c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006fd0 tx=0x7ff5b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:56.897+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5a4076540 con 0x7ff5b40cee90 2023-12-19T05:46:57.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.161+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff5b40c4de0 con 0x7ff5b40cee90 2023-12-19T05:46:57.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.171+0000 7ff5a97fa640 1 -- 172.21.15.49:0/3722210762 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff5a4035020 con 0x7ff5b40cee90 2023-12-19T05:46:57.173 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 msgr2=0x7ff5a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 0x7ff5a006c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006fd0 tx=0x7ff5b0008040 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 msgr2=0x7ff5b413bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402b950 tx=0x7ff5a40046c0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 shutdown_connections 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5b413df70 0x7ff5b413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b40cee90 0x7ff5b413bc80 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 --2- 172.21.15.49:0/3722210762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5b40659d0 0x7ff5b4140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 >> 172.21.15.49:0/3722210762 conn(0x7ff5b406f160 msgr2=0x7ff5b40c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:57.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 shutdown_connections 2023-12-19T05:46:57.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.174+0000 7ff5bad55640 1 -- 172.21.15.49:0/3722210762 wait complete. 2023-12-19T05:46:57.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:46:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.420+0000 7f2a82c04640 1 Processor -- start 2023-12-19T05:46:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.420+0000 7f2a82c04640 1 -- start start 2023-12-19T05:46:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.422+0000 7f2a82c04640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a7c0b2460 0x7f2a7c070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.422+0000 7f2a82c04640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.422+0000 7f2a82c04640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c15dc30 con 0x7f2a7c157c50 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.422+0000 7f2a82c04640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c15e8b0 con 0x7f2a7c0b2460 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.422+0000 7f2a82c04640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15df10 con 0x7f2a7c0b6960 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.423+0000 7f2a809a0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a7c0b2460 0x7f2a7c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.423+0000 7f2a811a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.423+0000 7f2a811a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:52018/0 (socket says 172.21.15.49:52018) 2023-12-19T05:46:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.423+0000 7f2a809a0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a7c0b2460 0x7f2a7c070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:33692/0 (socket says 172.21.15.49:33692) 2023-12-19T05:46:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.423+0000 7f2a811a1640 1 -- 172.21.15.49:0/1293504562 learned_addr learned my addr 172.21.15.49:0/1293504562 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.424+0000 7f2a809a0640 1 -- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 msgr2=0x7f2a7c0b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.424+0000 7f2a809a0640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.424+0000 7f2a809a0640 1 -- 172.21.15.49:0/1293504562 >> v1:172.21.15.115:6789/0 conn(0x7f2a7c157c50 legacy=0x7f2a7c0b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.424+0000 7f2a809a0640 1 -- 172.21.15.49:0/1293504562 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c15e1f0 con 0x7f2a7c0b2460 2023-12-19T05:46:57.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.424+0000 7f2a811a1640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:46:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.426+0000 7f2a809a0640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b2460 0x7f2a7c070740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2a780097a0 tx=0x7f2a7802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fba9d0cca51095 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.426+0000 7f2a737fe640 1 -- 172.21.15.49:0/1293504562 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7802d040 con 0x7f2a7c0b2460 2023-12-19T05:46:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.426+0000 7f2a737fe640 1 -- 172.21.15.49:0/1293504562 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a78031810 con 0x7f2a7c0b2460 2023-12-19T05:46:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.426+0000 7f2a737fe640 1 -- 172.21.15.49:0/1293504562 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78031ba0 con 0x7f2a7c0b2460 2023-12-19T05:46:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 -- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b2460 msgr2=0x7f2a7c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b2460 0x7f2a7c070740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2a780097a0 tx=0x7f2a7802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 -- 172.21.15.49:0/1293504562 shutdown_connections 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b6960 0x7f2a7c0b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1293504562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b2460 0x7f2a7c070740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 -- 172.21.15.49:0/1293504562 >> 172.21.15.49:0/1293504562 conn(0x7f2a7c0659d0 msgr2=0x7f2a7c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 -- 172.21.15.49:0/1293504562 shutdown_connections 2023-12-19T05:46:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.427+0000 7f2a82c04640 1 -- 172.21.15.49:0/1293504562 wait complete. 2023-12-19T05:46:57.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.429+0000 7f2a82c04640 1 Processor -- start 2023-12-19T05:46:57.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.429+0000 7f2a82c04640 1 -- start start 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b2460 0x7f2a7c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b6960 0x7f2a7c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c159a50 con 0x7f2a7c157c50 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c159490 con 0x7f2a7c0b6960 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a82c04640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c159770 con 0x7f2a7c0b2460 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a811a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a811a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52160/0 (socket says 172.21.15.49:52160) 2023-12-19T05:46:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.430+0000 7f2a811a1640 1 -- 172.21.15.49:0/1759958828 learned_addr learned my addr 172.21.15.49:0/1759958828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a809a0640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b2460 0x7f2a7c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a73fff640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b6960 0x7f2a7c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 -- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b2460 msgr2=0x7f2a7c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b2460 0x7f2a7c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 -- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b6960 msgr2=0x7f2a7c14a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b6960 0x7f2a7c14a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 -- 172.21.15.49:0/1759958828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009b30 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.431+0000 7f2a811a1640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400efc0 tx=0x7f2a7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.432+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74018070 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.432+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400f040 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.432+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400ce00 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.432+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a78009400 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.432+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c15a4e0 con 0x7f2a7c157c50 2023-12-19T05:46:57.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.433+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c06d8d0 con 0x7f2a7c157c50 2023-12-19T05:46:57.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.434+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a74014480 con 0x7f2a7c157c50 2023-12-19T05:46:57.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.435+0000 7f2a717fa640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 0x7f2a6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:57.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.435+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f2a74088c40 con 0x7f2a7c157c50 2023-12-19T05:46:57.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.436+0000 7f2a809a0640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 0x7f2a6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:57.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.437+0000 7f2a809a0640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 0x7f2a6806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2a78036000 tx=0x7f2a7803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:57.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.439+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a7c06d8d0 con 0x7f2a7c157c50 2023-12-19T05:46:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.672+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a7c06d8d0 con 0x7f2a7c157c50 2023-12-19T05:46:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.673+0000 7f2a717fa640 1 -- 172.21.15.49:0/1759958828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f2a7c06d8d0 con 0x7f2a7c157c50 2023-12-19T05:46:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:46:57.675 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:46:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.675+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 msgr2=0x7f2a6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.675+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 0x7f2a6806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2a78036000 tx=0x7f2a7803c040 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 msgr2=0x7f2a7c14ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400efc0 tx=0x7f2a7400c490 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 shutdown_connections 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2a6806a430 0x7f2a6806c8f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a7c157c50 0x7f2a7c14ab10 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a7c0b6960 0x7f2a7c14a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 --2- 172.21.15.49:0/1759958828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a7c0b2460 0x7f2a7c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 >> 172.21.15.49:0/1759958828 conn(0x7f2a7c0659d0 msgr2=0x7f2a7c0b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 shutdown_connections 2023-12-19T05:46:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:57.676+0000 7f2a82c04640 1 -- 172.21.15.49:0/1759958828 wait complete. 2023-12-19T05:46:57.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:57.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:58.098 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:46:51.014087+0000', 'modified': '2023-12-19T05:46:54.529180+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7632}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7632': {'gid': 7632, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/3042568277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 3042568277}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 3042568277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:46:58.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:46:58.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:46:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.341+0000 7f00af59e640 1 Processor -- start 2023-12-19T05:46:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.342+0000 7f00af59e640 1 -- start start 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.343+0000 7f00af59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00b0159e40 0x7f00b00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.343+0000 7f00af59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.343+0000 7f00af59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b006b3a0 con 0x7f00b00b0830 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.343+0000 7f00af59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00b23e0 con 0x7f00b0159e40 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.343+0000 7f00af59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b0ca0 con 0x7f00b00cd430 2023-12-19T05:46:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00b0159e40 0x7f00b00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00b0159e40 0x7f00b00b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52170/0 (socket says 172.21.15.49:52170) 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 -- 172.21.15.49:0/882693544 learned_addr learned my addr 172.21.15.49:0/882693544 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00a7fff640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 -- 172.21.15.49:0/882693544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 msgr2=0x7f00b00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 -- 172.21.15.49:0/882693544 >> v1:172.21.15.115:6789/0 conn(0x7f00b00b0830 legacy=0x7f00b015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.344+0000 7f00ae59c640 1 -- 172.21.15.49:0/882693544 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00cd8a0 con 0x7f00b0159e40 2023-12-19T05:46:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.345+0000 7f00ae59c640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b0159e40 0x7f00b00b1230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f00a00098a0 tx=0x7f00a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38340692de69e9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.346+0000 7f00add9b640 1 -- 172.21.15.49:0/882693544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0030840 con 0x7f00b0159e40 2023-12-19T05:46:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.346+0000 7f00add9b640 1 -- 172.21.15.49:0/882693544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00309a0 con 0x7f00b0159e40 2023-12-19T05:46:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.346+0000 7f00add9b640 1 -- 172.21.15.49:0/882693544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0030d30 con 0x7f00b0159e40 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 -- 172.21.15.49:0/882693544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b0159e40 msgr2=0x7f00b00b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b0159e40 0x7f00b00b1230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f00a00098a0 tx=0x7f00a002b980 comp rx=0 tx=0).stop 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 -- 172.21.15.49:0/882693544 shutdown_connections 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 --2- 172.21.15.49:0/882693544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b0159e40 0x7f00b00b1230 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 -- 172.21.15.49:0/882693544 >> 172.21.15.49:0/882693544 conn(0x7f00b00659a0 msgr2=0x7f00b0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 -- 172.21.15.49:0/882693544 shutdown_connections 2023-12-19T05:46:58.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.347+0000 7f00af59e640 1 -- 172.21.15.49:0/882693544 wait complete. 2023-12-19T05:46:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.349+0000 7f00af59e640 1 Processor -- start 2023-12-19T05:46:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.349+0000 7f00af59e640 1 -- start start 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b0159e40 0x7f00b00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01583a0 con 0x7f00b00b0830 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0158680 con 0x7f00b0159e40 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00af59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00a84a0 con 0x7f00b00cd430 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52178/0 (socket says 172.21.15.49:52178) 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 -- 172.21.15.49:0/290170632 learned_addr learned my addr 172.21.15.49:0/290170632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 -- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 msgr2=0x7f00b00aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 -- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b0159e40 msgr2=0x7f00b00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b0159e40 0x7f00b00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.350+0000 7f00ae59c640 1 -- 172.21.15.49:0/290170632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00094d0 con 0x7f00b00b0830 2023-12-19T05:46:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00ae59c640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f00a00098a0 tx=0x7f00a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00a6ffd640 1 -- 172.21.15.49:0/290170632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0047070 con 0x7f00b00b0830 2023-12-19T05:46:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00a6ffd640 1 -- 172.21.15.49:0/290170632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00307f0 con 0x7f00b00b0830 2023-12-19T05:46:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00a6ffd640 1 -- 172.21.15.49:0/290170632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0043400 con 0x7f00b00b0830 2023-12-19T05:46:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00a8780 con 0x7f00b00b0830 2023-12-19T05:46:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.351+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b0145c80 con 0x7f00b00b0830 2023-12-19T05:46:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.353+0000 7f00a6ffd640 1 -- 172.21.15.49:0/290170632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f00a004c410 con 0x7f00b00b0830 2023-12-19T05:46:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.355+0000 7f00a6ffd640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 0x7f009006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.355+0000 7f00a6ffd640 1 -- 172.21.15.49:0/290170632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f00a003e070 con 0x7f00b00b0830 2023-12-19T05:46:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.356+0000 7f00a7fff640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 0x7f009006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.356+0000 7f00b79d3740 1 Processor -- start 2023-12-19T05:46:58.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.356+0000 7f00b79d3740 1 -- start start 2023-12-19T05:46:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befad62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00a7fff640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 0x7f009006c8f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 0x555befad36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befa15f80 con 0x555befaa5e90 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befa13710 con 0x555befaa9a90 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555befa0f000 con 0x555befad5f10 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52180/0 (socket says 172.21.15.49:52180) 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.357+0000 7f00a7fff640 1 -- 172.21.15.49:0/730256784 learned_addr learned my addr 172.21.15.49:0/730256784 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00ae59c640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befad62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00aed9d640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 0x555befad36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 -- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 msgr2=0x555befad62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befad62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 -- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 msgr2=0x555befad36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 0x555befad36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 -- 172.21.15.49:0/730256784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bef9d6690 con 0x555befaa5e90 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00aed9d640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 0x555befad36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:46:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.358+0000 7f00a7fff640 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f009800cac0 tx=0x7f009800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaf62819e1b60b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f008ffff640 1 -- 172.21.15.49:0/730256784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098013b80 con 0x555befaa5e90 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f008ffff640 1 -- 172.21.15.49:0/730256784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098013ce0 con 0x555befaa5e90 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f008ffff640 1 -- 172.21.15.49:0/730256784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009801d630 con 0x555befaa5e90 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 -- 172.21.15.49:0/730256784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 msgr2=0x555befad3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f009800cac0 tx=0x7f009800f000 comp rx=0 tx=0).stop 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 -- 172.21.15.49:0/730256784 shutdown_connections 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befaa9a90 0x555befad36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa5e90 0x555befad3180 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 --2- 172.21.15.49:0/730256784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befad62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 -- 172.21.15.49:0/730256784 >> 172.21.15.49:0/730256784 conn(0x555befaa81a0 msgr2=0x555befaf0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 -- 172.21.15.49:0/730256784 shutdown_connections 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.359+0000 7f00b79d3740 1 -- 172.21.15.49:0/730256784 wait complete. 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.360+0000 7f00b79d3740 1 -- start start 2023-12-19T05:46:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.360+0000 7f00b79d3740 1 Processor -- start 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befaf3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bef9b07d0 con 0x555befaa9a90 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bef9b0470 con 0x555befac30b0 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bef776f20 con 0x555befad5f10 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00b79d3740 10 client.0 _ll_register_callbacks cb 0x555bef9ff1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.361+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52192/0 (socket says 172.21.15.49:52192) 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 -- 172.21.15.49:0/55398325 learned_addr learned my addr 172.21.15.49:0/55398325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00a7fff640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00aed9d640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befaf3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 -- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 msgr2=0x555befac2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 -- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 msgr2=0x555befaf3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befaf3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 -- 172.21.15.49:0/55398325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009800c7a0 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f00ae59c640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f00a007a2f0 tx=0x7f00a007a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d63e4eefed940 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.362+0000 7f008d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a007e420 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f00a00825d0 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555befa39550 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a00a9250 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 10 client.7758 fetch_fsmap learned FSMap version 64 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x555befa0d680 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555befa39550 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 64) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f00a0079ae0 con 0x555befaa9a90 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 10 client.7758 fetch_fsmap finished waiting for FSMap version 64 2023-12-19T05:46:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 10 client.7758 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:46:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 20 client.7758 populate_metadata read hostname 'smithi049' 2023-12-19T05:46:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac7be0 0x555befabed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 4 client.7758 mds_command: new command op to 7632 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:46:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.363+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 --> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555befa01b50 con 0x555befac7be0 2023-12-19T05:46:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.364+0000 7f00a7fff640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac7be0 0x555befabed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.364+0000 7f00a7fff640 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac7be0 0x555befabed60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b5340aa602a4b3e server_cookie=2240ada97f9095ee in_seq=0 out_seq=0 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.364+0000 7f008d7fa640 10 client.7758 ms_handle_connect on v2:172.21.15.49:6833/3042568277 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f008d7fa640 1 -- 172.21.15.49:0/55398325 <== mds.0 v2:172.21.15.49:6833/3042568277 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x555befa01b50 con 0x555befac7be0 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f008d7fa640 10 client.7758 handle_command_reply: tid=0 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 client.7758 shutdown 2023-12-19T05:46:58.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 msgr2=0x555befac10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f00a007a2f0 tx=0x7f00a007a010 comp rx=0 tx=0).stop 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 shutdown_connections 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac7be0 0x555befabed60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befaf3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 --2- 172.21.15.49:0/55398325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befac10f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f008d7fa640 0 client.7758 ms_handle_reset on v2:172.21.15.49:6833/3042568277 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.365+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 >> 172.21.15.49:0/55398325 conn(0x555befaa5e90 msgr2=0x555befaf4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.366+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 shutdown_connections 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.366+0000 7f00b79d3740 1 -- 172.21.15.49:0/55398325 wait complete. 2023-12-19T05:46:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.366+0000 7f00b79d3740 20 client.7758 trim_cache size 0 max 16384 2023-12-19T05:46:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.381+0000 7f00b79d3740 1 Processor -- start 2023-12-19T05:46:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 -- start start 2023-12-19T05:46:58.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befaa9a90 0x555befaaa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befac0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befaa5d20 con 0x555befad5f10 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befaf1d40 con 0x555befac30b0 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.382+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555befac09b0 con 0x555befaa9a90 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52206/0 (socket says 172.21.15.49:52206) 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 -- 172.21.15.49:0/4126288711 learned_addr learned my addr 172.21.15.49:0/4126288711 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00a7fff640 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befac0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 -- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befaa9a90 msgr2=0x555befaaa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befaa9a90 0x555befaaa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 -- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 msgr2=0x555befac0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befac0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 -- 172.21.15.49:0/4126288711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bef9af9e0 con 0x555befad5f10 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.383+0000 7f00aed9d640 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007e00 tx=0x7f00a800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb9599c04716c1f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00a4ff9640 1 -- 172.21.15.49:0/4126288711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800ee80 con 0x555befad5f10 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00a4ff9640 1 -- 172.21.15.49:0/4126288711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8011460 con 0x555befad5f10 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00a4ff9640 1 -- 172.21.15.49:0/4126288711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8011810 con 0x555befad5f10 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 -- 172.21.15.49:0/4126288711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 msgr2=0x555befac1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007e00 tx=0x7f00a800e6b0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 -- 172.21.15.49:0/4126288711 shutdown_connections 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befad5f10 0x555befac1440 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befac0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 --2- 172.21.15.49:0/4126288711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befaa9a90 0x555befaaa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 -- 172.21.15.49:0/4126288711 >> 172.21.15.49:0/4126288711 conn(0x555befaa5e90 msgr2=0x555befac9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 -- 172.21.15.49:0/4126288711 shutdown_connections 2023-12-19T05:46:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.384+0000 7f00b79d3740 1 -- 172.21.15.49:0/4126288711 wait complete. 2023-12-19T05:46:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.385+0000 7f00b79d3740 1 -- start start 2023-12-19T05:46:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.385+0000 7f00b79d3740 1 Processor -- start 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befabefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befac9880 con 0x555befaa9a90 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x555befaca850 con 0x555befac30b0 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x555befac99f0 con 0x555befad5f10 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.386+0000 7f00b79d3740 10 client.0 _ll_register_callbacks cb 0x7f009800a5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52212/0 (socket says 172.21.15.49:52212) 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 -- 172.21.15.49:0/3507323560 learned_addr learned my addr 172.21.15.49:0/3507323560 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00aed9d640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 -- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 msgr2=0x555befac60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 -- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 msgr2=0x555befabefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00a7fff640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befabefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befabefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 -- 172.21.15.49:0/3507323560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a8007a00 con 0x555befaa9a90 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00ae59c640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f00a0076aa0 tx=0x7f00a00a9620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e46eb75ab5e0e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f008d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a007e420 con 0x555befaa9a90 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f00a00a9460 con 0x555befaa9a90 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.387+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0098013ce0 con 0x555befaa9a90 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a00091c0 con 0x555befaa9a90 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 10 client.7764 fetch_fsmap learned FSMap version 64 2023-12-19T05:46:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x555bef9d4ef0 con 0x555befaa9a90 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098013ce0 con 0x555befaa9a90 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 64) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f00a00801d0 con 0x555befaa9a90 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 10 client.7764 fetch_fsmap finished waiting for FSMap version 64 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 10 client.7764 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 20 client.7764 populate_metadata read hostname 'smithi049' 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac65e0 0x555befac69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 4 client.7764 mds_command: new command op to 7632 tid=0[{"prefix": "status"}] 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 --> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555befa08080 con 0x555befac65e0 2023-12-19T05:46:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.388+0000 7f00a7fff640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac65e0 0x555befac69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00a7fff640 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac65e0 0x555befac69c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eaf192a987eb8f8 server_cookie=badf3c2fc056c2c0 in_seq=0 out_seq=0 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f008d7fa640 10 client.7764 ms_handle_connect on v2:172.21.15.49:6833/3042568277 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f008d7fa640 1 -- 172.21.15.49:0/3507323560 <== mds.0 v2:172.21.15.49:6833/3042568277 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x555befa08080 con 0x555befac65e0 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f008d7fa640 10 client.7764 handle_command_reply: tid=0 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 client.7764 shutdown 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 msgr2=0x555befabea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f00a0076aa0 tx=0x7f00a00a9620 comp rx=0 tx=0).stop 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 shutdown_connections 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x555befad5f10 0x555befac60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:6833/3042568277,v1:172.21.15.49:6835/3042568277] conn(0x555befac65e0 0x555befac69c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555befac30b0 0x555befabefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 --2- 172.21.15.49:0/3507323560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555befaa9a90 0x555befabea60 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f008d7fa640 0 client.7764 ms_handle_reset on v2:172.21.15.49:6833/3042568277 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 >> 172.21.15.49:0/3507323560 conn(0x555befaa5e90 msgr2=0x555befac8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.389+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 shutdown_connections 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00b79d3740 1 -- 172.21.15.49:0/3507323560 wait complete. 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00b79d3740 20 client.7764 trim_cache size 0 max 16384 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7632, 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.369128828, 2023-12-19T05:46:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 64, 2023-12-19T05:46:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 145, 2023-12-19T05:46:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 144, 2023-12-19T05:46:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.184159544 2023-12-19T05:46:58.396 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 msgr2=0x7f009006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 0x7f009006c8f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098008040 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 msgr2=0x7f00b0145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f00a00098a0 tx=0x7f00a0004730 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 shutdown_connections 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f009006a430 0x7f009006c8f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00b00cd430 0x7f00b00aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b0159e40 0x7f00b00aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 --2- 172.21.15.49:0/290170632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b00b0830 0x7f00b0145740 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 >> 172.21.15.49:0/290170632 conn(0x7f00b00659a0 msgr2=0x7f00b015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 shutdown_connections 2023-12-19T05:46:58.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.390+0000 7f00af59e640 1 -- 172.21.15.49:0/290170632 wait complete. 2023-12-19T05:46:58.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:46:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.647+0000 7fe395c15640 1 Processor -- start 2023-12-19T05:46:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.648+0000 7fe395c15640 1 -- start start 2023-12-19T05:46:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.649+0000 7fe395c15640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe390146e30 0x7fe3900b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.649+0000 7fe395c15640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3900d0c60 0x7fe39015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.649+0000 7fe395c15640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900d1070 con 0x7fe3900b7ea0 2023-12-19T05:46:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.649+0000 7fe395c15640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe390147210 con 0x7fe3900d0c60 2023-12-19T05:46:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.649+0000 7fe395c15640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3900b8330 con 0x7fe390146e30 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3900d0c60 0x7fe39015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3900d0c60 0x7fe39015d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52226/0 (socket says 172.21.15.49:52226) 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 -- 172.21.15.49:0/2317619207 learned_addr learned my addr 172.21.15.49:0/2317619207 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 -- 172.21.15.49:0/2317619207 >> v2:172.21.15.115:3300/0 conn(0x7fe390146e30 msgr2=0x7fe3900b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 --2- 172.21.15.49:0/2317619207 >> v2:172.21.15.115:3300/0 conn(0x7fe390146e30 0x7fe3900b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.650+0000 7fe395414640 1 -- 172.21.15.49:0/2317619207 >> v1:172.21.15.115:6789/0 conn(0x7fe3900b7ea0 legacy=0x7fe3900d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:46:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.651+0000 7fe395414640 1 -- 172.21.15.49:0/2317619207 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900d12d0 con 0x7fe3900d0c60 2023-12-19T05:46:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.652+0000 7fe395414640 1 --2- 172.21.15.49:0/2317619207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900d0c60 0x7fe39015d870 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe3900b85a0 tx=0x7fe38802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4c9d3bd89db31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.652+0000 7fe38f7fe640 1 -- 172.21.15.49:0/2317619207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388031870 con 0x7fe3900d0c60 2023-12-19T05:46:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.652+0000 7fe38f7fe640 1 -- 172.21.15.49:0/2317619207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880319d0 con 0x7fe3900d0c60 2023-12-19T05:46:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.652+0000 7fe38f7fe640 1 -- 172.21.15.49:0/2317619207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388031d60 con 0x7fe3900d0c60 2023-12-19T05:46:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 -- 172.21.15.49:0/2317619207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900d0c60 msgr2=0x7fe39015d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 --2- 172.21.15.49:0/2317619207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900d0c60 0x7fe39015d870 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe3900b85a0 tx=0x7fe38802b910 comp rx=0 tx=0).stop 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 -- 172.21.15.49:0/2317619207 shutdown_connections 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 --2- 172.21.15.49:0/2317619207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900d0c60 0x7fe39015d870 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 --2- 172.21.15.49:0/2317619207 >> v2:172.21.15.115:3300/0 conn(0x7fe390146e30 0x7fe3900b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 -- 172.21.15.49:0/2317619207 >> 172.21.15.49:0/2317619207 conn(0x7fe3900b2990 msgr2=0x7fe3900b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 -- 172.21.15.49:0/2317619207 shutdown_connections 2023-12-19T05:46:58.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.653+0000 7fe395c15640 1 -- 172.21.15.49:0/2317619207 wait complete. 2023-12-19T05:46:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.655+0000 7fe395c15640 1 Processor -- start 2023-12-19T05:46:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.655+0000 7fe395c15640 1 -- start start 2023-12-19T05:46:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3900d0c60 0x7fe39013db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390146e30 0x7fe3901d5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390140190 con 0x7fe3900b7ea0 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3901403e0 con 0x7fe390146e30 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395c15640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3901406c0 con 0x7fe3900d0c60 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe394c13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe394c13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52240/0 (socket says 172.21.15.49:52240) 2023-12-19T05:46:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe394c13640 1 -- 172.21.15.49:0/2832474809 learned_addr learned my addr 172.21.15.49:0/2832474809 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:46:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe38ffff640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3900d0c60 0x7fe39013db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.656+0000 7fe395414640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390146e30 0x7fe3901d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 -- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3900d0c60 msgr2=0x7fe39013db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3900d0c60 0x7fe39013db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 -- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390146e30 msgr2=0x7fe3901d5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390146e30 0x7fe3901d5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 -- 172.21.15.49:0/2832474809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880094d0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe394c13640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe38000ba50 tx=0x7fe38000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000cbe0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000cd60 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380014680 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.657+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3901409a0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.658+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3900c8ec0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.659+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe390140ec0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.660+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe38001d3b0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.661+0000 7fe38d7fa640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 0x7fe37006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:46:58.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.662+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fe3800888f0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.662+0000 7fe38ffff640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 0x7fe37006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:46:58.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.663+0000 7fe38ffff640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 0x7fe37006c920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe3900cece0 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:46:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.666+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe390140ec0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.899+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe390140ec0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.900+0000 7fe38d7fa640 1 -- 172.21.15.49:0/2832474809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe390140ec0 con 0x7fe3900b7ea0 2023-12-19T05:46:58.901 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:46:58.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.902+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 msgr2=0x7fe37006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.902+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 0x7fe37006c920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe3900cece0 tx=0x7fe378009040 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.902+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 msgr2=0x7fe3900c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.902+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe38000ba50 tx=0x7fe38000bf10 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 shutdown_connections 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe37006a460 0x7fe37006c920 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3900d0c60 0x7fe39013db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390146e30 0x7fe3901d5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 --2- 172.21.15.49:0/2832474809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3900b7ea0 0x7fe3900c8980 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 >> 172.21.15.49:0/2832474809 conn(0x7fe3900b2990 msgr2=0x7fe390143930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 shutdown_connections 2023-12-19T05:46:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:46:58.903+0000 7fe395c15640 1 -- 172.21.15.49:0/2832474809 wait complete. 2023-12-19T05:46:58.924 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:46:58.925 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:58.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:58.925 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:46:58.986 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:46:58.987 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41874sec preferred_lft 41874sec 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.988 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:46:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:46:58.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:58.990 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:46:59.098 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:46:59.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.103 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:46:59.163 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:46:59.163 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:46:59.163 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:46:59.163 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:46:59.163 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:46:59.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:46:59.165 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:46:59.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.376 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:46:59.431 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:46:59.431 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:46:59.432 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:59.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:46:59.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:59.544 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:59.602 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:46:59.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:46:59.603 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:59.658 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:46:59.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:59.820 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:59.820 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:46:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:46:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:46:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:46:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:46:59.858 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:46:59.858 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:46:59.858 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:46:59.858 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:46:59.858 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:46:59.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:46:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:46:59.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:46:59.946 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:47:00.008 INFO:teuthology.orchestra.run.smithi049.stdout:client6508 2023-12-19T05:47:00.008 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:00.008 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:00.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:47:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.340+0000 7f2f8903e640 1 Processor -- start 2023-12-19T05:47:00.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.340+0000 7f2f8903e640 1 -- start start 2023-12-19T05:47:00.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f8903e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f840cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:00.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f8903e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840ce780 con 0x7f2f841599c0 2023-12-19T05:47:00.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f8903e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840cea60 con 0x7f2f840af540 2023-12-19T05:47:00.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f8903e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415daa0 con 0x7f2f8406e190 2023-12-19T05:47:00.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f82d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f841599c0 0x7f2f8415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34556/0 (socket says 172.21.15.49:34556) 2023-12-19T05:47:00.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.342+0000 7f2f82d9d640 1 -- 172.21.15.49:0/3703382071 learned_addr learned my addr 172.21.15.49:0/3703382071 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:00.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.343+0000 7f2f7bfff640 1 --2- 172.21.15.49:0/3703382071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f840cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:00.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.344+0000 7f2f7bfff640 1 -- 172.21.15.49:0/3703382071 >> v1:172.21.15.115:6789/0 conn(0x7f2f840af540 legacy=0x7f2f840ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.344+0000 7f2f7bfff640 1 -- 172.21.15.49:0/3703382071 >> v1:172.21.15.49:6789/0 conn(0x7f2f841599c0 legacy=0x7f2f8415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.344+0000 7f2f7bfff640 1 -- 172.21.15.49:0/3703382071 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8415d6c0 con 0x7f2f8406e190 2023-12-19T05:47:00.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.345+0000 7f2f7bfff640 1 --2- 172.21.15.49:0/3703382071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f840cdea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097d0 tx=0x7f2f6c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3214efcd31017a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.348+0000 7f2f8259c640 1 -- 172.21.15.49:0/3703382071 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c031770 con 0x7f2f8406e190 2023-12-19T05:47:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.348+0000 7f2f8259c640 1 -- 172.21.15.49:0/3703382071 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0318d0 con 0x7f2f8406e190 2023-12-19T05:47:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.348+0000 7f2f8259c640 1 -- 172.21.15.49:0/3703382071 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c031c60 con 0x7f2f8406e190 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.348+0000 7f2f8903e640 1 -- 172.21.15.49:0/3703382071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 msgr2=0x7f2f840cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.348+0000 7f2f8903e640 1 --2- 172.21.15.49:0/3703382071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f840cdea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097d0 tx=0x7f2f6c02b810 comp rx=0 tx=0).stop 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.349+0000 7f2f8903e640 1 -- 172.21.15.49:0/3703382071 shutdown_connections 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.349+0000 7f2f8903e640 1 --2- 172.21.15.49:0/3703382071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f840cdea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.349+0000 7f2f8903e640 1 -- 172.21.15.49:0/3703382071 >> 172.21.15.49:0/3703382071 conn(0x7f2f840cbb70 msgr2=0x7f2f840cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.349+0000 7f2f8903e640 1 -- 172.21.15.49:0/3703382071 shutdown_connections 2023-12-19T05:47:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.349+0000 7f2f8903e640 1 -- 172.21.15.49:0/3703382071 wait complete. 2023-12-19T05:47:00.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.350+0000 7f2f8903e640 1 Processor -- start 2023-12-19T05:47:00.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.351+0000 7f2f8903e640 1 -- start start 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.351+0000 7f2f8903e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f8414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.351+0000 7f2f8903e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.351+0000 7f2f8903e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 0x7f2f8406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f8903e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84150550 con 0x7f2f840af540 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f8903e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8414ec80 con 0x7f2f841599c0 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f8903e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8414ef30 con 0x7f2f8406e190 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52248/0 (socket says 172.21.15.49:52248) 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 -- 172.21.15.49:0/1412197873 learned_addr learned my addr 172.21.15.49:0/1412197873 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f82d9d640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f8414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f8359e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 0x7f2f8406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 -- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 msgr2=0x7f2f8414e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f8414e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 -- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 msgr2=0x7f2f8406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 0x7f2f8406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f7bfff640 1 -- 172.21.15.49:0/1412197873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009400 con 0x7f2f840af540 2023-12-19T05:47:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.352+0000 7f2f8359e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 0x7f2f8406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f7bfff640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097d0 tx=0x7f2f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0328d0 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c032a50 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032e00 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8414fc20 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.353+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f841501e0 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.354+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84061910 con 0x7f2f840af540 2023-12-19T05:47:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.355+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f6c04e440 con 0x7f2f840af540 2023-12-19T05:47:00.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.356+0000 7f2f7b7fe640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 0x7f2f6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:00.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.356+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f2f6c0aab70 con 0x7f2f840af540 2023-12-19T05:47:00.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.357+0000 7f2f82d9d640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 0x7f2f6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:00.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.358+0000 7f2f82d9d640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 0x7f2f6406c920 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f74005880 tx=0x7f2f74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.361+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f6c076060 con 0x7f2f840af540 2023-12-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.595+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f8406b710 con 0x7f2f840af540 2023-12-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.596+0000 7f2f7b7fe640 1 -- 172.21.15.49:0/1412197873 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f6c079680 con 0x7f2f840af540 2023-12-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 msgr2=0x7f2f6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 0x7f2f6406c920 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f74005880 tx=0x7f2f74009040 comp rx=0 tx=0).stop 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 msgr2=0x7f2f840ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097d0 tx=0x7f2f6c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 shutdown_connections 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2f6406a460 0x7f2f6406c920 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f841599c0 0x7f2f8406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840af540 0x7f2f840ab3f0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 --2- 172.21.15.49:0/1412197873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f8406e190 0x7f2f8414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 >> 172.21.15.49:0/1412197873 conn(0x7f2f840cbb70 msgr2=0x7f2f840af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 shutdown_connections 2023-12-19T05:47:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:00.599+0000 7f2f8903e640 1 -- 172.21.15.49:0/1412197873 wait complete. 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:47:00.619 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:47:00.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:47:00.620 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:47:00.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:00.620 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:47:00.681 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:47:00.682 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41889sec preferred_lft 41889sec 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:47:00.683 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:47:00.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:00.685 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:47:00.775 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:47:00.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:00.780 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:47:00.834 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:47:00.834 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:47:00.835 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:47:00.835 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:47:00.835 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:47:00.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:47:00.835 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:47:01.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:01.015 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:47:01.066 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:47:01.066 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:47:01.066 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:47:01.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:01.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:47:01.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:47:01.160 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:47:01.214 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:47:01.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:47:01.214 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:47:01.266 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:47:01.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:01.266 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:47:01.405 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:47:01.405 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:47:01.435 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:47:01.435 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:47:01.435 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:47:01.435 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:47:01.435 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:47:01.437 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:47:01.437 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:47:01.437 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:47:01.437 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:47:01.437 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:47:01.440 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:47:01.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:01.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:47:01.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:01.522 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:47:01.575 INFO:teuthology.orchestra.run.smithi115.stdout:client5918 2023-12-19T05:47:01.576 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:01.576 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:01.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:01.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.868+0000 7f2d6238e640 1 Processor -- start 2023-12-19T05:47:01.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.868+0000 7f2d6238e640 1 -- start start 2023-12-19T05:47:01.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.869+0000 7f2d6238e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 0x7f2d5c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d6238e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d6238e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c0b2fa0 con 0x7f2d5c0acdf0 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d6238e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c0ad280 con 0x7f2d5c0b2460 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d6238e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c06f600 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d60b8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d60b8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52262/0 (socket says 172.21.15.49:52262) 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d60b8b640 1 -- 172.21.15.49:0/611569189 learned_addr learned my addr 172.21.15.49:0/611569189 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d61b8d640 1 --1- 172.21.15.49:0/611569189 >> v1:172.21.15.49:6789/0 conn(0x7f2d5c0acdf0 0x7f2d5c160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34568/0 (socket says 172.21.15.49:34568) 2023-12-19T05:47:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d6138c640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 0x7f2d5c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d60b8b640 1 -- 172.21.15.49:0/611569189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 msgr2=0x7f2d5c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.870+0000 7f2d60b8b640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 0x7f2d5c0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.871+0000 7f2d60b8b640 1 -- 172.21.15.49:0/611569189 >> v1:172.21.15.49:6789/0 conn(0x7f2d5c0acdf0 legacy=0x7f2d5c160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.871+0000 7f2d60b8b640 1 -- 172.21.15.49:0/611569189 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c15e7d0 con 0x7f2d5c0b2460 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.871+0000 7f2d6138c640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 0x7f2d5c0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:01.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.872+0000 7f2d60b8b640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009870 tx=0x7f2d4c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b959bb5e7ef7f55 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:01.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.872+0000 7f2d53fff640 1 -- 172.21.15.49:0/611569189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c031640 con 0x7f2d5c0b2460 2023-12-19T05:47:01.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.872+0000 7f2d53fff640 1 -- 172.21.15.49:0/611569189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0317a0 con 0x7f2d5c0b2460 2023-12-19T05:47:01.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.872+0000 7f2d53fff640 1 -- 172.21.15.49:0/611569189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c031b30 con 0x7f2d5c0b2460 2023-12-19T05:47:01.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 -- 172.21.15.49:0/611569189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c0b2460 msgr2=0x7f2d5c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009870 tx=0x7f2d4c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 -- 172.21.15.49:0/611569189 shutdown_connections 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c0b2460 0x7f2d5c0ac8b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 --2- 172.21.15.49:0/611569189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c15e3f0 0x7f2d5c0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 -- 172.21.15.49:0/611569189 >> 172.21.15.49:0/611569189 conn(0x7f2d5c0b0100 msgr2=0x7f2d5c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 -- 172.21.15.49:0/611569189 shutdown_connections 2023-12-19T05:47:01.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.873+0000 7f2d6238e640 1 -- 172.21.15.49:0/611569189 wait complete. 2023-12-19T05:47:01.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.875+0000 7f2d6238e640 1 Processor -- start 2023-12-19T05:47:01.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.875+0000 7f2d6238e640 1 -- start start 2023-12-19T05:47:01.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c0acdf0 0x7f2d5c145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c0b2460 0x7f2d5c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c145ff0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1462d0 con 0x7f2d5c0acdf0 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d6238e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c143700 con 0x7f2d5c0b2460 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d61b8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d61b8d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52270/0 (socket says 172.21.15.49:52270) 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.876+0000 7f2d61b8d640 1 -- 172.21.15.49:0/1738737880 learned_addr learned my addr 172.21.15.49:0/1738737880 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d60b8b640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c0b2460 0x7f2d5c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d6138c640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c0acdf0 0x7f2d5c145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 -- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c0b2460 msgr2=0x7f2d5c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c0b2460 0x7f2d5c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 -- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c0acdf0 msgr2=0x7f2d5c145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c0acdf0 0x7f2d5c145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:01.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 -- 172.21.15.49:0/1738737880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0094d0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d61b8d640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c730 tx=0x7f2d5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:01.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400ce40 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400a640 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.877+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400a9f0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.878+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c1439e0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.878+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c145bd0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.879+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c143c20 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.880+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d5400ab50 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.881+0000 7f2d51ffb640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 0x7f2d4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:01.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.881+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f2d54087fe0 con 0x7f2d5c15e3f0 2023-12-19T05:47:01.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.881+0000 7f2d6138c640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 0x7f2d4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:01.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.883+0000 7f2d6138c640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 0x7f2d4006c8f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2d58008850 tx=0x7f2d58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:01.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:01.885+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d5c143c20 con 0x7f2d5c15e3f0 2023-12-19T05:47:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.115+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d5c161c00 con 0x7f2d5c15e3f0 2023-12-19T05:47:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.116+0000 7f2d51ffb640 1 -- 172.21.15.49:0/1738737880 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f2d54017090 con 0x7f2d5c15e3f0 2023-12-19T05:47:02.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:02.118 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 msgr2=0x7f2d4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 0x7f2d4006c8f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2d58008850 tx=0x7f2d58008040 comp rx=0 tx=0).stop 2023-12-19T05:47:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 msgr2=0x7f2d5c155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c730 tx=0x7f2d5400cbf0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 shutdown_connections 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f2d4006a430 0x7f2d4006c8f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d5c0b2460 0x7f2d5c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d5c15e3f0 0x7f2d5c155b40 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 --2- 172.21.15.49:0/1738737880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c0acdf0 0x7f2d5c145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 >> 172.21.15.49:0/1738737880 conn(0x7f2d5c0b0100 msgr2=0x7f2d5c157670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.119+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 shutdown_connections 2023-12-19T05:47:02.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.120+0000 7f2d6238e640 1 -- 172.21.15.49:0/1738737880 wait complete. 2023-12-19T05:47:02.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:47:02.399 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":7632,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.360204932,"mdsmap_epoch":64,"osdmap_epoch":145,"osdmap_epoch_barrier":144,"uptime":17.175248054000001} 2023-12-19T05:47:02.399 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 7632, "mdsmap_epoch": 64, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "rank_uptime": 11.360204932, "state": "up:active", "uptime": 17.175248054, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:47:02.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T05:47:02.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.630+0000 7f018e977640 1 Processor -- start 2023-12-19T05:47:02.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.630+0000 7f018e977640 1 -- start start 2023-12-19T05:47:02.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.631+0000 7f018e977640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018813e200 0x7f01880ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.631+0000 7f018e977640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 0x7f0188140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f018e977640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880b1880 con 0x7f0188140f70 2023-12-19T05:47:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f018e977640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01881413e0 con 0x7f018813e200 2023-12-19T05:47:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f018e977640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880b26e0 con 0x7f0188141660 2023-12-19T05:47:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018813e200 0x7f01880ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018813e200 0x7f01880ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52286/0 (socket says 172.21.15.49:52286) 2023-12-19T05:47:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 -- 172.21.15.49:0/4159778169 learned_addr learned my addr 172.21.15.49:0/4159778169 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f01877fe640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 0x7f0188140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 -- 172.21.15.49:0/4159778169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 msgr2=0x7f0188140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 0x7f0188140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 -- 172.21.15.49:0/4159778169 >> v1:172.21.15.115:6789/0 conn(0x7f0188140f70 legacy=0x7f018815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.632+0000 7f0187fff640 1 -- 172.21.15.49:0/4159778169 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880cf020 con 0x7f018813e200 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.633+0000 7f01877fe640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 0x7f0188140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.634+0000 7f0187fff640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018813e200 0x7f01880ceae0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0178009870 tx=0x7f017802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57161cd07d2465b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.634+0000 7f0186ffd640 1 -- 172.21.15.49:0/4159778169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178031640 con 0x7f018813e200 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.634+0000 7f0186ffd640 1 -- 172.21.15.49:0/4159778169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780317a0 con 0x7f018813e200 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.634+0000 7f0186ffd640 1 -- 172.21.15.49:0/4159778169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178031b30 con 0x7f018813e200 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 -- 172.21.15.49:0/4159778169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018813e200 msgr2=0x7f01880ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018813e200 0x7f01880ceae0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0178009870 tx=0x7f017802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 -- 172.21.15.49:0/4159778169 shutdown_connections 2023-12-19T05:47:02.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0188141660 0x7f0188140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 --2- 172.21.15.49:0/4159778169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018813e200 0x7f01880ceae0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 -- 172.21.15.49:0/4159778169 >> 172.21.15.49:0/4159778169 conn(0x7f01880cf230 msgr2=0x7f01880cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:02.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 -- 172.21.15.49:0/4159778169 shutdown_connections 2023-12-19T05:47:02.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.635+0000 7f018e977640 1 -- 172.21.15.49:0/4159778169 wait complete. 2023-12-19T05:47:02.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.637+0000 7f018e977640 1 Processor -- start 2023-12-19T05:47:02.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.637+0000 7f018e977640 1 -- start start 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f018813e200 0x7f01881548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188140f70 0x7f018806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880b0df0 con 0x7f0188141660 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188070580 con 0x7f0188140f70 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018e977640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188070860 con 0x7f018813e200 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018cf14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018cf14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52292/0 (socket says 172.21.15.49:52292) 2023-12-19T05:47:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f018cf14640 1 -- 172.21.15.49:0/1197061557 learned_addr learned my addr 172.21.15.49:0/1197061557 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f01877fe640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188140f70 0x7f018806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.638+0000 7f0187fff640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f018813e200 0x7f01881548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 -- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f018813e200 msgr2=0x7f01881548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f018813e200 0x7f01881548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 -- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188140f70 msgr2=0x7f018806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188140f70 0x7f018806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 -- 172.21.15.49:0/1197061557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01780094d0 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018cf14640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f018000c780 tx=0x7f018000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180004b60 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000ce90 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000a850 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.639+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188070b40 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.640+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0188071100 con 0x7f0188141660 2023-12-19T05:47:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.641+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188061910 con 0x7f0188141660 2023-12-19T05:47:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.642+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f018000a9b0 con 0x7f0188141660 2023-12-19T05:47:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.643+0000 7f0184ff9640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 0x7f017406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.643+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f0180088c00 con 0x7f0188141660 2023-12-19T05:47:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.643+0000 7f0187fff640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 0x7f017406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:02.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.644+0000 7f0187fff640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 0x7f017406c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0178036000 tx=0x7f017803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.647+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0180054180 con 0x7f0188141660 2023-12-19T05:47:02.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:02.845+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f018815c3e0 con 0x7f0188141660 2023-12-19T05:47:03.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.376+0000 7f0184ff9640 1 -- 172.21.15.49:0/1197061557 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v146) v1 ==== 181+0+0 (secure 0 0 0) 0x7f01800577a0 con 0x7f0188141660 2023-12-19T05:47:03.378 INFO:teuthology.orchestra.run.smithi049.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 msgr2=0x7f017406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 0x7f017406c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0178036000 tx=0x7f017803c040 comp rx=0 tx=0).stop 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 msgr2=0x7f018806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f018000c780 tx=0x7f018000cc40 comp rx=0 tx=0).stop 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 shutdown_connections 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f017406a430 0x7f017406c8f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0188141660 0x7f018806ff50 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188140f70 0x7f018806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 --2- 172.21.15.49:0/1197061557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f018813e200 0x7f01881548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.382+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 >> 172.21.15.49:0/1197061557 conn(0x7f01880cf230 msgr2=0x7f01880cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.383+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 shutdown_connections 2023-12-19T05:47:03.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:03.383+0000 7f018e977640 1 -- 172.21.15.49:0/1197061557 wait complete. 2023-12-19T05:47:03.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:47:03.658 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:47:03.658 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:47:03.658 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-19T05:47:03.659 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:03.659 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:03.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:03.717 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-19T05:47:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:16+0 records in 2023-12-19T05:47:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:16+0 records out 2023-12-19T05:47:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.178686 s, 93.9 MB/s 2023-12-19T05:47:03.954 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:03.954 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:04.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:04.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-19T05:47:04.250 INFO:teuthology.orchestra.run.smithi049.stderr:17+0 records in 2023-12-19T05:47:04.250 INFO:teuthology.orchestra.run.smithi049.stderr:17+0 records out 2023-12-19T05:47:04.250 INFO:teuthology.orchestra.run.smithi049.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.185636 s, 96.0 MB/s 2023-12-19T05:47:04.252 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T05:47:04.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.476+0000 7f567b33e640 1 Processor -- start 2023-12-19T05:47:04.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.476+0000 7f567b33e640 1 -- start start 2023-12-19T05:47:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.478+0000 7f567b33e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 0x7f56740af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.478+0000 7f567b33e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f567406c6b0 0x7f56740b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.478+0000 7f567b33e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740afb10 con 0x7f56740b0b50 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.478+0000 7f567b33e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567406bb30 con 0x7f567406c6b0 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.478+0000 7f567b33e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740b0070 con 0x7f56741449e0 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.479+0000 7f56790da640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 0x7f56740af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.479+0000 7f56798db640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f567406c6b0 0x7f56740b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.479+0000 7f56788d9640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f56740b0b50 0x7f567406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44848/0 (socket says 172.21.15.49:44848) 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.479+0000 7f56788d9640 1 -- 172.21.15.49:0/3038568895 learned_addr learned my addr 172.21.15.49:0/3038568895 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.480+0000 7f56790da640 1 -- 172.21.15.49:0/3038568895 >> v2:172.21.15.115:3300/0 conn(0x7f567406c6b0 msgr2=0x7f56740b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.480+0000 7f566bfff640 1 -- 172.21.15.49:0/3038568895 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125090216 0 0) 0x7f56740afb10 con 0x7f56740b0b50 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.480+0000 7f56790da640 1 --2- 172.21.15.49:0/3038568895 >> v2:172.21.15.115:3300/0 conn(0x7f567406c6b0 0x7f56740b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.480+0000 7f56790da640 1 -- 172.21.15.49:0/3038568895 >> v1:172.21.15.115:6789/0 conn(0x7f56740b0b50 legacy=0x7f567406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.480+0000 7f56790da640 1 -- 172.21.15.49:0/3038568895 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740b0350 con 0x7f56741449e0 2023-12-19T05:47:04.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.482+0000 7f56790da640 1 --2- 172.21.15.49:0/3038568895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 0x7f56740af5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56700097a0 tx=0x7f567002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9eee0343bca57d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:04.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.482+0000 7f566bfff640 1 -- 172.21.15.49:0/3038568895 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031830 con 0x7f56741449e0 2023-12-19T05:47:04.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.482+0000 7f566bfff640 1 -- 172.21.15.49:0/3038568895 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670031990 con 0x7f56741449e0 2023-12-19T05:47:04.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.482+0000 7f566bfff640 1 -- 172.21.15.49:0/3038568895 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031d20 con 0x7f56741449e0 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 -- 172.21.15.49:0/3038568895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 msgr2=0x7f56740af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 --2- 172.21.15.49:0/3038568895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 0x7f56740af5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56700097a0 tx=0x7f567002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 -- 172.21.15.49:0/3038568895 shutdown_connections 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 --2- 172.21.15.49:0/3038568895 >> v2:172.21.15.115:3300/0 conn(0x7f567406c6b0 0x7f56740b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 --2- 172.21.15.49:0/3038568895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56741449e0 0x7f56740af5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 -- 172.21.15.49:0/3038568895 >> 172.21.15.49:0/3038568895 conn(0x7f56740cbb70 msgr2=0x7f56740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.483+0000 7f567b33e640 1 -- 172.21.15.49:0/3038568895 shutdown_connections 2023-12-19T05:47:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.484+0000 7f567b33e640 1 -- 172.21.15.49:0/3038568895 wait complete. 2023-12-19T05:47:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.486+0000 7f567b33e640 1 Processor -- start 2023-12-19T05:47:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.486+0000 7f567b33e640 1 -- start start 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567406c6b0 0x7f56741f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56740b0b50 0x7f56741f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741f5bd0 con 0x7f56741449e0 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567415c8d0 con 0x7f56740b0b50 2023-12-19T05:47:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.487+0000 7f567b33e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56741f3760 con 0x7f567406c6b0 2023-12-19T05:47:04.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56798db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56798db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58676/0 (socket says 172.21.15.49:58676) 2023-12-19T05:47:04.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56798db640 1 -- 172.21.15.49:0/2877212721 learned_addr learned my addr 172.21.15.49:0/2877212721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:04.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56790da640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567406c6b0 0x7f56741f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56788d9640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56740b0b50 0x7f56741f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.488+0000 7f56798db640 1 -- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567406c6b0 msgr2=0x7f56741f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f56798db640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567406c6b0 0x7f56741f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f56798db640 1 -- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56740b0b50 msgr2=0x7f56741f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f56798db640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56740b0b50 0x7f56741f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f56798db640 1 -- 172.21.15.49:0/2877212721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670009400 con 0x7f56741449e0 2023-12-19T05:47:04.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f56798db640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f566c00efc0 tx=0x7f566c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c014480 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00f040 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c014820 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567415bcc0 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.489+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567415c280 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.491+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567415ca60 con 0x7f56741449e0 2023-12-19T05:47:04.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.492+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f566c014980 con 0x7f56741449e0 2023-12-19T05:47:04.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.493+0000 7f5669ffb640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 0x7f565806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:04.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.493+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f566c0894f0 con 0x7f56741449e0 2023-12-19T05:47:04.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.494+0000 7f56790da640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 0x7f565806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:04.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.495+0000 7f56790da640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 0x7f565806c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5670036000 tx=0x7f567003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:04.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.498+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f566c054a90 con 0x7f56741449e0 2023-12-19T05:47:04.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.693+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5674061910 con 0x7f56741449e0 2023-12-19T05:47:04.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.695+0000 7f5669ffb640 1 -- 172.21.15.49:0/2877212721 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+34107 (secure 0 0 0) 0x7f566c0580b0 con 0x7f56741449e0 2023-12-19T05:47:04.697 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 146, 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:03.357729+0000", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:04.698 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.699 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:04.700 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:04.701 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:04.702 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:04.703 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:04.704 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:04.706 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:04.708 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:04.709 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.710 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "146", 2023-12-19T05:47:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.725 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.726 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.727 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.731 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.732 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.733 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.734 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.735 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.736 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.737 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.738 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.740 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:04.741 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.742 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.744 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.750 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.751 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.752 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:04.753 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:04.757 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.758 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.759 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:04.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:04.762 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.763 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:04.767 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:04.771 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 msgr2=0x7f565806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 0x7f565806c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5670036000 tx=0x7f567003c040 comp rx=0 tx=0).stop 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 msgr2=0x7f56741f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f566c00efc0 tx=0x7f566c00c490 comp rx=0 tx=0).stop 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 shutdown_connections 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f565806a430 0x7f565806c8f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56741449e0 0x7f56741f3220 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56740b0b50 0x7f56741f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 --2- 172.21.15.49:0/2877212721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f567406c6b0 0x7f56741f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 >> 172.21.15.49:0/2877212721 conn(0x7f56740cbb70 msgr2=0x7f567406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 shutdown_connections 2023-12-19T05:47:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:04.698+0000 7f567b33e640 1 -- 172.21.15.49:0/2877212721 wait complete. 2023-12-19T05:47:04.774 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:47:09.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:10.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.017+0000 7f4b0ffff640 1 Processor -- start 2023-12-19T05:47:10.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.017+0000 7f4b0ffff640 1 -- start start 2023-12-19T05:47:10.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b100ce300 0x7f4b1015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0ffff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1015ec30 con 0x7f4b100b2030 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0ffff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1015fbc0 con 0x7f4b1015e5a0 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0ffff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1015e980 con 0x7f4b100ce300 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b100ce300 0x7f4b1015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b100ce300 0x7f4b1015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58684/0 (socket says 172.21.15.49:58684) 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.019+0000 7f4b0f7fe640 1 -- 172.21.15.49:0/656621331 learned_addr learned my addr 172.21.15.49:0/656621331 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.020+0000 7f4b0f7fe640 1 -- 172.21.15.49:0/656621331 >> v1:172.21.15.115:6789/0 conn(0x7f4b1015e5a0 legacy=0x7f4b100b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:10.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.020+0000 7f4b0f7fe640 1 -- 172.21.15.49:0/656621331 >> v1:172.21.15.49:6789/0 conn(0x7f4b100b2030 legacy=0x7f4b100cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.020+0000 7f4b0f7fe640 1 -- 172.21.15.49:0/656621331 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100b2f90 con 0x7f4b100ce300 2023-12-19T05:47:10.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.021+0000 7f4b0f7fe640 1 --2- 172.21.15.49:0/656621331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100ce300 0x7f4b1015f680 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009e80 tx=0x7f4b0802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d683e92983feb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:10.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.021+0000 7f4b0dffb640 1 -- 172.21.15.49:0/656621331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0802caf0 con 0x7f4b100ce300 2023-12-19T05:47:10.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0dffb640 1 -- 172.21.15.49:0/656621331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0802cc50 con 0x7f4b100ce300 2023-12-19T05:47:10.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0dffb640 1 -- 172.21.15.49:0/656621331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080343f0 con 0x7f4b100ce300 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 -- 172.21.15.49:0/656621331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100ce300 msgr2=0x7f4b1015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/656621331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100ce300 0x7f4b1015f680 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009e80 tx=0x7f4b0802bf50 comp rx=0 tx=0).stop 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 -- 172.21.15.49:0/656621331 shutdown_connections 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/656621331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100ce300 0x7f4b1015f680 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 -- 172.21.15.49:0/656621331 >> 172.21.15.49:0/656621331 conn(0x7f4b100b0100 msgr2=0x7f4b100b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 -- 172.21.15.49:0/656621331 shutdown_connections 2023-12-19T05:47:10.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.022+0000 7f4b0ffff640 1 -- 172.21.15.49:0/656621331 wait complete. 2023-12-19T05:47:10.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.024+0000 7f4b0ffff640 1 Processor -- start 2023-12-19T05:47:10.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.024+0000 7f4b0ffff640 1 -- start start 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b100ce300 0x7f4b10159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1015e5a0 0x7f4b10159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c5b10 con 0x7f4b100b2030 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c5df0 con 0x7f4b100ce300 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.025+0000 7f4b0ffff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100ac8b0 con 0x7f4b1015e5a0 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58686/0 (socket says 172.21.15.49:58686) 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 -- 172.21.15.49:0/222416155 learned_addr learned my addr 172.21.15.49:0/222416155 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 -- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1015e5a0 msgr2=0x7f4b10159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1015e5a0 0x7f4b10159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 -- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b100ce300 msgr2=0x7f4b10159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b100ce300 0x7f4b10159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 -- 172.21.15.49:0/222416155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08009b30 con 0x7f4b100b2030 2023-12-19T05:47:10.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.026+0000 7f4b0effd640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c430 tx=0x7f4b0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.027+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00011790 con 0x7f4b100b2030 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.027+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000118f0 con 0x7f4b100b2030 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.027+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00011ce0 con 0x7f4b100b2030 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.027+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b100acb90 con 0x7f4b100b2030 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.027+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b100c4e20 con 0x7f4b100b2030 2023-12-19T05:47:10.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.028+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1015a860 con 0x7f4b100b2030 2023-12-19T05:47:10.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.029+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b0001c460 con 0x7f4b100b2030 2023-12-19T05:47:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.030+0000 7f4af7fff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 0x7f4afc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.030+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f4b00088970 con 0x7f4b100b2030 2023-12-19T05:47:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.031+0000 7f4b0e7fc640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 0x7f4afc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:10.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.032+0000 7f4b0e7fc640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 0x7f4afc06c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b04000f60 tx=0x7f4b040079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.035+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b00053e60 con 0x7f4b100b2030 2023-12-19T05:47:10.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.229+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4b10061910 con 0x7f4b100b2030 2023-12-19T05:47:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.233+0000 7f4af7fff640 1 -- 172.21.15.49:0/222416155 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+34107 (secure 0 0 0) 0x7f4b00057480 con 0x7f4b100b2030 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 146, 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:03.357729+0000", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:10.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:10.236 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:10.237 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:10.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:10.239 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:10.240 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:10.241 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:10.242 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:10.243 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:10.244 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:10.245 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:10.248 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:10.249 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:10.250 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "146", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:10.251 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:10.252 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:10.253 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:10.254 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.255 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.256 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.260 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.265 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:10.266 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.267 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.269 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.273 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:10.274 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:10.278 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.279 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:10.280 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.281 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:10.283 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.285 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.286 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:10.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:10.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:10.296 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.298 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:10.299 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.300 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:10.301 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.302 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:10.304 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 msgr2=0x7f4afc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 0x7f4afc06c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b04000f60 tx=0x7f4b040079b0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 msgr2=0x7f4b10157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c430 tx=0x7f4b0000c8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 shutdown_connections 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4afc06a430 0x7f4afc06c8f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b1015e5a0 0x7f4b10159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b100ce300 0x7f4b10159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 --2- 172.21.15.49:0/222416155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b100b2030 0x7f4b10157dd0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 >> 172.21.15.49:0/222416155 conn(0x7f4b100b0100 msgr2=0x7f4b1015d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 shutdown_connections 2023-12-19T05:47:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:10.236+0000 7f4b0ffff640 1 -- 172.21.15.49:0/222416155 wait complete. 2023-12-19T05:47:10.308 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:47:15.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:15.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.552+0000 7fcd33fff640 1 Processor -- start 2023-12-19T05:47:15.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.552+0000 7fcd33fff640 1 -- start start 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd33fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd34159f80 0x7fcd3406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd33fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd3415aa70 0x7fcd3415b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd33fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3406b520 con 0x7fcd3415b1e0 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd33fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340b2b20 con 0x7fcd34159f80 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd33fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340b2fb0 con 0x7fcd3415aa70 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.554+0000 7fcd32ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd34159f80 0x7fcd3406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd34159f80 0x7fcd3406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44440/0 (socket says 172.21.15.49:44440) 2023-12-19T05:47:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 -- 172.21.15.49:0/3083849202 learned_addr learned my addr 172.21.15.49:0/3083849202 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd337fe640 1 --2- 172.21.15.49:0/3083849202 >> v2:172.21.15.115:3300/0 conn(0x7fcd3415aa70 0x7fcd3415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 -- 172.21.15.49:0/3083849202 >> v2:172.21.15.115:3300/0 conn(0x7fcd3415aa70 msgr2=0x7fcd3415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 --2- 172.21.15.49:0/3083849202 >> v2:172.21.15.115:3300/0 conn(0x7fcd3415aa70 0x7fcd3415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 -- 172.21.15.49:0/3083849202 >> v1:172.21.15.49:6789/0 conn(0x7fcd3415b1e0 legacy=0x7fcd3415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd32ffd640 1 -- 172.21.15.49:0/3083849202 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340b1f10 con 0x7fcd34159f80 2023-12-19T05:47:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.555+0000 7fcd327fc640 1 -- 172.21.15.49:0/3083849202 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827590510 0 0) 0x7fcd3406b520 con 0x7fcd3415b1e0 2023-12-19T05:47:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.556+0000 7fcd32ffd640 1 --2- 172.21.15.49:0/3083849202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd3406f160 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae020 tx=0x7fcd2402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef2a39ffbe19104 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd327fc640 1 -- 172.21.15.49:0/3083849202 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2402f850 con 0x7fcd34159f80 2023-12-19T05:47:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd327fc640 1 -- 172.21.15.49:0/3083849202 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2402f9b0 con 0x7fcd34159f80 2023-12-19T05:47:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd327fc640 1 -- 172.21.15.49:0/3083849202 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2402fd40 con 0x7fcd34159f80 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 -- 172.21.15.49:0/3083849202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 msgr2=0x7fcd3406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 --2- 172.21.15.49:0/3083849202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd3406f160 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae020 tx=0x7fcd2402ba30 comp rx=0 tx=0).stop 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 -- 172.21.15.49:0/3083849202 shutdown_connections 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 --2- 172.21.15.49:0/3083849202 >> v2:172.21.15.115:3300/0 conn(0x7fcd3415aa70 0x7fcd3415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 --2- 172.21.15.49:0/3083849202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd3406f160 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 -- 172.21.15.49:0/3083849202 >> 172.21.15.49:0/3083849202 conn(0x7fcd340b0100 msgr2=0x7fcd340b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 -- 172.21.15.49:0/3083849202 shutdown_connections 2023-12-19T05:47:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.557+0000 7fcd33fff640 1 -- 172.21.15.49:0/3083849202 wait complete. 2023-12-19T05:47:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.559+0000 7fcd33fff640 1 Processor -- start 2023-12-19T05:47:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.559+0000 7fcd33fff640 1 -- start start 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd3415aa70 0x7fcd3413c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd3415b1e0 0x7fcd3413c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34140a00 con 0x7fcd34159f80 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3413cc70 con 0x7fcd3415b1e0 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.560+0000 7fcd33fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34167900 con 0x7fcd3415aa70 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44452/0 (socket says 172.21.15.49:44452) 2023-12-19T05:47:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 -- 172.21.15.49:0/2790937601 learned_addr learned my addr 172.21.15.49:0/2790937601 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 -- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd3415aa70 msgr2=0x7fcd3413c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd3415aa70 0x7fcd3413c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 -- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd3415b1e0 msgr2=0x7fcd3413c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd3415b1e0 0x7fcd3413c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240094d0 con 0x7fcd34159f80 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.561+0000 7fcd32ffd640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402ba70 tx=0x7fcd24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.562+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037d10 con 0x7fcd34159f80 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.562+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24037e90 con 0x7fcd34159f80 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.562+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd34167be0 con 0x7fcd34159f80 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.562+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24041640 con 0x7fcd34159f80 2023-12-19T05:47:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.562+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3414d310 con 0x7fcd34159f80 2023-12-19T05:47:15.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.563+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd34061910 con 0x7fcd34159f80 2023-12-19T05:47:15.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.564+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd240417a0 con 0x7fcd34159f80 2023-12-19T05:47:15.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.565+0000 7fcd30ff9640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 0x7fcd1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:15.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.565+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fcd2403c070 con 0x7fcd34159f80 2023-12-19T05:47:15.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.565+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fcd14072080 con 0x7fcd34159f80 2023-12-19T05:47:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.565+0000 7fcd2bfff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 0x7fcd1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.567+0000 7fcd2bfff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 0x7fcd1406c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcd3413ff30 tx=0x7fcd1c007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.569+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd24076d70 con 0x7fcd34159f80 2023-12-19T05:47:15.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.764+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcd340b0f70 con 0x7fcd34159f80 2023-12-19T05:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.767+0000 7fcd30ff9640 1 -- 172.21.15.49:0/2790937601 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34126 (secure 0 0 0) 0x7fcd2407a390 con 0x7fcd34159f80 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 147, 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:10.345215+0000", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:15.770 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:15.771 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:15.775 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:15.776 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.777 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:15.778 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:15.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:15.780 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:15.781 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:15.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:15.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "147", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:15.785 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:15.786 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:15.788 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.789 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.790 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.791 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.793 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.794 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:15.795 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.796 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.797 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.798 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.799 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:15.804 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:15.812 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.819 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:15.820 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:15.825 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:15.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:15.828 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:15.829 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.830 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.831 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.833 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.834 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.835 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:15.836 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.837 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:15.838 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:15.839 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 msgr2=0x7fcd1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 0x7fcd1406c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcd3413ff30 tx=0x7fcd1c007930 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 msgr2=0x7fcd34167200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402ba70 tx=0x7fcd24004730 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 shutdown_connections 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcd1406a430 0x7fcd1406c8f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd3415aa70 0x7fcd3413c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd3415b1e0 0x7fcd3413c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 --2- 172.21.15.49:0/2790937601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd34159f80 0x7fcd34167200 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 >> 172.21.15.49:0/2790937601 conn(0x7fcd340b0100 msgr2=0x7fcd340b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 shutdown_connections 2023-12-19T05:47:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:15.771+0000 7fcd33fff640 1 -- 172.21.15.49:0/2790937601 wait complete. 2023-12-19T05:47:15.842 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T05:47:15.842 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:15.842 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:15.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:15.905 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-19T05:47:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T05:47:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:47:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:47:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.376531 s, 139 MB/s 2023-12-19T05:47:16.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:47:16.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.563+0000 7fc5010f3640 1 Processor -- start 2023-12-19T05:47:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.563+0000 7fc5010f3640 1 -- start start 2023-12-19T05:47:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.565+0000 7fc5010f3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4fc0ac8b0 0x7fc4fc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.565+0000 7fc5010f3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0b2fa0 con 0x7fc4fc06fa90 2023-12-19T05:47:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.565+0000 7fc5010f3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc06f600 con 0x7fc4fc15e3f0 2023-12-19T05:47:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.565+0000 7fc5010f3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0ad280 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc4f3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4fc0ac8b0 0x7fc4fc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc5008f2640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc4fc06fa90 0x7fc4fc06fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37992/0 (socket says 172.21.15.49:37992) 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc5008f2640 1 -- 172.21.15.49:0/458164679 learned_addr learned my addr 172.21.15.49:0/458164679 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc4f3fff640 1 -- 172.21.15.49:0/458164679 >> v1:172.21.15.115:6789/0 conn(0x7fc4fc15e3f0 legacy=0x7fc4fc0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc4f3fff640 1 -- 172.21.15.49:0/458164679 >> v1:172.21.15.49:6789/0 conn(0x7fc4fc06fa90 legacy=0x7fc4fc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc4fb7fe640 1 -- 172.21.15.49:0/458164679 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431875634 0 0) 0x7fc4fc0b2fa0 con 0x7fc4fc06fa90 2023-12-19T05:47:16.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.566+0000 7fc4f3fff640 1 -- 172.21.15.49:0/458164679 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc15e7d0 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.567+0000 7fc4f3fff640 1 --2- 172.21.15.49:0/458164679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc0acd40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097a0 tx=0x7fc4e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db7251beeefc6e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.568+0000 7fc4fb7fe640 1 -- 172.21.15.49:0/458164679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e402e070 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.568+0000 7fc4fb7fe640 1 -- 172.21.15.49:0/458164679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e40315a0 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.568+0000 7fc4fb7fe640 1 -- 172.21.15.49:0/458164679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4031930 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 -- 172.21.15.49:0/458164679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 msgr2=0x7fc4fc0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 --2- 172.21.15.49:0/458164679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc0acd40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097a0 tx=0x7fc4e402b840 comp rx=0 tx=0).stop 2023-12-19T05:47:16.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 -- 172.21.15.49:0/458164679 shutdown_connections 2023-12-19T05:47:16.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 --2- 172.21.15.49:0/458164679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc0acd40 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 -- 172.21.15.49:0/458164679 >> 172.21.15.49:0/458164679 conn(0x7fc4fc0b0100 msgr2=0x7fc4fc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 -- 172.21.15.49:0/458164679 shutdown_connections 2023-12-19T05:47:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.569+0000 7fc5010f3640 1 -- 172.21.15.49:0/458164679 wait complete. 2023-12-19T05:47:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.571+0000 7fc5010f3640 1 Processor -- start 2023-12-19T05:47:16.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.571+0000 7fc5010f3640 1 -- start start 2023-12-19T05:47:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc06fa90 0x7fc4fc1f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4fc15e3f0 0x7fc4fc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc06bd30 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc06bfa0 con 0x7fc4fc06fa90 2023-12-19T05:47:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5010f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc06c280 con 0x7fc4fc15e3f0 2023-12-19T05:47:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44462/0 (socket says 172.21.15.49:44462) 2023-12-19T05:47:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc4f3fff640 1 -- 172.21.15.49:0/726119532 learned_addr learned my addr 172.21.15.49:0/726119532 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc4fbfff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc06fa90 0x7fc4fc1f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.572+0000 7fc5008f2640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4fc15e3f0 0x7fc4fc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 -- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4fc15e3f0 msgr2=0x7fc4fc155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4fc15e3f0 0x7fc4fc155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 -- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc06fa90 msgr2=0x7fc4fc1f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc06fa90 0x7fc4fc1f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009400 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f3fff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4034040 tx=0x7fc4e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4032900 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4032a60 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4032e10 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.573+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc06c560 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.574+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc15a100 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.575+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc06ca80 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.576+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4e403b3f0 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.577+0000 7fc4f97fa640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 0x7fc4dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.577+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fc4e40aa9b0 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.577+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fc4dc072080 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.578+0000 7fc4fbfff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 0x7fc4dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.579+0000 7fc4fbfff640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 0x7fc4dc06c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec004ea0 tx=0x7fc4ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.581+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc4fc06ca80 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.777+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc4fc06ca80 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.780+0000 7fc4f97fa640 1 -- 172.21.15.49:0/726119532 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34126 (secure 0 0 0) 0x7fc4fc06ca80 con 0x7fc4fc0ac8b0 2023-12-19T05:47:16.782 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:16.782 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:16.782 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 147, 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:10.345215+0000", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:16.783 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:16.784 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:16.787 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:16.789 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:16.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:16.791 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:16.792 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:16.793 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:16.794 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:16.795 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:16.797 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "147", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:16.806 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:16.807 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.809 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.810 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:16.811 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.813 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.815 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:16.816 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.817 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.818 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.824 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.825 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:16.826 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.828 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.830 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.831 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:16.832 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.833 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:16.834 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.835 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.837 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:16.838 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:16.839 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.840 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.843 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.844 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.845 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:16.846 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.847 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:16.848 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:16.849 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:16.850 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:16.851 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:16.852 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 msgr2=0x7fc4dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 0x7fc4dc06c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec004ea0 tx=0x7fc4ec009040 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 msgr2=0x7fc4fc155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4034040 tx=0x7fc4e40046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 shutdown_connections 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc4dc06a430 0x7fc4dc06c8f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4fc15e3f0 0x7fc4fc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4fc0ac8b0 0x7fc4fc155600 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.783+0000 7fc5010f3640 1 --2- 172.21.15.49:0/726119532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc06fa90 0x7fc4fc1f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.784+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 >> 172.21.15.49:0/726119532 conn(0x7fc4fc0b0100 msgr2=0x7fc4fc0709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.784+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 shutdown_connections 2023-12-19T05:47:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:16.784+0000 7fc5010f3640 1 -- 172.21.15.49:0/726119532 wait complete. 2023-12-19T05:47:16.855 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.091+0000 7f059b59e640 1 Processor -- start 2023-12-19T05:47:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.092+0000 7f059b59e640 1 -- start start 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 0x7f059c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 0x7f059c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f059c0b6160 0x7f059c0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0b4120 con 0x7f059c0b6160 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0b6ee0 con 0x7f059c15da00 2023-12-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.093+0000 7f059b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b71c0 con 0x7f059c15d620 2023-12-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f059c0b6160 0x7f059c0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f059c0b6160 0x7f059c0b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44468/0 (socket says 172.21.15.49:44468) 2023-12-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 -- 172.21.15.49:0/2018167099 learned_addr learned my addr 172.21.15.49:0/2018167099 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f0599d9b640 1 --2- 172.21.15.49:0/2018167099 >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 0x7f059c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059a59c640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 0x7f059c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 -- 172.21.15.49:0/2018167099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 msgr2=0x7f059c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 0x7f059c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 -- 172.21.15.49:0/2018167099 >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 msgr2=0x7f059c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 --2- 172.21.15.49:0/2018167099 >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 0x7f059c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059ad9d640 1 -- 172.21.15.49:0/2018167099 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0b4370 con 0x7f059c0b6160 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f059a59c640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 0x7f059c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.094+0000 7f0599d9b640 1 --2- 172.21.15.49:0/2018167099 >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 0x7f059c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.096+0000 7f059ad9d640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c0b6160 0x7f059c0b6610 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f059c0b33a0 tx=0x7f059402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc13d33182d02eeb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.096+0000 7f059959a640 1 -- 172.21.15.49:0/2018167099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594030860 con 0x7f059c0b6160 2023-12-19T05:47:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.096+0000 7f059959a640 1 -- 172.21.15.49:0/2018167099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05940309c0 con 0x7f059c0b6160 2023-12-19T05:47:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.096+0000 7f059959a640 1 -- 172.21.15.49:0/2018167099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594030d50 con 0x7f059c0b6160 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 -- 172.21.15.49:0/2018167099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c0b6160 msgr2=0x7f059c0b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c0b6160 0x7f059c0b6610 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f059c0b33a0 tx=0x7f059402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 -- 172.21.15.49:0/2018167099 shutdown_connections 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c0b6160 0x7f059c0b6610 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 --2- 172.21.15.49:0/2018167099 >> v2:172.21.15.115:3300/0 conn(0x7f059c15da00 0x7f059c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 --2- 172.21.15.49:0/2018167099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15d620 0x7f059c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 -- 172.21.15.49:0/2018167099 >> 172.21.15.49:0/2018167099 conn(0x7f059c0cfb90 msgr2=0x7f059c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 -- 172.21.15.49:0/2018167099 shutdown_connections 2023-12-19T05:47:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.097+0000 7f059b59e640 1 -- 172.21.15.49:0/2018167099 wait complete. 2023-12-19T05:47:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.099+0000 7f059b59e640 1 Processor -- start 2023-12-19T05:47:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.099+0000 7f059b59e640 1 -- start start 2023-12-19T05:47:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0b6160 0x7f059c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15da00 0x7f059c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15ff10 con 0x7f059c15d620 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c153890 con 0x7f059c0b6160 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15df50 con 0x7f059c15da00 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f0599d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f0599d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44480/0 (socket says 172.21.15.49:44480) 2023-12-19T05:47:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f0599d9b640 1 -- 172.21.15.49:0/3756444311 learned_addr learned my addr 172.21.15.49:0/3756444311 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.100+0000 7f059a59c640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0b6160 0x7f059c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f059ad9d640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15da00 0x7f059c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 -- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15da00 msgr2=0x7f059c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15da00 0x7f059c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 -- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0b6160 msgr2=0x7f059c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0b6160 0x7f059c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940094d0 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f0599d9b640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0590007ef0 tx=0x7f059000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.101+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590003b90 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.102+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000f040 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.102+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c15e230 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.102+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000de80 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.102+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c15e7f0 con 0x7f059c15d620 2023-12-19T05:47:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.103+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0d14c0 con 0x7f059c15d620 2023-12-19T05:47:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.104+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0590004030 con 0x7f059c15d620 2023-12-19T05:47:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.105+0000 7f058affd640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 0x7f057c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.105+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f0590088b70 con 0x7f059c15d620 2023-12-19T05:47:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.105+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f057c072080 con 0x7f059c15d620 2023-12-19T05:47:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.106+0000 7f059a59c640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 0x7f057c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.107+0000 7f059a59c640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 0x7f057c06c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f058c009950 tx=0x7f058c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.109+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f059001a060 con 0x7f059c15d620 2023-12-19T05:47:17.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.340+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f059c0710f0 con 0x7f059c15d620 2023-12-19T05:47:17.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.341+0000 7f058affd640 1 -- 172.21.15.49:0/3756444311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f059c0710f0 con 0x7f059c15d620 2023-12-19T05:47:17.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:17.343 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:17.343 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 msgr2=0x7f057c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 0x7f057c06c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f058c009950 tx=0x7f058c008040 comp rx=0 tx=0).stop 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 msgr2=0x7f059c15ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0590007ef0 tx=0x7f059000d4a0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 shutdown_connections 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f057c06a430 0x7f057c06c8f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f059c15da00 0x7f059c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f059c15d620 0x7f059c15ed10 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 --2- 172.21.15.49:0/3756444311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0b6160 0x7f059c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.343+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 >> 172.21.15.49:0/3756444311 conn(0x7f059c0cfb90 msgr2=0x7f059c0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:17.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.344+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 shutdown_connections 2023-12-19T05:47:17.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.344+0000 7f059b59e640 1 -- 172.21.15.49:0/3756444311 wait complete. 2023-12-19T05:47:17.364 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:47:17.605 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":7632,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.567285509000001,"mdsmap_epoch":64,"osdmap_epoch":147,"osdmap_epoch_barrier":147,"uptime":32.382339725000001} 2023-12-19T05:47:17.605 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 7632, "mdsmap_epoch": 64, "osdmap_epoch": 147, "osdmap_epoch_barrier": 147, "rank_uptime": 26.567285509, "state": "up:active", "uptime": 32.382339725, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:47:17.605 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:47:17.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:17.606 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T05:47:17.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:17.665 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T05:47:17.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:17.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.961+0000 7efebc501640 1 Processor -- start 2023-12-19T05:47:17.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.961+0000 7efebc501640 1 -- start start 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efebc501640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efeb40ae110 0x7efeb40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efebc501640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efebc501640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb40ae640 con 0x7efeb4157bf0 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efebc501640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb406b8c0 con 0x7efeb40ae110 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efebc501640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b0ab0 con 0x7efeb40b0640 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.963+0000 7efeba29d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efeb4157bf0 0x7efeb415b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37998/0 (socket says 172.21.15.49:37998) 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeba29d640 1 -- 172.21.15.49:0/4119275202 learned_addr learned my addr 172.21.15.49:0/4119275202 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeb9a9c640 1 --2- 172.21.15.49:0/4119275202 >> v2:172.21.15.49:3300/0 conn(0x7efeb40ae110 0x7efeb40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efebaa9e640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeb9a9c640 1 -- 172.21.15.49:0/4119275202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 msgr2=0x7efeb406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeb9a9c640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeb9a9c640 1 -- 172.21.15.49:0/4119275202 >> v1:172.21.15.49:6789/0 conn(0x7efeb4157bf0 legacy=0x7efeb415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.964+0000 7efeb9a9c640 1 -- 172.21.15.49:0/4119275202 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40ae920 con 0x7efeb40ae110 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.965+0000 7efeb9a9c640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb40ae110 0x7efeb40b0100 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efea00097d0 tx=0x7efea002dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b4289936de170a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efeb929b640 1 -- 172.21.15.49:0/4119275202 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea002f880 con 0x7efeb40ae110 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efeb929b640 1 -- 172.21.15.49:0/4119275202 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea002f9e0 con 0x7efeb40ae110 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efeb929b640 1 -- 172.21.15.49:0/4119275202 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea002fd70 con 0x7efeb40ae110 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 -- 172.21.15.49:0/4119275202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb40ae110 msgr2=0x7efeb40b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb40ae110 0x7efeb40b0100 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efea00097d0 tx=0x7efea002dac0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 -- 172.21.15.49:0/4119275202 shutdown_connections 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 --2- 172.21.15.49:0/4119275202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb40ae110 0x7efeb40b0100 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.966+0000 7efebc501640 1 -- 172.21.15.49:0/4119275202 >> 172.21.15.49:0/4119275202 conn(0x7efeb40cbb70 msgr2=0x7efeb40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.967+0000 7efebc501640 1 -- 172.21.15.49:0/4119275202 shutdown_connections 2023-12-19T05:47:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.967+0000 7efebc501640 1 -- 172.21.15.49:0/4119275202 wait complete. 2023-12-19T05:47:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.968+0000 7efebc501640 1 Processor -- start 2023-12-19T05:47:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.969+0000 7efebc501640 1 -- start start 2023-12-19T05:47:17.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb40ae110 0x7efeb41f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb4155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40aa4b0 con 0x7efeb4157bf0 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40aa790 con 0x7efeb40ae110 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebc501640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40aaa70 con 0x7efeb40b0640 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebaa9e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebaa9e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44496/0 (socket says 172.21.15.49:44496) 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efebaa9e640 1 -- 172.21.15.49:0/1896530315 learned_addr learned my addr 172.21.15.49:0/1896530315 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efeb9a9c640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.970+0000 7efeba29d640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb40ae110 0x7efeb41f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 -- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 msgr2=0x7efeb4155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb4155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 -- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb40ae110 msgr2=0x7efeb41f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb40ae110 0x7efeb41f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0009400 con 0x7efeb4157bf0 2023-12-19T05:47:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebaa9e640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efeac00d800 tx=0x7efeac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00b6c0 con 0x7efeb4157bf0 2023-12-19T05:47:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00b840 con 0x7efeb4157bf0 2023-12-19T05:47:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40aad50 con 0x7efeb4157bf0 2023-12-19T05:47:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00bbf0 con 0x7efeb4157bf0 2023-12-19T05:47:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.971+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41f2a30 con 0x7efeb4157bf0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.973+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb40ab270 con 0x7efeb4157bf0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.974+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efeac00bd50 con 0x7efeb4157bf0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.975+0000 7efeb2ffd640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.975+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5796+0+0 (secure 0 0 0) 0x7efeac088e90 con 0x7efeb4157bf0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.975+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7efe98072080 con 0x7efeb4157bf0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.975+0000 7efeba29d640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.976+0000 7efeba29d640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 0x7efe9806c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efea80012e0 tx=0x7efea8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:17.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:17.979+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efeb40ab270 con 0x7efeb4157bf0 2023-12-19T05:47:18.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.176+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efeb40ab270 con 0x7efeb4157bf0 2023-12-19T05:47:18.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.180+0000 7efeb2ffd640 1 -- 172.21.15.49:0/1896530315 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34126 (secure 0 0 0) 0x7efeb40ab270 con 0x7efeb4157bf0 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 147, 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:10.345215+0000", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:18.183 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:18.184 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:18.185 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:18.186 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:18.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:18.188 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:18.189 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:18.190 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:18.191 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:18.192 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:18.193 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:18.194 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:18.195 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:47:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:18.197 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "147", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:18.200 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:18.201 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.202 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.204 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.206 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.207 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.209 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:18.210 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.211 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.212 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:18.213 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.217 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.218 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.219 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:18.220 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.225 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.228 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:18.230 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.233 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.235 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:18.236 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.237 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:18.238 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.240 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.243 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:18.247 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.248 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:18.249 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:18.250 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:18.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:18.252 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 msgr2=0x7efe9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 0x7efe9806c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efea80012e0 tx=0x7efea8009040 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 msgr2=0x7efeb4155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efeac00d800 tx=0x7efeac00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 shutdown_connections 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efeb40b0640 0x7efeb4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb4157bf0 0x7efeb4155ab0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 --2- 172.21.15.49:0/1896530315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb40ae110 0x7efeb41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.182+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 >> 172.21.15.49:0/1896530315 conn(0x7efeb40cbb70 msgr2=0x7efeb4154440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.183+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 shutdown_connections 2023-12-19T05:47:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:18.183+0000 7efebc501640 1 -- 172.21.15.49:0/1896530315 wait complete. 2023-12-19T05:47:18.254 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:47:23.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.503+0000 7fc75593d640 1 Processor -- start 2023-12-19T05:47:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.503+0000 7fc75593d640 1 -- start start 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.504+0000 7fc75593d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc7500b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.504+0000 7fc75593d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500b4120 con 0x7fc7500cf670 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc75593d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500b5b80 con 0x7fc75015d620 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc75593d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b6ee0 con 0x7fc75015da00 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc74ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7500cf670 0x7fc7500b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38004/0 (socket says 172.21.15.49:38004) 2023-12-19T05:47:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc74ffff640 1 -- 172.21.15.49:0/3434647160 learned_addr learned my addr 172.21.15.49:0/3434647160 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc75513c640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc7500b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.505+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876887705 0 0) 0x7fc7500b4120 con 0x7fc7500cf670 2023-12-19T05:47:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc738003520 con 0x7fc7500cf670 2023-12-19T05:47:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080868970 0 0) 0x7fc7500b5b80 con 0x7fc75015d620 2023-12-19T05:47:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7500b4120 con 0x7fc75015d620 2023-12-19T05:47:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245690594 0 0) 0x7fc738003520 con 0x7fc7500cf670 2023-12-19T05:47:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 msgr2=0x7fc7500b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc7500b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 >> v1:172.21.15.115:6789/0 conn(0x7fc75015d620 legacy=0x7fc7500cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500b71c0 con 0x7fc7500cf670 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fc7440019f0 con 0x7fc7500cf670 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 >> v1:172.21.15.49:6789/0 conn(0x7fc7500cf670 legacy=0x7fc7500b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc738003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7380040e0 0x7fc7380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc738004d00 0x7fc738005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b6ee0 con 0x7fc738004d00 2023-12-19T05:47:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73800bac0 con 0x7fc7380040e0 2023-12-19T05:47:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.506+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73800bc80 con 0x7fc75015da00 2023-12-19T05:47:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc738004d00 0x7fc738005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75493b640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc738003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc74ffff640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7380040e0 0x7fc7380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 -- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 msgr2=0x7fc738003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc75015da00 0x7fc738003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 -- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7380040e0 msgr2=0x7fc7380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7380040e0 0x7fc7380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc75513c640 1 -- 172.21.15.49:0/3434647160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738003520 con 0x7fc738004d00 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.507+0000 7fc74ffff640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7380040e0 0x7fc7380047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc75513c640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc738004d00 0x7fc738005180 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc7500d30c0 tx=0x7fc7380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c02705b3856bcd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74802c660 con 0x7fc738004d00 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74802c7c0 con 0x7fc738004d00 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc74f7fe640 1 -- 172.21.15.49:0/3434647160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74802cb70 con 0x7fc738004d00 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc75593d640 1 -- 172.21.15.49:0/3434647160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc738004d00 msgr2=0x7fc738005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc75593d640 1 --2- 172.21.15.49:0/3434647160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc738004d00 0x7fc738005180 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc7500d30c0 tx=0x7fc7380057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.509+0000 7fc75513c640 1 -- 172.21.15.49:0/3434647160 reap_dead start 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.510+0000 7fc75593d640 1 -- 172.21.15.49:0/3434647160 shutdown_connections 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.510+0000 7fc75593d640 1 -- 172.21.15.49:0/3434647160 >> 172.21.15.49:0/3434647160 conn(0x7fc7500cfb90 msgr2=0x7fc7500cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.510+0000 7fc75593d640 1 -- 172.21.15.49:0/3434647160 shutdown_connections 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.510+0000 7fc75593d640 1 -- 172.21.15.49:0/3434647160 wait complete. 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.512+0000 7fc75593d640 1 Processor -- start 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.512+0000 7fc75593d640 1 -- start start 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 0x7fc7501f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7501e6500 0x7fc7501e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7501e8bf0 con 0x7fc7501e8230 2023-12-19T05:47:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c8150 con 0x7fc7501e6500 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75593d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c8430 con 0x7fc750159610 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc74ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc74ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44516/0 (socket says 172.21.15.49:44516) 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc74ffff640 1 -- 172.21.15.49:0/911443402 learned_addr learned my addr 172.21.15.49:0/911443402 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.513+0000 7fc75493b640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 0x7fc7501f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 -- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 msgr2=0x7fc7501f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc75513c640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7501e6500 0x7fc7501e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 0x7fc7501f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 -- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7501e6500 msgr2=0x7fc7501e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7501e6500 0x7fc7501e6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500c8710 con 0x7fc7501e8230 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc75493b640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 0x7fc7501f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74ffff640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc744001350 tx=0x7fc74400b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440072d0 con 0x7fc7501e8230 2023-12-19T05:47:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744007430 con 0x7fc7501e8230 2023-12-19T05:47:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440077c0 con 0x7fc7501e8230 2023-12-19T05:47:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.514+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500c89f0 con 0x7fc7501e8230 2023-12-19T05:47:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.515+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7501e6ec0 con 0x7fc7501e8230 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.516+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750061910 con 0x7fc7501e8230 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.517+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc744007920 con 0x7fc7501e8230 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.518+0000 7fc74d7fa640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 0x7fc73c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.518+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fc744088f10 con 0x7fc7501e8230 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.519+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fc73c0720b0 con 0x7fc7501e8230 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.519+0000 7fc75493b640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 0x7fc73c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.520+0000 7fc75493b640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 0x7fc73c06c920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc75006fc40 tx=0x7fc740009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:23.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.523+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc744019060 con 0x7fc7501e8230 2023-12-19T05:47:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.718+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc75015cdd0 con 0x7fc7501e8230 2023-12-19T05:47:23.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.722+0000 7fc74d7fa640 1 -- 172.21.15.49:0/911443402 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34126 (secure 0 0 0) 0x7fc744054400 con 0x7fc7501e8230 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 147, 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:10.345215+0000", 2023-12-19T05:47:23.724 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:23.725 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:23.730 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:23.739 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "147", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.744 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:23.747 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.748 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.749 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.750 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.753 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.755 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.758 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.759 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:23.762 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.763 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.764 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.765 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.766 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:23.767 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.768 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.769 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.771 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:23.772 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.773 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.774 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.775 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:23.778 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:23.779 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.780 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.781 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:23.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:23.783 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.785 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.787 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:23.788 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:23.789 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:23.790 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:23.792 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:23.793 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 msgr2=0x7fc73c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 0x7fc73c06c920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc75006fc40 tx=0x7fc740009040 comp rx=0 tx=0).stop 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 msgr2=0x7fc7501e86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc744001350 tx=0x7fc74400b560 comp rx=0 tx=0).stop 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 shutdown_connections 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc73c06a460 0x7fc73c06c920 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7501e6500 0x7fc7501e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7501e8230 0x7fc7501e86b0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 --2- 172.21.15.49:0/911443402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc750159610 0x7fc7501f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 >> 172.21.15.49:0/911443402 conn(0x7fc7500cfb90 msgr2=0x7fc75015a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 shutdown_connections 2023-12-19T05:47:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:23.725+0000 7fc75593d640 1 -- 172.21.15.49:0/911443402 wait complete. 2023-12-19T05:47:23.795 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:47:27.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:27.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:28.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:29.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.039+0000 7f60101a9640 1 Processor -- start 2023-12-19T05:47:29.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.040+0000 7f60101a9640 1 -- start start 2023-12-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.041+0000 7f60101a9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f60101a9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60080afb10 con 0x7f600806c6b0 2023-12-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f60101a9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600806bb30 con 0x7f60080b0b50 2023-12-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f60101a9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60080b0070 con 0x7f60081449e0 2023-12-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f600df45640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f600e746640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f600806c6b0 0x7f60080b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34960/0 (socket says 172.21.15.49:34960) 2023-12-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f600d744640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f60080b0b50 0x7f600806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:45480/0 (socket says 172.21.15.49:45480) 2023-12-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.042+0000 7f600df45640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47022/0 (socket says 172.21.15.49:47022) 2023-12-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600e746640 1 -- 172.21.15.49:0/2394867971 learned_addr learned my addr 172.21.15.49:0/2394867971 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600cf43640 1 -- 172.21.15.49:0/2394867971 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320905604 0 0) 0x7f60080afb10 con 0x7f600806c6b0 2023-12-19T05:47:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600cf43640 1 -- 172.21.15.49:0/2394867971 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4003520 con 0x7f600806c6b0 2023-12-19T05:47:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600df45640 1 -- 172.21.15.49:0/2394867971 >> v1:172.21.15.115:6789/0 conn(0x7f60080b0b50 legacy=0x7f600806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600df45640 1 -- 172.21.15.49:0/2394867971 >> v1:172.21.15.49:6789/0 conn(0x7f600806c6b0 legacy=0x7f60080b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.043+0000 7f600df45640 1 -- 172.21.15.49:0/2394867971 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080b0350 con 0x7f60081449e0 2023-12-19T05:47:29.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.045+0000 7f600df45640 1 --2- 172.21.15.49:0/2394867971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60040097d0 tx=0x7f600402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3414394e672c74e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.045+0000 7f600cf43640 1 -- 172.21.15.49:0/2394867971 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004031890 con 0x7f60081449e0 2023-12-19T05:47:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.045+0000 7f600cf43640 1 -- 172.21.15.49:0/2394867971 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60040319f0 con 0x7f60081449e0 2023-12-19T05:47:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.045+0000 7f600cf43640 1 -- 172.21.15.49:0/2394867971 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004031d80 con 0x7f60081449e0 2023-12-19T05:47:29.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 -- 172.21.15.49:0/2394867971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 msgr2=0x7f60080af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 --2- 172.21.15.49:0/2394867971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60040097d0 tx=0x7f600402b930 comp rx=0 tx=0).stop 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 -- 172.21.15.49:0/2394867971 shutdown_connections 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 --2- 172.21.15.49:0/2394867971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60081449e0 0x7f60080af5d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 -- 172.21.15.49:0/2394867971 >> 172.21.15.49:0/2394867971 conn(0x7f60080cbb70 msgr2=0x7f60080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 -- 172.21.15.49:0/2394867971 shutdown_connections 2023-12-19T05:47:29.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.046+0000 7f60101a9640 1 -- 172.21.15.49:0/2394867971 wait complete. 2023-12-19T05:47:29.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.048+0000 7f60101a9640 1 Processor -- start 2023-12-19T05:47:29.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.048+0000 7f60101a9640 1 -- start start 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b0b50 0x7f60080a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 0x7f60081f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008159ae0 con 0x7f600806c6b0 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008159d30 con 0x7f60081449e0 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f60101a9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600815a010 con 0x7f60080b0b50 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.049+0000 7f600df45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52608/0 (socket says 172.21.15.49:52608) 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 -- 172.21.15.49:0/2809743044 learned_addr learned my addr 172.21.15.49:0/2809743044 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600d744640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b0b50 0x7f60080a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600e746640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 0x7f60081f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 -- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b0b50 msgr2=0x7f60080a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b0b50 0x7f60080a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 -- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 msgr2=0x7f60081f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 0x7f60081f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 -- 172.21.15.49:0/2809743044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004009400 con 0x7f600806c6b0 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600e746640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 0x7f60081f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:29.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.050+0000 7f600df45640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f60040097d0 tx=0x7f60040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.051+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600403ac60 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.051+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600403ade0 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.051+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004044630 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.051+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600815a2f0 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.051+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600815dde0 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.052+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6008061910 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.053+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f600404d450 con 0x7f600806c6b0 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.054+0000 7f5ffa7fc640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 0x7f5fec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.054+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f60040aaff0 con 0x7f600806c6b0 2023-12-19T05:47:29.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.055+0000 7f600d744640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 0x7f5fec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.056+0000 7f600d744640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 0x7f5fec06c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f60080aa5a0 tx=0x7f5ffc007c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.059+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60040ddc80 con 0x7f600806c6b0 2023-12-19T05:47:29.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.254+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f60080cc1a0 con 0x7f600806c6b0 2023-12-19T05:47:29.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.257+0000 7f5ffa7fc640 1 -- 172.21.15.49:0/2809743044 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+34107 (secure 0 0 0) 0x7f6004035090 con 0x7f600806c6b0 2023-12-19T05:47:29.259 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:29.259 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:29.259 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 148, 2023-12-19T05:47:29.259 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:25.352273+0000", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:29.260 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:29.261 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:29.262 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:29.263 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.264 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.265 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:29.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:29.267 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:29.268 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.269 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.270 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.271 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:29.272 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.273 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.274 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.275 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "148", 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.276 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.277 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.278 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.279 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.280 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:29.281 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:29.282 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:29.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.284 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.287 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.288 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.289 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.290 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.291 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.292 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.294 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.295 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.296 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.299 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.304 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.305 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:29.311 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.313 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.314 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.315 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.315 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.315 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.315 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.315 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.316 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.317 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.318 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.321 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.321 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.321 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:29.322 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.323 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.323 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.323 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.323 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.325 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.326 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.327 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.328 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.329 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.330 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.331 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:29.332 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.333 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.334 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.335 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.337 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.339 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.340 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.341 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.342 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.343 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.344 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.345 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.346 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.347 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:29.348 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:29.349 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.352 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.259+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 msgr2=0x7f5fec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.259+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 0x7f5fec06c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f60080aa5a0 tx=0x7f5ffc007c80 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.259+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 msgr2=0x7f600813fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f60040097d0 tx=0x7f60040046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 shutdown_connections 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5fec06a460 0x7f5fec06c920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60080b0b50 0x7f60080a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60081449e0 0x7f60081f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 --2- 172.21.15.49:0/2809743044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f600806c6b0 0x7f600813fb50 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 >> 172.21.15.49:0/2809743044 conn(0x7f60080cbb70 msgr2=0x7f6008070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:29.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 shutdown_connections 2023-12-19T05:47:29.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.260+0000 7f60101a9640 1 -- 172.21.15.49:0/2809743044 wait complete. 2023-12-19T05:47:29.355 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T05:47:29.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:47:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.599+0000 7f0e5dd62640 1 Processor -- start 2023-12-19T05:47:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.599+0000 7f0e5dd62640 1 -- start start 2023-12-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e580b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5815f680 0x7f0e580b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 0x7f0e580ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580ce5c0 con 0x7f0e5815f680 2023-12-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5815ec30 con 0x7f0e580cdbf0 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e5dd62640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b2cc0 con 0x7f0e5815e5a0 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e57fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5815f680 0x7f0e580b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e57fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5815f680 0x7f0e580b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52618/0 (socket says 172.21.15.49:52618) 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.601+0000 7f0e57fff640 1 -- 172.21.15.49:0/2761746328 learned_addr learned my addr 172.21.15.49:0/2761746328 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e5d561640 1 --2- 172.21.15.49:0/2761746328 >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 0x7f0e580ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e5cd60640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e580b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e57fff640 1 -- 172.21.15.49:0/2761746328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 msgr2=0x7f0e580b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e57fff640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e580b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e57fff640 1 -- 172.21.15.49:0/2761746328 >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 msgr2=0x7f0e580ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e57fff640 1 --2- 172.21.15.49:0/2761746328 >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 0x7f0e580ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e57fff640 1 -- 172.21.15.49:0/2761746328 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5815e980 con 0x7f0e5815f680 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e5d561640 1 --2- 172.21.15.49:0/2761746328 >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 0x7f0e580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.602+0000 7f0e5cd60640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e580b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.603+0000 7f0e57fff640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e580b2780 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0e580711b0 tx=0x7f0e4402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4979024da929a4dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.603+0000 7f0e577fe640 1 -- 172.21.15.49:0/2761746328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44031880 con 0x7f0e5815f680 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.603+0000 7f0e577fe640 1 -- 172.21.15.49:0/2761746328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440319e0 con 0x7f0e5815f680 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.603+0000 7f0e577fe640 1 -- 172.21.15.49:0/2761746328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44031d70 con 0x7f0e5815f680 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 -- 172.21.15.49:0/2761746328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 msgr2=0x7f0e580b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e580b2780 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0e580711b0 tx=0x7f0e4402b920 comp rx=0 tx=0).stop 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 -- 172.21.15.49:0/2761746328 shutdown_connections 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/2761746328 >> v2:172.21.15.115:3300/0 conn(0x7f0e580cdbf0 0x7f0e580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e580b2780 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/2761746328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e580b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 -- 172.21.15.49:0/2761746328 >> 172.21.15.49:0/2761746328 conn(0x7f0e580b0100 msgr2=0x7f0e580b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 -- 172.21.15.49:0/2761746328 shutdown_connections 2023-12-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.604+0000 7f0e5dd62640 1 -- 172.21.15.49:0/2761746328 wait complete. 2023-12-19T05:47:29.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.606+0000 7f0e5dd62640 1 Processor -- start 2023-12-19T05:47:29.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.606+0000 7f0e5dd62640 1 -- start start 2023-12-19T05:47:29.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e580cdbf0 0x7f0e58151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e5815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5815d520 con 0x7f0e5815f680 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581530f0 con 0x7f0e580cdbf0 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5dd62640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581524e0 con 0x7f0e5815e5a0 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5d561640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5d561640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52630/0 (socket says 172.21.15.49:52630) 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.607+0000 7f0e5d561640 1 -- 172.21.15.49:0/1455417050 learned_addr learned my addr 172.21.15.49:0/1455417050 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e57fff640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e5815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5cd60640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e580cdbf0 0x7f0e58151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 -- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 msgr2=0x7f0e5815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e5815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 -- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e580cdbf0 msgr2=0x7f0e58151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e580cdbf0 0x7f0e58151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 -- 172.21.15.49:0/1455417050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440094d0 con 0x7f0e5815f680 2023-12-19T05:47:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.608+0000 7f0e5d561640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cef0 tx=0x7f0e5000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.609+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000d840 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.609+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000d9c0 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.609+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e581527c0 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.609+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000dd70 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.609+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58152d80 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.610+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58153260 con 0x7f0e5815f680 2023-12-19T05:47:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.611+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e5001e3b0 con 0x7f0e5815f680 2023-12-19T05:47:29.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.612+0000 7f0e557fa640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 0x7f0e3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:29.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.612+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f0e500894e0 con 0x7f0e5815f680 2023-12-19T05:47:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.613+0000 7f0e5cd60640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 0x7f0e3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.614+0000 7f0e5cd60640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 0x7f0e3c06c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0e58151430 tx=0x7f0e4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.616+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0e50054a90 con 0x7f0e5815f680 2023-12-19T05:47:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.814+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0e58061910 con 0x7f0e5815f680 2023-12-19T05:47:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.815+0000 7f0e557fa640 1 -- 172.21.15.49:0/1455417050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+34107 (secure 0 0 0) 0x7f0e500580b0 con 0x7f0e5815f680 2023-12-19T05:47:29.817 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 148, 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:47:25.352273+0000", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:47:29.818 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 17, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:47:29.819 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "luminous", 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:47:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.822 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.823 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:47:29.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 16, 2023-12-19T05:47:29.826 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:48.824621+0000", 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.827 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "142", 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.828 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.829 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.830 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:29.831 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 17, 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:47:29.832 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:46:50.051888+0000", 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:47:29.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "148", 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:47:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:47:29.835 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:47:29.836 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:47:29.837 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:47:29.838 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.839 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.844 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.845 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.846 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.848 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.850 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.852 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.853 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.854 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.855 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.856 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.857 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.858 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:47:29.859 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.860 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.861 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:47:29.862 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.865 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.866 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.867 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.868 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.869 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.870 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:47:29.871 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:29.872 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.873 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:47:29.874 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.877 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 141, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.878 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.879 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.880 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.881 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.882 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 144, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:47:29.883 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.885 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:47:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:47:29.887 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:47:29.888 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:47:29.889 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.890 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.891 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [ 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.893 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "16.1c", 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 4, 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 3 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.8", 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:29.894 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 5 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: "pgid": "17.3b", 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: "mappings": [ 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: "from": 6, 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: "to": 1 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:29.897 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 msgr2=0x7f0e3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 0x7f0e3c06c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0e58151430 tx=0x7f0e4c008040 comp rx=0 tx=0).stop 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 msgr2=0x7f0e5813b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cef0 tx=0x7f0e5000a710 comp rx=0 tx=0).stop 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 shutdown_connections 2023-12-19T05:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0e3c06a430 0x7f0e3c06c8f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5815e5a0 0x7f0e5815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5815f680 0x7f0e5813b950 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 --2- 172.21.15.49:0/1455417050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e580cdbf0 0x7f0e58151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.818+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 >> 172.21.15.49:0/1455417050 conn(0x7f0e580b0100 msgr2=0x7f0e5806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.819+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 shutdown_connections 2023-12-19T05:47:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:29.819+0000 7f0e5dd62640 1 -- 172.21.15.49:0/1455417050 wait complete. 2023-12-19T05:47:29.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.136+0000 7f78078ca640 1 Processor -- start 2023-12-19T05:47:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.137+0000 7f78078ca640 1 -- start start 2023-12-19T05:47:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.138+0000 7f78078ca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78000d2b00 0x7f78000d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.138+0000 7f78078ca640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78000ce110 0x7f78000ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.138+0000 7f78078ca640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78000cd840 con 0x7f7800146e10 2023-12-19T05:47:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.138+0000 7f78078ca640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78000d2430 con 0x7f78000d2b00 2023-12-19T05:47:30.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.138+0000 7f78078ca640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78000ceac0 con 0x7f78000ce110 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78000d2b00 0x7f78000d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78000d2b00 0x7f78000d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52636/0 (socket says 172.21.15.49:52636) 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7805666640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7800146e10 0x7f78000b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34964/0 (socket says 172.21.15.49:34964) 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 -- 172.21.15.49:0/1063235647 learned_addr learned my addr 172.21.15.49:0/1063235647 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7805e67640 1 --2- 172.21.15.49:0/1063235647 >> v2:172.21.15.115:3300/0 conn(0x7f78000ce110 0x7f78000ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 -- 172.21.15.49:0/1063235647 >> v2:172.21.15.115:3300/0 conn(0x7f78000ce110 msgr2=0x7f78000ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 --2- 172.21.15.49:0/1063235647 >> v2:172.21.15.115:3300/0 conn(0x7f78000ce110 0x7f78000ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 -- 172.21.15.49:0/1063235647 >> v1:172.21.15.49:6789/0 conn(0x7f7800146e10 legacy=0x7f78000b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.139+0000 7f7804e65640 1 -- 172.21.15.49:0/1063235647 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000b6e90 con 0x7f78000d2b00 2023-12-19T05:47:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.140+0000 7f7804e65640 1 --2- 172.21.15.49:0/1063235647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78000d2b00 0x7f78000d1ef0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f78000cedb0 tx=0x7f77f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c6517ff50a7f75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f77f7fff640 1 -- 172.21.15.49:0/1063235647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0031870 con 0x7f78000d2b00 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f77f7fff640 1 -- 172.21.15.49:0/1063235647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00319d0 con 0x7f78000d2b00 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f77f7fff640 1 -- 172.21.15.49:0/1063235647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0031d60 con 0x7f78000d2b00 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 -- 172.21.15.49:0/1063235647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78000d2b00 msgr2=0x7f78000d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 --2- 172.21.15.49:0/1063235647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78000d2b00 0x7f78000d1ef0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f78000cedb0 tx=0x7f77f002b910 comp rx=0 tx=0).stop 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 -- 172.21.15.49:0/1063235647 shutdown_connections 2023-12-19T05:47:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 --2- 172.21.15.49:0/1063235647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78000d2b00 0x7f78000d1ef0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 --2- 172.21.15.49:0/1063235647 >> v2:172.21.15.115:3300/0 conn(0x7f78000ce110 0x7f78000ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.141+0000 7f78078ca640 1 -- 172.21.15.49:0/1063235647 >> 172.21.15.49:0/1063235647 conn(0x7f78000b29c0 msgr2=0x7f78000b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.142+0000 7f78078ca640 1 -- 172.21.15.49:0/1063235647 shutdown_connections 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.142+0000 7f78078ca640 1 -- 172.21.15.49:0/1063235647 wait complete. 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.143+0000 7f78078ca640 1 Processor -- start 2023-12-19T05:47:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.143+0000 7f78078ca640 1 -- start start 2023-12-19T05:47:30.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 0x7f7800158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78000d2b00 0x7f780013d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800160e80 con 0x7f7800146e10 2023-12-19T05:47:30.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800158c50 con 0x7f78000ce110 2023-12-19T05:47:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.144+0000 7f78078ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780013de40 con 0x7f78000d2b00 2023-12-19T05:47:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52642/0 (socket says 172.21.15.49:52642) 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 -- 172.21.15.49:0/2762951999 learned_addr learned my addr 172.21.15.49:0/2762951999 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805666640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 0x7f7800158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7804e65640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78000d2b00 0x7f780013d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 -- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78000d2b00 msgr2=0x7f780013d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78000d2b00 0x7f780013d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 -- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 msgr2=0x7f7800158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 0x7f7800158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 -- 172.21.15.49:0/2762951999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00094d0 con 0x7f7800146e10 2023-12-19T05:47:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805666640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 0x7f7800158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.145+0000 7f7805e67640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007e90 tx=0x7f77f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.146+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8014420 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.146+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8014580 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.146+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8014930 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.146+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780013e0c0 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.146+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780013e680 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.147+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800061910 con 0x7f7800146e10 2023-12-19T05:47:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.148+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77f8014a90 con 0x7f7800146e10 2023-12-19T05:47:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.149+0000 7f77f5ffb640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 0x7f77e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.150+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f77f8089180 con 0x7f7800146e10 2023-12-19T05:47:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.150+0000 7f7805666640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 0x7f77e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.151+0000 7f7805666640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 0x7f77e406c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f60 tx=0x7f77fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.154+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77f80547a0 con 0x7f7800146e10 2023-12-19T05:47:30.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.384+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78000b92e0 con 0x7f7800146e10 2023-12-19T05:47:30.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.385+0000 7f77f5ffb640 1 -- 172.21.15.49:0/2762951999 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f77f8057dc0 con 0x7f7800146e10 2023-12-19T05:47:30.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:30.387 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 msgr2=0x7f77e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 0x7f77e406c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f60 tx=0x7f77fc009040 comp rx=0 tx=0).stop 2023-12-19T05:47:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 msgr2=0x7f780015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007e90 tx=0x7f77f800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 shutdown_connections 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f77e406a430 0x7f77e406c8f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78000d2b00 0x7f780013d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7800146e10 0x7f780015f1c0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 --2- 172.21.15.49:0/2762951999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78000ce110 0x7f7800158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 >> 172.21.15.49:0/2762951999 conn(0x7f78000b29c0 msgr2=0x7f78000b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 shutdown_connections 2023-12-19T05:47:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:30.388+0000 7f78078ca640 1 -- 172.21.15.49:0/2762951999 wait complete. 2023-12-19T05:47:30.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:47:30.653 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":7632,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.615847684999999,"mdsmap_epoch":64,"osdmap_epoch":148,"osdmap_epoch_barrier":147,"uptime":45.430903850999997} 2023-12-19T05:47:30.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 7632, "mdsmap_epoch": 64, "osdmap_epoch": 148, "osdmap_epoch_barrier": 147, "rank_uptime": 39.615847685, "state": "up:active", "uptime": 45.430903851, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:47:30.653 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:47:30.653 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:30.654 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:30.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:30.709 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T05:47:31.200 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:47:31.200 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:47:31.200 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.435694 s, 120 MB/s 2023-12-19T05:47:31.202 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:47:31.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:47:31.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:47:31.433 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:47:31.434 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:31.434 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:31.499 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:31.499 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:31.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:31.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.787+0000 7f9add438640 1 Processor -- start 2023-12-19T05:47:31.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.787+0000 7f9add438640 1 -- start start 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9add438640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad81449e0 0x7f9ad80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9add438640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ad80b0b50 0x7f9ad806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9add438640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80afb10 con 0x7f9ad806b590 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9add438640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad806bb30 con 0x7f9ad80b0b50 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9add438640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80b0070 con 0x7f9ad81449e0 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9ad67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ad80b0b50 0x7f9ad806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9ad67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ad80b0b50 0x7f9ad806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52650/0 (socket says 172.21.15.49:52650) 2023-12-19T05:47:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.789+0000 7f9ad67fc640 1 -- 172.21.15.49:0/4147305824 learned_addr learned my addr 172.21.15.49:0/4147305824 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.790+0000 7f9ad6ffd640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad81449e0 0x7f9ad80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.790+0000 7f9ad67fc640 1 -- 172.21.15.49:0/4147305824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad81449e0 msgr2=0x7f9ad80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.790+0000 7f9ad67fc640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad81449e0 0x7f9ad80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.790+0000 7f9ad67fc640 1 -- 172.21.15.49:0/4147305824 >> v1:172.21.15.49:6789/0 conn(0x7f9ad806b590 legacy=0x7f9ad815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.790+0000 7f9ad67fc640 1 -- 172.21.15.49:0/4147305824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80b0350 con 0x7f9ad80b0b50 2023-12-19T05:47:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.791+0000 7f9ad67fc640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad80b0b50 0x7f9ad806bfa0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009870 tx=0x7f9acc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152e3e86c962e21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9ad5ffb640 1 -- 172.21.15.49:0/4147305824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc030840 con 0x7f9ad80b0b50 2023-12-19T05:47:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9ad5ffb640 1 -- 172.21.15.49:0/4147305824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc0309a0 con 0x7f9ad80b0b50 2023-12-19T05:47:31.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9ad5ffb640 1 -- 172.21.15.49:0/4147305824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc030d30 con 0x7f9ad80b0b50 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 -- 172.21.15.49:0/4147305824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad80b0b50 msgr2=0x7f9ad806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad80b0b50 0x7f9ad806bfa0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009870 tx=0x7f9acc02b980 comp rx=0 tx=0).stop 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 -- 172.21.15.49:0/4147305824 shutdown_connections 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad80b0b50 0x7f9ad806bfa0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 --2- 172.21.15.49:0/4147305824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad81449e0 0x7f9ad80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 -- 172.21.15.49:0/4147305824 >> 172.21.15.49:0/4147305824 conn(0x7f9ad80cbb70 msgr2=0x7f9ad80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 -- 172.21.15.49:0/4147305824 shutdown_connections 2023-12-19T05:47:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.792+0000 7f9add438640 1 -- 172.21.15.49:0/4147305824 wait complete. 2023-12-19T05:47:31.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.794+0000 7f9add438640 1 Processor -- start 2023-12-19T05:47:31.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.794+0000 7f9add438640 1 -- start start 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.795+0000 7f9add438640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad806b590 0x7f9ad815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.795+0000 7f9add438640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 0x7f9ad81f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.795+0000 7f9add438640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9add438640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813efc0 con 0x7f9ad81449e0 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9add438640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813f2a0 con 0x7f9ad80b0b50 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9add438640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813f580 con 0x7f9ad806b590 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52658/0 (socket says 172.21.15.49:52658) 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 -- 172.21.15.49:0/682027718 learned_addr learned my addr 172.21.15.49:0/682027718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad6ffd640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad806b590 0x7f9ad815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad67fc640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 0x7f9ad81f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 -- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad806b590 msgr2=0x7f9ad815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad806b590 0x7f9ad815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 -- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 msgr2=0x7f9ad81f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 0x7f9ad81f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad77fe640 1 -- 172.21.15.49:0/682027718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0094d0 con 0x7f9ad81449e0 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.796+0000 7f9ad67fc640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 0x7f9ad81f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9ad77fe640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000c7a0 tx=0x7f9ad000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0003b70 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad0003cf0 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0003ea0 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad813f860 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.797+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80cb070 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.798+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8061910 con 0x7f9ad81449e0 2023-12-19T05:47:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.799+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ad000aa90 con 0x7f9ad81449e0 2023-12-19T05:47:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.800+0000 7f9abf7fe640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 0x7f9ac406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.800+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f9ad0088860 con 0x7f9ad81449e0 2023-12-19T05:47:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.801+0000 7f9ad6ffd640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 0x7f9ac406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.802+0000 7f9ad6ffd640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 0x7f9ac406c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8006fd0 tx=0x7f9ac8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:31.805+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ad0053d50 con 0x7f9ad81449e0 2023-12-19T05:47:32.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.001+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ad80ae560 con 0x7f9ad81449e0 2023-12-19T05:47:32.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.004+0000 7f9abf7fe640 1 -- 172.21.15.49:0/682027718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16256 (secure 0 0 0) 0x7f9ad0057370 con 0x7f9ad81449e0 2023-12-19T05:47:32.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":148,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:25.352273+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 msgr2=0x7f9ac406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 0x7f9ac406c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8006fd0 tx=0x7f9ac8008040 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 msgr2=0x7f9ad81402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000c7a0 tx=0x7f9ad000cc60 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 shutdown_connections 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ac406a430 0x7f9ac406c8f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad81449e0 0x7f9ad81402e0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ad80b0b50 0x7f9ad81f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 --2- 172.21.15.49:0/682027718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ad806b590 0x7f9ad815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 >> 172.21.15.49:0/682027718 conn(0x7f9ad80cbb70 msgr2=0x7f9ad806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 shutdown_connections 2023-12-19T05:47:32.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.007+0000 7f9add438640 1 -- 172.21.15.49:0/682027718 wait complete. 2023-12-19T05:47:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:48.824621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:50.051888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:47:32.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:47:32.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.257+0000 7f011c7fd640 1 Processor -- start 2023-12-19T05:47:32.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.257+0000 7f011c7fd640 1 -- start start 2023-12-19T05:47:32.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.259+0000 7f011c7fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.259+0000 7f011c7fd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f01140cc1a0 0x7f011415a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.259+0000 7f011c7fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140b2580 con 0x7f01140cf580 2023-12-19T05:47:32.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.259+0000 7f011c7fd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140b33e0 con 0x7f01140cc1a0 2023-12-19T05:47:32.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.259+0000 7f011c7fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01140b1ea0 con 0x7f01140cc880 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47088/0 (socket says 172.21.15.49:47088) 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 -- 172.21.15.49:0/2020380418 learned_addr learned my addr 172.21.15.49:0/2020380418 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011ad9a640 1 --2- 172.21.15.49:0/2020380418 >> v2:172.21.15.115:3300/0 conn(0x7f01140cc1a0 0x7f011415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 -- 172.21.15.49:0/2020380418 >> v2:172.21.15.115:3300/0 conn(0x7f01140cc1a0 msgr2=0x7f011415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 --2- 172.21.15.49:0/2020380418 >> v2:172.21.15.115:3300/0 conn(0x7f01140cc1a0 0x7f011415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 -- 172.21.15.49:0/2020380418 >> v1:172.21.15.115:6789/0 conn(0x7f01140cf580 legacy=0x7f01140ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.260+0000 7f011a599640 1 -- 172.21.15.49:0/2020380418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140b27d0 con 0x7f01140cc880 2023-12-19T05:47:32.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.262+0000 7f011a599640 1 --2- 172.21.15.49:0/2020380418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0110009870 tx=0x7f011002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff57129d5db5d214 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.262+0000 7f0119597640 1 -- 172.21.15.49:0/2020380418 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110030840 con 0x7f01140cc880 2023-12-19T05:47:32.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.262+0000 7f0119597640 1 -- 172.21.15.49:0/2020380418 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01100309a0 con 0x7f01140cc880 2023-12-19T05:47:32.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.262+0000 7f0119597640 1 -- 172.21.15.49:0/2020380418 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110030d30 con 0x7f01140cc880 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 -- 172.21.15.49:0/2020380418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 msgr2=0x7f011415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 --2- 172.21.15.49:0/2020380418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0110009870 tx=0x7f011002b980 comp rx=0 tx=0).stop 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 -- 172.21.15.49:0/2020380418 shutdown_connections 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 --2- 172.21.15.49:0/2020380418 >> v2:172.21.15.115:3300/0 conn(0x7f01140cc1a0 0x7f011415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 --2- 172.21.15.49:0/2020380418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc880 0x7f011415af20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 -- 172.21.15.49:0/2020380418 >> 172.21.15.49:0/2020380418 conn(0x7f0114073150 msgr2=0x7f01140659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 -- 172.21.15.49:0/2020380418 shutdown_connections 2023-12-19T05:47:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.263+0000 7f011c7fd640 1 -- 172.21.15.49:0/2020380418 wait complete. 2023-12-19T05:47:32.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.266+0000 7f011c7fd640 1 Processor -- start 2023-12-19T05:47:32.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.266+0000 7f011c7fd640 1 -- start start 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc1a0 0x7f0114155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01140cf580 0x7f011415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011414a3c0 con 0x7f01140cc880 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011414a7e0 con 0x7f01140cf580 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f011c7fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0114149740 con 0x7f01140cc1a0 2023-12-19T05:47:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.267+0000 7f0119d98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52664/0 (socket says 172.21.15.49:52664) 2023-12-19T05:47:32.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 -- 172.21.15.49:0/784574726 learned_addr learned my addr 172.21.15.49:0/784574726 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:32.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f011a599640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc1a0 0x7f0114155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f011ad9a640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01140cf580 0x7f011415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 -- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc1a0 msgr2=0x7f0114155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc1a0 0x7f0114155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 -- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01140cf580 msgr2=0x7f011415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01140cf580 0x7f011415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 -- 172.21.15.49:0/784574726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100094d0 con 0x7f01140cc880 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.268+0000 7f0119d98640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f010400c450 tx=0x7f010400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.269+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040052d0 con 0x7f01140cc880 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.269+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104005430 con 0x7f01140cc880 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.269+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0114149a20 con 0x7f01140cc880 2023-12-19T05:47:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.269+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104012870 con 0x7f01140cc880 2023-12-19T05:47:32.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.269+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114149fe0 con 0x7f01140cc880 2023-12-19T05:47:32.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.270+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0114061910 con 0x7f01140cc880 2023-12-19T05:47:32.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.272+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f01040129d0 con 0x7f01140cc880 2023-12-19T05:47:32.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.273+0000 7f010affd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 0x7f00f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.273+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f01040884f0 con 0x7f01140cc880 2023-12-19T05:47:32.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.273+0000 7f011a599640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 0x7f00f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.275+0000 7f011a599640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 0x7f00f806c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0110036000 tx=0x7f011003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.277+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f01040539f0 con 0x7f01140cc880 2023-12-19T05:47:32.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.468+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0114152190 con 0x7f01140cc880 2023-12-19T05:47:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.470+0000 7f010affd640 1 -- 172.21.15.49:0/784574726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0104057010 con 0x7f01140cc880 2023-12-19T05:47:32.471 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 msgr2=0x7f00f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 0x7f00f806c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0110036000 tx=0x7f011003b040 comp rx=0 tx=0).stop 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 msgr2=0x7f0114147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f010400c450 tx=0x7f010400c910 comp rx=0 tx=0).stop 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 shutdown_connections 2023-12-19T05:47:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00f806a430 0x7f00f806c8f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01140cf580 0x7f011415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01140cc880 0x7f0114147b50 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 --2- 172.21.15.49:0/784574726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f01140cc1a0 0x7f0114155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.472+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 >> 172.21.15.49:0/784574726 conn(0x7f0114073150 msgr2=0x7f011414e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.473+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 shutdown_connections 2023-12-19T05:47:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.473+0000 7f011c7fd640 1 -- 172.21.15.49:0/784574726 wait complete. 2023-12-19T05:47:32.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:47:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.734+0000 7f6a49430640 1 Processor -- start 2023-12-19T05:47:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.734+0000 7f6a49430640 1 -- start start 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a49430640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440d2b00 0x7f6a440d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a49430640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a440ce110 0x7f6a440ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a49430640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440cd840 con 0x7f6a44146e10 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a49430640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440d2430 con 0x7f6a440ce110 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a49430640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440ceae0 con 0x7f6a440d2b00 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a440ce110 0x7f6a440ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a437fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a440ce110 0x7f6a440ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52672/0 (socket says 172.21.15.49:52672) 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a437fe640 1 -- 172.21.15.49:0/3301734884 learned_addr learned my addr 172.21.15.49:0/3301734884 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.736+0000 7f6a427fc640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440d2b00 0x7f6a440d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.737+0000 7f6a437fe640 1 -- 172.21.15.49:0/3301734884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440d2b00 msgr2=0x7f6a440d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.737+0000 7f6a437fe640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440d2b00 0x7f6a440d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.737+0000 7f6a437fe640 1 -- 172.21.15.49:0/3301734884 >> v1:172.21.15.115:6789/0 conn(0x7f6a44146e10 legacy=0x7f6a440b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.737+0000 7f6a437fe640 1 -- 172.21.15.49:0/3301734884 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440b6e90 con 0x7f6a440ce110 2023-12-19T05:47:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.738+0000 7f6a437fe640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440ce110 0x7f6a440ce5a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0098a0 tx=0x7f6a3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5584547b6faf815 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.738+0000 7f6a41ffb640 1 -- 172.21.15.49:0/3301734884 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c031640 con 0x7f6a440ce110 2023-12-19T05:47:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.738+0000 7f6a41ffb640 1 -- 172.21.15.49:0/3301734884 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0317a0 con 0x7f6a440ce110 2023-12-19T05:47:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.738+0000 7f6a41ffb640 1 -- 172.21.15.49:0/3301734884 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c031b30 con 0x7f6a440ce110 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 -- 172.21.15.49:0/3301734884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440ce110 msgr2=0x7f6a440ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440ce110 0x7f6a440ce5a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0098a0 tx=0x7f6a3c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 -- 172.21.15.49:0/3301734884 shutdown_connections 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440d2b00 0x7f6a440d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 --2- 172.21.15.49:0/3301734884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440ce110 0x7f6a440ce5a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 -- 172.21.15.49:0/3301734884 >> 172.21.15.49:0/3301734884 conn(0x7f6a440b29c0 msgr2=0x7f6a440b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 -- 172.21.15.49:0/3301734884 shutdown_connections 2023-12-19T05:47:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.739+0000 7f6a49430640 1 -- 172.21.15.49:0/3301734884 wait complete. 2023-12-19T05:47:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.741+0000 7f6a49430640 1 Processor -- start 2023-12-19T05:47:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.742+0000 7f6a49430640 1 -- start start 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 0x7f6a4413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 0x7f6a44144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415c3f0 con 0x7f6a440d2b00 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44160160 con 0x7f6a44146e10 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a49430640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f6830 con 0x7f6a440ce110 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a427fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a427fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52676/0 (socket says 172.21.15.49:52676) 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.743+0000 7f6a427fc640 1 -- 172.21.15.49:0/3255031405 learned_addr learned my addr 172.21.15.49:0/3255031405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a437fe640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 0x7f6a44144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a42ffd640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 0x7f6a4413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 -- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 msgr2=0x7f6a4413ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 0x7f6a4413ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 -- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 msgr2=0x7f6a44144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 0x7f6a44144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 -- 172.21.15.49:0/3255031405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0094d0 con 0x7f6a440d2b00 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a437fe640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 0x7f6a44144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a42ffd640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 0x7f6a4413ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a427fc640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f6a34007ef0 tx=0x7f6a3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34014620 con 0x7f6a440d2b00 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34014780 con 0x7f6a440d2b00 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34014b30 con 0x7f6a440d2b00 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.744+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a441f6b10 con 0x7f6a440d2b00 2023-12-19T05:47:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.745+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4415fdf0 con 0x7f6a440d2b00 2023-12-19T05:47:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.746+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4415f970 con 0x7f6a440d2b00 2023-12-19T05:47:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.747+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a34014c90 con 0x7f6a440d2b00 2023-12-19T05:47:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.748+0000 7f6a3b7fe640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 0x7f6a2406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.748+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f6a34089320 con 0x7f6a440d2b00 2023-12-19T05:47:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.749+0000 7f6a42ffd640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 0x7f6a2406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.750+0000 7f6a42ffd640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 0x7f6a2406c920 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c003eb0 tx=0x7f6a2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.754+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6a4415f970 con 0x7f6a440d2b00 2023-12-19T05:47:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.948+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a4415f970 con 0x7f6a440d2b00 2023-12-19T05:47:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.949+0000 7f6a3b7fe640 1 -- 172.21.15.49:0/3255031405 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a4415f970 con 0x7f6a440d2b00 2023-12-19T05:47:32.950 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:47:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 msgr2=0x7f6a2406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 0x7f6a2406c920 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c003eb0 tx=0x7f6a2c009040 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 msgr2=0x7f6a441449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f6a34007ef0 tx=0x7f6a3400e4b0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 shutdown_connections 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6a2406a460 0x7f6a2406c920 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a44146e10 0x7f6a44144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a440d2b00 0x7f6a441449c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 --2- 172.21.15.49:0/3255031405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a440ce110 0x7f6a4413ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 >> 172.21.15.49:0/3255031405 conn(0x7f6a440b29c0 msgr2=0x7f6a440b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 shutdown_connections 2023-12-19T05:47:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:32.952+0000 7f6a49430640 1 -- 172.21.15.49:0/3255031405 wait complete. 2023-12-19T05:47:32.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:47:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.208+0000 7f9efbfff640 1 Processor -- start 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.208+0000 7f9efbfff640 1 -- start start 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.210+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.210+0000 7f9efbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9efc08a2d0 0x7f9efc08a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.210+0000 7f9efbfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc08ac70 con 0x7f9efc0aff20 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.210+0000 7f9efbfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0ce9a0 con 0x7f9efc08a2d0 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.210+0000 7f9efbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0cde20 con 0x7f9efc16d3c0 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.211+0000 7f9ef27fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9efc08a2d0 0x7f9efc08a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.211+0000 7f9ef27fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9efc08a2d0 0x7f9efc08a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52688/0 (socket says 172.21.15.49:52688) 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.211+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1724701952 learned_addr learned my addr 172.21.15.49:0/1724701952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.211+0000 7f9efaffd640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.212+0000 7f9efa7fc640 1 -- 172.21.15.49:0/1724701952 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107936145 0 0) 0x7f9efc08ac70 con 0x7f9efc0aff20 2023-12-19T05:47:33.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.225+0000 7f9efa7fc640 1 -- 172.21.15.49:0/1724701952 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee8003500 con 0x7f9efc0aff20 2023-12-19T05:47:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.226+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1724701952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 msgr2=0x7f9efc16a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.226+0000 7f9ef27fc640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.226+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1724701952 >> v1:172.21.15.115:6789/0 conn(0x7f9efc0aff20 legacy=0x7f9efc0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.226+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1724701952 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0ce100 con 0x7f9efc08a2d0 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.227+0000 7f9ef27fc640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc08a2d0 0x7f9efc08a730 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b920 tx=0x7f9ee402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3040c6b318a12ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.227+0000 7f9efa7fc640 1 -- 172.21.15.49:0/1724701952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee402cd00 con 0x7f9efc08a2d0 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.227+0000 7f9efa7fc640 1 -- 172.21.15.49:0/1724701952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee402ce60 con 0x7f9efc08a2d0 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.227+0000 7f9efa7fc640 1 -- 172.21.15.49:0/1724701952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4034660 con 0x7f9efc08a2d0 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 -- 172.21.15.49:0/1724701952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc08a2d0 msgr2=0x7f9efc08a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc08a2d0 0x7f9efc08a730 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b920 tx=0x7f9ee402bf50 comp rx=0 tx=0).stop 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 -- 172.21.15.49:0/1724701952 shutdown_connections 2023-12-19T05:47:33.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc08a2d0 0x7f9efc08a730 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1724701952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.228+0000 7f9efbfff640 1 -- 172.21.15.49:0/1724701952 >> 172.21.15.49:0/1724701952 conn(0x7f9efc06f630 msgr2=0x7f9efc06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:33.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.229+0000 7f9efbfff640 1 -- 172.21.15.49:0/1724701952 shutdown_connections 2023-12-19T05:47:33.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.229+0000 7f9efbfff640 1 -- 172.21.15.49:0/1724701952 wait complete. 2023-12-19T05:47:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.231+0000 7f9efbfff640 1 Processor -- start 2023-12-19T05:47:33.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.231+0000 7f9efbfff640 1 -- start start 2023-12-19T05:47:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9efc08a2d0 0x7f9efc2073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc1631f0 con 0x7f9efc0aff20 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc06b4c0 con 0x7f9efc08a2d0 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9efbfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc1615a0 con 0x7f9efc16d3c0 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9ef27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9ef27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52696/0 (socket says 172.21.15.49:52696) 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.232+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1283617122 learned_addr learned my addr 172.21.15.49:0/1283617122 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9efaffd640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9efc08a2d0 0x7f9efc2073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9efb7fe640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 msgr2=0x7f9efc16b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9efc08a2d0 msgr2=0x7f9efc2073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9efc08a2d0 0x7f9efc2073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 -- 172.21.15.49:0/1283617122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee400b580 con 0x7f9efc0aff20 2023-12-19T05:47:33.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef27fc640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b2c0 tx=0x7f9ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.233+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee403d600 con 0x7f9efc0aff20 2023-12-19T05:47:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.234+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee403d780 con 0x7f9efc0aff20 2023-12-19T05:47:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.234+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc161880 con 0x7f9efc0aff20 2023-12-19T05:47:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.234+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee403db30 con 0x7f9efc0aff20 2023-12-19T05:47:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.234+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc161e40 con 0x7f9efc0aff20 2023-12-19T05:47:33.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.235+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc061910 con 0x7f9efc0aff20 2023-12-19T05:47:33.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.236+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ee403b040 con 0x7f9efc0aff20 2023-12-19T05:47:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.237+0000 7f9ef3fff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.237+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f9ee40aa6e0 con 0x7f9efc0aff20 2023-12-19T05:47:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.238+0000 7f9efaffd640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.239+0000 7f9efaffd640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00cc70 tx=0x7f9eec005fe0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.241+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ee4075bd0 con 0x7f9efc0aff20 2023-12-19T05:47:33.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.437+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9efc16b040 con 0x7f9efc0aff20 2023-12-19T05:47:33.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.438+0000 7f9ef3fff640 1 -- 172.21.15.49:0/1283617122 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ee40791f0 con 0x7f9efc0aff20 2023-12-19T05:47:33.440 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 msgr2=0x7f9edc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00cc70 tx=0x7f9eec005fe0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 msgr2=0x7f9efc162cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b2c0 tx=0x7f9ee40046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 shutdown_connections 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9edc06a430 0x7f9edc06c8f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9efc16d3c0 0x7f9efc16b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9efc0aff20 0x7f9efc162cb0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 --2- 172.21.15.49:0/1283617122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9efc08a2d0 0x7f9efc2073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 >> 172.21.15.49:0/1283617122 conn(0x7f9efc06f630 msgr2=0x7f9efc169630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 shutdown_connections 2023-12-19T05:47:33.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.441+0000 7f9efbfff640 1 -- 172.21.15.49:0/1283617122 wait complete. 2023-12-19T05:47:33.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.693+0000 7f532763e640 1 Processor -- start 2023-12-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.693+0000 7f532763e640 1 -- start start 2023-12-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f532763e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 0x7f53200af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f532763e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53200b0b50 0x7f532006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f532763e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200afb10 con 0x7f532006b590 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f532763e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532006bb30 con 0x7f53200b0b50 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f532763e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200b0070 con 0x7f53201449e0 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f5324bd9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53200b0b50 0x7f532006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f5324bd9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53200b0b50 0x7f532006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52710/0 (socket says 172.21.15.49:52710) 2023-12-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f5324bd9640 1 -- 172.21.15.49:0/3643439186 learned_addr learned my addr 172.21.15.49:0/3643439186 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.695+0000 7f53253da640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 0x7f53200af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f5324bd9640 1 -- 172.21.15.49:0/3643439186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 msgr2=0x7f53200af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f5324bd9640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 0x7f53200af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f5324bd9640 1 -- 172.21.15.49:0/3643439186 >> v1:172.21.15.49:6789/0 conn(0x7f532006b590 legacy=0x7f532015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f5324bd9640 1 -- 172.21.15.49:0/3643439186 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200b0350 con 0x7f53200b0b50 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f53253da640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 0x7f53200af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.696+0000 7f5317fff640 1 -- 172.21.15.49:0/3643439186 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331440080 0 0) 0x7f53200afb10 con 0x7f532006b590 2023-12-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.697+0000 7f5324bd9640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532006bfa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5310009870 tx=0x7f531002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c544a7e827c79be6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f5317fff640 1 -- 172.21.15.49:0/3643439186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310030840 con 0x7f53200b0b50 2023-12-19T05:47:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f5317fff640 1 -- 172.21.15.49:0/3643439186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53100309a0 con 0x7f53200b0b50 2023-12-19T05:47:33.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f5317fff640 1 -- 172.21.15.49:0/3643439186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310030d30 con 0x7f53200b0b50 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f532763e640 1 -- 172.21.15.49:0/3643439186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 msgr2=0x7f532006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f532763e640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532006bfa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5310009870 tx=0x7f531002b980 comp rx=0 tx=0).stop 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f532763e640 1 -- 172.21.15.49:0/3643439186 shutdown_connections 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.698+0000 7f532763e640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532006bfa0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.699+0000 7f532763e640 1 --2- 172.21.15.49:0/3643439186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53201449e0 0x7f53200af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.699+0000 7f532763e640 1 -- 172.21.15.49:0/3643439186 >> 172.21.15.49:0/3643439186 conn(0x7f53200cbb70 msgr2=0x7f53200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.699+0000 7f532763e640 1 -- 172.21.15.49:0/3643439186 shutdown_connections 2023-12-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.699+0000 7f532763e640 1 -- 172.21.15.49:0/3643439186 wait complete. 2023-12-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.701+0000 7f532763e640 1 Processor -- start 2023-12-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.701+0000 7f532763e640 1 -- start start 2023-12-19T05:47:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f532006b590 0x7f53200adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53201449e0 0x7f53200a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532015dd80 con 0x7f53200b0b50 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532015ced0 con 0x7f53201449e0 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.702+0000 7f532763e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532015d170 con 0x7f532006b590 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52712/0 (socket says 172.21.15.49:52712) 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 -- 172.21.15.49:0/28171348 learned_addr learned my addr 172.21.15.49:0/28171348 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f53253da640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f532006b590 0x7f53200adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5325bdb640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53201449e0 0x7f53200a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 -- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f532006b590 msgr2=0x7f53200adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f532006b590 0x7f53200adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 -- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53201449e0 msgr2=0x7f53200a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.703+0000 7f5324bd9640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53201449e0 0x7f53200a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f5324bd9640 1 -- 172.21.15.49:0/28171348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100094d0 con 0x7f53200b0b50 2023-12-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f5324bd9640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310039c90 con 0x7f53200b0b50 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310039df0 con 0x7f53200b0b50 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310043640 con 0x7f53200b0b50 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.704+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532015d450 con 0x7f53200b0b50 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.705+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532015da10 con 0x7f53200b0b50 2023-12-19T05:47:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.706+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532015def0 con 0x7f53200b0b50 2023-12-19T05:47:33.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.707+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53100437a0 con 0x7f53200b0b50 2023-12-19T05:47:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.708+0000 7f5315ffb640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 0x7f530406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.708+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f531003e070 con 0x7f53200b0b50 2023-12-19T05:47:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.709+0000 7f53253da640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 0x7f530406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.710+0000 7f53253da640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 0x7f530406c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f531c006fd0 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.713+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5310076f50 con 0x7f53200b0b50 2023-12-19T05:47:33.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.919+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5320061910 con 0x7f53200b0b50 2023-12-19T05:47:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.920+0000 7f5315ffb640 1 -- 172.21.15.49:0/28171348 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v148) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5310034080 con 0x7f53200b0b50 2023-12-19T05:47:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:47:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 msgr2=0x7f530406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 0x7f530406c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f531c006fd0 tx=0x7f531c008040 comp rx=0 tx=0).stop 2023-12-19T05:47:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 msgr2=0x7f532015c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310004730 comp rx=0 tx=0).stop 2023-12-19T05:47:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 shutdown_connections 2023-12-19T05:47:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f530406a430 0x7f530406c8f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53201449e0 0x7f53200a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53200b0b50 0x7f532015c990 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 --2- 172.21.15.49:0/28171348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f532006b590 0x7f53200adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.923+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 >> 172.21.15.49:0/28171348 conn(0x7f53200cbb70 msgr2=0x7f532006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.924+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 shutdown_connections 2023-12-19T05:47:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:33.924+0000 7f532763e640 1 -- 172.21.15.49:0/28171348 wait complete. 2023-12-19T05:47:33.946 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:47:33.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:33.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:47:34.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:47:34.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:34.111 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:47:34.154 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:34.155 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:34.199 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:34.199 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:34.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:34.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.537+0000 7f0a958db640 1 Processor -- start 2023-12-19T05:47:34.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.537+0000 7f0a958db640 1 -- start start 2023-12-19T05:47:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.539+0000 7f0a958db640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a90157aa0 0x7f0a900b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.539+0000 7f0a958db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 0x7f0a9015e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.539+0000 7f0a958db640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9006e8c0 con 0x7f0a9006e410 2023-12-19T05:47:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a958db640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9015e9c0 con 0x7f0a90157aa0 2023-12-19T05:47:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a958db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900b2600 con 0x7f0a9015e040 2023-12-19T05:47:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a8effd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a90157aa0 0x7f0a900b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a8f7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 0x7f0a9015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a87fff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0a9006e410 0x7f0a90161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:45728/0 (socket says 172.21.15.49:45728) 2023-12-19T05:47:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.540+0000 7f0a87fff640 1 -- 172.21.15.49:0/1319947440 learned_addr learned my addr 172.21.15.49:0/1319947440 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:34.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.541+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/1319947440 >> v2:172.21.15.115:3300/0 conn(0x7f0a90157aa0 msgr2=0x7f0a900b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:34.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.541+0000 7f0a8e7fc640 1 -- 172.21.15.49:0/1319947440 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234973681 0 0) 0x7f0a9006e8c0 con 0x7f0a9006e410 2023-12-19T05:47:34.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.541+0000 7f0a8f7fe640 1 --2- 172.21.15.49:0/1319947440 >> v2:172.21.15.115:3300/0 conn(0x7f0a90157aa0 0x7f0a900b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.541+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/1319947440 >> v1:172.21.15.115:6789/0 conn(0x7f0a9006e410 legacy=0x7f0a90161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.541+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/1319947440 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900b1d60 con 0x7f0a9015e040 2023-12-19T05:47:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.543+0000 7f0a8f7fe640 1 --2- 172.21.15.49:0/1319947440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 0x7f0a9015e480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf9ba918aaabeb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.543+0000 7f0a8e7fc640 1 -- 172.21.15.49:0/1319947440 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8802cc50 con 0x7f0a9015e040 2023-12-19T05:47:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.543+0000 7f0a8e7fc640 1 -- 172.21.15.49:0/1319947440 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8802cdb0 con 0x7f0a9015e040 2023-12-19T05:47:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.543+0000 7f0a8e7fc640 1 -- 172.21.15.49:0/1319947440 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88034660 con 0x7f0a9015e040 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 -- 172.21.15.49:0/1319947440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 msgr2=0x7f0a9015e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 --2- 172.21.15.49:0/1319947440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 0x7f0a9015e480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8802bea0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 -- 172.21.15.49:0/1319947440 shutdown_connections 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 --2- 172.21.15.49:0/1319947440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9015e040 0x7f0a9015e480 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 --2- 172.21.15.49:0/1319947440 >> v2:172.21.15.115:3300/0 conn(0x7f0a90157aa0 0x7f0a900b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 -- 172.21.15.49:0/1319947440 >> 172.21.15.49:0/1319947440 conn(0x7f0a900cbb70 msgr2=0x7f0a900cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 -- 172.21.15.49:0/1319947440 shutdown_connections 2023-12-19T05:47:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.544+0000 7f0a958db640 1 -- 172.21.15.49:0/1319947440 wait complete. 2023-12-19T05:47:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.546+0000 7f0a958db640 1 Processor -- start 2023-12-19T05:47:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.546+0000 7f0a958db640 1 -- start start 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9006e410 0x7f0a9014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a90157aa0 0x7f0a9015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900ad230 con 0x7f0a9015e040 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9014c8c0 con 0x7f0a90157aa0 2023-12-19T05:47:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a958db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900ad480 con 0x7f0a9006e410 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50302/0 (socket says 172.21.15.49:50302) 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.547+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/4039978073 learned_addr learned my addr 172.21.15.49:0/4039978073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8effd640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9006e410 0x7f0a9014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a87fff640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a90157aa0 0x7f0a9015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9006e410 msgr2=0x7f0a9014c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9006e410 0x7f0a9014c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a90157aa0 msgr2=0x7f0a9015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a90157aa0 0x7f0a9015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 -- 172.21.15.49:0/4039978073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009a70 con 0x7f0a9015e040 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8f7fe640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88003b90 con 0x7f0a9015e040 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88003d10 con 0x7f0a9015e040 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88004270 con 0x7f0a9015e040 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.548+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a900ad760 con 0x7f0a9015e040 2023-12-19T05:47:34.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.549+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a900add20 con 0x7f0a9015e040 2023-12-19T05:47:34.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.550+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a900d0020 con 0x7f0a9015e040 2023-12-19T05:47:34.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.551+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a8803b050 con 0x7f0a9015e040 2023-12-19T05:47:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.552+0000 7f0a8cff9640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 0x7f0a7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.552+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f0a880aaea0 con 0x7f0a9015e040 2023-12-19T05:47:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.552+0000 7f0a8effd640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 0x7f0a7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.554+0000 7f0a8effd640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 0x7f0a7006c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009ad0 tx=0x7f0a80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.556+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a88076410 con 0x7f0a9015e040 2023-12-19T05:47:34.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.751+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a900b2300 con 0x7f0a9015e040 2023-12-19T05:47:34.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.753+0000 7f0a8cff9640 1 -- 172.21.15.49:0/4039978073 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16256 (secure 0 0 0) 0x7f0a900b2300 con 0x7f0a9015e040 2023-12-19T05:47:34.755 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":148,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:25.352273+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 msgr2=0x7f0a7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 0x7f0a7006c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009ad0 tx=0x7f0a80008040 comp rx=0 tx=0).stop 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 msgr2=0x7f0a9015fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a88004a40 comp rx=0 tx=0).stop 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 shutdown_connections 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a7006a430 0x7f0a7006c8f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a9015e040 0x7f0a9015fa00 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a90157aa0 0x7f0a9015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 --2- 172.21.15.49:0/4039978073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a9006e410 0x7f0a9014c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 >> 172.21.15.49:0/4039978073 conn(0x7f0a900cbb70 msgr2=0x7f0a900cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 shutdown_connections 2023-12-19T05:47:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:34.756+0000 7f0a958db640 1 -- 172.21.15.49:0/4039978073 wait complete. 2023-12-19T05:47:34.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:48.824621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:50.051888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:47:34.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.010+0000 7fbfe237e640 1 Processor -- start 2023-12-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.010+0000 7fbfe237e640 1 -- start start 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.012+0000 7fbfe237e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.012+0000 7fbfe237e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.012+0000 7fbfe237e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc15fde0 con 0x7fbfdc0b1ec0 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.012+0000 7fbfe237e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cf870 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.012+0000 7fbfe237e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15ef10 con 0x7fbfdc0ceea0 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50314/0 (socket says 172.21.15.49:50314) 2023-12-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 -- 172.21.15.49:0/1824958524 learned_addr learned my addr 172.21.15.49:0/1824958524 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfe091b640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 -- 172.21.15.49:0/1824958524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 msgr2=0x7fbfdc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 -- 172.21.15.49:0/1824958524 >> v1:172.21.15.115:6789/0 conn(0x7fbfdc0b1ec0 legacy=0x7fbfdc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfdbfff640 1 -- 172.21.15.49:0/1824958524 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0b2320 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.013+0000 7fbfe091b640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.014+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009e50 tx=0x7fbfcc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba88afea5d8aa5d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.015+0000 7fbfdb7fe640 1 -- 172.21.15.49:0/1824958524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc02ca70 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.015+0000 7fbfdb7fe640 1 -- 172.21.15.49:0/1824958524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc02cbd0 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.015+0000 7fbfdb7fe640 1 -- 172.21.15.49:0/1824958524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0343f0 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 -- 172.21.15.49:0/1824958524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 msgr2=0x7fbfdc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009e50 tx=0x7fbfcc02bed0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 -- 172.21.15.49:0/1824958524 shutdown_connections 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 --2- 172.21.15.49:0/1824958524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc0b2760 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 -- 172.21.15.49:0/1824958524 >> 172.21.15.49:0/1824958524 conn(0x7fbfdc073150 msgr2=0x7fbfdc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 -- 172.21.15.49:0/1824958524 shutdown_connections 2023-12-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.016+0000 7fbfe237e640 1 -- 172.21.15.49:0/1824958524 wait complete. 2023-12-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.018+0000 7fbfe237e640 1 Processor -- start 2023-12-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.018+0000 7fbfe237e640 1 -- start start 2023-12-19T05:47:35.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 0x7fbfdc14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c8340 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc146d90 con 0x7fbfdc0b1ec0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe237e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc147070 con 0x7fbfdc0ceea0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe091b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe091b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50324/0 (socket says 172.21.15.49:50324) 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.019+0000 7fbfe091b640 1 -- 172.21.15.49:0/2165483072 learned_addr learned my addr 172.21.15.49:0/2165483072 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 0x7fbfdc14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfd3fff640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 -- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 msgr2=0x7fbfdc1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc1462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 -- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 msgr2=0x7fbfdc14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 0x7fbfdc14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 -- 172.21.15.49:0/2165483072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009b30 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 0x7fbfdc14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.020+0000 7fbfe091b640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c7f0 tx=0x7fbfd400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.021+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4007820 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.021+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd4007980 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.021+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4007d70 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.021+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc147350 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.021+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc14bb90 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.022+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0c8510 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.023+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfd40113f0 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.025+0000 7fbfd97fa640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 0x7fbfbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.025+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbfd4088cd0 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.026+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 0x7fbfbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.027+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 0x7fbfbc06c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc035000 tx=0x7fbfcc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.030+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfdc0c8510 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.230+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfdc061910 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.230+0000 7fbfd97fa640 1 -- 172.21.15.49:0/2165483072 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfd401f0a0 con 0x7fbfdc15b1d0 2023-12-19T05:47:35.232 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:47:35.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 msgr2=0x7fbfbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 0x7fbfbc06c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc035000 tx=0x7fbfcc030000 comp rx=0 tx=0).stop 2023-12-19T05:47:35.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 msgr2=0x7fbfdc156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c7f0 tx=0x7fbfd400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 shutdown_connections 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbfbc06a430 0x7fbfbc06c8f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfdc0ceea0 0x7fbfdc1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfdc15b1d0 0x7fbfdc156c60 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 --2- 172.21.15.49:0/2165483072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfdc0b1ec0 0x7fbfdc14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 >> 172.21.15.49:0/2165483072 conn(0x7fbfdc073150 msgr2=0x7fbfdc158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 shutdown_connections 2023-12-19T05:47:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.234+0000 7fbfe237e640 1 -- 172.21.15.49:0/2165483072 wait complete. 2023-12-19T05:47:35.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:47:35.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.488+0000 7ffbc6284640 1 Processor -- start 2023-12-19T05:47:35.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.488+0000 7ffbc6284640 1 -- start start 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbc6284640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbc015da30 0x7ffbc00b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbc6284640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc015e1a0 con 0x7ffbc0161020 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbc6284640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc015e480 con 0x7ffbc00b6900 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbc6284640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc015e760 con 0x7ffbc015da30 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbbffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffbc0161020 0x7ffbc0143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44614/0 (socket says 172.21.15.49:44614) 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbbffff640 1 -- 172.21.15.49:0/4289954850 learned_addr learned my addr 172.21.15.49:0/4289954850 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:35.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.490+0000 7ffbb7fff640 1 --2- 172.21.15.49:0/4289954850 >> v2:172.21.15.49:3300/0 conn(0x7ffbc015da30 0x7ffbc00b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.491+0000 7ffbb7fff640 1 -- 172.21.15.49:0/4289954850 >> v1:172.21.15.115:6789/0 conn(0x7ffbc00b6900 legacy=0x7ffbc00b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:35.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.491+0000 7ffbbf7fe640 1 -- 172.21.15.49:0/4289954850 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153131782 0 0) 0x7ffbc015e1a0 con 0x7ffbc0161020 2023-12-19T05:47:35.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.491+0000 7ffbb7fff640 1 -- 172.21.15.49:0/4289954850 >> v1:172.21.15.49:6789/0 conn(0x7ffbc0161020 legacy=0x7ffbc0143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.491+0000 7ffbb7fff640 1 -- 172.21.15.49:0/4289954850 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0142d10 con 0x7ffbc015da30 2023-12-19T05:47:35.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.492+0000 7ffbb7fff640 1 --2- 172.21.15.49:0/4289954850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc015da30 0x7ffbc00b63c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ffba80097a0 tx=0x7ffba802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e061e0d4f26ff72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbbf7fe640 1 -- 172.21.15.49:0/4289954850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8031830 con 0x7ffbc015da30 2023-12-19T05:47:35.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbbf7fe640 1 -- 172.21.15.49:0/4289954850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8031990 con 0x7ffbc015da30 2023-12-19T05:47:35.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbbf7fe640 1 -- 172.21.15.49:0/4289954850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8031d20 con 0x7ffbc015da30 2023-12-19T05:47:35.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 -- 172.21.15.49:0/4289954850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc015da30 msgr2=0x7ffbc00b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 --2- 172.21.15.49:0/4289954850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc015da30 0x7ffbc00b63c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ffba80097a0 tx=0x7ffba802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 -- 172.21.15.49:0/4289954850 shutdown_connections 2023-12-19T05:47:35.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 --2- 172.21.15.49:0/4289954850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc015da30 0x7ffbc00b63c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 -- 172.21.15.49:0/4289954850 >> 172.21.15.49:0/4289954850 conn(0x7ffbc00b26f0 msgr2=0x7ffbc00b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:35.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.493+0000 7ffbc6284640 1 -- 172.21.15.49:0/4289954850 shutdown_connections 2023-12-19T05:47:35.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.494+0000 7ffbc6284640 1 -- 172.21.15.49:0/4289954850 wait complete. 2023-12-19T05:47:35.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.495+0000 7ffbc6284640 1 Processor -- start 2023-12-19T05:47:35.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.495+0000 7ffbc6284640 1 -- start start 2023-12-19T05:47:35.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbc00b6900 0x7ffbc015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbc015da30 0x7ffbc015f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01595d0 con 0x7ffbc0161020 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0133770 con 0x7ffbc015da30 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.496+0000 7ffbc6284640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0133a50 con 0x7ffbc00b6900 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50346/0 (socket says 172.21.15.49:50346) 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 -- 172.21.15.49:0/2893000180 learned_addr learned my addr 172.21.15.49:0/2893000180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbbffff640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbc00b6900 0x7ffbc015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbb7fff640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbc015da30 0x7ffbc015f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 -- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbc00b6900 msgr2=0x7ffbc015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbc00b6900 0x7ffbc015cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 -- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbc015da30 msgr2=0x7ffbc015f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbc015da30 0x7ffbc015f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.497+0000 7ffbc4821640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8009400 con 0x7ffbc0161020 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbc4821640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c780 tx=0x7ffbb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004b60 con 0x7ffbc0161020 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800ce90 con 0x7ffbc0161020 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800a850 con 0x7ffbc0161020 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc0133d30 con 0x7ffbc0161020 2023-12-19T05:47:35.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.498+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc01342f0 con 0x7ffbc0161020 2023-12-19T05:47:35.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.499+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0157eb0 con 0x7ffbc0161020 2023-12-19T05:47:35.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.500+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffbb800a9b0 con 0x7ffbc0161020 2023-12-19T05:47:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.501+0000 7ffbbd7fa640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 0x7ffba006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.501+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7ffbb8088ae0 con 0x7ffbc0161020 2023-12-19T05:47:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.502+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7ffba0072080 con 0x7ffbc0161020 2023-12-19T05:47:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.502+0000 7ffbbffff640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 0x7ffba006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.503+0000 7ffbbffff640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 0x7ffba006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000f60 tx=0x7ffbb0007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.506+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffbb8054100 con 0x7ffbc0161020 2023-12-19T05:47:35.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.704+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbc01344e0 con 0x7ffbc0161020 2023-12-19T05:47:35.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.705+0000 7ffbbd7fa640 1 -- 172.21.15.49:0/2893000180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbb8057720 con 0x7ffbc0161020 2023-12-19T05:47:35.706 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 msgr2=0x7ffba006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 0x7ffba006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000f60 tx=0x7ffbb0007c00 comp rx=0 tx=0).stop 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 msgr2=0x7ffbc015ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c780 tx=0x7ffbb800cc40 comp rx=0 tx=0).stop 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 shutdown_connections 2023-12-19T05:47:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba006a430 0x7ffba006c8f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc0161020 0x7ffbc015ff30 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbc015da30 0x7ffbc015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 --2- 172.21.15.49:0/2893000180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbc00b6900 0x7ffbc015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 >> 172.21.15.49:0/2893000180 conn(0x7ffbc00b26f0 msgr2=0x7ffbc0141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 shutdown_connections 2023-12-19T05:47:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.708+0000 7ffbc6284640 1 -- 172.21.15.49:0/2893000180 wait complete. 2023-12-19T05:47:35.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:47:35.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.965+0000 7fe62aab9640 1 Processor -- start 2023-12-19T05:47:35.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.965+0000 7fe62aab9640 1 -- start start 2023-12-19T05:47:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62aab9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe62415b040 0x7fe6240ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62aab9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6240b2020 0x7fe6240b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62aab9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240cfc90 con 0x7fe62415ebc0 2023-12-19T05:47:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62aab9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240b29d0 con 0x7fe6240b2020 2023-12-19T05:47:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62aab9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62415b420 con 0x7fe62415b040 2023-12-19T05:47:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62a2b8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6240b2020 0x7fe6240b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62a2b8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6240b2020 0x7fe6240b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50362/0 (socket says 172.21.15.49:50362) 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.967+0000 7fe62a2b8640 1 -- 172.21.15.49:0/399755860 learned_addr learned my addr 172.21.15.49:0/399755860 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.968+0000 7fe629ab7640 1 --2- 172.21.15.49:0/399755860 >> v2:172.21.15.115:3300/0 conn(0x7fe62415b040 0x7fe6240ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.968+0000 7fe62a2b8640 1 -- 172.21.15.49:0/399755860 >> v2:172.21.15.115:3300/0 conn(0x7fe62415b040 msgr2=0x7fe6240ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.968+0000 7fe62a2b8640 1 --2- 172.21.15.49:0/399755860 >> v2:172.21.15.115:3300/0 conn(0x7fe62415b040 0x7fe6240ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.968+0000 7fe62a2b8640 1 -- 172.21.15.49:0/399755860 >> v1:172.21.15.115:6789/0 conn(0x7fe62415ebc0 legacy=0x7fe6240b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.968+0000 7fe62a2b8640 1 -- 172.21.15.49:0/399755860 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240cf080 con 0x7fe6240b2020 2023-12-19T05:47:35.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.969+0000 7fe62a2b8640 1 --2- 172.21.15.49:0/399755860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6240b2020 0x7fe6240b2490 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe62406d5f0 tx=0x7fe61c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7bf6e0692c9d1e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.970+0000 7fe628ab5640 1 -- 172.21.15.49:0/399755860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c030880 con 0x7fe6240b2020 2023-12-19T05:47:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.970+0000 7fe628ab5640 1 -- 172.21.15.49:0/399755860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c0309e0 con 0x7fe6240b2020 2023-12-19T05:47:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.970+0000 7fe628ab5640 1 -- 172.21.15.49:0/399755860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c030d70 con 0x7fe6240b2020 2023-12-19T05:47:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.970+0000 7fe62aab9640 1 -- 172.21.15.49:0/399755860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6240b2020 msgr2=0x7fe6240b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.970+0000 7fe62aab9640 1 --2- 172.21.15.49:0/399755860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6240b2020 0x7fe6240b2490 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe62406d5f0 tx=0x7fe61c02b9c0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 -- 172.21.15.49:0/399755860 shutdown_connections 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 --2- 172.21.15.49:0/399755860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6240b2020 0x7fe6240b2490 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 --2- 172.21.15.49:0/399755860 >> v2:172.21.15.115:3300/0 conn(0x7fe62415b040 0x7fe6240ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 -- 172.21.15.49:0/399755860 >> 172.21.15.49:0/399755860 conn(0x7fe624071370 msgr2=0x7fe624071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 -- 172.21.15.49:0/399755860 shutdown_connections 2023-12-19T05:47:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.971+0000 7fe62aab9640 1 -- 172.21.15.49:0/399755860 wait complete. 2023-12-19T05:47:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.972+0000 7fe62aab9640 1 Processor -- start 2023-12-19T05:47:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.973+0000 7fe62aab9640 1 -- start start 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6240b2020 0x7fe62414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe62415ebc0 0x7fe6240ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62414f0d0 con 0x7fe62415b040 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b4df0 con 0x7fe62415ebc0 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62aab9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b4550 con 0x7fe6240b2020 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe6292b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe6292b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50374/0 (socket says 172.21.15.49:50374) 2023-12-19T05:47:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe6292b6640 1 -- 172.21.15.49:0/4044660806 learned_addr learned my addr 172.21.15.49:0/4044660806 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe629ab7640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6240b2020 0x7fe62414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.974+0000 7fe62a2b8640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe62415ebc0 0x7fe6240ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 -- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6240b2020 msgr2=0x7fe62414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6240b2020 0x7fe62414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 -- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe62415ebc0 msgr2=0x7fe6240ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe62415ebc0 0x7fe6240ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0094d0 con 0x7fe62415b040 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6292b6640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c450 tx=0x7fe61000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100052d0 con 0x7fe62415b040 2023-12-19T05:47:35.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe610005430 con 0x7fe62415b040 2023-12-19T05:47:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610012870 con 0x7fe62415b040 2023-12-19T05:47:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6240b4830 con 0x7fe62415b040 2023-12-19T05:47:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.975+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240ac9e0 con 0x7fe62415b040 2023-12-19T05:47:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.976+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624061910 con 0x7fe62415b040 2023-12-19T05:47:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.978+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6100129d0 con 0x7fe62415b040 2023-12-19T05:47:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.978+0000 7fe6227fc640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 0x7fe60806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.979+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fe6100884f0 con 0x7fe62415b040 2023-12-19T05:47:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.979+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fe608072080 con 0x7fe62415b040 2023-12-19T05:47:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.979+0000 7fe629ab7640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 0x7fe60806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:35.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.980+0000 7fe629ab7640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 0x7fe60806c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe6180074a0 tx=0x7fe61800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:35.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:35.983+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe610053a70 con 0x7fe62415b040 2023-12-19T05:47:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.182+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6240cf330 con 0x7fe62415b040 2023-12-19T05:47:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.183+0000 7fe6227fc640 1 -- 172.21.15.49:0/4044660806 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe610057090 con 0x7fe62415b040 2023-12-19T05:47:36.185 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 msgr2=0x7fe60806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 0x7fe60806c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe6180074a0 tx=0x7fe61800b040 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 msgr2=0x7fe624155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c450 tx=0x7fe61000c910 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 shutdown_connections 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe60806a430 0x7fe60806c8f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe62415ebc0 0x7fe6240ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe62415b040 0x7fe624155780 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 --2- 172.21.15.49:0/4044660806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6240b2020 0x7fe62414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 >> 172.21.15.49:0/4044660806 conn(0x7fe624071370 msgr2=0x7fe6240b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.186+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 shutdown_connections 2023-12-19T05:47:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.187+0000 7fe62aab9640 1 -- 172.21.15.49:0/4044660806 wait complete. 2023-12-19T05:47:36.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:47:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.432+0000 7f0bfece6640 1 Processor -- start 2023-12-19T05:47:36.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.432+0000 7f0bfece6640 1 -- start start 2023-12-19T05:47:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfece6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bf8157710 0x7f0bf80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfece6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf815d7d0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfece6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf80b2ea0 con 0x7f0bf80b2990 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfece6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf815da90 con 0x7f0bf8157710 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfdce4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bf8157710 0x7f0bf80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfdce4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bf8157710 0x7f0bf80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50382/0 (socket says 172.21.15.49:50382) 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfdce4640 1 -- 172.21.15.49:0/1320027491 learned_addr learned my addr 172.21.15.49:0/1320027491 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.434+0000 7f0bfe4e5640 1 --1- 172.21.15.49:0/1320027491 >> v1:172.21.15.49:6789/0 conn(0x7f0bf80b0a00 0x7f0bf8160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44624/0 (socket says 172.21.15.49:44624) 2023-12-19T05:47:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.435+0000 7f0bfcce2640 1 -- 172.21.15.49:0/1320027491 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498983058 0 0) 0x7f0bf815d7d0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.435+0000 7f0bfcce2640 1 -- 172.21.15.49:0/1320027491 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be0003520 con 0x7f0bf80b0a00 2023-12-19T05:47:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.435+0000 7f0bfdce4640 1 -- 172.21.15.49:0/1320027491 >> v1:172.21.15.115:6789/0 conn(0x7f0bf80b2990 legacy=0x7f0bf80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.435+0000 7f0bfdce4640 1 -- 172.21.15.49:0/1320027491 >> v1:172.21.15.49:6789/0 conn(0x7f0bf80b0a00 legacy=0x7f0bf8160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.435+0000 7f0bfdce4640 1 -- 172.21.15.49:0/1320027491 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf815dd70 con 0x7f0bf8157710 2023-12-19T05:47:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.436+0000 7f0bfdce4640 1 --2- 172.21.15.49:0/1320027491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf8157710 0x7f0bf80b2450 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a4d59088f0fcc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:36.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.436+0000 7f0bfcce2640 1 -- 172.21.15.49:0/1320027491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8031870 con 0x7f0bf8157710 2023-12-19T05:47:36.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfcce2640 1 -- 172.21.15.49:0/1320027491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80319d0 con 0x7f0bf8157710 2023-12-19T05:47:36.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfcce2640 1 -- 172.21.15.49:0/1320027491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8031d60 con 0x7f0bf8157710 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 -- 172.21.15.49:0/1320027491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf8157710 msgr2=0x7f0bf80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 --2- 172.21.15.49:0/1320027491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf8157710 0x7f0bf80b2450 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802b910 comp rx=0 tx=0).stop 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 -- 172.21.15.49:0/1320027491 shutdown_connections 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 --2- 172.21.15.49:0/1320027491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf8157710 0x7f0bf80b2450 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 -- 172.21.15.49:0/1320027491 >> 172.21.15.49:0/1320027491 conn(0x7f0bf80659a0 msgr2=0x7f0bf8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 -- 172.21.15.49:0/1320027491 shutdown_connections 2023-12-19T05:47:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.437+0000 7f0bfece6640 1 -- 172.21.15.49:0/1320027491 wait complete. 2023-12-19T05:47:36.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.439+0000 7f0bfece6640 1 Processor -- start 2023-12-19T05:47:36.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.439+0000 7f0bfece6640 1 -- start start 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bf80b2990 0x7f0bf815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bf8157710 0x7f0bf815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8158320 con 0x7f0bf80b0a00 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81585e0 con 0x7f0bf80b2990 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.440+0000 7f0bfece6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81588c0 con 0x7f0bf8157710 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50388/0 (socket says 172.21.15.49:50388) 2023-12-19T05:47:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 -- 172.21.15.49:0/4005765066 learned_addr learned my addr 172.21.15.49:0/4005765066 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfd4e3640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bf80b2990 0x7f0bf815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfe4e5640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bf8157710 0x7f0bf815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 -- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bf8157710 msgr2=0x7f0bf815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bf8157710 0x7f0bf815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 -- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bf80b2990 msgr2=0x7f0bf815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bf80b2990 0x7f0bf815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.441+0000 7f0bfdce4640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be80094d0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bfdce4640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be803abe0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be803ad40 con 0x7f0bf80b0a00 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8044630 con 0x7f0bf80b0a00 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf8158ba0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.442+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf8158010 con 0x7f0bf80b0a00 2023-12-19T05:47:36.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.443+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf81590c0 con 0x7f0bf80b0a00 2023-12-19T05:47:36.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.444+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0be804d450 con 0x7f0bf80b0a00 2023-12-19T05:47:36.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.445+0000 7f0bf67fc640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 0x7f0be406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:36.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.445+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f0be802d040 con 0x7f0bf80b0a00 2023-12-19T05:47:36.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.446+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f0be4072080 con 0x7f0bf80b0a00 2023-12-19T05:47:36.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.446+0000 7f0bfd4e3640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 0x7f0be406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:36.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.447+0000 7f0bfd4e3640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 0x7f0be406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0bf81f6b30 tx=0x7f0bec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:36.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.449+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0be8035060 con 0x7f0bf80b0a00 2023-12-19T05:47:36.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.660+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0bf8061910 con 0x7f0bf80b0a00 2023-12-19T05:47:36.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.661+0000 7f0bf67fc640 1 -- 172.21.15.49:0/4005765066 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v149) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0be8076400 con 0x7f0bf80b0a00 2023-12-19T05:47:36.662 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 msgr2=0x7f0be406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 0x7f0be406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0bf81f6b30 tx=0x7f0bec009040 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 msgr2=0x7f0bf814f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be80046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 shutdown_connections 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0be406a430 0x7f0be406c8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bf8157710 0x7f0bf815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bf80b2990 0x7f0bf815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 --2- 172.21.15.49:0/4005765066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bf80b0a00 0x7f0bf814f7d0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:36.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.663+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 >> 172.21.15.49:0/4005765066 conn(0x7f0bf80659a0 msgr2=0x7f0bf806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:36.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.664+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 shutdown_connections 2023-12-19T05:47:36.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:36.664+0000 7f0bfece6640 1 -- 172.21.15.49:0/4005765066 wait complete. 2023-12-19T05:47:36.685 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:47:36.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:36.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:47:36.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:47:36.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:47:36.797 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:47:36.853 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:36.854 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:36.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:47:36.920 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:36.920 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:36.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:47:36.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:37.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.220+0000 7f167f0a8640 1 Processor -- start 2023-12-19T05:47:37.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.220+0000 7f167f0a8640 1 -- start start 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.222+0000 7f167f0a8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f167815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.222+0000 7f167f0a8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167806b520 con 0x7f1678159f80 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.222+0000 7f167f0a8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16780b2b20 con 0x7f167815a8a0 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.222+0000 7f167f0a8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780b2fb0 con 0x7f167815b1e0 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.222+0000 7f167e0a6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1678159f80 0x7f167806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44634/0 (socket says 172.21.15.49:44634) 2023-12-19T05:47:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167e0a6640 1 -- 172.21.15.49:0/3479349908 learned_addr learned my addr 172.21.15.49:0/3479349908 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993130639 0 0) 0x7f167806b520 con 0x7f1678159f80 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1664003520 con 0x7f1678159f80 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d8a5640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f167815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3150925673 0 0) 0x7f1664003520 con 0x7f1678159f80 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 msgr2=0x7f167815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f167815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 >> v1:172.21.15.115:6789/0 conn(0x7f167815a8a0 legacy=0x7f167815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780b1f10 con 0x7f1678159f80 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.223+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1674001670 con 0x7f1678159f80 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 >> v1:172.21.15.49:6789/0 conn(0x7f1678159f80 legacy=0x7f167806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16640039a0 0x7f1664003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f16640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1664004d00 0x7f1664005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780b2fb0 con 0x7f1664004d00 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166400bba0 con 0x7f16640039a0 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166400bd60 con 0x7f167815b1e0 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1664004d00 0x7f1664005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e0a6640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16640039a0 0x7f1664003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167d8a5640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f16640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 -- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 msgr2=0x7f16640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167815b1e0 0x7f16640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 -- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16640039a0 msgr2=0x7f1664003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16640039a0 0x7f1664003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.224+0000 7f167e8a7640 1 -- 172.21.15.49:0/3479349908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664003520 con 0x7f1664004d00 2023-12-19T05:47:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167e8a7640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1664004d00 0x7f1664005180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f16700044b0 tx=0x7f16640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6c942091332828 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670030620 con 0x7f1664004d00 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670030780 con 0x7f1664004d00 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167d0a4640 1 -- 172.21.15.49:0/3479349908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670030b30 con 0x7f1664004d00 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167f0a8640 1 -- 172.21.15.49:0/3479349908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1664004d00 msgr2=0x7f1664005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.226+0000 7f167f0a8640 1 --2- 172.21.15.49:0/3479349908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1664004d00 0x7f1664005180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f16700044b0 tx=0x7f16640057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.227+0000 7f167e8a7640 1 -- 172.21.15.49:0/3479349908 reap_dead start 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.227+0000 7f167f0a8640 1 -- 172.21.15.49:0/3479349908 shutdown_connections 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.227+0000 7f167f0a8640 1 -- 172.21.15.49:0/3479349908 >> 172.21.15.49:0/3479349908 conn(0x7f16780b0100 msgr2=0x7f16780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.227+0000 7f167f0a8640 1 -- 172.21.15.49:0/3479349908 shutdown_connections 2023-12-19T05:47:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.227+0000 7f167f0a8640 1 -- 172.21.15.49:0/3479349908 wait complete. 2023-12-19T05:47:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.229+0000 7f167f0a8640 1 Processor -- start 2023-12-19T05:47:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.229+0000 7f167f0a8640 1 -- start start 2023-12-19T05:47:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1664004d00 0x7f1678142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16781576c0 0x7f16780acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16781563d0 con 0x7f1678157b40 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678157230 con 0x7f1664004d00 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167f0a8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1678143030 con 0x7f16781576c0 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167e8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167e8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50404/0 (socket says 172.21.15.49:50404) 2023-12-19T05:47:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167e8a7640 1 -- 172.21.15.49:0/1519443457 learned_addr learned my addr 172.21.15.49:0/1519443457 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167d8a5640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16781576c0 0x7f16780acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.230+0000 7f167e0a6640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1664004d00 0x7f1678142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 -- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16781576c0 msgr2=0x7f16780acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16781576c0 0x7f16780acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 -- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1664004d00 msgr2=0x7f1678142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1664004d00 0x7f1678142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678156620 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167e8a7640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f167002bf80 tx=0x7f1670003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167003f070 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670030930 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670039690 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1678156900 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.231+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1678156ec0 con 0x7f1678157b40 2023-12-19T05:47:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.232+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1678157080 con 0x7f1678157b40 2023-12-19T05:47:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.234+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16700397f0 con 0x7f1678157b40 2023-12-19T05:47:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.235+0000 7f166effd640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 0x7f165c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.235+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f16700a9950 con 0x7f1678157b40 2023-12-19T05:47:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.235+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f165c0720b0 con 0x7f1678157b40 2023-12-19T05:47:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.235+0000 7f167e0a6640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 0x7f165c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.236+0000 7f167e0a6640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 0x7f165c06c920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1674001eb0 tx=0x7f1674001b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.239+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1670074ed0 con 0x7f1678157b40 2023-12-19T05:47:37.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.475+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1678061910 con 0x7f1678157b40 2023-12-19T05:47:37.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.476+0000 7f166effd640 1 -- 172.21.15.49:0/1519443457 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f16700784f0 con 0x7f1678157b40 2023-12-19T05:47:37.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:37.478 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:37.478 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 msgr2=0x7f165c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 0x7f165c06c920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1674001eb0 tx=0x7f1674001b70 comp rx=0 tx=0).stop 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 msgr2=0x7f16780ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f167002bf80 tx=0x7f1670003a70 comp rx=0 tx=0).stop 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 shutdown_connections 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f165c06a460 0x7f165c06c920 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16781576c0 0x7f16780acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1678157b40 0x7f16780ad000 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 --2- 172.21.15.49:0/1519443457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1664004d00 0x7f1678142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 >> 172.21.15.49:0/1519443457 conn(0x7f16780b0100 msgr2=0x7f1678155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 shutdown_connections 2023-12-19T05:47:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.479+0000 7f167f0a8640 1 -- 172.21.15.49:0/1519443457 wait complete. 2023-12-19T05:47:37.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.732+0000 7f90f89f0640 1 Processor -- start 2023-12-19T05:47:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.733+0000 7f90f89f0640 1 -- start start 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.734+0000 7f90f89f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90f4146da0 0x7f90f40aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.734+0000 7f90f89f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 0x7f90f40aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f89f0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 0x7f90f4161640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f89f0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f4161b80 con 0x7f90f4146da0 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f89f0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40d1070 con 0x7f90f41611f0 2023-12-19T05:47:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f89f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4162020 con 0x7f90f4147180 2023-12-19T05:47:37.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90f4146da0 0x7f90f40aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90f4146da0 0x7f90f40aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50416/0 (socket says 172.21.15.49:50416) 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f259c640 1 -- 172.21.15.49:0/1116034515 learned_addr learned my addr 172.21.15.49:0/1116034515 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.735+0000 7f90f1d9b640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 0x7f90f40aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f259c640 1 -- 172.21.15.49:0/1116034515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 msgr2=0x7f90f40aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f2d9d640 1 --2- 172.21.15.49:0/1116034515 >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 0x7f90f4161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f259c640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 0x7f90f40aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f259c640 1 -- 172.21.15.49:0/1116034515 >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 msgr2=0x7f90f4161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f259c640 1 --2- 172.21.15.49:0/1116034515 >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 0x7f90f4161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f259c640 1 -- 172.21.15.49:0/1116034515 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40aabd0 con 0x7f90f4146da0 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f1d9b640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 0x7f90f40aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.736+0000 7f90f2d9d640 1 --2- 172.21.15.49:0/1116034515 >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 0x7f90f4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.737+0000 7f90f259c640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f4146da0 0x7f90f40aa060 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f90f40aaae0 tx=0x7f90e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afe72d082504c4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.737+0000 7f90f159a640 1 -- 172.21.15.49:0/1116034515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031870 con 0x7f90f4146da0 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.737+0000 7f90f159a640 1 -- 172.21.15.49:0/1116034515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40319d0 con 0x7f90f4146da0 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.737+0000 7f90f159a640 1 -- 172.21.15.49:0/1116034515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031d60 con 0x7f90f4146da0 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 -- 172.21.15.49:0/1116034515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f4146da0 msgr2=0x7f90f40aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f4146da0 0x7f90f40aa060 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f90f40aaae0 tx=0x7f90e402b910 comp rx=0 tx=0).stop 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 -- 172.21.15.49:0/1116034515 shutdown_connections 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1116034515 >> v2:172.21.15.115:3300/0 conn(0x7f90f41611f0 0x7f90f4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4147180 0x7f90f40aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1116034515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f4146da0 0x7f90f40aa060 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 -- 172.21.15.49:0/1116034515 >> 172.21.15.49:0/1116034515 conn(0x7f90f4071a50 msgr2=0x7f90f40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 -- 172.21.15.49:0/1116034515 shutdown_connections 2023-12-19T05:47:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.738+0000 7f90f89f0640 1 -- 172.21.15.49:0/1116034515 wait complete. 2023-12-19T05:47:37.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.740+0000 7f90f89f0640 1 Processor -- start 2023-12-19T05:47:37.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.740+0000 7f90f89f0640 1 -- start start 2023-12-19T05:47:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4146da0 0x7f90f415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f41611f0 0x7f90f413b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b0fb0 con 0x7f90f40af200 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40afd70 con 0x7f90f41611f0 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f89f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b0050 con 0x7f90f4146da0 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50430/0 (socket says 172.21.15.49:50430) 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.741+0000 7f90f2d9d640 1 -- 172.21.15.49:0/1522304208 learned_addr learned my addr 172.21.15.49:0/1522304208 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f259c640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4146da0 0x7f90f415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f1d9b640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f41611f0 0x7f90f413b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 -- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4146da0 msgr2=0x7f90f415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4146da0 0x7f90f415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 -- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f41611f0 msgr2=0x7f90f413b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f41611f0 0x7f90f413b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40094d0 con 0x7f90f40af200 2023-12-19T05:47:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f2d9d640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c7f0 tx=0x7f90ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec007820 con 0x7f90f40af200 2023-12-19T05:47:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec007980 con 0x7f90f40af200 2023-12-19T05:47:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec007d70 con 0x7f90f40af200 2023-12-19T05:47:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.742+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f413a550 con 0x7f90f40af200 2023-12-19T05:47:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.743+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f413ab10 con 0x7f90f40af200 2023-12-19T05:47:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.744+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f4073ec0 con 0x7f90f40af200 2023-12-19T05:47:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.745+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90ec0113f0 con 0x7f90f40af200 2023-12-19T05:47:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.746+0000 7f90e2ffd640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 0x7f90d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.746+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f90ec088cb0 con 0x7f90f40af200 2023-12-19T05:47:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.746+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f90d40720b0 con 0x7f90f40af200 2023-12-19T05:47:37.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.747+0000 7f90f259c640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 0x7f90d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.748+0000 7f90f259c640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 0x7f90d406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f90e4036000 tx=0x7f90e403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:37.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.750+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90ec01f060 con 0x7f90f40af200 2023-12-19T05:47:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.948+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f413ad30 con 0x7f90f40af200 2023-12-19T05:47:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.951+0000 7f90e2ffd640 1 -- 172.21.15.49:0/1522304208 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16275 (secure 0 0 0) 0x7f90ec01f020 con 0x7f90f40af200 2023-12-19T05:47:37.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:37.952 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":149,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:35.360479+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 msgr2=0x7f90d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 0x7f90d406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f90e4036000 tx=0x7f90e403c040 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 msgr2=0x7f90f40af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c7f0 tx=0x7f90ec00ccb0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 shutdown_connections 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f90d406a460 0x7f90d406c920 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90f40af200 0x7f90f40af6b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f41611f0 0x7f90f413b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 --2- 172.21.15.49:0/1522304208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f4146da0 0x7f90f415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.953+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 >> 172.21.15.49:0/1522304208 conn(0x7f90f4071a50 msgr2=0x7f90f40ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.954+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 shutdown_connections 2023-12-19T05:47:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:37.954+0000 7f90f89f0640 1 -- 172.21.15.49:0/1522304208 wait complete. 2023-12-19T05:47:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:46:48.824621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:46:50.051888+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:47:37.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:47:38.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.208+0000 7f415a3ea640 1 Processor -- start 2023-12-19T05:47:38.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.208+0000 7f415a3ea640 1 -- start start 2023-12-19T05:47:38.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.209+0000 7f415a3ea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f41540d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.209+0000 7f415a3ea640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41540b6430 0x7f415406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.209+0000 7f415a3ea640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415406fed0 con 0x7f415406fa70 2023-12-19T05:47:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.209+0000 7f415a3ea640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4154161080 con 0x7f41540b6430 2023-12-19T05:47:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.209+0000 7f415a3ea640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4154161e70 con 0x7f4154146ff0 2023-12-19T05:47:38.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4158987640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f415406fa70 0x7f415415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44640/0 (socket says 172.21.15.49:44640) 2023-12-19T05:47:38.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4158987640 1 -- 172.21.15.49:0/1374973042 learned_addr learned my addr 172.21.15.49:0/1374973042 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f41537fe640 1 --2- 172.21.15.49:0/1374973042 >> v2:172.21.15.115:3300/0 conn(0x7f41540b6430 0x7f415406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4153fff640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f41540d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561277015 0 0) 0x7f415406fed0 con 0x7f415406fa70 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140003520 con 0x7f415406fa70 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3130570607 0 0) 0x7f4140003520 con 0x7f415406fa70 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 msgr2=0x7f41540d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.210+0000 7f4152ffd640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f41540d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 >> v2:172.21.15.115:3300/0 conn(0x7f41540b6430 msgr2=0x7f415406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 --2- 172.21.15.49:0/1374973042 >> v2:172.21.15.115:3300/0 conn(0x7f41540b6430 0x7f415406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154161260 con 0x7f415406fa70 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f414c001670 con 0x7f415406fa70 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 >> v1:172.21.15.49:6789/0 conn(0x7f415406fa70 legacy=0x7f415415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41400039e0 0x7f4140003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41400047c0 0x7f4140004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f4140005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154161080 con 0x7f41400039e0 2023-12-19T05:47:38.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154161e70 con 0x7f41400047c0 2023-12-19T05:47:38.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414000b9b0 con 0x7f4154146ff0 2023-12-19T05:47:38.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4153fff640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41400039e0 0x7f4140003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f4158987640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f4140005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.211+0000 7f41537fe640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41400047c0 0x7f4140004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.212+0000 7f4153fff640 1 -- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 msgr2=0x7f4140005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.212+0000 7f4153fff640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4154146ff0 0x7f4140005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.212+0000 7f4153fff640 1 -- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41400047c0 msgr2=0x7f4140004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.212+0000 7f4153fff640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41400047c0 0x7f4140004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.212+0000 7f4153fff640 1 -- 172.21.15.49:0/1374973042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140003520 con 0x7f41400039e0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.213+0000 7f4153fff640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41400039e0 0x7f4140003e00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f4144009fc0 tx=0x7f41400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ea4fc4c88d4470 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.213+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414402cc20 con 0x7f41400039e0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.213+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400f040 con 0x7f41400039e0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.213+0000 7f4152ffd640 1 -- 172.21.15.49:0/1374973042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144034440 con 0x7f41400039e0 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 -- 172.21.15.49:0/1374973042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41400039e0 msgr2=0x7f4140003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1374973042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41400039e0 0x7f4140003e00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f4144009fc0 tx=0x7f41400057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f4158987640 1 -- 172.21.15.49:0/1374973042 reap_dead start 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 -- 172.21.15.49:0/1374973042 shutdown_connections 2023-12-19T05:47:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 -- 172.21.15.49:0/1374973042 >> 172.21.15.49:0/1374973042 conn(0x7f41540d3520 msgr2=0x7f41540d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:38.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 -- 172.21.15.49:0/1374973042 shutdown_connections 2023-12-19T05:47:38.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.214+0000 7f415a3ea640 1 -- 172.21.15.49:0/1374973042 wait complete. 2023-12-19T05:47:38.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.216+0000 7f415a3ea640 1 Processor -- start 2023-12-19T05:47:38.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.216+0000 7f415a3ea640 1 -- start start 2023-12-19T05:47:38.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41400039e0 0x7f415415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4154070c70 0x7f4154071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154071660 con 0x7f41540ceec0 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154136250 con 0x7f4154070c70 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.217+0000 7f415a3ea640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4154136530 con 0x7f41400039e0 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50450/0 (socket says 172.21.15.49:50450) 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 -- 172.21.15.49:0/1356926947 learned_addr learned my addr 172.21.15.49:0/1356926947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f4153fff640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41400039e0 0x7f415415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f4158987640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4154070c70 0x7f4154071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 -- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41400039e0 msgr2=0x7f415415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41400039e0 0x7f415415cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 -- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4154070c70 msgr2=0x7f4154071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4154070c70 0x7f4154071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.218+0000 7f41537fe640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154136810 con 0x7f41540ceec0 2023-12-19T05:47:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f41537fe640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f413c0108e0 tx=0x7f413c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00eb60 con 0x7f41540ceec0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c00ecc0 con 0x7f41540ceec0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c01c400 con 0x7f41540ceec0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4154136af0 con 0x7f41540ceec0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.219+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415415d2c0 con 0x7f41540ceec0 2023-12-19T05:47:38.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.220+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4154061910 con 0x7f41540ceec0 2023-12-19T05:47:38.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.221+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f413c01c560 con 0x7f41540ceec0 2023-12-19T05:47:38.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.222+0000 7f4150ff9640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 0x7f413406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.222+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f413c089080 con 0x7f41540ceec0 2023-12-19T05:47:38.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.222+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f4134072080 con 0x7f41540ceec0 2023-12-19T05:47:38.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.223+0000 7f4153fff640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 0x7f413406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.224+0000 7f4153fff640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 0x7f413406c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4144036000 tx=0x7f414402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.226+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f413c054630 con 0x7f41540ceec0 2023-12-19T05:47:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.421+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4154146810 con 0x7f41540ceec0 2023-12-19T05:47:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.423+0000 7f4150ff9640 1 -- 172.21.15.49:0/1356926947 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f413c021070 con 0x7f41540ceec0 2023-12-19T05:47:38.424 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 msgr2=0x7f413406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 0x7f413406c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4144036000 tx=0x7f414402e000 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 msgr2=0x7f4154135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f413c0108e0 tx=0x7f413c010da0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 shutdown_connections 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f413406a430 0x7f413406c8f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4154070c70 0x7f4154071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41540ceec0 0x7f4154135940 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 --2- 172.21.15.49:0/1356926947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41400039e0 0x7f415415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 >> 172.21.15.49:0/1356926947 conn(0x7f41540d3520 msgr2=0x7f4154144000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 shutdown_connections 2023-12-19T05:47:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.425+0000 7f415a3ea640 1 -- 172.21.15.49:0/1356926947 wait complete. 2023-12-19T05:47:38.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:47:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.686+0000 7f9e40b00640 1 Processor -- start 2023-12-19T05:47:38.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.686+0000 7f9e40b00640 1 -- start start 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.688+0000 7f9e40b00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e3c146e10 0x7f9e3c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.688+0000 7f9e40b00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.688+0000 7f9e40b00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c0cd840 con 0x7f9e3c0ce110 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e40b00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c0d2430 con 0x7f9e3c146e10 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e40b00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0d2620 con 0x7f9e3c0d2b00 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e3ad9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9e3c0ce110 0x7f9e3c0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44642/0 (socket says 172.21.15.49:44642) 2023-12-19T05:47:38.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e3ad9d640 1 -- 172.21.15.49:0/1366051407 learned_addr learned my addr 172.21.15.49:0/1366051407 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/1366051407 >> v2:172.21.15.115:3300/0 conn(0x7f9e3c146e10 0x7f9e3c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e39d9b640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.689+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090147482 0 0) 0x7f9e3c0cd840 con 0x7f9e3c0ce110 2023-12-19T05:47:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003520 con 0x7f9e3c0ce110 2023-12-19T05:47:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477083588 0 0) 0x7f9e24003520 con 0x7f9e3c0ce110 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3a59c640 1 -- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 msgr2=0x7f9e3c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3a59c640 1 -- 172.21.15.49:0/1366051407 >> v1:172.21.15.49:6789/0 conn(0x7f9e3c0ce110 legacy=0x7f9e3c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.690+0000 7f9e3a59c640 1 -- 172.21.15.49:0/1366051407 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0b41c0 con 0x7f9e3c146e10 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.691+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c0d1ef0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc95d423cee09d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.692+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340019f0 con 0x7f9e3c146e10 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.692+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c02e050 con 0x7f9e3c146e10 2023-12-19T05:47:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.692+0000 7f9e3959a640 1 -- 172.21.15.49:0/1366051407 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c030730 con 0x7f9e3c146e10 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.692+0000 7f9e40b00640 1 -- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 msgr2=0x7f9e3c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.692+0000 7f9e40b00640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c0d1ef0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02b790 comp rx=0 tx=0).stop 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 -- 172.21.15.49:0/1366051407 shutdown_connections 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 --2- 172.21.15.49:0/1366051407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c0d1ef0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 -- 172.21.15.49:0/1366051407 >> 172.21.15.49:0/1366051407 conn(0x7f9e3c0b29c0 msgr2=0x7f9e3c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 -- 172.21.15.49:0/1366051407 shutdown_connections 2023-12-19T05:47:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.693+0000 7f9e40b00640 1 -- 172.21.15.49:0/1366051407 wait complete. 2023-12-19T05:47:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.694+0000 7f9e40b00640 1 Processor -- start 2023-12-19T05:47:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.695+0000 7f9e40b00640 1 -- start start 2023-12-19T05:47:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c143f50 con 0x7f9e3c0ce110 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c143ac0 con 0x7f9e3c146e10 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e40b00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1f2b90 con 0x7f9e3c0d2b00 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50452/0 (socket says 172.21.15.49:50452) 2023-12-19T05:47:38.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 -- 172.21.15.49:0/4220149504 learned_addr learned my addr 172.21.15.49:0/4220149504 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3ad9d640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 -- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 msgr2=0x7f9e3c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 -- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 msgr2=0x7f9e3c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.696+0000 7f9e3a59c640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009400 con 0x7f9e3c0ce110 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e3a59c640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c000c00 tx=0x7f9e2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c03b810 con 0x7f9e3c0ce110 2023-12-19T05:47:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c03b970 con 0x7f9e3c0ce110 2023-12-19T05:47:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c03bd20 con 0x7f9e3c0ce110 2023-12-19T05:47:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c142eb0 con 0x7f9e3c0ce110 2023-12-19T05:47:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.697+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c143470 con 0x7f9e3c0ce110 2023-12-19T05:47:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.698+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c146670 con 0x7f9e3c0ce110 2023-12-19T05:47:38.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.699+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e2c039040 con 0x7f9e3c0ce110 2023-12-19T05:47:38.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.700+0000 7f9e2affd640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 0x7f9e1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:38.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.700+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f9e2c0a9f30 con 0x7f9e3c0ce110 2023-12-19T05:47:38.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.701+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f9e1c0720b0 con 0x7f9e3c0ce110 2023-12-19T05:47:38.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.701+0000 7f9e39d9b640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 0x7f9e1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:38.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.702+0000 7f9e39d9b640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 0x7f9e1c06c920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9e30006a90 tx=0x7f9e30006a20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:38.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.705+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e2c04b060 con 0x7f9e3c0ce110 2023-12-19T05:47:38.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.899+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e3c061910 con 0x7f9e3c0ce110 2023-12-19T05:47:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.900+0000 7f9e2affd640 1 -- 172.21.15.49:0/4220149504 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e2c037070 con 0x7f9e3c0ce110 2023-12-19T05:47:38.902 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:47:38.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.902+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 msgr2=0x7f9e1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.902+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 0x7f9e1c06c920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9e30006a90 tx=0x7f9e30006a20 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.902+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 msgr2=0x7f9e3c1f2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.902+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c000c00 tx=0x7f9e2c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 shutdown_connections 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e1c06a460 0x7f9e1c06c920 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e3c0d2b00 0x7f9e3c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c146e10 0x7f9e3c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 --2- 172.21.15.49:0/4220149504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e3c0ce110 0x7f9e3c1f2650 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 >> 172.21.15.49:0/4220149504 conn(0x7f9e3c0b29c0 msgr2=0x7f9e3c0b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 shutdown_connections 2023-12-19T05:47:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:38.903+0000 7f9e40b00640 1 -- 172.21.15.49:0/4220149504 wait complete. 2023-12-19T05:47:38.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:47:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.162+0000 7f87f9c68640 1 Processor -- start 2023-12-19T05:47:39.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.163+0000 7f87f9c68640 1 -- start start 2023-12-19T05:47:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.164+0000 7f87f9c68640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 0x7f87f40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.164+0000 7f87f9c68640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87f40b6890 0x7f87f406f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f9c68640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f4070260 con 0x7f87f406f9d0 2023-12-19T05:47:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f9c68640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f41470b0 con 0x7f87f40b6890 2023-12-19T05:47:39.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f9c68640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f406fe60 con 0x7f87f4146cd0 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87f40b6890 0x7f87f406f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87f40b6890 0x7f87f406f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50458/0 (socket says 172.21.15.49:50458) 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 -- 172.21.15.49:0/3797683199 learned_addr learned my addr 172.21.15.49:0/3797683199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f8c66640 1 --2- 172.21.15.49:0/3797683199 >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 0x7f87f40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 -- 172.21.15.49:0/3797683199 >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 msgr2=0x7f87f40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 --2- 172.21.15.49:0/3797683199 >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 0x7f87f40b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 -- 172.21.15.49:0/3797683199 >> v1:172.21.15.115:6789/0 conn(0x7f87f406f9d0 legacy=0x7f87f4160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f3fff640 1 -- 172.21.15.49:0/3797683199 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40b6ea0 con 0x7f87f40b6890 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.165+0000 7f87f8c66640 1 --2- 172.21.15.49:0/3797683199 >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 0x7f87f40b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f3fff640 1 --2- 172.21.15.49:0/3797683199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f406f490 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f87f406f0b0 tx=0x7f87dc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdc994fda3affa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f37fe640 1 -- 172.21.15.49:0/3797683199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0317e0 con 0x7f87f40b6890 2023-12-19T05:47:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f37fe640 1 -- 172.21.15.49:0/3797683199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc031940 con 0x7f87f40b6890 2023-12-19T05:47:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f37fe640 1 -- 172.21.15.49:0/3797683199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc031cd0 con 0x7f87f40b6890 2023-12-19T05:47:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f9c68640 1 -- 172.21.15.49:0/3797683199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 msgr2=0x7f87f406f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.167+0000 7f87f9c68640 1 --2- 172.21.15.49:0/3797683199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f406f490 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f87f406f0b0 tx=0x7f87dc02b880 comp rx=0 tx=0).stop 2023-12-19T05:47:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 -- 172.21.15.49:0/3797683199 shutdown_connections 2023-12-19T05:47:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 --2- 172.21.15.49:0/3797683199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f406f490 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 --2- 172.21.15.49:0/3797683199 >> v2:172.21.15.115:3300/0 conn(0x7f87f4146cd0 0x7f87f40b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 -- 172.21.15.49:0/3797683199 >> 172.21.15.49:0/3797683199 conn(0x7f87f40d3200 msgr2=0x7f87f40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 -- 172.21.15.49:0/3797683199 shutdown_connections 2023-12-19T05:47:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.168+0000 7f87f9c68640 1 -- 172.21.15.49:0/3797683199 wait complete. 2023-12-19T05:47:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.170+0000 7f87f9c68640 1 Processor -- start 2023-12-19T05:47:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.170+0000 7f87f9c68640 1 -- start start 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 0x7f87f413d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 0x7f87f40d2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41f41f0 con 0x7f87f40b6890 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41f44d0 con 0x7f87f406f9d0 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9c68640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41f47b0 con 0x7f87f4146cd0 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50466/0 (socket says 172.21.15.49:50466) 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f3fff640 1 -- 172.21.15.49:0/231489348 learned_addr learned my addr 172.21.15.49:0/231489348 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f8c66640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 0x7f87f413d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f9467640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 0x7f87f40d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.171+0000 7f87f3fff640 1 -- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 msgr2=0x7f87f40d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f3fff640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 0x7f87f40d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f3fff640 1 -- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 msgr2=0x7f87f413d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f3fff640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 0x7f87f413d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f3fff640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0094d0 con 0x7f87f40b6890 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f9467640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 0x7f87f40d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f8c66640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 0x7f87f413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f3fff640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000c00 tx=0x7f87dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc032900 con 0x7f87f40b6890 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc032a60 con 0x7f87f40b6890 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc032e10 con 0x7f87f40b6890 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.172+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f41f4a90 con 0x7f87f40b6890 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.173+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f413d070 con 0x7f87f40b6890 2023-12-19T05:47:39.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.174+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f41f4fb0 con 0x7f87f40b6890 2023-12-19T05:47:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.175+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87dc04e450 con 0x7f87f40b6890 2023-12-19T05:47:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.176+0000 7f87f17fa640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.176+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f87dc0aac10 con 0x7f87f40b6890 2023-12-19T05:47:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.176+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f87d4072080 con 0x7f87f40b6890 2023-12-19T05:47:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.176+0000 7f87f8c66640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.177+0000 7f87f8c66640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 0x7f87d406c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007fd0 tx=0x7f87e4007640 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.180+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87f41f4fb0 con 0x7f87f40b6890 2023-12-19T05:47:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.372+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87f41f4fb0 con 0x7f87f40b6890 2023-12-19T05:47:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.373+0000 7f87f17fa640 1 -- 172.21.15.49:0/231489348 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f41f4fb0 con 0x7f87f40b6890 2023-12-19T05:47:39.375 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 msgr2=0x7f87d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 0x7f87d406c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007fd0 tx=0x7f87e4007640 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 msgr2=0x7f87f413cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000c00 tx=0x7f87dc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 shutdown_connections 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87f4146cd0 0x7f87f40d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40b6890 0x7f87f413cb30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 --2- 172.21.15.49:0/231489348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f406f9d0 0x7f87f413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 >> 172.21.15.49:0/231489348 conn(0x7f87f40d3200 msgr2=0x7f87f4145270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 shutdown_connections 2023-12-19T05:47:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.376+0000 7f87f9c68640 1 -- 172.21.15.49:0/231489348 wait complete. 2023-12-19T05:47:39.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.632+0000 7f54cb5f6640 1 Processor -- start 2023-12-19T05:47:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.633+0000 7f54cb5f6640 1 -- start start 2023-12-19T05:47:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.634+0000 7f54cb5f6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54c41449e0 0x7f54c40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.634+0000 7f54cb5f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c406c6b0 0x7f54c40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54cb5f6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40afb10 con 0x7f54c40b0b50 2023-12-19T05:47:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54cb5f6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406bb30 con 0x7f54c41449e0 2023-12-19T05:47:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54cb5f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b0070 con 0x7f54c406c6b0 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54c41449e0 0x7f54c40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54c41449e0 0x7f54c40af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50468/0 (socket says 172.21.15.49:50468) 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 -- 172.21.15.49:0/1538013430 learned_addr learned my addr 172.21.15.49:0/1538013430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 -- 172.21.15.49:0/1538013430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c406c6b0 msgr2=0x7f54c40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9b93640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c406c6b0 0x7f54c40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c406c6b0 0x7f54c40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 -- 172.21.15.49:0/1538013430 >> v1:172.21.15.115:6789/0 conn(0x7f54c40b0b50 legacy=0x7f54c406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.635+0000 7f54c9392640 1 -- 172.21.15.49:0/1538013430 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40b0350 con 0x7f54c41449e0 2023-12-19T05:47:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.636+0000 7f54c9392640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c41449e0 0x7f54c40af5d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009870 tx=0x7f54c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714d6684dbd76de9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.637+0000 7f54bbfff640 1 -- 172.21.15.49:0/1538013430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0031640 con 0x7f54c41449e0 2023-12-19T05:47:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.637+0000 7f54bbfff640 1 -- 172.21.15.49:0/1538013430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c00317a0 con 0x7f54c41449e0 2023-12-19T05:47:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.637+0000 7f54bbfff640 1 -- 172.21.15.49:0/1538013430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0031b30 con 0x7f54c41449e0 2023-12-19T05:47:39.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 -- 172.21.15.49:0/1538013430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c41449e0 msgr2=0x7f54c40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c41449e0 0x7f54c40af5d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009870 tx=0x7f54c002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 -- 172.21.15.49:0/1538013430 shutdown_connections 2023-12-19T05:47:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c406c6b0 0x7f54c40b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/1538013430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c41449e0 0x7f54c40af5d0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 -- 172.21.15.49:0/1538013430 >> 172.21.15.49:0/1538013430 conn(0x7f54c40cbb70 msgr2=0x7f54c40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 -- 172.21.15.49:0/1538013430 shutdown_connections 2023-12-19T05:47:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.638+0000 7f54cb5f6640 1 -- 172.21.15.49:0/1538013430 wait complete. 2023-12-19T05:47:39.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.640+0000 7f54cb5f6640 1 Processor -- start 2023-12-19T05:47:39.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.640+0000 7f54cb5f6640 1 -- start start 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c40b0b50 0x7f54c4143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54c41449e0 0x7f54c415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41441d0 con 0x7f54c406c6b0 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40ab6c0 con 0x7f54c41449e0 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54cb5f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40c3c80 con 0x7f54c40b0b50 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54c9392640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54c9392640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50484/0 (socket says 172.21.15.49:50484) 2023-12-19T05:47:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.641+0000 7f54c9392640 1 -- 172.21.15.49:0/3826399798 learned_addr learned my addr 172.21.15.49:0/3826399798 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 -- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c40b0b50 msgr2=0x7f54c4143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c40b0b50 0x7f54c4143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 -- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54c41449e0 msgr2=0x7f54c415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54c41449e0 0x7f54c415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00094d0 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54c9392640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f54c0000c00 tx=0x7f54c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c003ac60 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c003ade0 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0044630 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.642+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40c3f60 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.643+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c40ab910 con 0x7f54c406c6b0 2023-12-19T05:47:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.644+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c40b0610 con 0x7f54c406c6b0 2023-12-19T05:47:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.645+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54c002f050 con 0x7f54c406c6b0 2023-12-19T05:47:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.646+0000 7f54b9ffb640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 0x7f54a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.646+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f54c00aa9c0 con 0x7f54c406c6b0 2023-12-19T05:47:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.646+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f54a80720b0 con 0x7f54c406c6b0 2023-12-19T05:47:39.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.646+0000 7f54c8b91640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 0x7f54a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:39.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.648+0000 7f54c8b91640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 0x7f54a806c920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f54c415df80 tx=0x7f54b40079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:39.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.650+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54c40b0610 con 0x7f54c406c6b0 2023-12-19T05:47:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.883+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54c40b0610 con 0x7f54c406c6b0 2023-12-19T05:47:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.884+0000 7f54b9ffb640 1 -- 172.21.15.49:0/3826399798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f54c40b0610 con 0x7f54c406c6b0 2023-12-19T05:47:39.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:39.886 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 msgr2=0x7f54a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 0x7f54a806c920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f54c415df80 tx=0x7f54b40079b0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 msgr2=0x7f54c40c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f54c0000c00 tx=0x7f54c00046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 shutdown_connections 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f54a806a460 0x7f54a806c920 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54c40b0b50 0x7f54c4143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54c41449e0 0x7f54c415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 --2- 172.21.15.49:0/3826399798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c406c6b0 0x7f54c40c35a0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 >> 172.21.15.49:0/3826399798 conn(0x7f54c40cbb70 msgr2=0x7f54c40b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 shutdown_connections 2023-12-19T05:47:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:39.887+0000 7f54cb5f6640 1 -- 172.21.15.49:0/3826399798 wait complete. 2023-12-19T05:47:39.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:40.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.141+0000 7f6b2e1c4640 1 Processor -- start 2023-12-19T05:47:40.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.141+0000 7f6b2e1c4640 1 -- start start 2023-12-19T05:47:40.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.142+0000 7f6b2e1c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b2815e5a0 0x7f6b280b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.142+0000 7f6b2e1c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 0x7f6b280ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.142+0000 7f6b2e1c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2815ec30 con 0x7f6b2815f680 2023-12-19T05:47:40.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.142+0000 7f6b2e1c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b280ce5a0 con 0x7f6b2815e5a0 2023-12-19T05:47:40.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.142+0000 7f6b2e1c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815e980 con 0x7f6b280cdbf0 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b2815e5a0 0x7f6b280b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b2815e5a0 0x7f6b280b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50486/0 (socket says 172.21.15.49:50486) 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 -- 172.21.15.49:0/2892473316 learned_addr learned my addr 172.21.15.49:0/2892473316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2c9c1640 1 --1- 172.21.15.49:0/2892473316 >> v1:172.21.15.49:6789/0 conn(0x7f6b2815f680 0x7f6b280b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44658/0 (socket says 172.21.15.49:44658) 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d9c3640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 0x7f6b280ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 -- 172.21.15.49:0/2892473316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 msgr2=0x7f6b280ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 0x7f6b280ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 -- 172.21.15.49:0/2892473316 >> v1:172.21.15.49:6789/0 conn(0x7f6b2815f680 legacy=0x7f6b280b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d1c2640 1 -- 172.21.15.49:0/2892473316 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280b2f90 con 0x7f6b2815e5a0 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b1bfff640 1 -- 172.21.15.49:0/2892473316 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871832583 0 0) 0x7f6b2815ec30 con 0x7f6b2815f680 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.143+0000 7f6b2d9c3640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 0x7f6b280ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.144+0000 7f6b2d1c2640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b280b2030 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098a0 tx=0x7f6b2402b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6600f2d3fc0fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b1bfff640 1 -- 172.21.15.49:0/2892473316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24030830 con 0x7f6b2815e5a0 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b1bfff640 1 -- 172.21.15.49:0/2892473316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24030990 con 0x7f6b2815e5a0 2023-12-19T05:47:40.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b1bfff640 1 -- 172.21.15.49:0/2892473316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24030d20 con 0x7f6b2815e5a0 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/2892473316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 msgr2=0x7f6b280b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b280b2030 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098a0 tx=0x7f6b2402b970 comp rx=0 tx=0).stop 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/2892473316 shutdown_connections 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cdbf0 0x7f6b280ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/2892473316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b280b2030 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/2892473316 >> 172.21.15.49:0/2892473316 conn(0x7f6b280b0100 msgr2=0x7f6b280b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:40.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.145+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/2892473316 shutdown_connections 2023-12-19T05:47:40.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.146+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/2892473316 wait complete. 2023-12-19T05:47:40.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.147+0000 7f6b2e1c4640 1 Processor -- start 2023-12-19T05:47:40.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.147+0000 7f6b2e1c4640 1 -- start start 2023-12-19T05:47:40.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b280cdbf0 0x7f6b28141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b2815f680 0x7f6b2814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2813f470 con 0x7f6b2815e5a0 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28149810 con 0x7f6b280cdbf0 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.148+0000 7f6b2e1c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28149ab0 con 0x7f6b2815f680 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50492/0 (socket says 172.21.15.49:50492) 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 -- 172.21.15.49:0/3277197466 learned_addr learned my addr 172.21.15.49:0/3277197466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2d1c2640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b280cdbf0 0x7f6b28141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2d9c3640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b2815f680 0x7f6b2814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 -- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b2815f680 msgr2=0x7f6b2814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b2815f680 0x7f6b2814dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 -- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b280cdbf0 msgr2=0x7f6b28141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b280cdbf0 0x7f6b28141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240094d0 con 0x7f6b2815e5a0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.149+0000 7f6b2c9c1640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c890 tx=0x7f6b1c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.150+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00a640 con 0x7f6b2815e5a0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.150+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00a7c0 con 0x7f6b2815e5a0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.150+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00ab70 con 0x7f6b2815e5a0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.150+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b28149d90 con 0x7f6b2815e5a0 2023-12-19T05:47:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.150+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2814a350 con 0x7f6b2815e5a0 2023-12-19T05:47:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.151+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b28061910 con 0x7f6b2815e5a0 2023-12-19T05:47:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.152+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b1c00acd0 con 0x7f6b2815e5a0 2023-12-19T05:47:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.154+0000 7f6b19ffb640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 0x7f6b0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.154+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f6b1c087f80 con 0x7f6b2815e5a0 2023-12-19T05:47:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.154+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f6b0c072080 con 0x7f6b2815e5a0 2023-12-19T05:47:40.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.154+0000 7f6b2d1c2640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 0x7f6b0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.156+0000 7f6b2d1c2640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 0x7f6b0c06c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6b24036000 tx=0x7f6b24008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.158+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b1c018020 con 0x7f6b2815e5a0 2023-12-19T05:47:40.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.356+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b281506b0 con 0x7f6b2815e5a0 2023-12-19T05:47:40.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.359+0000 7f6b19ffb640 1 -- 172.21.15.49:0/3277197466 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16275 (secure 0 0 0) 0x7f6b1c053470 con 0x7f6b2815e5a0 2023-12-19T05:47:40.361 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:40.361 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":149,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:35.360479+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 msgr2=0x7f6b0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 0x7f6b0c06c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6b24036000 tx=0x7f6b24008030 comp rx=0 tx=0).stop 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 msgr2=0x7f6b28147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c890 tx=0x7f6b1c00cd50 comp rx=0 tx=0).stop 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 shutdown_connections 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6b0c06a430 0x7f6b0c06c8f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b2815f680 0x7f6b2814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b2815e5a0 0x7f6b28147c50 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 --2- 172.21.15.49:0/3277197466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b280cdbf0 0x7f6b28141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 >> 172.21.15.49:0/3277197466 conn(0x7f6b280b0100 msgr2=0x7f6b2815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 shutdown_connections 2023-12-19T05:47:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.362+0000 7f6b2e1c4640 1 -- 172.21.15.49:0/3277197466 wait complete. 2023-12-19T05:47:40.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:47:40.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:40.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.617+0000 7fe0b108c640 1 Processor -- start 2023-12-19T05:47:40.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.617+0000 7fe0b108c640 1 -- start start 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.618+0000 7fe0b108c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe0ac0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.618+0000 7fe0b108c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0b4120 con 0x7fe0ac15da00 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.618+0000 7fe0b108c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0b5b80 con 0x7fe0ac15d620 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.618+0000 7fe0b108c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b6ee0 con 0x7fe0ac0cf670 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.619+0000 7fe0b088b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0ac15da00 0x7fe0ac0b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44666/0 (socket says 172.21.15.49:44666) 2023-12-19T05:47:40.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.619+0000 7fe0b088b640 1 -- 172.21.15.49:0/924373766 learned_addr learned my addr 172.21.15.49:0/924373766 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:40.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.619+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe0ac0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.619+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420401842 0 0) 0x7fe0ac0b4120 con 0x7fe0ac15da00 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.619+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe098003520 con 0x7fe0ac15da00 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735075872 0 0) 0x7fe098003520 con 0x7fe0ac15da00 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 msgr2=0x7fe0ac0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe0ac0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 >> v1:172.21.15.115:6789/0 conn(0x7fe0ac15d620 legacy=0x7fe0ac0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0b71c0 con 0x7fe0ac15da00 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe0a4001670 con 0x7fe0ac15da00 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 >> v1:172.21.15.49:6789/0 conn(0x7fe0ac15da00 legacy=0x7fe0ac0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0980039a0 0x7fe098003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe098004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe098005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b6ee0 con 0x7fe098004350 2023-12-19T05:47:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09800b9b0 con 0x7fe0980039a0 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09800bb70 con 0x7fe0ac0cf670 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe098004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.620+0000 7fe0abfff640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0980039a0 0x7fe098003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0b088b640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe098005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0ab7fe640 1 -- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 msgr2=0x7fe098005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe098005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0ab7fe640 1 -- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0980039a0 msgr2=0x7fe098003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0980039a0 0x7fe098003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0ab7fe640 1 -- 172.21.15.49:0/924373766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098003520 con 0x7fe098004350 2023-12-19T05:47:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.621+0000 7fe0b088b640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0cf670 0x7fe098005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:47:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe098004820 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe094009ac0 tx=0x7fe0980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25a8f0e85651d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09402c6b0 con 0x7fe098004350 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09402c810 con 0x7fe098004350 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0aaffd640 1 -- 172.21.15.49:0/924373766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09402cba0 con 0x7fe098004350 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0b108c640 1 -- 172.21.15.49:0/924373766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 msgr2=0x7fe098004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0b108c640 1 --2- 172.21.15.49:0/924373766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe098004820 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe094009ac0 tx=0x7fe0980057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.623+0000 7fe0b088b640 1 -- 172.21.15.49:0/924373766 reap_dead start 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.624+0000 7fe0b108c640 1 -- 172.21.15.49:0/924373766 shutdown_connections 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.624+0000 7fe0b108c640 1 -- 172.21.15.49:0/924373766 >> 172.21.15.49:0/924373766 conn(0x7fe0ac0cfb90 msgr2=0x7fe0ac0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.624+0000 7fe0b108c640 1 -- 172.21.15.49:0/924373766 shutdown_connections 2023-12-19T05:47:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.624+0000 7fe0b108c640 1 -- 172.21.15.49:0/924373766 wait complete. 2023-12-19T05:47:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.626+0000 7fe0b108c640 1 Processor -- start 2023-12-19T05:47:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.626+0000 7fe0b108c640 1 -- start start 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac070d10 0x7fe0ac1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac1605d0 0x7fe0ac15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac160140 con 0x7fe098004350 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac1450b0 con 0x7fe0ac1605d0 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0b108c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac145390 con 0x7fe0ac070d10 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50508/0 (socket says 172.21.15.49:50508) 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 -- 172.21.15.49:0/3979712029 learned_addr learned my addr 172.21.15.49:0/3979712029 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 -- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac070d10 msgr2=0x7fe0ac1447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac070d10 0x7fe0ac1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 -- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac1605d0 msgr2=0x7fe0ac15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac1605d0 0x7fe0ac15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.627+0000 7fe0abfff640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac145670 con 0x7fe098004350 2023-12-19T05:47:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0abfff640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00fb30 tx=0x7fe09c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c001b90 con 0x7fe098004350 2023-12-19T05:47:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c003b80 con 0x7fe098004350 2023-12-19T05:47:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00d900 con 0x7fe098004350 2023-12-19T05:47:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac15fdd0 con 0x7fe098004350 2023-12-19T05:47:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.628+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac144cf0 con 0x7fe098004350 2023-12-19T05:47:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.629+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac15fc30 con 0x7fe098004350 2023-12-19T05:47:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.630+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe09c00da60 con 0x7fe098004350 2023-12-19T05:47:40.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.631+0000 7fe0a8ff9640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:40.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.631+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fe09c088df0 con 0x7fe098004350 2023-12-19T05:47:40.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.631+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fe08c072080 con 0x7fe098004350 2023-12-19T05:47:40.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.632+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:40.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.633+0000 7fe0ab7fe640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 0x7fe08c06c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe094036000 tx=0x7fe09402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.636+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0ac15fc30 con 0x7fe098004350 2023-12-19T05:47:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.868+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0ac15fc30 con 0x7fe098004350 2023-12-19T05:47:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.869+0000 7fe0a8ff9640 1 -- 172.21.15.49:0/3979712029 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fe0ac15fc30 con 0x7fe098004350 2023-12-19T05:47:40.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:40.871 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:40.871 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.871+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 msgr2=0x7fe08c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.871+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 0x7fe08c06c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe094036000 tx=0x7fe09402e000 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.871+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 msgr2=0x7fe0ac141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.871+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00fb30 tx=0x7fe09c00d150 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 shutdown_connections 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe08c06a430 0x7fe08c06c8f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac070d10 0x7fe0ac1447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac1605d0 0x7fe0ac15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 --2- 172.21.15.49:0/3979712029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe098004350 0x7fe0ac141e20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 >> 172.21.15.49:0/3979712029 conn(0x7fe0ac0cfb90 msgr2=0x7fe0ac156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 shutdown_connections 2023-12-19T05:47:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:40.872+0000 7fe0b108c640 1 -- 172.21.15.49:0/3979712029 wait complete. 2023-12-19T05:47:40.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.104+0000 7fd9f1826640 1 Processor -- start 2023-12-19T05:47:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.104+0000 7fd9f1826640 1 -- start start 2023-12-19T05:47:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.106+0000 7fd9f1826640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9ec15d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9f1826640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec15d9b0 con 0x7fd9ec143390 2023-12-19T05:47:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9f1826640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec15dc30 con 0x7fd9ec0cfda0 2023-12-19T05:47:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9f1826640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0b1f90 con 0x7fd9ec142c50 2023-12-19T05:47:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9e27fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd9ec143390 0x7fd9ec0b26c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44678/0 (socket says 172.21.15.49:44678) 2023-12-19T05:47:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9e27fc640 1 -- 172.21.15.49:0/620853607 learned_addr learned my addr 172.21.15.49:0/620853607 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9ec15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.107+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417007137 0 0) 0x7fd9ec15d9b0 con 0x7fd9ec143390 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d8003520 con 0x7fd9ec143390 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3847118782 0 0) 0x7fd9d8003520 con 0x7fd9ec143390 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 msgr2=0x7fd9ec15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9ec15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 >> v1:172.21.15.115:6789/0 conn(0x7fd9ec0cfda0 legacy=0x7fd9ec070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec15df10 con 0x7fd9ec143390 2023-12-19T05:47:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd9d4001670 con 0x7fd9ec143390 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 >> v1:172.21.15.49:6789/0 conn(0x7fd9ec143390 legacy=0x7fd9ec0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d8003a10 0x7fd9d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9d8004d00 0x7fd9d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0b1f90 con 0x7fd9d8003a10 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d800cc20 con 0x7fd9d8004d00 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d800cdb0 con 0x7fd9ec142c50 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.108+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d8003a10 0x7fd9d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9e27fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eb7fe640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9d8004d00 0x7fd9d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eaffd640 1 -- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 msgr2=0x7fd9d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eaffd640 1 -- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9d8004d00 msgr2=0x7fd9d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9d8004d00 0x7fd9d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eaffd640 1 -- 172.21.15.49:0/620853607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8003520 con 0x7fd9d8003a10 2023-12-19T05:47:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9eb7fe640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9d8004d00 0x7fd9d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.109+0000 7fd9e27fc640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9ec142c50 0x7fd9d80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.110+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d8003a10 0x7fd9d8003e30 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009ac0 tx=0x7fd9d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8473fd83a5fa69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.110+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc02c680 con 0x7fd9d8003a10 2023-12-19T05:47:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.110+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc02c7e0 con 0x7fd9d8003a10 2023-12-19T05:47:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.110+0000 7fd9ea7fc640 1 -- 172.21.15.49:0/620853607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc02cb70 con 0x7fd9d8003a10 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 -- 172.21.15.49:0/620853607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d8003a10 msgr2=0x7fd9d8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 --2- 172.21.15.49:0/620853607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9d8003a10 0x7fd9d8003e30 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009ac0 tx=0x7fd9d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9eb7fe640 1 -- 172.21.15.49:0/620853607 reap_dead start 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 -- 172.21.15.49:0/620853607 shutdown_connections 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 -- 172.21.15.49:0/620853607 >> 172.21.15.49:0/620853607 conn(0x7fd9ec0cc770 msgr2=0x7fd9ec0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 -- 172.21.15.49:0/620853607 shutdown_connections 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.111+0000 7fd9f1826640 1 -- 172.21.15.49:0/620853607 wait complete. 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.113+0000 7fd9f1826640 1 Processor -- start 2023-12-19T05:47:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.113+0000 7fd9f1826640 1 -- start start 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9d8003a10 0x7fd9ec15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec0c2b90 0x7fd9ec1e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1598d0 con 0x7fd9ec133a10 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec131930 con 0x7fd9ec0c2b90 2023-12-19T05:47:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9f1826640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec130d60 con 0x7fd9d8003a10 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9e27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9e27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50534/0 (socket says 172.21.15.49:50534) 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.114+0000 7fd9e27fc640 1 -- 172.21.15.49:0/423334137 learned_addr learned my addr 172.21.15.49:0/423334137 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9d8003a10 0x7fd9ec15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9eb7fe640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec0c2b90 0x7fd9ec1e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 -- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9d8003a10 msgr2=0x7fd9ec15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9d8003a10 0x7fd9ec15a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 -- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec0c2b90 msgr2=0x7fd9ec1e46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec0c2b90 0x7fd9ec1e46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec131000 con 0x7fd9ec133a10 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e27fc640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400d810 tx=0x7fd9d400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40074e0 con 0x7fd9ec133a10 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4007640 con 0x7fd9ec133a10 2023-12-19T05:47:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.115+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec1312e0 con 0x7fd9ec133a10 2023-12-19T05:47:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.116+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004a00 con 0x7fd9ec133a10 2023-12-19T05:47:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.116+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec0c3040 con 0x7fd9ec133a10 2023-12-19T05:47:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.117+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec131aa0 con 0x7fd9ec133a10 2023-12-19T05:47:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.118+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9d4004b60 con 0x7fd9ec133a10 2023-12-19T05:47:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.119+0000 7fd9e8ff9640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 0x7fd9cc06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.119+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fd9d40887a0 con 0x7fd9ec133a10 2023-12-19T05:47:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.120+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fd9cc072070 con 0x7fd9ec133a10 2023-12-19T05:47:41.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.120+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 0x7fd9cc06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.121+0000 7fd9eaffd640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 0x7fd9cc06c8e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc036000 tx=0x7fd9dc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.124+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9d4019020 con 0x7fd9ec133a10 2023-12-19T05:47:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.358+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9ec15e1c0 con 0x7fd9ec133a10 2023-12-19T05:47:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.359+0000 7fd9e8ff9640 1 -- 172.21.15.49:0/423334137 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fd9d40577e0 con 0x7fd9ec133a10 2023-12-19T05:47:41.361 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:41.361 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:46:51.014087+0000","modified":"2023-12-19T05:46:54.529180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3042568277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3042568277},{"type":"v1","addr":"172.21.15.49:6835","nonce":3042568277}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-19T05:47:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 msgr2=0x7fd9cc06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 0x7fd9cc06c8e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc036000 tx=0x7fd9dc030000 comp rx=0 tx=0).stop 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 msgr2=0x7fd9ec159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400d810 tx=0x7fd9d400dcd0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 shutdown_connections 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd9cc06a420 0x7fd9cc06c8e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9ec0c2b90 0x7fd9ec1e46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9ec133a10 0x7fd9ec159390 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 --2- 172.21.15.49:0/423334137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9d8003a10 0x7fd9ec15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 >> 172.21.15.49:0/423334137 conn(0x7fd9ec0cc770 msgr2=0x7fd9ec0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 shutdown_connections 2023-12-19T05:47:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.362+0000 7fd9f1826640 1 -- 172.21.15.49:0/423334137 wait complete. 2023-12-19T05:47:41.382 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:41.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.603+0000 7f4d96e30640 1 Processor -- start 2023-12-19T05:47:41.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.603+0000 7f4d96e30640 1 -- start start 2023-12-19T05:47:41.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d96e30640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d900b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d96e30640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900b0a90 con 0x7f4d90157bf0 2023-12-19T05:47:41.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d96e30640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900ae640 con 0x7f4d900b0640 2023-12-19T05:47:41.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d96e30640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9006b8c0 con 0x7f4d900ae110 2023-12-19T05:47:41.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d94bcc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d90157bf0 0x7f4d9015b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44688/0 (socket says 172.21.15.49:44688) 2023-12-19T05:47:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d94bcc640 1 -- 172.21.15.49:0/1328415455 learned_addr learned my addr 172.21.15.49:0/1328415455 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d8ffff640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d900b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501527167 0 0) 0x7f4d84001110 con 0x7f4d90157bf0 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.606+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d80003520 con 0x7f4d90157bf0 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290110439 0 0) 0x7f4d80003520 con 0x7f4d90157bf0 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 msgr2=0x7f4d900b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d900b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 >> v1:172.21.15.115:6789/0 conn(0x7f4d900b0640 legacy=0x7f4d9006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900ae920 con 0x7f4d90157bf0 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f4d84001800 con 0x7f4d90157bf0 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 >> v1:172.21.15.49:6789/0 conn(0x7f4d90157bf0 legacy=0x7f4d9015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80003a10 0x7f4d80003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d80004d00 0x7f4d80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9006b8c0 con 0x7f4d80004d00 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8000ba90 con 0x7f4d80003a10 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8000bc50 con 0x7f4d900ae110 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.607+0000 7f4d953cd640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d80004d00 0x7f4d80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d94bcc640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80003a10 0x7f4d80003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d8ffff640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d953cd640 1 -- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 msgr2=0x7f4d800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d953cd640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d900ae110 0x7f4d800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d953cd640 1 -- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80003a10 msgr2=0x7f4d80003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d953cd640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80003a10 0x7f4d80003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.608+0000 7f4d953cd640 1 -- 172.21.15.49:0/1328415455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d80003520 con 0x7f4d80004d00 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.609+0000 7f4d953cd640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d80004d00 0x7f4d80005180 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f4d88001e20 tx=0x7f4d800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec432d90abdc9a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88003b70 con 0x7f4d80004d00 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d88003cd0 con 0x7f4d80004d00 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d8f7fe640 1 -- 172.21.15.49:0/1328415455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88005310 con 0x7f4d80004d00 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 -- 172.21.15.49:0/1328415455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d80004d00 msgr2=0x7f4d80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 --2- 172.21.15.49:0/1328415455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d80004d00 0x7f4d80005180 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f4d88001e20 tx=0x7f4d800057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d953cd640 1 -- 172.21.15.49:0/1328415455 reap_dead start 2023-12-19T05:47:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 -- 172.21.15.49:0/1328415455 shutdown_connections 2023-12-19T05:47:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 -- 172.21.15.49:0/1328415455 >> 172.21.15.49:0/1328415455 conn(0x7f4d900cbb70 msgr2=0x7f4d900cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 -- 172.21.15.49:0/1328415455 shutdown_connections 2023-12-19T05:47:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.610+0000 7f4d96e30640 1 -- 172.21.15.49:0/1328415455 wait complete. 2023-12-19T05:47:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.612+0000 7f4d96e30640 1 Processor -- start 2023-12-19T05:47:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.612+0000 7f4d96e30640 1 -- start start 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80004d00 0x7f4d90153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d9015dcd0 0x7f4d9015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d901f3780 con 0x7f4d9015baf0 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900ad540 con 0x7f4d80004d00 2023-12-19T05:47:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.613+0000 7f4d96e30640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9015c7c0 con 0x7f4d9015dcd0 2023-12-19T05:47:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50554/0 (socket says 172.21.15.49:50554) 2023-12-19T05:47:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 -- 172.21.15.49:0/2423502611 learned_addr learned my addr 172.21.15.49:0/2423502611 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d8ffff640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d9015dcd0 0x7f4d9015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d94bcc640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80004d00 0x7f4d90153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 -- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d9015dcd0 msgr2=0x7f4d9015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d9015dcd0 0x7f4d9015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 -- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80004d00 msgr2=0x7f4d90153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80004d00 0x7f4d90153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.614+0000 7f4d953cd640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d901f2b60 con 0x7f4d9015baf0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d953cd640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005040 tx=0x7f4d880014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8803e070 con 0x7f4d9015baf0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d88003e40 con 0x7f4d9015baf0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88006d50 con 0x7f4d9015baf0 2023-12-19T05:47:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d901f2de0 con 0x7f4d9015baf0 2023-12-19T05:47:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.615+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d901f33a0 con 0x7f4d9015baf0 2023-12-19T05:47:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.616+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d901f38c0 con 0x7f4d9015baf0 2023-12-19T05:47:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.617+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d88007030 con 0x7f4d9015baf0 2023-12-19T05:47:41.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.618+0000 7f4d8d7fa640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 0x7f4d7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:41.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.618+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f4d880a9b70 con 0x7f4d9015baf0 2023-12-19T05:47:41.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.619+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f4d74072080 con 0x7f4d9015baf0 2023-12-19T05:47:41.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.619+0000 7f4d94bcc640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 0x7f4d7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.620+0000 7f4d94bcc640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 0x7f4d7406c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4d84001050 tx=0x7f4d84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.622+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d88048070 con 0x7f4d9015baf0 2023-12-19T05:47:41.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.819+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d901f3a60 con 0x7f4d9015baf0 2023-12-19T05:47:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.823+0000 7f4d8d7fa640 1 -- 172.21.15.49:0/2423502611 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16275 (secure 0 0 0) 0x7f4d901f38c0 con 0x7f4d9015baf0 2023-12-19T05:47:41.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:41.825 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":149,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:35.360479+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:46:48.824621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-19T05:46:50.051888+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"17.8","mappings":[{"from":6,"to":5}]},{"pgid":"17.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:41.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.825+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 msgr2=0x7f4d7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.825+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 0x7f4d7406c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4d84001050 tx=0x7f4d84009040 comp rx=0 tx=0).stop 2023-12-19T05:47:41.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.825+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 msgr2=0x7f4d9015bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.825+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005040 tx=0x7f4d880014a0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 shutdown_connections 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4d7406a430 0x7f4d7406c8f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d9015dcd0 0x7f4d9015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9015baf0 0x7f4d9015bf70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 --2- 172.21.15.49:0/2423502611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80004d00 0x7f4d90153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 >> 172.21.15.49:0/2423502611 conn(0x7f4d900cbb70 msgr2=0x7f4d900cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 shutdown_connections 2023-12-19T05:47:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:41.826+0000 7f4d96e30640 1 -- 172.21.15.49:0/2423502611 wait complete. 2023-12-19T05:47:41.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:47:42.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.081+0000 7f687aca1640 1 Processor -- start 2023-12-19T05:47:42.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.081+0000 7f687aca1640 1 -- start start 2023-12-19T05:47:42.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f687aca1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68740d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f687aca1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740cd840 con 0x7f6874146e10 2023-12-19T05:47:42.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f687aca1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740b6e90 con 0x7f68740ce110 2023-12-19T05:47:42.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f687aca1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740d2430 con 0x7f68740d2b00 2023-12-19T05:47:42.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f6878a3d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6874146e10 0x7f68740b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44704/0 (socket says 172.21.15.49:44704) 2023-12-19T05:47:42.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f6878a3d640 1 -- 172.21.15.49:0/2253946804 learned_addr learned my addr 172.21.15.49:0/2253946804 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f6873fff640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68740d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233721168 0 0) 0x7f68740cd840 con 0x7f6874146e10 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.083+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6860003520 con 0x7f6874146e10 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2441538486 0 0) 0x7f6860003520 con 0x7f6874146e10 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 msgr2=0x7f68740d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68740d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 >> v1:172.21.15.115:6789/0 conn(0x7f68740ce110 legacy=0x7f68740b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740d2620 con 0x7f6874146e10 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f68640019f0 con 0x7f6874146e10 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 >> v1:172.21.15.49:6789/0 conn(0x7f6874146e10 legacy=0x7f68740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860003a10 0x7f6860003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f6860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68600051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686000bb40 con 0x7f68600047c0 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686000bcb0 con 0x7f6860003a10 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686000be70 con 0x7f68740d2b00 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.084+0000 7f6873fff640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f6860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6878a3d640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860003a10 0x7f6860003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f687923e640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68600051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6873fff640 1 -- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 msgr2=0x7f68600051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6873fff640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68600051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6873fff640 1 -- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860003a10 msgr2=0x7f6860003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6873fff640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860003a10 0x7f6860003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f6873fff640 1 -- 172.21.15.49:0/2253946804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860003520 con 0x7f68600047c0 2023-12-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.085+0000 7f687923e640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68740d2b00 0x7f68600051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.086+0000 7f6873fff640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f6860004c40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f685c009ac0 tx=0x7f68600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cf976666911cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.086+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c02c6b0 con 0x7f68600047c0 2023-12-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.086+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c02c810 con 0x7f68600047c0 2023-12-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.086+0000 7f68737fe640 1 -- 172.21.15.49:0/2253946804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c02cba0 con 0x7f68600047c0 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 -- 172.21.15.49:0/2253946804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 msgr2=0x7f6860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 --2- 172.21.15.49:0/2253946804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f6860004c40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f685c009ac0 tx=0x7f68600057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687923e640 1 -- 172.21.15.49:0/2253946804 reap_dead start 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 -- 172.21.15.49:0/2253946804 shutdown_connections 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 -- 172.21.15.49:0/2253946804 >> 172.21.15.49:0/2253946804 conn(0x7f68740b29c0 msgr2=0x7f68740b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 -- 172.21.15.49:0/2253946804 shutdown_connections 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.087+0000 7f687aca1640 1 -- 172.21.15.49:0/2253946804 wait complete. 2023-12-19T05:47:42.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.089+0000 7f687aca1640 1 Processor -- start 2023-12-19T05:47:42.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.089+0000 7f687aca1640 1 -- start start 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f687415a910 0x7f687415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f687406f120 0x7f687406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874160230 con 0x7f68600047c0 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687406fae0 con 0x7f687415a910 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.090+0000 7f687aca1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687415fec0 con 0x7f687406f120 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50566/0 (socket says 172.21.15.49:50566) 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 -- 172.21.15.49:0/3153388390 learned_addr learned my addr 172.21.15.49:0/3153388390 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6873fff640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f687415a910 0x7f687415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f687923e640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f687406f120 0x7f687406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 -- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f687406f120 msgr2=0x7f687406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f687406f120 0x7f687406f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 -- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f687415a910 msgr2=0x7f687415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f687415a910 0x7f687415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68741f6300 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.091+0000 7f6878a3d640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6864007a60 tx=0x7f686400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.092+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400ee50 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.092+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864013420 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.092+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68640137d0 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.092+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68741f65e0 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.092+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741f68c0 con 0x7f68600047c0 2023-12-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.093+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6874061910 con 0x7f68600047c0 2023-12-19T05:47:42.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.094+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6864013930 con 0x7f68600047c0 2023-12-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.095+0000 7f68717fa640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 0x7f685406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.095+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f68640891c0 con 0x7f68600047c0 2023-12-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.096+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f6854072080 con 0x7f68600047c0 2023-12-19T05:47:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.096+0000 7f6873fff640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 0x7f685406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.097+0000 7f6873fff640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 0x7f685406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f685c036000 tx=0x7f685c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.100+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6864054740 con 0x7f68600047c0 2023-12-19T05:47:42.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.335+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f687415b890 con 0x7f68600047c0 2023-12-19T05:47:42.338 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:47:42.337+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:47:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.340+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(150..150 src has 1..150) v4 ==== 374+0+0 (secure 0 0 0) 0x7f6864058400 con 0x7f68600047c0 2023-12-19T05:47:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.340+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f68540727c0 con 0x7f68600047c0 2023-12-19T05:47:42.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.356+0000 7f68717fa640 1 -- 172.21.15.49:0/3153388390 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6864001860 con 0x7f68600047c0 2023-12-19T05:47:42.358 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:47:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 msgr2=0x7f685406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 0x7f685406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f685c036000 tx=0x7f685c030000 comp rx=0 tx=0).stop 2023-12-19T05:47:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 msgr2=0x7f68741f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6864007a60 tx=0x7f686400e530 comp rx=0 tx=0).stop 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 shutdown_connections 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f685406a430 0x7f685406c8f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f687406f120 0x7f687406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f687415a910 0x7f687415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 --2- 172.21.15.49:0/3153388390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68600047c0 0x7f68741f5ab0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.359+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 >> 172.21.15.49:0/3153388390 conn(0x7f68740b29c0 msgr2=0x7f6874070540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.360+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 shutdown_connections 2023-12-19T05:47:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.360+0000 7f687aca1640 1 -- 172.21.15.49:0/3153388390 wait complete. 2023-12-19T05:47:42.373 INFO:tasks.ceph.mds.c.smithi049.stderr: -9464> 2023-12-19T05:46:55.470+0000 7f1bb7930640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:47:42.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:47:42.452 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:47:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.585+0000 7f6bd3777640 1 Processor -- start 2023-12-19T05:47:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.585+0000 7f6bd3777640 1 -- start start 2023-12-19T05:47:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd3777640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bcc0b1d20 0x7f6bcc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd3777640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc15a940 con 0x7f6bcc15db70 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd3777640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc15a050 con 0x7f6bcc1540c0 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd3777640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc15e3b0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd1d14640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6bcc15db70 0x7f6bcc0ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44712/0 (socket says 172.21.15.49:44712) 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd1d14640 1 -- 172.21.15.49:0/2947142825 learned_addr learned my addr 172.21.15.49:0/2947142825 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.587+0000 7f6bd0d12640 1 --2- 172.21.15.49:0/2947142825 >> v2:172.21.15.49:3300/0 conn(0x7f6bcc0b1d20 0x7f6bcc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.588+0000 7f6bc3fff640 1 -- 172.21.15.49:0/2947142825 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964430134 0 0) 0x7f6bcc15a940 con 0x7f6bcc15db70 2023-12-19T05:47:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.588+0000 7f6bc3fff640 1 -- 172.21.15.49:0/2947142825 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb8003520 con 0x7f6bcc15db70 2023-12-19T05:47:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.588+0000 7f6bd0d12640 1 -- 172.21.15.49:0/2947142825 >> v1:172.21.15.115:6789/0 conn(0x7f6bcc1540c0 legacy=0x7f6bcc0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.588+0000 7f6bd0d12640 1 -- 172.21.15.49:0/2947142825 >> v1:172.21.15.49:6789/0 conn(0x7f6bcc15db70 legacy=0x7f6bcc0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.588+0000 7f6bd0d12640 1 -- 172.21.15.49:0/2947142825 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc15a2f0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.589+0000 7f6bd0d12640 1 --2- 172.21.15.49:0/2947142825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc15d630 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0097a0 tx=0x7f6bbc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee81c29f5847327 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.589+0000 7f6bc3fff640 1 -- 172.21.15.49:0/2947142825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc02e070 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.589+0000 7f6bc3fff640 1 -- 172.21.15.49:0/2947142825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0315a0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.589+0000 7f6bc3fff640 1 -- 172.21.15.49:0/2947142825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc031930 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 -- 172.21.15.49:0/2947142825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 msgr2=0x7f6bcc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 --2- 172.21.15.49:0/2947142825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc15d630 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0097a0 tx=0x7f6bbc02b840 comp rx=0 tx=0).stop 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 -- 172.21.15.49:0/2947142825 shutdown_connections 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 --2- 172.21.15.49:0/2947142825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc15d630 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 -- 172.21.15.49:0/2947142825 >> 172.21.15.49:0/2947142825 conn(0x7f6bcc066160 msgr2=0x7f6bcc0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 -- 172.21.15.49:0/2947142825 shutdown_connections 2023-12-19T05:47:42.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.590+0000 7f6bd3777640 1 -- 172.21.15.49:0/2947142825 wait complete. 2023-12-19T05:47:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.592+0000 7f6bd3777640 1 Processor -- start 2023-12-19T05:47:42.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.592+0000 7f6bd3777640 1 -- start start 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bcc1540c0 0x7f6bcc14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc15db70 0x7f6bcc14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0ae780 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0aea60 con 0x7f6bcc15db70 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd3777640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0aed40 con 0x7f6bcc1540c0 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd1513640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd1513640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50604/0 (socket says 172.21.15.49:50604) 2023-12-19T05:47:42.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.593+0000 7f6bd1513640 1 -- 172.21.15.49:0/1084104711 learned_addr learned my addr 172.21.15.49:0/1084104711 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1d14640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc15db70 0x7f6bcc14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd0d12640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bcc1540c0 0x7f6bcc14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 -- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bcc1540c0 msgr2=0x7f6bcc14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bcc1540c0 0x7f6bcc14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 -- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc15db70 msgr2=0x7f6bcc14ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc15db70 0x7f6bcc14ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009400 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd1513640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c430 tx=0x7f6bc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011790 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80118f0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.594+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0af020 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.595+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011ce0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.595+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc14c910 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.596+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc15adb0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.597+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bc801c460 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.598+0000 7f6bc1ffb640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.598+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f6bc8088950 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.598+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f6bb00721c0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.598+0000 7f6bd0d12640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:42.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.599+0000 7f6bd0d12640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 0x7f6bb006c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc036000 tx=0x7f6bbc03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:42.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.602+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6bcc15adb0 con 0x7f6bcc0b1d20 2023-12-19T05:47:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:42.834+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6bcc15adb0 con 0x7f6bcc0b1d20 2023-12-19T05:47:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.361+0000 7f6bc1ffb640 1 -- 172.21.15.49:0/1084104711 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6bcc15adb0 con 0x7f6bcc0b1d20 2023-12-19T05:47:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 msgr2=0x7f6bb006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 0x7f6bb006c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc036000 tx=0x7f6bbc03d040 comp rx=0 tx=0).stop 2023-12-19T05:47:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 msgr2=0x7f6bcc0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c430 tx=0x7f6bc800c8f0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 shutdown_connections 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bcc1540c0 0x7f6bcc14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc15db70 0x7f6bcc14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.364+0000 7f6bd3777640 1 --2- 172.21.15.49:0/1084104711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bcc0b1d20 0x7f6bcc0ae070 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.365+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 >> 172.21.15.49:0/1084104711 conn(0x7f6bcc066160 msgr2=0x7f6bcc157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.365+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 shutdown_connections 2023-12-19T05:47:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.365+0000 7f6bd3777640 1 -- 172.21.15.49:0/1084104711 wait complete. 2023-12-19T05:47:43.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:47:43.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.628+0000 7f009cfea640 1 Processor -- start 2023-12-19T05:47:43.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.629+0000 7f009cfea640 1 -- start start 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.630+0000 7f009cfea640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0098141660 0x7f0098140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.630+0000 7f009cfea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0098140f70 0x7f00980cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.630+0000 7f009cfea640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980b1880 con 0x7f009813e200 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.630+0000 7f009cfea640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00981413e0 con 0x7f0098141660 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.630+0000 7f009cfea640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980b26e0 con 0x7f0098140f70 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0098141660 0x7f0098140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0098141660 0x7f0098140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50606/0 (socket says 172.21.15.49:50606) 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 -- 172.21.15.49:0/2988269060 learned_addr learned my addr 172.21.15.49:0/2988269060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0096d9d640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0098140f70 0x7f00980cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 -- 172.21.15.49:0/2988269060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0098140f70 msgr2=0x7f00980cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0098140f70 0x7f00980cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 -- 172.21.15.49:0/2988269060 >> v1:172.21.15.115:6789/0 conn(0x7f009813e200 legacy=0x7f00980ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.631+0000 7f0095d9b640 1 -- 172.21.15.49:0/2988269060 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980b1ad0 con 0x7f0098141660 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.632+0000 7f0095d9b640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f0098140a30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f0080009e50 tx=0x7f008002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796edeba56079637 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.633+0000 7f009559a640 1 -- 172.21.15.49:0/2988269060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008002ca70 con 0x7f0098141660 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.633+0000 7f009559a640 1 -- 172.21.15.49:0/2988269060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008002cbd0 con 0x7f0098141660 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.633+0000 7f009559a640 1 -- 172.21.15.49:0/2988269060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800343f0 con 0x7f0098141660 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 -- 172.21.15.49:0/2988269060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 msgr2=0x7f0098140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:43.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f0098140a30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f0080009e50 tx=0x7f008002bed0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 -- 172.21.15.49:0/2988269060 shutdown_connections 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0098140f70 0x7f00980cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 --2- 172.21.15.49:0/2988269060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f0098140a30 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 -- 172.21.15.49:0/2988269060 >> 172.21.15.49:0/2988269060 conn(0x7f00980cf230 msgr2=0x7f00980cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 -- 172.21.15.49:0/2988269060 shutdown_connections 2023-12-19T05:47:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.634+0000 7f009cfea640 1 -- 172.21.15.49:0/2988269060 wait complete. 2023-12-19T05:47:43.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.636+0000 7f009cfea640 1 Processor -- start 2023-12-19T05:47:43.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.636+0000 7f009cfea640 1 -- start start 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f009813e200 0x7f00981f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0098140f70 0x7f0098139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981f67b0 con 0x7f0098141660 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981f36c0 con 0x7f0098140f70 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f009cfea640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00981f39a0 con 0x7f009813e200 2023-12-19T05:47:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50614/0 (socket says 172.21.15.49:50614) 2023-12-19T05:47:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 -- 172.21.15.49:0/806462652 learned_addr learned my addr 172.21.15.49:0/806462652 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 -- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f009813e200 msgr2=0x7f00981f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f009813e200 0x7f00981f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 -- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0098140f70 msgr2=0x7f0098139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0098140f70 0x7f0098139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.637+0000 7f0096d9d640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080009b30 con 0x7f0098141660 2023-12-19T05:47:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f0096d9d640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f009000d800 tx=0x7f009000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000b6c0 con 0x7f0098141660 2023-12-19T05:47:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000b840 con 0x7f0098141660 2023-12-19T05:47:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000bbf0 con 0x7f0098141660 2023-12-19T05:47:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00981f3c80 con 0x7f0098141660 2023-12-19T05:47:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.638+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009806c5c0 con 0x7f0098141660 2023-12-19T05:47:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.639+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0098061910 con 0x7f0098141660 2023-12-19T05:47:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.640+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f009000bd50 con 0x7f0098141660 2023-12-19T05:47:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.641+0000 7f008effd640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 0x7f007c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.641+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f0090088e60 con 0x7f0098141660 2023-12-19T05:47:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.642+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f007c072190 con 0x7f0098141660 2023-12-19T05:47:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.642+0000 7f009659c640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 0x7f007c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.643+0000 7f009659c640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 0x7f007c06c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0088003cc0 tx=0x7f00880079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.646+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0090054410 con 0x7f0098141660 2023-12-19T05:47:43.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:43.843+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f009815b760 con 0x7f0098141660 2023-12-19T05:47:44.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.578+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(151..151 src has 1..151) v4 ==== 313+0+0 (secure 0 0 0) 0x7f00900587d0 con 0x7f0098141660 2023-12-19T05:47:44.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.578+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f007c0705c0 con 0x7f0098141660 2023-12-19T05:47:44.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.583+0000 7f008effd640 1 -- 172.21.15.49:0/806462652 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0090057c10 con 0x7f0098141660 2023-12-19T05:47:44.589 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:47:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.589+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 msgr2=0x7f007c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.589+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 0x7f007c06c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0088003cc0 tx=0x7f00880079b0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.589+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 msgr2=0x7f009806c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.589+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f009000d800 tx=0x7f009000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 shutdown_connections 2023-12-19T05:47:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f007c06a430 0x7f007c06c8f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0098141660 0x7f009806c080 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0098140f70 0x7f0098139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 --2- 172.21.15.49:0/806462652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f009813e200 0x7f00981f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.590+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 >> 172.21.15.49:0/806462652 conn(0x7f00980cf230 msgr2=0x7f009815d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.592+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 shutdown_connections 2023-12-19T05:47:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.592+0000 7f009cfea640 1 -- 172.21.15.49:0/806462652 wait complete. 2023-12-19T05:47:44.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:47:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.831+0000 7fddb81f0640 1 Processor -- start 2023-12-19T05:47:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.831+0000 7fddb81f0640 1 -- start start 2023-12-19T05:47:44.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.833+0000 7fddb81f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddb006b8b0 0x7fddb0161f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.833+0000 7fddb81f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 0x7fddb015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.833+0000 7fddb81f0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb0162570 con 0x7fddb006bc90 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.833+0000 7fddb81f0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb0165610 con 0x7fddb006b8b0 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.833+0000 7fddb81f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00ce920 con 0x7fddb00b0cb0 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddb006b8b0 0x7fddb0161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddb006b8b0 0x7fddb0161f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49660/0 (socket says 172.21.15.49:49660) 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb578b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fddb006bc90 0x7fddb00ae100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51720/0 (socket says 172.21.15.49:51720) 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 -- 172.21.15.49:0/221039715 learned_addr learned my addr 172.21.15.49:0/221039715 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb678d640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 0x7fddb015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 -- 172.21.15.49:0/221039715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 msgr2=0x7fddb015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 0x7fddb015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 -- 172.21.15.49:0/221039715 >> v1:172.21.15.49:6789/0 conn(0x7fddb006bc90 legacy=0x7fddb00ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb5f8c640 1 -- 172.21.15.49:0/221039715 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0162850 con 0x7fddb006b8b0 2023-12-19T05:47:44.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.834+0000 7fddb678d640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 0x7fddb015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.835+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb006b8b0 0x7fddb0161f90 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fddac009870 tx=0x7fddac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464700fda6095076 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.836+0000 7fddb4f8a640 1 -- 172.21.15.49:0/221039715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac030840 con 0x7fddb006b8b0 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.836+0000 7fddb4f8a640 1 -- 172.21.15.49:0/221039715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac0309a0 con 0x7fddb006b8b0 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.836+0000 7fddb4f8a640 1 -- 172.21.15.49:0/221039715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac030d30 con 0x7fddb006b8b0 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.836+0000 7fddb81f0640 1 -- 172.21.15.49:0/221039715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb006b8b0 msgr2=0x7fddb0161f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.836+0000 7fddb81f0640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb006b8b0 0x7fddb0161f90 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fddac009870 tx=0x7fddac02b980 comp rx=0 tx=0).stop 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 -- 172.21.15.49:0/221039715 shutdown_connections 2023-12-19T05:47:44.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb00b0cb0 0x7fddb015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 --2- 172.21.15.49:0/221039715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb006b8b0 0x7fddb0161f90 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 -- 172.21.15.49:0/221039715 >> 172.21.15.49:0/221039715 conn(0x7fddb00cf2f0 msgr2=0x7fddb00cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:44.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 -- 172.21.15.49:0/221039715 shutdown_connections 2023-12-19T05:47:44.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.837+0000 7fddb81f0640 1 -- 172.21.15.49:0/221039715 wait complete. 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.838+0000 7fddb81f0640 1 Processor -- start 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.839+0000 7fddb81f0640 1 -- start start 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.839+0000 7fddb81f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 0x7fddb015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb81f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 0x7fddb01f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb81f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb81f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb015ead0 con 0x7fddb00b0cb0 2023-12-19T05:47:44.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb81f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb015edb0 con 0x7fddb006b8b0 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb81f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb015f090 con 0x7fddb006bc90 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49670/0 (socket says 172.21.15.49:49670) 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 -- 172.21.15.49:0/3252192400 learned_addr learned my addr 172.21.15.49:0/3252192400 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 0x7fddb015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb578b640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 0x7fddb01f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 -- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 msgr2=0x7fddb01f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 0x7fddb01f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 -- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 msgr2=0x7fddb015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 0x7fddb015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:44.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb678d640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0094d0 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 0x7fddb015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.840+0000 7fddb578b640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 0x7fddb01f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fddb678d640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdda800cd50 tx=0x7fdda800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800f680 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800f800 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb015f370 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800fbb0 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.841+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb015e730 con 0x7fddb00b0cb0 2023-12-19T05:47:44.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.842+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb0074770 con 0x7fddb00b0cb0 2023-12-19T05:47:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.843+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdda800b040 con 0x7fddb00b0cb0 2023-12-19T05:47:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.844+0000 7fdda67fc640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 0x7fdd9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.844+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fdda80892c0 con 0x7fddb00b0cb0 2023-12-19T05:47:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.845+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fdd940712c0 con 0x7fddb00b0cb0 2023-12-19T05:47:44.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.845+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 0x7fdd9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:44.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.846+0000 7fddb5f8c640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 0x7fdd9406c8f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fddac036000 tx=0x7fddac03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:44.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:44.849+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdda80548a0 con 0x7fddb00b0cb0 2023-12-19T05:47:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.044+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fddb015f890 con 0x7fddb00b0cb0 2023-12-19T05:47:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.589+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(152..152 src has 1..152) v4 ==== 330+0+0 (secure 0 0 0) 0x7fdda8058560 con 0x7fddb00b0cb0 2023-12-19T05:47:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.589+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fdd94070050 con 0x7fddb00b0cb0 2023-12-19T05:47:45.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.599+0000 7fdda67fc640 1 -- 172.21.15.49:0/3252192400 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 169+0+0 (secure 0 0 0) 0x7fddb015f890 con 0x7fddb00b0cb0 2023-12-19T05:47:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:47:45.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.608+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 msgr2=0x7fdd9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.608+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 0x7fdd9406c8f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fddac036000 tx=0x7fddac03b040 comp rx=0 tx=0).stop 2023-12-19T05:47:45.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 msgr2=0x7fddb01f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdda800cd50 tx=0x7fdda800a650 comp rx=0 tx=0).stop 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 shutdown_connections 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdd9406a430 0x7fdd9406c8f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fddb006bc90 0x7fddb01f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddb00b0cb0 0x7fddb01f6860 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 --2- 172.21.15.49:0/3252192400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb006b8b0 0x7fddb015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.609+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 >> 172.21.15.49:0/3252192400 conn(0x7fddb00cf2f0 msgr2=0x7fddb01634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:45.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.610+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 shutdown_connections 2023-12-19T05:47:45.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.611+0000 7fddb81f0640 1 -- 172.21.15.49:0/3252192400 wait complete. 2023-12-19T05:47:45.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:47:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.842+0000 7fe6a7fff640 1 Processor -- start 2023-12-19T05:47:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.842+0000 7fe6a7fff640 1 -- start start 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6a80b0a00 0x7fe6a806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a7fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a815c9c0 con 0x7fe6a8155460 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a7fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a806d270 con 0x7fe6a806ca80 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a7fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a806d550 con 0x7fe6a80b0a00 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a6ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6a8155460 0x7fe6a80b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51734/0 (socket says 172.21.15.49:51734) 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/288388005 learned_addr learned my addr 172.21.15.49:0/288388005 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.844+0000 7fe69ffff640 1 --2- 172.21.15.49:0/288388005 >> v2:172.21.15.49:3300/0 conn(0x7fe6a80b0a00 0x7fe6a806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:45.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.845+0000 7fe6a67fc640 1 -- 172.21.15.49:0/288388005 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933661327 0 0) 0x7fe6a815c9c0 con 0x7fe6a8155460 2023-12-19T05:47:45.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.845+0000 7fe6a67fc640 1 -- 172.21.15.49:0/288388005 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694003520 con 0x7fe6a8155460 2023-12-19T05:47:45.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.845+0000 7fe69ffff640 1 -- 172.21.15.49:0/288388005 >> v1:172.21.15.115:6789/0 conn(0x7fe6a806ca80 legacy=0x7fe6a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.845+0000 7fe69ffff640 1 -- 172.21.15.49:0/288388005 >> v1:172.21.15.49:6789/0 conn(0x7fe6a8155460 legacy=0x7fe6a80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.845+0000 7fe69ffff640 1 -- 172.21.15.49:0/288388005 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a806d830 con 0x7fe6a80b0a00 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.846+0000 7fe69ffff640 1 --2- 172.21.15.49:0/288388005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a80b0a00 0x7fe6a806c540 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe6900097a0 tx=0x7fe69002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846af67c830f48dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a67fc640 1 -- 172.21.15.49:0/288388005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690030610 con 0x7fe6a80b0a00 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a67fc640 1 -- 172.21.15.49:0/288388005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe690030770 con 0x7fe6a80b0a00 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a67fc640 1 -- 172.21.15.49:0/288388005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690030b00 con 0x7fe6a80b0a00 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a7fff640 1 -- 172.21.15.49:0/288388005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a80b0a00 msgr2=0x7fe6a806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/288388005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a80b0a00 0x7fe6a806c540 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe6900097a0 tx=0x7fe69002b960 comp rx=0 tx=0).stop 2023-12-19T05:47:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a7fff640 1 -- 172.21.15.49:0/288388005 shutdown_connections 2023-12-19T05:47:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/288388005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a80b0a00 0x7fe6a806c540 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.847+0000 7fe6a7fff640 1 -- 172.21.15.49:0/288388005 >> 172.21.15.49:0/288388005 conn(0x7fe6a80659a0 msgr2=0x7fe6a8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.848+0000 7fe6a7fff640 1 -- 172.21.15.49:0/288388005 shutdown_connections 2023-12-19T05:47:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.848+0000 7fe6a7fff640 1 -- 172.21.15.49:0/288388005 wait complete. 2023-12-19T05:47:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.849+0000 7fe6a7fff640 1 Processor -- start 2023-12-19T05:47:45.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.850+0000 7fe6a7fff640 1 -- start start 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80b0a00 0x7fe6a81f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a8155460 0x7fe6a814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8155b80 con 0x7fe6a806ca80 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8155df0 con 0x7fe6a80b0a00 2023-12-19T05:47:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a7fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81560d0 con 0x7fe6a8155460 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49682/0 (socket says 172.21.15.49:49682) 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/856812627 learned_addr learned my addr 172.21.15.49:0/856812627 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe69ffff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80b0a00 0x7fe6a81f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a8155460 msgr2=0x7fe6a814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a8155460 0x7fe6a814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80b0a00 msgr2=0x7fe6a81f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80b0a00 0x7fe6a81f0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.851+0000 7fe6a6ffd640 1 -- 172.21.15.49:0/856812627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690009400 con 0x7fe6a806ca80 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe6a6ffd640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c410 tx=0x7fe69800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698005ce0 con 0x7fe6a806ca80 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe698005e40 con 0x7fe6a806ca80 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980072f0 con 0x7fe6a806ca80 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a81563b0 con 0x7fe6a806ca80 2023-12-19T05:47:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.852+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a81f11d0 con 0x7fe6a806ca80 2023-12-19T05:47:45.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.853+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a81565a0 con 0x7fe6a806ca80 2023-12-19T05:47:45.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.854+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe698007510 con 0x7fe6a806ca80 2023-12-19T05:47:45.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.855+0000 7fe69f7fe640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 0x7fe68806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:45.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.855+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe698087c80 con 0x7fe6a806ca80 2023-12-19T05:47:45.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.856+0000 7fe69ffff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 0x7fe68806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:45.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.857+0000 7fe69ffff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 0x7fe68806c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe690036000 tx=0x7fe69003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:45.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:45.860+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe698053630 con 0x7fe6a806ca80 2023-12-19T05:47:46.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.057+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe6a8061910 con 0x7fe6a806ca80 2023-12-19T05:47:46.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.068+0000 7fe69f7fe640 1 -- 172.21.15.49:0/856812627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe69805be60 con 0x7fe6a806ca80 2023-12-19T05:47:46.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 msgr2=0x7fe68806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 0x7fe68806c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe690036000 tx=0x7fe69003b040 comp rx=0 tx=0).stop 2023-12-19T05:47:46.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 msgr2=0x7fe6a814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c410 tx=0x7fe69800c8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 shutdown_connections 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe68806a430 0x7fe68806c8f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a8155460 0x7fe6a814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80b0a00 0x7fe6a81f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 --2- 172.21.15.49:0/856812627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6a806ca80 0x7fe6a814db00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 >> 172.21.15.49:0/856812627 conn(0x7fe6a80659a0 msgr2=0x7fe6a806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 shutdown_connections 2023-12-19T05:47:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.071+0000 7fe6a7fff640 1 -- 172.21.15.49:0/856812627 wait complete. 2023-12-19T05:47:46.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-19T05:47:46.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.321+0000 7fee96547640 1 Processor -- start 2023-12-19T05:47:46.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.322+0000 7fee96547640 1 -- start start 2023-12-19T05:47:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.323+0000 7fee96547640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee9015e5a0 0x7fee900b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.323+0000 7fee96547640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee9015f680 0x7fee900b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee96547640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9015ec30 con 0x7fee900cdbf0 2023-12-19T05:47:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee96547640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900b2cc0 con 0x7fee9015f680 2023-12-19T05:47:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee96547640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9015e980 con 0x7fee9015e5a0 2023-12-19T05:47:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee94d44640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee9015f680 0x7fee900b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee94d44640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee9015f680 0x7fee900b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49684/0 (socket says 172.21.15.49:49684) 2023-12-19T05:47:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee94d44640 1 -- 172.21.15.49:0/159008429 learned_addr learned my addr 172.21.15.49:0/159008429 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.324+0000 7fee95545640 1 --2- 172.21.15.49:0/159008429 >> v2:172.21.15.115:3300/0 conn(0x7fee9015e5a0 0x7fee900b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.325+0000 7fee94d44640 1 -- 172.21.15.49:0/159008429 >> v2:172.21.15.115:3300/0 conn(0x7fee9015e5a0 msgr2=0x7fee900b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.325+0000 7fee94d44640 1 --2- 172.21.15.49:0/159008429 >> v2:172.21.15.115:3300/0 conn(0x7fee9015e5a0 0x7fee900b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.325+0000 7fee94d44640 1 -- 172.21.15.49:0/159008429 >> v1:172.21.15.49:6789/0 conn(0x7fee900cdbf0 legacy=0x7fee9006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.325+0000 7fee94d44640 1 -- 172.21.15.49:0/159008429 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900b2f90 con 0x7fee9015f680 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.325+0000 7fee87fff640 1 -- 172.21.15.49:0/159008429 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804633956 0 0) 0x7fee9015ec30 con 0x7fee900cdbf0 2023-12-19T05:47:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.326+0000 7fee94d44640 1 --2- 172.21.15.49:0/159008429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee9015f680 0x7fee900b2780 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fee80009870 tx=0x7fee8002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee916239db4dd99d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee87fff640 1 -- 172.21.15.49:0/159008429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80030860 con 0x7fee9015f680 2023-12-19T05:47:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee87fff640 1 -- 172.21.15.49:0/159008429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee800309c0 con 0x7fee9015f680 2023-12-19T05:47:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee87fff640 1 -- 172.21.15.49:0/159008429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80030d50 con 0x7fee9015f680 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 -- 172.21.15.49:0/159008429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee9015f680 msgr2=0x7fee900b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 --2- 172.21.15.49:0/159008429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee9015f680 0x7fee900b2780 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fee80009870 tx=0x7fee8002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 -- 172.21.15.49:0/159008429 shutdown_connections 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 --2- 172.21.15.49:0/159008429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee9015f680 0x7fee900b2780 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 --2- 172.21.15.49:0/159008429 >> v2:172.21.15.115:3300/0 conn(0x7fee9015e5a0 0x7fee900b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.327+0000 7fee96547640 1 -- 172.21.15.49:0/159008429 >> 172.21.15.49:0/159008429 conn(0x7fee900b0100 msgr2=0x7fee900b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.328+0000 7fee96547640 1 -- 172.21.15.49:0/159008429 shutdown_connections 2023-12-19T05:47:46.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.328+0000 7fee96547640 1 -- 172.21.15.49:0/159008429 wait complete. 2023-12-19T05:47:46.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.329+0000 7fee96547640 1 Processor -- start 2023-12-19T05:47:46.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.329+0000 7fee96547640 1 -- start start 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 0x7fee900ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee9015f680 0x7fee9014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9014d260 con 0x7fee900cdbf0 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015b1d0 con 0x7fee9015e5a0 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.330+0000 7fee96547640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015b4b0 con 0x7fee9015f680 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49698/0 (socket says 172.21.15.49:49698) 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 -- 172.21.15.49:0/3061931933 learned_addr learned my addr 172.21.15.49:0/3061931933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee94d44640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 0x7fee900ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 -- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee9015f680 msgr2=0x7fee9014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee9015f680 0x7fee9014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 -- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 msgr2=0x7fee900ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 0x7fee900ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee95545640 1 -- 172.21.15.49:0/3061931933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800094d0 con 0x7fee900cdbf0 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.331+0000 7fee94d44640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 0x7fee900ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee95545640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00d800 tx=0x7fee8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00b6c0 con 0x7fee900cdbf0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00b820 con 0x7fee900cdbf0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee900c9570 con 0x7fee900cdbf0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00bbb0 con 0x7fee900cdbf0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.332+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee900c8780 con 0x7fee900cdbf0 2023-12-19T05:47:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.333+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90061910 con 0x7fee900cdbf0 2023-12-19T05:47:46.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.334+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee8c00bd10 con 0x7fee900cdbf0 2023-12-19T05:47:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.335+0000 7fee85ffb640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 0x7fee7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.335+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee8c088c00 con 0x7fee900cdbf0 2023-12-19T05:47:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.336+0000 7fee94d44640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 0x7fee7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.337+0000 7fee94d44640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 0x7fee7406c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fee80036000 tx=0x7fee8003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.340+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee8c054450 con 0x7fee900cdbf0 2023-12-19T05:47:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:46.606+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fee900ce980 con 0x7fee900cdbf0 2023-12-19T05:47:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.605+0000 7fee85ffb640 1 -- 172.21.15.49:0/3061931933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v453) v1 ==== 140+0+0 (secure 0 0 0) 0x7fee8c057a70 con 0x7fee900cdbf0 2023-12-19T05:47:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.608+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 msgr2=0x7fee7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.608+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 0x7fee7406c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fee80036000 tx=0x7fee8003b040 comp rx=0 tx=0).stop 2023-12-19T05:47:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.608+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 msgr2=0x7fee90158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.608+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00d800 tx=0x7fee8c00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 shutdown_connections 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fee7406a430 0x7fee7406c8f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee9015f680 0x7fee9014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9015e5a0 0x7fee900ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 --2- 172.21.15.49:0/3061931933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900cdbf0 0x7fee90158610 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 >> 172.21.15.49:0/3061931933 conn(0x7fee900b0100 msgr2=0x7fee90157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 shutdown_connections 2023-12-19T05:47:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.609+0000 7fee96547640 1 -- 172.21.15.49:0/3061931933 wait complete. 2023-12-19T05:47:47.632 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T05:47:47.632 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T05:47:47.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.864+0000 7fa16b701640 1 Processor -- start 2023-12-19T05:47:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.864+0000 7fa16b701640 1 -- start start 2023-12-19T05:47:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16b701640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa1640b0b50 0x7fa16406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16b701640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16406bb30 con 0x7fa1641449e0 2023-12-19T05:47:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16b701640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640b0070 con 0x7fa16406b590 2023-12-19T05:47:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16b701640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640b0350 con 0x7fa1640b0b50 2023-12-19T05:47:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16949d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1641449e0 0x7fa1640af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51760/0 (socket says 172.21.15.49:51760) 2023-12-19T05:47:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.866+0000 7fa16949d640 1 -- 172.21.15.49:0/798485302 learned_addr learned my addr 172.21.15.49:0/798485302 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa168c9c640 1 --2- 172.21.15.49:0/798485302 >> v2:172.21.15.115:3300/0 conn(0x7fa1640b0b50 0x7fa16406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080677118 0 0) 0x7fa16406bb30 con 0x7fa1641449e0 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa150003520 con 0x7fa1641449e0 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317474595 0 0) 0x7fa150003520 con 0x7fa1641449e0 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 >> v2:172.21.15.115:3300/0 conn(0x7fa1640b0b50 msgr2=0x7fa16406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 --2- 172.21.15.49:0/798485302 >> v2:172.21.15.115:3300/0 conn(0x7fa1640b0b50 0x7fa16406bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 >> v1:172.21.15.115:6789/0 conn(0x7fa16406b590 legacy=0x7fa1640b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640b0630 con 0x7fa1641449e0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa160001670 con 0x7fa1641449e0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 >> v1:172.21.15.49:6789/0 conn(0x7fa1641449e0 legacy=0x7fa1640af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa150003a30 0x7fa150003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1500047c0 0x7fa150004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 0x7fa15000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640b0350 con 0x7fa1500051d0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15000c100 con 0x7fa150003a30 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.867+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15000c2c0 con 0x7fa1500047c0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 0x7fa15000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa16949d640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa150003a30 0x7fa150003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa168c9c640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1500047c0 0x7fa150004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 -- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1500047c0 msgr2=0x7fa150004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:47.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1500047c0 0x7fa150004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 -- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa150003a30 msgr2=0x7fa150003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa150003a30 0x7fa150003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.868+0000 7fa169c9e640 1 -- 172.21.15.49:0/798485302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150003520 con 0x7fa1500051d0 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.869+0000 7fa169c9e640 1 -- 172.21.15.49:0/798485302 reap_dead start 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.869+0000 7fa169c9e640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 0x7fa15000b980 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa15c001e50 tx=0x7fa1500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60010da84a86cb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c003b70 con 0x7fa1500051d0 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c003d10 con 0x7fa1500051d0 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa15bfff640 1 -- 172.21.15.49:0/798485302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c005310 con 0x7fa1500051d0 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 -- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 msgr2=0x7fa15000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 0x7fa15000b980 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa15c001e50 tx=0x7fa1500057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 -- 172.21.15.49:0/798485302 shutdown_connections 2023-12-19T05:47:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 --2- 172.21.15.49:0/798485302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500051d0 0x7fa15000b980 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 -- 172.21.15.49:0/798485302 >> 172.21.15.49:0/798485302 conn(0x7fa1640cbb70 msgr2=0x7fa1640cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 -- 172.21.15.49:0/798485302 shutdown_connections 2023-12-19T05:47:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.870+0000 7fa16b701640 1 -- 172.21.15.49:0/798485302 wait complete. 2023-12-19T05:47:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.872+0000 7fa16b701640 1 Processor -- start 2023-12-19T05:47:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.872+0000 7fa16b701640 1 -- start start 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1500051d0 0x7fa1641f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1640a84a0 0x7fa164070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1641f3a70 con 0x7fa16415d3b0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16415ba00 con 0x7fa1500051d0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.873+0000 7fa16b701640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1641f2f30 con 0x7fa1640a84a0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49720/0 (socket says 172.21.15.49:49720) 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 -- 172.21.15.49:0/2855412781 learned_addr learned my addr 172.21.15.49:0/2855412781 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa16949d640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1500051d0 0x7fa1641f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa169c9e640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1640a84a0 0x7fa164070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 -- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1640a84a0 msgr2=0x7fa164070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1640a84a0 0x7fa164070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 -- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1500051d0 msgr2=0x7fa1641f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1500051d0 0x7fa1641f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.874+0000 7fa168c9c640 1 -- 172.21.15.49:0/2855412781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1641f31d0 con 0x7fa16415d3b0 2023-12-19T05:47:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa168c9c640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa154011540 tx=0x7fa154011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154015930 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154015a90 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154015e20 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1641f34b0 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.875+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1640aa480 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.876+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16415b7f0 con 0x7fa16415d3b0 2023-12-19T05:47:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.877+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa15401d400 con 0x7fa16415d3b0 2023-12-19T05:47:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.879+0000 7fa159ffb640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 0x7fa14806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.879+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa154088da0 con 0x7fa16415d3b0 2023-12-19T05:47:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.879+0000 7fa16949d640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 0x7fa14806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.881+0000 7fa16949d640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 0x7fa14806c920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa160001050 tx=0x7fa160009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:47.883+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa154054690 con 0x7fa16415d3b0 2023-12-19T05:47:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.079+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa164061910 con 0x7fa16415d3b0 2023-12-19T05:47:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.081+0000 7fa159ffb640 1 -- 172.21.15.49:0/2855412781 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+12529 (secure 0 0 0) 0x7fa154057cb0 con 0x7fa16415d3b0 2023-12-19T05:47:48.083 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:48.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":152,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:45.579204+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/3042568277":"2023-12-20T05:47:42.336989+0000","172.21.15.49:6833/3042568277":"2023-12-20T05:47:42.336989+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.084+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 msgr2=0x7fa14806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.084+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 0x7fa14806c920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa160001050 tx=0x7fa160009040 comp rx=0 tx=0).stop 2023-12-19T05:47:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.084+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 msgr2=0x7fa1640a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.084+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa154011540 tx=0x7fa154011a00 comp rx=0 tx=0).stop 2023-12-19T05:47:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 shutdown_connections 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa14806a460 0x7fa14806c920 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1640a84a0 0x7fa164070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16415d3b0 0x7fa1640a9f40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 --2- 172.21.15.49:0/2855412781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1500051d0 0x7fa1641f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 >> 172.21.15.49:0/2855412781 conn(0x7fa1640cbb70 msgr2=0x7fa16413f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 shutdown_connections 2023-12-19T05:47:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.085+0000 7fa16b701640 1 -- 172.21.15.49:0/2855412781 wait complete. 2023-12-19T05:47:48.107 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:47:48.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:47:48.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.342+0000 7ff6f16f7640 1 Processor -- start 2023-12-19T05:47:48.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.343+0000 7ff6f16f7640 1 -- start start 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6f16f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6ec0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6f16f7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec161e70 con 0x7ff6ec06fc40 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6f16f7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec161260 con 0x7ff6ec146ff0 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6f16f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec161080 con 0x7ff6ec0b6430 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6ea7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff6ec06fc40 0x7ff6ec15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51776/0 (socket says 172.21.15.49:51776) 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.344+0000 7ff6ea7fc640 1 -- 172.21.15.49:0/4244151889 learned_addr learned my addr 172.21.15.49:0/4244151889 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6ec0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147855416 0 0) 0x7ff6ec161e70 con 0x7ff6ec06fc40 2023-12-19T05:47:48.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d8003520 con 0x7ff6ec06fc40 2023-12-19T05:47:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 611167005 0 0) 0x7ff6d8003520 con 0x7ff6ec06fc40 2023-12-19T05:47:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 msgr2=0x7ff6ec0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6ec0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 >> v1:172.21.15.115:6789/0 conn(0x7ff6ec146ff0 legacy=0x7ff6ec06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec161540 con 0x7ff6ec06fc40 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff6d4001670 con 0x7ff6ec06fc40 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 >> v1:172.21.15.49:6789/0 conn(0x7ff6ec06fc40 legacy=0x7ff6ec15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d8003a10 0x7ff6d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec161080 con 0x7ff6d80047c0 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d800bab0 con 0x7ff6d8003a10 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.345+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d800bc70 con 0x7ff6ec0b6430 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6eaffd640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d8003a10 0x7ff6d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 -- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 msgr2=0x7ff6d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec0b6430 0x7ff6d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 -- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d8003a10 msgr2=0x7ff6d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d8003a10 0x7ff6d8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.346+0000 7ff6ea7fc640 1 -- 172.21.15.49:0/4244151889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8003520 con 0x7ff6d80047c0 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c210 tx=0x7ff6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f702ea2de4c3c33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4005ad0 con 0x7ff6d80047c0 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4005c30 con 0x7ff6d80047c0 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6e9ffb640 1 -- 172.21.15.49:0/4244151889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d402c890 con 0x7ff6d80047c0 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6f16f7640 1 -- 172.21.15.49:0/4244151889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d80047c0 msgr2=0x7ff6d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/4244151889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c210 tx=0x7ff6d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.348+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/4244151889 reap_dead start 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.349+0000 7ff6f16f7640 1 -- 172.21.15.49:0/4244151889 shutdown_connections 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.349+0000 7ff6f16f7640 1 -- 172.21.15.49:0/4244151889 >> 172.21.15.49:0/4244151889 conn(0x7ff6ec0d3520 msgr2=0x7ff6ec0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.349+0000 7ff6f16f7640 1 -- 172.21.15.49:0/4244151889 shutdown_connections 2023-12-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.349+0000 7ff6f16f7640 1 -- 172.21.15.49:0/4244151889 wait complete. 2023-12-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.351+0000 7ff6f16f7640 1 Processor -- start 2023-12-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.351+0000 7ff6f16f7640 1 -- start start 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d80047c0 0x7ff6ec1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 0x7ff6ec136d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1f2ae0 con 0x7ff6ec135070 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec137880 con 0x7ff6d80047c0 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6f16f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec137b60 con 0x7ff6ec134bf0 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49736/0 (socket says 172.21.15.49:49736) 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2669894790 learned_addr learned my addr 172.21.15.49:0/2669894790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eaffd640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d80047c0 0x7ff6ec1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 0x7ff6ec136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 msgr2=0x7ff6ec136d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 0x7ff6ec136d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d80047c0 msgr2=0x7ff6ec1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d80047c0 0x7ff6ec1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.352+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2669894790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0cdcd0 con 0x7ff6ec135070 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6ea7fc640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 0x7ff6ec136d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b7b70 tx=0x7ff6e4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004500 con 0x7ff6ec135070 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e4003610 con 0x7ff6ec135070 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40039e0 con 0x7ff6ec135070 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec0cdfb0 con 0x7ff6ec135070 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.353+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec0cd8f0 con 0x7ff6ec135070 2023-12-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.355+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec0674e0 con 0x7ff6ec135070 2023-12-19T05:47:48.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.356+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6e4003b40 con 0x7ff6ec135070 2023-12-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.357+0000 7ff6e37fe640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.357+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6e4088700 con 0x7ff6ec135070 2023-12-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.357+0000 7ff6eaffd640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.358+0000 7ff6eaffd640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc007fd0 tx=0x7ff6dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.361+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6e4054080 con 0x7ff6ec135070 2023-12-19T05:47:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.554+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6ec061910 con 0x7ff6ec135070 2023-12-19T05:47:48.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.555+0000 7ff6e37fe640 1 -- 172.21.15.49:0/2669894790 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6e40576a0 con 0x7ff6ec135070 2023-12-19T05:47:48.557 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:47:48.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 msgr2=0x7ff6cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc007fd0 tx=0x7ff6dc009040 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 msgr2=0x7ff6ec137250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b7b70 tx=0x7ff6e4011920 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 shutdown_connections 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec134bf0 0x7ff6ec136d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec135070 0x7ff6ec137250 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 --2- 172.21.15.49:0/2669894790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6d80047c0 0x7ff6ec1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.558+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 >> 172.21.15.49:0/2669894790 conn(0x7ff6ec0d3520 msgr2=0x7ff6ec1602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.559+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 shutdown_connections 2023-12-19T05:47:48.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.559+0000 7ff6f16f7640 1 -- 172.21.15.49:0/2669894790 wait complete. 2023-12-19T05:47:48.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-19T05:47:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.805+0000 7f74fa5ce640 1 Processor -- start 2023-12-19T05:47:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.805+0000 7f74fa5ce640 1 -- start start 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74fa5ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f415e5a0 0x7f74f40b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74fa5ce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74f415f680 0x7f74f40b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74fa5ce640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f415ec30 con 0x7f74f40cdbf0 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74fa5ce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f40b2cc0 con 0x7f74f415f680 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74fa5ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f415e980 con 0x7f74f415e5a0 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74f8dcb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74f415f680 0x7f74f40b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74f8dcb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74f415f680 0x7f74f40b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49748/0 (socket says 172.21.15.49:49748) 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.807+0000 7f74f8dcb640 1 -- 172.21.15.49:0/117760991 learned_addr learned my addr 172.21.15.49:0/117760991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.808+0000 7f74f95cc640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f415e5a0 0x7f74f40b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.808+0000 7f74f8dcb640 1 -- 172.21.15.49:0/117760991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f415e5a0 msgr2=0x7f74f40b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.808+0000 7f74f8dcb640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f415e5a0 0x7f74f40b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.808+0000 7f74f8dcb640 1 -- 172.21.15.49:0/117760991 >> v1:172.21.15.49:6789/0 conn(0x7f74f40cdbf0 legacy=0x7f74f406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.808+0000 7f74f8dcb640 1 -- 172.21.15.49:0/117760991 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40b2f90 con 0x7f74f415f680 2023-12-19T05:47:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.809+0000 7f74f8dcb640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f40b2780 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba658e4bd955ccf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74ebfff640 1 -- 172.21.15.49:0/117760991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4030840 con 0x7f74f415f680 2023-12-19T05:47:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74ebfff640 1 -- 172.21.15.49:0/117760991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e40309a0 con 0x7f74f415f680 2023-12-19T05:47:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74ebfff640 1 -- 172.21.15.49:0/117760991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4030d30 con 0x7f74f415f680 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 -- 172.21.15.49:0/117760991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 msgr2=0x7f74f40b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f40b2780 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402b980 comp rx=0 tx=0).stop 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 -- 172.21.15.49:0/117760991 shutdown_connections 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f40b2780 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/117760991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f415e5a0 0x7f74f40b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 -- 172.21.15.49:0/117760991 >> 172.21.15.49:0/117760991 conn(0x7f74f40b0100 msgr2=0x7f74f40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 -- 172.21.15.49:0/117760991 shutdown_connections 2023-12-19T05:47:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.810+0000 7f74fa5ce640 1 -- 172.21.15.49:0/117760991 wait complete. 2023-12-19T05:47:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.812+0000 7f74fa5ce640 1 Processor -- start 2023-12-19T05:47:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.812+0000 7f74fa5ce640 1 -- start start 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f40cdbf0 0x7f74f4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 0x7f74f41f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41f2aa0 con 0x7f74f415f680 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41f6520 con 0x7f74f415e5a0 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.813+0000 7f74fa5ce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41f6800 con 0x7f74f40cdbf0 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49754/0 (socket says 172.21.15.49:49754) 2023-12-19T05:47:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 -- 172.21.15.49:0/1554117212 learned_addr learned my addr 172.21.15.49:0/1554117212 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f8dcb640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 0x7f74f41f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f95cc640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f40cdbf0 0x7f74f4151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 -- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f40cdbf0 msgr2=0x7f74f4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f40cdbf0 0x7f74f4151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 -- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 msgr2=0x7f74f41f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 0x7f74f41f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f9dcd640 1 -- 172.21.15.49:0/1554117212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40094d0 con 0x7f74f415f680 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.814+0000 7f74f8dcb640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 0x7f74f41f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74f9dcd640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c7a0 tx=0x7f74ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec003b70 con 0x7f74f415f680 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec003cf0 con 0x7f74f415f680 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f41f6ae0 con 0x7f74f415f680 2023-12-19T05:47:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec003ea0 con 0x7f74f415f680 2023-12-19T05:47:48.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.815+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f41f6dc0 con 0x7f74f415f680 2023-12-19T05:47:48.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.816+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f415f140 con 0x7f74f415f680 2023-12-19T05:47:48.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.817+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74ec00aa90 con 0x7f74f415f680 2023-12-19T05:47:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.819+0000 7f74e9ffb640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 0x7f74d806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.819+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f74ec088320 con 0x7f74f415f680 2023-12-19T05:47:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.819+0000 7f74f95cc640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 0x7f74d806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:48.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.821+0000 7f74f95cc640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 0x7f74d806c970 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:48.823+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74f415f140 con 0x7f74f415f680 2023-12-19T05:47:49.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.091+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f74f415f140 con 0x7f74f415f680 2023-12-19T05:47:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.617+0000 7f74e9ffb640 1 -- 172.21.15.49:0/1554117212 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v455) v1 ==== 135+0+0 (secure 0 0 0) 0x7f74f415f140 con 0x7f74f415f680 2023-12-19T05:47:49.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.621+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 msgr2=0x7f74d806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.621+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 0x7f74d806c970 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0008040 comp rx=0 tx=0).stop 2023-12-19T05:47:49.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.621+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 msgr2=0x7f74f41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.621+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c7a0 tx=0x7f74ec00cc60 comp rx=0 tx=0).stop 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 shutdown_connections 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74d806a4b0 0x7f74d806c970 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74f415f680 0x7f74f41530c0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f415e5a0 0x7f74f41f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 --2- 172.21.15.49:0/1554117212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74f40cdbf0 0x7f74f4151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 >> 172.21.15.49:0/1554117212 conn(0x7f74f40b0100 msgr2=0x7f74f406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 shutdown_connections 2023-12-19T05:47:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.622+0000 7f74fa5ce640 1 -- 172.21.15.49:0/1554117212 wait complete. 2023-12-19T05:47:49.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:47:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.883+0000 7feacb6ab640 1 Processor -- start 2023-12-19T05:47:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.883+0000 7feacb6ab640 1 -- start start 2023-12-19T05:47:49.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feacb6ab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feac40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feacb6ab640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac4161e70 con 0x7feac4146ff0 2023-12-19T05:47:49.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feacb6ab640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac4161260 con 0x7feac406fc40 2023-12-19T05:47:49.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feacb6ab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac4161080 con 0x7feac40b6430 2023-12-19T05:47:49.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feac9447640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feac4146ff0 0x7feac406f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51794/0 (socket says 172.21.15.49:51794) 2023-12-19T05:47:49.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.885+0000 7feac9447640 1 -- 172.21.15.49:0/1921031365 learned_addr learned my addr 172.21.15.49:0/1921031365 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feac9c48640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feac40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665862524 0 0) 0x7feac4161e70 con 0x7feac4146ff0 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab0003520 con 0x7feac4146ff0 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542891547 0 0) 0x7feab0003520 con 0x7feac4146ff0 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 msgr2=0x7feac40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feac40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 >> v1:172.21.15.115:6789/0 conn(0x7feac406fc40 legacy=0x7feac415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4161540 con 0x7feac4146ff0 2023-12-19T05:47:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7feac0001670 con 0x7feac4146ff0 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 >> v1:172.21.15.49:6789/0 conn(0x7feac4146ff0 legacy=0x7feac406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feab0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feab0003fe0 0x7feab00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feab0004d00 0x7feab0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4161080 con 0x7feab0004d00 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab000bb40 con 0x7feab0003fe0 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.886+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab000bd00 con 0x7feac40b6430 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feab0004d00 0x7feab0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9447640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feab0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac8c46640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feab0003fe0 0x7feab00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 -- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 msgr2=0x7feab0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feac40b6430 0x7feab0003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 -- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feab0003fe0 msgr2=0x7feab00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feab0003fe0 0x7feab00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.887+0000 7feac9c48640 1 -- 172.21.15.49:0/1921031365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0003520 con 0x7feab0004d00 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.888+0000 7feac9c48640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feab0004d00 0x7feab0005180 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feab00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56be516ff6b139f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc02cc20 con 0x7feab0004d00 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc00f040 con 0x7feab0004d00 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feabbfff640 1 -- 172.21.15.49:0/1921031365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc034440 con 0x7feab0004d00 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 -- 172.21.15.49:0/1921031365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feab0004d00 msgr2=0x7feab0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 --2- 172.21.15.49:0/1921031365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feab0004d00 0x7feab0005180 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feab00057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feac9c48640 1 -- 172.21.15.49:0/1921031365 reap_dead start 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 -- 172.21.15.49:0/1921031365 shutdown_connections 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 -- 172.21.15.49:0/1921031365 >> 172.21.15.49:0/1921031365 conn(0x7feac40d3520 msgr2=0x7feac40d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 -- 172.21.15.49:0/1921031365 shutdown_connections 2023-12-19T05:47:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.889+0000 7feacb6ab640 1 -- 172.21.15.49:0/1921031365 wait complete. 2023-12-19T05:47:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.891+0000 7feacb6ab640 1 Processor -- start 2023-12-19T05:47:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.891+0000 7feacb6ab640 1 -- start start 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feab0004d00 0x7feac4143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac415a030 0x7feac413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac413edd0 con 0x7feac413d690 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac413df90 con 0x7feac415a030 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.892+0000 7feacb6ab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac413e5c0 con 0x7feab0004d00 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49770/0 (socket says 172.21.15.49:49770) 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 -- 172.21.15.49:0/4121268018 learned_addr learned my addr 172.21.15.49:0/4121268018 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9447640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feab0004d00 0x7feac4143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac8c46640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac415a030 0x7feac413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 -- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feab0004d00 msgr2=0x7feac4143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feab0004d00 0x7feac4143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 -- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac415a030 msgr2=0x7feac413d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac415a030 0x7feac413d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.893+0000 7feac9c48640 1 -- 172.21.15.49:0/4121268018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac413e810 con 0x7feac413d690 2023-12-19T05:47:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feac9c48640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7feabc037040 tx=0x7feabc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc034d50 con 0x7feac413d690 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc003990 con 0x7feac413d690 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc003d40 con 0x7feac413d690 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac413eaf0 con 0x7feac413d690 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.894+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac4143b60 con 0x7feac413d690 2023-12-19T05:47:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.895+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac4061910 con 0x7feac413d690 2023-12-19T05:47:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.896+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feabc004030 con 0x7feac413d690 2023-12-19T05:47:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.897+0000 7feab9ffb640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 0x7feaa806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:49.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.897+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feabc0aa140 con 0x7feac413d690 2023-12-19T05:47:49.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.898+0000 7feac9447640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 0x7feaa806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.899+0000 7feac9447640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 0x7feaa806c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feac00059f0 tx=0x7feac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:49.902+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feabc075ad0 con 0x7feac413d690 2023-12-19T05:47:50.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.095+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feac40d43e0 con 0x7feac413d690 2023-12-19T05:47:50.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.102+0000 7feab9ffb640 1 -- 172.21.15.49:0/4121268018 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7feabc0790f0 con 0x7feac413d690 2023-12-19T05:47:50.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 msgr2=0x7feaa806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 0x7feaa806c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feac00059f0 tx=0x7feac0009040 comp rx=0 tx=0).stop 2023-12-19T05:47:50.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 msgr2=0x7feac415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7feabc037040 tx=0x7feabc009750 comp rx=0 tx=0).stop 2023-12-19T05:47:50.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 shutdown_connections 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feaa806a430 0x7feaa806c8f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac413d690 0x7feac415c180 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.105+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac415a030 0x7feac413d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.106+0000 7feacb6ab640 1 --2- 172.21.15.49:0/4121268018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feab0004d00 0x7feac4143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.106+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 >> 172.21.15.49:0/4121268018 conn(0x7feac40d3520 msgr2=0x7feac4145040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.106+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 shutdown_connections 2023-12-19T05:47:50.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.106+0000 7feacb6ab640 1 -- 172.21.15.49:0/4121268018 wait complete. 2023-12-19T05:47:50.126 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:47:50.126 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:47:50.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:47:50.371 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:47:50.372 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:50.372 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:50.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:47:50.436 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:50.437 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:50.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:47:50.495 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:47:50.496 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:50.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:47:50.560 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:47:50.560 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:47:50.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:47:50.619 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:47:50.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:47:50.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.858+0000 7f0b49929640 1 Processor -- start 2023-12-19T05:47:50.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.858+0000 7f0b49929640 1 -- start start 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49929640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b4415e5a0 0x7f0b440b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49929640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b440cdbf0 0x7f0b440ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49929640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4415ec30 con 0x7f0b4415f680 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49929640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b440ce560 con 0x7f0b440cdbf0 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49929640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4415e980 con 0x7f0b4415e5a0 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b49128640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b440cdbf0 0x7f0b440ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.860+0000 7f0b3bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0b4415f680 0x7f0b440b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51808/0 (socket says 172.21.15.49:51808) 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3906257261 learned_addr learned my addr 172.21.15.49:0/3906257261 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b48927640 1 --2- 172.21.15.49:0/3906257261 >> v2:172.21.15.115:3300/0 conn(0x7f0b4415e5a0 0x7f0b440b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b49128640 1 -- 172.21.15.49:0/3906257261 >> v2:172.21.15.115:3300/0 conn(0x7f0b4415e5a0 msgr2=0x7f0b440b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:50.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b49128640 1 --2- 172.21.15.49:0/3906257261 >> v2:172.21.15.115:3300/0 conn(0x7f0b4415e5a0 0x7f0b440b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b49128640 1 -- 172.21.15.49:0/3906257261 >> v1:172.21.15.49:6789/0 conn(0x7f0b4415f680 legacy=0x7f0b440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.861+0000 7f0b49128640 1 -- 172.21.15.49:0/3906257261 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440b2f90 con 0x7f0b440cdbf0 2023-12-19T05:47:50.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.862+0000 7f0b49128640 1 --2- 172.21.15.49:0/3906257261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b440cdbf0 0x7f0b440ce020 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0097a0 tx=0x7f0b3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e8a7e09b2ab931 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:50.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.862+0000 7f0b3b7fe640 1 -- 172.21.15.49:0/3906257261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c031830 con 0x7f0b440cdbf0 2023-12-19T05:47:50.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b3b7fe640 1 -- 172.21.15.49:0/3906257261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c031990 con 0x7f0b440cdbf0 2023-12-19T05:47:50.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b3b7fe640 1 -- 172.21.15.49:0/3906257261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c031d20 con 0x7f0b440cdbf0 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 -- 172.21.15.49:0/3906257261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b440cdbf0 msgr2=0x7f0b440ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 --2- 172.21.15.49:0/3906257261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b440cdbf0 0x7f0b440ce020 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0097a0 tx=0x7f0b3c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 -- 172.21.15.49:0/3906257261 shutdown_connections 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 --2- 172.21.15.49:0/3906257261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b440cdbf0 0x7f0b440ce020 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 --2- 172.21.15.49:0/3906257261 >> v2:172.21.15.115:3300/0 conn(0x7f0b4415e5a0 0x7f0b440b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 -- 172.21.15.49:0/3906257261 >> 172.21.15.49:0/3906257261 conn(0x7f0b440b0100 msgr2=0x7f0b440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 -- 172.21.15.49:0/3906257261 shutdown_connections 2023-12-19T05:47:50.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.863+0000 7f0b49929640 1 -- 172.21.15.49:0/3906257261 wait complete. 2023-12-19T05:47:50.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.865+0000 7f0b49929640 1 Processor -- start 2023-12-19T05:47:50.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.865+0000 7f0b49929640 1 -- start start 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.866+0000 7f0b49929640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b440cdbf0 0x7f0b441f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.866+0000 7f0b49929640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b49929640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4415f680 0x7f0b441f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b49929640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4414a5b0 con 0x7f0b4415e5a0 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b49929640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441f6580 con 0x7f0b440cdbf0 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b49929640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441f6820 con 0x7f0b4415f680 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49782/0 (socket says 172.21.15.49:49782) 2023-12-19T05:47:50.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1511307206 learned_addr learned my addr 172.21.15.49:0/1511307206 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b48927640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b440cdbf0 0x7f0b441f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b49128640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4415f680 0x7f0b441f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4415f680 msgr2=0x7f0b441f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4415f680 0x7f0b441f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b440cdbf0 msgr2=0x7f0b441f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b440cdbf0 0x7f0b441f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.867+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1511307206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c009400 con 0x7f0b4415e5a0 2023-12-19T05:47:50.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c4a0 tx=0x7f0b3400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34005ce0 con 0x7f0b4415e5a0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34005e40 con 0x7f0b4415e5a0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007270 con 0x7f0b4415e5a0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b441f6b00 con 0x7f0b4415e5a0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.868+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4414a7c0 con 0x7f0b4415e5a0 2023-12-19T05:47:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.869+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4414a9b0 con 0x7f0b4415e5a0 2023-12-19T05:47:50.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.870+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b34007490 con 0x7f0b4415e5a0 2023-12-19T05:47:50.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.871+0000 7f0b397fa640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 0x7f0b3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:50.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.871+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b34087b50 con 0x7f0b4415e5a0 2023-12-19T05:47:50.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.872+0000 7f0b48927640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 0x7f0b3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:50.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.873+0000 7f0b48927640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 0x7f0b3006c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009a60 tx=0x7f0b40003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:50.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:50.876+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0b34053450 con 0x7f0b4415e5a0 2023-12-19T05:47:51.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.109+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b44061910 con 0x7f0b4415e5a0 2023-12-19T05:47:51.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.110+0000 7f0b397fa640 1 -- 172.21.15.49:0/1511307206 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0b34017090 con 0x7f0b4415e5a0 2023-12-19T05:47:51.112 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:51.112 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1611880904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1611880904},{"type":"v1","addr":"172.21.15.49:6834","nonce":1611880904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6412,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3278069233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3278069233},{"type":"v1","addr":"172.21.15.115:6835","nonce":3278069233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3185307680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3185307680},{"type":"v1","addr":"172.21.15.115:6837","nonce":3185307680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8001,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1632130378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1632130378},{"type":"v1","addr":"172.21.15.49:6835","nonce":1632130378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[]} 2023-12-19T05:47:51.112 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 66 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.112+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 msgr2=0x7f0b3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.112+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 0x7f0b3006c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009a60 tx=0x7f0b40003990 comp rx=0 tx=0).stop 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.112+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 msgr2=0x7f0b4406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.112+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c4a0 tx=0x7f0b3400c960 comp rx=0 tx=0).stop 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 shutdown_connections 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0b3006a430 0x7f0b3006c8f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4415f680 0x7f0b441f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4415e5a0 0x7f0b4406c8d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 --2- 172.21.15.49:0/1511307206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b440cdbf0 0x7f0b441f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 >> 172.21.15.49:0/1511307206 conn(0x7f0b440b0100 msgr2=0x7f0b4406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:51.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 shutdown_connections 2023-12-19T05:47:51.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.113+0000 7f0b49929640 1 -- 172.21.15.49:0/1511307206 wait complete. 2023-12-19T05:47:51.135 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:47:51.135 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:47:51.135 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:47:51.135 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:47:51.135 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:47:51.135 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:47:51.136 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:47:51.136 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:47:51.136 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:47:51.136 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:47:51.136 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:47:51.136 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:47:51.136 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:47:51.137 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:47:51.137 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:47:51.137 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:47:51.155 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:47:51.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:47:51.157 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:47:51.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:47:51.158 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:47:51.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:47:51.160 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:47:51.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:47:51.206 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:47:51.206 DEBUG:teuthology.parallel:result is None 2023-12-19T05:47:51.208 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:47:51.208 DEBUG:teuthology.parallel:result is None 2023-12-19T05:47:51.213 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:47:51.213 DEBUG:teuthology.parallel:result is None 2023-12-19T05:47:51.215 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:47:51.215 DEBUG:teuthology.parallel:result is None 2023-12-19T05:47:51.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:47:51.373 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:47:51.373 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:47:51.378 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:47:51.379 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:47:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.421+0000 7f43d79ae640 1 Processor -- start 2023-12-19T05:47:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.421+0000 7f43d79ae640 1 -- start start 2023-12-19T05:47:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.422+0000 7f43d79ae640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f43d0157bf0 0x7f43d015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.422+0000 7f43d79ae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.422+0000 7f43d79ae640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00b0a90 con 0x7f43d00b0640 2023-12-19T05:47:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.422+0000 7f43d79ae640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d006b8c0 con 0x7f43d0157bf0 2023-12-19T05:47:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.422+0000 7f43d79ae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015b740 con 0x7f43d00ae110 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f43d0157bf0 0x7f43d015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d4f49640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f43d0157bf0 0x7f43d015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42860/0 (socket says 172.21.15.49:42860) 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 -- 172.21.15.49:0/4069167248 learned_addr learned my addr 172.21.15.49:0/4069167248 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d5f4b640 1 --1- 172.21.15.49:0/4069167248 >> v1:172.21.15.115:6789/0 conn(0x7f43d00b0640 0x7f43d015dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46242/0 (socket says 172.21.15.49:46242) 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 -- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 msgr2=0x7f43d00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 --2- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 -- 172.21.15.49:0/4069167248 >> v1:172.21.15.115:6789/0 conn(0x7f43d00b0640 legacy=0x7f43d015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.423+0000 7f43d574a640 1 -- 172.21.15.49:0/4069167248 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00ae640 con 0x7f43d0157bf0 2023-12-19T05:47:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d574a640 1 --2- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d0157bf0 0x7f43d015b200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009870 tx=0x7f43cc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e1ea8a9652bde0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43c7fff640 1 -- 172.21.15.49:0/4069167248 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc030840 con 0x7f43d0157bf0 2023-12-19T05:47:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43c7fff640 1 -- 172.21.15.49:0/4069167248 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0309a0 con 0x7f43d0157bf0 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43c7fff640 1 -- 172.21.15.49:0/4069167248 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc030d30 con 0x7f43d0157bf0 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 -- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d0157bf0 msgr2=0x7f43d015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 --2- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d0157bf0 0x7f43d015b200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009870 tx=0x7f43cc02b980 comp rx=0 tx=0).stop 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 -- 172.21.15.49:0/4069167248 shutdown_connections 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 --2- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 --2- 172.21.15.49:0/4069167248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d0157bf0 0x7f43d015b200 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.425+0000 7f43d79ae640 1 -- 172.21.15.49:0/4069167248 >> 172.21.15.49:0/4069167248 conn(0x7f43d00cbb70 msgr2=0x7f43d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.426+0000 7f43d79ae640 1 -- 172.21.15.49:0/4069167248 shutdown_connections 2023-12-19T05:47:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.426+0000 7f43d79ae640 1 -- 172.21.15.49:0/4069167248 wait complete. 2023-12-19T05:47:51.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.427+0000 7f43d79ae640 1 Processor -- start 2023-12-19T05:47:51.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.428+0000 7f43d79ae640 1 -- start start 2023-12-19T05:47:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43d0157bf0 0x7f43d01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01f6f20 con 0x7f43d0157bf0 2023-12-19T05:47:51.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015bd60 con 0x7f43d00b0640 2023-12-19T05:47:51.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d79ae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015c040 con 0x7f43d00ae110 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d4f49640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d4f49640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42874/0 (socket says 172.21.15.49:42874) 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d4f49640 1 -- 172.21.15.49:0/2502686836 learned_addr learned my addr 172.21.15.49:0/2502686836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.429+0000 7f43d574a640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d5f4b640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43d0157bf0 0x7f43d01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 -- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 msgr2=0x7f43d014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 -- 172.21.15.49:0/2502686836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43d0157bf0 msgr2=0x7f43d01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43d0157bf0 0x7f43d01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 -- 172.21.15.49:0/2502686836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0094d0 con 0x7f43d00b0640 2023-12-19T05:47:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.430+0000 7f43d4f49640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e9b0 tx=0x7f43c000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.431+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0009670 con 0x7f43d00b0640 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.431+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000c9a0 con 0x7f43d00b0640 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.431+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d015c320 con 0x7f43d00b0640 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.431+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000cd30 con 0x7f43d00b0640 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.431+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d015d110 con 0x7f43d00b0640 2023-12-19T05:47:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.432+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d015c840 con 0x7f43d00b0640 2023-12-19T05:47:51.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.433+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43c0005990 con 0x7f43d00b0640 2023-12-19T05:47:51.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.434+0000 7f43c5ffb640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:51.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.434+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43c00887c0 con 0x7f43d00b0640 2023-12-19T05:47:51.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.435+0000 7f43d574a640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:51.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.436+0000 7f43d574a640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 0x7f43b406c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43cc036000 tx=0x7f43cc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:51.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.438+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43c00542d0 con 0x7f43d00b0640 2023-12-19T05:47:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:51.649+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f43d015c840 con 0x7f43d00b0640 2023-12-19T05:47:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.657+0000 7f43c5ffb640 1 -- 172.21.15.49:0/2502686836 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v157) v1 ==== 97+0+0 (secure 0 0 0) 0x7f43d015c840 con 0x7f43d00b0640 2023-12-19T05:47:52.658 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 msgr2=0x7f43b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 0x7f43b406c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43cc036000 tx=0x7f43cc008030 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 msgr2=0x7f43d01f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e9b0 tx=0x7f43c000ee70 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 shutdown_connections 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43d0157bf0 0x7f43d01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43d00b0640 0x7f43d01f69e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 --2- 172.21.15.49:0/2502686836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43d00ae110 0x7f43d014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 >> 172.21.15.49:0/2502686836 conn(0x7f43d00cbb70 msgr2=0x7f43d00ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 shutdown_connections 2023-12-19T05:47:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.660+0000 7f43d79ae640 1 -- 172.21.15.49:0/2502686836 wait complete. 2023-12-19T05:47:52.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:47:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.914+0000 7f9887984640 1 Processor -- start 2023-12-19T05:47:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.915+0000 7f9887984640 1 -- start start 2023-12-19T05:47:52.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.916+0000 7f9887984640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9880146e10 0x7f98800d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.916+0000 7f9887984640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98800ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.916+0000 7f9887984640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800cd840 con 0x7f98800d2b00 2023-12-19T05:47:52.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.916+0000 7f9887984640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800d2430 con 0x7f9880146e10 2023-12-19T05:47:52.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.916+0000 7f9887984640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800ceac0 con 0x7f98800ce110 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.917+0000 7f9885f21640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98800ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.917+0000 7f9884f1f640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f98800d2b00 0x7f98800b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46246/0 (socket says 172.21.15.49:46246) 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.917+0000 7f9884f1f640 1 -- 172.21.15.49:0/1744125715 learned_addr learned my addr 172.21.15.49:0/1744125715 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.917+0000 7f9885720640 1 --2- 172.21.15.49:0/1744125715 >> v2:172.21.15.115:3300/0 conn(0x7f9880146e10 0x7f98800d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.918+0000 7f9885720640 1 -- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 msgr2=0x7f98800ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.918+0000 7f9885720640 1 --2- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98800ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.918+0000 7f9885720640 1 -- 172.21.15.49:0/1744125715 >> v1:172.21.15.115:6789/0 conn(0x7f98800d2b00 legacy=0x7f98800b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.918+0000 7f9885720640 1 -- 172.21.15.49:0/1744125715 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800b6e90 con 0x7f9880146e10 2023-12-19T05:47:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.919+0000 7f9885720640 1 --2- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f98800d1ef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f987c0097d0 tx=0x7f987c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb71d3f86e634363 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:52.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.920+0000 7f9877fff640 1 -- 172.21.15.49:0/1744125715 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c02d040 con 0x7f9880146e10 2023-12-19T05:47:52.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.920+0000 7f9877fff640 1 -- 172.21.15.49:0/1744125715 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c031810 con 0x7f9880146e10 2023-12-19T05:47:52.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.920+0000 7f9877fff640 1 -- 172.21.15.49:0/1744125715 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c031ba0 con 0x7f9880146e10 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.920+0000 7f9887984640 1 -- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 msgr2=0x7f98800d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.920+0000 7f9887984640 1 --2- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f98800d1ef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f987c0097d0 tx=0x7f987c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 -- 172.21.15.49:0/1744125715 shutdown_connections 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 --2- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98800ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 --2- 172.21.15.49:0/1744125715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f98800d1ef0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 -- 172.21.15.49:0/1744125715 >> 172.21.15.49:0/1744125715 conn(0x7f98800b29c0 msgr2=0x7f98800b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:52.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 -- 172.21.15.49:0/1744125715 shutdown_connections 2023-12-19T05:47:52.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.921+0000 7f9887984640 1 -- 172.21.15.49:0/1744125715 wait complete. 2023-12-19T05:47:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.923+0000 7f9887984640 1 Processor -- start 2023-12-19T05:47:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.923+0000 7f9887984640 1 -- start start 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.924+0000 7f9887984640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98801f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.924+0000 7f9887984640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.924+0000 7f9887984640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f9880146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9887984640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98801f5f30 con 0x7f98800d2b00 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9887984640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988015fb70 con 0x7f9880146e10 2023-12-19T05:47:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9887984640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988015fe50 con 0x7f98800ce110 2023-12-19T05:47:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49810/0 (socket says 172.21.15.49:49810) 2023-12-19T05:47:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 -- 172.21.15.49:0/2786544215 learned_addr learned my addr 172.21.15.49:0/2786544215 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9885720640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98801f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9885f21640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f9880146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 -- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 msgr2=0x7f98801f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98801f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 -- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 msgr2=0x7f9880146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f9880146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.925+0000 7f9884f1f640 1 -- 172.21.15.49:0/2786544215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c009400 con 0x7f98800d2b00 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9884f1f640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f987000c4a0 tx=0x7f987000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870005ce0 con 0x7f98800d2b00 2023-12-19T05:47:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870005e40 con 0x7f98800d2b00 2023-12-19T05:47:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870007270 con 0x7f98800d2b00 2023-12-19T05:47:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9880160130 con 0x7f98800d2b00 2023-12-19T05:47:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.926+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98801606f0 con 0x7f98800d2b00 2023-12-19T05:47:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.928+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98801f2b30 con 0x7f98800d2b00 2023-12-19T05:47:52.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.929+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98700073d0 con 0x7f98800d2b00 2023-12-19T05:47:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.929+0000 7f9875ffb640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.930+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9870087af0 con 0x7f98800d2b00 2023-12-19T05:47:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.930+0000 7f9885720640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.932+0000 7f9885720640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 0x7f986406c920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f987c036000 tx=0x7f987c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:52.934+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9870053440 con 0x7f98800d2b00 2023-12-19T05:47:53.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.197+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f98800d4270 con 0x7f98800d2b00 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.198+0000 7f9875ffb640 1 -- 172.21.15.49:0/2786544215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9870017090 con 0x7f98800d2b00 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:47:53.200 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:47:53.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.204 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.205 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:47:53.205 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:47:53.205 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.206 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:47:53.207 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:47:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:47:53.210 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:47:53.211 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:47:53.214 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 msgr2=0x7f986406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 0x7f986406c920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f987c036000 tx=0x7f987c03c040 comp rx=0 tx=0).stop 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 msgr2=0x7f9880145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f987000c4a0 tx=0x7f987000c960 comp rx=0 tx=0).stop 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 shutdown_connections 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9880146e10 0x7f9880146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98800d2b00 0x7f9880145c40 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 --2- 172.21.15.49:0/2786544215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98800ce110 0x7f98801f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 >> 172.21.15.49:0/2786544215 conn(0x7f98800b29c0 msgr2=0x7f98800b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:53.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 shutdown_connections 2023-12-19T05:47:53.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.201+0000 7f9887984640 1 -- 172.21.15.49:0/2786544215 wait complete. 2023-12-19T05:47:53.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:53.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.457+0000 7f8486e3e640 1 Processor -- start 2023-12-19T05:47:53.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.457+0000 7f8486e3e640 1 -- start start 2023-12-19T05:47:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8486e3e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84800b0b50 0x7f848006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8486e3e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f848006b590 0x7f848006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8486e3e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848006bb30 con 0x7f84801449e0 2023-12-19T05:47:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8486e3e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800b0070 con 0x7f84800b0b50 2023-12-19T05:47:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8486e3e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800b0350 con 0x7f848006b590 2023-12-19T05:47:53.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8484bda640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84801449e0 0x7f84800af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51824/0 (socket says 172.21.15.49:51824) 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f8484bda640 1 -- 172.21.15.49:0/564828180 learned_addr learned my addr 172.21.15.49:0/564828180 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.460+0000 7f847ffff640 1 --2- 172.21.15.49:0/564828180 >> v2:172.21.15.115:3300/0 conn(0x7f84800b0b50 0x7f848006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f84853db640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f848006b590 0x7f848006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847f7fe640 1 -- 172.21.15.49:0/564828180 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093666961 0 0) 0x7f848006bb30 con 0x7f84801449e0 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847f7fe640 1 -- 172.21.15.49:0/564828180 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470003520 con 0x7f84801449e0 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847ffff640 1 -- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f848006b590 msgr2=0x7f848006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847ffff640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f848006b590 0x7f848006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847ffff640 1 -- 172.21.15.49:0/564828180 >> v1:172.21.15.49:6789/0 conn(0x7f84801449e0 legacy=0x7f84800af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.461+0000 7f847ffff640 1 -- 172.21.15.49:0/564828180 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800b0630 con 0x7f84800b0b50 2023-12-19T05:47:53.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.463+0000 7f847ffff640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84800b0b50 0x7f848006bfa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097a0 tx=0x7f846c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8622f1d627dcbefe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.463+0000 7f847f7fe640 1 -- 172.21.15.49:0/564828180 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c02d040 con 0x7f84800b0b50 2023-12-19T05:47:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.463+0000 7f847f7fe640 1 -- 172.21.15.49:0/564828180 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c031810 con 0x7f84800b0b50 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.463+0000 7f847f7fe640 1 -- 172.21.15.49:0/564828180 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c031ba0 con 0x7f84800b0b50 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 -- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84800b0b50 msgr2=0x7f848006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84800b0b50 0x7f848006bfa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097a0 tx=0x7f846c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 -- 172.21.15.49:0/564828180 shutdown_connections 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f848006b590 0x7f848006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 --2- 172.21.15.49:0/564828180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84800b0b50 0x7f848006bfa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 -- 172.21.15.49:0/564828180 >> 172.21.15.49:0/564828180 conn(0x7f84800cbb70 msgr2=0x7f84800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 -- 172.21.15.49:0/564828180 shutdown_connections 2023-12-19T05:47:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.464+0000 7f8486e3e640 1 -- 172.21.15.49:0/564828180 wait complete. 2023-12-19T05:47:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.466+0000 7f8486e3e640 1 Processor -- start 2023-12-19T05:47:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.466+0000 7f8486e3e640 1 -- start start 2023-12-19T05:47:53.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 0x7f848013a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 0x7f848013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480141bd0 con 0x7f848006b590 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480141050 con 0x7f84801449e0 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8486e3e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8480141330 con 0x7f84800b0b50 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8484bda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8484bda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49816/0 (socket says 172.21.15.49:49816) 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.467+0000 7f8484bda640 1 -- 172.21.15.49:0/2910398085 learned_addr learned my addr 172.21.15.49:0/2910398085 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f847ffff640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 0x7f848013a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f84853db640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 0x7f848013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 -- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 msgr2=0x7f848013a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 0x7f848013a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 -- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 msgr2=0x7f848013ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 0x7f848013ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 -- 172.21.15.49:0/2910398085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009400 con 0x7f848006b590 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f847ffff640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 0x7f848013a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:53.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f84853db640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 0x7f848013ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.468+0000 7f8484bda640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f847400c410 tx=0x7f847400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.469+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474005ce0 con 0x7f848006b590 2023-12-19T05:47:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.469+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8474005e40 con 0x7f848006b590 2023-12-19T05:47:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.469+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84740072f0 con 0x7f848006b590 2023-12-19T05:47:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.469+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8480141610 con 0x7f848006b590 2023-12-19T05:47:53.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.469+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480140cf0 con 0x7f848006b590 2023-12-19T05:47:53.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.470+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8480061910 con 0x7f848006b590 2023-12-19T05:47:53.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.471+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8474007510 con 0x7f848006b590 2023-12-19T05:47:53.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.472+0000 7f847d7fa640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 0x7f846406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.472+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8474087ba0 con 0x7f848006b590 2023-12-19T05:47:53.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.473+0000 7f847ffff640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 0x7f846406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.474+0000 7f847ffff640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 0x7f846406c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f846c036000 tx=0x7f846c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.476+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8474053630 con 0x7f848006b590 2023-12-19T05:47:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.671+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f848015c8d0 con 0x7f848006b590 2023-12-19T05:47:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.672+0000 7f847d7fa640 1 -- 172.21.15.49:0/2910398085 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+12400 (secure 0 0 0) 0x7f847405be60 con 0x7f848006b590 2023-12-19T05:47:53.674 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:53.674 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:52.632127+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 msgr2=0x7f846406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 0x7f846406c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f846c036000 tx=0x7f846c03c040 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 msgr2=0x7f848013d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f847400c410 tx=0x7f847400c8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 shutdown_connections 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f846406a430 0x7f846406c8f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84800b0b50 0x7f848013a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84801449e0 0x7f848013ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 --2- 172.21.15.49:0/2910398085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f848006b590 0x7f848013d940 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 >> 172.21.15.49:0/2910398085 conn(0x7f84800cbb70 msgr2=0x7f848006bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:53.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 shutdown_connections 2023-12-19T05:47:53.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.675+0000 7f8486e3e640 1 -- 172.21.15.49:0/2910398085 wait complete. 2023-12-19T05:47:53.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:47:53.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:47:53.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.932+0000 7f425d515640 1 Processor -- start 2023-12-19T05:47:53.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.932+0000 7f425d515640 1 -- start start 2023-12-19T05:47:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.934+0000 7f425d515640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4258146cd0 0x7f42580b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.934+0000 7f425d515640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f425806fba0 0x7f42580d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.934+0000 7f425d515640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4258070260 con 0x7f42580b6890 2023-12-19T05:47:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.934+0000 7f425d515640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42581470b0 con 0x7f425806fba0 2023-12-19T05:47:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.934+0000 7f425d515640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580b6ea0 con 0x7f4258146cd0 2023-12-19T05:47:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f425806fba0 0x7f42580d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f425806fba0 0x7f42580d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49820/0 (socket says 172.21.15.49:49820) 2023-12-19T05:47:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 -- 172.21.15.49:0/1955107026 learned_addr learned my addr 172.21.15.49:0/1955107026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 -- 172.21.15.49:0/1955107026 >> v2:172.21.15.115:3300/0 conn(0x7f4258146cd0 msgr2=0x7f42580b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 --2- 172.21.15.49:0/1955107026 >> v2:172.21.15.115:3300/0 conn(0x7f4258146cd0 0x7f42580b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 -- 172.21.15.49:0/1955107026 >> v1:172.21.15.115:6789/0 conn(0x7f42580b6890 legacy=0x7f425806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.935+0000 7f425cd14640 1 -- 172.21.15.49:0/1955107026 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580b7180 con 0x7f425806fba0 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.936+0000 7f425cd14640 1 --2- 172.21.15.49:0/1955107026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425806fba0 0x7f42580d1670 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f425806f0b0 tx=0x7f425002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35752c1ee9735818 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.937+0000 7f4256ffd640 1 -- 172.21.15.49:0/1955107026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425002c9f0 con 0x7f425806fba0 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.937+0000 7f4256ffd640 1 -- 172.21.15.49:0/1955107026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425002cb50 con 0x7f425806fba0 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.937+0000 7f4256ffd640 1 -- 172.21.15.49:0/1955107026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500343f0 con 0x7f425806fba0 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.937+0000 7f425d515640 1 -- 172.21.15.49:0/1955107026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425806fba0 msgr2=0x7f42580d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 --2- 172.21.15.49:0/1955107026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425806fba0 0x7f42580d1670 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f425806f0b0 tx=0x7f425002be50 comp rx=0 tx=0).stop 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 -- 172.21.15.49:0/1955107026 shutdown_connections 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 --2- 172.21.15.49:0/1955107026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425806fba0 0x7f42580d1670 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 --2- 172.21.15.49:0/1955107026 >> v2:172.21.15.115:3300/0 conn(0x7f4258146cd0 0x7f42580b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 -- 172.21.15.49:0/1955107026 >> 172.21.15.49:0/1955107026 conn(0x7f42580d3200 msgr2=0x7f42580d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 -- 172.21.15.49:0/1955107026 shutdown_connections 2023-12-19T05:47:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.938+0000 7f425d515640 1 -- 172.21.15.49:0/1955107026 wait complete. 2023-12-19T05:47:53.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.940+0000 7f425d515640 1 Processor -- start 2023-12-19T05:47:53.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.940+0000 7f425d515640 1 -- start start 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425806fba0 0x7f42580d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4258146cd0 0x7f42581567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42581f73a0 con 0x7f42580b6890 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42581f3f80 con 0x7f4258146cd0 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f425d515640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42581f6de0 con 0x7f425806fba0 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f42577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f42577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49824/0 (socket says 172.21.15.49:49824) 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.941+0000 7f42577fe640 1 -- 172.21.15.49:0/1707877774 learned_addr learned my addr 172.21.15.49:0/1707877774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 -- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425806fba0 msgr2=0x7f42580d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f4257fff640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425806fba0 0x7f42580d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f425cd14640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4258146cd0 0x7f42581567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425806fba0 0x7f42580d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 -- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4258146cd0 msgr2=0x7f42581567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4258146cd0 0x7f42581567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 -- 172.21.15.49:0/1707877774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009b30 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f42577fe640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c410 tx=0x7f424c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0035f0 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c003750 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c003b40 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.942+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581f70c0 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.943+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425813f160 con 0x7f42580b6890 2023-12-19T05:47:53.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.944+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425813f320 con 0x7f42580b6890 2023-12-19T05:47:53.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.945+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f424c003ca0 con 0x7f42580b6890 2023-12-19T05:47:53.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.945+0000 7f4254ff9640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 0x7f424406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:53.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.946+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f424c0878b0 con 0x7f42580b6890 2023-12-19T05:47:53.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.946+0000 7f4257fff640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 0x7f424406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:53.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.947+0000 7f4257fff640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 0x7f424406c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f424800a810 tx=0x7f4248008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:53.950+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f424c053150 con 0x7f42580b6890 2023-12-19T05:47:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.142+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f425813ece0 con 0x7f42580b6890 2023-12-19T05:47:54.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.143+0000 7f4254ff9640 1 -- 172.21.15.49:0/1707877774 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7f425813ece0 con 0x7f42580b6890 2023-12-19T05:47:54.145 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 msgr2=0x7f424406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 0x7f424406c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f424800a810 tx=0x7f4248008040 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 msgr2=0x7f42581f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c410 tx=0x7f424c00c8d0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 shutdown_connections 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f424406a430 0x7f424406c8f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4258146cd0 0x7f42581567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42580b6890 0x7f42581f63b0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 --2- 172.21.15.49:0/1707877774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f425806fba0 0x7f42580d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.146+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 >> 172.21.15.49:0/1707877774 conn(0x7f42580d3200 msgr2=0x7f425815ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.147+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 shutdown_connections 2023-12-19T05:47:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.147+0000 7f425d515640 1 -- 172.21.15.49:0/1707877774 wait complete. 2023-12-19T05:47:54.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:47:54.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.401+0000 7f504dea8640 1 Processor -- start 2023-12-19T05:47:54.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.402+0000 7f504dea8640 1 -- start start 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.403+0000 7f504dea8640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f50480b0a40 0x7f504816c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.403+0000 7f504dea8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480ae7c0 con 0x7f5048161670 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.403+0000 7f504dea8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5048161d80 con 0x7f50480cc210 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.403+0000 7f504dea8640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480ceba0 con 0x7f50480b0a40 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.404+0000 7f504cea6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5048161670 0x7f50480b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52722/0 (socket says 172.21.15.49:52722) 2023-12-19T05:47:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.404+0000 7f504cea6640 1 -- 172.21.15.49:0/1558396777 learned_addr learned my addr 172.21.15.49:0/1558396777 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.404+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735144538 0 0) 0x7f50480ae7c0 con 0x7f5048161670 2023-12-19T05:47:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.404+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5030003520 con 0x7f5048161670 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.404+0000 7f504d6a7640 1 --2- 172.21.15.49:0/1558396777 >> v2:172.21.15.115:3300/0 conn(0x7f50480b0a40 0x7f504816c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949268769 0 0) 0x7f5030003520 con 0x7f5048161670 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 >> v2:172.21.15.115:3300/0 conn(0x7f50480b0a40 msgr2=0x7f504816c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 --2- 172.21.15.49:0/1558396777 >> v2:172.21.15.115:3300/0 conn(0x7f50480b0a40 0x7f504816c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 >> v1:172.21.15.115:6789/0 conn(0x7f50480cc210 legacy=0x7f50480b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048162060 con 0x7f5048161670 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f503c001670 con 0x7f5048161670 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 >> v1:172.21.15.49:6789/0 conn(0x7f5048161670 legacy=0x7f50480b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 0x7f5030003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50300047c0 0x7f5030004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300051d0 0x7f503000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ceba0 con 0x7f50300039c0 2023-12-19T05:47:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503000c120 con 0x7f50300051d0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503000c2e0 con 0x7f50300047c0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.405+0000 7f504cea6640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 0x7f5030003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f5047fff640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50300047c0 0x7f5030004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504d6a7640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300051d0 0x7f503000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504cea6640 1 -- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50300047c0 msgr2=0x7f5030004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504cea6640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50300047c0 0x7f5030004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504cea6640 1 -- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300051d0 msgr2=0x7f503000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504cea6640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300051d0 0x7f503000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504cea6640 1 -- 172.21.15.49:0/1558396777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030003520 con 0x7f50300039c0 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f5047fff640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50300047c0 0x7f5030004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504d6a7640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300051d0 0x7f503000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.406+0000 7f504d6a7640 1 -- 172.21.15.49:0/1558396777 reap_dead start 2023-12-19T05:47:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.407+0000 7f504cea6640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 0x7f5030003de0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c0e0 tx=0x7f50300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5214161601491ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.407+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c005ad0 con 0x7f50300039c0 2023-12-19T05:47:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.407+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c005c30 con 0x7f50300039c0 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.407+0000 7f50477fe640 1 -- 172.21.15.49:0/1558396777 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c02ca50 con 0x7f50300039c0 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 -- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 msgr2=0x7f5030003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 0x7f5030003de0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c0e0 tx=0x7f50300057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 -- 172.21.15.49:0/1558396777 shutdown_connections 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 --2- 172.21.15.49:0/1558396777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50300039c0 0x7f5030003de0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 -- 172.21.15.49:0/1558396777 >> 172.21.15.49:0/1558396777 conn(0x7f50480659a0 msgr2=0x7f5048065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 -- 172.21.15.49:0/1558396777 shutdown_connections 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.408+0000 7f504dea8640 1 -- 172.21.15.49:0/1558396777 wait complete. 2023-12-19T05:47:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.410+0000 7f504dea8640 1 Processor -- start 2023-12-19T05:47:54.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.410+0000 7f504dea8640 1 -- start start 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300039c0 0x7f50480aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f504806d750 0x7f5048151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048152610 con 0x7f504806dbb0 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480a9870 con 0x7f50300039c0 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504dea8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480a87d0 con 0x7f504806d750 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504d6a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504d6a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50494/0 (socket says 172.21.15.49:50494) 2023-12-19T05:47:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.411+0000 7f504d6a7640 1 -- 172.21.15.49:0/556529879 learned_addr learned my addr 172.21.15.49:0/556529879 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:54.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f5047fff640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f504806d750 0x7f5048151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504cea6640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300039c0 0x7f50480aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 -- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f504806d750 msgr2=0x7f5048151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f504806d750 0x7f5048151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 -- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300039c0 msgr2=0x7f50480aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300039c0 0x7f50480aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 -- 172.21.15.49:0/556529879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480a8ab0 con 0x7f504806dbb0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.412+0000 7f504d6a7640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f50480cc6c0 tx=0x7f5040009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.413+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040007d20 con 0x7f504806dbb0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.413+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040014400 con 0x7f504806dbb0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.413+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040007ea0 con 0x7f504806dbb0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.413+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480a8d90 con 0x7f504806dbb0 2023-12-19T05:47:54.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.413+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480a9350 con 0x7f504806dbb0 2023-12-19T05:47:54.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.414+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480a9570 con 0x7f504806dbb0 2023-12-19T05:47:54.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.415+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f504001d3b0 con 0x7f504806dbb0 2023-12-19T05:47:54.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.416+0000 7f50457fa640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 0x7f503406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.417+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5040088440 con 0x7f504806dbb0 2023-12-19T05:47:54.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.417+0000 7f504cea6640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 0x7f503406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.418+0000 7f504cea6640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 0x7f503406c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f503c034000 tx=0x7f503c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.421+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5040053ce0 con 0x7f504806dbb0 2023-12-19T05:47:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.625+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5048061910 con 0x7f504806dbb0 2023-12-19T05:47:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.626+0000 7f50457fa640 1 -- 172.21.15.49:0/556529879 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v157) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5040019060 con 0x7f504806dbb0 2023-12-19T05:47:54.627 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:47:54.628 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:47:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 msgr2=0x7f503406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 0x7f503406c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f503c034000 tx=0x7f503c009030 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 msgr2=0x7f50481520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f50480cc6c0 tx=0x7f5040009d50 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 shutdown_connections 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f503406a430 0x7f503406c8f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f504806d750 0x7f5048151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f504806dbb0 0x7f50481520d0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 --2- 172.21.15.49:0/556529879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50300039c0 0x7f50480aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 >> 172.21.15.49:0/556529879 conn(0x7f50480659a0 msgr2=0x7f50480cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 shutdown_connections 2023-12-19T05:47:54.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.629+0000 7f504dea8640 1 -- 172.21.15.49:0/556529879 wait complete. 2023-12-19T05:47:54.649 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:47:54.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:47:54.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.883+0000 7eff2e218640 1 Processor -- start 2023-12-19T05:47:54.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.883+0000 7eff2e218640 1 -- start start 2023-12-19T05:47:54.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2e218640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff2806d070 0x7eff280ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2e218640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2815f920 con 0x7eff280b04c0 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2e218640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2815ed10 con 0x7eff2815afd0 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2e218640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280adc40 con 0x7eff2806d070 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2da17640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff2806d070 0x7eff280ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2ca15640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7eff280b04c0 0x7eff2806b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52734/0 (socket says 172.21.15.49:52734) 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2da17640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff2806d070 0x7eff280ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50510/0 (socket says 172.21.15.49:50510) 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.885+0000 7eff2ca15640 1 -- 172.21.15.49:0/3749770752 learned_addr learned my addr 172.21.15.49:0/3749770752 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:54.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.886+0000 7eff2da17640 1 -- 172.21.15.49:0/3749770752 >> v1:172.21.15.115:6789/0 conn(0x7eff2815afd0 legacy=0x7eff280afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.886+0000 7eff2da17640 1 -- 172.21.15.49:0/3749770752 >> v1:172.21.15.49:6789/0 conn(0x7eff280b04c0 legacy=0x7eff2806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.886+0000 7eff2da17640 1 -- 172.21.15.49:0/3749770752 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2815eff0 con 0x7eff2806d070 2023-12-19T05:47:54.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.887+0000 7eff2da17640 1 --2- 172.21.15.49:0/3749770752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2806d070 0x7eff280ad700 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7eff20009d90 tx=0x7eff2002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa65ee856aad2e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.887+0000 7eff1ffff640 1 -- 172.21.15.49:0/3749770752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2002cbd0 con 0x7eff2806d070 2023-12-19T05:47:54.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.887+0000 7eff1ffff640 1 -- 172.21.15.49:0/3749770752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2002cd30 con 0x7eff2806d070 2023-12-19T05:47:54.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.887+0000 7eff1ffff640 1 -- 172.21.15.49:0/3749770752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2002cea0 con 0x7eff2806d070 2023-12-19T05:47:54.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 -- 172.21.15.49:0/3749770752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2806d070 msgr2=0x7eff280ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 --2- 172.21.15.49:0/3749770752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2806d070 0x7eff280ad700 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7eff20009d90 tx=0x7eff2002be20 comp rx=0 tx=0).stop 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 -- 172.21.15.49:0/3749770752 shutdown_connections 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 --2- 172.21.15.49:0/3749770752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2806d070 0x7eff280ad700 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 -- 172.21.15.49:0/3749770752 >> 172.21.15.49:0/3749770752 conn(0x7eff280b4750 msgr2=0x7eff280659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 -- 172.21.15.49:0/3749770752 shutdown_connections 2023-12-19T05:47:54.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.888+0000 7eff2e218640 1 -- 172.21.15.49:0/3749770752 wait complete. 2023-12-19T05:47:54.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.890+0000 7eff2e218640 1 Processor -- start 2023-12-19T05:47:54.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.890+0000 7eff2e218640 1 -- start start 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff2806d070 0x7eff2815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 0x7eff2814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281f6d00 con 0x7eff2815afd0 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281f63f0 con 0x7eff280b04c0 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2e218640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff28157bc0 con 0x7eff2806d070 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2da17640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2da17640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50524/0 (socket says 172.21.15.49:50524) 2023-12-19T05:47:54.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.891+0000 7eff2da17640 1 -- 172.21.15.49:0/1431123516 learned_addr learned my addr 172.21.15.49:0/1431123516 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 -- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff2806d070 msgr2=0x7eff2815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2d216640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff2806d070 0x7eff2815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2ca15640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 0x7eff2814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff2806d070 0x7eff2815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 -- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 msgr2=0x7eff2814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 0x7eff2814fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 -- 172.21.15.49:0/1431123516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009a70 con 0x7eff2815afd0 2023-12-19T05:47:54.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2ca15640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 0x7eff2814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.892+0000 7eff2da17640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7eff20009d90 tx=0x7eff20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.893+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2002cea0 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.893+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff20040650 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.893+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20040a00 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.893+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff281f6640 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.893+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28150130 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.894+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28061910 con 0x7eff2815afd0 2023-12-19T05:47:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.895+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff20040b60 con 0x7eff2815afd0 2023-12-19T05:47:54.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.896+0000 7eff1dffb640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 0x7eff0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:54.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.896+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff200ab2c0 con 0x7eff2815afd0 2023-12-19T05:47:54.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.897+0000 7eff2d216640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 0x7eff0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.898+0000 7eff2d216640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 0x7eff0c06c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff2400a750 tx=0x7eff24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:54.901+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff20076d50 con 0x7eff2815afd0 2023-12-19T05:47:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.095+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff28066710 con 0x7eff2815afd0 2023-12-19T05:47:55.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.675+0000 7eff1dffb640 1 -- 172.21.15.49:0/1431123516 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v158) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff2007a370 con 0x7eff2815afd0 2023-12-19T05:47:55.677 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:47:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.682+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 msgr2=0x7eff0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.682+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 0x7eff0c06c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff2400a750 tx=0x7eff24008040 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.682+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 msgr2=0x7eff28157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.682+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7eff20009d90 tx=0x7eff20004a40 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 shutdown_connections 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7eff0c06a430 0x7eff0c06c8f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff2815afd0 0x7eff28157370 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff280b04c0 0x7eff2814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 --2- 172.21.15.49:0/1431123516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff2806d070 0x7eff2815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 >> 172.21.15.49:0/1431123516 conn(0x7eff280b4750 msgr2=0x7eff281548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 shutdown_connections 2023-12-19T05:47:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.683+0000 7eff2e218640 1 -- 172.21.15.49:0/1431123516 wait complete. 2023-12-19T05:47:55.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:47:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.931+0000 7f8b68ff1640 1 Processor -- start 2023-12-19T05:47:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.932+0000 7f8b68ff1640 1 -- start start 2023-12-19T05:47:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b68ff1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b640b5550 0x7f8b640d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b68ff1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b640b6820 con 0x7f8b640b50e0 2023-12-19T05:47:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b68ff1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b640b6b00 con 0x7f8b640b9150 2023-12-19T05:47:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b68ff1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b64140b70 con 0x7f8b640b5550 2023-12-19T05:47:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b61d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b640b50e0 0x7f8b640d1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52748/0 (socket says 172.21.15.49:52748) 2023-12-19T05:47:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.934+0000 7f8b61d9b640 1 -- 172.21.15.49:0/1441879407 learned_addr learned my addr 172.21.15.49:0/1441879407 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068838304 0 0) 0x7f8b640b6820 con 0x7f8b640b50e0 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b62d9d640 1 --2- 172.21.15.49:0/1441879407 >> v2:172.21.15.115:3300/0 conn(0x7f8b640b5550 0x7f8b640d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c003520 con 0x7f8b640b50e0 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023551629 0 0) 0x7f8b4c003520 con 0x7f8b640b50e0 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 >> v2:172.21.15.115:3300/0 conn(0x7f8b640b5550 msgr2=0x7f8b640d1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 --2- 172.21.15.49:0/1441879407 >> v2:172.21.15.115:3300/0 conn(0x7f8b640b5550 0x7f8b640d1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 >> v1:172.21.15.115:6789/0 conn(0x7f8b640b9150 legacy=0x7f8b6415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640b6de0 con 0x7f8b640b50e0 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8b58001670 con 0x7f8b640b50e0 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 >> v1:172.21.15.49:6789/0 conn(0x7f8b640b50e0 legacy=0x7f8b640d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b4c0047c0 0x7f8b4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b4c005180 0x7f8b4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64140b70 con 0x7f8b4c003970 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.935+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00c0d0 con 0x7f8b4c0047c0 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00c290 con 0x7f8b4c005180 2023-12-19T05:47:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b61d9b640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b4c0047c0 0x7f8b4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b62d9d640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b4c005180 0x7f8b4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 -- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b4c005180 msgr2=0x7f8b4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b4c005180 0x7f8b4c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 -- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b4c0047c0 msgr2=0x7f8b4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b4c0047c0 0x7f8b4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b6259c640 1 -- 172.21.15.49:0/1441879407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c003520 con 0x7f8b4c003970 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.936+0000 7f8b62d9d640 1 -- 172.21.15.49:0/1441879407 reap_dead start 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.938+0000 7f8b6259c640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b4c003d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8b54001750 tx=0x7f8b4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8614bb0c5db78a8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.938+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540052d0 con 0x7f8b4c003970 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.938+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5402e050 con 0x7f8b4c003970 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.938+0000 7f8b6159a640 1 -- 172.21.15.49:0/1441879407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003830 con 0x7f8b4c003970 2023-12-19T05:47:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 -- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 msgr2=0x7f8b4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b4c003d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8b54001750 tx=0x7f8b4c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 -- 172.21.15.49:0/1441879407 shutdown_connections 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/1441879407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b4c003d90 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 -- 172.21.15.49:0/1441879407 >> 172.21.15.49:0/1441879407 conn(0x7f8b640b2600 msgr2=0x7f8b640b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 -- 172.21.15.49:0/1441879407 shutdown_connections 2023-12-19T05:47:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.939+0000 7f8b68ff1640 1 -- 172.21.15.49:0/1441879407 wait complete. 2023-12-19T05:47:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.941+0000 7f8b68ff1640 1 Processor -- start 2023-12-19T05:47:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.941+0000 7f8b68ff1640 1 -- start start 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64157310 0x7f8b641f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6413b030 0x7f8b6413b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64158140 con 0x7f8b4c003970 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64157b80 con 0x7f8b64157310 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b68ff1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64157e60 con 0x7f8b6413b030 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b6259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b6259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50550/0 (socket says 172.21.15.49:50550) 2023-12-19T05:47:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.942+0000 7f8b6259c640 1 -- 172.21.15.49:0/246084110 learned_addr learned my addr 172.21.15.49:0/246084110 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b62d9d640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6413b030 0x7f8b6413b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b61d9b640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64157310 0x7f8b641f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 -- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6413b030 msgr2=0x7f8b6413b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6413b030 0x7f8b6413b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 -- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64157310 msgr2=0x7f8b641f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64157310 0x7f8b641f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 -- 172.21.15.49:0/246084110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64139d10 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.943+0000 7f8b6259c640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f8b5402bc30 tx=0x7f8b54001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.944+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540076c0 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.944+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54007a30 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.944+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54006c20 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.944+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b64139ff0 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.944+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b64157790 con 0x7f8b4c003970 2023-12-19T05:47:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.945+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64074770 con 0x7f8b4c003970 2023-12-19T05:47:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.946+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b540035f0 con 0x7f8b4c003970 2023-12-19T05:47:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.947+0000 7f8b52ffd640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 0x7f8b4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.948+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8b540aa300 con 0x7f8b4c003970 2023-12-19T05:47:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.948+0000 7f8b61d9b640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 0x7f8b4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.949+0000 7f8b61d9b640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 0x7f8b4406c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b58001c90 tx=0x7f8b58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:55.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:55.953+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b54075b60 con 0x7f8b4c003970 2023-12-19T05:47:56.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.148+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b64061910 con 0x7f8b4c003970 2023-12-19T05:47:56.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.693+0000 7f8b52ffd640 1 -- 172.21.15.49:0/246084110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v159) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8b54079180 con 0x7f8b4c003970 2023-12-19T05:47:56.698 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:47:56.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.701+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 msgr2=0x7f8b4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.701+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 0x7f8b4406c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b58001c90 tx=0x7f8b58009040 comp rx=0 tx=0).stop 2023-12-19T05:47:56.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.701+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 msgr2=0x7f8b64155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.701+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f8b5402bc30 tx=0x7f8b54001120 comp rx=0 tx=0).stop 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.702+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 shutdown_connections 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.702+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b4406a460 0x7f8b4406c920 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.702+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6413b030 0x7f8b6413b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.703+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64157310 0x7f8b641f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.703+0000 7f8b68ff1640 1 --2- 172.21.15.49:0/246084110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b4c003970 0x7f8b64155050 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.703+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 >> 172.21.15.49:0/246084110 conn(0x7f8b640b2600 msgr2=0x7f8b64154210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:56.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.704+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 shutdown_connections 2023-12-19T05:47:56.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.704+0000 7f8b68ff1640 1 -- 172.21.15.49:0/246084110 wait complete. 2023-12-19T05:47:56.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:47:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.935+0000 7f1ad0a23640 1 Processor -- start 2023-12-19T05:47:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.935+0000 7f1ad0a23640 1 -- start start 2023-12-19T05:47:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1ad0a23640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1acc15b1d0 0x7f1acc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1ad0a23640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc15fde0 con 0x7f1acc0b1ec0 2023-12-19T05:47:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1ad0a23640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc15ef10 con 0x7f1acc0ceea0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1ad0a23640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0b2320 con 0x7f1acc15b1d0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1aca59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1acc15b1d0 0x7f1acc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1aca59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1acc15b1d0 0x7f1acc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50556/0 (socket says 172.21.15.49:50556) 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1aca59c640 1 -- 172.21.15.49:0/373283510 learned_addr learned my addr 172.21.15.49:0/373283510 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.937+0000 7f1ac9d9b640 1 --1- 172.21.15.49:0/373283510 >> v1:172.21.15.49:6789/0 conn(0x7f1acc0b1ec0 0x7f1acc15f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52750/0 (socket says 172.21.15.49:52750) 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.938+0000 7f1aca59c640 1 -- 172.21.15.49:0/373283510 >> v1:172.21.15.115:6789/0 conn(0x7f1acc0ceea0 legacy=0x7f1acc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.938+0000 7f1aca59c640 1 -- 172.21.15.49:0/373283510 >> v1:172.21.15.49:6789/0 conn(0x7f1acc0b1ec0 legacy=0x7f1acc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.938+0000 7f1ac959a640 1 -- 172.21.15.49:0/373283510 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217111726 0 0) 0x7f1acc15fde0 con 0x7f1acc0b1ec0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.938+0000 7f1aca59c640 1 -- 172.21.15.49:0/373283510 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0b2e40 con 0x7f1acc15b1d0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.939+0000 7f1aca59c640 1 --2- 172.21.15.49:0/373283510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc15b1d0 0x7f1acc0b2760 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e50 tx=0x7f1abc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6340999e3f49efb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.939+0000 7f1ac959a640 1 -- 172.21.15.49:0/373283510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc02cbb0 con 0x7f1acc15b1d0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.939+0000 7f1ac959a640 1 -- 172.21.15.49:0/373283510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc02cd10 con 0x7f1acc15b1d0 2023-12-19T05:47:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.939+0000 7f1ac959a640 1 -- 172.21.15.49:0/373283510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc034610 con 0x7f1acc15b1d0 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 -- 172.21.15.49:0/373283510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc15b1d0 msgr2=0x7f1acc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/373283510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc15b1d0 0x7f1acc0b2760 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e50 tx=0x7f1abc02c010 comp rx=0 tx=0).stop 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 -- 172.21.15.49:0/373283510 shutdown_connections 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/373283510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc15b1d0 0x7f1acc0b2760 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 -- 172.21.15.49:0/373283510 >> 172.21.15.49:0/373283510 conn(0x7f1acc073150 msgr2=0x7f1acc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 -- 172.21.15.49:0/373283510 shutdown_connections 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.940+0000 7f1ad0a23640 1 -- 172.21.15.49:0/373283510 wait complete. 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.942+0000 7f1ad0a23640 1 Processor -- start 2023-12-19T05:47:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.942+0000 7f1ad0a23640 1 -- start start 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0b1ec0 0x7f1acc0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 0x7f1acc15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0a9ae0 con 0x7f1acc0ceea0 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0c91f0 con 0x7f1acc0b1ec0 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ad0a23640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0a8a40 con 0x7f1acc15b1d0 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ac9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ac9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50570/0 (socket says 172.21.15.49:50570) 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1ac9d9b640 1 -- 172.21.15.49:0/44611231 learned_addr learned my addr 172.21.15.49:0/44611231 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.943+0000 7f1aca59c640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0b1ec0 0x7f1acc0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1acad9d640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 0x7f1acc15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 -- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 msgr2=0x7f1acc15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 0x7f1acc15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 -- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0b1ec0 msgr2=0x7f1acc0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0b1ec0 0x7f1acc0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 -- 172.21.15.49:0/44611231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009b30 con 0x7f1acc0ceea0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1acad9d640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 0x7f1acc15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac9d9b640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c4a0 tx=0x7f1ab400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40074e0 con 0x7f1acc0ceea0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4007640 con 0x7f1acc0ceea0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4004a00 con 0x7f1acc0ceea0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.944+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc0a8d20 con 0x7f1acc0ceea0 2023-12-19T05:47:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.945+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0a92e0 con 0x7f1acc0ceea0 2023-12-19T05:47:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.946+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc0ca5c0 con 0x7f1acc0ceea0 2023-12-19T05:47:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.947+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1ab4004b60 con 0x7f1acc0ceea0 2023-12-19T05:47:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.948+0000 7f1ac2ffd640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 0x7f1aac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.948+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1ab4087d70 con 0x7f1acc0ceea0 2023-12-19T05:47:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.949+0000 7f1aca59c640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 0x7f1aac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.950+0000 7f1aca59c640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 0x7f1aac06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1abc035000 tx=0x7f1abc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:56.952+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1ab4053430 con 0x7f1acc0ceea0 2023-12-19T05:47:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.186+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1acc061910 con 0x7f1acc0ceea0 2023-12-19T05:47:57.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.194+0000 7f1ac2ffd640 1 -- 172.21.15.49:0/44611231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v68) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1ab4056a50 con 0x7f1acc0ceea0 2023-12-19T05:47:57.197 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 18 and data pool 19 2023-12-19T05:47:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 msgr2=0x7f1aac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 0x7f1aac06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1abc035000 tx=0x7f1abc030000 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 msgr2=0x7f1acc1f22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c4a0 tx=0x7f1ab400c960 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 shutdown_connections 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1aac06a430 0x7f1aac06c8f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15b1d0 0x7f1acc15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1acc0ceea0 0x7f1acc1f22a0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 --2- 172.21.15.49:0/44611231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0b1ec0 0x7f1acc0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 >> 172.21.15.49:0/44611231 conn(0x7f1acc073150 msgr2=0x7f1acc0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.199+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 shutdown_connections 2023-12-19T05:47:57.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.200+0000 7f1ad0a23640 1 -- 172.21.15.49:0/44611231 wait complete. 2023-12-19T05:47:57.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.414+0000 7f8ad24fa640 1 Processor -- start 2023-12-19T05:47:57.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.415+0000 7f8ad24fa640 1 -- start start 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.416+0000 7f8ad24fa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8acc15e5a0 0x7f8acc0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad24fa640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc15ec30 con 0x7f8acc15f680 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad24fa640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc15e980 con 0x7f8acc0cdbf0 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad24fa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0b2f90 con 0x7f8acc15e5a0 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad0cf7640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8acc15f680 0x7f8acc0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52760/0 (socket says 172.21.15.49:52760) 2023-12-19T05:47:57.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad0cf7640 1 -- 172.21.15.49:0/159855549 learned_addr learned my addr 172.21.15.49:0/159855549 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/159855549 >> v2:172.21.15.115:3300/0 conn(0x7f8acc15e5a0 0x7f8acc0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414473999 0 0) 0x7f8acc15ec30 con 0x7f8acc15f680 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.417+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab8003520 con 0x7f8acc15f680 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357127773 0 0) 0x7f8ab8003520 con 0x7f8acc15f680 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 >> v2:172.21.15.115:3300/0 conn(0x7f8acc15e5a0 msgr2=0x7f8acc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/159855549 >> v2:172.21.15.115:3300/0 conn(0x7f8acc15e5a0 0x7f8acc0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 >> v1:172.21.15.115:6789/0 conn(0x7f8acc0cdbf0 legacy=0x7f8acc06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0b3270 con 0x7f8acc15f680 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8abc001670 con 0x7f8acc15f680 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 >> v1:172.21.15.49:6789/0 conn(0x7f8acc15f680 legacy=0x7f8acc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab80039c0 0x7f8ab8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab80047c0 0x7f8ab8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8ab800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b2f90 con 0x7f8ab8005180 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab800c080 con 0x7f8ab80039c0 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab800c240 con 0x7f8ab80047c0 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.418+0000 7f8ad1cf9640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8ab800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad0cf7640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab80047c0 0x7f8ab8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab80039c0 0x7f8ab8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad1cf9640 1 -- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab80047c0 msgr2=0x7f8ab8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad1cf9640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab80047c0 0x7f8ab8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad1cf9640 1 -- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab80039c0 msgr2=0x7f8ab8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad1cf9640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab80039c0 0x7f8ab8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad1cf9640 1 -- 172.21.15.49:0/159855549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8003520 con 0x7f8ab8005180 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab80039c0 0x7f8ab8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:57.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.419+0000 7f8ad0cf7640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab80047c0 0x7f8ab8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.420+0000 7f8ad1cf9640 1 -- 172.21.15.49:0/159855549 reap_dead start 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.420+0000 7f8ad1cf9640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8ab800b980 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4001e50 tx=0x7f8ab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe3878f0624b4e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.420+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003b70 con 0x7f8ab8005180 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.420+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac4003d10 con 0x7f8ab8005180 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.420+0000 7f8ac3fff640 1 -- 172.21.15.49:0/159855549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4005310 con 0x7f8ab8005180 2023-12-19T05:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 -- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 msgr2=0x7f8ab800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8ab800b980 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4001e50 tx=0x7f8ab80057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 -- 172.21.15.49:0/159855549 shutdown_connections 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/159855549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8ab800b980 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 -- 172.21.15.49:0/159855549 >> 172.21.15.49:0/159855549 conn(0x7f8acc0b0100 msgr2=0x7f8acc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 -- 172.21.15.49:0/159855549 shutdown_connections 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.421+0000 7f8ad24fa640 1 -- 172.21.15.49:0/159855549 wait complete. 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.423+0000 7f8ad24fa640 1 Processor -- start 2023-12-19T05:47:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.423+0000 7f8ad24fa640 1 -- start start 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8acc157280 0x7f8acc15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8acc0b2330 0x7f8acc0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b2d20 con 0x7f8ab8005180 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1f1860 con 0x7f8acc0b2330 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad24fa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc15dc20 con 0x7f8acc157280 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad14f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad14f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50580/0 (socket says 172.21.15.49:50580) 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.424+0000 7f8ad14f8640 1 -- 172.21.15.49:0/3927280110 learned_addr learned my addr 172.21.15.49:0/3927280110 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:57.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 -- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8acc157280 msgr2=0x7f8acc15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8acc157280 0x7f8acc15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 -- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8acc0b2330 msgr2=0x7f8acc0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8acc0b2330 0x7f8acc0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 -- 172.21.15.49:0/3927280110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc1f0ba0 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad14f8640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80108b0 tx=0x7f8ac8010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800eb00 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac800ec60 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac801c400 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc1f0e80 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.425+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc1f1440 con 0x7f8ab8005180 2023-12-19T05:47:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.427+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc061910 con 0x7f8ab8005180 2023-12-19T05:47:57.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.428+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ac801c560 con 0x7f8ab8005180 2023-12-19T05:47:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.429+0000 7f8ac1ffb640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 0x7f8ab006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.429+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ac8088e00 con 0x7f8ab8005180 2023-12-19T05:47:57.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.430+0000 7f8ad0cf7640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 0x7f8ab006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.431+0000 7f8ad0cf7640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 0x7f8ab006c920 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8abc000c00 tx=0x7f8abc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.434+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ac8054530 con 0x7f8ab8005180 2023-12-19T05:47:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.622+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8acc0ce980 con 0x7f8ab8005180 2023-12-19T05:47:57.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.625+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/3927280110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16073 (secure 0 0 0) 0x7f8ac8057b50 con 0x7f8ab8005180 2023-12-19T05:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":160,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:57.189099+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 msgr2=0x7f8ab006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 0x7f8ab006c920 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8abc000c00 tx=0x7f8abc009040 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 msgr2=0x7f8acc1f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80108b0 tx=0x7f8ac8010d70 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 shutdown_connections 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8ab006a460 0x7f8ab006c920 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8acc157280 0x7f8acc15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8acc0b2330 0x7f8acc0b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 --2- 172.21.15.49:0/3927280110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ab8005180 0x7f8acc1f0520 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 >> 172.21.15.49:0/3927280110 conn(0x7f8acc0b0100 msgr2=0x7f8acc0aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 shutdown_connections 2023-12-19T05:47:57.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.627+0000 7f8ad24fa640 1 -- 172.21.15.49:0/3927280110 wait complete. 2023-12-19T05:47:57.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:47:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.867+0000 7f6f35885640 1 Processor -- start 2023-12-19T05:47:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.867+0000 7f6f35885640 1 -- start start 2023-12-19T05:47:57.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f30159810 0x7f6f30159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f3006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f300cc990 0x7f6f300cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3015d0e0 con 0x7f6f300cc990 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f30070350 con 0x7f6f30159810 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35885640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cd360 con 0x7f6f3006f9f0 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35084640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f300cc990 0x7f6f300cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35084640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f300cc990 0x7f6f300cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50586/0 (socket says 172.21.15.49:50586) 2023-12-19T05:47:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.869+0000 7f6f35084640 1 -- 172.21.15.49:0/3601476618 learned_addr learned my addr 172.21.15.49:0/3601476618 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f34883640 1 --2- 172.21.15.49:0/3601476618 >> v2:172.21.15.115:3300/0 conn(0x7f6f30159810 0x7f6f30159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f27fff640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f3006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f35084640 1 -- 172.21.15.49:0/3601476618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 msgr2=0x7f6f3006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f35084640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f3006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f35084640 1 -- 172.21.15.49:0/3601476618 >> v2:172.21.15.115:3300/0 conn(0x7f6f30159810 msgr2=0x7f6f30159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f35084640 1 --2- 172.21.15.49:0/3601476618 >> v2:172.21.15.115:3300/0 conn(0x7f6f30159810 0x7f6f30159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.870+0000 7f6f35084640 1 -- 172.21.15.49:0/3601476618 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300b1590 con 0x7f6f300cc990 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.871+0000 7f6f35084640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f300cc990 0x7f6f300cce20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6f300678a0 tx=0x7f6f2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0d0796a4a8e557 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.871+0000 7f6f277fe640 1 -- 172.21.15.49:0/3601476618 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f280317e0 con 0x7f6f300cc990 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.871+0000 7f6f277fe640 1 -- 172.21.15.49:0/3601476618 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28031940 con 0x7f6f300cc990 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.871+0000 7f6f277fe640 1 -- 172.21.15.49:0/3601476618 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28031cd0 con 0x7f6f300cc990 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 -- 172.21.15.49:0/3601476618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f300cc990 msgr2=0x7f6f300cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f300cc990 0x7f6f300cce20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6f300678a0 tx=0x7f6f2802b880 comp rx=0 tx=0).stop 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 -- 172.21.15.49:0/3601476618 shutdown_connections 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f300cc990 0x7f6f300cce20 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 --2- 172.21.15.49:0/3601476618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f3006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 --2- 172.21.15.49:0/3601476618 >> v2:172.21.15.115:3300/0 conn(0x7f6f30159810 0x7f6f30159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 -- 172.21.15.49:0/3601476618 >> 172.21.15.49:0/3601476618 conn(0x7f6f300b0100 msgr2=0x7f6f300b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 -- 172.21.15.49:0/3601476618 shutdown_connections 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.872+0000 7f6f35885640 1 -- 172.21.15.49:0/3601476618 wait complete. 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.874+0000 7f6f35885640 1 Processor -- start 2023-12-19T05:47:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.874+0000 7f6f35885640 1 -- start start 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f301e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 0x7f6f300ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3006b720 con 0x7f6f30159810 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301e27e0 con 0x7f6f300cc990 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35885640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3006c260 con 0x7f6f3006f9f0 2023-12-19T05:47:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50588/0 (socket says 172.21.15.49:50588) 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f35084640 1 -- 172.21.15.49:0/3888143617 learned_addr learned my addr 172.21.15.49:0/3888143617 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.875+0000 7f6f34883640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f301e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f27fff640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 0x7f6f300ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 -- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 msgr2=0x7f6f301e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f301e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 -- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 msgr2=0x7f6f300ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 0x7f6f300ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 -- 172.21.15.49:0/3888143617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280094d0 con 0x7f6f30159810 2023-12-19T05:47:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f27fff640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 0x7f6f300ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35084640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6f2802b8c0 tx=0x7f6f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28032880 con 0x7f6f30159810 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28032a20 con 0x7f6f30159810 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28032dd0 con 0x7f6f30159810 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.876+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3006b930 con 0x7f6f30159810 2023-12-19T05:47:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.877+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3006bef0 con 0x7f6f30159810 2023-12-19T05:47:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.878+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30061910 con 0x7f6f30159810 2023-12-19T05:47:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.879+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6f280453f0 con 0x7f6f30159810 2023-12-19T05:47:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.879+0000 7f6f257fa640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 0x7f6f1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.880+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f280aac00 con 0x7f6f30159810 2023-12-19T05:47:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.880+0000 7f6f34883640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 0x7f6f1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:57.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.881+0000 7f6f34883640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 0x7f6f1c06c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00ac90 tx=0x7f6f2c00c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:57.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:57.884+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6f28076270 con 0x7f6f30159810 2023-12-19T05:47:57.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:57.984 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:58.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.076+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f3006c3a0 con 0x7f6f30159810 2023-12-19T05:47:58.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.078+0000 7f6f257fa640 1 -- 172.21.15.49:0/3888143617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16073 (secure 0 0 0) 0x7f6f28079890 con 0x7f6f30159810 2023-12-19T05:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":160,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:57.189099+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 msgr2=0x7f6f1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 0x7f6f1c06c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00ac90 tx=0x7f6f2c00c040 comp rx=0 tx=0).stop 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 msgr2=0x7f6f300acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6f2802b8c0 tx=0x7f6f280046c0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 shutdown_connections 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6f1c06a460 0x7f6f1c06c920 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f30159810 0x7f6f300acdf0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f300cc990 0x7f6f300ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 --2- 172.21.15.49:0/3888143617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3006f9f0 0x7f6f301e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.080+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 >> 172.21.15.49:0/3888143617 conn(0x7f6f300b0100 msgr2=0x7f6f30157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:58.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.081+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 shutdown_connections 2023-12-19T05:47:58.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.081+0000 7f6f35885640 1 -- 172.21.15.49:0/3888143617 wait complete. 2023-12-19T05:47:58.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:47:58.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.321+0000 7f7af17c9640 1 Processor -- start 2023-12-19T05:47:58.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.321+0000 7f7af17c9640 1 -- start start 2023-12-19T05:47:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.323+0000 7f7af17c9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.323+0000 7f7af17c9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7aec06c6b0 0x7f7aec0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.323+0000 7f7af17c9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0afb10 con 0x7f7aec0b0b50 2023-12-19T05:47:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.323+0000 7f7af17c9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec06bb30 con 0x7f7aec06c6b0 2023-12-19T05:47:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.323+0000 7f7af17c9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b0070 con 0x7f7aec1449e0 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7aea7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7aec0b0b50 0x7f7aec06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52776/0 (socket says 172.21.15.49:52776) 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7aea7fc640 1 -- 172.21.15.49:0/1140201071 learned_addr learned my addr 172.21.15.49:0/1140201071 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/1140201071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7aeb7fe640 1 --2- 172.21.15.49:0/1140201071 >> v2:172.21.15.115:3300/0 conn(0x7f7aec06c6b0 0x7f7aec0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658498793 0 0) 0x7f7aec0afb10 con 0x7f7aec0b0b50 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.324+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad4003520 con 0x7f7aec0b0b50 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.325+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799490833 0 0) 0x7f7ad4003520 con 0x7f7aec0b0b50 2023-12-19T05:47:58.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.325+0000 7f7aeaffd640 1 -- 172.21.15.49:0/1140201071 >> v2:172.21.15.115:3300/0 conn(0x7f7aec06c6b0 msgr2=0x7f7aec0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:58.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.325+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/1140201071 >> v2:172.21.15.115:3300/0 conn(0x7f7aec06c6b0 0x7f7aec0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.325+0000 7f7aeaffd640 1 -- 172.21.15.49:0/1140201071 >> v1:172.21.15.49:6789/0 conn(0x7f7aec0b0b50 legacy=0x7f7aec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.325+0000 7f7aeaffd640 1 -- 172.21.15.49:0/1140201071 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0b0350 con 0x7f7aec1449e0 2023-12-19T05:47:58.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.326+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/1140201071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0af5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0097a0 tx=0x7f7adc02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e58b162a86a56fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.326+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0001670 con 0x7f7aec1449e0 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc02e050 con 0x7f7aec1449e0 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7ae9ffb640 1 -- 172.21.15.49:0/1140201071 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc030730 con 0x7f7aec1449e0 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 -- 172.21.15.49:0/1140201071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 msgr2=0x7f7aec0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 --2- 172.21.15.49:0/1140201071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0af5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0097a0 tx=0x7f7adc02b790 comp rx=0 tx=0).stop 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 -- 172.21.15.49:0/1140201071 shutdown_connections 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 --2- 172.21.15.49:0/1140201071 >> v2:172.21.15.115:3300/0 conn(0x7f7aec06c6b0 0x7f7aec0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 --2- 172.21.15.49:0/1140201071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0af5d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 -- 172.21.15.49:0/1140201071 >> 172.21.15.49:0/1140201071 conn(0x7f7aec0cbb70 msgr2=0x7f7aec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:58.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 -- 172.21.15.49:0/1140201071 shutdown_connections 2023-12-19T05:47:58.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.327+0000 7f7af17c9640 1 -- 172.21.15.49:0/1140201071 wait complete. 2023-12-19T05:47:58.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.329+0000 7f7af17c9640 1 Processor -- start 2023-12-19T05:47:58.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.329+0000 7f7af17c9640 1 -- start start 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7aec06c6b0 0x7f7aec14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec143ab0 con 0x7f7aec0b0b50 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec143d50 con 0x7f7aec06c6b0 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7af17c9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec144030 con 0x7f7aec1449e0 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.330+0000 7f7aea7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50608/0 (socket says 172.21.15.49:50608) 2023-12-19T05:47:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 -- 172.21.15.49:0/137489924 learned_addr learned my addr 172.21.15.49:0/137489924 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aeb7fe640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7aec06c6b0 0x7f7aec14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 -- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 msgr2=0x7f7aec0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 -- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7aec06c6b0 msgr2=0x7f7aec14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7aec06c6b0 0x7f7aec14f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 -- 172.21.15.49:0/137489924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc009400 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.331+0000 7f7aea7fc640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c710 tx=0x7f7ae000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.332+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0005ad0 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.332+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0005c30 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.332+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec1409d0 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.332+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007070 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.332+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0a84a0 con 0x7f7aec0b0b50 2023-12-19T05:47:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.333+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec140830 con 0x7f7aec0b0b50 2023-12-19T05:47:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.334+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ae00071f0 con 0x7f7aec0b0b50 2023-12-19T05:47:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.335+0000 7f7ad37fe640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 0x7f7ad806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.335+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ae0088800 con 0x7f7aec0b0b50 2023-12-19T05:47:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.336+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 0x7f7ad806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.337+0000 7f7aeaffd640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 0x7f7ad806c8f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7adc034000 tx=0x7f7adc02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.339+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7aec140830 con 0x7f7aec0b0b50 2023-12-19T05:47:58.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:58.575+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7aec140ef0 con 0x7f7aec0b0b50 2023-12-19T05:47:59.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.224+0000 7f7ad37fe640 1 -- 172.21.15.49:0/137489924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7aec140ef0 con 0x7f7aec0b0b50 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 msgr2=0x7f7ad806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 0x7f7ad806c8f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7adc034000 tx=0x7f7adc02f000 comp rx=0 tx=0).stop 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 msgr2=0x7f7aec143570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c710 tx=0x7f7ae000cbd0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 shutdown_connections 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ad806a430 0x7f7ad806c8f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7aec1449e0 0x7f7aec0add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec0b0b50 0x7f7aec143570 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 --2- 172.21.15.49:0/137489924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7aec06c6b0 0x7f7aec14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 >> 172.21.15.49:0/137489924 conn(0x7f7aec0cbb70 msgr2=0x7f7aec0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 shutdown_connections 2023-12-19T05:47:59.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.228+0000 7f7af17c9640 1 -- 172.21.15.49:0/137489924 wait complete. 2023-12-19T05:47:59.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:47:59.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:47:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.483+0000 7f31dc79c640 1 Processor -- start 2023-12-19T05:47:59.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.483+0000 7f31dc79c640 1 -- start start 2023-12-19T05:47:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31dc79c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31d406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31dc79c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40b2600 con 0x7f31d40b1710 2023-12-19T05:47:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31dc79c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40b1d60 con 0x7f31d4157aa0 2023-12-19T05:47:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31dc79c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b2040 con 0x7f31d415e750 2023-12-19T05:47:59.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9d37640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31d40b1710 0x7f31d415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52788/0 (socket says 172.21.15.49:52788) 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9d37640 1 -- 172.21.15.49:0/1959422260 learned_addr learned my addr 172.21.15.49:0/1959422260 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31dad39640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31d406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70348742 0 0) 0x7f31d40b2600 con 0x7f31d40b1710 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c0003520 con 0x7f31d40b1710 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594279292 0 0) 0x7f31d40b1d60 con 0x7f31d4157aa0 2023-12-19T05:47:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.486+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d40b2600 con 0x7f31d4157aa0 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930003330 0 0) 0x7f31c0003520 con 0x7f31d40b1710 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 msgr2=0x7f31d406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31d406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 >> v1:172.21.15.115:6789/0 conn(0x7f31d4157aa0 legacy=0x7f31d4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40b2320 con 0x7f31d40b1710 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f31c4001670 con 0x7f31d40b1710 2023-12-19T05:47:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 >> v1:172.21.15.49:6789/0 conn(0x7f31d40b1710 legacy=0x7f31d415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31c0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c0004d00 0x7f31c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b2040 con 0x7f31c0003ba0 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000ba60 con 0x7f31c0004d00 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000bc20 con 0x7f31d415e750 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31da538640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31c0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.487+0000 7f31dad39640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c0004d00 0x7f31c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31d9d37640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31da538640 1 -- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 msgr2=0x7f31c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31da538640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31da538640 1 -- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c0004d00 msgr2=0x7f31c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31da538640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c0004d00 0x7f31c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31da538640 1 -- 172.21.15.49:0/1959422260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0003520 con 0x7f31c0003ba0 2023-12-19T05:47:59.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.488+0000 7f31d9d37640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d415e750 0x7f31c00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:59.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.489+0000 7f31da538640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31c0003fa0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f31d00018a0 tx=0x7f31c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faf16d1814ad354 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.489+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00052d0 con 0x7f31c0003ba0 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.489+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0005430 con 0x7f31c0003ba0 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.489+0000 7f31d9536640 1 -- 172.21.15.49:0/1959422260 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003810 con 0x7f31c0003ba0 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 -- 172.21.15.49:0/1959422260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 msgr2=0x7f31c0003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 --2- 172.21.15.49:0/1959422260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31c0003fa0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f31d00018a0 tx=0x7f31c00057f0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dad39640 1 -- 172.21.15.49:0/1959422260 reap_dead start 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 -- 172.21.15.49:0/1959422260 shutdown_connections 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 -- 172.21.15.49:0/1959422260 >> 172.21.15.49:0/1959422260 conn(0x7f31d40cbb70 msgr2=0x7f31d40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 -- 172.21.15.49:0/1959422260 shutdown_connections 2023-12-19T05:47:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.490+0000 7f31dc79c640 1 -- 172.21.15.49:0/1959422260 wait complete. 2023-12-19T05:47:59.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.492+0000 7f31dc79c640 1 Processor -- start 2023-12-19T05:47:59.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.492+0000 7f31dc79c640 1 -- start start 2023-12-19T05:47:59.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d415ebb0 0x7f31d4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 0x7f31d415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4159ef0 con 0x7f31c0003ba0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4159bc0 con 0x7f31d415ebb0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.493+0000 7f31dc79c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d406cde0 con 0x7f31d40ae4f0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50634/0 (socket says 172.21.15.49:50634) 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 -- 172.21.15.49:0/2707012615 learned_addr learned my addr 172.21.15.49:0/2707012615 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31dad39640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 0x7f31d415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31d9d37640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d415ebb0 0x7f31d4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 -- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 msgr2=0x7f31d415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 0x7f31d415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 -- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d415ebb0 msgr2=0x7f31d4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:47:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d415ebb0 0x7f31d4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:47:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31da538640 1 -- 172.21.15.49:0/2707012615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d406d5f0 con 0x7f31c0003ba0 2023-12-19T05:47:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.494+0000 7f31dad39640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 0x7f31d415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31da538640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f31d0005040 tx=0x7f31d00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0007240 con 0x7f31c0003ba0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d00073a0 con 0x7f31c0003ba0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0006e10 con 0x7f31c0003ba0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d4158540 con 0x7f31c0003ba0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.495+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d406d310 con 0x7f31c0003ba0 2023-12-19T05:47:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.496+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4061910 con 0x7f31c0003ba0 2023-12-19T05:47:59.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.497+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31d00035f0 con 0x7f31c0003ba0 2023-12-19T05:47:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.498+0000 7f31caffd640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 0x7f31b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:47:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.499+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d00aa260 con 0x7f31c0003ba0 2023-12-19T05:47:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.499+0000 7f31d9d37640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 0x7f31b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:47:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.501+0000 7f31d9d37640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 0x7f31b806c920 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001200 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:47:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.503+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f31d00758f0 con 0x7f31c0003ba0 2023-12-19T05:47:59.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:47:59.737+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f31d4071ae0 con 0x7f31c0003ba0 2023-12-19T05:48:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.731+0000 7f31caffd640 1 -- 172.21.15.49:0/2707012615 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7f31d0078f10 con 0x7f31c0003ba0 2023-12-19T05:48:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.734+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 msgr2=0x7f31b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 0x7f31b806c920 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001200 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 msgr2=0x7f31d406c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f31d0005040 tx=0x7f31d00012d0 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 shutdown_connections 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f31b806a460 0x7f31b806c920 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40ae4f0 0x7f31d415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d415ebb0 0x7f31d4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 --2- 172.21.15.49:0/2707012615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31c0003ba0 0x7f31d406c140 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 >> 172.21.15.49:0/2707012615 conn(0x7f31d40cbb70 msgr2=0x7f31d4156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 shutdown_connections 2023-12-19T05:48:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.735+0000 7f31dc79c640 1 -- 172.21.15.49:0/2707012615 wait complete. 2023-12-19T05:48:00.761 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:48:00.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:48:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.996+0000 7f885516c640 1 Processor -- start 2023-12-19T05:48:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.996+0000 7f885516c640 1 -- start start 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885516c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f885015e5a0 0x7f88500b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885516c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 0x7f88500b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885516c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885015ec30 con 0x7f88500cdbf0 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885516c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500b2cc0 con 0x7f885015e5a0 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885516c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885015e980 con 0x7f885015f680 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f884ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f885015e5a0 0x7f88500b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885496b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f88500cdbf0 0x7f885006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52790/0 (socket says 172.21.15.49:52790) 2023-12-19T05:48:01.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.998+0000 7f885496b640 1 -- 172.21.15.49:0/3688177733 learned_addr learned my addr 172.21.15.49:0/3688177733 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884f7fe640 1 --2- 172.21.15.49:0/3688177733 >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 0x7f88500b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884effd640 1 -- 172.21.15.49:0/3688177733 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000847737 0 0) 0x7f885015ec30 con 0x7f88500cdbf0 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884effd640 1 -- 172.21.15.49:0/3688177733 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003520 con 0x7f88500cdbf0 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884ffff640 1 -- 172.21.15.49:0/3688177733 >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 msgr2=0x7f88500b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884ffff640 1 --2- 172.21.15.49:0/3688177733 >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 0x7f88500b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884ffff640 1 -- 172.21.15.49:0/3688177733 >> v1:172.21.15.49:6789/0 conn(0x7f88500cdbf0 legacy=0x7f885006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884ffff640 1 -- 172.21.15.49:0/3688177733 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500b2f90 con 0x7f885015e5a0 2023-12-19T05:48:01.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:00.999+0000 7f884f7fe640 1 --2- 172.21.15.49:0/3688177733 >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 0x7f88500b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:01.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.001+0000 7f884ffff640 1 --2- 172.21.15.49:0/3688177733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885015e5a0 0x7f88500b2030 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f88400097a0 tx=0x7f884002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ccaf0ab6bef935 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.001+0000 7f884effd640 1 -- 172.21.15.49:0/3688177733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840031830 con 0x7f885015e5a0 2023-12-19T05:48:01.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f884effd640 1 -- 172.21.15.49:0/3688177733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840031990 con 0x7f885015e5a0 2023-12-19T05:48:01.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f884effd640 1 -- 172.21.15.49:0/3688177733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840031d00 con 0x7f885015e5a0 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 -- 172.21.15.49:0/3688177733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885015e5a0 msgr2=0x7f88500b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 --2- 172.21.15.49:0/3688177733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885015e5a0 0x7f88500b2030 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f88400097a0 tx=0x7f884002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 -- 172.21.15.49:0/3688177733 shutdown_connections 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 --2- 172.21.15.49:0/3688177733 >> v2:172.21.15.115:3300/0 conn(0x7f885015f680 0x7f88500b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 --2- 172.21.15.49:0/3688177733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885015e5a0 0x7f88500b2030 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 -- 172.21.15.49:0/3688177733 >> 172.21.15.49:0/3688177733 conn(0x7f88500b0100 msgr2=0x7f88500b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.002+0000 7f885516c640 1 -- 172.21.15.49:0/3688177733 shutdown_connections 2023-12-19T05:48:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.003+0000 7f885516c640 1 -- 172.21.15.49:0/3688177733 wait complete. 2023-12-19T05:48:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.004+0000 7f885516c640 1 Processor -- start 2023-12-19T05:48:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.004+0000 7f885516c640 1 -- start start 2023-12-19T05:48:01.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.005+0000 7f885516c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.005+0000 7f885516c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f885015e5a0 0x7f88501587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.005+0000 7f885516c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f885015f680 0x7f8850158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f885516c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501f6d90 con 0x7f88500cdbf0 2023-12-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f885516c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850152d30 con 0x7f885015f680 2023-12-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f885516c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88501f6180 con 0x7f885015e5a0 2023-12-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50654/0 (socket says 172.21.15.49:50654) 2023-12-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 -- 172.21.15.49:0/4175467760 learned_addr learned my addr 172.21.15.49:0/4175467760 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884f7fe640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f885015e5a0 0x7f88501587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 -- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f885015e5a0 msgr2=0x7f88501587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f885496b640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f885015f680 0x7f8850158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f885015e5a0 0x7f88501587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 -- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f885015f680 msgr2=0x7f8850158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f885015f680 0x7f8850158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.006+0000 7f884ffff640 1 -- 172.21.15.49:0/4175467760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009400 con 0x7f88500cdbf0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f884ffff640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f88400098c0 tx=0x7f88400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884003a6f0 con 0x7f88500cdbf0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884003a850 con 0x7f88500cdbf0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88501f6460 con 0x7f88500cdbf0 2023-12-19T05:48:01.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884003ac00 con 0x7f88500cdbf0 2023-12-19T05:48:01.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.007+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88501f6a20 con 0x7f88500cdbf0 2023-12-19T05:48:01.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.008+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8850061910 con 0x7f88500cdbf0 2023-12-19T05:48:01.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.010+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f884004c3b0 con 0x7f88500cdbf0 2023-12-19T05:48:01.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.011+0000 7f884cff9640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 0x7f883c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.011+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88400aa560 con 0x7f88500cdbf0 2023-12-19T05:48:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.011+0000 7f884f7fe640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 0x7f883c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.013+0000 7f884f7fe640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 0x7f883c06c8f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8850150ea0 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.015+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8840075ab0 con 0x7f88500cdbf0 2023-12-19T05:48:01.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.247+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88500ce980 con 0x7f88500cdbf0 2023-12-19T05:48:01.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.248+0000 7f884cff9640 1 -- 172.21.15.49:0/4175467760 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f88400790d0 con 0x7f88500cdbf0 2023-12-19T05:48:01.250 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:01.250 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:48:01.251 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 msgr2=0x7f883c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 0x7f883c06c8f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8850150ea0 tx=0x7f8844008040 comp rx=0 tx=0).stop 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 msgr2=0x7f88501e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f88400098c0 tx=0x7f88400046c0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 shutdown_connections 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f883c06a430 0x7f883c06c8f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f885015e5a0 0x7f88501587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f885015f680 0x7f8850158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 --2- 172.21.15.49:0/4175467760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88500cdbf0 0x7f88501e70f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 >> 172.21.15.49:0/4175467760 conn(0x7f88500b0100 msgr2=0x7f885015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:01.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 shutdown_connections 2023-12-19T05:48:01.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.251+0000 7f885516c640 1 -- 172.21.15.49:0/4175467760 wait complete. 2023-12-19T05:48:01.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:48:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.513+0000 7f5ecf59e640 1 Processor -- start 2023-12-19T05:48:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.514+0000 7f5ecf59e640 1 -- start start 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.515+0000 7f5ecf59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5ed00b8070 0x7f5ed00d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.515+0000 7f5ecf59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00d12d0 con 0x7f5ed0146e30 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.515+0000 7f5ecf59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00d15b0 con 0x7f5ed00d0a90 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.515+0000 7f5ecf59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0147210 con 0x7f5ed00b8070 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.516+0000 7f5ece59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ed0146e30 0x7f5ed00b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52802/0 (socket says 172.21.15.49:52802) 2023-12-19T05:48:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.516+0000 7f5ece59c640 1 -- 172.21.15.49:0/200767711 learned_addr learned my addr 172.21.15.49:0/200767711 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:01.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.516+0000 7f5ecdd9b640 1 --2- 172.21.15.49:0/200767711 >> v2:172.21.15.115:3300/0 conn(0x7f5ed00b8070 0x7f5ed00d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.516+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803966192 0 0) 0x7f5ed00d12d0 con 0x7f5ed0146e30 2023-12-19T05:48:01.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.516+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc003520 con 0x7f5ed0146e30 2023-12-19T05:48:01.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599753173 0 0) 0x7f5ebc003520 con 0x7f5ed0146e30 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 >> v2:172.21.15.115:3300/0 conn(0x7f5ed00b8070 msgr2=0x7f5ed00d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 --2- 172.21.15.49:0/200767711 >> v2:172.21.15.115:3300/0 conn(0x7f5ed00b8070 0x7f5ed00d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 >> v1:172.21.15.115:6789/0 conn(0x7f5ed00d0a90 legacy=0x7f5ed015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00d1890 con 0x7f5ed0146e30 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5ec00019f0 con 0x7f5ed0146e30 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 >> v1:172.21.15.49:6789/0 conn(0x7f5ed0146e30 legacy=0x7f5ed00b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0039c0 0x7f5ebc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ebc0047c0 0x7f5ebc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 0x7f5ebc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0147210 con 0x7f5ebc0051d0 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00c120 con 0x7f5ebc0039c0 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00c2e0 con 0x7f5ebc0047c0 2023-12-19T05:48:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.517+0000 7f5eced9d640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 0x7f5ebc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5ece59c640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0039c0 0x7f5ebc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5ecdd9b640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ebc0047c0 0x7f5ebc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5eced9d640 1 -- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ebc0047c0 msgr2=0x7f5ebc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5eced9d640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ebc0047c0 0x7f5ebc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5eced9d640 1 -- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0039c0 msgr2=0x7f5ebc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5eced9d640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0039c0 0x7f5ebc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.518+0000 7f5eced9d640 1 -- 172.21.15.49:0/200767711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc003520 con 0x7f5ebc0051d0 2023-12-19T05:48:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.519+0000 7f5eced9d640 1 -- 172.21.15.49:0/200767711 reap_dead start 2023-12-19T05:48:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.519+0000 7f5eced9d640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 0x7f5ebc00b980 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8001720 tx=0x7f5ebc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7e9a587bd546d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.519+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80052d0 con 0x7f5ebc0051d0 2023-12-19T05:48:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.519+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec802e050 con 0x7f5ebc0051d0 2023-12-19T05:48:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.519+0000 7f5ecd59a640 1 -- 172.21.15.49:0/200767711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80035f0 con 0x7f5ebc0051d0 2023-12-19T05:48:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 -- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 msgr2=0x7f5ebc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 0x7f5ebc00b980 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8001720 tx=0x7f5ebc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 -- 172.21.15.49:0/200767711 shutdown_connections 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/200767711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc0051d0 0x7f5ebc00b980 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 -- 172.21.15.49:0/200767711 >> 172.21.15.49:0/200767711 conn(0x7f5ed00b2990 msgr2=0x7f5ed00b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 -- 172.21.15.49:0/200767711 shutdown_connections 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.520+0000 7f5ecf59e640 1 -- 172.21.15.49:0/200767711 wait complete. 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.522+0000 7f5ecf59e640 1 Processor -- start 2023-12-19T05:48:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.522+0000 7f5ecf59e640 1 -- start start 2023-12-19T05:48:01.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 0x7f5ed01d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ed013f7c0 0x7f5ed01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01d08e0 con 0x7f5ed013f340 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01402e0 con 0x7f5ebc0051d0 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecf59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed013fd20 con 0x7f5ed013f7c0 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.523+0000 7f5ecdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50668/0 (socket says 172.21.15.49:50668) 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 -- 172.21.15.49:0/1472100693 learned_addr learned my addr 172.21.15.49:0/1472100693 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5eced9d640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ed013f7c0 0x7f5ed01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ece59c640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 0x7f5ed01d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 -- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ed013f7c0 msgr2=0x7f5ed01f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ed013f7c0 0x7f5ed01f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 -- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 msgr2=0x7f5ed01d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 0x7f5ed01d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 -- 172.21.15.49:0/1472100693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0140000 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ece59c640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 0x7f5ed01d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.524+0000 7f5ecdd9b640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8011540 tx=0x7f5eb8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.525+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8015930 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.525+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8015a90 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.525+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed01d0500 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.525+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8015e60 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.525+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01d2ca0 con 0x7f5ed013f340 2023-12-19T05:48:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.526+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed0061910 con 0x7f5ed013f340 2023-12-19T05:48:01.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.527+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5eb800f460 con 0x7f5ed013f340 2023-12-19T05:48:01.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.528+0000 7f5ec6ffd640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 0x7f5eb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.529+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb8089050 con 0x7f5ed013f340 2023-12-19T05:48:01.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.529+0000 7f5ece59c640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 0x7f5eb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.530+0000 7f5ece59c640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 0x7f5eb006c920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0001b20 tx=0x7f5ec0001250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.533+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5eb80546d0 con 0x7f5ed013f340 2023-12-19T05:48:01.644 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-12-19T05:48:01.642+0000 7f1d623a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:48:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.728+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed01440c0 con 0x7f5ed013f340 2023-12-19T05:48:01.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.730+0000 7f5ec6ffd640 1 -- 172.21.15.49:0/1472100693 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16060 (secure 0 0 0) 0x7f5eb8057cf0 con 0x7f5ed013f340 2023-12-19T05:48:01.732 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:01.732 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":161,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:47:58.192928+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:48:01.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 msgr2=0x7f5eb006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 0x7f5eb006c920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0001b20 tx=0x7f5ec0001250 comp rx=0 tx=0).stop 2023-12-19T05:48:01.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 msgr2=0x7f5ed01f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8011540 tx=0x7f5eb8011a00 comp rx=0 tx=0).stop 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 shutdown_connections 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5eb006a460 0x7f5eb006c920 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ed013f7c0 0x7f5ed01f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed013f340 0x7f5ed01f4ed0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 --2- 172.21.15.49:0/1472100693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ebc0051d0 0x7f5ed01d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.732+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 >> 172.21.15.49:0/1472100693 conn(0x7f5ed00b2990 msgr2=0x7f5ed00b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:01.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.733+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 shutdown_connections 2023-12-19T05:48:01.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.733+0000 7f5ecf59e640 1 -- 172.21.15.49:0/1472100693 wait complete. 2023-12-19T05:48:01.756 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:48:01.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:48:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.987+0000 7fb24a0f3640 1 Processor -- start 2023-12-19T05:48:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.987+0000 7fb24a0f3640 1 -- start start 2023-12-19T05:48:01.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.989+0000 7fb24a0f3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2440cc990 0x7fb2440ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.989+0000 7fb24a0f3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24415d0e0 con 0x7fb244159810 2023-12-19T05:48:01.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.989+0000 7fb24a0f3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440b1590 con 0x7fb24406f9f0 2023-12-19T05:48:01.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.989+0000 7fb24a0f3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440b1870 con 0x7fb2440cc990 2023-12-19T05:48:01.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb2490f1640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb244159810 0x7fb244159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52814/0 (socket says 172.21.15.49:52814) 2023-12-19T05:48:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb2490f1640 1 -- 172.21.15.49:0/1136574924 learned_addr learned my addr 172.21.15.49:0/1136574924 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb2498f2640 1 --2- 172.21.15.49:0/1136574924 >> v2:172.21.15.115:3300/0 conn(0x7fb2440cc990 0x7fb2440ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870283355 0 0) 0x7fb240001110 con 0x7fb244159810 2023-12-19T05:48:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb230003520 con 0x7fb244159810 2023-12-19T05:48:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.990+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 157563752 0 0) 0x7fb230003520 con 0x7fb244159810 2023-12-19T05:48:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 >> v2:172.21.15.115:3300/0 conn(0x7fb2440cc990 msgr2=0x7fb2440ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 --2- 172.21.15.49:0/1136574924 >> v2:172.21.15.115:3300/0 conn(0x7fb2440cc990 0x7fb2440ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 >> v1:172.21.15.115:6789/0 conn(0x7fb24406f9f0 legacy=0x7fb24406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440b1b50 con 0x7fb244159810 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fb240001800 con 0x7fb244159810 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 >> v1:172.21.15.49:6789/0 conn(0x7fb244159810 legacy=0x7fb244159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb230003970 0x7fb230003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2300047c0 0x7fb230004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb23000ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440b1870 con 0x7fb230005180 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23000d230 con 0x7fb230003970 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb230005950 con 0x7fb2300047c0 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb2498f2640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb23000ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb2490f1640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb230003970 0x7fb230003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb2498f2640 1 -- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2300047c0 msgr2=0x7fb230004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.991+0000 7fb2498f2640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2300047c0 0x7fb230004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.992+0000 7fb2498f2640 1 -- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb230003970 msgr2=0x7fb230003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.992+0000 7fb2498f2640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb230003970 0x7fb230003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.992+0000 7fb2498f2640 1 -- 172.21.15.49:0/1136574924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230003520 con 0x7fb230005180 2023-12-19T05:48:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.992+0000 7fb2490f1640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb230003970 0x7fb230003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.992+0000 7fb2498f2640 1 -- 172.21.15.49:0/1136574924 reap_dead start 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.993+0000 7fb2498f2640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb23000ca90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fc0 tx=0x7fb2300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb66e9ae556a22b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.993+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02cc60 con 0x7fb230005180 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.993+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00f040 con 0x7fb230005180 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.993+0000 7fb23bfff640 1 -- 172.21.15.49:0/1136574924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c003990 con 0x7fb230005180 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 -- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 msgr2=0x7fb23000ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb23000ca90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fc0 tx=0x7fb2300057f0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 -- 172.21.15.49:0/1136574924 shutdown_connections 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/1136574924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb23000ca90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 -- 172.21.15.49:0/1136574924 >> 172.21.15.49:0/1136574924 conn(0x7fb2440b0100 msgr2=0x7fb2440b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 -- 172.21.15.49:0/1136574924 shutdown_connections 2023-12-19T05:48:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.994+0000 7fb24a0f3640 1 -- 172.21.15.49:0/1136574924 wait complete. 2023-12-19T05:48:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.996+0000 7fb24a0f3640 1 Processor -- start 2023-12-19T05:48:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.996+0000 7fb24a0f3640 1 -- start start 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb244147ac0 0x7fb244145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 0x7fb2440adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441476a0 con 0x7fb230005180 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244145cf0 con 0x7fb244146510 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb24a0f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb244146a20 con 0x7fb244147ac0 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb2490f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb2490f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50682/0 (socket says 172.21.15.49:50682) 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb2490f1640 1 -- 172.21.15.49:0/2296392082 learned_addr learned my addr 172.21.15.49:0/2296392082 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.997+0000 7fb2488f0640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb244147ac0 0x7fb244145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2498f2640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 0x7fb2440adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 -- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb244147ac0 msgr2=0x7fb244145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb244147ac0 0x7fb244145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 -- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 msgr2=0x7fb2440adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 0x7fb2440adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 -- 172.21.15.49:0/2296392082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244146d00 con 0x7fb230005180 2023-12-19T05:48:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2498f2640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 0x7fb2440adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb2490f1640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb240000fb0 tx=0x7fb24000dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400074e0 con 0x7fb230005180 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240007640 con 0x7fb230005180 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240004a20 con 0x7fb230005180 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.998+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb244146fe0 con 0x7fb230005180 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:01.999+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb244158280 con 0x7fb230005180 2023-12-19T05:48:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.000+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb244061910 con 0x7fb230005180 2023-12-19T05:48:02.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.001+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb240004b80 con 0x7fb230005180 2023-12-19T05:48:02.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.002+0000 7fb239ffb640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 0x7fb22806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.002+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb240088030 con 0x7fb230005180 2023-12-19T05:48:02.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.003+0000 7fb2488f0640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 0x7fb22806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.004+0000 7fb2488f0640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 0x7fb22806c920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb244149160 tx=0x7fb234009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:02.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.007+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2400536b0 con 0x7fb230005180 2023-12-19T05:48:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.196+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2440b2110 con 0x7fb22806a460 2023-12-19T05:48:02.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.219+0000 7fb239ffb640 1 -- 172.21.15.49:0/2296392082 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283087 (secure 0 0 0) 0x7fb234001c90 con 0x7fb22806a460 2023-12-19T05:48:02.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:02.227 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:48:02.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 msgr2=0x7fb22806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 0x7fb22806c920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb244149160 tx=0x7fb234009040 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 msgr2=0x7fb2441457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb240000fb0 tx=0x7fb24000dc70 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 shutdown_connections 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb22806a460 0x7fb22806c920 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb244147ac0 0x7fb244145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb244146510 0x7fb2440adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.226+0000 7fb24a0f3640 1 --2- 172.21.15.49:0/2296392082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb230005180 0x7fb2441457b0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.227+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 >> 172.21.15.49:0/2296392082 conn(0x7fb2440b0100 msgr2=0x7fb2440aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.227+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 shutdown_connections 2023-12-19T05:48:02.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.227+0000 7fb24a0f3640 1 -- 172.21.15.49:0/2296392082 wait complete. 2023-12-19T05:48:02.251 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2023-12-19T05:48:00.691084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554381,"statfs":{"total":1600000000,"available":1591686170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.017353"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.226648+0000","last_change":"2023-12-19T05:47:57.226411+0000","last_active":"2023-12-19T05:47:57.226648+0000","last_peered":"2023-12-19T05:47:57.226648+0000","last_clean":"2023-12-19T05:47:57.226648+0000","last_became_active":"2023-12-19T05:47:57.225631+0000","last_became_peered":"2023-12-19T05:47:57.225631+0000","last_unstale":"2023-12-19T05:47:57.226648+0000","last_undegraded":"2023-12-19T05:47:57.226648+0000","last_fullsized":"2023-12-19T05:47:57.226648+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:30.354688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225404+0000","last_change":"2023-12-19T05:47:57.225326+0000","last_active":"2023-12-19T05:47:57.225404+0000","last_peered":"2023-12-19T05:47:57.225404+0000","last_clean":"2023-12-19T05:47:57.225404+0000","last_became_active":"2023-12-19T05:47:57.223537+0000","last_became_peered":"2023-12-19T05:47:57.223537+0000","last_unstale":"2023-12-19T05:47:57.225404+0000","last_undegraded":"2023-12-19T05:47:57.225404+0000","last_fullsized":"2023-12-19T05:47:57.225404+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:34:39.977648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224479+0000","last_change":"2023-12-19T05:47:57.223807+0000","last_active":"2023-12-19T05:47:57.224479+0000","last_peered":"2023-12-19T05:47:57.224479+0000","last_clean":"2023-12-19T05:47:57.224479+0000","last_became_active":"2023-12-19T05:47:57.223585+0000","last_became_peered":"2023-12-19T05:47:57.223585+0000","last_unstale":"2023-12-19T05:47:57.224479+0000","last_undegraded":"2023-12-19T05:47:57.224479+0000","last_fullsized":"2023-12-19T05:47:57.224479+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:02:03.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217843+0000","last_change":"2023-12-19T05:47:57.216180+0000","last_active":"2023-12-19T05:47:57.217843+0000","last_peered":"2023-12-19T05:47:57.217843+0000","last_clean":"2023-12-19T05:47:57.217843+0000","last_became_active":"2023-12-19T05:47:57.215115+0000","last_became_peered":"2023-12-19T05:47:57.215115+0000","last_unstale":"2023-12-19T05:47:57.217843+0000","last_undegraded":"2023-12-19T05:47:57.217843+0000","last_fullsized":"2023-12-19T05:47:57.217843+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:51.406399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.219173+0000","last_change":"2023-12-19T05:47:57.218885+0000","last_active":"2023-12-19T05:47:57.219173+0000","last_peered":"2023-12-19T05:47:57.219173+0000","last_clean":"2023-12-19T05:47:57.219173+0000","last_became_active":"2023-12-19T05:47:57.217265+0000","last_became_peered":"2023-12-19T05:47:57.217265+0000","last_unstale":"2023-12-19T05:47:57.219173+0000","last_undegraded":"2023-12-19T05:47:57.219173+0000","last_fullsized":"2023-12-19T05:47:57.219173+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:29.108720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.222610+0000","last_change":"2023-12-19T05:47:57.222072+0000","last_active":"2023-12-19T05:47:57.222610+0000","last_peered":"2023-12-19T05:47:57.222610+0000","last_clean":"2023-12-19T05:47:57.222610+0000","last_became_active":"2023-12-19T05:47:57.218070+0000","last_became_peered":"2023-12-19T05:47:57.218070+0000","last_unstale":"2023-12-19T05:47:57.222610+0000","last_undegraded":"2023-12-19T05:47:57.222610+0000","last_fullsized":"2023-12-19T05:47:57.222610+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:19.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.215018+0000","last_change":"2023-12-19T05:47:57.213369+0000","last_active":"2023-12-19T05:47:57.215018+0000","last_peered":"2023-12-19T05:47:57.215018+0000","last_clean":"2023-12-19T05:47:57.215018+0000","last_became_active":"2023-12-19T05:47:57.213109+0000","last_became_peered":"2023-12-19T05:47:57.213109+0000","last_unstale":"2023-12-19T05:47:57.215018+0000","last_undegraded":"2023-12-19T05:47:57.215018+0000","last_fullsized":"2023-12-19T05:47:57.215018+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:07.074465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.221510+0000","last_change":"2023-12-19T05:47:57.221411+0000","last_active":"2023-12-19T05:47:57.221510+0000","last_peered":"2023-12-19T05:47:57.221510+0000","last_clean":"2023-12-19T05:47:57.221510+0000","last_became_active":"2023-12-19T05:47:57.220658+0000","last_became_peered":"2023-12-19T05:47:57.220658+0000","last_unstale":"2023-12-19T05:47:57.221510+0000","last_undegraded":"2023-12-19T05:47:57.221510+0000","last_fullsized":"2023-12-19T05:47:57.221510+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:33.766694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229429+0000","last_change":"2023-12-19T05:47:57.229356+0000","last_active":"2023-12-19T05:47:57.229429+0000","last_peered":"2023-12-19T05:47:57.229429+0000","last_clean":"2023-12-19T05:47:57.229429+0000","last_became_active":"2023-12-19T05:47:57.228986+0000","last_became_peered":"2023-12-19T05:47:57.228986+0000","last_unstale":"2023-12-19T05:47:57.229429+0000","last_undegraded":"2023-12-19T05:47:57.229429+0000","last_fullsized":"2023-12-19T05:47:57.229429+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:54:27.417549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224121+0000","last_change":"2023-12-19T05:47:57.222609+0000","last_active":"2023-12-19T05:47:57.224121+0000","last_peered":"2023-12-19T05:47:57.224121+0000","last_clean":"2023-12-19T05:47:57.224121+0000","last_became_active":"2023-12-19T05:47:57.221530+0000","last_became_peered":"2023-12-19T05:47:57.221530+0000","last_unstale":"2023-12-19T05:47:57.224121+0000","last_undegraded":"2023-12-19T05:47:57.224121+0000","last_fullsized":"2023-12-19T05:47:57.224121+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:50:45.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224606+0000","last_change":"2023-12-19T05:47:57.224342+0000","last_active":"2023-12-19T05:47:57.224606+0000","last_peered":"2023-12-19T05:47:57.224606+0000","last_clean":"2023-12-19T05:47:57.224606+0000","last_became_active":"2023-12-19T05:47:57.223853+0000","last_became_peered":"2023-12-19T05:47:57.223853+0000","last_unstale":"2023-12-19T05:47:57.224606+0000","last_undegraded":"2023-12-19T05:47:57.224606+0000","last_fullsized":"2023-12-19T05:47:57.224606+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:24.752718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217031+0000","last_change":"2023-12-19T05:47:57.215122+0000","last_active":"2023-12-19T05:47:57.217031+0000","last_peered":"2023-12-19T05:47:57.217031+0000","last_clean":"2023-12-19T05:47:57.217031+0000","last_became_active":"2023-12-19T05:47:57.214740+0000","last_became_peered":"2023-12-19T05:47:57.214740+0000","last_unstale":"2023-12-19T05:47:57.217031+0000","last_undegraded":"2023-12-19T05:47:57.217031+0000","last_fullsized":"2023-12-19T05:47:57.217031+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:55:26.336514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.223325+0000","last_change":"2023-12-19T05:47:57.223127+0000","last_active":"2023-12-19T05:47:57.223325+0000","last_peered":"2023-12-19T05:47:57.223325+0000","last_clean":"2023-12-19T05:47:57.223325+0000","last_became_active":"2023-12-19T05:47:57.218067+0000","last_became_peered":"2023-12-19T05:47:57.218067+0000","last_unstale":"2023-12-19T05:47:57.223325+0000","last_undegraded":"2023-12-19T05:47:57.223325+0000","last_fullsized":"2023-12-19T05:47:57.223325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:50:45.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.230508+0000","last_change":"2023-12-19T05:47:57.230265+0000","last_active":"2023-12-19T05:47:57.230508+0000","last_peered":"2023-12-19T05:47:57.230508+0000","last_clean":"2023-12-19T05:47:57.230508+0000","last_became_active":"2023-12-19T05:47:57.229675+0000","last_became_peered":"2023-12-19T05:47:57.229675+0000","last_unstale":"2023-12-19T05:47:57.230508+0000","last_undegraded":"2023-12-19T05:47:57.230508+0000","last_fullsized":"2023-12-19T05:47:57.230508+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:03.316110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.223076+0000","last_change":"2023-12-19T05:47:57.222470+0000","last_active":"2023-12-19T05:47:57.223076+0000","last_peered":"2023-12-19T05:47:57.223076+0000","last_clean":"2023-12-19T05:47:57.223076+0000","last_became_active":"2023-12-19T05:47:57.222216+0000","last_became_peered":"2023-12-19T05:47:57.222216+0000","last_unstale":"2023-12-19T05:47:57.223076+0000","last_undegraded":"2023-12-19T05:47:57.223076+0000","last_fullsized":"2023-12-19T05:47:57.223076+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:57.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.218207+0000","last_change":"2023-12-19T05:47:57.217779+0000","last_active":"2023-12-19T05:47:57.218207+0000","last_peered":"2023-12-19T05:47:57.218207+0000","last_clean":"2023-12-19T05:47:57.218207+0000","last_became_active":"2023-12-19T05:47:57.217534+0000","last_became_peered":"2023-12-19T05:47:57.217534+0000","last_unstale":"2023-12-19T05:47:57.218207+0000","last_undegraded":"2023-12-19T05:47:57.218207+0000","last_fullsized":"2023-12-19T05:47:57.218207+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:34:24.742342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.203564+0000","last_change":"2023-12-19T05:47:57.203484+0000","last_active":"2023-12-19T05:47:57.203564+0000","last_peered":"2023-12-19T05:47:57.203564+0000","last_clean":"2023-12-19T05:47:57.203564+0000","last_became_active":"2023-12-19T05:47:57.203214+0000","last_became_peered":"2023-12-19T05:47:57.203214+0000","last_unstale":"2023-12-19T05:47:57.203564+0000","last_undegraded":"2023-12-19T05:47:57.203564+0000","last_fullsized":"2023-12-19T05:47:57.203564+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:55:27.490877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.228629+0000","last_change":"2023-12-19T05:47:57.228374+0000","last_active":"2023-12-19T05:47:57.228629+0000","last_peered":"2023-12-19T05:47:57.228629+0000","last_clean":"2023-12-19T05:47:57.228629+0000","last_became_active":"2023-12-19T05:47:57.226704+0000","last_became_peered":"2023-12-19T05:47:57.226704+0000","last_unstale":"2023-12-19T05:47:57.228629+0000","last_undegraded":"2023-12-19T05:47:57.228629+0000","last_fullsized":"2023-12-19T05:47:57.228629+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:53:46.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227520+0000","last_change":"2023-12-19T05:47:57.227254+0000","last_active":"2023-12-19T05:47:57.227520+0000","last_peered":"2023-12-19T05:47:57.227520+0000","last_clean":"2023-12-19T05:47:57.227520+0000","last_became_active":"2023-12-19T05:47:57.226789+0000","last_became_peered":"2023-12-19T05:47:57.226789+0000","last_unstale":"2023-12-19T05:47:57.227520+0000","last_undegraded":"2023-12-19T05:47:57.227520+0000","last_fullsized":"2023-12-19T05:47:57.227520+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:34.001120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.230658+0000","last_change":"2023-12-19T05:47:57.230507+0000","last_active":"2023-12-19T05:47:57.230658+0000","last_peered":"2023-12-19T05:47:57.230658+0000","last_clean":"2023-12-19T05:47:57.230658+0000","last_became_active":"2023-12-19T05:47:57.230144+0000","last_became_peered":"2023-12-19T05:47:57.230144+0000","last_unstale":"2023-12-19T05:47:57.230658+0000","last_undegraded":"2023-12-19T05:47:57.230658+0000","last_fullsized":"2023-12-19T05:47:57.230658+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:12.824294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.222626+0000","last_change":"2023-12-19T05:47:57.222522+0000","last_active":"2023-12-19T05:47:57.222626+0000","last_peered":"2023-12-19T05:47:57.222626+0000","last_clean":"2023-12-19T05:47:57.222626+0000","last_became_active":"2023-12-19T05:47:57.222293+0000","last_became_peered":"2023-12-19T05:47:57.222293+0000","last_unstale":"2023-12-19T05:47:57.222626+0000","last_undegraded":"2023-12-19T05:47:57.222626+0000","last_fullsized":"2023-12-19T05:47:57.222626+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:36.237402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227619+0000","last_change":"2023-12-19T05:47:57.227507+0000","last_active":"2023-12-19T05:47:57.227619+0000","last_peered":"2023-12-19T05:47:57.227619+0000","last_clean":"2023-12-19T05:47:57.227619+0000","last_became_active":"2023-12-19T05:47:57.224957+0000","last_became_peered":"2023-12-19T05:47:57.224957+0000","last_unstale":"2023-12-19T05:47:57.227619+0000","last_undegraded":"2023-12-19T05:47:57.227619+0000","last_fullsized":"2023-12-19T05:47:57.227619+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:40.930372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.212167+0000","last_change":"2023-12-19T05:47:57.212089+0000","last_active":"2023-12-19T05:47:57.212167+0000","last_peered":"2023-12-19T05:47:57.212167+0000","last_clean":"2023-12-19T05:47:57.212167+0000","last_became_active":"2023-12-19T05:47:57.211459+0000","last_became_peered":"2023-12-19T05:47:57.211459+0000","last_unstale":"2023-12-19T05:47:57.212167+0000","last_undegraded":"2023-12-19T05:47:57.212167+0000","last_fullsized":"2023-12-19T05:47:57.212167+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:56.280159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229158+0000","last_change":"2023-12-19T05:47:57.229074+0000","last_active":"2023-12-19T05:47:57.229158+0000","last_peered":"2023-12-19T05:47:57.229158+0000","last_clean":"2023-12-19T05:47:57.229158+0000","last_became_active":"2023-12-19T05:47:57.228480+0000","last_became_peered":"2023-12-19T05:47:57.228480+0000","last_unstale":"2023-12-19T05:47:57.229158+0000","last_undegraded":"2023-12-19T05:47:57.229158+0000","last_fullsized":"2023-12-19T05:47:57.229158+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:13.903457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217655+0000","last_change":"2023-12-19T05:47:57.213291+0000","last_active":"2023-12-19T05:47:57.217655+0000","last_peered":"2023-12-19T05:47:57.217655+0000","last_clean":"2023-12-19T05:47:57.217655+0000","last_became_active":"2023-12-19T05:47:57.212923+0000","last_became_peered":"2023-12-19T05:47:57.212923+0000","last_unstale":"2023-12-19T05:47:57.217655+0000","last_undegraded":"2023-12-19T05:47:57.217655+0000","last_fullsized":"2023-12-19T05:47:57.217655+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:18.307014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224146+0000","last_change":"2023-12-19T05:47:57.222131+0000","last_active":"2023-12-19T05:47:57.224146+0000","last_peered":"2023-12-19T05:47:57.224146+0000","last_clean":"2023-12-19T05:47:57.224146+0000","last_became_active":"2023-12-19T05:47:57.221884+0000","last_became_peered":"2023-12-19T05:47:57.221884+0000","last_unstale":"2023-12-19T05:47:57.224146+0000","last_undegraded":"2023-12-19T05:47:57.224146+0000","last_fullsized":"2023-12-19T05:47:57.224146+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:28:12.752549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224811+0000","last_change":"2023-12-19T05:47:57.224682+0000","last_active":"2023-12-19T05:47:57.224811+0000","last_peered":"2023-12-19T05:47:57.224811+0000","last_clean":"2023-12-19T05:47:57.224811+0000","last_became_active":"2023-12-19T05:47:57.224393+0000","last_became_peered":"2023-12-19T05:47:57.224393+0000","last_unstale":"2023-12-19T05:47:57.224811+0000","last_undegraded":"2023-12-19T05:47:57.224811+0000","last_fullsized":"2023-12-19T05:47:57.224811+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:19.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.220392+0000","last_change":"2023-12-19T05:47:57.220265+0000","last_active":"2023-12-19T05:47:57.220392+0000","last_peered":"2023-12-19T05:47:57.220392+0000","last_clean":"2023-12-19T05:47:57.220392+0000","last_became_active":"2023-12-19T05:47:57.219922+0000","last_became_peered":"2023-12-19T05:47:57.219922+0000","last_unstale":"2023-12-19T05:47:57.220392+0000","last_undegraded":"2023-12-19T05:47:57.220392+0000","last_fullsized":"2023-12-19T05:47:57.220392+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:13.903457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.223749+0000","last_change":"2023-12-19T05:47:57.223441+0000","last_active":"2023-12-19T05:47:57.223749+0000","last_peered":"2023-12-19T05:47:57.223749+0000","last_clean":"2023-12-19T05:47:57.223749+0000","last_became_active":"2023-12-19T05:47:57.218087+0000","last_became_peered":"2023-12-19T05:47:57.218087+0000","last_unstale":"2023-12-19T05:47:57.223749+0000","last_undegraded":"2023-12-19T05:47:57.223749+0000","last_fullsized":"2023-12-19T05:47:57.223749+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:34.776884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.213462+0000","last_change":"2023-12-19T05:47:57.208244+0000","last_active":"2023-12-19T05:47:57.213462+0000","last_peered":"2023-12-19T05:47:57.213462+0000","last_clean":"2023-12-19T05:47:57.213462+0000","last_became_active":"2023-12-19T05:47:57.206377+0000","last_became_peered":"2023-12-19T05:47:57.206377+0000","last_unstale":"2023-12-19T05:47:57.213462+0000","last_undegraded":"2023-12-19T05:47:57.213462+0000","last_fullsized":"2023-12-19T05:47:57.213462+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:21.694457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.219694+0000","last_change":"2023-12-19T05:47:57.219644+0000","last_active":"2023-12-19T05:47:57.219694+0000","last_peered":"2023-12-19T05:47:57.219694+0000","last_clean":"2023-12-19T05:47:57.219694+0000","last_became_active":"2023-12-19T05:47:57.219468+0000","last_became_peered":"2023-12-19T05:47:57.219468+0000","last_unstale":"2023-12-19T05:47:57.219694+0000","last_undegraded":"2023-12-19T05:47:57.219694+0000","last_fullsized":"2023-12-19T05:47:57.219694+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:53:46.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.210001+0000","last_change":"2023-12-19T05:47:57.209670+0000","last_active":"2023-12-19T05:47:57.210001+0000","last_peered":"2023-12-19T05:47:57.210001+0000","last_clean":"2023-12-19T05:47:57.210001+0000","last_became_active":"2023-12-19T05:47:57.209417+0000","last_became_peered":"2023-12-19T05:47:57.209417+0000","last_unstale":"2023-12-19T05:47:57.210001+0000","last_undegraded":"2023-12-19T05:47:57.210001+0000","last_fullsized":"2023-12-19T05:47:57.210001+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:29:07.865696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.219703+0000","last_change":"2023-12-19T05:47:57.219455+0000","last_active":"2023-12-19T05:47:57.219703+0000","last_peered":"2023-12-19T05:47:57.219703+0000","last_clean":"2023-12-19T05:47:57.219703+0000","last_became_active":"2023-12-19T05:47:57.218871+0000","last_became_peered":"2023-12-19T05:47:57.218871+0000","last_unstale":"2023-12-19T05:47:57.219703+0000","last_undegraded":"2023-12-19T05:47:57.219703+0000","last_fullsized":"2023-12-19T05:47:57.219703+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:36.237402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"160'4","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.226520+0000","last_change":"2023-12-19T05:47:56.710333+0000","last_active":"2023-12-19T05:47:57.226520+0000","last_peered":"2023-12-19T05:47:57.226520+0000","last_clean":"2023-12-19T05:47:57.226520+0000","last_became_active":"2023-12-19T05:47:56.709522+0000","last_became_peered":"2023-12-19T05:47:56.709522+0000","last_unstale":"2023-12-19T05:47:57.226520+0000","last_undegraded":"2023-12-19T05:47:57.226520+0000","last_fullsized":"2023-12-19T05:47:57.226520+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:59:58.474673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.208518+0000","last_change":"2023-12-19T05:47:57.206874+0000","last_active":"2023-12-19T05:47:57.208518+0000","last_peered":"2023-12-19T05:47:57.208518+0000","last_clean":"2023-12-19T05:47:57.208518+0000","last_became_active":"2023-12-19T05:47:57.206619+0000","last_became_peered":"2023-12-19T05:47:57.206619+0000","last_unstale":"2023-12-19T05:47:57.208518+0000","last_undegraded":"2023-12-19T05:47:57.208518+0000","last_fullsized":"2023-12-19T05:47:57.208518+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:33:34.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217522+0000","last_change":"2023-12-19T05:47:56.706296+0000","last_active":"2023-12-19T05:47:57.217522+0000","last_peered":"2023-12-19T05:47:57.217522+0000","last_clean":"2023-12-19T05:47:57.217522+0000","last_became_active":"2023-12-19T05:47:56.702050+0000","last_became_peered":"2023-12-19T05:47:56.702050+0000","last_unstale":"2023-12-19T05:47:57.217522+0000","last_undegraded":"2023-12-19T05:47:57.217522+0000","last_fullsized":"2023-12-19T05:47:57.217522+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:53:28.886871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.211658+0000","last_change":"2023-12-19T05:47:57.211228+0000","last_active":"2023-12-19T05:47:57.211658+0000","last_peered":"2023-12-19T05:47:57.211658+0000","last_clean":"2023-12-19T05:47:57.211658+0000","last_became_active":"2023-12-19T05:47:57.211014+0000","last_became_peered":"2023-12-19T05:47:57.211014+0000","last_unstale":"2023-12-19T05:47:57.211658+0000","last_undegraded":"2023-12-19T05:47:57.211658+0000","last_fullsized":"2023-12-19T05:47:57.211658+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:01:52.949662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.230725+0000","last_change":"2023-12-19T05:47:56.698022+0000","last_active":"2023-12-19T05:47:57.230725+0000","last_peered":"2023-12-19T05:47:57.230725+0000","last_clean":"2023-12-19T05:47:57.230725+0000","last_became_active":"2023-12-19T05:47:56.697191+0000","last_became_peered":"2023-12-19T05:47:56.697191+0000","last_unstale":"2023-12-19T05:47:57.230725+0000","last_undegraded":"2023-12-19T05:47:57.230725+0000","last_fullsized":"2023-12-19T05:47:57.230725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:16:34.614154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225302+0000","last_change":"2023-12-19T05:47:57.225226+0000","last_active":"2023-12-19T05:47:57.225302+0000","last_peered":"2023-12-19T05:47:57.225302+0000","last_clean":"2023-12-19T05:47:57.225302+0000","last_became_active":"2023-12-19T05:47:57.224002+0000","last_became_peered":"2023-12-19T05:47:57.224002+0000","last_unstale":"2023-12-19T05:47:57.225302+0000","last_undegraded":"2023-12-19T05:47:57.225302+0000","last_fullsized":"2023-12-19T05:47:57.225302+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:00.573268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224102+0000","last_change":"2023-12-19T05:47:56.712214+0000","last_active":"2023-12-19T05:47:57.224102+0000","last_peered":"2023-12-19T05:47:57.224102+0000","last_clean":"2023-12-19T05:47:57.224102+0000","last_became_active":"2023-12-19T05:47:56.710798+0000","last_became_peered":"2023-12-19T05:47:56.710798+0000","last_unstale":"2023-12-19T05:47:57.224102+0000","last_undegraded":"2023-12-19T05:47:57.224102+0000","last_fullsized":"2023-12-19T05:47:57.224102+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:25.134926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.228606+0000","last_change":"2023-12-19T05:47:57.228001+0000","last_active":"2023-12-19T05:47:57.228606+0000","last_peered":"2023-12-19T05:47:57.228606+0000","last_clean":"2023-12-19T05:47:57.228606+0000","last_became_active":"2023-12-19T05:47:57.223227+0000","last_became_peered":"2023-12-19T05:47:57.223227+0000","last_unstale":"2023-12-19T05:47:57.228606+0000","last_undegraded":"2023-12-19T05:47:57.228606+0000","last_fullsized":"2023-12-19T05:47:57.228606+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:06.962341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225134+0000","last_change":"2023-12-19T05:47:56.713894+0000","last_active":"2023-12-19T05:47:57.225134+0000","last_peered":"2023-12-19T05:47:57.225134+0000","last_clean":"2023-12-19T05:47:57.225134+0000","last_became_active":"2023-12-19T05:47:56.713159+0000","last_became_peered":"2023-12-19T05:47:56.713159+0000","last_unstale":"2023-12-19T05:47:57.225134+0000","last_undegraded":"2023-12-19T05:47:57.225134+0000","last_fullsized":"2023-12-19T05:47:57.225134+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:23.837336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.221859+0000","last_change":"2023-12-19T05:47:57.217434+0000","last_active":"2023-12-19T05:47:57.221859+0000","last_peered":"2023-12-19T05:47:57.221859+0000","last_clean":"2023-12-19T05:47:57.221859+0000","last_became_active":"2023-12-19T05:47:57.217157+0000","last_became_peered":"2023-12-19T05:47:57.217157+0000","last_unstale":"2023-12-19T05:47:57.221859+0000","last_undegraded":"2023-12-19T05:47:57.221859+0000","last_fullsized":"2023-12-19T05:47:57.221859+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:24.848639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229749+0000","last_change":"2023-12-19T05:47:56.711065+0000","last_active":"2023-12-19T05:47:57.229749+0000","last_peered":"2023-12-19T05:47:57.229749+0000","last_clean":"2023-12-19T05:47:57.229749+0000","last_became_active":"2023-12-19T05:47:56.710796+0000","last_became_peered":"2023-12-19T05:47:56.710796+0000","last_unstale":"2023-12-19T05:47:57.229749+0000","last_undegraded":"2023-12-19T05:47:57.229749+0000","last_fullsized":"2023-12-19T05:47:57.229749+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:40:18.010200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.216990+0000","last_change":"2023-12-19T05:47:57.214216+0000","last_active":"2023-12-19T05:47:57.216990+0000","last_peered":"2023-12-19T05:47:57.216990+0000","last_clean":"2023-12-19T05:47:57.216990+0000","last_became_active":"2023-12-19T05:47:57.213809+0000","last_became_peered":"2023-12-19T05:47:57.213809+0000","last_unstale":"2023-12-19T05:47:57.216990+0000","last_undegraded":"2023-12-19T05:47:57.216990+0000","last_fullsized":"2023-12-19T05:47:57.216990+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:43.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.195707+0000","last_change":"2023-12-19T05:47:56.708503+0000","last_active":"2023-12-19T05:47:57.195707+0000","last_peered":"2023-12-19T05:47:57.195707+0000","last_clean":"2023-12-19T05:47:57.195707+0000","last_became_active":"2023-12-19T05:47:56.708170+0000","last_became_peered":"2023-12-19T05:47:56.708170+0000","last_unstale":"2023-12-19T05:47:57.195707+0000","last_undegraded":"2023-12-19T05:47:57.195707+0000","last_fullsized":"2023-12-19T05:47:57.195707+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:28:58.082302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227502+0000","last_change":"2023-12-19T05:47:57.227066+0000","last_active":"2023-12-19T05:47:57.227502+0000","last_peered":"2023-12-19T05:47:57.227502+0000","last_clean":"2023-12-19T05:47:57.227502+0000","last_became_active":"2023-12-19T05:47:57.221510+0000","last_became_peered":"2023-12-19T05:47:57.221510+0000","last_unstale":"2023-12-19T05:47:57.227502+0000","last_undegraded":"2023-12-19T05:47:57.227502+0000","last_fullsized":"2023-12-19T05:47:57.227502+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:17.654996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.205721+0000","last_change":"2023-12-19T05:47:56.710354+0000","last_active":"2023-12-19T05:47:57.205721+0000","last_peered":"2023-12-19T05:47:57.205721+0000","last_clean":"2023-12-19T05:47:57.205721+0000","last_became_active":"2023-12-19T05:47:56.710106+0000","last_became_peered":"2023-12-19T05:47:56.710106+0000","last_unstale":"2023-12-19T05:47:57.205721+0000","last_undegraded":"2023-12-19T05:47:57.205721+0000","last_fullsized":"2023-12-19T05:47:57.205721+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:59.561965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227539+0000","last_change":"2023-12-19T05:47:57.227258+0000","last_active":"2023-12-19T05:47:57.227539+0000","last_peered":"2023-12-19T05:47:57.227539+0000","last_clean":"2023-12-19T05:47:57.227539+0000","last_became_active":"2023-12-19T05:47:57.224618+0000","last_became_peered":"2023-12-19T05:47:57.224618+0000","last_unstale":"2023-12-19T05:47:57.227539+0000","last_undegraded":"2023-12-19T05:47:57.227539+0000","last_fullsized":"2023-12-19T05:47:57.227539+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:10:09.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.207624+0000","last_change":"2023-12-19T05:47:56.700751+0000","last_active":"2023-12-19T05:47:57.207624+0000","last_peered":"2023-12-19T05:47:57.207624+0000","last_clean":"2023-12-19T05:47:57.207624+0000","last_became_active":"2023-12-19T05:47:56.700436+0000","last_became_peered":"2023-12-19T05:47:56.700436+0000","last_unstale":"2023-12-19T05:47:57.207624+0000","last_undegraded":"2023-12-19T05:47:57.207624+0000","last_fullsized":"2023-12-19T05:47:57.207624+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:54.246012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.220738+0000","last_change":"2023-12-19T05:47:57.220665+0000","last_active":"2023-12-19T05:47:57.220738+0000","last_peered":"2023-12-19T05:47:57.220738+0000","last_clean":"2023-12-19T05:47:57.220738+0000","last_became_active":"2023-12-19T05:47:57.220426+0000","last_became_peered":"2023-12-19T05:47:57.220426+0000","last_unstale":"2023-12-19T05:47:57.220738+0000","last_undegraded":"2023-12-19T05:47:57.220738+0000","last_fullsized":"2023-12-19T05:47:57.220738+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:45:24.007559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.220245+0000","last_change":"2023-12-19T05:47:56.700399+0000","last_active":"2023-12-19T05:47:57.220245+0000","last_peered":"2023-12-19T05:47:57.220245+0000","last_clean":"2023-12-19T05:47:57.220245+0000","last_became_active":"2023-12-19T05:47:56.699903+0000","last_became_peered":"2023-12-19T05:47:56.699903+0000","last_unstale":"2023-12-19T05:47:57.220245+0000","last_undegraded":"2023-12-19T05:47:57.220245+0000","last_fullsized":"2023-12-19T05:47:57.220245+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:12.592607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217047+0000","last_change":"2023-12-19T05:47:57.215802+0000","last_active":"2023-12-19T05:47:57.217047+0000","last_peered":"2023-12-19T05:47:57.217047+0000","last_clean":"2023-12-19T05:47:57.217047+0000","last_became_active":"2023-12-19T05:47:57.212742+0000","last_became_peered":"2023-12-19T05:47:57.212742+0000","last_unstale":"2023-12-19T05:47:57.217047+0000","last_undegraded":"2023-12-19T05:47:57.217047+0000","last_fullsized":"2023-12-19T05:47:57.217047+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:44:25.440727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"160'3","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.221269+0000","last_change":"2023-12-19T05:47:56.709780+0000","last_active":"2023-12-19T05:47:57.221269+0000","last_peered":"2023-12-19T05:47:57.221269+0000","last_clean":"2023-12-19T05:47:57.221269+0000","last_became_active":"2023-12-19T05:47:56.708383+0000","last_became_peered":"2023-12-19T05:47:56.708383+0000","last_unstale":"2023-12-19T05:47:57.221269+0000","last_undegraded":"2023-12-19T05:47:57.221269+0000","last_fullsized":"2023-12-19T05:47:57.221269+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:56:55.047548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.218809+0000","last_change":"2023-12-19T05:47:57.218733+0000","last_active":"2023-12-19T05:47:57.218809+0000","last_peered":"2023-12-19T05:47:57.218809+0000","last_clean":"2023-12-19T05:47:57.218809+0000","last_became_active":"2023-12-19T05:47:57.218351+0000","last_became_peered":"2023-12-19T05:47:57.218351+0000","last_unstale":"2023-12-19T05:47:57.218809+0000","last_undegraded":"2023-12-19T05:47:57.218809+0000","last_fullsized":"2023-12-19T05:47:57.218809+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:16.042300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"160'6","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227139+0000","last_change":"2023-12-19T05:47:56.694622+0000","last_active":"2023-12-19T05:47:57.227139+0000","last_peered":"2023-12-19T05:47:57.227139+0000","last_clean":"2023-12-19T05:47:57.227139+0000","last_became_active":"2023-12-19T05:47:56.693861+0000","last_became_peered":"2023-12-19T05:47:56.693861+0000","last_unstale":"2023-12-19T05:47:57.227139+0000","last_undegraded":"2023-12-19T05:47:57.227139+0000","last_fullsized":"2023-12-19T05:47:57.227139+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:35:12.113488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227038+0000","last_change":"2023-12-19T05:47:57.226709+0000","last_active":"2023-12-19T05:47:57.227038+0000","last_peered":"2023-12-19T05:47:57.227038+0000","last_clean":"2023-12-19T05:47:57.227038+0000","last_became_active":"2023-12-19T05:47:57.226441+0000","last_became_peered":"2023-12-19T05:47:57.226441+0000","last_unstale":"2023-12-19T05:47:57.227038+0000","last_undegraded":"2023-12-19T05:47:57.227038+0000","last_fullsized":"2023-12-19T05:47:57.227038+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:34.211997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.214971+0000","last_change":"2023-12-19T05:47:56.712114+0000","last_active":"2023-12-19T05:47:57.214971+0000","last_peered":"2023-12-19T05:47:57.214971+0000","last_clean":"2023-12-19T05:47:57.214971+0000","last_became_active":"2023-12-19T05:47:56.711890+0000","last_became_peered":"2023-12-19T05:47:56.711890+0000","last_unstale":"2023-12-19T05:47:57.214971+0000","last_undegraded":"2023-12-19T05:47:57.214971+0000","last_fullsized":"2023-12-19T05:47:57.214971+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:08:25.851391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.219349+0000","last_change":"2023-12-19T05:47:57.218731+0000","last_active":"2023-12-19T05:47:57.219349+0000","last_peered":"2023-12-19T05:47:57.219349+0000","last_clean":"2023-12-19T05:47:57.219349+0000","last_became_active":"2023-12-19T05:47:57.218245+0000","last_became_peered":"2023-12-19T05:47:57.218245+0000","last_unstale":"2023-12-19T05:47:57.219349+0000","last_undegraded":"2023-12-19T05:47:57.219349+0000","last_fullsized":"2023-12-19T05:47:57.219349+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:16:35.625458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.200827+0000","last_change":"2023-12-19T05:47:56.699728+0000","last_active":"2023-12-19T05:47:57.200827+0000","last_peered":"2023-12-19T05:47:57.200827+0000","last_clean":"2023-12-19T05:47:57.200827+0000","last_became_active":"2023-12-19T05:47:56.699152+0000","last_became_peered":"2023-12-19T05:47:56.699152+0000","last_unstale":"2023-12-19T05:47:57.200827+0000","last_undegraded":"2023-12-19T05:47:57.200827+0000","last_fullsized":"2023-12-19T05:47:57.200827+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:35.226099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217013+0000","last_change":"2023-12-19T05:47:57.214985+0000","last_active":"2023-12-19T05:47:57.217013+0000","last_peered":"2023-12-19T05:47:57.217013+0000","last_clean":"2023-12-19T05:47:57.217013+0000","last_became_active":"2023-12-19T05:47:57.212803+0000","last_became_peered":"2023-12-19T05:47:57.212803+0000","last_unstale":"2023-12-19T05:47:57.217013+0000","last_undegraded":"2023-12-19T05:47:57.217013+0000","last_fullsized":"2023-12-19T05:47:57.217013+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:28:44.419770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"160'8","reported_seq":18,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.224665+0000","last_change":"2023-12-19T05:47:56.710300+0000","last_active":"2023-12-19T05:47:57.224665+0000","last_peered":"2023-12-19T05:47:57.224665+0000","last_clean":"2023-12-19T05:47:57.224665+0000","last_became_active":"2023-12-19T05:47:56.710071+0000","last_became_peered":"2023-12-19T05:47:56.710071+0000","last_unstale":"2023-12-19T05:47:57.224665+0000","last_undegraded":"2023-12-19T05:47:57.224665+0000","last_fullsized":"2023-12-19T05:47:57.224665+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:30:50.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.221372+0000","last_change":"2023-12-19T05:47:57.221133+0000","last_active":"2023-12-19T05:47:57.221372+0000","last_peered":"2023-12-19T05:47:57.221372+0000","last_clean":"2023-12-19T05:47:57.221372+0000","last_became_active":"2023-12-19T05:47:57.220817+0000","last_became_peered":"2023-12-19T05:47:57.220817+0000","last_unstale":"2023-12-19T05:47:57.221372+0000","last_undegraded":"2023-12-19T05:47:57.221372+0000","last_fullsized":"2023-12-19T05:47:57.221372+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:21:10.408699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.212542+0000","last_change":"2023-12-19T05:47:56.697888+0000","last_active":"2023-12-19T05:47:57.212542+0000","last_peered":"2023-12-19T05:47:57.212542+0000","last_clean":"2023-12-19T05:47:57.212542+0000","last_became_active":"2023-12-19T05:47:56.695517+0000","last_became_peered":"2023-12-19T05:47:56.695517+0000","last_unstale":"2023-12-19T05:47:57.212542+0000","last_undegraded":"2023-12-19T05:47:57.212542+0000","last_fullsized":"2023-12-19T05:47:57.212542+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:59:58.474673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225457+0000","last_change":"2023-12-19T05:47:57.225122+0000","last_active":"2023-12-19T05:47:57.225457+0000","last_peered":"2023-12-19T05:47:57.225457+0000","last_clean":"2023-12-19T05:47:57.225457+0000","last_became_active":"2023-12-19T05:47:57.224880+0000","last_became_peered":"2023-12-19T05:47:57.224880+0000","last_unstale":"2023-12-19T05:47:57.225457+0000","last_undegraded":"2023-12-19T05:47:57.225457+0000","last_fullsized":"2023-12-19T05:47:57.225457+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:29.599064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.226730+0000","last_change":"2023-12-19T05:47:56.704093+0000","last_active":"2023-12-19T05:47:57.226730+0000","last_peered":"2023-12-19T05:47:57.226730+0000","last_clean":"2023-12-19T05:47:57.226730+0000","last_became_active":"2023-12-19T05:47:56.703618+0000","last_became_peered":"2023-12-19T05:47:56.703618+0000","last_unstale":"2023-12-19T05:47:57.226730+0000","last_undegraded":"2023-12-19T05:47:57.226730+0000","last_fullsized":"2023-12-19T05:47:57.226730+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:42.367587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.219672+0000","last_change":"2023-12-19T05:47:57.218993+0000","last_active":"2023-12-19T05:47:57.219672+0000","last_peered":"2023-12-19T05:47:57.219672+0000","last_clean":"2023-12-19T05:47:57.219672+0000","last_became_active":"2023-12-19T05:47:57.215628+0000","last_became_peered":"2023-12-19T05:47:57.215628+0000","last_unstale":"2023-12-19T05:47:57.219672+0000","last_undegraded":"2023-12-19T05:47:57.219672+0000","last_fullsized":"2023-12-19T05:47:57.219672+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:13.345883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225031+0000","last_change":"2023-12-19T05:47:56.706133+0000","last_active":"2023-12-19T05:47:57.225031+0000","last_peered":"2023-12-19T05:47:57.225031+0000","last_clean":"2023-12-19T05:47:57.225031+0000","last_became_active":"2023-12-19T05:47:56.705551+0000","last_became_peered":"2023-12-19T05:47:56.705551+0000","last_unstale":"2023-12-19T05:47:57.225031+0000","last_undegraded":"2023-12-19T05:47:57.225031+0000","last_fullsized":"2023-12-19T05:47:57.225031+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:09:14.164035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.226678+0000","last_change":"2023-12-19T05:47:57.226579+0000","last_active":"2023-12-19T05:47:57.226678+0000","last_peered":"2023-12-19T05:47:57.226678+0000","last_clean":"2023-12-19T05:47:57.226678+0000","last_became_active":"2023-12-19T05:47:57.226168+0000","last_became_peered":"2023-12-19T05:47:57.226168+0000","last_unstale":"2023-12-19T05:47:57.226678+0000","last_undegraded":"2023-12-19T05:47:57.226678+0000","last_fullsized":"2023-12-19T05:47:57.226678+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:03:29.146790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.204691+0000","last_change":"2023-12-19T05:47:56.714529+0000","last_active":"2023-12-19T05:47:57.204691+0000","last_peered":"2023-12-19T05:47:57.204691+0000","last_clean":"2023-12-19T05:47:57.204691+0000","last_became_active":"2023-12-19T05:47:56.714272+0000","last_became_peered":"2023-12-19T05:47:56.714272+0000","last_unstale":"2023-12-19T05:47:57.204691+0000","last_undegraded":"2023-12-19T05:47:57.204691+0000","last_fullsized":"2023-12-19T05:47:57.204691+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:12.892153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.216769+0000","last_change":"2023-12-19T05:47:57.215755+0000","last_active":"2023-12-19T05:47:57.216769+0000","last_peered":"2023-12-19T05:47:57.216769+0000","last_clean":"2023-12-19T05:47:57.216769+0000","last_became_active":"2023-12-19T05:47:57.215399+0000","last_became_peered":"2023-12-19T05:47:57.215399+0000","last_unstale":"2023-12-19T05:47:57.216769+0000","last_undegraded":"2023-12-19T05:47:57.216769+0000","last_fullsized":"2023-12-19T05:47:57.216769+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:27:01.584776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.222589+0000","last_change":"2023-12-19T05:47:56.700339+0000","last_active":"2023-12-19T05:47:57.222589+0000","last_peered":"2023-12-19T05:47:57.222589+0000","last_clean":"2023-12-19T05:47:57.222589+0000","last_became_active":"2023-12-19T05:47:56.698863+0000","last_became_peered":"2023-12-19T05:47:56.698863+0000","last_unstale":"2023-12-19T05:47:57.222589+0000","last_undegraded":"2023-12-19T05:47:57.222589+0000","last_fullsized":"2023-12-19T05:47:57.222589+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:15.121513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.214795+0000","last_change":"2023-12-19T05:47:57.214648+0000","last_active":"2023-12-19T05:47:57.214795+0000","last_peered":"2023-12-19T05:47:57.214795+0000","last_clean":"2023-12-19T05:47:57.214795+0000","last_became_active":"2023-12-19T05:47:57.214391+0000","last_became_peered":"2023-12-19T05:47:57.214391+0000","last_unstale":"2023-12-19T05:47:57.214795+0000","last_undegraded":"2023-12-19T05:47:57.214795+0000","last_fullsized":"2023-12-19T05:47:57.214795+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:06.962341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.210456+0000","last_change":"2023-12-19T05:47:56.697466+0000","last_active":"2023-12-19T05:47:57.210456+0000","last_peered":"2023-12-19T05:47:57.210456+0000","last_clean":"2023-12-19T05:47:57.210456+0000","last_became_active":"2023-12-19T05:47:56.696721+0000","last_became_peered":"2023-12-19T05:47:56.696721+0000","last_unstale":"2023-12-19T05:47:57.210456+0000","last_undegraded":"2023-12-19T05:47:57.210456+0000","last_fullsized":"2023-12-19T05:47:57.210456+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:31:22.142037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229085+0000","last_change":"2023-12-19T05:47:57.228939+0000","last_active":"2023-12-19T05:47:57.229085+0000","last_peered":"2023-12-19T05:47:57.229085+0000","last_clean":"2023-12-19T05:47:57.229085+0000","last_became_active":"2023-12-19T05:47:57.228705+0000","last_became_peered":"2023-12-19T05:47:57.228705+0000","last_unstale":"2023-12-19T05:47:57.229085+0000","last_undegraded":"2023-12-19T05:47:57.229085+0000","last_fullsized":"2023-12-19T05:47:57.229085+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:37:07.686223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.216889+0000","last_change":"2023-12-19T05:47:56.708017+0000","last_active":"2023-12-19T05:47:57.216889+0000","last_peered":"2023-12-19T05:47:57.216889+0000","last_clean":"2023-12-19T05:47:57.216889+0000","last_became_active":"2023-12-19T05:47:56.707756+0000","last_became_peered":"2023-12-19T05:47:56.707756+0000","last_unstale":"2023-12-19T05:47:57.216889+0000","last_undegraded":"2023-12-19T05:47:57.216889+0000","last_fullsized":"2023-12-19T05:47:57.216889+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:42.577046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225939+0000","last_change":"2023-12-19T05:47:57.225339+0000","last_active":"2023-12-19T05:47:57.225939+0000","last_peered":"2023-12-19T05:47:57.225939+0000","last_clean":"2023-12-19T05:47:57.225939+0000","last_became_active":"2023-12-19T05:47:57.225011+0000","last_became_peered":"2023-12-19T05:47:57.225011+0000","last_unstale":"2023-12-19T05:47:57.225939+0000","last_undegraded":"2023-12-19T05:47:57.225939+0000","last_fullsized":"2023-12-19T05:47:57.225939+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:36.628039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.201792+0000","last_change":"2023-12-19T05:47:56.704390+0000","last_active":"2023-12-19T05:47:57.201792+0000","last_peered":"2023-12-19T05:47:57.201792+0000","last_clean":"2023-12-19T05:47:57.201792+0000","last_became_active":"2023-12-19T05:47:56.701634+0000","last_became_peered":"2023-12-19T05:47:56.701634+0000","last_unstale":"2023-12-19T05:47:57.201792+0000","last_undegraded":"2023-12-19T05:47:57.201792+0000","last_fullsized":"2023-12-19T05:47:57.201792+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:51:29.365133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.218673+0000","last_change":"2023-12-19T05:47:57.218610+0000","last_active":"2023-12-19T05:47:57.218673+0000","last_peered":"2023-12-19T05:47:57.218673+0000","last_clean":"2023-12-19T05:47:57.218673+0000","last_became_active":"2023-12-19T05:47:57.218029+0000","last_became_peered":"2023-12-19T05:47:57.218029+0000","last_unstale":"2023-12-19T05:47:57.218673+0000","last_undegraded":"2023-12-19T05:47:57.218673+0000","last_fullsized":"2023-12-19T05:47:57.218673+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:57.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227623+0000","last_change":"2023-12-19T05:47:56.697790+0000","last_active":"2023-12-19T05:47:57.227623+0000","last_peered":"2023-12-19T05:47:57.227623+0000","last_clean":"2023-12-19T05:47:57.227623+0000","last_became_active":"2023-12-19T05:47:56.697009+0000","last_became_peered":"2023-12-19T05:47:56.697009+0000","last_unstale":"2023-12-19T05:47:57.227623+0000","last_undegraded":"2023-12-19T05:47:57.227623+0000","last_fullsized":"2023-12-19T05:47:57.227623+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:38:36.959492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.216790+0000","last_change":"2023-12-19T05:47:57.216264+0000","last_active":"2023-12-19T05:47:57.216790+0000","last_peered":"2023-12-19T05:47:57.216790+0000","last_clean":"2023-12-19T05:47:57.216790+0000","last_became_active":"2023-12-19T05:47:57.214563+0000","last_became_peered":"2023-12-19T05:47:57.214563+0000","last_unstale":"2023-12-19T05:47:57.216790+0000","last_undegraded":"2023-12-19T05:47:57.216790+0000","last_fullsized":"2023-12-19T05:47:57.216790+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:00.020426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.208220+0000","last_change":"2023-12-19T05:47:56.710042+0000","last_active":"2023-12-19T05:47:57.208220+0000","last_peered":"2023-12-19T05:47:57.208220+0000","last_clean":"2023-12-19T05:47:57.208220+0000","last_became_active":"2023-12-19T05:47:56.708759+0000","last_became_peered":"2023-12-19T05:47:56.708759+0000","last_unstale":"2023-12-19T05:47:57.208220+0000","last_undegraded":"2023-12-19T05:47:57.208220+0000","last_fullsized":"2023-12-19T05:47:57.208220+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:29:06.091177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.220631+0000","last_change":"2023-12-19T05:47:57.220059+0000","last_active":"2023-12-19T05:47:57.220631+0000","last_peered":"2023-12-19T05:47:57.220631+0000","last_clean":"2023-12-19T05:47:57.220631+0000","last_became_active":"2023-12-19T05:47:57.219772+0000","last_became_peered":"2023-12-19T05:47:57.219772+0000","last_unstale":"2023-12-19T05:47:57.220631+0000","last_undegraded":"2023-12-19T05:47:57.220631+0000","last_fullsized":"2023-12-19T05:47:57.220631+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:18.307014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.227605+0000","last_change":"2023-12-19T05:47:56.709164+0000","last_active":"2023-12-19T05:47:57.227605+0000","last_peered":"2023-12-19T05:47:57.227605+0000","last_clean":"2023-12-19T05:47:57.227605+0000","last_became_active":"2023-12-19T05:47:56.708673+0000","last_became_peered":"2023-12-19T05:47:56.708673+0000","last_unstale":"2023-12-19T05:47:57.227605+0000","last_undegraded":"2023-12-19T05:47:57.227605+0000","last_fullsized":"2023-12-19T05:47:57.227605+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:22.342986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229552+0000","last_change":"2023-12-19T05:47:57.229503+0000","last_active":"2023-12-19T05:47:57.229552+0000","last_peered":"2023-12-19T05:47:57.229552+0000","last_clean":"2023-12-19T05:47:57.229552+0000","last_became_active":"2023-12-19T05:47:57.229195+0000","last_became_peered":"2023-12-19T05:47:57.229195+0000","last_unstale":"2023-12-19T05:47:57.229552+0000","last_undegraded":"2023-12-19T05:47:57.229552+0000","last_fullsized":"2023-12-19T05:47:57.229552+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:00.190892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.217076+0000","last_change":"2023-12-19T05:47:56.710228+0000","last_active":"2023-12-19T05:47:57.217076+0000","last_peered":"2023-12-19T05:47:57.217076+0000","last_clean":"2023-12-19T05:47:57.217076+0000","last_became_active":"2023-12-19T05:47:56.709969+0000","last_became_peered":"2023-12-19T05:47:56.709969+0000","last_unstale":"2023-12-19T05:47:57.217076+0000","last_undegraded":"2023-12-19T05:47:57.217076+0000","last_fullsized":"2023-12-19T05:47:57.217076+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:00.513843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.213978+0000","last_change":"2023-12-19T05:47:57.212151+0000","last_active":"2023-12-19T05:47:57.213978+0000","last_peered":"2023-12-19T05:47:57.213978+0000","last_clean":"2023-12-19T05:47:57.213978+0000","last_became_active":"2023-12-19T05:47:57.211888+0000","last_became_peered":"2023-12-19T05:47:57.211888+0000","last_unstale":"2023-12-19T05:47:57.213978+0000","last_undegraded":"2023-12-19T05:47:57.213978+0000","last_fullsized":"2023-12-19T05:47:57.213978+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:26.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.211010+0000","last_change":"2023-12-19T05:47:56.712473+0000","last_active":"2023-12-19T05:47:57.211010+0000","last_peered":"2023-12-19T05:47:57.211010+0000","last_clean":"2023-12-19T05:47:57.211010+0000","last_became_active":"2023-12-19T05:47:56.711836+0000","last_became_peered":"2023-12-19T05:47:56.711836+0000","last_unstale":"2023-12-19T05:47:57.211010+0000","last_undegraded":"2023-12-19T05:47:57.211010+0000","last_fullsized":"2023-12-19T05:47:57.211010+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:35.616735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.225983+0000","last_change":"2023-12-19T05:47:57.225692+0000","last_active":"2023-12-19T05:47:57.225983+0000","last_peered":"2023-12-19T05:47:57.225983+0000","last_clean":"2023-12-19T05:47:57.225983+0000","last_became_active":"2023-12-19T05:47:57.225437+0000","last_became_peered":"2023-12-19T05:47:57.225437+0000","last_unstale":"2023-12-19T05:47:57.225983+0000","last_undegraded":"2023-12-19T05:47:57.225983+0000","last_fullsized":"2023-12-19T05:47:57.225983+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:35.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.205984+0000","last_change":"2023-12-19T05:47:56.702949+0000","last_active":"2023-12-19T05:47:57.205984+0000","last_peered":"2023-12-19T05:47:57.205984+0000","last_clean":"2023-12-19T05:47:57.205984+0000","last_became_active":"2023-12-19T05:47:56.700825+0000","last_became_peered":"2023-12-19T05:47:56.700825+0000","last_unstale":"2023-12-19T05:47:57.205984+0000","last_undegraded":"2023-12-19T05:47:57.205984+0000","last_fullsized":"2023-12-19T05:47:57.205984+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:50:38.603374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.229356+0000","last_change":"2023-12-19T05:47:57.229289+0000","last_active":"2023-12-19T05:47:57.229356+0000","last_peered":"2023-12-19T05:47:57.229356+0000","last_clean":"2023-12-19T05:47:57.229356+0000","last_became_active":"2023-12-19T05:47:57.228828+0000","last_became_peered":"2023-12-19T05:47:57.228828+0000","last_unstale":"2023-12-19T05:47:57.229356+0000","last_undegraded":"2023-12-19T05:47:57.229356+0000","last_fullsized":"2023-12-19T05:47:57.229356+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:16.042300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.204427+0000","last_change":"2023-12-19T05:47:56.701228+0000","last_active":"2023-12-19T05:47:57.204427+0000","last_peered":"2023-12-19T05:47:57.204427+0000","last_clean":"2023-12-19T05:47:57.204427+0000","last_became_active":"2023-12-19T05:47:56.700123+0000","last_became_peered":"2023-12-19T05:47:56.700123+0000","last_unstale":"2023-12-19T05:47:57.204427+0000","last_undegraded":"2023-12-19T05:47:57.204427+0000","last_fullsized":"2023-12-19T05:47:57.204427+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:18.933469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.223128+0000","last_change":"2023-12-19T05:47:57.222809+0000","last_active":"2023-12-19T05:47:57.223128+0000","last_peered":"2023-12-19T05:47:57.223128+0000","last_clean":"2023-12-19T05:47:57.223128+0000","last_became_active":"2023-12-19T05:47:57.221041+0000","last_became_peered":"2023-12-19T05:47:57.221041+0000","last_unstale":"2023-12-19T05:47:57.223128+0000","last_undegraded":"2023-12-19T05:47:57.223128+0000","last_fullsized":"2023-12-19T05:47:57.223128+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:43.378890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.207443+0000","last_change":"2023-12-19T05:47:56.710838+0000","last_active":"2023-12-19T05:47:57.207443+0000","last_peered":"2023-12-19T05:47:57.207443+0000","last_clean":"2023-12-19T05:47:57.207443+0000","last_became_active":"2023-12-19T05:47:56.710599+0000","last_became_peered":"2023-12-19T05:47:56.710599+0000","last_unstale":"2023-12-19T05:47:57.207443+0000","last_undegraded":"2023-12-19T05:47:57.207443+0000","last_fullsized":"2023-12-19T05:47:57.207443+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:32.755391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.203582+0000","last_change":"2023-12-19T05:47:57.203515+0000","last_active":"2023-12-19T05:47:57.203582+0000","last_peered":"2023-12-19T05:47:57.203582+0000","last_clean":"2023-12-19T05:47:57.203582+0000","last_became_active":"2023-12-19T05:47:57.203329+0000","last_became_peered":"2023-12-19T05:47:57.203329+0000","last_unstale":"2023-12-19T05:47:57.203582+0000","last_undegraded":"2023-12-19T05:47:57.203582+0000","last_fullsized":"2023-12-19T05:47:57.203582+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:06.860178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.223003+0000","last_change":"2023-12-19T05:47:56.711837+0000","last_active":"2023-12-19T05:47:57.223003+0000","last_peered":"2023-12-19T05:47:57.223003+0000","last_clean":"2023-12-19T05:47:57.223003+0000","last_became_active":"2023-12-19T05:47:56.711589+0000","last_became_peered":"2023-12-19T05:47:56.711589+0000","last_unstale":"2023-12-19T05:47:57.223003+0000","last_undegraded":"2023-12-19T05:47:57.223003+0000","last_fullsized":"2023-12-19T05:47:57.223003+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:12.781553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-19T05:47:56.682341+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:47:56.682341+0000","last_peered":"2023-12-19T05:47:56.682341+0000","last_clean":"2023-12-19T05:47:56.682341+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:47:56.682341+0000","last_undegraded":"2023-12-19T05:47:56.682341+0000","last_fullsized":"2023-12-19T05:47:56.682341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.1359999999999999,"15min":1.0600000000000001},"min":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.554,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.145,"15min":1.0780000000000001},"min":{"1min":0.73099999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4119999999999999,"5min":3.976,"15min":3.976},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1859999999999999,"15min":1.1080000000000001},"min":{"1min":0.76900000000000002,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":1.387,"5min":6.399,"15min":6.399},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.204,"5min":1.2230000000000001,"15min":1.173},"min":{"1min":0.78500000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.6599999999999999,"5min":4.25,"15min":4.25},"last":1.228}]},{"osd":2,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.72199999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3640000000000001,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.97599999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.345,"15min":1.2070000000000001},"min":{"1min":0.94899999999999995,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":1.776,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.381},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.411,"15min":1.3360000000000001},"min":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":1.6890000000000001,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.403}]},{"osd":4,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1859999999999999,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.345,"15min":1.2789999999999999},"min":{"1min":0.79600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.917,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.544}]},{"osd":5,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3879999999999999,"15min":1.333},"min":{"1min":0.82399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.1480000000000001,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.339,"15min":1.26},"min":{"1min":0.72699999999999998,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":1.631,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.4870000000000001,"15min":1.3720000000000001},"min":{"1min":0.77500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0310000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.655},{"interface":"front","average":{"1min":1.474,"5min":1.5609999999999999,"15min":1.4370000000000001},"min":{"1min":0.93999999999999995,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":2.0139999999999998,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.6319999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.171},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4970000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.0660000000000001,"15min":1.038},"min":{"1min":0.621,"5min":0.621,"15min":0.46500000000000002},"max":{"1min":1.4179999999999999,"5min":1.635,"15min":1.635},"last":0.73799999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.159},"min":{"1min":0.85799999999999998,"5min":0.66900000000000004,"15min":0.64900000000000002},"max":{"1min":1.5449999999999999,"5min":1.792,"15min":1.792},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2270000000000001,"15min":1.29},"min":{"1min":0.90200000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":3.4670000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.141,"15min":1.177},"min":{"1min":0.77700000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.619},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1990000000000001,"15min":1.2769999999999999},"min":{"1min":0.90100000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5349999999999999,"5min":1.6699999999999999,"15min":3.5859999999999999},"last":1.087}]},{"osd":3,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1759999999999999,"15min":1.306},"min":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.70799999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.5220000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.262,"15min":1.341},"min":{"1min":1.097,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.885,"5min":2.0059999999999998,"15min":4.452},"last":1.702}]},{"osd":4,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.1870000000000001,"15min":1.302},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7470000000000001,"15min":2.7130000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.226,"15min":1.3899999999999999},"min":{"1min":0.88700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":4.6689999999999996},"last":0.85599999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.365,"15min":1.5169999999999999},"min":{"1min":0.92800000000000005,"5min":0.56799999999999995,"15min":0.53900000000000003},"max":{"1min":1.9099999999999999,"5min":2.0179999999999998,"15min":4.5670000000000002},"last":1.522},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4350000000000001,"15min":1.653},"min":{"1min":1.1279999999999999,"5min":0.64000000000000001,"15min":0.63400000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":3.681},"last":1.3500000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3999999999999999,"15min":1.492},"min":{"1min":0.999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.96,"5min":1.96,"15min":3.2719999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.659,"5min":1.5209999999999999,"15min":1.595},"min":{"1min":1.3380000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":4.7480000000000002},"last":1.788}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1452,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193859,"statfs":{"total":200000000,"available":198512463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":2.9620000000000002,"15min":6.9420000000000002},"last":1.27},{"interface":"front","average":{"1min":1.036,"5min":1.1579999999999999,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.438},"max":{"1min":1.5700000000000001,"5min":2.1219999999999999,"15min":2.641},"last":1.177}]},{"osd":1,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.208,"15min":1.228},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.56299999999999994},"max":{"1min":1.5209999999999999,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.008},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.3049999999999999,"15min":1.355},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.65600000000000003},"max":{"1min":1.6319999999999999,"5min":2.2890000000000001,"15min":6.8700000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.2150000000000001,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.516,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.206,"15min":1.212},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.677,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.3380000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2929999999999999,"15min":1.4159999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.61899999999999999},"max":{"1min":1.7669999999999999,"5min":2.774,"15min":6.9969999999999999},"last":1.377},{"interface":"front","average":{"1min":1.177,"5min":1.333,"15min":1.399},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.992,"15min":2.992},"last":1.4970000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.238,"15min":1.4299999999999999},"min":{"1min":0.65800000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5589999999999999,"5min":3.2040000000000002,"15min":6.3559999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.528},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.8859999999999999,"5min":3.0499999999999998,"15min":7.0469999999999997},"last":1.5629999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.407,"15min":1.478},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6739999999999999,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.645},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4239999999999999,"15min":1.5960000000000001},"min":{"1min":0.78500000000000003,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0190000000000001,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.5329999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.512,"15min":1.6659999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":3.2639999999999998,"15min":7.0949999999999998},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.5860000000000001,"15min":1.607},"min":{"1min":0.80100000000000005,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":1.905,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.837}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.073,"15min":1.0249999999999999},"min":{"1min":0.58599999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1279999999999999,"15min":1.077},"min":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.403}]},{"osd":1,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.677,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.153},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.222,"15min":1.095},"min":{"1min":0.81799999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8600000000000001,"5min":1.954,"15min":1.954},"last":1.0149999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.206,"15min":1.2},"min":{"1min":0.748,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.8380000000000001},"last":1.464},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2649999999999999,"15min":1.226},"min":{"1min":0.77800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.111}]},{"osd":3,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.236,"15min":1.115},"min":{"1min":0.66200000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1079999999999997,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.3240000000000001,"15min":1.292},"min":{"1min":0.82499999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5129999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.587}]},{"osd":5,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.351},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.825,"5min":2.081,"15min":2.081},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.4299999999999999,"15min":1.323},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.2160000000000002,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":1.5409999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.397,"15min":1.3740000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.47,"15min":1.419},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.3340000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.49,"15min":1.3879999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":5.484,"5min":5.484,"15min":5.484},"last":1.494},{"interface":"front","average":{"1min":1.409,"5min":1.51,"15min":1.472},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0099999999999998,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.6830000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.314,"15min":0.314},"max":{"1min":1.6919999999999999,"5min":1.99,"15min":1.99},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":0.83999999999999997},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.34999999999999998},"max":{"1min":1.464,"5min":1.72,"15min":1.72},"last":0.502}]},{"osd":1,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.879,"15min":0.90200000000000002},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.393,"5min":1.6060000000000001,"15min":2.702},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0740000000000001,"15min":0.97499999999999998},"min":{"1min":0.624,"5min":0.45800000000000002,"15min":0.39100000000000001},"max":{"1min":1.4350000000000001,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.57299999999999995}]},{"osd":2,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0880000000000001,"15min":0.96599999999999997},"min":{"1min":0.501,"5min":0.47299999999999998,"15min":0.45200000000000001},"max":{"1min":1.7410000000000001,"5min":1.796,"15min":1.796},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.24,"5min":1.228,"15min":1.1100000000000001},"min":{"1min":0.81699999999999995,"5min":0.498,"15min":0.45600000000000002},"max":{"1min":1.5229999999999999,"5min":2.931,"15min":2.931},"last":0.628}]},{"osd":4,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1870000000000001,"15min":1.161},"min":{"1min":0.91900000000000004,"5min":0.58199999999999996,"15min":0.51400000000000001},"max":{"1min":1.716,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.256,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3660000000000001,"15min":1.327},"min":{"1min":0.88300000000000001,"5min":0.77700000000000002,"15min":0.75600000000000001},"max":{"1min":1.829,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":0.97599999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.581,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4330000000000001,"15min":1.375},"min":{"1min":1.038,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":1.6819999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.341,"15min":1.327},"min":{"1min":0.84099999999999997,"5min":0.69799999999999995,"15min":0.69199999999999995},"max":{"1min":1.8680000000000001,"5min":1.9730000000000001,"15min":2.02},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4099999999999999,"15min":1.389},"min":{"1min":0.79300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.929,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.403,"5min":1.4339999999999999,"15min":1.425},"min":{"1min":0.82299999999999995,"5min":0.748,"15min":0.70099999999999996},"max":{"1min":1.776,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":0.88500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.84799999999999998,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.341,"5min":1.516,"15min":1.516},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94899999999999995,"15min":0.91700000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8660000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1499999999999999,"15min":1.0680000000000001},"min":{"1min":0.64900000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.2330000000000001,"15min":1.163},"min":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5629999999999999,"5min":1.867,"15min":1.867},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97699999999999998,"15min":0.92800000000000005},"min":{"1min":0.54700000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2689999999999999,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":0.62},{"interface":"front","average":{"1min":1.202,"5min":1.2250000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6439999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.749}]},{"osd":4,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3740000000000001,"15min":1.2869999999999999},"min":{"1min":0.82399999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.8879999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.024},{"interface":"front","average":{"1min":1.343,"5min":1.331,"15min":1.256},"min":{"1min":0.88100000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.3370000000000002},"last":0.89100000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.385,"15min":1.302},"min":{"1min":0.80700000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.732,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.2},{"interface":"front","average":{"1min":1.361,"5min":1.343,"15min":1.302},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.72699999999999998},"max":{"1min":2.21,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":0.95699999999999996}]},{"osd":6,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.327,"15min":1.294},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.655,"5min":1.897,"15min":2.0950000000000002},"last":0.875},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.4870000000000001,"15min":1.3640000000000001},"min":{"1min":1.018,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.153,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1850000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.522,"15min":1.4350000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.84799999999999998},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.4350000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5289999999999999,"15min":1.4430000000000001},"min":{"1min":1.0489999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8260000000000001,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.3069999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193859,"statfs":{"total":200000000,"available":198511619,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88800000000000001,"15min":0.92100000000000004},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.4650000000000001,"5min":1.504,"15min":2.992},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.43099999999999999},"max":{"1min":1.4059999999999999,"5min":1.704,"15min":3.5169999999999999},"last":1.3089999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.89700000000000002,"15min":0.94699999999999995},"min":{"1min":0.45000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.5,"5min":1.577,"15min":2.2789999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.105,"15min":1.333},"min":{"1min":0.57599999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.879,"5min":1.879,"15min":70.206000000000003},"last":0.91800000000000004}]},{"osd":3,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":3.5670000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.242,"15min":1.232},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":1.8089999999999999,"5min":2.3580000000000001,"15min":3.1920000000000002},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3120000000000001,"15min":1.2370000000000001},"min":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":1.7709999999999999,"5min":2.3969999999999998,"15min":5.3860000000000001},"last":1.425},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.4239999999999999,"15min":1.3919999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0840000000000001,"5min":2.5960000000000001,"15min":4.306},"last":1.1220000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":0.92700000000000005,"5min":0.79500000000000004,"15min":0.68400000000000005},"max":{"1min":1.968,"5min":2.5550000000000002,"15min":4.9880000000000004},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3999999999999999,"15min":1.3700000000000001},"min":{"1min":0.82499999999999996,"5min":0.753,"15min":0.67900000000000005},"max":{"1min":2.0569999999999999,"5min":2.464,"15min":5.4569999999999999},"last":1.157}]},{"osd":6,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.512,"15min":1.4450000000000001},"min":{"1min":0.84699999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0179999999999998,"5min":2.8860000000000001,"15min":5.1429999999999998},"last":1.47},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4770000000000001,"15min":1.4359999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.70199999999999996},"max":{"1min":1.9139999999999999,"5min":2.6899999999999999,"15min":3.75},"last":1.5029999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.583,"15min":1.5469999999999999},"min":{"1min":0.83399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":8.4039999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.6180000000000001,"15min":1.607},"min":{"1min":0.84399999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.873,"5min":2.7290000000000001,"15min":8.2390000000000008},"last":1.675}]}]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194443,"statfs":{"total":200000000,"available":199110348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83999999999999997,"15min":0.80200000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5209999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.94399999999999995,"15min":0.89300000000000002},"min":{"1min":0.42299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.569,"5min":1.837,"15min":2.0459999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.0629999999999999},"min":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.153,"15min":1.141},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5029999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":0.88700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.218,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.1339999999999999,"15min":1.071},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7330000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2390000000000001,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.60299999999999998,"15min":0.59499999999999997},"max":{"1min":1.6140000000000001,"5min":1.845,"15min":1.845},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.367,"15min":1.28},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.954,"5min":2.149,"15min":2.149},"last":0.98199999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.327},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.63300000000000001},"max":{"1min":1.7969999999999999,"5min":2.173,"15min":2.173},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.296,"5min":1.3580000000000001,"15min":1.294},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7210000000000001,"5min":1.8340000000000001,"15min":1.879},"last":1.01}]},{"osd":6,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.45,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0489999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.2949999999999999},"min":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.016,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4890000000000001,"15min":1.4279999999999999},"min":{"1min":0.89100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.917,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.4330000000000001,"15min":1.3779999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7629999999999999,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.127}]}]}],"pool_statfs":[]}} 2023-12-19T05:48:02.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:48:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.532+0000 7f00f3483640 1 Processor -- start 2023-12-19T05:48:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.532+0000 7f00f3483640 1 -- start start 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.534+0000 7f00f3483640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00ec15d8f0 0x7f00ec0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.534+0000 7f00f3483640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec15e890 con 0x7f00ec15d510 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.534+0000 7f00f3483640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec15e2d0 con 0x7f00ec15dd80 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.534+0000 7f00f3483640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec15e5b0 con 0x7f00ec15d8f0 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f2481640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f00ec15d510 0x7f00ec161810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52826/0 (socket says 172.21.15.49:52826) 2023-12-19T05:48:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f2481640 1 -- 172.21.15.49:0/3272423235 learned_addr learned my addr 172.21.15.49:0/3272423235 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f1c80640 1 --2- 172.21.15.49:0/3272423235 >> v2:172.21.15.115:3300/0 conn(0x7f00ec15d8f0 0x7f00ec0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283957647 0 0) 0x7f00ec15e890 con 0x7f00ec15d510 2023-12-19T05:48:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003520 con 0x7f00ec15d510 2023-12-19T05:48:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145207907 0 0) 0x7f00d8003520 con 0x7f00ec15d510 2023-12-19T05:48:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 >> v2:172.21.15.115:3300/0 conn(0x7f00ec15d8f0 msgr2=0x7f00ec0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 --2- 172.21.15.49:0/3272423235 >> v2:172.21.15.115:3300/0 conn(0x7f00ec15d8f0 0x7f00ec0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 >> v1:172.21.15.115:6789/0 conn(0x7f00ec15dd80 legacy=0x7f00ec0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec161010 con 0x7f00ec15d510 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.535+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f00e8001670 con 0x7f00ec15d510 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 >> v1:172.21.15.49:6789/0 conn(0x7f00ec15d510 legacy=0x7f00ec161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d80039c0 0x7f00d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec15e5b0 con 0x7f00d80047c0 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800c080 con 0x7f00d80039c0 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800c240 con 0x7f00d8005180 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f1c80640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f2481640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d80039c0 0x7f00d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f2c82640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.536+0000 7f00f1c80640 1 -- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d8005180 msgr2=0x7f00d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.537+0000 7f00f1c80640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.537+0000 7f00f1c80640 1 -- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d80039c0 msgr2=0x7f00d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.537+0000 7f00f1c80640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00d80039c0 0x7f00d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.537+0000 7f00f1c80640 1 -- 172.21.15.49:0/3272423235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8003520 con 0x7f00d80047c0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.537+0000 7f00f2c82640 1 -- 172.21.15.49:0/3272423235 reap_dead start 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.538+0000 7f00f1c80640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00d8004c40 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009ac0 tx=0x7f00d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe52a945d0aab92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.538+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc02c6b0 con 0x7f00d80047c0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.538+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc02c810 con 0x7f00d80047c0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.538+0000 7f00f147f640 1 -- 172.21.15.49:0/3272423235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc02cba0 con 0x7f00d80047c0 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 -- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 msgr2=0x7f00d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00d8004c40 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009ac0 tx=0x7f00d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 -- 172.21.15.49:0/3272423235 shutdown_connections 2023-12-19T05:48:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 --2- 172.21.15.49:0/3272423235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 -- 172.21.15.49:0/3272423235 >> 172.21.15.49:0/3272423235 conn(0x7f00ec0d30e0 msgr2=0x7f00ec0d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:02.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 -- 172.21.15.49:0/3272423235 shutdown_connections 2023-12-19T05:48:02.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.539+0000 7f00f3483640 1 -- 172.21.15.49:0/3272423235 wait complete. 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.541+0000 7f00f3483640 1 Processor -- start 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.541+0000 7f00f3483640 1 -- start start 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00ec157340 0x7f00ec1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00ec1f61a0 0x7f00ec1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec1f24f0 con 0x7f00d80047c0 2023-12-19T05:48:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec157800 con 0x7f00ec157340 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f3483640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec157ae0 con 0x7f00ec1f61a0 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50692/0 (socket says 172.21.15.49:50692) 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 -- 172.21.15.49:0/611248403 learned_addr learned my addr 172.21.15.49:0/611248403 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 -- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00ec1f61a0 msgr2=0x7f00ec1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00ec1f61a0 0x7f00ec1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 -- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00ec157340 msgr2=0x7f00ec1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00ec157340 0x7f00ec1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.542+0000 7f00f2481640 1 -- 172.21.15.49:0/611248403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec157dc0 con 0x7f00d80047c0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00f2481640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f00e800e730 tx=0x7f00e800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800c6c0 con 0x7f00d80047c0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800c840 con 0x7f00d80047c0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec1580a0 con 0x7f00d80047c0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800cbf0 con 0x7f00d80047c0 2023-12-19T05:48:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.543+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec15ab40 con 0x7f00d80047c0 2023-12-19T05:48:02.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.544+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec061910 con 0x7f00d80047c0 2023-12-19T05:48:02.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.545+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f00e801d460 con 0x7f00d80047c0 2023-12-19T05:48:02.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.546+0000 7f00e2ffd640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 0x7f00d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:02.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.547+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00e8088a30 con 0x7f00d80047c0 2023-12-19T05:48:02.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.547+0000 7f00f1c80640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 0x7f00d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:02.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.549+0000 7f00f1c80640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 0x7f00d006c920 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f00dc036000 tx=0x7f00dc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:02.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.551+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f00e8054010 con 0x7f00d80047c0 2023-12-19T05:48:02.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.742+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00ec1612f0 con 0x7f00d006a460 2023-12-19T05:48:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.767+0000 7f00e2ffd640 1 -- 172.21.15.49:0/611248403 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283074 (secure 0 0 0) 0x7f00dc0040c0 con 0x7f00d006a460 2023-12-19T05:48:02.774 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:02.776 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:48:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 msgr2=0x7f00d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 0x7f00d006c920 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f00dc036000 tx=0x7f00dc02e000 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 msgr2=0x7f00ec1f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f00e800e730 tx=0x7f00e800ebf0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 shutdown_connections 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f00d006a460 0x7f00d006c920 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00ec1f61a0 0x7f00ec1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00ec157340 0x7f00ec1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 --2- 172.21.15.49:0/611248403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00d80047c0 0x7f00ec1f1fb0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 >> 172.21.15.49:0/611248403 conn(0x7f00ec0d30e0 msgr2=0x7f00ec0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 shutdown_connections 2023-12-19T05:48:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:02.772+0000 7f00f3483640 1 -- 172.21.15.49:0/611248403 wait complete. 2023-12-19T05:48:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2023-12-19T05:48:02.691694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554289,"statfs":{"total":1600000000,"available":1591592724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.009814"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591242+0000","last_change":"2023-12-19T05:47:57.226411+0000","last_active":"2023-12-19T05:47:57.591242+0000","last_peered":"2023-12-19T05:47:57.591242+0000","last_clean":"2023-12-19T05:47:57.591242+0000","last_became_active":"2023-12-19T05:47:57.225631+0000","last_became_peered":"2023-12-19T05:47:57.225631+0000","last_unstale":"2023-12-19T05:47:57.591242+0000","last_undegraded":"2023-12-19T05:47:57.591242+0000","last_fullsized":"2023-12-19T05:47:57.591242+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:23:30.354688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590999+0000","last_change":"2023-12-19T05:47:57.225326+0000","last_active":"2023-12-19T05:47:57.590999+0000","last_peered":"2023-12-19T05:47:57.590999+0000","last_clean":"2023-12-19T05:47:57.590999+0000","last_became_active":"2023-12-19T05:47:57.223537+0000","last_became_peered":"2023-12-19T05:47:57.223537+0000","last_unstale":"2023-12-19T05:47:57.590999+0000","last_undegraded":"2023-12-19T05:47:57.590999+0000","last_fullsized":"2023-12-19T05:47:57.590999+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:34:39.977648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573491+0000","last_change":"2023-12-19T05:47:57.223807+0000","last_active":"2023-12-19T05:47:57.573491+0000","last_peered":"2023-12-19T05:47:57.573491+0000","last_clean":"2023-12-19T05:47:57.573491+0000","last_became_active":"2023-12-19T05:47:57.223585+0000","last_became_peered":"2023-12-19T05:47:57.223585+0000","last_unstale":"2023-12-19T05:47:57.573491+0000","last_undegraded":"2023-12-19T05:47:57.573491+0000","last_fullsized":"2023-12-19T05:47:57.573491+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:02:03.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590194+0000","last_change":"2023-12-19T05:47:57.216180+0000","last_active":"2023-12-19T05:47:57.590194+0000","last_peered":"2023-12-19T05:47:57.590194+0000","last_clean":"2023-12-19T05:47:57.590194+0000","last_became_active":"2023-12-19T05:47:57.215115+0000","last_became_peered":"2023-12-19T05:47:57.215115+0000","last_unstale":"2023-12-19T05:47:57.590194+0000","last_undegraded":"2023-12-19T05:47:57.590194+0000","last_fullsized":"2023-12-19T05:47:57.590194+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:57:51.406399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585934+0000","last_change":"2023-12-19T05:47:57.218885+0000","last_active":"2023-12-19T05:47:57.585934+0000","last_peered":"2023-12-19T05:47:57.585934+0000","last_clean":"2023-12-19T05:47:57.585934+0000","last_became_active":"2023-12-19T05:47:57.217265+0000","last_became_peered":"2023-12-19T05:47:57.217265+0000","last_unstale":"2023-12-19T05:47:57.585934+0000","last_undegraded":"2023-12-19T05:47:57.585934+0000","last_fullsized":"2023-12-19T05:47:57.585934+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:30:29.108720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589441+0000","last_change":"2023-12-19T05:47:57.222072+0000","last_active":"2023-12-19T05:47:57.589441+0000","last_peered":"2023-12-19T05:47:57.589441+0000","last_clean":"2023-12-19T05:47:57.589441+0000","last_became_active":"2023-12-19T05:47:57.218070+0000","last_became_peered":"2023-12-19T05:47:57.218070+0000","last_unstale":"2023-12-19T05:47:57.589441+0000","last_undegraded":"2023-12-19T05:47:57.589441+0000","last_fullsized":"2023-12-19T05:47:57.589441+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:19.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585844+0000","last_change":"2023-12-19T05:47:57.213369+0000","last_active":"2023-12-19T05:47:57.585844+0000","last_peered":"2023-12-19T05:47:57.585844+0000","last_clean":"2023-12-19T05:47:57.585844+0000","last_became_active":"2023-12-19T05:47:57.213109+0000","last_became_peered":"2023-12-19T05:47:57.213109+0000","last_unstale":"2023-12-19T05:47:57.585844+0000","last_undegraded":"2023-12-19T05:47:57.585844+0000","last_fullsized":"2023-12-19T05:47:57.585844+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:07.074465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585752+0000","last_change":"2023-12-19T05:47:57.221411+0000","last_active":"2023-12-19T05:47:57.585752+0000","last_peered":"2023-12-19T05:47:57.585752+0000","last_clean":"2023-12-19T05:47:57.585752+0000","last_became_active":"2023-12-19T05:47:57.220658+0000","last_became_peered":"2023-12-19T05:47:57.220658+0000","last_unstale":"2023-12-19T05:47:57.585752+0000","last_undegraded":"2023-12-19T05:47:57.585752+0000","last_fullsized":"2023-12-19T05:47:57.585752+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:33.766694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573391+0000","last_change":"2023-12-19T05:47:57.229356+0000","last_active":"2023-12-19T05:47:57.573391+0000","last_peered":"2023-12-19T05:47:57.573391+0000","last_clean":"2023-12-19T05:47:57.573391+0000","last_became_active":"2023-12-19T05:47:57.228986+0000","last_became_peered":"2023-12-19T05:47:57.228986+0000","last_unstale":"2023-12-19T05:47:57.573391+0000","last_undegraded":"2023-12-19T05:47:57.573391+0000","last_fullsized":"2023-12-19T05:47:57.573391+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:54:27.417549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591444+0000","last_change":"2023-12-19T05:47:57.222609+0000","last_active":"2023-12-19T05:47:57.591444+0000","last_peered":"2023-12-19T05:47:57.591444+0000","last_clean":"2023-12-19T05:47:57.591444+0000","last_became_active":"2023-12-19T05:47:57.221530+0000","last_became_peered":"2023-12-19T05:47:57.221530+0000","last_unstale":"2023-12-19T05:47:57.591444+0000","last_undegraded":"2023-12-19T05:47:57.591444+0000","last_fullsized":"2023-12-19T05:47:57.591444+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:50:45.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590374+0000","last_change":"2023-12-19T05:47:57.224342+0000","last_active":"2023-12-19T05:47:57.590374+0000","last_peered":"2023-12-19T05:47:57.590374+0000","last_clean":"2023-12-19T05:47:57.590374+0000","last_became_active":"2023-12-19T05:47:57.223853+0000","last_became_peered":"2023-12-19T05:47:57.223853+0000","last_unstale":"2023-12-19T05:47:57.590374+0000","last_undegraded":"2023-12-19T05:47:57.590374+0000","last_fullsized":"2023-12-19T05:47:57.590374+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:59:24.752718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589333+0000","last_change":"2023-12-19T05:47:57.215122+0000","last_active":"2023-12-19T05:47:57.589333+0000","last_peered":"2023-12-19T05:47:57.589333+0000","last_clean":"2023-12-19T05:47:57.589333+0000","last_became_active":"2023-12-19T05:47:57.214740+0000","last_became_peered":"2023-12-19T05:47:57.214740+0000","last_unstale":"2023-12-19T05:47:57.589333+0000","last_undegraded":"2023-12-19T05:47:57.589333+0000","last_fullsized":"2023-12-19T05:47:57.589333+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:55:26.336514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590250+0000","last_change":"2023-12-19T05:47:57.223127+0000","last_active":"2023-12-19T05:47:57.590250+0000","last_peered":"2023-12-19T05:47:57.590250+0000","last_clean":"2023-12-19T05:47:57.590250+0000","last_became_active":"2023-12-19T05:47:57.218067+0000","last_became_peered":"2023-12-19T05:47:57.218067+0000","last_unstale":"2023-12-19T05:47:57.590250+0000","last_undegraded":"2023-12-19T05:47:57.590250+0000","last_fullsized":"2023-12-19T05:47:57.590250+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:50:45.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592287+0000","last_change":"2023-12-19T05:47:57.230265+0000","last_active":"2023-12-19T05:47:57.592287+0000","last_peered":"2023-12-19T05:47:57.592287+0000","last_clean":"2023-12-19T05:47:57.592287+0000","last_became_active":"2023-12-19T05:47:57.229675+0000","last_became_peered":"2023-12-19T05:47:57.229675+0000","last_unstale":"2023-12-19T05:47:57.592287+0000","last_undegraded":"2023-12-19T05:47:57.592287+0000","last_fullsized":"2023-12-19T05:47:57.592287+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:03.316110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591883+0000","last_change":"2023-12-19T05:47:57.222470+0000","last_active":"2023-12-19T05:47:57.591883+0000","last_peered":"2023-12-19T05:47:57.591883+0000","last_clean":"2023-12-19T05:47:57.591883+0000","last_became_active":"2023-12-19T05:47:57.222216+0000","last_became_peered":"2023-12-19T05:47:57.222216+0000","last_unstale":"2023-12-19T05:47:57.591883+0000","last_undegraded":"2023-12-19T05:47:57.591883+0000","last_fullsized":"2023-12-19T05:47:57.591883+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:57.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592602+0000","last_change":"2023-12-19T05:47:57.217779+0000","last_active":"2023-12-19T05:47:57.592602+0000","last_peered":"2023-12-19T05:47:57.592602+0000","last_clean":"2023-12-19T05:47:57.592602+0000","last_became_active":"2023-12-19T05:47:57.217534+0000","last_became_peered":"2023-12-19T05:47:57.217534+0000","last_unstale":"2023-12-19T05:47:57.592602+0000","last_undegraded":"2023-12-19T05:47:57.592602+0000","last_fullsized":"2023-12-19T05:47:57.592602+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:34:24.742342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573577+0000","last_change":"2023-12-19T05:47:57.203484+0000","last_active":"2023-12-19T05:47:57.573577+0000","last_peered":"2023-12-19T05:47:57.573577+0000","last_clean":"2023-12-19T05:47:57.573577+0000","last_became_active":"2023-12-19T05:47:57.203214+0000","last_became_peered":"2023-12-19T05:47:57.203214+0000","last_unstale":"2023-12-19T05:47:57.573577+0000","last_undegraded":"2023-12-19T05:47:57.573577+0000","last_fullsized":"2023-12-19T05:47:57.573577+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:55:27.490877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591745+0000","last_change":"2023-12-19T05:47:57.228374+0000","last_active":"2023-12-19T05:47:57.591745+0000","last_peered":"2023-12-19T05:47:57.591745+0000","last_clean":"2023-12-19T05:47:57.591745+0000","last_became_active":"2023-12-19T05:47:57.226704+0000","last_became_peered":"2023-12-19T05:47:57.226704+0000","last_unstale":"2023-12-19T05:47:57.591745+0000","last_undegraded":"2023-12-19T05:47:57.591745+0000","last_fullsized":"2023-12-19T05:47:57.591745+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:53:46.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590870+0000","last_change":"2023-12-19T05:47:57.227254+0000","last_active":"2023-12-19T05:47:57.590870+0000","last_peered":"2023-12-19T05:47:57.590870+0000","last_clean":"2023-12-19T05:47:57.590870+0000","last_became_active":"2023-12-19T05:47:57.226789+0000","last_became_peered":"2023-12-19T05:47:57.226789+0000","last_unstale":"2023-12-19T05:47:57.590870+0000","last_undegraded":"2023-12-19T05:47:57.590870+0000","last_fullsized":"2023-12-19T05:47:57.590870+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:34.001120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591922+0000","last_change":"2023-12-19T05:47:57.230507+0000","last_active":"2023-12-19T05:47:57.591922+0000","last_peered":"2023-12-19T05:47:57.591922+0000","last_clean":"2023-12-19T05:47:57.591922+0000","last_became_active":"2023-12-19T05:47:57.230144+0000","last_became_peered":"2023-12-19T05:47:57.230144+0000","last_unstale":"2023-12-19T05:47:57.591922+0000","last_undegraded":"2023-12-19T05:47:57.591922+0000","last_fullsized":"2023-12-19T05:47:57.591922+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:12.824294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589461+0000","last_change":"2023-12-19T05:47:57.222522+0000","last_active":"2023-12-19T05:47:57.589461+0000","last_peered":"2023-12-19T05:47:57.589461+0000","last_clean":"2023-12-19T05:47:57.589461+0000","last_became_active":"2023-12-19T05:47:57.222293+0000","last_became_peered":"2023-12-19T05:47:57.222293+0000","last_unstale":"2023-12-19T05:47:57.589461+0000","last_undegraded":"2023-12-19T05:47:57.589461+0000","last_fullsized":"2023-12-19T05:47:57.589461+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:36.237402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591038+0000","last_change":"2023-12-19T05:47:57.227507+0000","last_active":"2023-12-19T05:47:57.591038+0000","last_peered":"2023-12-19T05:47:57.591038+0000","last_clean":"2023-12-19T05:47:57.591038+0000","last_became_active":"2023-12-19T05:47:57.224957+0000","last_became_peered":"2023-12-19T05:47:57.224957+0000","last_unstale":"2023-12-19T05:47:57.591038+0000","last_undegraded":"2023-12-19T05:47:57.591038+0000","last_fullsized":"2023-12-19T05:47:57.591038+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:40.930372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583578+0000","last_change":"2023-12-19T05:47:57.212089+0000","last_active":"2023-12-19T05:47:57.583578+0000","last_peered":"2023-12-19T05:47:57.583578+0000","last_clean":"2023-12-19T05:47:57.583578+0000","last_became_active":"2023-12-19T05:47:57.211459+0000","last_became_peered":"2023-12-19T05:47:57.211459+0000","last_unstale":"2023-12-19T05:47:57.583578+0000","last_undegraded":"2023-12-19T05:47:57.583578+0000","last_fullsized":"2023-12-19T05:47:57.583578+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:03:56.280159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591591+0000","last_change":"2023-12-19T05:47:57.229074+0000","last_active":"2023-12-19T05:47:57.591591+0000","last_peered":"2023-12-19T05:47:57.591591+0000","last_clean":"2023-12-19T05:47:57.591591+0000","last_became_active":"2023-12-19T05:47:57.228480+0000","last_became_peered":"2023-12-19T05:47:57.228480+0000","last_unstale":"2023-12-19T05:47:57.591591+0000","last_undegraded":"2023-12-19T05:47:57.591591+0000","last_fullsized":"2023-12-19T05:47:57.591591+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:13.903457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590458+0000","last_change":"2023-12-19T05:47:57.213291+0000","last_active":"2023-12-19T05:47:57.590458+0000","last_peered":"2023-12-19T05:47:57.590458+0000","last_clean":"2023-12-19T05:47:57.590458+0000","last_became_active":"2023-12-19T05:47:57.212923+0000","last_became_peered":"2023-12-19T05:47:57.212923+0000","last_unstale":"2023-12-19T05:47:57.590458+0000","last_undegraded":"2023-12-19T05:47:57.590458+0000","last_fullsized":"2023-12-19T05:47:57.590458+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:18.307014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591280+0000","last_change":"2023-12-19T05:47:57.222131+0000","last_active":"2023-12-19T05:47:57.591280+0000","last_peered":"2023-12-19T05:47:57.591280+0000","last_clean":"2023-12-19T05:47:57.591280+0000","last_became_active":"2023-12-19T05:47:57.221884+0000","last_became_peered":"2023-12-19T05:47:57.221884+0000","last_unstale":"2023-12-19T05:47:57.591280+0000","last_undegraded":"2023-12-19T05:47:57.591280+0000","last_fullsized":"2023-12-19T05:47:57.591280+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:28:12.752549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592509+0000","last_change":"2023-12-19T05:47:57.224682+0000","last_active":"2023-12-19T05:47:57.592509+0000","last_peered":"2023-12-19T05:47:57.592509+0000","last_clean":"2023-12-19T05:47:57.592509+0000","last_became_active":"2023-12-19T05:47:57.224393+0000","last_became_peered":"2023-12-19T05:47:57.224393+0000","last_unstale":"2023-12-19T05:47:57.592509+0000","last_undegraded":"2023-12-19T05:47:57.592509+0000","last_fullsized":"2023-12-19T05:47:57.592509+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:19.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583556+0000","last_change":"2023-12-19T05:47:57.220265+0000","last_active":"2023-12-19T05:47:57.583556+0000","last_peered":"2023-12-19T05:47:57.583556+0000","last_clean":"2023-12-19T05:47:57.583556+0000","last_became_active":"2023-12-19T05:47:57.219922+0000","last_became_peered":"2023-12-19T05:47:57.219922+0000","last_unstale":"2023-12-19T05:47:57.583556+0000","last_undegraded":"2023-12-19T05:47:57.583556+0000","last_fullsized":"2023-12-19T05:47:57.583556+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:13.903457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590808+0000","last_change":"2023-12-19T05:47:57.223441+0000","last_active":"2023-12-19T05:47:57.590808+0000","last_peered":"2023-12-19T05:47:57.590808+0000","last_clean":"2023-12-19T05:47:57.590808+0000","last_became_active":"2023-12-19T05:47:57.218087+0000","last_became_peered":"2023-12-19T05:47:57.218087+0000","last_unstale":"2023-12-19T05:47:57.590808+0000","last_undegraded":"2023-12-19T05:47:57.590808+0000","last_fullsized":"2023-12-19T05:47:57.590808+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:25:34.776884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591484+0000","last_change":"2023-12-19T05:47:57.208244+0000","last_active":"2023-12-19T05:47:57.591484+0000","last_peered":"2023-12-19T05:47:57.591484+0000","last_clean":"2023-12-19T05:47:57.591484+0000","last_became_active":"2023-12-19T05:47:57.206377+0000","last_became_peered":"2023-12-19T05:47:57.206377+0000","last_unstale":"2023-12-19T05:47:57.591484+0000","last_undegraded":"2023-12-19T05:47:57.591484+0000","last_fullsized":"2023-12-19T05:47:57.591484+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:21.694457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583662+0000","last_change":"2023-12-19T05:47:57.219644+0000","last_active":"2023-12-19T05:47:57.583662+0000","last_peered":"2023-12-19T05:47:57.583662+0000","last_clean":"2023-12-19T05:47:57.583662+0000","last_became_active":"2023-12-19T05:47:57.219468+0000","last_became_peered":"2023-12-19T05:47:57.219468+0000","last_unstale":"2023-12-19T05:47:57.583662+0000","last_undegraded":"2023-12-19T05:47:57.583662+0000","last_fullsized":"2023-12-19T05:47:57.583662+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:53:46.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573556+0000","last_change":"2023-12-19T05:47:57.209670+0000","last_active":"2023-12-19T05:47:57.573556+0000","last_peered":"2023-12-19T05:47:57.573556+0000","last_clean":"2023-12-19T05:47:57.573556+0000","last_became_active":"2023-12-19T05:47:57.209417+0000","last_became_peered":"2023-12-19T05:47:57.209417+0000","last_unstale":"2023-12-19T05:47:57.573556+0000","last_undegraded":"2023-12-19T05:47:57.573556+0000","last_fullsized":"2023-12-19T05:47:57.573556+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:29:07.865696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592330+0000","last_change":"2023-12-19T05:47:57.219455+0000","last_active":"2023-12-19T05:47:57.592330+0000","last_peered":"2023-12-19T05:47:57.592330+0000","last_clean":"2023-12-19T05:47:57.592330+0000","last_became_active":"2023-12-19T05:47:57.218871+0000","last_became_peered":"2023-12-19T05:47:57.218871+0000","last_unstale":"2023-12-19T05:47:57.592330+0000","last_undegraded":"2023-12-19T05:47:57.592330+0000","last_fullsized":"2023-12-19T05:47:57.592330+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:36.237402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"160'4","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585775+0000","last_change":"2023-12-19T05:47:56.710333+0000","last_active":"2023-12-19T05:47:57.585775+0000","last_peered":"2023-12-19T05:47:57.585775+0000","last_clean":"2023-12-19T05:47:57.585775+0000","last_became_active":"2023-12-19T05:47:56.709522+0000","last_became_peered":"2023-12-19T05:47:56.709522+0000","last_unstale":"2023-12-19T05:47:57.585775+0000","last_undegraded":"2023-12-19T05:47:57.585775+0000","last_fullsized":"2023-12-19T05:47:57.585775+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:59:58.474673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573511+0000","last_change":"2023-12-19T05:47:57.206874+0000","last_active":"2023-12-19T05:47:57.573511+0000","last_peered":"2023-12-19T05:47:57.573511+0000","last_clean":"2023-12-19T05:47:57.573511+0000","last_became_active":"2023-12-19T05:47:57.206619+0000","last_became_peered":"2023-12-19T05:47:57.206619+0000","last_unstale":"2023-12-19T05:47:57.573511+0000","last_undegraded":"2023-12-19T05:47:57.573511+0000","last_fullsized":"2023-12-19T05:47:57.573511+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:33:34.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573446+0000","last_change":"2023-12-19T05:47:56.706296+0000","last_active":"2023-12-19T05:47:57.573446+0000","last_peered":"2023-12-19T05:47:57.573446+0000","last_clean":"2023-12-19T05:47:57.573446+0000","last_became_active":"2023-12-19T05:47:56.702050+0000","last_became_peered":"2023-12-19T05:47:56.702050+0000","last_unstale":"2023-12-19T05:47:57.573446+0000","last_undegraded":"2023-12-19T05:47:57.573446+0000","last_fullsized":"2023-12-19T05:47:57.573446+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:53:28.886871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573597+0000","last_change":"2023-12-19T05:47:57.211228+0000","last_active":"2023-12-19T05:47:57.573597+0000","last_peered":"2023-12-19T05:47:57.573597+0000","last_clean":"2023-12-19T05:47:57.573597+0000","last_became_active":"2023-12-19T05:47:57.211014+0000","last_became_peered":"2023-12-19T05:47:57.211014+0000","last_unstale":"2023-12-19T05:47:57.573597+0000","last_undegraded":"2023-12-19T05:47:57.573597+0000","last_fullsized":"2023-12-19T05:47:57.573597+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:01:52.949662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590500+0000","last_change":"2023-12-19T05:47:56.698022+0000","last_active":"2023-12-19T05:47:57.590500+0000","last_peered":"2023-12-19T05:47:57.590500+0000","last_clean":"2023-12-19T05:47:57.590500+0000","last_became_active":"2023-12-19T05:47:56.697191+0000","last_became_peered":"2023-12-19T05:47:56.697191+0000","last_unstale":"2023-12-19T05:47:57.590500+0000","last_undegraded":"2023-12-19T05:47:57.590500+0000","last_fullsized":"2023-12-19T05:47:57.590500+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:16:34.614154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589566+0000","last_change":"2023-12-19T05:47:57.225226+0000","last_active":"2023-12-19T05:47:57.589566+0000","last_peered":"2023-12-19T05:47:57.589566+0000","last_clean":"2023-12-19T05:47:57.589566+0000","last_became_active":"2023-12-19T05:47:57.224002+0000","last_became_peered":"2023-12-19T05:47:57.224002+0000","last_unstale":"2023-12-19T05:47:57.589566+0000","last_undegraded":"2023-12-19T05:47:57.589566+0000","last_fullsized":"2023-12-19T05:47:57.589566+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:00.573268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591322+0000","last_change":"2023-12-19T05:47:56.712214+0000","last_active":"2023-12-19T05:47:57.591322+0000","last_peered":"2023-12-19T05:47:57.591322+0000","last_clean":"2023-12-19T05:47:57.591322+0000","last_became_active":"2023-12-19T05:47:56.710798+0000","last_became_peered":"2023-12-19T05:47:56.710798+0000","last_unstale":"2023-12-19T05:47:57.591322+0000","last_undegraded":"2023-12-19T05:47:57.591322+0000","last_fullsized":"2023-12-19T05:47:57.591322+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:25.134926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591766+0000","last_change":"2023-12-19T05:47:57.228001+0000","last_active":"2023-12-19T05:47:57.591766+0000","last_peered":"2023-12-19T05:47:57.591766+0000","last_clean":"2023-12-19T05:47:57.591766+0000","last_became_active":"2023-12-19T05:47:57.223227+0000","last_became_peered":"2023-12-19T05:47:57.223227+0000","last_unstale":"2023-12-19T05:47:57.591766+0000","last_undegraded":"2023-12-19T05:47:57.591766+0000","last_fullsized":"2023-12-19T05:47:57.591766+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:06.962341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591197+0000","last_change":"2023-12-19T05:47:56.713894+0000","last_active":"2023-12-19T05:47:57.591197+0000","last_peered":"2023-12-19T05:47:57.591197+0000","last_clean":"2023-12-19T05:47:57.591197+0000","last_became_active":"2023-12-19T05:47:56.713159+0000","last_became_peered":"2023-12-19T05:47:56.713159+0000","last_unstale":"2023-12-19T05:47:57.591197+0000","last_undegraded":"2023-12-19T05:47:57.591197+0000","last_fullsized":"2023-12-19T05:47:57.591197+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:23.837336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589355+0000","last_change":"2023-12-19T05:47:57.217434+0000","last_active":"2023-12-19T05:47:57.589355+0000","last_peered":"2023-12-19T05:47:57.589355+0000","last_clean":"2023-12-19T05:47:57.589355+0000","last_became_active":"2023-12-19T05:47:57.217157+0000","last_became_peered":"2023-12-19T05:47:57.217157+0000","last_unstale":"2023-12-19T05:47:57.589355+0000","last_undegraded":"2023-12-19T05:47:57.589355+0000","last_fullsized":"2023-12-19T05:47:57.589355+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:57:24.848639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591789+0000","last_change":"2023-12-19T05:47:56.711065+0000","last_active":"2023-12-19T05:47:57.591789+0000","last_peered":"2023-12-19T05:47:57.591789+0000","last_clean":"2023-12-19T05:47:57.591789+0000","last_became_active":"2023-12-19T05:47:56.710796+0000","last_became_peered":"2023-12-19T05:47:56.710796+0000","last_unstale":"2023-12-19T05:47:57.591789+0000","last_undegraded":"2023-12-19T05:47:57.591789+0000","last_fullsized":"2023-12-19T05:47:57.591789+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:40:18.010200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589524+0000","last_change":"2023-12-19T05:47:57.214216+0000","last_active":"2023-12-19T05:47:57.589524+0000","last_peered":"2023-12-19T05:47:57.589524+0000","last_clean":"2023-12-19T05:47:57.589524+0000","last_became_active":"2023-12-19T05:47:57.213809+0000","last_became_peered":"2023-12-19T05:47:57.213809+0000","last_unstale":"2023-12-19T05:47:57.589524+0000","last_undegraded":"2023-12-19T05:47:57.589524+0000","last_fullsized":"2023-12-19T05:47:57.589524+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:43.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573470+0000","last_change":"2023-12-19T05:47:56.708503+0000","last_active":"2023-12-19T05:47:57.573470+0000","last_peered":"2023-12-19T05:47:57.573470+0000","last_clean":"2023-12-19T05:47:57.573470+0000","last_became_active":"2023-12-19T05:47:56.708170+0000","last_became_peered":"2023-12-19T05:47:56.708170+0000","last_unstale":"2023-12-19T05:47:57.573470+0000","last_undegraded":"2023-12-19T05:47:57.573470+0000","last_fullsized":"2023-12-19T05:47:57.573470+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:28:58.082302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590925+0000","last_change":"2023-12-19T05:47:57.227066+0000","last_active":"2023-12-19T05:47:57.590925+0000","last_peered":"2023-12-19T05:47:57.590925+0000","last_clean":"2023-12-19T05:47:57.590925+0000","last_became_active":"2023-12-19T05:47:57.221510+0000","last_became_peered":"2023-12-19T05:47:57.221510+0000","last_unstale":"2023-12-19T05:47:57.590925+0000","last_undegraded":"2023-12-19T05:47:57.590925+0000","last_fullsized":"2023-12-19T05:47:57.590925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:17.654996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591518+0000","last_change":"2023-12-19T05:47:56.710354+0000","last_active":"2023-12-19T05:47:57.591518+0000","last_peered":"2023-12-19T05:47:57.591518+0000","last_clean":"2023-12-19T05:47:57.591518+0000","last_became_active":"2023-12-19T05:47:56.710106+0000","last_became_peered":"2023-12-19T05:47:56.710106+0000","last_unstale":"2023-12-19T05:47:57.591518+0000","last_undegraded":"2023-12-19T05:47:57.591518+0000","last_fullsized":"2023-12-19T05:47:57.591518+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:59.561965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591077+0000","last_change":"2023-12-19T05:47:57.227258+0000","last_active":"2023-12-19T05:47:57.591077+0000","last_peered":"2023-12-19T05:47:57.591077+0000","last_clean":"2023-12-19T05:47:57.591077+0000","last_became_active":"2023-12-19T05:47:57.224618+0000","last_became_peered":"2023-12-19T05:47:57.224618+0000","last_unstale":"2023-12-19T05:47:57.591077+0000","last_undegraded":"2023-12-19T05:47:57.591077+0000","last_fullsized":"2023-12-19T05:47:57.591077+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:10:09.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589502+0000","last_change":"2023-12-19T05:47:56.700751+0000","last_active":"2023-12-19T05:47:57.589502+0000","last_peered":"2023-12-19T05:47:57.589502+0000","last_clean":"2023-12-19T05:47:57.589502+0000","last_became_active":"2023-12-19T05:47:56.700436+0000","last_became_peered":"2023-12-19T05:47:56.700436+0000","last_unstale":"2023-12-19T05:47:57.589502+0000","last_undegraded":"2023-12-19T05:47:57.589502+0000","last_fullsized":"2023-12-19T05:47:57.589502+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:54.246012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585885+0000","last_change":"2023-12-19T05:47:57.220665+0000","last_active":"2023-12-19T05:47:57.585885+0000","last_peered":"2023-12-19T05:47:57.585885+0000","last_clean":"2023-12-19T05:47:57.585885+0000","last_became_active":"2023-12-19T05:47:57.220426+0000","last_became_peered":"2023-12-19T05:47:57.220426+0000","last_unstale":"2023-12-19T05:47:57.585885+0000","last_undegraded":"2023-12-19T05:47:57.585885+0000","last_fullsized":"2023-12-19T05:47:57.585885+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:45:24.007559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591813+0000","last_change":"2023-12-19T05:47:56.700399+0000","last_active":"2023-12-19T05:47:57.591813+0000","last_peered":"2023-12-19T05:47:57.591813+0000","last_clean":"2023-12-19T05:47:57.591813+0000","last_became_active":"2023-12-19T05:47:56.699903+0000","last_became_peered":"2023-12-19T05:47:56.699903+0000","last_unstale":"2023-12-19T05:47:57.591813+0000","last_undegraded":"2023-12-19T05:47:57.591813+0000","last_fullsized":"2023-12-19T05:47:57.591813+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:37:12.592607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589164+0000","last_change":"2023-12-19T05:47:57.215802+0000","last_active":"2023-12-19T05:47:57.589164+0000","last_peered":"2023-12-19T05:47:57.589164+0000","last_clean":"2023-12-19T05:47:57.589164+0000","last_became_active":"2023-12-19T05:47:57.212742+0000","last_became_peered":"2023-12-19T05:47:57.212742+0000","last_unstale":"2023-12-19T05:47:57.589164+0000","last_undegraded":"2023-12-19T05:47:57.589164+0000","last_fullsized":"2023-12-19T05:47:57.589164+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:44:25.440727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"160'3","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585800+0000","last_change":"2023-12-19T05:47:56.709780+0000","last_active":"2023-12-19T05:47:57.585800+0000","last_peered":"2023-12-19T05:47:57.585800+0000","last_clean":"2023-12-19T05:47:57.585800+0000","last_became_active":"2023-12-19T05:47:56.708383+0000","last_became_peered":"2023-12-19T05:47:56.708383+0000","last_unstale":"2023-12-19T05:47:57.585800+0000","last_undegraded":"2023-12-19T05:47:57.585800+0000","last_fullsized":"2023-12-19T05:47:57.585800+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:56:55.047548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583599+0000","last_change":"2023-12-19T05:47:57.218733+0000","last_active":"2023-12-19T05:47:57.583599+0000","last_peered":"2023-12-19T05:47:57.583599+0000","last_clean":"2023-12-19T05:47:57.583599+0000","last_became_active":"2023-12-19T05:47:57.218351+0000","last_became_peered":"2023-12-19T05:47:57.218351+0000","last_unstale":"2023-12-19T05:47:57.583599+0000","last_undegraded":"2023-12-19T05:47:57.583599+0000","last_fullsized":"2023-12-19T05:47:57.583599+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:16.042300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"160'6","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583511+0000","last_change":"2023-12-19T05:47:56.694622+0000","last_active":"2023-12-19T05:47:57.583511+0000","last_peered":"2023-12-19T05:47:57.583511+0000","last_clean":"2023-12-19T05:47:57.583511+0000","last_became_active":"2023-12-19T05:47:56.693861+0000","last_became_peered":"2023-12-19T05:47:56.693861+0000","last_unstale":"2023-12-19T05:47:57.583511+0000","last_undegraded":"2023-12-19T05:47:57.583511+0000","last_fullsized":"2023-12-19T05:47:57.583511+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:35:12.113488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592674+0000","last_change":"2023-12-19T05:47:57.226709+0000","last_active":"2023-12-19T05:47:57.592674+0000","last_peered":"2023-12-19T05:47:57.592674+0000","last_clean":"2023-12-19T05:47:57.592674+0000","last_became_active":"2023-12-19T05:47:57.226441+0000","last_became_peered":"2023-12-19T05:47:57.226441+0000","last_unstale":"2023-12-19T05:47:57.592674+0000","last_undegraded":"2023-12-19T05:47:57.592674+0000","last_fullsized":"2023-12-19T05:47:57.592674+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:34.211997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592650+0000","last_change":"2023-12-19T05:47:56.712114+0000","last_active":"2023-12-19T05:47:57.592650+0000","last_peered":"2023-12-19T05:47:57.592650+0000","last_clean":"2023-12-19T05:47:57.592650+0000","last_became_active":"2023-12-19T05:47:56.711890+0000","last_became_peered":"2023-12-19T05:47:56.711890+0000","last_unstale":"2023-12-19T05:47:57.592650+0000","last_undegraded":"2023-12-19T05:47:57.592650+0000","last_fullsized":"2023-12-19T05:47:57.592650+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:08:25.851391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592425+0000","last_change":"2023-12-19T05:47:57.218731+0000","last_active":"2023-12-19T05:47:57.592425+0000","last_peered":"2023-12-19T05:47:57.592425+0000","last_clean":"2023-12-19T05:47:57.592425+0000","last_became_active":"2023-12-19T05:47:57.218245+0000","last_became_peered":"2023-12-19T05:47:57.218245+0000","last_unstale":"2023-12-19T05:47:57.592425+0000","last_undegraded":"2023-12-19T05:47:57.592425+0000","last_fullsized":"2023-12-19T05:47:57.592425+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:16:35.625458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590333+0000","last_change":"2023-12-19T05:47:56.699728+0000","last_active":"2023-12-19T05:47:57.590333+0000","last_peered":"2023-12-19T05:47:57.590333+0000","last_clean":"2023-12-19T05:47:57.590333+0000","last_became_active":"2023-12-19T05:47:56.699152+0000","last_became_peered":"2023-12-19T05:47:56.699152+0000","last_unstale":"2023-12-19T05:47:57.590333+0000","last_undegraded":"2023-12-19T05:47:57.590333+0000","last_fullsized":"2023-12-19T05:47:57.590333+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:35.226099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589377+0000","last_change":"2023-12-19T05:47:57.214985+0000","last_active":"2023-12-19T05:47:57.589377+0000","last_peered":"2023-12-19T05:47:57.589377+0000","last_clean":"2023-12-19T05:47:57.589377+0000","last_became_active":"2023-12-19T05:47:57.212803+0000","last_became_peered":"2023-12-19T05:47:57.212803+0000","last_unstale":"2023-12-19T05:47:57.589377+0000","last_undegraded":"2023-12-19T05:47:57.589377+0000","last_fullsized":"2023-12-19T05:47:57.589377+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:28:44.419770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"160'8","reported_seq":19,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589290+0000","last_change":"2023-12-19T05:47:56.710300+0000","last_active":"2023-12-19T05:47:57.589290+0000","last_peered":"2023-12-19T05:47:57.589290+0000","last_clean":"2023-12-19T05:47:57.589290+0000","last_became_active":"2023-12-19T05:47:56.710071+0000","last_became_peered":"2023-12-19T05:47:56.710071+0000","last_unstale":"2023-12-19T05:47:57.589290+0000","last_undegraded":"2023-12-19T05:47:57.589290+0000","last_fullsized":"2023-12-19T05:47:57.589290+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:30:50.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585960+0000","last_change":"2023-12-19T05:47:57.221133+0000","last_active":"2023-12-19T05:47:57.585960+0000","last_peered":"2023-12-19T05:47:57.585960+0000","last_clean":"2023-12-19T05:47:57.585960+0000","last_became_active":"2023-12-19T05:47:57.220817+0000","last_became_peered":"2023-12-19T05:47:57.220817+0000","last_unstale":"2023-12-19T05:47:57.585960+0000","last_undegraded":"2023-12-19T05:47:57.585960+0000","last_fullsized":"2023-12-19T05:47:57.585960+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:21:10.408699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589226+0000","last_change":"2023-12-19T05:47:56.697888+0000","last_active":"2023-12-19T05:47:57.589226+0000","last_peered":"2023-12-19T05:47:57.589226+0000","last_clean":"2023-12-19T05:47:57.589226+0000","last_became_active":"2023-12-19T05:47:56.695517+0000","last_became_peered":"2023-12-19T05:47:56.695517+0000","last_unstale":"2023-12-19T05:47:57.589226+0000","last_undegraded":"2023-12-19T05:47:57.589226+0000","last_fullsized":"2023-12-19T05:47:57.589226+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:59:58.474673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585722+0000","last_change":"2023-12-19T05:47:57.225122+0000","last_active":"2023-12-19T05:47:57.585722+0000","last_peered":"2023-12-19T05:47:57.585722+0000","last_clean":"2023-12-19T05:47:57.585722+0000","last_became_active":"2023-12-19T05:47:57.224880+0000","last_became_peered":"2023-12-19T05:47:57.224880+0000","last_unstale":"2023-12-19T05:47:57.585722+0000","last_undegraded":"2023-12-19T05:47:57.585722+0000","last_fullsized":"2023-12-19T05:47:57.585722+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:29.599064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590599+0000","last_change":"2023-12-19T05:47:56.704093+0000","last_active":"2023-12-19T05:47:57.590599+0000","last_peered":"2023-12-19T05:47:57.590599+0000","last_clean":"2023-12-19T05:47:57.590599+0000","last_became_active":"2023-12-19T05:47:56.703618+0000","last_became_peered":"2023-12-19T05:47:56.703618+0000","last_unstale":"2023-12-19T05:47:57.590599+0000","last_undegraded":"2023-12-19T05:47:57.590599+0000","last_fullsized":"2023-12-19T05:47:57.590599+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:42.367587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591117+0000","last_change":"2023-12-19T05:47:57.218993+0000","last_active":"2023-12-19T05:47:57.591117+0000","last_peered":"2023-12-19T05:47:57.591117+0000","last_clean":"2023-12-19T05:47:57.591117+0000","last_became_active":"2023-12-19T05:47:57.215628+0000","last_became_peered":"2023-12-19T05:47:57.215628+0000","last_unstale":"2023-12-19T05:47:57.591117+0000","last_undegraded":"2023-12-19T05:47:57.591117+0000","last_fullsized":"2023-12-19T05:47:57.591117+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:13.345883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573644+0000","last_change":"2023-12-19T05:47:56.706133+0000","last_active":"2023-12-19T05:47:57.573644+0000","last_peered":"2023-12-19T05:47:57.573644+0000","last_clean":"2023-12-19T05:47:57.573644+0000","last_became_active":"2023-12-19T05:47:56.705551+0000","last_became_peered":"2023-12-19T05:47:56.705551+0000","last_unstale":"2023-12-19T05:47:57.573644+0000","last_undegraded":"2023-12-19T05:47:57.573644+0000","last_fullsized":"2023-12-19T05:47:57.573644+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:09:14.164035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591366+0000","last_change":"2023-12-19T05:47:57.226579+0000","last_active":"2023-12-19T05:47:57.591366+0000","last_peered":"2023-12-19T05:47:57.591366+0000","last_clean":"2023-12-19T05:47:57.591366+0000","last_became_active":"2023-12-19T05:47:57.226168+0000","last_became_peered":"2023-12-19T05:47:57.226168+0000","last_unstale":"2023-12-19T05:47:57.591366+0000","last_undegraded":"2023-12-19T05:47:57.591366+0000","last_fullsized":"2023-12-19T05:47:57.591366+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:03:29.146790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.585864+0000","last_change":"2023-12-19T05:47:56.714529+0000","last_active":"2023-12-19T05:47:57.585864+0000","last_peered":"2023-12-19T05:47:57.585864+0000","last_clean":"2023-12-19T05:47:57.585864+0000","last_became_active":"2023-12-19T05:47:56.714272+0000","last_became_peered":"2023-12-19T05:47:56.714272+0000","last_unstale":"2023-12-19T05:47:57.585864+0000","last_undegraded":"2023-12-19T05:47:57.585864+0000","last_fullsized":"2023-12-19T05:47:57.585864+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:44:12.892153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590965+0000","last_change":"2023-12-19T05:47:57.215755+0000","last_active":"2023-12-19T05:47:57.590965+0000","last_peered":"2023-12-19T05:47:57.590965+0000","last_clean":"2023-12-19T05:47:57.590965+0000","last_became_active":"2023-12-19T05:47:57.215399+0000","last_became_peered":"2023-12-19T05:47:57.215399+0000","last_unstale":"2023-12-19T05:47:57.590965+0000","last_undegraded":"2023-12-19T05:47:57.590965+0000","last_fullsized":"2023-12-19T05:47:57.590965+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:27:01.584776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573533+0000","last_change":"2023-12-19T05:47:56.700339+0000","last_active":"2023-12-19T05:47:57.573533+0000","last_peered":"2023-12-19T05:47:57.573533+0000","last_clean":"2023-12-19T05:47:57.573533+0000","last_became_active":"2023-12-19T05:47:56.698863+0000","last_became_peered":"2023-12-19T05:47:56.698863+0000","last_unstale":"2023-12-19T05:47:57.573533+0000","last_undegraded":"2023-12-19T05:47:57.573533+0000","last_fullsized":"2023-12-19T05:47:57.573533+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:15.121513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583620+0000","last_change":"2023-12-19T05:47:57.214648+0000","last_active":"2023-12-19T05:47:57.583620+0000","last_peered":"2023-12-19T05:47:57.583620+0000","last_clean":"2023-12-19T05:47:57.583620+0000","last_became_active":"2023-12-19T05:47:57.214391+0000","last_became_peered":"2023-12-19T05:47:57.214391+0000","last_unstale":"2023-12-19T05:47:57.583620+0000","last_undegraded":"2023-12-19T05:47:57.583620+0000","last_fullsized":"2023-12-19T05:47:57.583620+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:44:06.962341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591689+0000","last_change":"2023-12-19T05:47:56.697466+0000","last_active":"2023-12-19T05:47:57.591689+0000","last_peered":"2023-12-19T05:47:57.591689+0000","last_clean":"2023-12-19T05:47:57.591689+0000","last_became_active":"2023-12-19T05:47:56.696721+0000","last_became_peered":"2023-12-19T05:47:56.696721+0000","last_unstale":"2023-12-19T05:47:57.591689+0000","last_undegraded":"2023-12-19T05:47:57.591689+0000","last_fullsized":"2023-12-19T05:47:57.591689+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:31:22.142037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592628+0000","last_change":"2023-12-19T05:47:57.228939+0000","last_active":"2023-12-19T05:47:57.592628+0000","last_peered":"2023-12-19T05:47:57.592628+0000","last_clean":"2023-12-19T05:47:57.592628+0000","last_became_active":"2023-12-19T05:47:57.228705+0000","last_became_peered":"2023-12-19T05:47:57.228705+0000","last_unstale":"2023-12-19T05:47:57.592628+0000","last_undegraded":"2023-12-19T05:47:57.592628+0000","last_fullsized":"2023-12-19T05:47:57.592628+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:37:07.686223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592717+0000","last_change":"2023-12-19T05:47:56.708017+0000","last_active":"2023-12-19T05:47:57.592717+0000","last_peered":"2023-12-19T05:47:57.592717+0000","last_clean":"2023-12-19T05:47:57.592717+0000","last_became_active":"2023-12-19T05:47:56.707756+0000","last_became_peered":"2023-12-19T05:47:56.707756+0000","last_unstale":"2023-12-19T05:47:57.592717+0000","last_undegraded":"2023-12-19T05:47:57.592717+0000","last_fullsized":"2023-12-19T05:47:57.592717+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:42.577046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589545+0000","last_change":"2023-12-19T05:47:57.225339+0000","last_active":"2023-12-19T05:47:57.589545+0000","last_peered":"2023-12-19T05:47:57.589545+0000","last_clean":"2023-12-19T05:47:57.589545+0000","last_became_active":"2023-12-19T05:47:57.225011+0000","last_became_peered":"2023-12-19T05:47:57.225011+0000","last_unstale":"2023-12-19T05:47:57.589545+0000","last_undegraded":"2023-12-19T05:47:57.589545+0000","last_fullsized":"2023-12-19T05:47:57.589545+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:36.628039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590416+0000","last_change":"2023-12-19T05:47:56.704390+0000","last_active":"2023-12-19T05:47:57.590416+0000","last_peered":"2023-12-19T05:47:57.590416+0000","last_clean":"2023-12-19T05:47:57.590416+0000","last_became_active":"2023-12-19T05:47:56.701634+0000","last_became_peered":"2023-12-19T05:47:56.701634+0000","last_unstale":"2023-12-19T05:47:57.590416+0000","last_undegraded":"2023-12-19T05:47:57.590416+0000","last_fullsized":"2023-12-19T05:47:57.590416+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:51:29.365133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.583640+0000","last_change":"2023-12-19T05:47:57.218610+0000","last_active":"2023-12-19T05:47:57.583640+0000","last_peered":"2023-12-19T05:47:57.583640+0000","last_clean":"2023-12-19T05:47:57.583640+0000","last_became_active":"2023-12-19T05:47:57.218029+0000","last_became_peered":"2023-12-19T05:47:57.218029+0000","last_unstale":"2023-12-19T05:47:57.583640+0000","last_undegraded":"2023-12-19T05:47:57.583640+0000","last_fullsized":"2023-12-19T05:47:57.583640+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:23:57.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591839+0000","last_change":"2023-12-19T05:47:56.697790+0000","last_active":"2023-12-19T05:47:57.591839+0000","last_peered":"2023-12-19T05:47:57.591839+0000","last_clean":"2023-12-19T05:47:57.591839+0000","last_became_active":"2023-12-19T05:47:56.697009+0000","last_became_peered":"2023-12-19T05:47:56.697009+0000","last_unstale":"2023-12-19T05:47:57.591839+0000","last_undegraded":"2023-12-19T05:47:57.591839+0000","last_fullsized":"2023-12-19T05:47:57.591839+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:38:36.959492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591155+0000","last_change":"2023-12-19T05:47:57.216264+0000","last_active":"2023-12-19T05:47:57.591155+0000","last_peered":"2023-12-19T05:47:57.591155+0000","last_clean":"2023-12-19T05:47:57.591155+0000","last_became_active":"2023-12-19T05:47:57.214563+0000","last_became_peered":"2023-12-19T05:47:57.214563+0000","last_unstale":"2023-12-19T05:47:57.591155+0000","last_undegraded":"2023-12-19T05:47:57.591155+0000","last_fullsized":"2023-12-19T05:47:57.591155+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:31:00.020426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-12-19T05:47:58.655330+0000","last_change":"2023-12-19T05:47:56.710042+0000","last_active":"2023-12-19T05:47:58.655330+0000","last_peered":"2023-12-19T05:47:58.655330+0000","last_clean":"2023-12-19T05:47:58.655330+0000","last_became_active":"2023-12-19T05:47:56.708759+0000","last_became_peered":"2023-12-19T05:47:56.708759+0000","last_unstale":"2023-12-19T05:47:58.655330+0000","last_undegraded":"2023-12-19T05:47:58.655330+0000","last_fullsized":"2023-12-19T05:47:58.655330+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:29:06.091177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592696+0000","last_change":"2023-12-19T05:47:57.220059+0000","last_active":"2023-12-19T05:47:57.592696+0000","last_peered":"2023-12-19T05:47:57.592696+0000","last_clean":"2023-12-19T05:47:57.592696+0000","last_became_active":"2023-12-19T05:47:57.219772+0000","last_became_peered":"2023-12-19T05:47:57.219772+0000","last_unstale":"2023-12-19T05:47:57.592696+0000","last_undegraded":"2023-12-19T05:47:57.592696+0000","last_fullsized":"2023-12-19T05:47:57.592696+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:18.307014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591725+0000","last_change":"2023-12-19T05:47:56.709164+0000","last_active":"2023-12-19T05:47:57.591725+0000","last_peered":"2023-12-19T05:47:57.591725+0000","last_clean":"2023-12-19T05:47:57.591725+0000","last_became_active":"2023-12-19T05:47:56.708673+0000","last_became_peered":"2023-12-19T05:47:56.708673+0000","last_unstale":"2023-12-19T05:47:57.591725+0000","last_undegraded":"2023-12-19T05:47:57.591725+0000","last_fullsized":"2023-12-19T05:47:57.591725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:35:22.342986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573421+0000","last_change":"2023-12-19T05:47:57.229503+0000","last_active":"2023-12-19T05:47:57.573421+0000","last_peered":"2023-12-19T05:47:57.573421+0000","last_clean":"2023-12-19T05:47:57.573421+0000","last_became_active":"2023-12-19T05:47:57.229195+0000","last_became_peered":"2023-12-19T05:47:57.229195+0000","last_unstale":"2023-12-19T05:47:57.573421+0000","last_undegraded":"2023-12-19T05:47:57.573421+0000","last_fullsized":"2023-12-19T05:47:57.573421+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:00.190892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592739+0000","last_change":"2023-12-19T05:47:56.710228+0000","last_active":"2023-12-19T05:47:57.592739+0000","last_peered":"2023-12-19T05:47:57.592739+0000","last_clean":"2023-12-19T05:47:57.592739+0000","last_became_active":"2023-12-19T05:47:56.709969+0000","last_became_peered":"2023-12-19T05:47:56.709969+0000","last_unstale":"2023-12-19T05:47:57.592739+0000","last_undegraded":"2023-12-19T05:47:57.592739+0000","last_fullsized":"2023-12-19T05:47:57.592739+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:09:00.513843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589397+0000","last_change":"2023-12-19T05:47:57.212151+0000","last_active":"2023-12-19T05:47:57.589397+0000","last_peered":"2023-12-19T05:47:57.589397+0000","last_clean":"2023-12-19T05:47:57.589397+0000","last_became_active":"2023-12-19T05:47:57.211888+0000","last_became_peered":"2023-12-19T05:47:57.211888+0000","last_unstale":"2023-12-19T05:47:57.589397+0000","last_undegraded":"2023-12-19T05:47:57.589397+0000","last_fullsized":"2023-12-19T05:47:57.589397+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:26.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591404+0000","last_change":"2023-12-19T05:47:56.712473+0000","last_active":"2023-12-19T05:47:57.591404+0000","last_peered":"2023-12-19T05:47:57.591404+0000","last_clean":"2023-12-19T05:47:57.591404+0000","last_became_active":"2023-12-19T05:47:56.711836+0000","last_became_peered":"2023-12-19T05:47:56.711836+0000","last_unstale":"2023-12-19T05:47:57.591404+0000","last_undegraded":"2023-12-19T05:47:57.591404+0000","last_fullsized":"2023-12-19T05:47:57.591404+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:51:35.616735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589481+0000","last_change":"2023-12-19T05:47:57.225692+0000","last_active":"2023-12-19T05:47:57.589481+0000","last_peered":"2023-12-19T05:47:57.589481+0000","last_clean":"2023-12-19T05:47:57.589481+0000","last_became_active":"2023-12-19T05:47:57.225437+0000","last_became_peered":"2023-12-19T05:47:57.225437+0000","last_unstale":"2023-12-19T05:47:57.589481+0000","last_undegraded":"2023-12-19T05:47:57.589481+0000","last_fullsized":"2023-12-19T05:47:57.589481+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:35.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589418+0000","last_change":"2023-12-19T05:47:56.702949+0000","last_active":"2023-12-19T05:47:57.589418+0000","last_peered":"2023-12-19T05:47:57.589418+0000","last_clean":"2023-12-19T05:47:57.589418+0000","last_became_active":"2023-12-19T05:47:56.700825+0000","last_became_peered":"2023-12-19T05:47:56.700825+0000","last_unstale":"2023-12-19T05:47:57.589418+0000","last_undegraded":"2023-12-19T05:47:57.589418+0000","last_fullsized":"2023-12-19T05:47:57.589418+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:50:38.603374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.591647+0000","last_change":"2023-12-19T05:47:57.229289+0000","last_active":"2023-12-19T05:47:57.591647+0000","last_peered":"2023-12-19T05:47:57.591647+0000","last_clean":"2023-12-19T05:47:57.591647+0000","last_became_active":"2023-12-19T05:47:57.228828+0000","last_became_peered":"2023-12-19T05:47:57.228828+0000","last_unstale":"2023-12-19T05:47:57.591647+0000","last_undegraded":"2023-12-19T05:47:57.591647+0000","last_fullsized":"2023-12-19T05:47:57.591647+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:16.042300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.590292+0000","last_change":"2023-12-19T05:47:56.701228+0000","last_active":"2023-12-19T05:47:57.590292+0000","last_peered":"2023-12-19T05:47:57.590292+0000","last_clean":"2023-12-19T05:47:57.590292+0000","last_became_active":"2023-12-19T05:47:56.700123+0000","last_became_peered":"2023-12-19T05:47:56.700123+0000","last_unstale":"2023-12-19T05:47:57.590292+0000","last_undegraded":"2023-12-19T05:47:57.590292+0000","last_fullsized":"2023-12-19T05:47:57.590292+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:10:18.933469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592468+0000","last_change":"2023-12-19T05:47:57.222809+0000","last_active":"2023-12-19T05:47:57.592468+0000","last_peered":"2023-12-19T05:47:57.592468+0000","last_clean":"2023-12-19T05:47:57.592468+0000","last_became_active":"2023-12-19T05:47:57.221041+0000","last_became_peered":"2023-12-19T05:47:57.221041+0000","last_unstale":"2023-12-19T05:47:57.592468+0000","last_undegraded":"2023-12-19T05:47:57.592468+0000","last_fullsized":"2023-12-19T05:47:57.592468+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:43.378890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.592378+0000","last_change":"2023-12-19T05:47:56.710838+0000","last_active":"2023-12-19T05:47:57.592378+0000","last_peered":"2023-12-19T05:47:57.592378+0000","last_clean":"2023-12-19T05:47:57.592378+0000","last_became_active":"2023-12-19T05:47:56.710599+0000","last_became_peered":"2023-12-19T05:47:56.710599+0000","last_unstale":"2023-12-19T05:47:57.592378+0000","last_undegraded":"2023-12-19T05:47:57.592378+0000","last_fullsized":"2023-12-19T05:47:57.592378+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:32.755391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.573622+0000","last_change":"2023-12-19T05:47:57.203515+0000","last_active":"2023-12-19T05:47:57.573622+0000","last_peered":"2023-12-19T05:47:57.573622+0000","last_clean":"2023-12-19T05:47:57.573622+0000","last_became_active":"2023-12-19T05:47:57.203329+0000","last_became_peered":"2023-12-19T05:47:57.203329+0000","last_unstale":"2023-12-19T05:47:57.573622+0000","last_undegraded":"2023-12-19T05:47:57.573622+0000","last_fullsized":"2023-12-19T05:47:57.573622+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:56.670796+0000","last_clean_scrub_stamp":"2023-12-19T05:47:56.670796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:24:06.860178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.589587+0000","last_change":"2023-12-19T05:47:56.711837+0000","last_active":"2023-12-19T05:47:57.589587+0000","last_peered":"2023-12-19T05:47:57.589587+0000","last_clean":"2023-12-19T05:47:57.589587+0000","last_became_active":"2023-12-19T05:47:56.711589+0000","last_became_peered":"2023-12-19T05:47:56.711589+0000","last_unstale":"2023-12-19T05:47:57.589587+0000","last_undegraded":"2023-12-19T05:47:57.589587+0000","last_fullsized":"2023-12-19T05:47:57.589587+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:47:55.659493+0000","last_clean_scrub_stamp":"2023-12-19T05:47:55.659493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:12.781553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":294,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-12-19T05:47:57.207814+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:47:57.207814+0000","last_peered":"2023-12-19T05:47:57.207814+0000","last_clean":"2023-12-19T05:47:57.207814+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:47:57.207814+0000","last_undegraded":"2023-12-19T05:47:57.207814+0000","last_fullsized":"2023-12-19T05:47:57.207814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199097239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.1359999999999999,"15min":1.0600000000000001},"min":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.554,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.145,"15min":1.0780000000000001},"min":{"1min":0.73099999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4119999999999999,"5min":3.976,"15min":3.976},"last":1.1819999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1859999999999999,"15min":1.1080000000000001},"min":{"1min":0.76900000000000002,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":1.387,"5min":6.399,"15min":6.399},"last":1.22},{"interface":"front","average":{"1min":1.204,"5min":1.2230000000000001,"15min":1.173},"min":{"1min":0.78500000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.6599999999999999,"5min":4.25,"15min":4.25},"last":1.4470000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.651},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.72199999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3640000000000001,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.98599999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.345,"15min":1.2070000000000001},"min":{"1min":0.94899999999999995,"5min":0.78200000000000003,"15min":0.622},"max":{"1min":1.776,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.411,"15min":1.3360000000000001},"min":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83299999999999996},"max":{"1min":1.6890000000000001,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":1.044}]},{"osd":4,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1859999999999999,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.345,"15min":1.2789999999999999},"min":{"1min":0.79600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.917,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.319}]},{"osd":5,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3879999999999999,"15min":1.333},"min":{"1min":0.82399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.1480000000000001,"5min":6.3099999999999996,"15min":6.3099999999999996},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.339,"15min":1.26},"min":{"1min":0.72699999999999998,"5min":0.59599999999999997,"15min":0.55600000000000005},"max":{"1min":1.631,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.9970000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.4870000000000001,"15min":1.3720000000000001},"min":{"1min":0.77500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0310000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.7889999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5609999999999999,"15min":1.4370000000000001},"min":{"1min":0.93999999999999995,"5min":0.68799999999999994,"15min":0.59999999999999998},"max":{"1min":2.0139999999999998,"5min":7.7519999999999998,"15min":7.7519999999999998},"last":1.401}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199097273,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.171},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4970000000000001,"5min":1.7310000000000001,"15min":4.7000000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.0660000000000001,"15min":1.038},"min":{"1min":0.621,"5min":0.621,"15min":0.46500000000000002},"max":{"1min":1.4179999999999999,"5min":1.635,"15min":1.635},"last":0.82399999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.159},"min":{"1min":0.85799999999999998,"5min":0.66900000000000004,"15min":0.64900000000000002},"max":{"1min":1.5449999999999999,"5min":1.792,"15min":1.792},"last":1.48},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2270000000000001,"15min":1.29},"min":{"1min":0.90200000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":3.4670000000000001},"last":1.3260000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.141,"15min":1.177},"min":{"1min":0.77700000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1990000000000001,"15min":1.2769999999999999},"min":{"1min":0.90100000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5349999999999999,"5min":1.6699999999999999,"15min":3.5859999999999999},"last":1.2250000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1759999999999999,"15min":1.306},"min":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.70799999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.5220000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.262,"15min":1.341},"min":{"1min":1.097,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.885,"5min":2.0059999999999998,"15min":4.452},"last":1.3660000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.1870000000000001,"15min":1.302},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7470000000000001,"15min":2.7130000000000001},"last":1.641},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.226,"15min":1.3899999999999999},"min":{"1min":0.88700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":4.6689999999999996},"last":1.282}]},{"osd":5,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.365,"15min":1.5169999999999999},"min":{"1min":0.92800000000000005,"5min":0.56799999999999995,"15min":0.53900000000000003},"max":{"1min":1.9099999999999999,"5min":2.0179999999999998,"15min":4.5670000000000002},"last":2.2759999999999998},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4350000000000001,"15min":1.653},"min":{"1min":1.1279999999999999,"5min":0.64000000000000001,"15min":0.63400000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":3.681},"last":2.2069999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3999999999999999,"15min":1.492},"min":{"1min":0.999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.96,"5min":1.96,"15min":3.2719999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.5209999999999999,"15min":1.595},"min":{"1min":1.3380000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":4.7480000000000002},"last":1.6819999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1458,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193853,"statfs":{"total":200000000,"available":198506163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":2.9620000000000002,"15min":6.9420000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1579999999999999,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.438},"max":{"1min":1.5700000000000001,"5min":2.1219999999999999,"15min":2.641},"last":0.97399999999999998}]},{"osd":1,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.208,"15min":1.228},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.56299999999999994},"max":{"1min":1.5209999999999999,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.274},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.3049999999999999,"15min":1.355},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.65600000000000003},"max":{"1min":1.6319999999999999,"5min":2.2890000000000001,"15min":6.8700000000000001},"last":0.86699999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.2150000000000001,"15min":1.224},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.516,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.175},{"interface":"front","average":{"1min":1.105,"5min":1.206,"15min":1.212},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.677,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.143}]},{"osd":3,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2929999999999999,"15min":1.4159999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.61899999999999999},"max":{"1min":1.7669999999999999,"5min":2.774,"15min":6.9969999999999999},"last":1.242},{"interface":"front","average":{"1min":1.177,"5min":1.333,"15min":1.399},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.992,"15min":2.992},"last":1.296}]},{"osd":4,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.238,"15min":1.4299999999999999},"min":{"1min":0.65800000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5589999999999999,"5min":3.2040000000000002,"15min":6.3559999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.528},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.8859999999999999,"5min":3.0499999999999998,"15min":7.0469999999999997},"last":1.518}]},{"osd":6,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.407,"15min":1.478},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6739999999999999,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4239999999999999,"15min":1.5960000000000001},"min":{"1min":0.78500000000000003,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0190000000000001,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.0389999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.512,"15min":1.6659999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":3.2639999999999998,"15min":7.0949999999999998},"last":1.341},{"interface":"front","average":{"1min":1.48,"5min":1.5860000000000001,"15min":1.607},"min":{"1min":0.80100000000000005,"5min":0.753,"15min":0.53200000000000003},"max":{"1min":1.905,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.423}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199097273,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.073,"15min":1.0249999999999999},"min":{"1min":0.58599999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.006},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1279999999999999,"15min":1.077},"min":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.1950000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.66000000000000003,"15min":0.64600000000000002},"max":{"1min":1.677,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.222,"15min":1.095},"min":{"1min":0.81799999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8600000000000001,"5min":1.954,"15min":1.954},"last":1.4179999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.206,"15min":1.2},"min":{"1min":0.748,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.8380000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2649999999999999,"15min":1.226},"min":{"1min":0.77800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.5509999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.236,"15min":1.115},"min":{"1min":0.66200000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1079999999999997,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":1.321},{"interface":"front","average":{"1min":1.181,"5min":1.3240000000000001,"15min":1.292},"min":{"1min":0.82499999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5129999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.4770000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.351},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.825,"5min":2.081,"15min":2.081},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.4299999999999999,"15min":1.323},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.2160000000000002,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":1.52}]},{"osd":6,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.397,"15min":1.3740000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.47,"15min":1.419},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.639}]},{"osd":7,"last update":"Tue Dec 19 05:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.49,"15min":1.3879999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":5.484,"5min":5.484,"15min":5.484},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.51,"15min":1.472},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0099999999999998,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.589}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199097203,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.314,"15min":0.314},"max":{"1min":1.6919999999999999,"5min":1.99,"15min":1.99},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":0.83999999999999997},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.34999999999999998},"max":{"1min":1.464,"5min":1.72,"15min":1.72},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.879,"15min":0.90200000000000002},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.393,"5min":1.6060000000000001,"15min":2.702},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0740000000000001,"15min":0.97499999999999998},"min":{"1min":0.624,"5min":0.45800000000000002,"15min":0.39100000000000001},"max":{"1min":1.4350000000000001,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4650000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0880000000000001,"15min":0.96599999999999997},"min":{"1min":0.501,"5min":0.47299999999999998,"15min":0.45200000000000001},"max":{"1min":1.7410000000000001,"5min":1.796,"15min":1.796},"last":1.085},{"interface":"front","average":{"1min":1.24,"5min":1.228,"15min":1.1100000000000001},"min":{"1min":0.81699999999999995,"5min":0.498,"15min":0.45600000000000002},"max":{"1min":1.5229999999999999,"5min":2.931,"15min":2.931},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1870000000000001,"15min":1.161},"min":{"1min":0.91900000000000004,"5min":0.58199999999999996,"15min":0.51400000000000001},"max":{"1min":1.716,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.224},{"interface":"front","average":{"1min":1.256,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.302}]},{"osd":5,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3660000000000001,"15min":1.327},"min":{"1min":0.88300000000000001,"5min":0.77700000000000002,"15min":0.75600000000000001},"max":{"1min":1.829,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.55},{"interface":"front","average":{"1min":1.325,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":0.97599999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.581,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.272}]},{"osd":6,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4330000000000001,"15min":1.375},"min":{"1min":1.038,"5min":0.77500000000000002,"15min":0.71499999999999997},"max":{"1min":1.6819999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.341,"15min":1.327},"min":{"1min":0.84099999999999997,"5min":0.69799999999999995,"15min":0.69199999999999995},"max":{"1min":1.8680000000000001,"5min":1.9730000000000001,"15min":2.02},"last":1.002}]},{"osd":7,"last update":"Tue Dec 19 05:47:03 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4099999999999999,"15min":1.389},"min":{"1min":0.79300000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.929,"5min":2.1000000000000001,"15min":2.1509999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.4339999999999999,"15min":1.425},"min":{"1min":0.82299999999999995,"5min":0.748,"15min":0.70099999999999996},"max":{"1min":1.776,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.4199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199096601,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.84799999999999998,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.341,"5min":1.516,"15min":1.516},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94899999999999995,"15min":0.91700000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8660000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.57999999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1499999999999999,"15min":1.0680000000000001},"min":{"1min":0.64900000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.877},{"interface":"front","average":{"1min":1.071,"5min":1.2330000000000001,"15min":1.163},"min":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5629999999999999,"5min":1.867,"15min":1.867},"last":0.755}]},{"osd":3,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97699999999999998,"15min":0.92800000000000005},"min":{"1min":0.54700000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2689999999999999,"5min":1.5980000000000001,"15min":1.6399999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.202,"5min":1.2250000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6439999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3740000000000001,"15min":1.2869999999999999},"min":{"1min":0.82399999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.8879999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.331,"15min":1.256},"min":{"1min":0.88100000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.3370000000000002},"last":1.0649999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.385,"15min":1.302},"min":{"1min":0.80700000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.732,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.258},{"interface":"front","average":{"1min":1.361,"5min":1.343,"15min":1.302},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.72699999999999998},"max":{"1min":2.21,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.0049999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.327,"15min":1.294},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.655,"5min":1.897,"15min":2.0950000000000002},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.4870000000000001,"15min":1.3640000000000001},"min":{"1min":1.018,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.153,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.0349999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.522,"15min":1.4350000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.84799999999999998},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.4350000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5289999999999999,"15min":1.4430000000000001},"min":{"1min":1.0489999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8260000000000001,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.2709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193852,"statfs":{"total":200000000,"available":198505319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88800000000000001,"15min":0.92100000000000004},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":1.4650000000000001,"5min":1.504,"15min":2.992},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.43099999999999999},"max":{"1min":1.4059999999999999,"5min":1.704,"15min":3.5169999999999999},"last":1.169}]},{"osd":2,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.89700000000000002,"15min":0.94699999999999995},"min":{"1min":0.45000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.5,"5min":1.577,"15min":2.2789999999999999},"last":1.03},{"interface":"front","average":{"1min":1.024,"5min":1.105,"15min":1.333},"min":{"1min":0.57599999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.879,"5min":1.879,"15min":70.206000000000003},"last":1.105}]},{"osd":3,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.46100000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":3.5670000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.242,"15min":1.232},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.39400000000000002},"max":{"1min":1.8089999999999999,"5min":2.3580000000000001,"15min":3.1920000000000002},"last":0.95099999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3120000000000001,"15min":1.2370000000000001},"min":{"1min":0.79800000000000004,"5min":0.78300000000000003,"15min":0.74399999999999999},"max":{"1min":1.7709999999999999,"5min":2.3969999999999998,"15min":5.3860000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.4239999999999999,"15min":1.3919999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0840000000000001,"5min":2.5960000000000001,"15min":4.306},"last":1.264}]},{"osd":5,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":0.92700000000000005,"5min":0.79500000000000004,"15min":0.68400000000000005},"max":{"1min":1.968,"5min":2.5550000000000002,"15min":4.9880000000000004},"last":1.296},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3999999999999999,"15min":1.3700000000000001},"min":{"1min":0.82499999999999996,"5min":0.753,"15min":0.67900000000000005},"max":{"1min":2.0569999999999999,"5min":2.464,"15min":5.4569999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.512,"15min":1.4450000000000001},"min":{"1min":0.84699999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0179999999999998,"5min":2.8860000000000001,"15min":5.1429999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4770000000000001,"15min":1.4359999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.70199999999999996},"max":{"1min":1.9139999999999999,"5min":2.6899999999999999,"15min":3.75},"last":1.4790000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:47:11 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.583,"15min":1.5469999999999999},"min":{"1min":0.83399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":8.4039999999999999},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.6180000000000001,"15min":1.607},"min":{"1min":0.84399999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.873,"5min":2.7290000000000001,"15min":8.2390000000000008},"last":1.5760000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194429,"statfs":{"total":200000000,"available":199095653,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83999999999999997,"15min":0.80200000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5209999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.94399999999999995,"15min":0.89300000000000002},"min":{"1min":0.42299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.569,"5min":1.837,"15min":2.0459999999999998},"last":1.04}]},{"osd":2,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.0629999999999999},"min":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.153,"15min":1.141},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5029999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4219999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":0.88700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.218,"5min":1.4690000000000001,"15min":1.5229999999999999},"last":0.876},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.1339999999999999,"15min":1.071},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7330000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.6890000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2390000000000001,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.60299999999999998,"15min":0.59499999999999997},"max":{"1min":1.6140000000000001,"5min":1.845,"15min":1.845},"last":1.742},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.367,"15min":1.28},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.954,"5min":2.149,"15min":2.149},"last":1.278}]},{"osd":5,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.327},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.63300000000000001},"max":{"1min":1.7969999999999999,"5min":2.173,"15min":2.173},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3580000000000001,"15min":1.294},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7210000000000001,"5min":1.8340000000000001,"15min":1.879},"last":1.5649999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.45,"15min":1.3959999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0489999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.504},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.2949999999999999},"min":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.016,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.6339999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:47:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4890000000000001,"15min":1.4279999999999999},"min":{"1min":0.89100000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.917,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.4330000000000001,"15min":1.3779999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7629999999999999,"5min":2.0510000000000002,"15min":2.2410000000000001},"last":1.369}]}]}],"pool_statfs":[]}} 2023-12-19T05:48:02.803 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:48:02.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:48:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.084+0000 7f401bfff640 1 Processor -- start 2023-12-19T05:48:03.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.084+0000 7f401bfff640 1 -- start start 2023-12-19T05:48:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f401c0b7c40 0x7f401c167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401bfff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c070cf0 con 0x7f401c146d60 2023-12-19T05:48:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401bfff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c0b3200 con 0x7f401c06fb70 2023-12-19T05:48:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401bfff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c147140 con 0x7f401c0b7c40 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f401c146d60 0x7f401c0b6e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52828/0 (socket says 172.21.15.49:52828) 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401affd640 1 -- 172.21.15.49:0/389833256 learned_addr learned my addr 172.21.15.49:0/389833256 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401b7fe640 1 --2- 172.21.15.49:0/389833256 >> v2:172.21.15.49:3300/0 conn(0x7f401c0b7c40 0x7f401c167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401b7fe640 1 -- 172.21.15.49:0/389833256 >> v1:172.21.15.115:6789/0 conn(0x7f401c06fb70 legacy=0x7f401c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.086+0000 7f401b7fe640 1 -- 172.21.15.49:0/389833256 >> v1:172.21.15.49:6789/0 conn(0x7f401c146d60 legacy=0x7f401c0b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.087+0000 7f401b7fe640 1 -- 172.21.15.49:0/389833256 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c0b1470 con 0x7f401c0b7c40 2023-12-19T05:48:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.087+0000 7f4019ffb640 1 -- 172.21.15.49:0/389833256 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603360948 0 0) 0x7f401c070cf0 con 0x7f401c146d60 2023-12-19T05:48:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.088+0000 7f401b7fe640 1 --2- 172.21.15.49:0/389833256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c0b7c40 0x7f401c167fc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f40140097a0 tx=0x7f401402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352126aad25f683a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.088+0000 7f4019ffb640 1 -- 172.21.15.49:0/389833256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014030610 con 0x7f401c0b7c40 2023-12-19T05:48:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.088+0000 7f4019ffb640 1 -- 172.21.15.49:0/389833256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014030770 con 0x7f401c0b7c40 2023-12-19T05:48:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.088+0000 7f4019ffb640 1 -- 172.21.15.49:0/389833256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014030b00 con 0x7f401c0b7c40 2023-12-19T05:48:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 -- 172.21.15.49:0/389833256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c0b7c40 msgr2=0x7f401c167fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 --2- 172.21.15.49:0/389833256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c0b7c40 0x7f401c167fc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f40140097a0 tx=0x7f401402b960 comp rx=0 tx=0).stop 2023-12-19T05:48:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 -- 172.21.15.49:0/389833256 shutdown_connections 2023-12-19T05:48:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 --2- 172.21.15.49:0/389833256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c0b7c40 0x7f401c167fc0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 -- 172.21.15.49:0/389833256 >> 172.21.15.49:0/389833256 conn(0x7f401c0b2390 msgr2=0x7f401c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 -- 172.21.15.49:0/389833256 shutdown_connections 2023-12-19T05:48:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.089+0000 7f401bfff640 1 -- 172.21.15.49:0/389833256 wait complete. 2023-12-19T05:48:03.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.091+0000 7f401bfff640 1 Processor -- start 2023-12-19T05:48:03.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.091+0000 7f401bfff640 1 -- start start 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 0x7f401c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f401c146d60 0x7f401c132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c15d750 con 0x7f401c06fb70 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c132910 con 0x7f401c0b7c40 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.092+0000 7f401bfff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c131d00 con 0x7f401c146d60 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50704/0 (socket says 172.21.15.49:50704) 2023-12-19T05:48:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 -- 172.21.15.49:0/958133444 learned_addr learned my addr 172.21.15.49:0/958133444 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401b7fe640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f401c146d60 0x7f401c132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401a7fc640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 0x7f401c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 -- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f401c146d60 msgr2=0x7f401c132da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f401c146d60 0x7f401c132da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 -- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 msgr2=0x7f401c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 0x7f401c15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 -- 172.21.15.49:0/958133444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014009400 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401a7fc640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 0x7f401c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.093+0000 7f401affd640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c7a0 tx=0x7f400c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.094+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00a640 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.094+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c00a7a0 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.094+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c131fe0 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.094+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00ab90 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.094+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c1325a0 con 0x7f401c06fb70 2023-12-19T05:48:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.095+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c061910 con 0x7f401c06fb70 2023-12-19T05:48:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.096+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f400c00acf0 con 0x7f401c06fb70 2023-12-19T05:48:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.097+0000 7f40137fe640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 0x7f3ffc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.097+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f400c088210 con 0x7f401c06fb70 2023-12-19T05:48:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.098+0000 7f401a7fc640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 0x7f3ffc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.099+0000 7f401a7fc640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 0x7f3ffc06c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f401c09c740 tx=0x7f4004009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.101+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f400c0537f0 con 0x7f401c06fb70 2023-12-19T05:48:03.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.363+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f401c146510 con 0x7f401c06fb70 2023-12-19T05:48:03.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.371+0000 7f40137fe640 1 -- 172.21.15.49:0/958133444 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f400c0170e0 con 0x7f401c06fb70 2023-12-19T05:48:03.373 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 msgr2=0x7f3ffc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 0x7f3ffc06c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f401c09c740 tx=0x7f4004009040 comp rx=0 tx=0).stop 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 msgr2=0x7f401c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c7a0 tx=0x7f400c00cc60 comp rx=0 tx=0).stop 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 shutdown_connections 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3ffc06a430 0x7f3ffc06c8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f401c146d60 0x7f401c132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0b7c40 0x7f401c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 --2- 172.21.15.49:0/958133444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f401c06fb70 0x7f401c131600 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 >> 172.21.15.49:0/958133444 conn(0x7f401c0b2390 msgr2=0x7f401c0b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:03.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 shutdown_connections 2023-12-19T05:48:03.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.374+0000 7f401bfff640 1 -- 172.21.15.49:0/958133444 wait complete. 2023-12-19T05:48:03.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:48:03.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.619+0000 7fcfb94da640 1 Processor -- start 2023-12-19T05:48:03.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.619+0000 7fcfb94da640 1 -- start start 2023-12-19T05:48:03.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb94da640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcfb4159f80 0x7fcfb406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb94da640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb406b520 con 0x7fcfb415aa70 2023-12-19T05:48:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb94da640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40b2b20 con 0x7fcfb415b1e0 2023-12-19T05:48:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb94da640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40b2fb0 con 0x7fcfb4159f80 2023-12-19T05:48:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb8cd9640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcfb415aa70 0x7fcfb415b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52844/0 (socket says 172.21.15.49:52844) 2023-12-19T05:48:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.621+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/1745866669 learned_addr learned my addr 172.21.15.49:0/1745866669 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847750210 0 0) 0x7fcfb406b520 con 0x7fcfb415aa70 2023-12-19T05:48:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/1745866669 >> v2:172.21.15.115:3300/0 conn(0x7fcfb4159f80 0x7fcfb406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa0003520 con 0x7fcfb415aa70 2023-12-19T05:48:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 405739391 0 0) 0x7fcfa0003520 con 0x7fcfb415aa70 2023-12-19T05:48:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 >> v2:172.21.15.115:3300/0 conn(0x7fcfb4159f80 msgr2=0x7fcfb406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 --2- 172.21.15.49:0/1745866669 >> v2:172.21.15.115:3300/0 conn(0x7fcfb4159f80 0x7fcfb406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 >> v1:172.21.15.115:6789/0 conn(0x7fcfb415b1e0 legacy=0x7fcfb415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40b1f10 con 0x7fcfb415aa70 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fcfac0019f0 con 0x7fcfb415aa70 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 >> v1:172.21.15.49:6789/0 conn(0x7fcfb415aa70 legacy=0x7fcfb415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00039c0 0x7fcfa0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 0x7fcfa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00051d0 0x7fcfa000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b2fb0 con 0x7fcfa00047c0 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa000e320 con 0x7fcfa00039c0 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.622+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa000e4e0 con 0x7fcfa00051d0 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 0x7fcfa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00039c0 0x7fcfa0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfb8cd9640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00051d0 0x7fcfa000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 -- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00051d0 msgr2=0x7fcfa000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00051d0 0x7fcfa000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 -- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00039c0 msgr2=0x7fcfa0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00039c0 0x7fcfa0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfabfff640 1 -- 172.21.15.49:0/1745866669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0003520 con 0x7fcfa00047c0 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00039c0 0x7fcfa0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.623+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/1745866669 reap_dead start 2023-12-19T05:48:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.624+0000 7fcfabfff640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 0x7fcfa0004c40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c001750 tx=0x7fcfa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67c24fe86d45990 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.625+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0052d0 con 0x7fcfa00047c0 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.625+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c02e050 con 0x7fcfa00047c0 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.625+0000 7fcfb37fe640 1 -- 172.21.15.49:0/1745866669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c003830 con 0x7fcfa00047c0 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.625+0000 7fcfb94da640 1 -- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 msgr2=0x7fcfa0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.625+0000 7fcfb94da640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 0x7fcfa0004c40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c001750 tx=0x7fcfa00057f0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.626+0000 7fcfb94da640 1 -- 172.21.15.49:0/1745866669 shutdown_connections 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.626+0000 7fcfb94da640 1 --2- 172.21.15.49:0/1745866669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfa00047c0 0x7fcfa0004c40 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.626+0000 7fcfb94da640 1 -- 172.21.15.49:0/1745866669 >> 172.21.15.49:0/1745866669 conn(0x7fcfb40b0100 msgr2=0x7fcfb40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.626+0000 7fcfb94da640 1 -- 172.21.15.49:0/1745866669 shutdown_connections 2023-12-19T05:48:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.626+0000 7fcfb94da640 1 -- 172.21.15.49:0/1745866669 wait complete. 2023-12-19T05:48:03.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.627+0000 7fcfb94da640 1 Processor -- start 2023-12-19T05:48:03.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.628+0000 7fcfb94da640 1 -- start start 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00047c0 0x7fcfb414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 0x7fcfb4146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4151310 con 0x7fcfb4150950 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb414fb00 con 0x7fcfb414e710 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb94da640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb406da00 con 0x7fcfa00047c0 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50722/0 (socket says 172.21.15.49:50722) 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/2922381473 learned_addr learned my addr 172.21.15.49:0/2922381473 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00047c0 0x7fcfb414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfabfff640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 0x7fcfb4146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00047c0 msgr2=0x7fcfb414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00047c0 0x7fcfb414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 msgr2=0x7fcfb4146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.629+0000 7fcfb8cd9640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 0x7fcfb4146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb8cd9640 1 -- 172.21.15.49:0/2922381473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb414eef0 con 0x7fcfb4150950 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfabfff640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 0x7fcfb4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb8cd9640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4070c20 tx=0x7fcfac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00eb90 con 0x7fcfb4150950 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00ecf0 con 0x7fcfb4150950 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac013660 con 0x7fcfb4150950 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb414f1d0 con 0x7fcfb4150950 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.630+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb414f790 con 0x7fcfb4150950 2023-12-19T05:48:03.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.632+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb4061910 con 0x7fcfb4150950 2023-12-19T05:48:03.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.633+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfac0137c0 con 0x7fcfb4150950 2023-12-19T05:48:03.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.633+0000 7fcfb17fa640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 0x7fcf9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:03.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.634+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfac088d00 con 0x7fcfb4150950 2023-12-19T05:48:03.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.634+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 0x7fcf9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:03.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.635+0000 7fcfb3fff640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 0x7fcf9406c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4150690 tx=0x7fcfa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:03.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.638+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfac054250 con 0x7fcfb4150950 2023-12-19T05:48:03.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.871+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb4061910 con 0x7fcfb4150950 2023-12-19T05:48:03.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.872+0000 7fcfb17fa640 1 -- 172.21.15.49:0/2922381473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fcfac057870 con 0x7fcfb4150950 2023-12-19T05:48:03.874 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:03.874 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:48:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:48:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 msgr2=0x7fcf9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 0x7fcf9406c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4150690 tx=0x7fcfa4008040 comp rx=0 tx=0).stop 2023-12-19T05:48:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 msgr2=0x7fcfb4150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4070c20 tx=0x7fcfac00e530 comp rx=0 tx=0).stop 2023-12-19T05:48:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 shutdown_connections 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcf9406a430 0x7fcf9406c8f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfb4150950 0x7fcfb4150dd0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb414e710 0x7fcfb4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 --2- 172.21.15.49:0/2922381473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa00047c0 0x7fcfb414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 >> 172.21.15.49:0/2922381473 conn(0x7fcfb40b0100 msgr2=0x7fcfb40b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 shutdown_connections 2023-12-19T05:48:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:03.875+0000 7fcfb94da640 1 -- 172.21.15.49:0/2922381473 wait complete. 2023-12-19T05:48:04.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:47:57.189482+0000', 'modified': '2023-12-19T05:48:00.715073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8100}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8100': {'gid': 8100, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/508042264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 508042264}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 508042264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:48:04.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:48:04.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:48:04.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.551+0000 7f5774e8b640 1 Processor -- start 2023-12-19T05:48:04.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.552+0000 7f5774e8b640 1 -- start start 2023-12-19T05:48:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f5774e8b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f577015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f5774e8b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57700cc540 0x7f577006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f5774e8b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5770161510 con 0x7f577006f6a0 2023-12-19T05:48:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f5774e8b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577015ed70 con 0x7f57700cc540 2023-12-19T05:48:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f5774e8b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577015e4d0 con 0x7f577015b3c0 2023-12-19T05:48:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f576ed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f577006f6a0 0x7f577006c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44300/0 (socket says 172.21.15.49:44300) 2023-12-19T05:48:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f576ed9d640 1 -- 172.21.15.49:0/2064329365 learned_addr learned my addr 172.21.15.49:0/2064329365 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f576e59c640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f577015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f576dd9b640 1 --2- 172.21.15.49:0/2064329365 >> v2:172.21.15.115:3300/0 conn(0x7f57700cc540 0x7f577006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.554+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267238791 0 0) 0x7f5770161510 con 0x7f577006f6a0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003520 con 0x7f577006f6a0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2039888048 0 0) 0x7f575c003520 con 0x7f577006f6a0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 msgr2=0x7f577015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f577015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 >> v2:172.21.15.115:3300/0 conn(0x7f57700cc540 msgr2=0x7f577006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 --2- 172.21.15.49:0/2064329365 >> v2:172.21.15.115:3300/0 conn(0x7f57700cc540 0x7f577006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577015e7b0 con 0x7f577006f6a0 2023-12-19T05:48:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5768001670 con 0x7f577006f6a0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 >> v1:172.21.15.49:6789/0 conn(0x7f577006f6a0 legacy=0x7f577006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f575c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f575c003fb0 0x7f575c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c004d00 0x7f575c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577015ed70 con 0x7f575c004d00 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577015e4d0 con 0x7f575c003fb0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c00ba00 con 0x7f577015b3c0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.555+0000 7f576ed9d640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c004d00 0x7f575c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576e59c640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f575c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576dd9b640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f575c003fb0 0x7f575c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576ed9d640 1 -- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 msgr2=0x7f575c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576ed9d640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577015b3c0 0x7f575c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576ed9d640 1 -- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f575c003fb0 msgr2=0x7f575c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576ed9d640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f575c003fb0 0x7f575c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576ed9d640 1 -- 172.21.15.49:0/2064329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c003520 con 0x7f575c004d00 2023-12-19T05:48:04.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.556+0000 7f576dd9b640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f575c003fb0 0x7f575c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.557+0000 7f576ed9d640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c004d00 0x7f575c005180 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f57700b35c0 tx=0x7f575c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3ef2bb806adaa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.557+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768005ad0 con 0x7f575c004d00 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.557+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768005c30 con 0x7f575c004d00 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.557+0000 7f576d59a640 1 -- 172.21.15.49:0/2064329365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576802c790 con 0x7f575c004d00 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 -- 172.21.15.49:0/2064329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c004d00 msgr2=0x7f575c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 --2- 172.21.15.49:0/2064329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c004d00 0x7f575c005180 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f57700b35c0 tx=0x7f575c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f576ed9d640 1 -- 172.21.15.49:0/2064329365 reap_dead start 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 -- 172.21.15.49:0/2064329365 shutdown_connections 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 -- 172.21.15.49:0/2064329365 >> 172.21.15.49:0/2064329365 conn(0x7f57700d01a0 msgr2=0x7f57700d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 -- 172.21.15.49:0/2064329365 shutdown_connections 2023-12-19T05:48:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.558+0000 7f5774e8b640 1 -- 172.21.15.49:0/2064329365 wait complete. 2023-12-19T05:48:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.560+0000 7f5774e8b640 1 Processor -- start 2023-12-19T05:48:04.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.560+0000 7f5774e8b640 1 -- start start 2023-12-19T05:48:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577014c1f0 0x7f577015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700701f0 0x7f577015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770070a40 con 0x7f577014be10 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770070760 con 0x7f57700701f0 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f5774e8b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700ce070 con 0x7f577014c1f0 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49488/0 (socket says 172.21.15.49:49488) 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.561+0000 7f576e59c640 1 -- 172.21.15.49:0/910235468 learned_addr learned my addr 172.21.15.49:0/910235468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576dd9b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577014c1f0 0x7f577015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576ed9d640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700701f0 0x7f577015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 -- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577014c1f0 msgr2=0x7f577015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577014c1f0 0x7f577015f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 -- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700701f0 msgr2=0x7f577015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700701f0 0x7f577015fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 -- 172.21.15.49:0/910235468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700ce350 con 0x7f577014be10 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.562+0000 7f576e59c640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5760007f30 tx=0x7f5760011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.563+0000 7f5766ffd640 1 -- 172.21.15.49:0/910235468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000e030 con 0x7f577014be10 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.563+0000 7f5766ffd640 1 -- 172.21.15.49:0/910235468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760016470 con 0x7f577014be10 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.563+0000 7f5766ffd640 1 -- 172.21.15.49:0/910235468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760016820 con 0x7f577014be10 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.563+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700ce630 con 0x7f577014be10 2023-12-19T05:48:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.563+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770149470 con 0x7f577014be10 2023-12-19T05:48:04.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.566+0000 7f5766ffd640 1 -- 172.21.15.49:0/910235468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5760016980 con 0x7f577014be10 2023-12-19T05:48:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.567+0000 7f5766ffd640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 0x7f575006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.567+0000 7f5766ffd640 1 -- 172.21.15.49:0/910235468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f576000f070 con 0x7f577014be10 2023-12-19T05:48:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.567+0000 7f57779fb740 1 Processor -- start 2023-12-19T05:48:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.568+0000 7f57779fb740 1 -- start start 2023-12-19T05:48:04.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.568+0000 7f576dd9b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 0x7f575006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.568+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebfd30 0x5624bcec0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.568+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bce8fcb0 0x5624bcebcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f57779fb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f57779fb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcdfff80 con 0x5624bce938b0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcdfd710 con 0x5624bcebfd30 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bcdf9000 con 0x5624bce8fcb0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49494/0 (socket says 172.21.15.49:49494) 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 -- 172.21.15.49:0/308990863 learned_addr learned my addr 172.21.15.49:0/308990863 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576dd9b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 0x7f575006c920 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f577006cc50 tx=0x7f5758008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576e59c640 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebfd30 0x5624bcec0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 -- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bce8fcb0 msgr2=0x5624bcebcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bce8fcb0 0x5624bcebcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 -- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebfd30 msgr2=0x5624bcec0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebfd30 0x5624bcec0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.569+0000 7f576ed9d640 1 -- 172.21.15.49:0/308990863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bcdc0690 con 0x5624bce938b0 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.570+0000 7f576ed9d640 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f576802c330 tx=0x7f576802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c39967c00bf1b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.570+0000 7f574ffff640 1 -- 172.21.15.49:0/308990863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680015b0 con 0x5624bce938b0 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.570+0000 7f574ffff640 1 -- 172.21.15.49:0/308990863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768000e40 con 0x5624bce938b0 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.570+0000 7f574ffff640 1 -- 172.21.15.49:0/308990863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768004aa0 con 0x5624bce938b0 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 -- 172.21.15.49:0/308990863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 msgr2=0x5624bcebd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f576802c330 tx=0x7f576802e000 comp rx=0 tx=0).stop 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 -- 172.21.15.49:0/308990863 shutdown_connections 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bce8fcb0 0x5624bcebcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bcebd4e0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 --2- 172.21.15.49:0/308990863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebfd30 0x5624bcec0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 -- 172.21.15.49:0/308990863 >> 172.21.15.49:0/308990863 conn(0x5624bce91fc0 msgr2=0x5624bcedab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 -- 172.21.15.49:0/308990863 shutdown_connections 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.571+0000 7f57779fb740 1 -- 172.21.15.49:0/308990863 wait complete. 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.572+0000 7f57779fb740 1 -- start start 2023-12-19T05:48:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.572+0000 7f57779fb740 1 Processor -- start 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bcebdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bcebcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcd9a7d0 con 0x5624bce938b0 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcd9a470 con 0x5624bcebe4f0 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bcb60f20 con 0x5624bcebfd30 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f57779fb740 10 client.0 _ll_register_callbacks cb 0x5624bcde91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49500/0 (socket says 172.21.15.49:49500) 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.573+0000 7f576e59c640 1 -- 172.21.15.49:0/2273765227 learned_addr learned my addr 172.21.15.49:0/2273765227 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 -- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 msgr2=0x5624bcebdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bcebdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 -- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 msgr2=0x5624bcebcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bcebcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 -- 172.21.15.49:0/2273765227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c003520 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f576e59c640 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f5760087d30 tx=0x7f5760058c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894b94d95d06abbf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f574d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760070180 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5760058da0 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624bce23550 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5760058f60 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f57779fb740 10 client.8229 fetch_fsmap learned FSMap version 72 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5624bcdf7680 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.574+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624bce23550 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5760026020 con 0x5624bce938b0 2023-12-19T05:48:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 10 client.8229 fetch_fsmap finished waiting for FSMap version 72 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 10 client.8229 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 20 client.8229 populate_metadata read hostname 'smithi049' 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bcef3360 0x5624bcef7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 4 client.8229 mds_command: new command op to 8100 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 --> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624bcdebb50 con 0x5624bcef3360 2023-12-19T05:48:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.575+0000 7f576dd9b640 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bcef3360 0x5624bcef7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.576+0000 7f574d7fa640 10 client.8229 ms_handle_connect on v2:172.21.15.49:6832/508042264 2023-12-19T05:48:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.576+0000 7f576dd9b640 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bcef3360 0x5624bcef7420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fbc1d0faf64c57 server_cookie=326a1f9460d6d570 in_seq=0 out_seq=0 2023-12-19T05:48:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.576+0000 7f574d7fa640 1 -- 172.21.15.49:0/2273765227 <== mds.0 v2:172.21.15.49:6832/508042264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5624bcdebb50 con 0x5624bcef3360 2023-12-19T05:48:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.576+0000 7f574d7fa640 10 client.8229 handle_command_reply: tid=0 2023-12-19T05:48:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.576+0000 7f57779fb740 1 client.8229 shutdown 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 msgr2=0x5624bceb8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f5760087d30 tx=0x7f5760058c00 comp rx=0 tx=0).stop 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 shutdown_connections 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bcef3360 0x5624bcef7420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bcebdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bcebcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 --2- 172.21.15.49:0/2273765227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bceb8680 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 >> 172.21.15.49:0/2273765227 conn(0x5624bce8fcb0 msgr2=0x5624bce93e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f574d7fa640 0 client.8229 ms_handle_reset on v2:172.21.15.49:6832/508042264 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 shutdown_connections 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 1 -- 172.21.15.49:0/2273765227 wait complete. 2023-12-19T05:48:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.577+0000 7f57779fb740 20 client.8229 trim_cache size 0 max 16384 2023-12-19T05:48:04.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.594+0000 7f57779fb740 1 Processor -- start 2023-12-19T05:48:04.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.594+0000 7f57779fb740 1 -- start start 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bced92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bced9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bce8ab70 con 0x5624bce938b0 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcebdff0 con 0x5624bcebe4f0 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bcebc330 con 0x5624bcebfd30 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49502/0 (socket says 172.21.15.49:49502) 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 -- 172.21.15.49:0/3503704012 learned_addr learned my addr 172.21.15.49:0/3503704012 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 -- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 msgr2=0x5624bced9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bced9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 -- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 msgr2=0x5624bced92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bced92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.595+0000 7f576e59c640 1 -- 172.21.15.49:0/3503704012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bcd999e0 con 0x5624bce938b0 2023-12-19T05:48:04.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f576e59c640 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f5760055040 tx=0x7f576005a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61eec3657d2a132 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f5764ff9640 1 -- 172.21.15.49:0/3503704012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760070180 con 0x5624bce938b0 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f5764ff9640 1 -- 172.21.15.49:0/3503704012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760058da0 con 0x5624bce938b0 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f5764ff9640 1 -- 172.21.15.49:0/3503704012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760060730 con 0x5624bce938b0 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 -- 172.21.15.49:0/3503704012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 msgr2=0x5624bce8f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f5760055040 tx=0x7f576005a000 comp rx=0 tx=0).stop 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 -- 172.21.15.49:0/3503704012 shutdown_connections 2023-12-19T05:48:04.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bced9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bcebe4f0 0x5624bced92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 --2- 172.21.15.49:0/3503704012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bce938b0 0x5624bce8f020 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.596+0000 7f57779fb740 1 -- 172.21.15.49:0/3503704012 >> 172.21.15.49:0/3503704012 conn(0x5624bce8fcb0 msgr2=0x5624bce95e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.597+0000 7f57779fb740 1 -- 172.21.15.49:0/3503704012 shutdown_connections 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.597+0000 7f57779fb740 1 -- 172.21.15.49:0/3503704012 wait complete. 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.597+0000 7f57779fb740 1 -- start start 2023-12-19T05:48:04.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.597+0000 7f57779fb740 1 Processor -- start 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bce938b0 0x5624bcebeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bceeb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcedcff0 con 0x5624bcebe4f0 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bcedd160 con 0x5624bce938b0 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624bcef22d0 con 0x5624bcebfd30 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.598+0000 7f57779fb740 10 client.0 _ll_register_callbacks cb 0x7f575c0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49506/0 (socket says 172.21.15.49:49506) 2023-12-19T05:48:04.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 -- 172.21.15.49:0/3428403106 learned_addr learned my addr 172.21.15.49:0/3428403106 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 -- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 msgr2=0x5624bceeb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bceeb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 -- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bce938b0 msgr2=0x5624bcebeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bce938b0 0x5624bcebeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 -- 172.21.15.49:0/3428403106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624bcdf7680 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f576dd9b640 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x5624bcedb6b0 tx=0x7f5758026cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659f86cb8218c9cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.599+0000 7f574d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580262e0 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5758015840 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5768000e40 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5758026440 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 10 client.8235 fetch_fsmap learned FSMap version 72 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5624bcdbeef0 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768000e40 con 0x5624bcebe4f0 2023-12-19T05:48:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5758015a00 con 0x5624bcebe4f0 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 10 client.8235 fetch_fsmap finished waiting for FSMap version 72 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 10 client.8235 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 20 client.8235 populate_metadata read hostname 'smithi049' 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bceeb7e0 0x5624bceebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 4 client.8235 mds_command: new command op to 8100 tid=0[{"prefix": "status"}] 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.600+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 --> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5624bcdf2080 con 0x5624bceeb7e0 2023-12-19T05:48:04.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.601+0000 7f576e59c640 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bceeb7e0 0x5624bceebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.601+0000 7f576e59c640 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bceeb7e0 0x5624bceebbe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e8c6dc0b0dccae server_cookie=1323a73646df8e8a in_seq=0 out_seq=0 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.601+0000 7f574d7fa640 10 client.8235 ms_handle_connect on v2:172.21.15.49:6832/508042264 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f574d7fa640 1 -- 172.21.15.49:0/3428403106 <== mds.0 v2:172.21.15.49:6832/508042264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5624bcdf2080 con 0x5624bceeb7e0 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f574d7fa640 10 client.8235 handle_command_reply: tid=0 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 client.8235 shutdown 2023-12-19T05:48:04.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 msgr2=0x5624bcebf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x5624bcedb6b0 tx=0x7f5758026cf0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 shutdown_connections 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:6832/508042264,v1:172.21.15.49:6834/508042264] conn(0x5624bceeb7e0 0x5624bceebbe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5624bcebfd30 0x5624bceeb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624bcebe4f0 0x5624bcebf040 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 --2- 172.21.15.49:0/3428403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5624bce938b0 0x5624bcebeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f574d7fa640 0 client.8235 ms_handle_reset on v2:172.21.15.49:6832/508042264 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 >> 172.21.15.49:0/3428403106 conn(0x5624bce8fcb0 msgr2=0x5624bce90090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 shutdown_connections 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 1 -- 172.21.15.49:0/3428403106 wait complete. 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.602+0000 7f57779fb740 20 client.8235 trim_cache size 0 max 16384 2023-12-19T05:48:04.606 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8100, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.4076391859999999, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 72, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 161, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 161, 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.220280086000001 2023-12-19T05:48:04.607 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 msgr2=0x7f575006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 0x7f575006c920 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f577006cc50 tx=0x7f5758008040 comp rx=0 tx=0).stop 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 msgr2=0x7f57700cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5760007f30 tx=0x7f5760011660 comp rx=0 tx=0).stop 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 shutdown_connections 2023-12-19T05:48:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f575006a460 0x7f575006c920 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f577014c1f0 0x7f577015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700701f0 0x7f577015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 --2- 172.21.15.49:0/910235468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f577014be10 0x7f57700cd690 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 >> 172.21.15.49:0/910235468 conn(0x7f57700d01a0 msgr2=0x7f5770156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 shutdown_connections 2023-12-19T05:48:04.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.603+0000 7f5774e8b640 1 -- 172.21.15.49:0/910235468 wait complete. 2023-12-19T05:48:04.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:48:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.849+0000 7fed92bc4640 1 Processor -- start 2023-12-19T05:48:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.850+0000 7fed92bc4640 1 -- start start 2023-12-19T05:48:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.851+0000 7fed92bc4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed8c0b8070 0x7fed8c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.851+0000 7fed92bc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.851+0000 7fed92bc4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0d12d0 con 0x7fed8c146e30 2023-12-19T05:48:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.851+0000 7fed92bc4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c147210 con 0x7fed8c0b8070 2023-12-19T05:48:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.851+0000 7fed92bc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0d2370 con 0x7fed8c0d0a90 2023-12-19T05:48:04.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.852+0000 7fed913c1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed8c0b8070 0x7fed8c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.852+0000 7fed923c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.852+0000 7fed91bc2640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fed8c146e30 0x7fed8c0b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:41104/0 (socket says 172.21.15.49:41104) 2023-12-19T05:48:04.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.852+0000 7fed91bc2640 1 -- 172.21.15.49:0/4019811319 learned_addr learned my addr 172.21.15.49:0/4019811319 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.853+0000 7fed913c1640 1 -- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 msgr2=0x7fed8c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.853+0000 7fed913c1640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.853+0000 7fed913c1640 1 -- 172.21.15.49:0/4019811319 >> v1:172.21.15.115:6789/0 conn(0x7fed8c146e30 legacy=0x7fed8c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.853+0000 7fed913c1640 1 -- 172.21.15.49:0/4019811319 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0d15b0 con 0x7fed8c0b8070 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.853+0000 7fed923c3640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:48:04.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.854+0000 7fed913c1640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c0b8070 0x7fed8c0d0550 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed800097a0 tx=0x7fed8002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e260dd3c8139a355 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.854+0000 7fed90bc0640 1 -- 172.21.15.49:0/4019811319 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80031780 con 0x7fed8c0b8070 2023-12-19T05:48:04.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.854+0000 7fed90bc0640 1 -- 172.21.15.49:0/4019811319 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800318e0 con 0x7fed8c0b8070 2023-12-19T05:48:04.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed90bc0640 1 -- 172.21.15.49:0/4019811319 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80031c70 con 0x7fed8c0b8070 2023-12-19T05:48:04.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 -- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c0b8070 msgr2=0x7fed8c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c0b8070 0x7fed8c0d0550 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed800097a0 tx=0x7fed8002b820 comp rx=0 tx=0).stop 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 -- 172.21.15.49:0/4019811319 shutdown_connections 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 --2- 172.21.15.49:0/4019811319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c0b8070 0x7fed8c0d0550 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 -- 172.21.15.49:0/4019811319 >> 172.21.15.49:0/4019811319 conn(0x7fed8c0b2990 msgr2=0x7fed8c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 -- 172.21.15.49:0/4019811319 shutdown_connections 2023-12-19T05:48:04.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.855+0000 7fed92bc4640 1 -- 172.21.15.49:0/4019811319 wait complete. 2023-12-19T05:48:04.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.857+0000 7fed92bc4640 1 Processor -- start 2023-12-19T05:48:04.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.857+0000 7fed92bc4640 1 -- start start 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c13f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 0x7fed8c1e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1decf0 con 0x7fed8c0b8070 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c13e0c0 con 0x7fed8c146e30 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.858+0000 7fed92bc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c13e3a0 con 0x7fed8c0d0a90 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49512/0 (socket says 172.21.15.49:49512) 2023-12-19T05:48:04.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 -- 172.21.15.49:0/1646156466 learned_addr learned my addr 172.21.15.49:0/1646156466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed913c1640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c13f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed923c3640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 0x7fed8c1e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 -- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 msgr2=0x7fed8c13f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c13f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 -- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 msgr2=0x7fed8c1e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 0x7fed8c1e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed91bc2640 1 -- 172.21.15.49:0/1646156466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84009a70 con 0x7fed8c0b8070 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.859+0000 7fed923c3640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 0x7fed8c1e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:04.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed91bc2640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c480 tx=0x7fed8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88005ce0 con 0x7fed8c0b8070 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88005e40 con 0x7fed8c0b8070 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880072f0 con 0x7fed8c0b8070 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed80009400 con 0x7fed8c0b8070 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.860+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c1e2860 con 0x7fed8c0b8070 2023-12-19T05:48:04.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.861+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c0d1b50 con 0x7fed8c0b8070 2023-12-19T05:48:04.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.862+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fed88007510 con 0x7fed8c0b8070 2023-12-19T05:48:04.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.863+0000 7fed7e7fc640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 0x7fed7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:04.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.863+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed88087e30 con 0x7fed8c0b8070 2023-12-19T05:48:04.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.864+0000 7fed913c1640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 0x7fed7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:04.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.865+0000 7fed913c1640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 0x7fed7006c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fed80036000 tx=0x7fed8003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:04.868+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fed8c0d1b50 con 0x7fed8c0b8070 2023-12-19T05:48:05.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.113+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fed8c0d1b50 con 0x7fed8c0b8070 2023-12-19T05:48:05.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.113+0000 7fed7e7fc640 1 -- 172.21.15.49:0/1646156466 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7fed8c0d1b50 con 0x7fed8c0b8070 2023-12-19T05:48:05.115 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:48:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 msgr2=0x7fed7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 0x7fed7006c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fed80036000 tx=0x7fed8003d040 comp rx=0 tx=0).stop 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 msgr2=0x7fed8c1de7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c480 tx=0x7fed8800c940 comp rx=0 tx=0).stop 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 shutdown_connections 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fed7006a430 0x7fed7006c8f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed8c0d0a90 0x7fed8c13f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed8c146e30 0x7fed8c1e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 --2- 172.21.15.49:0/1646156466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0b8070 0x7fed8c1de7b0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 >> 172.21.15.49:0/1646156466 conn(0x7fed8c0b2990 msgr2=0x7fed8c1e7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 shutdown_connections 2023-12-19T05:48:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:05.116+0000 7fed92bc4640 1 -- 172.21.15.49:0/1646156466 wait complete. 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:48:05.139 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:48:05.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.140 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:48:05.199 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:48:05.200 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41807sec preferred_lft 41807sec 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:48:05.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:48:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:05.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.203 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:48:05.304 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:48:05.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.309 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:48:05.366 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:48:05.366 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:48:05.367 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:48:05.367 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:48:05.367 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:48:05.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:48:05.367 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:48:05.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.583 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:48:05.641 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:48:05.641 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:48:05.642 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:48:05.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:48:05.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:48:05.754 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:48:05.814 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:48:05.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:48:05.815 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:48:05.870 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:48:05.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:05.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:06.027 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:06.027 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:48:06.060 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:06.061 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:48:06.061 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:48:06.061 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:48:06.061 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:48:06.063 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:48:06.063 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:48:06.064 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:48:06.064 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:48:06.064 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:48:06.068 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:48:06.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:06.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:48:06.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:06.168 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:48:06.242 INFO:teuthology.orchestra.run.smithi049.stdout:client8241 2023-12-19T05:48:06.242 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:48:06.242 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:48:06.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:48:06.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.518+0000 7f4064dcf640 1 Processor -- start 2023-12-19T05:48:06.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.518+0000 7f4064dcf640 1 -- start start 2023-12-19T05:48:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.519+0000 7f4064dcf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40600b2030 0x7f406015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.519+0000 7f4064dcf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40600ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.519+0000 7f4064dcf640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406015ec30 con 0x7f406015e5a0 2023-12-19T05:48:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.519+0000 7f4064dcf640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600ce5a0 con 0x7f40600b2030 2023-12-19T05:48:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.519+0000 7f4064dcf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406015fbc0 con 0x7f40600cdbf0 2023-12-19T05:48:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.520+0000 7f405effd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40600b2030 0x7f406015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.520+0000 7f405effd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40600b2030 0x7f406015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49514/0 (socket says 172.21.15.49:49514) 2023-12-19T05:48:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.520+0000 7f405effd640 1 -- 172.21.15.49:0/1847347316 learned_addr learned my addr 172.21.15.49:0/1847347316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.520+0000 7f405ffff640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40600ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.521+0000 7f405effd640 1 -- 172.21.15.49:0/1847347316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 msgr2=0x7f40600ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.521+0000 7f405effd640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40600ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.521+0000 7f405effd640 1 -- 172.21.15.49:0/1847347316 >> v1:172.21.15.115:6789/0 conn(0x7f406015e5a0 legacy=0x7f40600b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.521+0000 7f405effd640 1 -- 172.21.15.49:0/1847347316 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406015e980 con 0x7f40600b2030 2023-12-19T05:48:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.522+0000 7f405effd640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40600b2030 0x7f406015f680 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f40540098a0 tx=0x7f405402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3c3d11c8aaee4d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.522+0000 7f405e7fc640 1 -- 172.21.15.49:0/1847347316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054030840 con 0x7f40600b2030 2023-12-19T05:48:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.522+0000 7f405e7fc640 1 -- 172.21.15.49:0/1847347316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40540309a0 con 0x7f40600b2030 2023-12-19T05:48:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.522+0000 7f405e7fc640 1 -- 172.21.15.49:0/1847347316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054030d30 con 0x7f40600b2030 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 -- 172.21.15.49:0/1847347316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40600b2030 msgr2=0x7f406015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40600b2030 0x7f406015f680 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f40540098a0 tx=0x7f405402b980 comp rx=0 tx=0).stop 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 -- 172.21.15.49:0/1847347316 shutdown_connections 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40600ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 --2- 172.21.15.49:0/1847347316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40600b2030 0x7f406015f680 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 -- 172.21.15.49:0/1847347316 >> 172.21.15.49:0/1847347316 conn(0x7f40600b0100 msgr2=0x7f40600b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 -- 172.21.15.49:0/1847347316 shutdown_connections 2023-12-19T05:48:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.523+0000 7f4064dcf640 1 -- 172.21.15.49:0/1847347316 wait complete. 2023-12-19T05:48:06.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.525+0000 7f4064dcf640 1 Processor -- start 2023-12-19T05:48:06.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.525+0000 7f4064dcf640 1 -- start start 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 0x7f4060149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40601f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406014a510 con 0x7f406015e5a0 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060147aa0 con 0x7f40600b2030 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.526+0000 7f4064dcf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4060147d80 con 0x7f40600cdbf0 2023-12-19T05:48:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49520/0 (socket says 172.21.15.49:49520) 2023-12-19T05:48:06.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 -- 172.21.15.49:0/2484004095 learned_addr learned my addr 172.21.15.49:0/2484004095 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:06.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405f7fe640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 0x7f4060149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405effd640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40601f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 -- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 msgr2=0x7f40601f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40601f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 -- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 msgr2=0x7f4060149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 0x7f4060149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405ffff640 1 -- 172.21.15.49:0/2484004095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540094d0 con 0x7f406015e5a0 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.527+0000 7f405f7fe640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 0x7f4060149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f405ffff640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f4058007e60 tx=0x7f405800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058014420 con 0x7f406015e5a0 2023-12-19T05:48:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580145a0 con 0x7f406015e5a0 2023-12-19T05:48:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4060148060 con 0x7f406015e5a0 2023-12-19T05:48:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058014950 con 0x7f406015e5a0 2023-12-19T05:48:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.528+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060148620 con 0x7f406015e5a0 2023-12-19T05:48:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.529+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060148810 con 0x7f406015e5a0 2023-12-19T05:48:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.530+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4058014ab0 con 0x7f406015e5a0 2023-12-19T05:48:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.531+0000 7f4047fff640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 0x7f404c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.532+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40580892c0 con 0x7f406015e5a0 2023-12-19T05:48:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.532+0000 7f405f7fe640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 0x7f404c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.533+0000 7f405f7fe640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 0x7f404c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4050007fd0 tx=0x7f4050009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.536+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4058054810 con 0x7f406015e5a0 2023-12-19T05:48:06.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.769+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4060061910 con 0x7f406015e5a0 2023-12-19T05:48:06.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.770+0000 7f4047fff640 1 -- 172.21.15.49:0/2484004095 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4058057e30 con 0x7f406015e5a0 2023-12-19T05:48:06.772 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 msgr2=0x7f404c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 0x7f404c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4050007fd0 tx=0x7f4050009040 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 msgr2=0x7f4060148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f4058007e60 tx=0x7f405800e4b0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 shutdown_connections 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f404c06a430 0x7f404c06c8f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40600cdbf0 0x7f40601f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406015e5a0 0x7f4060148b40 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 --2- 172.21.15.49:0/2484004095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600b2030 0x7f4060149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:06.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 >> 172.21.15.49:0/2484004095 conn(0x7f40600b0100 msgr2=0x7f406006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:06.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 shutdown_connections 2023-12-19T05:48:06.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:06.773+0000 7f4064dcf640 1 -- 172.21.15.49:0/2484004095 wait complete. 2023-12-19T05:48:06.794 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:48:06.795 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:48:06.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:06.795 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:48:06.855 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:48:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41823sec preferred_lft 41823sec 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.857 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:48:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:48:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:48:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:48:06.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:06.859 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:48:06.953 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:48:06.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:06.957 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:48:07.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:48:07.011 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:48:07.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:48:07.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:48:07.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:48:07.011 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:48:07.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.192 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:48:07.239 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:48:07.239 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:48:07.240 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:48:07.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:48:07.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:48:07.327 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:48:07.377 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:48:07.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:48:07.378 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:48:07.423 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:48:07.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:07.608 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:07.608 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:48:07.641 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:48:07.642 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:48:07.642 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:48:07.642 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:48:07.642 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:48:07.644 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:48:07.644 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:48:07.644 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:48:07.644 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:48:07.644 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:48:07.650 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:48:07.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:48:07.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:48:07.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:48:07.787 INFO:teuthology.orchestra.run.smithi115.stdout:client6796 2023-12-19T05:48:07.788 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:48:07.788 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:48:07.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:48:08.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.078+0000 7f8c57fff640 1 Processor -- start 2023-12-19T05:48:08.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.078+0000 7f8c57fff640 1 -- start start 2023-12-19T05:48:08.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.080+0000 7f8c57fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c58159f80 0x7f8c5806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.080+0000 7f8c57fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 0x7f8c5815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.080+0000 7f8c57fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5806b520 con 0x7f8c5815a8a0 2023-12-19T05:48:08.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.080+0000 7f8c57fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580b2b20 con 0x7f8c58159f80 2023-12-19T05:48:08.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.080+0000 7f8c57fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b2fb0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.081+0000 7f8c56ffd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c58159f80 0x7f8c5806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.081+0000 7f8c4ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 0x7f8c5815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.081+0000 7f8c577fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8c5815a8a0 0x7f8c5815dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:41120/0 (socket says 172.21.15.49:41120) 2023-12-19T05:48:08.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.081+0000 7f8c577fe640 1 -- 172.21.15.49:0/4242902596 learned_addr learned my addr 172.21.15.49:0/4242902596 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:48:08.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.081+0000 7f8c56ffd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c58159f80 0x7f8c5806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59064/0 (socket says 172.21.15.49:59064) 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.082+0000 7f8c56ffd640 1 -- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 msgr2=0x7f8c5815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.082+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 0x7f8c5815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.082+0000 7f8c56ffd640 1 -- 172.21.15.49:0/4242902596 >> v1:172.21.15.115:6789/0 conn(0x7f8c5815a8a0 legacy=0x7f8c5815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.083+0000 7f8c56ffd640 1 -- 172.21.15.49:0/4242902596 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580b1f10 con 0x7f8c58159f80 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.083+0000 7f8c567fc640 1 -- 172.21.15.49:0/4242902596 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009663245 0 0) 0x7f8c5806b520 con 0x7f8c5815a8a0 2023-12-19T05:48:08.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.083+0000 7f8c4ffff640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 0x7f8c5815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:48:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.084+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c58159f80 0x7f8c5806f160 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097a0 tx=0x7f8c4802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374a2b0a6f778c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.085+0000 7f8c567fc640 1 -- 172.21.15.49:0/4242902596 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48030800 con 0x7f8c58159f80 2023-12-19T05:48:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.085+0000 7f8c567fc640 1 -- 172.21.15.49:0/4242902596 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48030960 con 0x7f8c58159f80 2023-12-19T05:48:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.085+0000 7f8c567fc640 1 -- 172.21.15.49:0/4242902596 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48030cf0 con 0x7f8c58159f80 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.085+0000 7f8c57fff640 1 -- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c58159f80 msgr2=0x7f8c5806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.085+0000 7f8c57fff640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c58159f80 0x7f8c5806f160 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097a0 tx=0x7f8c4802b940 comp rx=0 tx=0).stop 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 -- 172.21.15.49:0/4242902596 shutdown_connections 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c5815b1e0 0x7f8c5815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 --2- 172.21.15.49:0/4242902596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c58159f80 0x7f8c5806f160 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 -- 172.21.15.49:0/4242902596 >> 172.21.15.49:0/4242902596 conn(0x7f8c580b0100 msgr2=0x7f8c580b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 -- 172.21.15.49:0/4242902596 shutdown_connections 2023-12-19T05:48:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.086+0000 7f8c57fff640 1 -- 172.21.15.49:0/4242902596 wait complete. 2023-12-19T05:48:08.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.088+0000 7f8c57fff640 1 Processor -- start 2023-12-19T05:48:08.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.088+0000 7f8c57fff640 1 -- start start 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.089+0000 7f8c57fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 0x7f8c5806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.089+0000 7f8c57fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 0x7f8c5814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c57fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c57fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c58159120 con 0x7f8c5815b1e0 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c57fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5806c400 con 0x7f8c5815a8a0 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c57fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5806d190 con 0x7f8c58159f80 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49534/0 (socket says 172.21.15.49:49534) 2023-12-19T05:48:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 -- 172.21.15.49:0/2298455218 learned_addr learned my addr 172.21.15.49:0/2298455218 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c4ffff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 0x7f8c5814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 0x7f8c5806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 -- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 msgr2=0x7f8c5806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 0x7f8c5806bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 -- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 msgr2=0x7f8c5814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 0x7f8c5814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.090+0000 7f8c577fe640 1 -- 172.21.15.49:0/2298455218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009400 con 0x7f8c5815b1e0 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c4ffff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 0x7f8c5814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 0x7f8c5806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:48:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c577fe640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c7e0 tx=0x7f8c5000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000a640 con 0x7f8c5815b1e0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c48009400 con 0x7f8c5815b1e0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5000a7c0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000ab70 con 0x7f8c5815b1e0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.091+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5806d750 con 0x7f8c5815b1e0 2023-12-19T05:48:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.093+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5814e7f0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.094+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8c5000acd0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.095+0000 7f8c4f7fe640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 0x7f8c3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.095+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c50087f00 con 0x7f8c5815b1e0 2023-12-19T05:48:08.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.095+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 0x7f8c3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.097+0000 7f8c56ffd640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 0x7f8c3806c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8c48036000 tx=0x7f8c4803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.099+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8c5814e7f0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.332+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5814e7f0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.333+0000 7f8c4f7fe640 1 -- 172.21.15.49:0/2298455218 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f8c5814e7f0 con 0x7f8c5815b1e0 2023-12-19T05:48:08.335 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:48:08.335 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:48:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:48:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 msgr2=0x7f8c3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 0x7f8c3806c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8c48036000 tx=0x7f8c4803b040 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 msgr2=0x7f8c5815c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c7e0 tx=0x7f8c5000cca0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 shutdown_connections 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8c3806a430 0x7f8c3806c8f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c5815b1e0 0x7f8c5815c7a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c5815a8a0 0x7f8c5814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 --2- 172.21.15.49:0/2298455218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c58159f80 0x7f8c5806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 >> 172.21.15.49:0/2298455218 conn(0x7f8c580b0100 msgr2=0x7f8c58154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 shutdown_connections 2023-12-19T05:48:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.336+0000 7f8c57fff640 1 -- 172.21.15.49:0/2298455218 wait complete. 2023-12-19T05:48:08.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:48:08.607 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":8100,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.394498835,"mdsmap_epoch":72,"osdmap_epoch":161,"osdmap_epoch_barrier":161,"uptime":17.207151426999999} 2023-12-19T05:48:08.607 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 8100, "mdsmap_epoch": 72, "osdmap_epoch": 161, "osdmap_epoch_barrier": 161, "rank_uptime": 11.394498835, "state": "up:active", "uptime": 17.207151427, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:48:08.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T05:48:08.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.850+0000 7f7ec3963640 1 Processor -- start 2023-12-19T05:48:08.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.850+0000 7f7ec3963640 1 -- start start 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec3963640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7ebc15a000 0x7f7ebc15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec3963640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ebc0b1f90 0x7f7ebc06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec3963640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc15ec00 con 0x7f7ebc0cbca0 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec3963640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc071c60 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec3963640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc070bc0 con 0x7f7ebc15a000 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec1f00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ebc0b1f90 0x7f7ebc06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.852+0000 7f7ec1f00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ebc0b1f90 0x7f7ebc06c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49544/0 (socket says 172.21.15.49:49544) 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec1f00640 1 -- 172.21.15.49:0/3534080411 learned_addr learned my addr 172.21.15.49:0/3534080411 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:08.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec16ff640 1 --2- 172.21.15.49:0/3534080411 >> v2:172.21.15.115:3300/0 conn(0x7f7ebc15a000 0x7f7ebc15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec1f00640 1 -- 172.21.15.49:0/3534080411 >> v2:172.21.15.115:3300/0 conn(0x7f7ebc15a000 msgr2=0x7f7ebc15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec1f00640 1 --2- 172.21.15.49:0/3534080411 >> v2:172.21.15.115:3300/0 conn(0x7f7ebc15a000 0x7f7ebc15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec1f00640 1 -- 172.21.15.49:0/3534080411 >> v1:172.21.15.115:6789/0 conn(0x7f7ebc0cbca0 legacy=0x7f7ebc0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:48:08.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.853+0000 7f7ec1f00640 1 -- 172.21.15.49:0/3534080411 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc070ea0 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.854+0000 7f7ec1f00640 1 --2- 172.21.15.49:0/3534080411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc06c810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc06f7a0 tx=0x7f7eb402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a544b610ef0a0aa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.854+0000 7f7eb3fff640 1 -- 172.21.15.49:0/3534080411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb402ec90 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7eb3fff640 1 -- 172.21.15.49:0/3534080411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb402edf0 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7eb3fff640 1 -- 172.21.15.49:0/3534080411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4036610 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 -- 172.21.15.49:0/3534080411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 msgr2=0x7f7ebc06c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 --2- 172.21.15.49:0/3534080411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc06c810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc06f7a0 tx=0x7f7eb402e0f0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 -- 172.21.15.49:0/3534080411 shutdown_connections 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 --2- 172.21.15.49:0/3534080411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc06c810 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 --2- 172.21.15.49:0/3534080411 >> v2:172.21.15.115:3300/0 conn(0x7f7ebc15a000 0x7f7ebc15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 -- 172.21.15.49:0/3534080411 >> 172.21.15.49:0/3534080411 conn(0x7f7ebc0cf230 msgr2=0x7f7ebc0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.855+0000 7f7ec3963640 1 -- 172.21.15.49:0/3534080411 shutdown_connections 2023-12-19T05:48:08.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.856+0000 7f7ec3963640 1 -- 172.21.15.49:0/3534080411 wait complete. 2023-12-19T05:48:08.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.857+0000 7f7ec3963640 1 Processor -- start 2023-12-19T05:48:08.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.858+0000 7f7ec3963640 1 -- start start 2023-12-19T05:48:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ebc0cbca0 0x7f7ebc1458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ebc15a000 0x7f7ebc1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc155160 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc1f6ff0 con 0x7f7ebc0cbca0 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec3963640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc13e160 con 0x7f7ebc15a000 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49560/0 (socket says 172.21.15.49:49560) 2023-12-19T05:48:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 -- 172.21.15.49:0/2326108165 learned_addr learned my addr 172.21.15.49:0/2326108165 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 -- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ebc15a000 msgr2=0x7f7ebc1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ebc15a000 0x7f7ebc1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 -- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ebc0cbca0 msgr2=0x7f7ebc1458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ebc0cbca0 0x7f7ebc1458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.859+0000 7f7ec16ff640 1 -- 172.21.15.49:0/2326108165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009b30 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7ec16ff640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800d620 tx=0x7f7eb800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800b620 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb800b780 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc1482c0 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800bb30 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.860+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc148880 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.861+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc061910 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.862+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7eb800bc90 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.864+0000 7f7eb1ffb640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:48:08.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.864+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7eb8088e10 con 0x7f7ebc0b1f90 2023-12-19T05:48:08.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.865+0000 7f7ec0efe640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:48:08.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.866+0000 7f7ec0efe640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc156d10 tx=0x7f7eac0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:48:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:08.868+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7eb808c030 con 0x7f7ebc0b1f90 2023-12-19T05:48:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.064+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f7ebc1552a0 con 0x7f7ebc0b1f90 2023-12-19T05:48:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.792+0000 7f7eb1ffb640 1 -- 172.21.15.49:0/2326108165 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v162) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7ebc1552a0 con 0x7f7ebc0b1f90 2023-12-19T05:48:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.795+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 msgr2=0x7f7ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.795+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc156d10 tx=0x7f7eac0079b0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.795+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 msgr2=0x7f7ebc13dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.795+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800d620 tx=0x7f7eb800dae0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 shutdown_connections 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ebc15a000 0x7f7ebc1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ebc0cbca0 0x7f7ebc1458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 --2- 172.21.15.49:0/2326108165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0b1f90 0x7f7ebc13dc20 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 >> 172.21.15.49:0/2326108165 conn(0x7f7ebc0cf230 msgr2=0x7f7ebc0af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 shutdown_connections 2023-12-19T05:48:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:48:09.796+0000 7f7ec3963640 1 -- 172.21.15.49:0/2326108165 wait complete. 2023-12-19T05:48:09.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:48:10.072 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:48:10.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:48:10.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T05:48:10.310 INFO:teuthology.orchestra.run.smithi049.stdout:{"mon_tick_interval":"5"} 2023-12-19T05:48:10.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T05:48:10.311 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> import time 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> import datetime 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> # Write some buffered data through before going full, all should be well 2023-12-19T05:48:10.311 DEBUG:teuthology.orchestra.run.smithi049:> print("writing some data through which we expect to succeed") 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> bytes = 0 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> # from write 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> full = False 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(32 * 0.9)): 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> print("done writing {0} bytes".format(bytes)) 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.312 DEBUG:teuthology.orchestra.run.smithi049:> # OK, now we should sneak in under the full condition 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> # due to the time it takes the OSDs to report to the 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> # mons, and get a successful fsync on our full-making data 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> # buffered write, add more dirty data to the buffer 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> print("starting buffered write") 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(32 * 0.2)): 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(15.0) 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> except OSError: 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> pass; 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-19T05:48:10.313 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> # Wait long enough for a background flush that should fail 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(30) 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> # ...and check that the failed background flush is reflected in fclose 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> except OSError: 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> print("close() returned an error as expected") 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("close() failed to raise error") 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> # The kernel cephfs client does not raise errors on fclose 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T05:48:10.314 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:48:28.121 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:28.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:58.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:58.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:49:28.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:49:28.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:49:58.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:49:58.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:11.674 INFO:teuthology.orchestra.run.smithi049.stdout:writing some data through which we expect to succeed 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-19T05:50:11.675 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-19T05:50:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:done writing 29884416 bytes 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:successfully fsync'ed prior to getting full state reported 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:starting buffered write 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:50:11.677 INFO:teuthology.orchestra.run.smithi049.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-19T05:50:11.856 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:50:11.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:50:11.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:50:12.127 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:50:12.128 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:12.128 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:12.195 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:12.195 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:12.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:12.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.494+0000 7f9a2a3f0640 1 Processor -- start 2023-12-19T05:50:12.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.494+0000 7f9a2a3f0640 1 -- start start 2023-12-19T05:50:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2a3f0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 0x7f9a240cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2a3f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 0x7f9a24070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2a3f0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a241620b0 con 0x7f9a240cf7c0 2023-12-19T05:50:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2a3f0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240cfc50 con 0x7f9a2415d490 2023-12-19T05:50:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2a3f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24161e90 con 0x7f9a24161a20 2023-12-19T05:50:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a23fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 0x7f9a240cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.496+0000 7f9a2898d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 0x7f9a24070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a23fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 0x7f9a240cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:48538/0 (socket says 172.21.15.49:48538) 2023-12-19T05:50:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a23fff640 1 -- 172.21.15.49:0/2034930263 learned_addr learned my addr 172.21.15.49:0/2034930263 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a2898d640 1 -- 172.21.15.49:0/2034930263 >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 msgr2=0x7f9a240cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a2898d640 1 --2- 172.21.15.49:0/2034930263 >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 0x7f9a240cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a2898d640 1 -- 172.21.15.49:0/2034930263 >> v1:172.21.15.115:6789/0 conn(0x7f9a240cf7c0 legacy=0x7f9a24161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.497+0000 7f9a2898d640 1 -- 172.21.15.49:0/2034930263 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2406d900 con 0x7f9a24161a20 2023-12-19T05:50:12.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.499+0000 7f9a2898d640 1 --2- 172.21.15.49:0/2034930263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 0x7f9a24070270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0097a0 tx=0x7f9a1c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13adbdf4986d5c03 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.499+0000 7f9a22ffd640 1 -- 172.21.15.49:0/2034930263 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c02d040 con 0x7f9a24161a20 2023-12-19T05:50:12.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.499+0000 7f9a22ffd640 1 -- 172.21.15.49:0/2034930263 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c031810 con 0x7f9a24161a20 2023-12-19T05:50:12.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.499+0000 7f9a22ffd640 1 -- 172.21.15.49:0/2034930263 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c031ba0 con 0x7f9a24161a20 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/2034930263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 msgr2=0x7f9a24070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/2034930263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 0x7f9a24070270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0097a0 tx=0x7f9a1c02b8b0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/2034930263 shutdown_connections 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/2034930263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a24161a20 0x7f9a24070270 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/2034930263 >> v2:172.21.15.115:3300/0 conn(0x7f9a2415d490 0x7f9a240cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/2034930263 >> 172.21.15.49:0/2034930263 conn(0x7f9a2406a2e0 msgr2=0x7f9a2406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/2034930263 shutdown_connections 2023-12-19T05:50:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.500+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/2034930263 wait complete. 2023-12-19T05:50:12.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.503+0000 7f9a2a3f0640 1 Processor -- start 2023-12-19T05:50:12.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.503+0000 7f9a2a3f0640 1 -- start start 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a240cf7c0 0x7f9a24146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2415d490 0x7f9a24155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240cc350 con 0x7f9a24161a20 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241565e0 con 0x7f9a2415d490 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2a3f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240cba20 con 0x7f9a240cf7c0 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2898d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.505+0000 7f9a2898d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45400/0 (socket says 172.21.15.49:45400) 2023-12-19T05:50:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 -- 172.21.15.49:0/225366542 learned_addr learned my addr 172.21.15.49:0/225366542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a23fff640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a240cf7c0 0x7f9a24146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a237fe640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2415d490 0x7f9a24155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 -- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a240cf7c0 msgr2=0x7f9a24146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a240cf7c0 0x7f9a24146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 -- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2415d490 msgr2=0x7f9a24155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2415d490 0x7f9a24155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.506+0000 7f9a2898d640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c009400 con 0x7f9a24161a20 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a2898d640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0097a0 tx=0x7f9a1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c006e10 con 0x7f9a24161a20 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c03ace0 con 0x7f9a24161a20 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c044640 con 0x7f9a24161a20 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a240cbd00 con 0x7f9a24161a20 2023-12-19T05:50:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.507+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240b5130 con 0x7f9a24161a20 2023-12-19T05:50:12.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.509+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a240cc500 con 0x7f9a24161a20 2023-12-19T05:50:12.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.509+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a1c04d440 con 0x7f9a24161a20 2023-12-19T05:50:12.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.510+0000 7f9a20ff9640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 0x7f9a0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.510+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a1c0aa9e0 con 0x7f9a24161a20 2023-12-19T05:50:12.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.511+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f9a04071f90 con 0x7f9a24161a20 2023-12-19T05:50:12.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.511+0000 7f9a23fff640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 0x7f9a0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.512+0000 7f9a23fff640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 0x7f9a0406c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9a140113e0 tx=0x7f9a1400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.515+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9a1c076080 con 0x7f9a24161a20 2023-12-19T05:50:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.712+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a24061910 con 0x7f9a24161a20 2023-12-19T05:50:12.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.716+0000 7f9a20ff9640 1 -- 172.21.15.49:0/225366542 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f9a1c035030 con 0x7f9a24161a20 2023-12-19T05:50:12.719 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:12.719 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":163,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:49:30.402626+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.719+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 msgr2=0x7f9a0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.719+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 0x7f9a0406c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9a140113e0 tx=0x7f9a1400b040 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.719+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 msgr2=0x7f9a240b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.719+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0097a0 tx=0x7f9a1c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 shutdown_connections 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9a0406a460 0x7f9a0406c920 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a24161a20 0x7f9a240b5420 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2415d490 0x7f9a24155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 --2- 172.21.15.49:0/225366542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a240cf7c0 0x7f9a24146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 >> 172.21.15.49:0/225366542 conn(0x7f9a2406a2e0 msgr2=0x7f9a24070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 shutdown_connections 2023-12-19T05:50:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.720+0000 7f9a2a3f0640 1 -- 172.21.15.49:0/225366542 wait complete. 2023-12-19T05:50:12.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:47:55.166539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:47:56.215056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:50:12.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:50:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.966+0000 7f7514bf4640 1 Processor -- start 2023-12-19T05:50:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.966+0000 7f7514bf4640 1 -- start start 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7510141900 0x7f75100afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75100b02a0 0x7f751006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f751006da30 0x7f75100ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751006e220 con 0x7f751006da30 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75100b0700 con 0x7f7510141900 2023-12-19T05:50:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.968+0000 7f7514bf4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75100cbea0 con 0x7f75100b02a0 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f751006da30 0x7f75100ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f751006da30 0x7f75100ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45406/0 (socket says 172.21.15.49:45406) 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 -- 172.21.15.49:0/756966734 learned_addr learned my addr 172.21.15.49:0/756966734 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750effd640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75100b02a0 0x7f751006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750f7fe640 1 --2- 172.21.15.49:0/756966734 >> v2:172.21.15.115:3300/0 conn(0x7f7510141900 0x7f75100afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 -- 172.21.15.49:0/756966734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75100b02a0 msgr2=0x7f751006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75100b02a0 0x7f751006d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 -- 172.21.15.49:0/756966734 >> v2:172.21.15.115:3300/0 conn(0x7f7510141900 msgr2=0x7f75100afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 --2- 172.21.15.49:0/756966734 >> v2:172.21.15.115:3300/0 conn(0x7f7510141900 0x7f75100afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.969+0000 7f750ffff640 1 -- 172.21.15.49:0/756966734 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100cc180 con 0x7f751006da30 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.970+0000 7f750ffff640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75100ceb60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7510067480 tx=0x7f750802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68f0580d52b10ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.971+0000 7f750e7fc640 1 -- 172.21.15.49:0/756966734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750802ca70 con 0x7f751006da30 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.971+0000 7f750e7fc640 1 -- 172.21.15.49:0/756966734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750802cbd0 con 0x7f751006da30 2023-12-19T05:50:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.971+0000 7f750e7fc640 1 -- 172.21.15.49:0/756966734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75080343f0 con 0x7f751006da30 2023-12-19T05:50:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 -- 172.21.15.49:0/756966734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 msgr2=0x7f75100ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75100ceb60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7510067480 tx=0x7f750802bed0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 -- 172.21.15.49:0/756966734 shutdown_connections 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75100ceb60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 --2- 172.21.15.49:0/756966734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75100b02a0 0x7f751006d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 --2- 172.21.15.49:0/756966734 >> v2:172.21.15.115:3300/0 conn(0x7f7510141900 0x7f75100afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 -- 172.21.15.49:0/756966734 >> 172.21.15.49:0/756966734 conn(0x7f751006f630 msgr2=0x7f751006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 -- 172.21.15.49:0/756966734 shutdown_connections 2023-12-19T05:50:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.972+0000 7f7514bf4640 1 -- 172.21.15.49:0/756966734 wait complete. 2023-12-19T05:50:12.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.974+0000 7f7514bf4640 1 Processor -- start 2023-12-19T05:50:12.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.974+0000 7f7514bf4640 1 -- start start 2023-12-19T05:50:12.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 0x7f75101f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 0x7f751015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100b1790 con 0x7f751006da30 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75101f7450 con 0x7f75100b02a0 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f7514bf4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75101f7730 con 0x7f7510141900 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45418/0 (socket says 172.21.15.49:45418) 2023-12-19T05:50:12.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.975+0000 7f750f7fe640 1 -- 172.21.15.49:0/2436414933 learned_addr learned my addr 172.21.15.49:0/2436414933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:12.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750ffff640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 0x7f751015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750effd640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 0x7f75101f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 -- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 msgr2=0x7f751015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 0x7f751015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 -- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 msgr2=0x7f75101f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 0x7f75101f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009b30 con 0x7f751006da30 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750ffff640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 0x7f751015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750effd640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 0x7f75101f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f750f7fe640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f750000d800 tx=0x7f750000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000b6c0 con 0x7f751006da30 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000b820 con 0x7f751006da30 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000bbb0 con 0x7f751006da30 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.976+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75100b13b0 con 0x7f751006da30 2023-12-19T05:50:12.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.977+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7510155a90 con 0x7f751006da30 2023-12-19T05:50:12.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.978+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510061910 con 0x7f751006da30 2023-12-19T05:50:12.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.979+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f750000bd10 con 0x7f751006da30 2023-12-19T05:50:12.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.979+0000 7f74f7fff640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:12.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.980+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7500088e60 con 0x7f751006da30 2023-12-19T05:50:12.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.980+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f74fc071f60 con 0x7f751006da30 2023-12-19T05:50:12.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.980+0000 7f750effd640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:12.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.981+0000 7f750effd640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 0x7f74fc06c8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f75101f45c0 tx=0x7f7504008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:12.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:12.984+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7500054450 con 0x7f751006da30 2023-12-19T05:50:13.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.183+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75101f78f0 con 0x7f751006da30 2023-12-19T05:50:13.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.184+0000 7f74f7fff640 1 -- 172.21.15.49:0/2436414933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7500057a70 con 0x7f751006da30 2023-12-19T05:50:13.186 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:50:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 msgr2=0x7f74fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 0x7f74fc06c8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f75101f45c0 tx=0x7f7504008040 comp rx=0 tx=0).stop 2023-12-19T05:50:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 msgr2=0x7f75101561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f750000d800 tx=0x7f750000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 shutdown_connections 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7510141900 0x7f751015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75100b02a0 0x7f75101f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 --2- 172.21.15.49:0/2436414933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751006da30 0x7f75101561f0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.187+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 >> 172.21.15.49:0/2436414933 conn(0x7f751006f630 msgr2=0x7f75100ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.188+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 shutdown_connections 2023-12-19T05:50:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.188+0000 7f7514bf4640 1 -- 172.21.15.49:0/2436414933 wait complete. 2023-12-19T05:50:13.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:50:13.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.443+0000 7fc0b5270640 1 Processor -- start 2023-12-19T05:50:13.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.443+0000 7fc0b5270640 1 -- start start 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0b0146e10 0x7fc0b00d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0b00d2b00 0x7fc0b00b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b00ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00d2430 con 0x7fc0b00d2b00 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00ceac0 con 0x7fc0b0146e10 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0b5270640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00cd840 con 0x7fc0b00ce110 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0ae7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0b00d2b00 0x7fc0b00b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0ae7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc0b00d2b00 0x7fc0b00b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45434/0 (socket says 172.21.15.49:45434) 2023-12-19T05:50:13.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0ae7fc640 1 -- 172.21.15.49:0/2373799599 learned_addr learned my addr 172.21.15.49:0/2373799599 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0aeffd640 1 --2- 172.21.15.49:0/2373799599 >> v2:172.21.15.115:3300/0 conn(0x7fc0b0146e10 0x7fc0b00d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.445+0000 7fc0af7fe640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b00ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.446+0000 7fc0ae7fc640 1 -- 172.21.15.49:0/2373799599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 msgr2=0x7fc0b00ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.446+0000 7fc0ae7fc640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b00ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.446+0000 7fc0ae7fc640 1 -- 172.21.15.49:0/2373799599 >> v2:172.21.15.115:3300/0 conn(0x7fc0b0146e10 msgr2=0x7fc0b00d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.446+0000 7fc0ae7fc640 1 --2- 172.21.15.49:0/2373799599 >> v2:172.21.15.115:3300/0 conn(0x7fc0b0146e10 0x7fc0b00d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.446+0000 7fc0ae7fc640 1 -- 172.21.15.49:0/2373799599 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00d2620 con 0x7fc0b00d2b00 2023-12-19T05:50:13.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.447+0000 7fc0ae7fc640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b00d2b00 0x7fc0b00b6780 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00d0720 tx=0x7fc09802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2349425cb40770 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.447+0000 7fc0adffb640 1 -- 172.21.15.49:0/2373799599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031640 con 0x7fc0b00d2b00 2023-12-19T05:50:13.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.447+0000 7fc0adffb640 1 -- 172.21.15.49:0/2373799599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980317a0 con 0x7fc0b00d2b00 2023-12-19T05:50:13.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.447+0000 7fc0adffb640 1 -- 172.21.15.49:0/2373799599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031b30 con 0x7fc0b00d2b00 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 -- 172.21.15.49:0/2373799599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b00d2b00 msgr2=0x7fc0b00b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b00d2b00 0x7fc0b00b6780 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00d0720 tx=0x7fc09802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 -- 172.21.15.49:0/2373799599 shutdown_connections 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b00ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 --2- 172.21.15.49:0/2373799599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b00d2b00 0x7fc0b00b6780 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 --2- 172.21.15.49:0/2373799599 >> v2:172.21.15.115:3300/0 conn(0x7fc0b0146e10 0x7fc0b00d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 -- 172.21.15.49:0/2373799599 >> 172.21.15.49:0/2373799599 conn(0x7fc0b00b29c0 msgr2=0x7fc0b00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:13.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 -- 172.21.15.49:0/2373799599 shutdown_connections 2023-12-19T05:50:13.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.448+0000 7fc0b5270640 1 -- 172.21.15.49:0/2373799599 wait complete. 2023-12-19T05:50:13.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.450+0000 7fc0b5270640 1 Processor -- start 2023-12-19T05:50:13.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.450+0000 7fc0b5270640 1 -- start start 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.451+0000 7fc0b5270640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b0142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.451+0000 7fc0b5270640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 0x7fc0b015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.451+0000 7fc0b5270640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0b5270640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b014d760 con 0x7fc0b0146e10 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0b5270640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b014cb50 con 0x7fc0b00d2b00 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0b5270640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b014ce30 con 0x7fc0b00ce110 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45450/0 (socket says 172.21.15.49:45450) 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 -- 172.21.15.49:0/1206928141 learned_addr learned my addr 172.21.15.49:0/1206928141 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0aeffd640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b0142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0ae7fc640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 0x7fc0b015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 -- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 msgr2=0x7fc0b0142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b0142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 -- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 msgr2=0x7fc0b015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 0x7fc0b015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0af7fe640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980094d0 con 0x7fc0b0146e10 2023-12-19T05:50:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.452+0000 7fc0ae7fc640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 0x7fc0b015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0af7fe640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d800 tx=0x7fc0a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80096c0 con 0x7fc0b0146e10 2023-12-19T05:50:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8009840 con 0x7fc0b0146e10 2023-12-19T05:50:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8009bf0 con 0x7fc0b0146e10 2023-12-19T05:50:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b014d110 con 0x7fc0b0146e10 2023-12-19T05:50:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.453+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b0140470 con 0x7fc0b0146e10 2023-12-19T05:50:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.454+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b0061910 con 0x7fc0b0146e10 2023-12-19T05:50:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.456+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0a8009d50 con 0x7fc0b0146e10 2023-12-19T05:50:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.457+0000 7fc0a77fe640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 0x7fc09006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.457+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0a8088d50 con 0x7fc0b0146e10 2023-12-19T05:50:13.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.457+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fc090071f60 con 0x7fc0b0146e10 2023-12-19T05:50:13.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.458+0000 7fc0aeffd640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 0x7fc09006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.459+0000 7fc0aeffd640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 0x7fc09006c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00099c0 tx=0x7fc0a0003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.462+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0a8054330 con 0x7fc0b0146e10 2023-12-19T05:50:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.658+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0b015db90 con 0x7fc0b0146e10 2023-12-19T05:50:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.659+0000 7fc0a77fe640 1 -- 172.21.15.49:0/1206928141 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0a8018020 con 0x7fc0b0146e10 2023-12-19T05:50:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:50:13.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 msgr2=0x7fc09006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 0x7fc09006c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00099c0 tx=0x7fc0a0003990 comp rx=0 tx=0).stop 2023-12-19T05:50:13.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 msgr2=0x7fc0b013ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d800 tx=0x7fc0a800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 shutdown_connections 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc09006a430 0x7fc09006c8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0b0146e10 0x7fc0b013ff30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b00d2b00 0x7fc0b015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 --2- 172.21.15.49:0/1206928141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0b00ce110 0x7fc0b0142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 >> 172.21.15.49:0/1206928141 conn(0x7fc0b00b29c0 msgr2=0x7fc0b015b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.661+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 shutdown_connections 2023-12-19T05:50:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.662+0000 7fc0b5270640 1 -- 172.21.15.49:0/1206928141 wait complete. 2023-12-19T05:50:13.681 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:50:13.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.912+0000 7fdc229ef640 1 Processor -- start 2023-12-19T05:50:13.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.912+0000 7fdc229ef640 1 -- start start 2023-12-19T05:50:13.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.914+0000 7fdc229ef640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc1c0b2730 0x7fdc1c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.914+0000 7fdc229ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c06f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.914+0000 7fdc229ef640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c06f160 con 0x7fdc1c161560 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.914+0000 7fdc229ef640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0b69c0 con 0x7fdc1c0b2730 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.914+0000 7fdc229ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1656c0 con 0x7fdc1c1651e0 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc221ee640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c06f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc211ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc1c0b2730 0x7fdc1c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc211ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc1c0b2730 0x7fdc1c0b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:48594/0 (socket says 172.21.15.49:48594) 2023-12-19T05:50:13.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc219ed640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdc1c161560 0x7fdc1c0b2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:45010/0 (socket says 172.21.15.49:45010) 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc219ed640 1 -- 172.21.15.49:0/616068861 learned_addr learned my addr 172.21.15.49:0/616068861 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.915+0000 7fdc221ee640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c06f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:59972/0 (socket says 172.21.15.49:59972) 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.916+0000 7fdc211ec640 1 -- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 msgr2=0x7fdc1c06f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.916+0000 7fdc211ec640 1 --2- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c06f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.916+0000 7fdc211ec640 1 -- 172.21.15.49:0/616068861 >> v1:172.21.15.115:6789/0 conn(0x7fdc1c161560 legacy=0x7fdc1c0b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.916+0000 7fdc211ec640 1 -- 172.21.15.49:0/616068861 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c1659a0 con 0x7fdc1c0b2730 2023-12-19T05:50:13.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.917+0000 7fdc211ec640 1 --2- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c0b6480 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097a0 tx=0x7fdc0802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb66d10928b3cb33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.917+0000 7fdc209eb640 1 -- 172.21.15.49:0/616068861 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08031830 con 0x7fdc1c0b2730 2023-12-19T05:50:13.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.917+0000 7fdc209eb640 1 -- 172.21.15.49:0/616068861 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08031990 con 0x7fdc1c0b2730 2023-12-19T05:50:13.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.917+0000 7fdc209eb640 1 -- 172.21.15.49:0/616068861 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08031d20 con 0x7fdc1c0b2730 2023-12-19T05:50:13.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.918+0000 7fdc229ef640 1 -- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 msgr2=0x7fdc1c0b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.918+0000 7fdc229ef640 1 --2- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c0b6480 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097a0 tx=0x7fdc0802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 -- 172.21.15.49:0/616068861 shutdown_connections 2023-12-19T05:50:13.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 --2- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c06f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 --2- 172.21.15.49:0/616068861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c0b6480 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 -- 172.21.15.49:0/616068861 >> 172.21.15.49:0/616068861 conn(0x7fdc1c071370 msgr2=0x7fdc1c071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 -- 172.21.15.49:0/616068861 shutdown_connections 2023-12-19T05:50:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.919+0000 7fdc229ef640 1 -- 172.21.15.49:0/616068861 wait complete. 2023-12-19T05:50:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.921+0000 7fdc229ef640 1 Processor -- start 2023-12-19T05:50:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.921+0000 7fdc229ef640 1 -- start start 2023-12-19T05:50:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c157da0 con 0x7fdc1c161560 2023-12-19T05:50:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c157ac0 con 0x7fdc1c0b2730 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc229ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c159960 con 0x7fdc1c1651e0 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc211ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc211ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45458/0 (socket says 172.21.15.49:45458) 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc211ec640 1 -- 172.21.15.49:0/2287278839 learned_addr learned my addr 172.21.15.49:0/2287278839 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.923+0000 7fdc219ed640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc221ee640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 -- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 msgr2=0x7fdc1c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 -- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 msgr2=0x7fdc1c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009400 con 0x7fdc1c161560 2023-12-19T05:50:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc219ed640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.924+0000 7fdc211ec640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802bee0 tx=0x7fdc080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.925+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0803a6f0 con 0x7fdc1c161560 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.925+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0803a870 con 0x7fdc1c161560 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.925+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0803ac20 con 0x7fdc1c161560 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.925+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c159c40 con 0x7fdc1c161560 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.925+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c148700 con 0x7fdc1c161560 2023-12-19T05:50:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.926+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c061910 con 0x7fdc1c161560 2023-12-19T05:50:13.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.927+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc08030380 con 0x7fdc1c161560 2023-12-19T05:50:13.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.928+0000 7fdc1a7fc640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.928+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc080aa2e0 con 0x7fdc1c161560 2023-12-19T05:50:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.928+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fdc00071f60 con 0x7fdc1c161560 2023-12-19T05:50:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.929+0000 7fdc219ed640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.930+0000 7fdc219ed640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005c00 tx=0x7fdc10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:13.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:13.933+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc080758c0 con 0x7fdc1c161560 2023-12-19T05:50:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.126+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc1c06dd40 con 0x7fdc1c161560 2023-12-19T05:50:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.127+0000 7fdc1a7fc640 1 -- 172.21.15.49:0/2287278839 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc080480a0 con 0x7fdc1c161560 2023-12-19T05:50:14.129 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:50:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.129+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 msgr2=0x7fdc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.129+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005c00 tx=0x7fdc10009040 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.129+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 msgr2=0x7fdc1c1481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.129+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802bee0 tx=0x7fdc080046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 shutdown_connections 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1c1651e0 0x7fdc1c070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc1c161560 0x7fdc1c1481c0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 --2- 172.21.15.49:0/2287278839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc1c0b2730 0x7fdc1c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 >> 172.21.15.49:0/2287278839 conn(0x7fdc1c071370 msgr2=0x7fdc1c164490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 shutdown_connections 2023-12-19T05:50:14.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.130+0000 7fdc229ef640 1 -- 172.21.15.49:0/2287278839 wait complete. 2023-12-19T05:50:14.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:50:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.368+0000 7ff458eec640 1 Processor -- start 2023-12-19T05:50:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.369+0000 7ff458eec640 1 -- start start 2023-12-19T05:50:14.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.370+0000 7ff458eec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff454155460 0x7ff4540b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.370+0000 7ff458eec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4540b0830 0x7ff45406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff458eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff4540cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff458eec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540b0ce0 con 0x7ff454155460 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff458eec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45415c9c0 con 0x7ff4540b0830 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff458eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45406d270 con 0x7ff45406ca80 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff454155460 0x7ff4540b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff454155460 0x7ff4540b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52624/0 (socket says 172.21.15.49:52624) 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 -- 172.21.15.49:0/3728751021 learned_addr learned my addr 172.21.15.49:0/3728751021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 -- 172.21.15.49:0/3728751021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 msgr2=0x7ff4540cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:14.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 --2- 172.21.15.49:0/3728751021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff4540cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff44bfff640 1 --2- 172.21.15.49:0/3728751021 >> v2:172.21.15.115:3300/0 conn(0x7ff4540b0830 0x7ff45406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 -- 172.21.15.49:0/3728751021 >> v2:172.21.15.115:3300/0 conn(0x7ff4540b0830 msgr2=0x7ff45406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 --2- 172.21.15.49:0/3728751021 >> v2:172.21.15.115:3300/0 conn(0x7ff4540b0830 0x7ff45406c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.371+0000 7ff4537fe640 1 -- 172.21.15.49:0/3728751021 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45406d550 con 0x7ff454155460 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.373+0000 7ff4537fe640 1 --2- 172.21.15.49:0/3728751021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540b02f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff4540afea0 tx=0x7ff44402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3a03f8c2cf079d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:14.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.373+0000 7ff452ffd640 1 -- 172.21.15.49:0/3728751021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444031860 con 0x7ff454155460 2023-12-19T05:50:14.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.373+0000 7ff452ffd640 1 -- 172.21.15.49:0/3728751021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4440319c0 con 0x7ff454155460 2023-12-19T05:50:14.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.373+0000 7ff452ffd640 1 -- 172.21.15.49:0/3728751021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444031d50 con 0x7ff454155460 2023-12-19T05:50:14.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 -- 172.21.15.49:0/3728751021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 msgr2=0x7ff4540b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 --2- 172.21.15.49:0/3728751021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540b02f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff4540afea0 tx=0x7ff44402b900 comp rx=0 tx=0).stop 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 -- 172.21.15.49:0/3728751021 shutdown_connections 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 --2- 172.21.15.49:0/3728751021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff4540cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 --2- 172.21.15.49:0/3728751021 >> v2:172.21.15.115:3300/0 conn(0x7ff4540b0830 0x7ff45406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 --2- 172.21.15.49:0/3728751021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540b02f0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 -- 172.21.15.49:0/3728751021 >> 172.21.15.49:0/3728751021 conn(0x7ff4540659a0 msgr2=0x7ff454065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 -- 172.21.15.49:0/3728751021 shutdown_connections 2023-12-19T05:50:14.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.374+0000 7ff458eec640 1 -- 172.21.15.49:0/3728751021 wait complete. 2023-12-19T05:50:14.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.376+0000 7ff458eec640 1 Processor -- start 2023-12-19T05:50:14.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.376+0000 7ff458eec640 1 -- start start 2023-12-19T05:50:14.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff454158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 0x7ff4540ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454152830 con 0x7ff454155460 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540acdf0 con 0x7ff4540b0830 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff458eec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540ad050 con 0x7ff45406ca80 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff453fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.377+0000 7ff453fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52634/0 (socket says 172.21.15.49:52634) 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 -- 172.21.15.49:0/1208864785 learned_addr learned my addr 172.21.15.49:0/1208864785 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff4537fe640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff454158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff44bfff640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 0x7ff4540ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 -- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 msgr2=0x7ff454158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff454158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 -- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 msgr2=0x7ff4540ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 0x7ff4540ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440094d0 con 0x7ff454155460 2023-12-19T05:50:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff44bfff640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 0x7ff4540ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff453fff640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00b970 tx=0x7ff44c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.378+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00cb40 con 0x7ff454155460 2023-12-19T05:50:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.379+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00ccc0 con 0x7ff454155460 2023-12-19T05:50:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.379+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c014680 con 0x7ff454155460 2023-12-19T05:50:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.379+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4540ad330 con 0x7ff454155460 2023-12-19T05:50:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.379+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540ad8f0 con 0x7ff454155460 2023-12-19T05:50:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.380+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45415ba90 con 0x7ff454155460 2023-12-19T05:50:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.381+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff44c01d3b0 con 0x7ff454155460 2023-12-19T05:50:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.382+0000 7ff450ff9640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 0x7ff43406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.382+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff44c088900 con 0x7ff454155460 2023-12-19T05:50:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.383+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7ff434071f60 con 0x7ff454155460 2023-12-19T05:50:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.383+0000 7ff4537fe640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 0x7ff43406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.384+0000 7ff4537fe640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 0x7ff43406c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff444036000 tx=0x7ff44403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.387+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff44c019020 con 0x7ff454155460 2023-12-19T05:50:14.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.592+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff454061910 con 0x7ff454155460 2023-12-19T05:50:14.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.593+0000 7ff450ff9640 1 -- 172.21.15.49:0/1208864785 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff44c053e50 con 0x7ff454155460 2023-12-19T05:50:14.595 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 msgr2=0x7ff43406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 0x7ff43406c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff444036000 tx=0x7ff44403c040 comp rx=0 tx=0).stop 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 msgr2=0x7ff4540ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00b970 tx=0x7ff44c00be30 comp rx=0 tx=0).stop 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 shutdown_connections 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff43406a430 0x7ff43406c8f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff454155460 0x7ff4540ac8b0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4540b0830 0x7ff4540ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 --2- 172.21.15.49:0/1208864785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45406ca80 0x7ff454158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 >> 172.21.15.49:0/1208864785 conn(0x7ff4540659a0 msgr2=0x7ff45415e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 shutdown_connections 2023-12-19T05:50:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:14.596+0000 7ff458eec640 1 -- 172.21.15.49:0/1208864785 wait complete. 2023-12-19T05:50:14.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:50:14.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:14.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:50:14.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:50:14.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:14.731 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:50:14.783 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:14.783 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:14.842 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:14.842 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:14.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.140+0000 7f29a2ce5640 1 Processor -- start 2023-12-19T05:50:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.140+0000 7f29a2ce5640 1 -- start start 2023-12-19T05:50:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a2ce5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f299c0b2030 0x7f299c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a2ce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 0x7f299c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a2ce5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c15ec30 con 0x7f299c15e5a0 2023-12-19T05:50:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a2ce5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0ce5a0 con 0x7f299c0b2030 2023-12-19T05:50:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a2ce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c15fbc0 con 0x7f299c0cdbf0 2023-12-19T05:50:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.143+0000 7f29a24e4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 0x7f299c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.143+0000 7f29a1ce3640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f299c15e5a0 0x7f299c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:45032/0 (socket says 172.21.15.49:45032) 2023-12-19T05:50:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.142+0000 7f29a14e2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f299c0b2030 0x7f299c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.143+0000 7f29a1ce3640 1 -- 172.21.15.49:0/1074007318 learned_addr learned my addr 172.21.15.49:0/1074007318 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.143+0000 7f29a0ce1640 1 -- 172.21.15.49:0/1074007318 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187056645 0 0) 0x7f299c15ec30 con 0x7f299c15e5a0 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.143+0000 7f29a0ce1640 1 -- 172.21.15.49:0/1074007318 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2988003520 con 0x7f299c15e5a0 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.144+0000 7f29a24e4640 1 -- 172.21.15.49:0/1074007318 >> v2:172.21.15.115:3300/0 conn(0x7f299c0b2030 msgr2=0x7f299c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.144+0000 7f29a24e4640 1 --2- 172.21.15.49:0/1074007318 >> v2:172.21.15.115:3300/0 conn(0x7f299c0b2030 0x7f299c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.144+0000 7f29a24e4640 1 -- 172.21.15.49:0/1074007318 >> v1:172.21.15.115:6789/0 conn(0x7f299c15e5a0 legacy=0x7f299c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.144+0000 7f29a24e4640 1 -- 172.21.15.49:0/1074007318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c15e980 con 0x7f299c0cdbf0 2023-12-19T05:50:15.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.145+0000 7f29a24e4640 1 --2- 172.21.15.49:0/1074007318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 0x7f299c0ce060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29940097d0 tx=0x7f299402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44fccf4bcf28dbaf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.145+0000 7f29a0ce1640 1 -- 172.21.15.49:0/1074007318 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299402d040 con 0x7f299c0cdbf0 2023-12-19T05:50:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a0ce1640 1 -- 172.21.15.49:0/1074007318 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994031810 con 0x7f299c0cdbf0 2023-12-19T05:50:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a0ce1640 1 -- 172.21.15.49:0/1074007318 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994031b80 con 0x7f299c0cdbf0 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 -- 172.21.15.49:0/1074007318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 msgr2=0x7f299c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/1074007318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 0x7f299c0ce060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29940097d0 tx=0x7f299402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 -- 172.21.15.49:0/1074007318 shutdown_connections 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/1074007318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0cdbf0 0x7f299c0ce060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/1074007318 >> v2:172.21.15.115:3300/0 conn(0x7f299c0b2030 0x7f299c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 -- 172.21.15.49:0/1074007318 >> 172.21.15.49:0/1074007318 conn(0x7f299c0b0100 msgr2=0x7f299c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 -- 172.21.15.49:0/1074007318 shutdown_connections 2023-12-19T05:50:15.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.146+0000 7f29a2ce5640 1 -- 172.21.15.49:0/1074007318 wait complete. 2023-12-19T05:50:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.148+0000 7f29a2ce5640 1 Processor -- start 2023-12-19T05:50:15.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.148+0000 7f29a2ce5640 1 -- start start 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0b2030 0x7f299c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f299c15e5a0 0x7f299c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0a9740 con 0x7f299c0cdbf0 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c154c70 con 0x7f299c15e5a0 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.149+0000 7f29a2ce5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0a8ac0 con 0x7f299c0b2030 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52642/0 (socket says 172.21.15.49:52642) 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 -- 172.21.15.49:0/2722958277 learned_addr learned my addr 172.21.15.49:0/2722958277 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a1ce3640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0b2030 0x7f299c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a24e4640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f299c15e5a0 0x7f299c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 -- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0b2030 msgr2=0x7f299c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0b2030 0x7f299c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 -- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f299c15e5a0 msgr2=0x7f299c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f299c15e5a0 0x7f299c1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.150+0000 7f29a14e2640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994009400 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29a14e2640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e870 tx=0x7f298c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0094f0 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00c940 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ccf0 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c0a8da0 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.151+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c0a9360 con 0x7f299c0cdbf0 2023-12-19T05:50:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.153+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0a9880 con 0x7f299c0cdbf0 2023-12-19T05:50:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.153+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f298c013470 con 0x7f299c0cdbf0 2023-12-19T05:50:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.154+0000 7f29927fc640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 0x7f298006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.155+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f298c0889b0 con 0x7f299c0cdbf0 2023-12-19T05:50:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.155+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f2980071f60 con 0x7f299c0cdbf0 2023-12-19T05:50:15.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.155+0000 7f29a1ce3640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 0x7f298006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.156+0000 7f29a1ce3640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 0x7f298006c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2998001560 tx=0x7f2998009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.159+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f298c021060 con 0x7f299c0cdbf0 2023-12-19T05:50:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.361+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f299c061910 con 0x7f299c0cdbf0 2023-12-19T05:50:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.363+0000 7f29927fc640 1 -- 172.21.15.49:0/2722958277 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f299c0a9880 con 0x7f299c0cdbf0 2023-12-19T05:50:15.365 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:15.366 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":163,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:49:30.402626+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 msgr2=0x7f298006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 0x7f298006c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2998001560 tx=0x7f2998009040 comp rx=0 tx=0).stop 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 msgr2=0x7f299c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e870 tx=0x7f298c00ed30 comp rx=0 tx=0).stop 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 shutdown_connections 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f298006a430 0x7f298006c8f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f299c15e5a0 0x7f299c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0cdbf0 0x7f299c0a9b60 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 --2- 172.21.15.49:0/2722958277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f299c0b2030 0x7f299c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.366+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 >> 172.21.15.49:0/2722958277 conn(0x7f299c0b0100 msgr2=0x7f299c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.367+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 shutdown_connections 2023-12-19T05:50:15.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.367+0000 7f29a2ce5640 1 -- 172.21.15.49:0/2722958277 wait complete. 2023-12-19T05:50:15.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:47:55.166539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:47:56.215056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:50:15.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:50:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.625+0000 7f563c93c640 1 Processor -- start 2023-12-19T05:50:15.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.625+0000 7f563c93c640 1 -- start start 2023-12-19T05:50:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563c93c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f56380b6430 0x7f56380d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563c93c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5638161e70 con 0x7f5638146ff0 2023-12-19T05:50:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563c93c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5638161260 con 0x7f563806fc40 2023-12-19T05:50:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563c93c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5638161080 con 0x7f56380b6430 2023-12-19T05:50:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5638146ff0 0x7f563806f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58408/0 (socket says 172.21.15.49:58408) 2023-12-19T05:50:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.627+0000 7f563659c640 1 -- 172.21.15.49:0/1869997441 learned_addr learned my addr 172.21.15.49:0/1869997441 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f5636d9d640 1 --2- 172.21.15.49:0/1869997441 >> v2:172.21.15.115:3300/0 conn(0x7f56380b6430 0x7f56380d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828236692 0 0) 0x7f5638161e70 con 0x7f5638146ff0 2023-12-19T05:50:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5624003520 con 0x7f5638146ff0 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834573984 0 0) 0x7f5624003520 con 0x7f5638146ff0 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 >> v2:172.21.15.115:3300/0 conn(0x7f56380b6430 msgr2=0x7f56380d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 --2- 172.21.15.49:0/1869997441 >> v2:172.21.15.115:3300/0 conn(0x7f56380b6430 0x7f56380d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 >> v1:172.21.15.115:6789/0 conn(0x7f563806fc40 legacy=0x7f563815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638161540 con 0x7f5638146ff0 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f56280019f0 con 0x7f5638146ff0 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 >> v1:172.21.15.49:6789/0 conn(0x7f5638146ff0 legacy=0x7f563806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56240039e0 0x7f5624003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 0x7f562400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5638161080 con 0x7f5624005180 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562400c0b0 con 0x7f56240047c0 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.628+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562400c270 con 0x7f56240039e0 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 0x7f562400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5635d9b640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f563659c640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56240039e0 0x7f5624003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 -- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56240039e0 msgr2=0x7f5624003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56240039e0 0x7f5624003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 -- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 msgr2=0x7f5624004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56240047c0 0x7f5624004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.629+0000 7f5636d9d640 1 -- 172.21.15.49:0/1869997441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624003520 con 0x7f5624005180 2023-12-19T05:50:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.631+0000 7f5636d9d640 1 -- 172.21.15.49:0/1869997441 reap_dead start 2023-12-19T05:50:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.631+0000 7f5636d9d640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 0x7f562400b980 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f5630009ac0 tx=0x7f56240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a6073c5fb268f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.631+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630004020 con 0x7f5624005180 2023-12-19T05:50:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.631+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630004180 con 0x7f5624005180 2023-12-19T05:50:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.631+0000 7f563559a640 1 -- 172.21.15.49:0/1869997441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563002c710 con 0x7f5624005180 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 -- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 msgr2=0x7f562400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 0x7f562400b980 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f5630009ac0 tx=0x7f56240057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 -- 172.21.15.49:0/1869997441 shutdown_connections 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 --2- 172.21.15.49:0/1869997441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5624005180 0x7f562400b980 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 -- 172.21.15.49:0/1869997441 >> 172.21.15.49:0/1869997441 conn(0x7f56380d3520 msgr2=0x7f56380d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 -- 172.21.15.49:0/1869997441 shutdown_connections 2023-12-19T05:50:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.632+0000 7f563c93c640 1 -- 172.21.15.49:0/1869997441 wait complete. 2023-12-19T05:50:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.634+0000 7f563c93c640 1 Processor -- start 2023-12-19T05:50:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.634+0000 7f563c93c640 1 -- start start 2023-12-19T05:50:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624005180 0x7f56380b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56380cbe00 0x7f56381f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c83a0 con 0x7f56380c9340 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380cc280 con 0x7f5624005180 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f563c93c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c8eb0 con 0x7f56380cbe00 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.635+0000 7f5635d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52660/0 (socket says 172.21.15.49:52660) 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 -- 172.21.15.49:0/2860916657 learned_addr learned my addr 172.21.15.49:0/2860916657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f563659c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624005180 0x7f56380b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5636d9d640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56380cbe00 0x7f56381f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 -- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56380cbe00 msgr2=0x7f56381f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56380cbe00 0x7f56381f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 -- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624005180 msgr2=0x7f56380b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624005180 0x7f56380b7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380cc480 con 0x7f56380c9340 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.636+0000 7f5635d9b640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f562000f5f0 tx=0x7f562000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.637+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56200052e0 con 0x7f56380c9340 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.637+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5620005440 con 0x7f56380c9340 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.637+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620003830 con 0x7f56380c9340 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.637+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380c8580 con 0x7f56380c9340 2023-12-19T05:50:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.637+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380c8b40 con 0x7f56380c9340 2023-12-19T05:50:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.638+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638061910 con 0x7f56380c9340 2023-12-19T05:50:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.639+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5620003990 con 0x7f56380c9340 2023-12-19T05:50:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.640+0000 7f562effd640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.641+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5620088830 con 0x7f56380c9340 2023-12-19T05:50:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.641+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f5618071f60 con 0x7f56380c9340 2023-12-19T05:50:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.641+0000 7f563659c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.642+0000 7f563659c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5628001c60 tx=0x7f5628001bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:15.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.645+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5620053d80 con 0x7f56380c9340 2023-12-19T05:50:15.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.843+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f563806f780 con 0x7f56380c9340 2023-12-19T05:50:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.843+0000 7f562effd640 1 -- 172.21.15.49:0/2860916657 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56200573a0 con 0x7f56380c9340 2023-12-19T05:50:15.845 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:50:15.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.846+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 msgr2=0x7f561806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.846+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5628001c60 tx=0x7f5628001bf0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.846+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 msgr2=0x7f56380cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.846+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f562000f5f0 tx=0x7f562000fab0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 shutdown_connections 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f561806a430 0x7f561806c8f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56380cbe00 0x7f56381f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56380c9340 0x7f56380cb8c0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 --2- 172.21.15.49:0/2860916657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5624005180 0x7f56380b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 >> 172.21.15.49:0/2860916657 conn(0x7f56380d3520 msgr2=0x7f5638144070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 shutdown_connections 2023-12-19T05:50:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:15.847+0000 7f563c93c640 1 -- 172.21.15.49:0/2860916657 wait complete. 2023-12-19T05:50:15.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:50:16.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.102+0000 7f73678ad640 1 Processor -- start 2023-12-19T05:50:16.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.102+0000 7f73678ad640 1 -- start start 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.103+0000 7f73678ad640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7360157bf0 0x7f736015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.103+0000 7f73678ad640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73600b0810 0x7f736006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.103+0000 7f73678ad640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736015b740 con 0x7f73600ae110 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.103+0000 7f73678ad640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736006b8c0 con 0x7f73600b0810 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.103+0000 7f73678ad640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600ae640 con 0x7f7360157bf0 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365e4a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73600b0810 0x7f736006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7364e48640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f73600ae110 0x7f73600b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58424/0 (socket says 172.21.15.49:58424) 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7364e48640 1 -- 172.21.15.49:0/1080491550 learned_addr learned my addr 172.21.15.49:0/1080491550 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365649640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7360157bf0 0x7f736015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365e4a640 1 -- 172.21.15.49:0/1080491550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7360157bf0 msgr2=0x7f736015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365e4a640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7360157bf0 0x7f736015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365e4a640 1 -- 172.21.15.49:0/1080491550 >> v1:172.21.15.49:6789/0 conn(0x7f73600ae110 legacy=0x7f73600b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7365e4a640 1 -- 172.21.15.49:0/1080491550 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600ae920 con 0x7f73600b0810 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.104+0000 7f7357fff640 1 -- 172.21.15.49:0/1080491550 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955401139 0 0) 0x7f736015b740 con 0x7f73600ae110 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.105+0000 7f7365e4a640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600b0810 0x7f736006d230 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c768cbc044a99d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f7357fff640 1 -- 172.21.15.49:0/1080491550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735802cc60 con 0x7f73600b0810 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f7357fff640 1 -- 172.21.15.49:0/1080491550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735802cdc0 con 0x7f73600b0810 2023-12-19T05:50:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f7357fff640 1 -- 172.21.15.49:0/1080491550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358034660 con 0x7f73600b0810 2023-12-19T05:50:16.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 -- 172.21.15.49:0/1080491550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600b0810 msgr2=0x7f736006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600b0810 0x7f736006d230 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802beb0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 -- 172.21.15.49:0/1080491550 shutdown_connections 2023-12-19T05:50:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600b0810 0x7f736006d230 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 --2- 172.21.15.49:0/1080491550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7360157bf0 0x7f736015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 -- 172.21.15.49:0/1080491550 >> 172.21.15.49:0/1080491550 conn(0x7f73600cbb70 msgr2=0x7f73600cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 -- 172.21.15.49:0/1080491550 shutdown_connections 2023-12-19T05:50:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.106+0000 7f73678ad640 1 -- 172.21.15.49:0/1080491550 wait complete. 2023-12-19T05:50:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.108+0000 7f73678ad640 1 Processor -- start 2023-12-19T05:50:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.108+0000 7f73678ad640 1 -- start start 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73600b0810 0x7f736006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 0x7f736006d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736015d700 con 0x7f73600ae110 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600700b0 con 0x7f7360157bf0 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.109+0000 7f73678ad640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360070390 con 0x7f73600b0810 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52682/0 (socket says 172.21.15.49:52682) 2023-12-19T05:50:16.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 -- 172.21.15.49:0/404341844 learned_addr learned my addr 172.21.15.49:0/404341844 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365e4a640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 0x7f736006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7364e48640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73600b0810 0x7f736006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 -- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73600b0810 msgr2=0x7f736006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73600b0810 0x7f736006d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 -- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 msgr2=0x7f736006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 0x7f736006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358009a70 con 0x7f73600ae110 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365e4a640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 0x7f736006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.110+0000 7f7365649640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f735c00d5f0 tx=0x7f735c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.111+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0125f0 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.111+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c012750 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.111+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c012b00 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.111+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360070670 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.111+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7360070e70 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.112+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360061910 con 0x7f73600ae110 2023-12-19T05:50:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.113+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f735c012c60 con 0x7f73600ae110 2023-12-19T05:50:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.114+0000 7f7355ffb640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 0x7f734406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.114+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f735c088e00 con 0x7f73600ae110 2023-12-19T05:50:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.114+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f7344071f90 con 0x7f73600ae110 2023-12-19T05:50:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.115+0000 7f7364e48640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 0x7f734406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.116+0000 7f7364e48640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 0x7f734406c920 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7350007fd0 tx=0x7f7350009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.118+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f735c054350 con 0x7f73600ae110 2023-12-19T05:50:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.314+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73600ceaf0 con 0x7f73600ae110 2023-12-19T05:50:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.315+0000 7f7355ffb640 1 -- 172.21.15.49:0/404341844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7f735c057970 con 0x7f73600ae110 2023-12-19T05:50:16.317 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:50:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.317+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 msgr2=0x7f734406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.317+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 0x7f734406c920 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7350007fd0 tx=0x7f7350009040 comp rx=0 tx=0).stop 2023-12-19T05:50:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 msgr2=0x7f736014bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f735c00d5f0 tx=0x7f735c00dab0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 shutdown_connections 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f734406a460 0x7f734406c920 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73600b0810 0x7f736006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7360157bf0 0x7f736006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 --2- 172.21.15.49:0/404341844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73600ae110 0x7f736014bdc0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 >> 172.21.15.49:0/404341844 conn(0x7f73600cbb70 msgr2=0x7f73600b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 shutdown_connections 2023-12-19T05:50:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.318+0000 7f73678ad640 1 -- 172.21.15.49:0/404341844 wait complete. 2023-12-19T05:50:16.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:50:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.569+0000 7f0750b01640 1 Processor -- start 2023-12-19T05:50:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.570+0000 7f0750b01640 1 -- start start 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.571+0000 7f0750b01640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f074c06f490 0x7f074c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.571+0000 7f0750b01640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f074c0d1670 0x7f074c0d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.571+0000 7f0750b01640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06fe30 con 0x7f074c146cd0 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.571+0000 7f0750b01640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c1470b0 con 0x7f074c06f490 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.571+0000 7f0750b01640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c070260 con 0x7f074c0d1670 2023-12-19T05:50:16.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f074c06f490 0x7f074c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f074c06f490 0x7f074c06f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52688/0 (socket says 172.21.15.49:52688) 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 -- 172.21.15.49:0/1291423106 learned_addr learned my addr 172.21.15.49:0/1291423106 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074bfff640 1 --2- 172.21.15.49:0/1291423106 >> v2:172.21.15.115:3300/0 conn(0x7f074c0d1670 0x7f074c0d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 -- 172.21.15.49:0/1291423106 >> v2:172.21.15.115:3300/0 conn(0x7f074c0d1670 msgr2=0x7f074c0d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 --2- 172.21.15.49:0/1291423106 >> v2:172.21.15.115:3300/0 conn(0x7f074c0d1670 0x7f074c0d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.572+0000 7f074affd640 1 -- 172.21.15.49:0/1291423106 >> v1:172.21.15.115:6789/0 conn(0x7f074c146cd0 legacy=0x7f074c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.573+0000 7f074affd640 1 -- 172.21.15.49:0/1291423106 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0b6ea0 con 0x7f074c06f490 2023-12-19T05:50:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.574+0000 7f074affd640 1 --2- 172.21.15.49:0/1291423106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c06f490 0x7f074c06f8f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f074c0b3320 tx=0x7f073402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19623d769c10a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.574+0000 7f074a7fc640 1 -- 172.21.15.49:0/1291423106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734031870 con 0x7f074c06f490 2023-12-19T05:50:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.574+0000 7f074a7fc640 1 -- 172.21.15.49:0/1291423106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340319d0 con 0x7f074c06f490 2023-12-19T05:50:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.574+0000 7f074a7fc640 1 -- 172.21.15.49:0/1291423106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734031d60 con 0x7f074c06f490 2023-12-19T05:50:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 -- 172.21.15.49:0/1291423106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c06f490 msgr2=0x7f074c06f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 --2- 172.21.15.49:0/1291423106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c06f490 0x7f074c06f8f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f074c0b3320 tx=0x7f073402b910 comp rx=0 tx=0).stop 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 -- 172.21.15.49:0/1291423106 shutdown_connections 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 --2- 172.21.15.49:0/1291423106 >> v2:172.21.15.115:3300/0 conn(0x7f074c0d1670 0x7f074c0d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 --2- 172.21.15.49:0/1291423106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c06f490 0x7f074c06f8f0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 -- 172.21.15.49:0/1291423106 >> 172.21.15.49:0/1291423106 conn(0x7f074c0d3200 msgr2=0x7f074c0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 -- 172.21.15.49:0/1291423106 shutdown_connections 2023-12-19T05:50:16.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.575+0000 7f0750b01640 1 -- 172.21.15.49:0/1291423106 wait complete. 2023-12-19T05:50:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.577+0000 7f0750b01640 1 Processor -- start 2023-12-19T05:50:16.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.577+0000 7f0750b01640 1 -- start start 2023-12-19T05:50:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f074c06f490 0x7f074c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c0d1670 0x7f074c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c15b570 con 0x7f074c146cd0 2023-12-19T05:50:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c13dd30 con 0x7f074c0d1670 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.578+0000 7f0750b01640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c13e010 con 0x7f074c06f490 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52692/0 (socket says 172.21.15.49:52692) 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 -- 172.21.15.49:0/3362118913 learned_addr learned my addr 172.21.15.49:0/3362118913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074affd640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c0d1670 0x7f074c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074b7fe640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f074c06f490 0x7f074c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 -- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f074c06f490 msgr2=0x7f074c13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f074c06f490 0x7f074c13edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 -- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c0d1670 msgr2=0x7f074c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c0d1670 0x7f074c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.579+0000 7f074bfff640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340094d0 con 0x7f074c146cd0 2023-12-19T05:50:16.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.580+0000 7f074bfff640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f074400d800 tx=0x7f074400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.581+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400b6c0 con 0x7f074c146cd0 2023-12-19T05:50:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.581+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400b840 con 0x7f074c146cd0 2023-12-19T05:50:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.581+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400bbf0 con 0x7f074c146cd0 2023-12-19T05:50:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.581+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c13e2f0 con 0x7f074c146cd0 2023-12-19T05:50:16.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.582+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c13e8b0 con 0x7f074c146cd0 2023-12-19T05:50:16.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.583+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c1e74c0 con 0x7f074c146cd0 2023-12-19T05:50:16.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.584+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f074400bd50 con 0x7f074c146cd0 2023-12-19T05:50:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.585+0000 7f0743fff640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 0x7f072c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.585+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0744088e20 con 0x7f074c146cd0 2023-12-19T05:50:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.585+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f072c071f60 con 0x7f074c146cd0 2023-12-19T05:50:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.586+0000 7f074b7fe640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 0x7f072c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:16.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.587+0000 7f074b7fe640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 0x7f072c06c8f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f074c13fa20 tx=0x7f073c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.589+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0744054410 con 0x7f074c146cd0 2023-12-19T05:50:16.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.784+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f074c061910 con 0x7f074c146cd0 2023-12-19T05:50:16.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.785+0000 7f0743fff640 1 -- 172.21.15.49:0/3362118913 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0744057a30 con 0x7f074c146cd0 2023-12-19T05:50:16.787 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:50:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 msgr2=0x7f072c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 0x7f072c06c8f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f074c13fa20 tx=0x7f073c009040 comp rx=0 tx=0).stop 2023-12-19T05:50:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 msgr2=0x7f074c1e67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f074400d800 tx=0x7f074400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 shutdown_connections 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f072c06a430 0x7f072c06c8f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f074c146cd0 0x7f074c1e67c0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c0d1670 0x7f074c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 --2- 172.21.15.49:0/3362118913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f074c06f490 0x7f074c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 >> 172.21.15.49:0/3362118913 conn(0x7f074c0d3200 msgr2=0x7f074c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.788+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 shutdown_connections 2023-12-19T05:50:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:16.789+0000 7f0750b01640 1 -- 172.21.15.49:0/3362118913 wait complete. 2023-12-19T05:50:16.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:50:17.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.043+0000 7f762d2d5640 1 Processor -- start 2023-12-19T05:50:17.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.043+0000 7f762d2d5640 1 -- start start 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76281449e0 0x7f76280af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76280b0b50 0x7f762806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f762806b590 0x7f762806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76280afb10 con 0x7f76281449e0 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762806bb30 con 0x7f76280b0b50 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.045+0000 7f762d2d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76280b0070 con 0x7f762806b590 2023-12-19T05:50:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f7626ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76281449e0 0x7f76280af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f7626ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76281449e0 0x7f76280af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52700/0 (socket says 172.21.15.49:52700) 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f7626ffd640 1 -- 172.21.15.49:0/1597222763 learned_addr learned my addr 172.21.15.49:0/1597222763 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f76277fe640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f762806b590 0x7f762806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f761e7fc640 1 --2- 172.21.15.49:0/1597222763 >> v2:172.21.15.115:3300/0 conn(0x7f76280b0b50 0x7f762806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f7626ffd640 1 -- 172.21.15.49:0/1597222763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f762806b590 msgr2=0x7f762806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.046+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f762806b590 0x7f762806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.047+0000 7f7626ffd640 1 -- 172.21.15.49:0/1597222763 >> v2:172.21.15.115:3300/0 conn(0x7f76280b0b50 msgr2=0x7f762806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.047+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1597222763 >> v2:172.21.15.115:3300/0 conn(0x7f76280b0b50 0x7f762806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.047+0000 7f7626ffd640 1 -- 172.21.15.49:0/1597222763 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76280b0350 con 0x7f76281449e0 2023-12-19T05:50:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.048+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76281449e0 0x7f76280af5d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7628071c80 tx=0x7f761802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803adfc9318ada2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.049+0000 7f76267fc640 1 -- 172.21.15.49:0/1597222763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618031870 con 0x7f76281449e0 2023-12-19T05:50:17.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.049+0000 7f76267fc640 1 -- 172.21.15.49:0/1597222763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76180319d0 con 0x7f76281449e0 2023-12-19T05:50:17.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.049+0000 7f76267fc640 1 -- 172.21.15.49:0/1597222763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618031d60 con 0x7f76281449e0 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 -- 172.21.15.49:0/1597222763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76281449e0 msgr2=0x7f76280af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76281449e0 0x7f76280af5d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7628071c80 tx=0x7f761802b910 comp rx=0 tx=0).stop 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 -- 172.21.15.49:0/1597222763 shutdown_connections 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f762806b590 0x7f762806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1597222763 >> v2:172.21.15.115:3300/0 conn(0x7f76280b0b50 0x7f762806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1597222763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76281449e0 0x7f76280af5d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 -- 172.21.15.49:0/1597222763 >> 172.21.15.49:0/1597222763 conn(0x7f76280cbb70 msgr2=0x7f76280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 -- 172.21.15.49:0/1597222763 shutdown_connections 2023-12-19T05:50:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.050+0000 7f762d2d5640 1 -- 172.21.15.49:0/1597222763 wait complete. 2023-12-19T05:50:17.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.052+0000 7f762d2d5640 1 Processor -- start 2023-12-19T05:50:17.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.053+0000 7f762d2d5640 1 -- start start 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76280b0b50 0x7f76281f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76281449e0 0x7f7628159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76280ab9f0 con 0x7f762806b590 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76280aae50 con 0x7f76281449e0 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f762d2d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76280ab0c0 con 0x7f76280b0b50 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f7626ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f7626ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52702/0 (socket says 172.21.15.49:52702) 2023-12-19T05:50:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.054+0000 7f7626ffd640 1 -- 172.21.15.49:0/1390859701 learned_addr learned my addr 172.21.15.49:0/1390859701 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:17.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f761e7fc640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76280b0b50 0x7f76281f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f76277fe640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76281449e0 0x7f7628159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 -- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76280b0b50 msgr2=0x7f76281f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76280b0b50 0x7f76281f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 -- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76281449e0 msgr2=0x7f7628159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76281449e0 0x7f7628159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180094d0 con 0x7f762806b590 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.055+0000 7f7626ffd640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f761802b950 tx=0x7f76180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.056+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761803ac60 con 0x7f762806b590 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.056+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761803adc0 con 0x7f762806b590 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.056+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618044630 con 0x7f762806b590 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.056+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76280ab3a0 con 0x7f762806b590 2023-12-19T05:50:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.056+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76280ca8a0 con 0x7f762806b590 2023-12-19T05:50:17.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.057+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7628061910 con 0x7f762806b590 2023-12-19T05:50:17.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.058+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f761804d450 con 0x7f762806b590 2023-12-19T05:50:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.059+0000 7f761ffff640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 0x7f760806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.059+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f761802d040 con 0x7f762806b590 2023-12-19T05:50:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.059+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f7608071f60 con 0x7f762806b590 2023-12-19T05:50:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.060+0000 7f761e7fc640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 0x7f760806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.061+0000 7f761e7fc640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 0x7f760806c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f762806c8a0 tx=0x7f7610008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.063+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7618035020 con 0x7f762806b590 2023-12-19T05:50:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.269+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76280b26f0 con 0x7f762806b590 2023-12-19T05:50:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.270+0000 7f761ffff640 1 -- 172.21.15.49:0/1390859701 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76180764c0 con 0x7f762806b590 2023-12-19T05:50:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:50:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.272+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 msgr2=0x7f760806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.272+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 0x7f760806c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f762806c8a0 tx=0x7f7610008040 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.272+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 msgr2=0x7f76280ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.272+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f761802b950 tx=0x7f76180046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 shutdown_connections 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f760806a430 0x7f760806c8f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76280b0b50 0x7f76281f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76281449e0 0x7f7628159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 --2- 172.21.15.49:0/1390859701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f762806b590 0x7f76280ca360 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 >> 172.21.15.49:0/1390859701 conn(0x7f76280cbb70 msgr2=0x7f76280ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 shutdown_connections 2023-12-19T05:50:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.273+0000 7f762d2d5640 1 -- 172.21.15.49:0/1390859701 wait complete. 2023-12-19T05:50:17.293 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:50:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:17.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:50:17.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:50:17.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:17.409 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:50:17.460 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:17.460 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:17.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:50:17.526 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:17.526 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:17.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:50:17.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.826+0000 7f7ce6d62640 1 Processor -- start 2023-12-19T05:50:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.826+0000 7f7ce6d62640 1 -- start start 2023-12-19T05:50:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.828+0000 7f7ce6d62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.828+0000 7f7ce6d62640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7ce015f680 0x7f7ce00b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.828+0000 7f7ce6d62640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce015ec30 con 0x7f7ce00cdbf0 2023-12-19T05:50:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.828+0000 7f7ce6d62640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00b2cc0 con 0x7f7ce015f680 2023-12-19T05:50:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.828+0000 7f7ce6d62640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce015e980 con 0x7f7ce015e5a0 2023-12-19T05:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.829+0000 7f7ce5d60640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.829+0000 7f7ce5d60640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:43706/0 (socket says 172.21.15.49:43706) 2023-12-19T05:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.829+0000 7f7ce6561640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7ce00cdbf0 0x7f7ce006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:45054/0 (socket says 172.21.15.49:45054) 2023-12-19T05:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.829+0000 7f7ce6561640 1 -- 172.21.15.49:0/909947493 learned_addr learned my addr 172.21.15.49:0/909947493 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.829+0000 7f7ce555f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7ce015f680 0x7f7ce00b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce4d5e640 1 -- 172.21.15.49:0/909947493 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242806197 0 0) 0x7f7ce015ec30 con 0x7f7ce00cdbf0 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce4d5e640 1 -- 172.21.15.49:0/909947493 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ccc003520 con 0x7f7ce00cdbf0 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce555f640 1 -- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 msgr2=0x7f7ce00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce555f640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce555f640 1 -- 172.21.15.49:0/909947493 >> v1:172.21.15.115:6789/0 conn(0x7f7ce00cdbf0 legacy=0x7f7ce006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce555f640 1 -- 172.21.15.49:0/909947493 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00b2f90 con 0x7f7ce015f680 2023-12-19T05:50:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.830+0000 7f7ce5d60640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:50:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.832+0000 7f7ce555f640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce015f680 0x7f7ce00b2780 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00097a0 tx=0x7f7cd002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90ae8f7925e2c3ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.832+0000 7f7ce4d5e640 1 -- 172.21.15.49:0/909947493 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd002d040 con 0x7f7ce015f680 2023-12-19T05:50:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.832+0000 7f7ce4d5e640 1 -- 172.21.15.49:0/909947493 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd0031810 con 0x7f7ce015f680 2023-12-19T05:50:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.832+0000 7f7ce4d5e640 1 -- 172.21.15.49:0/909947493 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0031b80 con 0x7f7ce015f680 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 -- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce015f680 msgr2=0x7f7ce00b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce015f680 0x7f7ce00b2780 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00097a0 tx=0x7f7cd002b8b0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 -- 172.21.15.49:0/909947493 shutdown_connections 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce015f680 0x7f7ce00b2780 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/909947493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015e5a0 0x7f7ce00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 -- 172.21.15.49:0/909947493 >> 172.21.15.49:0/909947493 conn(0x7f7ce00b0100 msgr2=0x7f7ce00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 -- 172.21.15.49:0/909947493 shutdown_connections 2023-12-19T05:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.833+0000 7f7ce6d62640 1 -- 172.21.15.49:0/909947493 wait complete. 2023-12-19T05:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.836+0000 7f7ce6d62640 1 Processor -- start 2023-12-19T05:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.836+0000 7f7ce6d62640 1 -- start start 2023-12-19T05:50:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce00cdbf0 0x7f7ce00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015f680 0x7f7ce0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce01f6d40 con 0x7f7ce015e5a0 2023-12-19T05:50:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00c4440 con 0x7f7ce00cdbf0 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.837+0000 7f7ce6d62640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce01f69c0 con 0x7f7ce015f680 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52716/0 (socket says 172.21.15.49:52716) 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 -- 172.21.15.49:0/1730782828 learned_addr learned my addr 172.21.15.49:0/1730782828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce5d60640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce00cdbf0 0x7f7ce00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce6561640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015f680 0x7f7ce0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 -- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015f680 msgr2=0x7f7ce0158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015f680 0x7f7ce0158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 -- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce00cdbf0 msgr2=0x7f7ce00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce00cdbf0 0x7f7ce00c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.838+0000 7f7ce555f640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc009400 con 0x7f7ce015e5a0 2023-12-19T05:50:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7ce555f640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f7cd002b8f0 tx=0x7f7cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0003820 con 0x7f7ce015e5a0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd003f070 con 0x7f7ce015e5a0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0003b80 con 0x7f7ce015e5a0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd0009400 con 0x7f7ce015e5a0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.839+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce00c4980 con 0x7f7ce015e5a0 2023-12-19T05:50:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.840+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce0061910 con 0x7f7ce015e5a0 2023-12-19T05:50:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.842+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cd0003ce0 con 0x7f7ce015e5a0 2023-12-19T05:50:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.843+0000 7f7cd67fc640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 0x7f7cc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.843+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cd0041070 con 0x7f7ce015e5a0 2023-12-19T05:50:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.843+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f7cc4071f60 con 0x7f7ce015e5a0 2023-12-19T05:50:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.843+0000 7f7ce5d60640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 0x7f7cc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.844+0000 7f7ce5d60640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 0x7f7cc406c8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009cd0 tx=0x7f7cdc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:17.849+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7cd0076080 con 0x7f7ce015e5a0 2023-12-19T05:50:18.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.080+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ce00ce980 con 0x7f7ce015e5a0 2023-12-19T05:50:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.081+0000 7f7cd67fc640 1 -- 172.21.15.49:0/1730782828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f7cd004a030 con 0x7f7ce015e5a0 2023-12-19T05:50:18.083 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:18.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:50:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.083+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 msgr2=0x7f7cc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.083+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 0x7f7cc406c8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009cd0 tx=0x7f7cdc009190 comp rx=0 tx=0).stop 2023-12-19T05:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 msgr2=0x7f7ce00c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f7cd002b8f0 tx=0x7f7cd00046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 shutdown_connections 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7cc406a430 0x7f7cc406c8f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ce015f680 0x7f7ce0158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ce015e5a0 0x7f7ce00c3f00 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 --2- 172.21.15.49:0/1730782828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce00cdbf0 0x7f7ce00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 >> 172.21.15.49:0/1730782828 conn(0x7f7ce00b0100 msgr2=0x7f7ce015a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 shutdown_connections 2023-12-19T05:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.084+0000 7f7ce6d62640 1 -- 172.21.15.49:0/1730782828 wait complete. 2023-12-19T05:50:18.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:18.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.338+0000 7f9349f6e640 1 Processor -- start 2023-12-19T05:50:18.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.339+0000 7f9349f6e640 1 -- start start 2023-12-19T05:50:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.340+0000 7f9349f6e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9344146e30 0x7f93440b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.340+0000 7f9349f6e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93440b7ea0 0x7f93440d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.340+0000 7f9349f6e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440d12d0 con 0x7f93440d0a90 2023-12-19T05:50:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.340+0000 7f9349f6e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9344147210 con 0x7f93440b7ea0 2023-12-19T05:50:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.340+0000 7f9349f6e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440b8330 con 0x7f9344146e30 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f9343fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93440b7ea0 0x7f93440d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f934976d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f93440d0a90 0x7f934406f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58426/0 (socket says 172.21.15.49:58426) 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f934976d640 1 -- 172.21.15.49:0/3257399992 learned_addr learned my addr 172.21.15.49:0/3257399992 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f9348f6c640 1 --2- 172.21.15.49:0/3257399992 >> v2:172.21.15.115:3300/0 conn(0x7f9344146e30 0x7f93440b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f93437fe640 1 -- 172.21.15.49:0/3257399992 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313323961 0 0) 0x7f93440d12d0 con 0x7f93440d0a90 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.341+0000 7f93437fe640 1 -- 172.21.15.49:0/3257399992 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9330003520 con 0x7f93440d0a90 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.342+0000 7f9343fff640 1 -- 172.21.15.49:0/3257399992 >> v2:172.21.15.115:3300/0 conn(0x7f9344146e30 msgr2=0x7f93440b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.342+0000 7f9343fff640 1 --2- 172.21.15.49:0/3257399992 >> v2:172.21.15.115:3300/0 conn(0x7f9344146e30 0x7f93440b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.342+0000 7f9343fff640 1 -- 172.21.15.49:0/3257399992 >> v1:172.21.15.49:6789/0 conn(0x7f93440d0a90 legacy=0x7f934406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.342+0000 7f9343fff640 1 -- 172.21.15.49:0/3257399992 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440d15b0 con 0x7f93440b7ea0 2023-12-19T05:50:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.343+0000 7f9343fff640 1 --2- 172.21.15.49:0/3257399992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440b7ea0 0x7f93440d0550 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f93440b85a0 tx=0x7f932c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e092f8f01fe9edb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.343+0000 7f93437fe640 1 -- 172.21.15.49:0/3257399992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c02e070 con 0x7f93440b7ea0 2023-12-19T05:50:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.343+0000 7f93437fe640 1 -- 172.21.15.49:0/3257399992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c0315a0 con 0x7f93440b7ea0 2023-12-19T05:50:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.343+0000 7f93437fe640 1 -- 172.21.15.49:0/3257399992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c031930 con 0x7f93440b7ea0 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 -- 172.21.15.49:0/3257399992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440b7ea0 msgr2=0x7f93440d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 --2- 172.21.15.49:0/3257399992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440b7ea0 0x7f93440d0550 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f93440b85a0 tx=0x7f932c02b840 comp rx=0 tx=0).stop 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 -- 172.21.15.49:0/3257399992 shutdown_connections 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 --2- 172.21.15.49:0/3257399992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440b7ea0 0x7f93440d0550 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 --2- 172.21.15.49:0/3257399992 >> v2:172.21.15.115:3300/0 conn(0x7f9344146e30 0x7f93440b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 -- 172.21.15.49:0/3257399992 >> 172.21.15.49:0/3257399992 conn(0x7f93440b2990 msgr2=0x7f93440b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 -- 172.21.15.49:0/3257399992 shutdown_connections 2023-12-19T05:50:18.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.344+0000 7f9349f6e640 1 -- 172.21.15.49:0/3257399992 wait complete. 2023-12-19T05:50:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.346+0000 7f9349f6e640 1 Processor -- start 2023-12-19T05:50:18.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.346+0000 7f9349f6e640 1 -- start start 2023-12-19T05:50:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93440b7ea0 0x7f93441f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9344146e30 0x7f93441e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344141bf0 con 0x7f93440d0a90 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93441f6280 con 0x7f9344146e30 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9349f6e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440ca780 con 0x7f93440b7ea0 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9343fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9343fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52722/0 (socket says 172.21.15.49:52722) 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.347+0000 7f9343fff640 1 -- 172.21.15.49:0/968165889 learned_addr learned my addr 172.21.15.49:0/968165889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9348f6c640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93440b7ea0 0x7f93441f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f934976d640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9344146e30 0x7f93441e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 -- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93440b7ea0 msgr2=0x7f93441f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93440b7ea0 0x7f93441f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 -- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9344146e30 msgr2=0x7f93441e8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9344146e30 0x7f93441e8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c009400 con 0x7f93440d0a90 2023-12-19T05:50:18.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.348+0000 7f9343fff640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f932c009890 tx=0x7f932c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.349+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c032630 con 0x7f93440d0a90 2023-12-19T05:50:18.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.349+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c032790 con 0x7f93440d0a90 2023-12-19T05:50:18.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.349+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c032b40 con 0x7f93440d0a90 2023-12-19T05:50:18.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.349+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93440caa60 con 0x7f93440d0a90 2023-12-19T05:50:18.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.349+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93441f6790 con 0x7f93440d0a90 2023-12-19T05:50:18.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.350+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93440cabf0 con 0x7f93440d0a90 2023-12-19T05:50:18.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.351+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f932c03b3f0 con 0x7f93440d0a90 2023-12-19T05:50:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.352+0000 7f93417fa640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 0x7f932406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.352+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f932c0aa930 con 0x7f93440d0a90 2023-12-19T05:50:18.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.352+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f9324071f90 con 0x7f93440d0a90 2023-12-19T05:50:18.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.352+0000 7f9348f6c640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 0x7f932406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.354+0000 7f9348f6c640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 0x7f932406c920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9334009a30 tx=0x7f9334008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.357+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f932c075f00 con 0x7f93440d0a90 2023-12-19T05:50:18.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.551+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9344061910 con 0x7f93440d0a90 2023-12-19T05:50:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.555+0000 7f93417fa640 1 -- 172.21.15.49:0/968165889 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f932c079520 con 0x7f93440d0a90 2023-12-19T05:50:18.556 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:18.557 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":163,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:49:30.402626+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 msgr2=0x7f932406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 0x7f932406c920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9334009a30 tx=0x7f9334008040 comp rx=0 tx=0).stop 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 msgr2=0x7f93441e4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f932c009890 tx=0x7f932c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 shutdown_connections 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f932406a460 0x7f932406c920 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9344146e30 0x7f93441e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93440d0a90 0x7f93441e4b40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 --2- 172.21.15.49:0/968165889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93440b7ea0 0x7f93441f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.557+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 >> 172.21.15.49:0/968165889 conn(0x7f93440b2990 msgr2=0x7f934406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.558+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 shutdown_connections 2023-12-19T05:50:18.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.558+0000 7f9349f6e640 1 -- 172.21.15.49:0/968165889 wait complete. 2023-12-19T05:50:18.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:47:55.166539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:47:56.215056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:50:18.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:50:18.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.807+0000 7fcead1f0640 1 Processor -- start 2023-12-19T05:50:18.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.807+0000 7fcead1f0640 1 -- start start 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fcead1f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea80b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fcead1f0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcea80b1ec0 0x7fcea815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fcead1f0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea815ef10 con 0x7fcea80ceea0 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fcead1f0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80b2320 con 0x7fcea80b1ec0 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fcead1f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80b2e40 con 0x7fcea815b1d0 2023-12-19T05:50:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.809+0000 7fce9ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcea80b1ec0 0x7fcea815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcea80b1ec0 0x7fcea815f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52732/0 (socket says 172.21.15.49:52732) 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 -- 172.21.15.49:0/2703466902 learned_addr learned my addr 172.21.15.49:0/2703466902 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fcea759e640 1 --1- 172.21.15.49:0/2703466902 >> v1:172.21.15.49:6789/0 conn(0x7fcea80ceea0 0x7fcea806c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58438/0 (socket says 172.21.15.49:58438) 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fcea6d9d640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea80b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 -- 172.21.15.49:0/2703466902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 msgr2=0x7fcea80b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea80b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 -- 172.21.15.49:0/2703466902 >> v1:172.21.15.49:6789/0 conn(0x7fcea80ceea0 legacy=0x7fcea806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fce9ffff640 1 -- 172.21.15.49:0/2703466902 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80b3120 con 0x7fcea80b1ec0 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.810+0000 7fcea659c640 1 -- 172.21.15.49:0/2703466902 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285695249 0 0) 0x7fcea815ef10 con 0x7fcea80ceea0 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.811+0000 7fce9ffff640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80b1ec0 0x7fcea815f6d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fce90009870 tx=0x7fce9002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b021eefc471ccac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcea659c640 1 -- 172.21.15.49:0/2703466902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90030840 con 0x7fcea80b1ec0 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcea659c640 1 -- 172.21.15.49:0/2703466902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce900309a0 con 0x7fcea80b1ec0 2023-12-19T05:50:18.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcea659c640 1 -- 172.21.15.49:0/2703466902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90030d30 con 0x7fcea80b1ec0 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcead1f0640 1 -- 172.21.15.49:0/2703466902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80b1ec0 msgr2=0x7fcea815f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80b1ec0 0x7fcea815f6d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fce90009870 tx=0x7fce9002b980 comp rx=0 tx=0).stop 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.812+0000 7fcead1f0640 1 -- 172.21.15.49:0/2703466902 shutdown_connections 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.813+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80b1ec0 0x7fcea815f6d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.813+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2703466902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea80b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.813+0000 7fcead1f0640 1 -- 172.21.15.49:0/2703466902 >> 172.21.15.49:0/2703466902 conn(0x7fcea8073150 msgr2=0x7fcea80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.813+0000 7fcead1f0640 1 -- 172.21.15.49:0/2703466902 shutdown_connections 2023-12-19T05:50:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.813+0000 7fcead1f0640 1 -- 172.21.15.49:0/2703466902 wait complete. 2023-12-19T05:50:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.814+0000 7fcead1f0640 1 Processor -- start 2023-12-19T05:50:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.815+0000 7fcead1f0640 1 -- start start 2023-12-19T05:50:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.815+0000 7fcead1f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 0x7fcea815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.815+0000 7fcead1f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcead1f0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcead1f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8146aa0 con 0x7fcea80ceea0 2023-12-19T05:50:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcead1f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea815c1b0 con 0x7fcea80b1ec0 2023-12-19T05:50:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcead1f0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80aebd0 con 0x7fcea815b1d0 2023-12-19T05:50:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52736/0 (socket says 172.21.15.49:52736) 2023-12-19T05:50:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 -- 172.21.15.49:0/2041921539 learned_addr learned my addr 172.21.15.49:0/2041921539 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcea759e640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcea6d9d640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 0x7fcea815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 -- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 msgr2=0x7fcea8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 -- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 msgr2=0x7fcea815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 0x7fcea815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fce9ffff640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900094d0 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcea6d9d640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 0x7fcea815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.816+0000 7fcea759e640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fce9ffff640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce90000c00 tx=0x7fce90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9003e040 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce90039c90 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90004030 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea815bed0 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.817+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea80ae860 con 0x7fcea80ceea0 2023-12-19T05:50:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.818+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea80ae9f0 con 0x7fcea80ceea0 2023-12-19T05:50:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.819+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce90004190 con 0x7fcea80ceea0 2023-12-19T05:50:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.820+0000 7fce9f7fe640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 0x7fce8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.820+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce900aad80 con 0x7fcea80ceea0 2023-12-19T05:50:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.821+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fce88071f90 con 0x7fcea80ceea0 2023-12-19T05:50:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.821+0000 7fcea6d9d640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 0x7fce8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.822+0000 7fcea6d9d640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 0x7fce8806c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fce98006fd0 tx=0x7fce98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:18.825+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce90076360 con 0x7fcea80ceea0 2023-12-19T05:50:19.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.017+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcea80ae3e0 con 0x7fcea80ceea0 2023-12-19T05:50:19.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.018+0000 7fce9f7fe640 1 -- 172.21.15.49:0/2041921539 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcea80ae3e0 con 0x7fcea80ceea0 2023-12-19T05:50:19.020 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:50:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 msgr2=0x7fce8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 0x7fce8806c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fce98006fd0 tx=0x7fce98008040 comp rx=0 tx=0).stop 2023-12-19T05:50:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 msgr2=0x7fcea8146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce90000c00 tx=0x7fce90004730 comp rx=0 tx=0).stop 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 shutdown_connections 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8806a460 0x7fce8806c920 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcea815b1d0 0x7fcea8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80ceea0 0x7fcea8146560 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 --2- 172.21.15.49:0/2041921539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea80b1ec0 0x7fcea815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.020+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 >> 172.21.15.49:0/2041921539 conn(0x7fcea8073150 msgr2=0x7fcea806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.021+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 shutdown_connections 2023-12-19T05:50:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.021+0000 7fcead1f0640 1 -- 172.21.15.49:0/2041921539 wait complete. 2023-12-19T05:50:19.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:50:19.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.272+0000 7f70b5355640 1 Processor -- start 2023-12-19T05:50:19.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.272+0000 7f70b5355640 1 -- start start 2023-12-19T05:50:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70b5355640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70b006c6b0 0x7f70b0166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70b5355640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b006bb30 con 0x7f70b01449e0 2023-12-19T05:50:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70b5355640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00b0070 con 0x7f70b00b0b50 2023-12-19T05:50:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70b5355640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b00b0350 con 0x7f70b006c6b0 2023-12-19T05:50:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70aeffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f70b01449e0 0x7f70b00af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58454/0 (socket says 172.21.15.49:58454) 2023-12-19T05:50:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70aeffd640 1 -- 172.21.15.49:0/2084714553 learned_addr learned my addr 172.21.15.49:0/2084714553 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.274+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320946338 0 0) 0x7f70b006bb30 con 0x7f70b01449e0 2023-12-19T05:50:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f709c003520 con 0x7f70b01449e0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70af7fe640 1 --2- 172.21.15.49:0/2084714553 >> v2:172.21.15.115:3300/0 conn(0x7f70b006c6b0 0x7f70b0166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566491759 0 0) 0x7f709c003520 con 0x7f70b01449e0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 >> v2:172.21.15.115:3300/0 conn(0x7f70b006c6b0 msgr2=0x7f70b0166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 --2- 172.21.15.49:0/2084714553 >> v2:172.21.15.115:3300/0 conn(0x7f70b006c6b0 0x7f70b0166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 >> v1:172.21.15.115:6789/0 conn(0x7f70b00b0b50 legacy=0x7f70b006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00b0630 con 0x7f70b01449e0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f70a0001670 con 0x7f70b01449e0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 >> v1:172.21.15.49:6789/0 conn(0x7f70b01449e0 legacy=0x7f70b00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f709c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f709c0047c0 0x7f709c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f709c0052a0 0x7f709c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00b0350 con 0x7f709c003a30 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c00c1a0 con 0x7f709c0047c0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c00c360 con 0x7f709c0052a0 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70af7fe640 1 --2- 172.21.15.49:0/2084714553 >> v2:172.21.15.115:3300/0 conn(0x7f70b006c6b0 0x7f70b0166200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:50:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.275+0000 7f70aeffd640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f709c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70ae7fc640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f709c0047c0 0x7f709c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70aeffd640 1 -- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f709c0052a0 msgr2=0x7f709c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70aeffd640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f709c0052a0 0x7f709c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70aeffd640 1 -- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f709c0047c0 msgr2=0x7f709c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70aeffd640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f709c0047c0 0x7f709c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70aeffd640 1 -- 172.21.15.49:0/2084714553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c003520 con 0x7f709c003a30 2023-12-19T05:50:19.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.276+0000 7f70af7fe640 1 -- 172.21.15.49:0/2084714553 reap_dead start 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.277+0000 7f70aeffd640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f709c003e50 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001eb0 tx=0x7f709c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05bd680f952c661 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.277+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005ad0 con 0x7f709c003a30 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0005c30 con 0x7f709c003a30 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70adffb640 1 -- 172.21.15.49:0/2084714553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a002ca00 con 0x7f709c003a30 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 -- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 msgr2=0x7f709c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f709c003e50 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001eb0 tx=0x7f709c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 -- 172.21.15.49:0/2084714553 shutdown_connections 2023-12-19T05:50:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 --2- 172.21.15.49:0/2084714553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f709c003e50 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 -- 172.21.15.49:0/2084714553 >> 172.21.15.49:0/2084714553 conn(0x7f70b00cbb70 msgr2=0x7f70b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 -- 172.21.15.49:0/2084714553 shutdown_connections 2023-12-19T05:50:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.278+0000 7f70b5355640 1 -- 172.21.15.49:0/2084714553 wait complete. 2023-12-19T05:50:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.280+0000 7f70b5355640 1 Processor -- start 2023-12-19T05:50:19.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.280+0000 7f70b5355640 1 -- start start 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 0x7f70b01f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b01f6450 0x7f70b0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01f6e90 con 0x7f709c003a30 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0159540 con 0x7f70b00cd620 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.281+0000 7f70b5355640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01f68d0 con 0x7f70b01f6450 2023-12-19T05:50:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52754/0 (socket says 172.21.15.49:52754) 2023-12-19T05:50:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 -- 172.21.15.49:0/413564828 learned_addr learned my addr 172.21.15.49:0/413564828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70af7fe640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b01f6450 0x7f70b0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70ae7fc640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 0x7f70b01f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 -- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b01f6450 msgr2=0x7f70b0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b01f6450 0x7f70b0159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 -- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 msgr2=0x7f70b01f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 0x7f70b01f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70aeffd640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b01f6bb0 con 0x7f709c003a30 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.282+0000 7f70ae7fc640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 0x7f70b01f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:19.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70aeffd640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000c00 tx=0x7f70a002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a003c040 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a002cd30 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a002cea0 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b00cce20 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.283+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00cdaa0 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.284+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b00ccc80 con 0x7f709c003a30 2023-12-19T05:50:19.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.285+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70a0032070 con 0x7f709c003a30 2023-12-19T05:50:19.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.286+0000 7f70a77fe640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 0x7f709006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.287+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a00a9d90 con 0x7f709c003a30 2023-12-19T05:50:19.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.287+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f7090071f60 con 0x7f709c003a30 2023-12-19T05:50:19.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.287+0000 7f70ae7fc640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 0x7f709006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.288+0000 7f70ae7fc640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 0x7f709006c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.291+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70b00ccc80 con 0x7f709c003a30 2023-12-19T05:50:19.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.488+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70b00ccc80 con 0x7f709c003a30 2023-12-19T05:50:19.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.489+0000 7f70a77fe640 1 -- 172.21.15.49:0/413564828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70b00ccc80 con 0x7f709c003a30 2023-12-19T05:50:19.490 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:50:19.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 msgr2=0x7f709006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 0x7f709006c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098009040 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 msgr2=0x7f70b0159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000c00 tx=0x7f70a002e070 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 shutdown_connections 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f709006a430 0x7f709006c8f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70b01f6450 0x7f70b0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70b00cd620 0x7f70b01f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.491+0000 7f70b5355640 1 --2- 172.21.15.49:0/413564828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f709c003a30 0x7f70b0159000 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.492+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 >> 172.21.15.49:0/413564828 conn(0x7f70b00cbb70 msgr2=0x7f70b00cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.492+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 shutdown_connections 2023-12-19T05:50:19.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.492+0000 7f70b5355640 1 -- 172.21.15.49:0/413564828 wait complete. 2023-12-19T05:50:19.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:50:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.752+0000 7f97ea5fd640 1 Processor -- start 2023-12-19T05:50:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.753+0000 7f97ea5fd640 1 -- start start 2023-12-19T05:50:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.754+0000 7f97ea5fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 0x7f97e40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.754+0000 7f97ea5fd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e4070260 con 0x7f97e40b6890 2023-12-19T05:50:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.754+0000 7f97ea5fd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e40b6ea0 con 0x7f97e406fba0 2023-12-19T05:50:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.754+0000 7f97ea5fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41470b0 con 0x7f97e4146cd0 2023-12-19T05:50:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.755+0000 7f97e8dfa640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97e40b6890 0x7f97e406f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58464/0 (socket says 172.21.15.49:58464) 2023-12-19T05:50:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.755+0000 7f97e8dfa640 1 -- 172.21.15.49:0/798243978 learned_addr learned my addr 172.21.15.49:0/798243978 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.755+0000 7f97e95fb640 1 --2- 172.21.15.49:0/798243978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 0x7f97e40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.755+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279894659 0 0) 0x7f97e4070260 con 0x7f97e40b6890 2023-12-19T05:50:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.755+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97cc003520 con 0x7f97e40b6890 2023-12-19T05:50:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.756+0000 7f97e95fb640 1 -- 172.21.15.49:0/798243978 >> v1:172.21.15.115:6789/0 conn(0x7f97e406fba0 legacy=0x7f97e40d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.756+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716199707 0 0) 0x7f97cc003520 con 0x7f97e40b6890 2023-12-19T05:50:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.756+0000 7f97e95fb640 1 -- 172.21.15.49:0/798243978 >> v1:172.21.15.49:6789/0 conn(0x7f97e40b6890 legacy=0x7f97e406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.756+0000 7f97e95fb640 1 -- 172.21.15.49:0/798243978 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e40b7180 con 0x7f97e4146cd0 2023-12-19T05:50:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.757+0000 7f97e95fb640 1 --2- 172.21.15.49:0/798243978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 0x7f97e40b6350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009dc0 tx=0x7f97d402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e84ed5637ff79 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.758+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8001670 con 0x7f97e4146cd0 2023-12-19T05:50:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.758+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d402c880 con 0x7f97e4146cd0 2023-12-19T05:50:19.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.758+0000 7f97e3fff640 1 -- 172.21.15.49:0/798243978 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d402cc10 con 0x7f97e4146cd0 2023-12-19T05:50:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.758+0000 7f97ea5fd640 1 -- 172.21.15.49:0/798243978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 msgr2=0x7f97e40b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.758+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/798243978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 0x7f97e40b6350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009dc0 tx=0x7f97d402bd50 comp rx=0 tx=0).stop 2023-12-19T05:50:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.759+0000 7f97ea5fd640 1 -- 172.21.15.49:0/798243978 shutdown_connections 2023-12-19T05:50:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.759+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/798243978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e4146cd0 0x7f97e40b6350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.759+0000 7f97ea5fd640 1 -- 172.21.15.49:0/798243978 >> 172.21.15.49:0/798243978 conn(0x7f97e40d3200 msgr2=0x7f97e40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.759+0000 7f97ea5fd640 1 -- 172.21.15.49:0/798243978 shutdown_connections 2023-12-19T05:50:19.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.759+0000 7f97ea5fd640 1 -- 172.21.15.49:0/798243978 wait complete. 2023-12-19T05:50:19.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.760+0000 7f97ea5fd640 1 Processor -- start 2023-12-19T05:50:19.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.761+0000 7f97ea5fd640 1 -- start start 2023-12-19T05:50:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.761+0000 7f97ea5fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97e406fba0 0x7f97e41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.761+0000 7f97ea5fd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e40b6890 0x7f97e4131430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97ea5fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97ea5fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41593b0 con 0x7f97e4146cd0 2023-12-19T05:50:19.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97ea5fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e413d270 con 0x7f97e406fba0 2023-12-19T05:50:19.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97ea5fd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4158730 con 0x7f97e40b6890 2023-12-19T05:50:19.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52764/0 (socket says 172.21.15.49:52764) 2023-12-19T05:50:19.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 -- 172.21.15.49:0/3598590690 learned_addr learned my addr 172.21.15.49:0/3598590690 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e8dfa640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e40b6890 0x7f97e4131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 -- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e40b6890 msgr2=0x7f97e4131430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e40b6890 0x7f97e4131430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 -- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97e406fba0 msgr2=0x7f97e41569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97e406fba0 0x7f97e41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.762+0000 7f97e9dfc640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009a70 con 0x7f97e4146cd0 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97e9dfc640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f97dc001eb0 tx=0x7f97dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0052d0 con 0x7f97e4146cd0 2023-12-19T05:50:19.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc005430 con 0x7f97e4146cd0 2023-12-19T05:50:19.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4158a10 con 0x7f97e4146cd0 2023-12-19T05:50:19.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc003810 con 0x7f97e4146cd0 2023-12-19T05:50:19.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.763+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e4158fd0 con 0x7f97e4146cd0 2023-12-19T05:50:19.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.764+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4061910 con 0x7f97e4146cd0 2023-12-19T05:50:19.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.765+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97dc003970 con 0x7f97e4146cd0 2023-12-19T05:50:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.766+0000 7f97e1ffb640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 0x7f97d006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.766+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97dc087fe0 con 0x7f97e4146cd0 2023-12-19T05:50:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.767+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f97d0071f30 con 0x7f97e4146cd0 2023-12-19T05:50:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.767+0000 7f97e95fb640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 0x7f97d006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:19.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.768+0000 7f97e95fb640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 0x7f97d006c8c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f97d4036000 tx=0x7f97d402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.770+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f97dc0534a0 con 0x7f97e4146cd0 2023-12-19T05:50:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.963+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97e41594f0 con 0x7f97e4146cd0 2023-12-19T05:50:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.964+0000 7f97e1ffb640 1 -- 172.21.15.49:0/3598590690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97e41594f0 con 0x7f97e4146cd0 2023-12-19T05:50:19.966 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:50:19.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.967+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 msgr2=0x7f97d006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.967+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 0x7f97d006c8c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f97d4036000 tx=0x7f97d402e000 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.967+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 msgr2=0x7f97e41597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.967+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f97dc001eb0 tx=0x7f97dc00c890 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 shutdown_connections 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f97d006a400 0x7f97d006c8c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97e40b6890 0x7f97e4131430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e4146cd0 0x7f97e41597d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 --2- 172.21.15.49:0/3598590690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97e406fba0 0x7f97e41569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 >> 172.21.15.49:0/3598590690 conn(0x7f97e40d3200 msgr2=0x7f97e40b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 shutdown_connections 2023-12-19T05:50:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:19.968+0000 7f97ea5fd640 1 -- 172.21.15.49:0/3598590690 wait complete. 2023-12-19T05:50:19.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.204+0000 7f53c0c79640 1 Processor -- start 2023-12-19T05:50:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.204+0000 7f53c0c79640 1 -- start start 2023-12-19T05:50:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53c0c79640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53bc15b1e0 0x7f53bc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53c0c79640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc06b520 con 0x7f53bc159f80 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53c0c79640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc0b2b20 con 0x7f53bc15a8a0 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53c0c79640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc0b2fb0 con 0x7f53bc15b1e0 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53bb7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53bc159f80 0x7f53bc06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58470/0 (socket says 172.21.15.49:58470) 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53bb7fe640 1 -- 172.21.15.49:0/798159905 learned_addr learned my addr 172.21.15.49:0/798159905 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.206+0000 7f53baffd640 1 --2- 172.21.15.49:0/798159905 >> v2:172.21.15.49:3300/0 conn(0x7f53bc15b1e0 0x7f53bc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.207+0000 7f53ba7fc640 1 -- 172.21.15.49:0/798159905 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902750271 0 0) 0x7f53bc06b520 con 0x7f53bc159f80 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.207+0000 7f53ba7fc640 1 -- 172.21.15.49:0/798159905 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a4003520 con 0x7f53bc159f80 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.207+0000 7f53baffd640 1 -- 172.21.15.49:0/798159905 >> v1:172.21.15.115:6789/0 conn(0x7f53bc15a8a0 legacy=0x7f53bc15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.207+0000 7f53baffd640 1 -- 172.21.15.49:0/798159905 >> v1:172.21.15.49:6789/0 conn(0x7f53bc159f80 legacy=0x7f53bc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.207+0000 7f53baffd640 1 -- 172.21.15.49:0/798159905 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc0b1f10 con 0x7f53bc15b1e0 2023-12-19T05:50:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.208+0000 7f53baffd640 1 --2- 172.21.15.49:0/798159905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc15a360 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f53b00097a0 tx=0x7f53b002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2505550aee0fdf74 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53ba7fc640 1 -- 172.21.15.49:0/798159905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0030610 con 0x7f53bc15b1e0 2023-12-19T05:50:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53ba7fc640 1 -- 172.21.15.49:0/798159905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b0030770 con 0x7f53bc15b1e0 2023-12-19T05:50:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53ba7fc640 1 -- 172.21.15.49:0/798159905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0030ae0 con 0x7f53bc15b1e0 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 -- 172.21.15.49:0/798159905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 msgr2=0x7f53bc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 --2- 172.21.15.49:0/798159905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc15a360 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f53b00097a0 tx=0x7f53b002b960 comp rx=0 tx=0).stop 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 -- 172.21.15.49:0/798159905 shutdown_connections 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 --2- 172.21.15.49:0/798159905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc15a360 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 -- 172.21.15.49:0/798159905 >> 172.21.15.49:0/798159905 conn(0x7f53bc0b0100 msgr2=0x7f53bc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.209+0000 7f53c0c79640 1 -- 172.21.15.49:0/798159905 shutdown_connections 2023-12-19T05:50:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.210+0000 7f53c0c79640 1 -- 172.21.15.49:0/798159905 wait complete. 2023-12-19T05:50:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.211+0000 7f53c0c79640 1 Processor -- start 2023-12-19T05:50:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.212+0000 7f53c0c79640 1 -- start start 2023-12-19T05:50:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.212+0000 7f53c0c79640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 0x7f53bc143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53c0c79640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 0x7f53bc1e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53c0c79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53c0c79640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc1e7000 con 0x7f53bc15b1e0 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53c0c79640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc1440b0 con 0x7f53bc15a8a0 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53c0c79640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc1e6380 con 0x7f53bc159f80 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52794/0 (socket says 172.21.15.49:52794) 2023-12-19T05:50:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 -- 172.21.15.49:0/2014489012 learned_addr learned my addr 172.21.15.49:0/2014489012 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bb7fe640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 0x7f53bc143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53baffd640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 0x7f53bc1e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 -- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 msgr2=0x7f53bc143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 0x7f53bc143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 -- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 msgr2=0x7f53bc1e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 0x7f53bc1e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bbfff640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0009400 con 0x7f53bc15b1e0 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53bb7fe640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 0x7f53bc143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.213+0000 7f53baffd640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 0x7f53bc1e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53bbfff640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c780 tx=0x7f53b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4004b60 con 0x7f53bc15b1e0 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400ce90 con 0x7f53bc15b1e0 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400a850 con 0x7f53bc15b1e0 2023-12-19T05:50:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc1e6660 con 0x7f53bc15b1e0 2023-12-19T05:50:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.214+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc1e6c20 con 0x7f53bc15b1e0 2023-12-19T05:50:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.216+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc1e7140 con 0x7f53bc15b1e0 2023-12-19T05:50:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.216+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53b400a9b0 con 0x7f53bc15b1e0 2023-12-19T05:50:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.217+0000 7f53a3fff640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 0x7f53a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.217+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b4088b00 con 0x7f53bc15b1e0 2023-12-19T05:50:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.218+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f53a8071f60 con 0x7f53bc15b1e0 2023-12-19T05:50:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.218+0000 7f53bb7fe640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 0x7f53a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.219+0000 7f53bb7fe640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 0x7f53a806c8f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005880 tx=0x7f53ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.221+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f53bc1e7140 con 0x7f53bc15b1e0 2023-12-19T05:50:20.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.426+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(164..164 src has 1..164) v4 ==== 679+0+0 (secure 0 0 0) 0x7f53b4058410 con 0x7f53bc15b1e0 2023-12-19T05:50:20.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.426+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=165}) v3 -- 0x7f53a8072af0 con 0x7f53bc15b1e0 2023-12-19T05:50:20.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.455+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53bc1e6de0 con 0x7f53bc15b1e0 2023-12-19T05:50:20.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.456+0000 7f53a3fff640 1 -- 172.21.15.49:0/2014489012 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f53b408ae60 con 0x7f53bc15b1e0 2023-12-19T05:50:20.458 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:50:20.458 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.458+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 msgr2=0x7f53a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.458+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 0x7f53a806c8f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005880 tx=0x7f53ac009040 comp rx=0 tx=0).stop 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.458+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 msgr2=0x7f53bc1e5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.458+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c780 tx=0x7f53b400cc40 comp rx=0 tx=0).stop 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 shutdown_connections 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f53a806a430 0x7f53a806c8f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53bc15b1e0 0x7f53bc1e5d70 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53bc15a8a0 0x7f53bc1e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 --2- 172.21.15.49:0/2014489012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53bc159f80 0x7f53bc143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 >> 172.21.15.49:0/2014489012 conn(0x7f53bc0b0100 msgr2=0x7f53bc159250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 shutdown_connections 2023-12-19T05:50:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.459+0000 7f53c0c79640 1 -- 172.21.15.49:0/2014489012 wait complete. 2023-12-19T05:50:20.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.714+0000 7f9090b88640 1 Processor -- start 2023-12-19T05:50:20.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.714+0000 7f9090b88640 1 -- start start 2023-12-19T05:50:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f9090b88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c146e30 0x7f908c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f9090b88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f908c0d0c60 0x7f908c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f9090b88640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c0b8300 con 0x7f908c0b7ea0 2023-12-19T05:50:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f9090b88640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c147210 con 0x7f908c0d0c60 2023-12-19T05:50:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f9090b88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0d10d0 con 0x7f908c146e30 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f908bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f908c0d0c60 0x7f908c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f908bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f908c0d0c60 0x7f908c15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52796/0 (socket says 172.21.15.49:52796) 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.716+0000 7f908bfff640 1 -- 172.21.15.49:0/1269348945 learned_addr learned my addr 172.21.15.49:0/1269348945 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908b7fe640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c146e30 0x7f908c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908bfff640 1 -- 172.21.15.49:0/1269348945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c146e30 msgr2=0x7f908c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908bfff640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c146e30 0x7f908c0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908bfff640 1 -- 172.21.15.49:0/1269348945 >> v1:172.21.15.49:6789/0 conn(0x7f908c0b7ea0 legacy=0x7f908c0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908a7fc640 1 -- 172.21.15.49:0/1269348945 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205988906 0 0) 0x7f908c0b8300 con 0x7f908c0b7ea0 2023-12-19T05:50:20.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.717+0000 7f908bfff640 1 -- 172.21.15.49:0/1269348945 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0d12d0 con 0x7f908c0d0c60 2023-12-19T05:50:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.718+0000 7f908bfff640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c0d0c60 0x7f908c15d870 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e50 tx=0x7f908402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75464f6060f313ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f908a7fc640 1 -- 172.21.15.49:0/1269348945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908402ca80 con 0x7f908c0d0c60 2023-12-19T05:50:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f908a7fc640 1 -- 172.21.15.49:0/1269348945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908402cbe0 con 0x7f908c0d0c60 2023-12-19T05:50:20.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f908a7fc640 1 -- 172.21.15.49:0/1269348945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840343f0 con 0x7f908c0d0c60 2023-12-19T05:50:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 -- 172.21.15.49:0/1269348945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c0d0c60 msgr2=0x7f908c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c0d0c60 0x7f908c15d870 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e50 tx=0x7f908402bee0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 -- 172.21.15.49:0/1269348945 shutdown_connections 2023-12-19T05:50:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c0d0c60 0x7f908c15d870 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 --2- 172.21.15.49:0/1269348945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c146e30 0x7f908c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 -- 172.21.15.49:0/1269348945 >> 172.21.15.49:0/1269348945 conn(0x7f908c0b2990 msgr2=0x7f908c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:20.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 -- 172.21.15.49:0/1269348945 shutdown_connections 2023-12-19T05:50:20.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.719+0000 7f9090b88640 1 -- 172.21.15.49:0/1269348945 wait complete. 2023-12-19T05:50:20.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.721+0000 7f9090b88640 1 Processor -- start 2023-12-19T05:50:20.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.722+0000 7f9090b88640 1 -- start start 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c0b7ea0 0x7f908c13dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f908c0d0c60 0x7f908c13b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c13bc00 con 0x7f908c146e30 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c1d2610 con 0x7f908c0d0c60 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f9090b88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c1d2bd0 con 0x7f908c0b7ea0 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52810/0 (socket says 172.21.15.49:52810) 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 -- 172.21.15.49:0/4265280493 learned_addr learned my addr 172.21.15.49:0/4265280493 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908b7fe640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c0b7ea0 0x7f908c13dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908affd640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f908c0d0c60 0x7f908c13b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 -- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c0b7ea0 msgr2=0x7f908c13dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c0b7ea0 0x7f908c13dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 -- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f908c0d0c60 msgr2=0x7f908c13b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.723+0000 7f908bfff640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f908c0d0c60 0x7f908c13b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f908bfff640 1 -- 172.21.15.49:0/4265280493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084009b30 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f908bfff640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e50 tx=0x7f9084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908403e450 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908403e5b0 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908403e960 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.724+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c13e270 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.725+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c1d2860 con 0x7f908c146e30 2023-12-19T05:50:20.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.726+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c1d2d80 con 0x7f908c146e30 2023-12-19T05:50:20.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.727+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f908402cd50 con 0x7f908c146e30 2023-12-19T05:50:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.728+0000 7f9073fff640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 0x7f907806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.728+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90840ab2e0 con 0x7f908c146e30 2023-12-19T05:50:20.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.728+0000 7f908b7fe640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 0x7f907806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.730+0000 7f908b7fe640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 0x7f907806c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.732+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f908c1d2d80 con 0x7f908c146e30 2023-12-19T05:50:20.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.932+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f908c1d2d40 con 0x7f908c146e30 2023-12-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.936+0000 7f9073fff640 1 -- 172.21.15.49:0/4265280493 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16067 (secure 0 0 0) 0x7f9084076960 con 0x7f908c146e30 2023-12-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":164,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:20.422404+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.938+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 msgr2=0x7f907806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.938+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 0x7f907806c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c008040 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.938+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 msgr2=0x7f908c1d49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.938+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e50 tx=0x7f9084004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 shutdown_connections 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f907806a430 0x7f907806c8f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f908c146e30 0x7f908c1d49d0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f908c0d0c60 0x7f908c13b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 --2- 172.21.15.49:0/4265280493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f908c0b7ea0 0x7f908c13dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 >> 172.21.15.49:0/4265280493 conn(0x7f908c0b2990 msgr2=0x7f908c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 shutdown_connections 2023-12-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:20.939+0000 7f9090b88640 1 -- 172.21.15.49:0/4265280493 wait complete. 2023-12-19T05:50:20.960 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:50:20.960 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:21.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.191+0000 7f904d83e640 1 Processor -- start 2023-12-19T05:50:21.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.192+0000 7f904d83e640 1 -- start start 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.193+0000 7f904d83e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480b0b50 0x7f904806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.193+0000 7f904d83e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f904806b590 0x7f904806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.193+0000 7f904d83e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904806bb30 con 0x7f90481449e0 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.193+0000 7f904d83e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90480b0070 con 0x7f904806b590 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.193+0000 7f904d83e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b0350 con 0x7f90480b0b50 2023-12-19T05:50:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f9046ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f90481449e0 0x7f90480af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58492/0 (socket says 172.21.15.49:58492) 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f9046ffd640 1 -- 172.21.15.49:0/3071816838 learned_addr learned my addr 172.21.15.49:0/3071816838 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f90477fe640 1 --2- 172.21.15.49:0/3071816838 >> v2:172.21.15.49:3300/0 conn(0x7f904806b590 0x7f904806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f903ffff640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480b0b50 0x7f904806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f90477fe640 1 -- 172.21.15.49:0/3071816838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480b0b50 msgr2=0x7f904806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f90477fe640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480b0b50 0x7f904806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f90477fe640 1 -- 172.21.15.49:0/3071816838 >> v1:172.21.15.49:6789/0 conn(0x7f90481449e0 legacy=0x7f90480af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.194+0000 7f90477fe640 1 -- 172.21.15.49:0/3071816838 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480b0630 con 0x7f904806b590 2023-12-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.195+0000 7f90477fe640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904806b590 0x7f904806c4e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9040009d90 tx=0x7f904002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58ccc71a754886f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.196+0000 7f90467fc640 1 -- 172.21.15.49:0/3071816838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904002cc60 con 0x7f904806b590 2023-12-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.196+0000 7f90467fc640 1 -- 172.21.15.49:0/3071816838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904002cdc0 con 0x7f904806b590 2023-12-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.196+0000 7f90467fc640 1 -- 172.21.15.49:0/3071816838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040034660 con 0x7f904806b590 2023-12-19T05:50:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 -- 172.21.15.49:0/3071816838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904806b590 msgr2=0x7f904806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904806b590 0x7f904806c4e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9040009d90 tx=0x7f904002beb0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 -- 172.21.15.49:0/3071816838 shutdown_connections 2023-12-19T05:50:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904806b590 0x7f904806c4e0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 --2- 172.21.15.49:0/3071816838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90480b0b50 0x7f904806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 -- 172.21.15.49:0/3071816838 >> 172.21.15.49:0/3071816838 conn(0x7f90480cbb70 msgr2=0x7f90480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 -- 172.21.15.49:0/3071816838 shutdown_connections 2023-12-19T05:50:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.197+0000 7f904d83e640 1 -- 172.21.15.49:0/3071816838 wait complete. 2023-12-19T05:50:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.199+0000 7f904d83e640 1 Processor -- start 2023-12-19T05:50:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.199+0000 7f904d83e640 1 -- start start 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 0x7f904813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480b0b50 0x7f9048143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90481f5fa0 con 0x7f90481449e0 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904813b0b0 con 0x7f90480b0b50 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f904d83e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904815dd90 con 0x7f904806b590 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f90477fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f90477fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52834/0 (socket says 172.21.15.49:52834) 2023-12-19T05:50:21.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.200+0000 7f90477fe640 1 -- 172.21.15.49:0/1242742132 learned_addr learned my addr 172.21.15.49:0/1242742132 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:21.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f9046ffd640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 0x7f904813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f903ffff640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480b0b50 0x7f9048143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 -- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 msgr2=0x7f904813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 0x7f904813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 -- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480b0b50 msgr2=0x7f9048143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480b0b50 0x7f9048143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 -- 172.21.15.49:0/1242742132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009a70 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f9046ffd640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 0x7f904813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f90477fe640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9040009d90 tx=0x7f9040004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.201+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040040650 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.202+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400407d0 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.202+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040040b80 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.202+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90481f61f0 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.202+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90481f67b0 con 0x7f90481449e0 2023-12-19T05:50:21.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.203+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9048061910 con 0x7f90481449e0 2023-12-19T05:50:21.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.204+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9040040ce0 con 0x7f90481449e0 2023-12-19T05:50:21.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.205+0000 7f9044ff9640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 0x7f902806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.205+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90400ab7e0 con 0x7f90481449e0 2023-12-19T05:50:21.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.206+0000 7f9046ffd640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 0x7f902806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.207+0000 7f9046ffd640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 0x7f902806c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9038000f60 tx=0x7f9038009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.209+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9040076d30 con 0x7f90481449e0 2023-12-19T05:50:21.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.450+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90480b16e0 con 0x7f90481449e0 2023-12-19T05:50:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.451+0000 7f9044ff9640 1 -- 172.21.15.49:0/1242742132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f904007a350 con 0x7f90481449e0 2023-12-19T05:50:21.454 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:21.454 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:50:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:50:21.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 msgr2=0x7f902806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 0x7f902806c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9038000f60 tx=0x7f9038009040 comp rx=0 tx=0).stop 2023-12-19T05:50:21.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 msgr2=0x7f9048143bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9040009d90 tx=0x7f9040004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 shutdown_connections 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f902806a430 0x7f902806c8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90481449e0 0x7f9048143bd0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90480b0b50 0x7f9048143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 --2- 172.21.15.49:0/1242742132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f904806b590 0x7f904813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.454+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 >> 172.21.15.49:0/1242742132 conn(0x7f90480cbb70 msgr2=0x7f9048140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.455+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 shutdown_connections 2023-12-19T05:50:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.455+0000 7f904d83e640 1 -- 172.21.15.49:0/1242742132 wait complete. 2023-12-19T05:50:21.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.709+0000 7f89e238e640 1 Processor -- start 2023-12-19T05:50:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.709+0000 7f89e238e640 1 -- start start 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc15e5a0 0x7f89dc0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89dc15f680 0x7f89dc0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89dc0cdbf0 0x7f89dc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0ce5c0 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc15ec30 con 0x7f89dc15f680 2023-12-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.711+0000 7f89e238e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0b2cc0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89dc0cdbf0 0x7f89dc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89dc0cdbf0 0x7f89dc0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52848/0 (socket says 172.21.15.49:52848) 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 -- 172.21.15.49:0/714820682 learned_addr learned my addr 172.21.15.49:0/714820682 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e138c640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc15e5a0 0x7f89dc0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e0b8b640 1 --2- 172.21.15.49:0/714820682 >> v2:172.21.15.115:3300/0 conn(0x7f89dc15f680 0x7f89dc0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 -- 172.21.15.49:0/714820682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc15e5a0 msgr2=0x7f89dc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc15e5a0 0x7f89dc0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 -- 172.21.15.49:0/714820682 >> v2:172.21.15.115:3300/0 conn(0x7f89dc15f680 msgr2=0x7f89dc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 --2- 172.21.15.49:0/714820682 >> v2:172.21.15.115:3300/0 conn(0x7f89dc15f680 0x7f89dc0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.712+0000 7f89e1b8d640 1 -- 172.21.15.49:0/714820682 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc15e980 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.713+0000 7f89e1b8d640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc0cdbf0 0x7f89dc0ce080 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0cfe20 tx=0x7f89d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b214d7b2a46974f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.714+0000 7f89d3fff640 1 -- 172.21.15.49:0/714820682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d402ca70 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.714+0000 7f89d3fff640 1 -- 172.21.15.49:0/714820682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d402cbd0 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.714+0000 7f89d3fff640 1 -- 172.21.15.49:0/714820682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40343f0 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.714+0000 7f89e238e640 1 -- 172.21.15.49:0/714820682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc0cdbf0 msgr2=0x7f89dc0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.714+0000 7f89e238e640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc0cdbf0 0x7f89dc0ce080 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0cfe20 tx=0x7f89d402bed0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 -- 172.21.15.49:0/714820682 shutdown_connections 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc0cdbf0 0x7f89dc0ce080 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 --2- 172.21.15.49:0/714820682 >> v2:172.21.15.115:3300/0 conn(0x7f89dc15f680 0x7f89dc0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 --2- 172.21.15.49:0/714820682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc15e5a0 0x7f89dc0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 -- 172.21.15.49:0/714820682 >> 172.21.15.49:0/714820682 conn(0x7f89dc0b0100 msgr2=0x7f89dc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 -- 172.21.15.49:0/714820682 shutdown_connections 2023-12-19T05:50:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.715+0000 7f89e238e640 1 -- 172.21.15.49:0/714820682 wait complete. 2023-12-19T05:50:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.717+0000 7f89e238e640 1 Processor -- start 2023-12-19T05:50:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.717+0000 7f89e238e640 1 -- start start 2023-12-19T05:50:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc0cdbf0 0x7f89dc154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc15f680 0x7f89dc14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc155890 con 0x7f89dc15e5a0 2023-12-19T05:50:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc154c10 con 0x7f89dc15f680 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e238e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc154ef0 con 0x7f89dc0cdbf0 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e0b8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e0b8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52864/0 (socket says 172.21.15.49:52864) 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.718+0000 7f89e0b8b640 1 -- 172.21.15.49:0/334597027 learned_addr learned my addr 172.21.15.49:0/334597027 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e138c640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc0cdbf0 0x7f89dc154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 -- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc0cdbf0 msgr2=0x7f89dc154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e1b8d640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc15f680 0x7f89dc14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc0cdbf0 0x7f89dc154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 -- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc15f680 msgr2=0x7f89dc14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc15f680 0x7f89dc14e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 -- 172.21.15.49:0/334597027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009b30 con 0x7f89dc15e5a0 2023-12-19T05:50:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e0b8b640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00e870 tx=0x7f89cc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0094f0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00c940 con 0x7f89dc15e5a0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00ccf0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc1551d0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.719+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc14e850 con 0x7f89dc15e5a0 2023-12-19T05:50:21.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.721+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc1559d0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.722+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89cc013470 con 0x7f89dc15e5a0 2023-12-19T05:50:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.723+0000 7f89d1ffb640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 0x7f89c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.723+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89cc088990 con 0x7f89dc15e5a0 2023-12-19T05:50:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.723+0000 7f89e138c640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 0x7f89c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.724+0000 7f89e138c640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 0x7f89c006c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009a10 tx=0x7f89d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:21.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.727+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89dc1559d0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.956+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89dc1559d0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.957+0000 7f89d1ffb640 1 -- 172.21.15.49:0/334597027 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f89dc1559d0 con 0x7f89dc15e5a0 2023-12-19T05:50:21.959 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:21.959 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:47:57.189482+0000","modified":"2023-12-19T05:48:00.715073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8100":{"gid":8100,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/508042264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":508042264},{"type":"v1","addr":"172.21.15.49:6834","nonce":508042264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-19T05:50:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 72 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 msgr2=0x7f89c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 0x7f89c006c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009a10 tx=0x7f89d8008040 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 msgr2=0x7f89dc0af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00e870 tx=0x7f89cc00ed30 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 shutdown_connections 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f89c006a430 0x7f89c006c8f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc15f680 0x7f89dc14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89dc15e5a0 0x7f89dc0af880 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 --2- 172.21.15.49:0/334597027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89dc0cdbf0 0x7f89dc154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 >> 172.21.15.49:0/334597027 conn(0x7f89dc0b0100 msgr2=0x7f89dc0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 shutdown_connections 2023-12-19T05:50:21.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:21.960+0000 7f89e238e640 1 -- 172.21.15.49:0/334597027 wait complete. 2023-12-19T05:50:21.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.203+0000 7f8b746df640 1 Processor -- start 2023-12-19T05:50:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.203+0000 7f8b746df640 1 -- start start 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.205+0000 7f8b746df640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b6c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.205+0000 7f8b746df640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b6c06b590 0x7f8b6c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.205+0000 7f8b746df640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c06bb30 con 0x7f8b6c1449e0 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.205+0000 7f8b746df640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b0070 con 0x7f8b6c06b590 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.205+0000 7f8b746df640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b0350 con 0x7f8b6c0b0b50 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b7247b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b6c1449e0 0x7f8b6c0af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58496/0 (socket says 172.21.15.49:58496) 2023-12-19T05:50:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b7247b640 1 -- 172.21.15.49:0/1825748947 learned_addr learned my addr 172.21.15.49:0/1825748947 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b71c7a640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b6c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b72c7c640 1 --2- 172.21.15.49:0/1825748947 >> v2:172.21.15.115:3300/0 conn(0x7f8b6c06b590 0x7f8b6c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070709548 0 0) 0x7f8b6c06bb30 con 0x7f8b6c1449e0 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.206+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b58003520 con 0x7f8b6c1449e0 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529368451 0 0) 0x7f8b58003520 con 0x7f8b6c1449e0 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 msgr2=0x7f8b6c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b6c06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 >> v2:172.21.15.115:3300/0 conn(0x7f8b6c06b590 msgr2=0x7f8b6c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 --2- 172.21.15.49:0/1825748947 >> v2:172.21.15.115:3300/0 conn(0x7f8b6c06b590 0x7f8b6c06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0b0630 con 0x7f8b6c1449e0 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8b68001690 con 0x7f8b6c1449e0 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 >> v1:172.21.15.49:6789/0 conn(0x7f8b6c1449e0 legacy=0x7f8b6c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b58003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58004d00 0x7f8b58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b0070 con 0x7f8b580039e0 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b0350 con 0x7f8b58004d00 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5800b9b0 con 0x7f8b6c0b0b50 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b58003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b71c7a640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 -- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 msgr2=0x7f8b580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c0b0b50 0x7f8b580047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 -- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58004d00 msgr2=0x7f8b58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58004d00 0x7f8b58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.207+0000 7f8b7247b640 1 -- 172.21.15.49:0/1825748947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58003520 con 0x7f8b580039e0 2023-12-19T05:50:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b7247b640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b58003e00 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c160 tx=0x7f8b580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745be19fa7059634 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68005ad0 con 0x7f8b580039e0 2023-12-19T05:50:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68005c30 con 0x7f8b580039e0 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b71479640 1 -- 172.21.15.49:0/1825748947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6802c810 con 0x7f8b580039e0 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b746df640 1 -- 172.21.15.49:0/1825748947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 msgr2=0x7f8b58003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.209+0000 7f8b746df640 1 --2- 172.21.15.49:0/1825748947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b58003e00 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c160 tx=0x7f8b580057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.210+0000 7f8b72c7c640 1 -- 172.21.15.49:0/1825748947 reap_dead start 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.210+0000 7f8b746df640 1 -- 172.21.15.49:0/1825748947 shutdown_connections 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.210+0000 7f8b746df640 1 -- 172.21.15.49:0/1825748947 >> 172.21.15.49:0/1825748947 conn(0x7f8b6c0cbb70 msgr2=0x7f8b6c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.210+0000 7f8b746df640 1 -- 172.21.15.49:0/1825748947 shutdown_connections 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.210+0000 7f8b746df640 1 -- 172.21.15.49:0/1825748947 wait complete. 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.212+0000 7f8b746df640 1 Processor -- start 2023-12-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.212+0000 7f8b746df640 1 -- start start 2023-12-19T05:50:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b6c141960 0x7f8b6c13fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c159960 0x7f8b6c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1405a0 con 0x7f8b580039e0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c141de0 con 0x7f8b6c141960 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b746df640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c15a320 con 0x7f8b6c159960 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b7247b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b7247b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52872/0 (socket says 172.21.15.49:52872) 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.213+0000 7f8b7247b640 1 -- 172.21.15.49:0/2668518246 learned_addr learned my addr 172.21.15.49:0/2668518246 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b71c7a640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b6c141960 0x7f8b6c13fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 -- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c159960 msgr2=0x7f8b6c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c159960 0x7f8b6c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 -- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b6c141960 msgr2=0x7f8b6c13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b6c141960 0x7f8b6c13fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 -- 172.21.15.49:0/2668518246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c142fa0 con 0x7f8b580039e0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b7247b640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c160 tx=0x7f8b6c06ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6803c040 con 0x7f8b580039e0 2023-12-19T05:50:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6802cc20 con 0x7f8b580039e0 2023-12-19T05:50:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007070 con 0x7f8b580039e0 2023-12-19T05:50:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c143280 con 0x7f8b580039e0 2023-12-19T05:50:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.214+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c143840 con 0x7f8b580039e0 2023-12-19T05:50:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.216+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c06bf20 con 0x7f8b580039e0 2023-12-19T05:50:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.217+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b68032070 con 0x7f8b580039e0 2023-12-19T05:50:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.218+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 0x7f8b5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.218+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b680a9680 con 0x7f8b580039e0 2023-12-19T05:50:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.219+0000 7f8b71c7a640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 0x7f8b5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.220+0000 7f8b71c7a640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 0x7f8b5006c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0b2050 tx=0x7f8b5c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.222+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b68074bd0 con 0x7f8b580039e0 2023-12-19T05:50:22.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.415+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b6c061910 con 0x7f8b580039e0 2023-12-19T05:50:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.417+0000 7f8b62ffd640 1 -- 172.21.15.49:0/2668518246 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16067 (secure 0 0 0) 0x7f8b68045090 con 0x7f8b580039e0 2023-12-19T05:50:22.421 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":164,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:20.422404+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:47:55.166539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-19T05:47:56.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 msgr2=0x7f8b5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 0x7f8b5006c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0b2050 tx=0x7f8b5c008040 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 msgr2=0x7f8b6c142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c160 tx=0x7f8b6c06ba20 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 shutdown_connections 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b5006a430 0x7f8b5006c8f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b6c159960 0x7f8b6c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b6c141960 0x7f8b6c13fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 --2- 172.21.15.49:0/2668518246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b580039e0 0x7f8b6c142940 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 >> 172.21.15.49:0/2668518246 conn(0x7f8b6c0cbb70 msgr2=0x7f8b6c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.420+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 shutdown_connections 2023-12-19T05:50:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.421+0000 7f8b746df640 1 -- 172.21.15.49:0/2668518246 wait complete. 2023-12-19T05:50:22.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:50:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.673+0000 7fd38e699640 1 Processor -- start 2023-12-19T05:50:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.673+0000 7fd38e699640 1 -- start start 2023-12-19T05:50:22.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38e699640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3880b7360 0x7fd3880b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38e699640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3880cf8e0 0x7fd3880cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38e699640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880b7d00 con 0x7fd388146c40 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38e699640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880700c0 con 0x7fd3880cf8e0 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38e699640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38806f160 con 0x7fd3880b7360 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38d697640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd388146c40 0x7fd388070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58506/0 (socket says 172.21.15.49:58506) 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38d697640 1 -- 172.21.15.49:0/2772710918 learned_addr learned my addr 172.21.15.49:0/2772710918 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38de98640 1 --2- 172.21.15.49:0/2772710918 >> v2:172.21.15.49:3300/0 conn(0x7fd3880cf8e0 0x7fd3880cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd38ce96640 1 --2- 172.21.15.49:0/2772710918 >> v2:172.21.15.115:3300/0 conn(0x7fd3880b7360 0x7fd3880b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.675+0000 7fd387fff640 1 -- 172.21.15.49:0/2772710918 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426284487 0 0) 0x7fd3880b7d00 con 0x7fd388146c40 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.676+0000 7fd387fff640 1 -- 172.21.15.49:0/2772710918 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd370003520 con 0x7fd388146c40 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.676+0000 7fd38de98640 1 -- 172.21.15.49:0/2772710918 >> v2:172.21.15.115:3300/0 conn(0x7fd3880b7360 msgr2=0x7fd3880b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.676+0000 7fd38de98640 1 --2- 172.21.15.49:0/2772710918 >> v2:172.21.15.115:3300/0 conn(0x7fd3880b7360 0x7fd3880b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.676+0000 7fd38de98640 1 -- 172.21.15.49:0/2772710918 >> v1:172.21.15.49:6789/0 conn(0x7fd388146c40 legacy=0x7fd388070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.676+0000 7fd38de98640 1 -- 172.21.15.49:0/2772710918 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38806f440 con 0x7fd3880cf8e0 2023-12-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.677+0000 7fd38de98640 1 --2- 172.21.15.49:0/2772710918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd3880cfd30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd388066910 tx=0x7fd38002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e256659122f64937 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.677+0000 7fd387fff640 1 -- 172.21.15.49:0/2772710918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380031830 con 0x7fd3880cf8e0 2023-12-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.677+0000 7fd387fff640 1 -- 172.21.15.49:0/2772710918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380031990 con 0x7fd3880cf8e0 2023-12-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.677+0000 7fd387fff640 1 -- 172.21.15.49:0/2772710918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380031d20 con 0x7fd3880cf8e0 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 -- 172.21.15.49:0/2772710918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 msgr2=0x7fd3880cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 --2- 172.21.15.49:0/2772710918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd3880cfd30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd388066910 tx=0x7fd38002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 -- 172.21.15.49:0/2772710918 shutdown_connections 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 --2- 172.21.15.49:0/2772710918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd3880cfd30 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 --2- 172.21.15.49:0/2772710918 >> v2:172.21.15.115:3300/0 conn(0x7fd3880b7360 0x7fd3880b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 -- 172.21.15.49:0/2772710918 >> 172.21.15.49:0/2772710918 conn(0x7fd3880d31b0 msgr2=0x7fd3880d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 -- 172.21.15.49:0/2772710918 shutdown_connections 2023-12-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.678+0000 7fd38e699640 1 -- 172.21.15.49:0/2772710918 wait complete. 2023-12-19T05:50:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.680+0000 7fd38e699640 1 Processor -- start 2023-12-19T05:50:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.680+0000 7fd38e699640 1 -- start start 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 0x7fd3881599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd388146c40 0x7fd38815fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38813e8d0 con 0x7fd3880cf8e0 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b5070 con 0x7fd388146c40 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38e699640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b5350 con 0x7fd3880b7360 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38ce96640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38ce96640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52904/0 (socket says 172.21.15.49:52904) 2023-12-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.681+0000 7fd38ce96640 1 -- 172.21.15.49:0/2609185176 learned_addr learned my addr 172.21.15.49:0/2609185176 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38de98640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd388146c40 0x7fd38815fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38d697640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 0x7fd3881599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 -- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 msgr2=0x7fd3881599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 0x7fd3881599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 -- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd388146c40 msgr2=0x7fd38815fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd388146c40 0x7fd38815fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 -- 172.21.15.49:0/2609185176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009400 con 0x7fd3880cf8e0 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38d697640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 0x7fd3881599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd38ce96640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d800 tx=0x7fd37c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.682+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00b6c0 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.683+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00b820 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.683+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00bbb0 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.683+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880b5630 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.683+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38813b780 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.684+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388061910 con 0x7fd3880cf8e0 2023-12-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.685+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd37c00bd10 con 0x7fd3880cf8e0 2023-12-19T05:50:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.686+0000 7fd385ffb640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 0x7fd37406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.686+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd37c088e30 con 0x7fd3880cf8e0 2023-12-19T05:50:22.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.687+0000 7fd38d697640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 0x7fd37406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:22.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.688+0000 7fd38d697640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 0x7fd37406c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd378001560 tx=0x7fd378009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:22.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.690+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd37c054410 con 0x7fd3880cf8e0 2023-12-19T05:50:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.925+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3880b8a50 con 0x7fd3880cf8e0 2023-12-19T05:50:22.929 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:50:22.926+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:50:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.943+0000 7fd385ffb640 1 -- 172.21.15.49:0/2609185176 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd37c057a30 con 0x7fd3880cf8e0 2023-12-19T05:50:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:50:22.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 msgr2=0x7fd37406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 0x7fd37406c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd378001560 tx=0x7fd378009040 comp rx=0 tx=0).stop 2023-12-19T05:50:22.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 msgr2=0x7fd38815f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d800 tx=0x7fd37c00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 shutdown_connections 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd37406a460 0x7fd37406c920 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd388146c40 0x7fd38815fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.946+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3880cf8e0 0x7fd38815f740 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.947+0000 7fd38e699640 1 --2- 172.21.15.49:0/2609185176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3880b7360 0x7fd3881599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.947+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 >> 172.21.15.49:0/2609185176 conn(0x7fd3880d31b0 msgr2=0x7fd3880cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.947+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 shutdown_connections 2023-12-19T05:50:22.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:22.947+0000 7fd38e699640 1 -- 172.21.15.49:0/2609185176 wait complete. 2023-12-19T05:50:22.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:50:23.062 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:50:23.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.176+0000 7fe29759e640 1 Processor -- start 2023-12-19T05:50:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.176+0000 7fe29759e640 1 -- start start 2023-12-19T05:50:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe29759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2980b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe29759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29806b3a0 con 0x7fe2980b0a00 2023-12-19T05:50:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe29759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980b1860 con 0x7fe2980cd430 2023-12-19T05:50:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe29759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b23e0 con 0x7fe298159e40 2023-12-19T05:50:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe296d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe2980b0a00 0x7fe29806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58522/0 (socket says 172.21.15.49:58522) 2023-12-19T05:50:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.178+0000 7fe296d9d640 1 -- 172.21.15.49:0/564108967 learned_addr learned my addr 172.21.15.49:0/564108967 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29659c640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2980b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891868486 0 0) 0x7fe29806b3a0 con 0x7fe2980b0a00 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280003520 con 0x7fe2980b0a00 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217902755 0 0) 0x7fe280003520 con 0x7fe2980b0a00 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 msgr2=0x7fe2980b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2980b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 >> v1:172.21.15.115:6789/0 conn(0x7fe2980cd430 legacy=0x7fe2980b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980b1b40 con 0x7fe2980b0a00 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe2900019f0 con 0x7fe2980b0a00 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 >> v1:172.21.15.49:6789/0 conn(0x7fe2980b0a00 legacy=0x7fe29806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe280003a10 0x7fe280003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2800047c0 0x7fe280004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2800051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b23e0 con 0x7fe2800047c0 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28000bbd0 con 0x7fe280003a10 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.179+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28000dfa0 con 0x7fe298159e40 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2800047c0 0x7fe280004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe296d9d640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2800051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe29659c640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe280003a10 0x7fe280003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 -- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 msgr2=0x7fe2800051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe298159e40 0x7fe2800051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 -- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe280003a10 msgr2=0x7fe280003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe280003a10 0x7fe280003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe295d9b640 1 -- 172.21.15.49:0/564108967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280003520 con 0x7fe2800047c0 2023-12-19T05:50:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.180+0000 7fe29659c640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe280003a10 0x7fe280003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.181+0000 7fe295d9b640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2800047c0 0x7fe280004c40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fe28c001750 tx=0x7fe2800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a071a13a87898e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0052d0 con 0x7fe2800047c0 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c02e050 con 0x7fe2800047c0 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29559a640 1 -- 172.21.15.49:0/564108967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0035f0 con 0x7fe2800047c0 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29759e640 1 -- 172.21.15.49:0/564108967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2800047c0 msgr2=0x7fe280004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29759e640 1 --2- 172.21.15.49:0/564108967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2800047c0 0x7fe280004c40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fe28c001750 tx=0x7fe2800057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe296d9d640 1 -- 172.21.15.49:0/564108967 reap_dead start 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29759e640 1 -- 172.21.15.49:0/564108967 shutdown_connections 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.182+0000 7fe29759e640 1 -- 172.21.15.49:0/564108967 >> 172.21.15.49:0/564108967 conn(0x7fe2980659a0 msgr2=0x7fe298065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.183+0000 7fe29759e640 1 -- 172.21.15.49:0/564108967 shutdown_connections 2023-12-19T05:50:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.183+0000 7fe29759e640 1 -- 172.21.15.49:0/564108967 wait complete. 2023-12-19T05:50:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.184+0000 7fe29759e640 1 Processor -- start 2023-12-19T05:50:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.185+0000 7fe29759e640 1 -- start start 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2800047c0 0x7fe29813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe298070720 0x7fe298070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980710e0 con 0x7fe29814a810 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29813e470 con 0x7fe298070720 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29813e6f0 con 0x7fe2800047c0 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe295d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe295d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52926/0 (socket says 172.21.15.49:52926) 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe295d9b640 1 -- 172.21.15.49:0/3165187130 learned_addr learned my addr 172.21.15.49:0/3165187130 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe29659c640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2800047c0 0x7fe29813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.186+0000 7fe296d9d640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe298070720 0x7fe298070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 -- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2800047c0 msgr2=0x7fe29813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2800047c0 0x7fe29813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 -- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe298070720 msgr2=0x7fe298070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe298070720 0x7fe298070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 -- 172.21.15.49:0/3165187130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29814d8d0 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe295d9b640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe28c008fd0 tx=0x7fe28c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0076c0 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c007a30 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c006be0 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.187+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2981416d0 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.188+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29814db40 con 0x7fe29814a810 2023-12-19T05:50:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.189+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe298061910 con 0x7fe29814a810 2023-12-19T05:50:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.190+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe28c006d40 con 0x7fe29814a810 2023-12-19T05:50:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.190+0000 7fe286ffd640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.191+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe28c0aaa70 con 0x7fe29814a810 2023-12-19T05:50:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.191+0000 7fe29659c640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.192+0000 7fe29659c640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 0x7fe27806c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe288009aa0 tx=0x7fe288008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:23.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.195+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe28c075f70 con 0x7fe29814a810 2023-12-19T05:50:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.424+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe2980ce030 con 0x7fe29814a810 2023-12-19T05:50:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.947+0000 7fe286ffd640 1 -- 172.21.15.49:0/3165187130 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe28c04b0a0 con 0x7fe29814a810 2023-12-19T05:50:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 msgr2=0x7fe27806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 0x7fe27806c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe288009aa0 tx=0x7fe288008040 comp rx=0 tx=0).stop 2023-12-19T05:50:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 msgr2=0x7fe298141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe28c008fd0 tx=0x7fe28c001120 comp rx=0 tx=0).stop 2023-12-19T05:50:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 shutdown_connections 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe27806a430 0x7fe27806c8f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe298070720 0x7fe298070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29814a810 0x7fe298141190 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 --2- 172.21.15.49:0/3165187130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2800047c0 0x7fe29813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 >> 172.21.15.49:0/3165187130 conn(0x7fe2980659a0 msgr2=0x7fe2980b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 shutdown_connections 2023-12-19T05:50:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:23.951+0000 7fe29759e640 1 -- 172.21.15.49:0/3165187130 wait complete. 2023-12-19T05:50:23.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:50:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.198+0000 7ff047c5f640 1 Processor -- start 2023-12-19T05:50:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.198+0000 7ff047c5f640 1 -- start start 2023-12-19T05:50:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff047c5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400cd610 0x7ff04015a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff047c5f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0400ada20 0x7ff04006b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff047c5f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400b29e0 con 0x7ff0401574b0 2023-12-19T05:50:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff047c5f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400b2420 con 0x7ff0400ada20 2023-12-19T05:50:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff047c5f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400b2700 con 0x7ff0400cd610 2023-12-19T05:50:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff0459fb640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff0401574b0 0x7ff0400ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58966/0 (socket says 172.21.15.49:58966) 2023-12-19T05:50:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.200+0000 7ff0459fb640 1 -- 172.21.15.49:0/1666622425 learned_addr learned my addr 172.21.15.49:0/1666622425 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0461fc640 1 --2- 172.21.15.49:0/1666622425 >> v2:172.21.15.49:3300/0 conn(0x7ff0400ada20 0x7ff04006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0451fa640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400cd610 0x7ff04015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0449f9640 1 -- 172.21.15.49:0/1666622425 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183343585 0 0) 0x7ff0400b29e0 con 0x7ff0401574b0 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0449f9640 1 -- 172.21.15.49:0/1666622425 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c003520 con 0x7ff0401574b0 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0461fc640 1 -- 172.21.15.49:0/1666622425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400cd610 msgr2=0x7ff04015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0461fc640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400cd610 0x7ff04015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0461fc640 1 -- 172.21.15.49:0/1666622425 >> v1:172.21.15.49:6789/0 conn(0x7ff0401574b0 legacy=0x7ff0400ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.201+0000 7ff0461fc640 1 -- 172.21.15.49:0/1666622425 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04006cac0 con 0x7ff0400ada20 2023-12-19T05:50:24.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff0461fc640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400ada20 0x7ff04006b790 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff038009d90 tx=0x7ff03802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e714512db16d7ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:24.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff0449f9640 1 -- 172.21.15.49:0/1666622425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03802cc60 con 0x7ff0400ada20 2023-12-19T05:50:24.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff0449f9640 1 -- 172.21.15.49:0/1666622425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03802cdc0 con 0x7ff0400ada20 2023-12-19T05:50:24.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff0449f9640 1 -- 172.21.15.49:0/1666622425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038034660 con 0x7ff0400ada20 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff047c5f640 1 -- 172.21.15.49:0/1666622425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400ada20 msgr2=0x7ff04006b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.203+0000 7ff047c5f640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400ada20 0x7ff04006b790 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff038009d90 tx=0x7ff03802beb0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 -- 172.21.15.49:0/1666622425 shutdown_connections 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400ada20 0x7ff04006b790 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 --2- 172.21.15.49:0/1666622425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400cd610 0x7ff04015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 -- 172.21.15.49:0/1666622425 >> 172.21.15.49:0/1666622425 conn(0x7ff0400cf230 msgr2=0x7ff0400cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 -- 172.21.15.49:0/1666622425 shutdown_connections 2023-12-19T05:50:24.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.204+0000 7ff047c5f640 1 -- 172.21.15.49:0/1666622425 wait complete. 2023-12-19T05:50:24.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.205+0000 7ff047c5f640 1 Processor -- start 2023-12-19T05:50:24.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.206+0000 7ff047c5f640 1 -- start start 2023-12-19T05:50:24.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 0x7ff04014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff04014c360 0x7ff04014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040158e00 con 0x7ff0401574b0 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040158560 con 0x7ff04014c360 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff047c5f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff040158840 con 0x7ff0400ada20 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59692/0 (socket says 172.21.15.49:59692) 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 -- 172.21.15.49:0/231786633 learned_addr learned my addr 172.21.15.49:0/231786633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0459fb640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 0x7ff04014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0461fc640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff04014c360 0x7ff04014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 -- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 msgr2=0x7ff04014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 0x7ff04014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 -- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff04014c360 msgr2=0x7ff04014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.207+0000 7ff0451fa640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff04014c360 0x7ff04014a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0451fa640 1 -- 172.21.15.49:0/231786633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009a70 con 0x7ff0401574b0 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0459fb640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 0x7ff04014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:24.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0451fa640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e9b0 tx=0x7ff03000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030009670 con 0x7ff0401574b0 2023-12-19T05:50:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000c9a0 con 0x7ff0401574b0 2023-12-19T05:50:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000cd50 con 0x7ff0401574b0 2023-12-19T05:50:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff040158b20 con 0x7ff0401574b0 2023-12-19T05:50:24.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.208+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04015b240 con 0x7ff0401574b0 2023-12-19T05:50:24.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.209+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff040061910 con 0x7ff0401574b0 2023-12-19T05:50:24.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.210+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff030013470 con 0x7ff0401574b0 2023-12-19T05:50:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.211+0000 7ff0367fc640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 0x7ff02406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.211+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff030088c80 con 0x7ff0401574b0 2023-12-19T05:50:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.212+0000 7ff0459fb640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 0x7ff02406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.213+0000 7ff0459fb640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 0x7ff02406c920 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0011e0 tx=0x7ff03c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:24.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.215+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff030054170 con 0x7ff0401574b0 2023-12-19T05:50:24.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.416+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0400ccae0 con 0x7ff0401574b0 2023-12-19T05:50:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.954+0000 7ff0367fc640 1 -- 172.21.15.49:0/231786633 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0300170d0 con 0x7ff0401574b0 2023-12-19T05:50:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:50:24.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 msgr2=0x7ff02406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 0x7ff02406c920 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0011e0 tx=0x7ff03c009040 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 msgr2=0x7ff040157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e9b0 tx=0x7ff03000ee70 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 shutdown_connections 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff02406a460 0x7ff02406c920 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff04014c360 0x7ff04014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401574b0 0x7ff040157b30 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 --2- 172.21.15.49:0/231786633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0400ada20 0x7ff04014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.959+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 >> 172.21.15.49:0/231786633 conn(0x7ff0400cf230 msgr2=0x7ff04014f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.960+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 shutdown_connections 2023-12-19T05:50:24.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:24.960+0000 7ff047c5f640 1 -- 172.21.15.49:0/231786633 wait complete. 2023-12-19T05:50:24.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:50:25.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.222+0000 7f4bf1c95640 1 Processor -- start 2023-12-19T05:50:25.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.222+0000 7f4bf1c95640 1 -- start start 2023-12-19T05:50:25.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.223+0000 7f4bf1c95640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bec15d600 0x7f4bec06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:25.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.223+0000 7f4bf1c95640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0b4120 con 0x7f4bec0cd8b0 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.223+0000 7f4bf1c95640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0d03b0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.223+0000 7f4bf1c95640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0cf7a0 con 0x7f4bec15d600 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bebfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bec15d600 0x7f4bec06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bf0c93640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4bec0cd8b0 0x7f4bec0cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58970/0 (socket says 172.21.15.49:58970) 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bf0c93640 1 -- 172.21.15.49:0/1348570824 learned_addr learned my addr 172.21.15.49:0/1348570824 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bebfff640 1 -- 172.21.15.49:0/1348570824 >> v1:172.21.15.115:6789/0 conn(0x7f4bec06dcb0 legacy=0x7f4bec071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bebfff640 1 -- 172.21.15.49:0/1348570824 >> v1:172.21.15.49:6789/0 conn(0x7f4bec0cd8b0 legacy=0x7f4bec0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4bebfff640 1 -- 172.21.15.49:0/1348570824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0cfa80 con 0x7f4bec15d600 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.224+0000 7f4beb7fe640 1 -- 172.21.15.49:0/1348570824 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100113927 0 0) 0x7f4bec0b4120 con 0x7f4bec0cd8b0 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.225+0000 7f4bebfff640 1 --2- 172.21.15.49:0/1348570824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec15d600 0x7f4bec06d690 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40097a0 tx=0x7f4bd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7685035c5364f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4beb7fe640 1 -- 172.21.15.49:0/1348570824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4031830 con 0x7f4bec15d600 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4beb7fe640 1 -- 172.21.15.49:0/1348570824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd4031990 con 0x7f4bec15d600 2023-12-19T05:50:25.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4beb7fe640 1 -- 172.21.15.49:0/1348570824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4031d20 con 0x7f4bec15d600 2023-12-19T05:50:25.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4bf1c95640 1 -- 172.21.15.49:0/1348570824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec15d600 msgr2=0x7f4bec06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:25.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/1348570824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec15d600 0x7f4bec06d690 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40097a0 tx=0x7f4bd402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:50:25.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4bf1c95640 1 -- 172.21.15.49:0/1348570824 shutdown_connections 2023-12-19T05:50:25.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/1348570824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec15d600 0x7f4bec06d690 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:25.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.226+0000 7f4bf1c95640 1 -- 172.21.15.49:0/1348570824 >> 172.21.15.49:0/1348570824 conn(0x7f4bec0659a0 msgr2=0x7f4bec065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:25.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.227+0000 7f4bf1c95640 1 -- 172.21.15.49:0/1348570824 shutdown_connections 2023-12-19T05:50:25.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.227+0000 7f4bf1c95640 1 -- 172.21.15.49:0/1348570824 wait complete. 2023-12-19T05:50:25.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.228+0000 7f4bf1c95640 1 Processor -- start 2023-12-19T05:50:25.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.229+0000 7f4bf1c95640 1 -- start start 2023-12-19T05:50:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.229+0000 7f4bf1c95640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1c95640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bec0cd8b0 0x7f4bec1f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1c95640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 0x7f4bec151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1c95640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1f6e80 con 0x7f4bec06dcb0 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1c95640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c6fb0 con 0x7f4bec15d600 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1c95640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0ae4d0 con 0x7f4bec0cd8b0 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59712/0 (socket says 172.21.15.49:59712) 2023-12-19T05:50:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 -- 172.21.15.49:0/2991158986 learned_addr learned my addr 172.21.15.49:0/2991158986 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 -- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bec0cd8b0 msgr2=0x7f4bec1f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bec0cd8b0 0x7f4bec1f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1494640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 0x7f4bec151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 -- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 msgr2=0x7f4bec151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 0x7f4bec151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf0c93640 1 -- 172.21.15.49:0/2991158986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4009400 con 0x7f4bec06dcb0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.230+0000 7f4bf1494640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 0x7f4bec151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4bf0c93640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00c890 tx=0x7f4bdc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00a640 con 0x7f4bec06dcb0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00a7c0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0ae7b0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00ab70 con 0x7f4bec06dcb0 2023-12-19T05:50:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.231+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec0aed70 con 0x7f4bec06dcb0 2023-12-19T05:50:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.232+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec061910 con 0x7f4bec06dcb0 2023-12-19T05:50:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.233+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4bdc00acd0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.234+0000 7f4be97fa640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 0x7f4bcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.234+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4bdc087ff0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.235+0000 7f4bebfff640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 0x7f4bcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.236+0000 7f4bebfff640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 0x7f4bcc06c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4036000 tx=0x7f4bd4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:25.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.239+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4bdc0537d0 con 0x7f4bec06dcb0 2023-12-19T05:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:25.432+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bec0c6a90 con 0x7f4bec06dcb0 2023-12-19T05:50:26.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.440+0000 7f4be97fa640 1 -- 172.21.15.49:0/2991158986 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4bdc056df0 con 0x7f4bec06dcb0 2023-12-19T05:50:26.443 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:50:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.445+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 msgr2=0x7f4bcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.445+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 0x7f4bcc06c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4036000 tx=0x7f4bd4030000 comp rx=0 tx=0).stop 2023-12-19T05:50:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.445+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 msgr2=0x7f4bec0af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.445+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00c890 tx=0x7f4bdc00cd50 comp rx=0 tx=0).stop 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 shutdown_connections 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4bcc06a430 0x7f4bcc06c8f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bec0cd8b0 0x7f4bec1f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bec15d600 0x7f4bec151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 --2- 172.21.15.49:0/2991158986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bec06dcb0 0x7f4bec0af570 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.446+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 >> 172.21.15.49:0/2991158986 conn(0x7f4bec0659a0 msgr2=0x7f4bec0b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.447+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 shutdown_connections 2023-12-19T05:50:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.447+0000 7f4bf1c95640 1 -- 172.21.15.49:0/2991158986 wait complete. 2023-12-19T05:50:26.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:50:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.701+0000 7f61be695640 1 Processor -- start 2023-12-19T05:50:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.701+0000 7f61be695640 1 -- start start 2023-12-19T05:50:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.703+0000 7f61be695640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61b8146c40 0x7f61b8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.703+0000 7f61be695640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b80b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.703+0000 7f61be695640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b80b7d00 con 0x7f61b80b7360 2023-12-19T05:50:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.703+0000 7f61be695640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80700c0 con 0x7f61b8146c40 2023-12-19T05:50:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.703+0000 7f61be695640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b806f160 con 0x7f61b80d08f0 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61bce92640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f61b80b7360 0x7f61b8160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58974/0 (socket says 172.21.15.49:58974) 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61bce92640 1 -- 172.21.15.49:0/1538728560 learned_addr learned my addr 172.21.15.49:0/1538728560 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61bde94640 1 --2- 172.21.15.49:0/1538728560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b80b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61bd693640 1 --2- 172.21.15.49:0/1538728560 >> v2:172.21.15.115:3300/0 conn(0x7f61b8146c40 0x7f61b8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61affff640 1 -- 172.21.15.49:0/1538728560 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798651257 0 0) 0x7f61b80b7d00 con 0x7f61b80b7360 2023-12-19T05:50:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.704+0000 7f61affff640 1 -- 172.21.15.49:0/1538728560 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a4003520 con 0x7f61b80b7360 2023-12-19T05:50:26.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.705+0000 7f61bde94640 1 -- 172.21.15.49:0/1538728560 >> v2:172.21.15.115:3300/0 conn(0x7f61b8146c40 msgr2=0x7f61b8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:26.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.705+0000 7f61bde94640 1 --2- 172.21.15.49:0/1538728560 >> v2:172.21.15.115:3300/0 conn(0x7f61b8146c40 0x7f61b8070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.705+0000 7f61bde94640 1 -- 172.21.15.49:0/1538728560 >> v1:172.21.15.49:6789/0 conn(0x7f61b80b7360 legacy=0x7f61b8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.705+0000 7f61bde94640 1 -- 172.21.15.49:0/1538728560 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b806f440 con 0x7f61b80d08f0 2023-12-19T05:50:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.706+0000 7f61bde94640 1 --2- 172.21.15.49:0/1538728560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b80b77c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb231a52eed8fac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61affff640 1 -- 172.21.15.49:0/1538728560 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b002cc60 con 0x7f61b80d08f0 2023-12-19T05:50:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61affff640 1 -- 172.21.15.49:0/1538728560 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b002cdc0 con 0x7f61b80d08f0 2023-12-19T05:50:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61affff640 1 -- 172.21.15.49:0/1538728560 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0034640 con 0x7f61b80d08f0 2023-12-19T05:50:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 -- 172.21.15.49:0/1538728560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 msgr2=0x7f61b80b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 --2- 172.21.15.49:0/1538728560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b80b77c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b002beb0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 -- 172.21.15.49:0/1538728560 shutdown_connections 2023-12-19T05:50:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 --2- 172.21.15.49:0/1538728560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b80b77c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 --2- 172.21.15.49:0/1538728560 >> v2:172.21.15.115:3300/0 conn(0x7f61b8146c40 0x7f61b8070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 -- 172.21.15.49:0/1538728560 >> 172.21.15.49:0/1538728560 conn(0x7f61b80d31b0 msgr2=0x7f61b80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.707+0000 7f61be695640 1 -- 172.21.15.49:0/1538728560 shutdown_connections 2023-12-19T05:50:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.708+0000 7f61be695640 1 -- 172.21.15.49:0/1538728560 wait complete. 2023-12-19T05:50:26.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.709+0000 7f61be695640 1 Processor -- start 2023-12-19T05:50:26.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.709+0000 7f61be695640 1 -- start start 2023-12-19T05:50:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61b80b7360 0x7f61b813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b813ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b813b490 con 0x7f61b8146c40 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8141f60 con 0x7f61b80b7360 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.710+0000 7f61be695640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81419a0 con 0x7f61b80d08f0 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59724/0 (socket says 172.21.15.49:59724) 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 -- 172.21.15.49:0/1179079376 learned_addr learned my addr 172.21.15.49:0/1179079376 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bce92640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b813ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 -- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 msgr2=0x7f61b813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bd693640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61b80b7360 0x7f61b813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b813ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 -- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61b80b7360 msgr2=0x7f61b813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61b80b7360 0x7f61b813af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.711+0000 7f61bde94640 1 -- 172.21.15.49:0/1179079376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0009a70 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61bde94640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0004880 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0009450 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0034640 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b8141c80 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.712+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b813c420 con 0x7f61b8146c40 2023-12-19T05:50:26.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.713+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b813c610 con 0x7f61b8146c40 2023-12-19T05:50:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.715+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61b003b030 con 0x7f61b8146c40 2023-12-19T05:50:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.715+0000 7f61adffb640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 0x7f619c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.716+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61b00aa7d0 con 0x7f61b8146c40 2023-12-19T05:50:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.716+0000 7f61bd693640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 0x7f619c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.717+0000 7f61bd693640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 0x7f619c06c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b7290 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.721+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61b0076170 con 0x7f61b8146c40 2023-12-19T05:50:26.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.924+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f61b8061910 con 0x7f61b8146c40 2023-12-19T05:50:26.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.933+0000 7f61adffb640 1 -- 172.21.15.49:0/1179079376 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f61b0079790 con 0x7f61b8146c40 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 msgr2=0x7f619c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 0x7f619c06c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b7290 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 msgr2=0x7f61b80b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b0004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 shutdown_connections 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f619c06a430 0x7f619c06c8f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61b80d08f0 0x7f61b813ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8146c40 0x7f61b80b5110 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 --2- 172.21.15.49:0/1179079376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61b80b7360 0x7f61b813af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.936+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 >> 172.21.15.49:0/1179079376 conn(0x7f61b80d31b0 msgr2=0x7f61b8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.937+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 shutdown_connections 2023-12-19T05:50:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:26.937+0000 7f61be695640 1 -- 172.21.15.49:0/1179079376 wait complete. 2023-12-19T05:50:26.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-19T05:50:27.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.176+0000 7f46fd8b2640 1 Processor -- start 2023-12-19T05:50:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.176+0000 7f46fd8b2640 1 -- start start 2023-12-19T05:50:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.177+0000 7f46fd8b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f80b0b50 0x7f46f806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.177+0000 7f46fd8b2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 0x7f46f806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.177+0000 7f46fd8b2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f806bb30 con 0x7f46f81449e0 2023-12-19T05:50:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.177+0000 7f46fd8b2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80b0070 con 0x7f46f80b0b50 2023-12-19T05:50:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.177+0000 7f46fd8b2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80b0350 con 0x7f46f806b590 2023-12-19T05:50:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f80b0b50 0x7f46f806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f80b0b50 0x7f46f806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59726/0 (socket says 172.21.15.49:59726) 2023-12-19T05:50:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 -- 172.21.15.49:0/2869016245 learned_addr learned my addr 172.21.15.49:0/2869016245 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f77fe640 1 --2- 172.21.15.49:0/2869016245 >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 0x7f46f806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 -- 172.21.15.49:0/2869016245 >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 msgr2=0x7f46f806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 --2- 172.21.15.49:0/2869016245 >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 0x7f46f806c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 -- 172.21.15.49:0/2869016245 >> v1:172.21.15.115:6789/0 conn(0x7f46f81449e0 legacy=0x7f46f80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f67fc640 1 -- 172.21.15.49:0/2869016245 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80b0630 con 0x7f46f80b0b50 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.178+0000 7f46f77fe640 1 --2- 172.21.15.49:0/2869016245 >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 0x7f46f806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.180+0000 7f46f67fc640 1 --2- 172.21.15.49:0/2869016245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f806bfa0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f46f80b1270 tx=0x7f46e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35191f373467f9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.180+0000 7f46f5ffb640 1 -- 172.21.15.49:0/2869016245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e002ca80 con 0x7f46f80b0b50 2023-12-19T05:50:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.180+0000 7f46f5ffb640 1 -- 172.21.15.49:0/2869016245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e002cbe0 con 0x7f46f80b0b50 2023-12-19T05:50:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.180+0000 7f46f5ffb640 1 -- 172.21.15.49:0/2869016245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e00343f0 con 0x7f46f80b0b50 2023-12-19T05:50:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 -- 172.21.15.49:0/2869016245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 msgr2=0x7f46f806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/2869016245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f806bfa0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f46f80b1270 tx=0x7f46e002bee0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 -- 172.21.15.49:0/2869016245 shutdown_connections 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/2869016245 >> v2:172.21.15.115:3300/0 conn(0x7f46f806b590 0x7f46f806c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/2869016245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f806bfa0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 -- 172.21.15.49:0/2869016245 >> 172.21.15.49:0/2869016245 conn(0x7f46f80cbb70 msgr2=0x7f46f80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 -- 172.21.15.49:0/2869016245 shutdown_connections 2023-12-19T05:50:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.181+0000 7f46fd8b2640 1 -- 172.21.15.49:0/2869016245 wait complete. 2023-12-19T05:50:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.183+0000 7f46fd8b2640 1 Processor -- start 2023-12-19T05:50:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.183+0000 7f46fd8b2640 1 -- start start 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 0x7f46f813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f81449e0 0x7f46f814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81507a0 con 0x7f46f80b0b50 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81590f0 con 0x7f46f806b590 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46fd8b2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81593d0 con 0x7f46f81449e0 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46f67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46f67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59732/0 (socket says 172.21.15.49:59732) 2023-12-19T05:50:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.184+0000 7f46f67fc640 1 -- 172.21.15.49:0/4073287150 learned_addr learned my addr 172.21.15.49:0/4073287150 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f77fe640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f81449e0 0x7f46f814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 -- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f81449e0 msgr2=0x7f46f814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f81449e0 0x7f46f814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 -- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 msgr2=0x7f46f813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f6ffd640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 0x7f46f813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 0x7f46f813a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 -- 172.21.15.49:0/4073287150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0009b30 con 0x7f46f80b0b50 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f6ffd640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 0x7f46f813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46f67fc640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000f80 tx=0x7f46e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e003e450 con 0x7f46f80b0b50 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e003e5f0 con 0x7f46f80b0b50 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f81596b0 con 0x7f46f80b0b50 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.185+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e003e9a0 con 0x7f46f80b0b50 2023-12-19T05:50:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.186+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f8159c70 con 0x7f46f80b0b50 2023-12-19T05:50:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.187+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f8159e60 con 0x7f46f80b0b50 2023-12-19T05:50:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.188+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f46e002cd50 con 0x7f46f80b0b50 2023-12-19T05:50:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.189+0000 7f46effff640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 0x7f46d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.189+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f46e00ab260 con 0x7f46f80b0b50 2023-12-19T05:50:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.189+0000 7f46f6ffd640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 0x7f46d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:27.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.190+0000 7f46f6ffd640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 0x7f46d806c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46f815a340 tx=0x7f46e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.193+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f46e0076b40 con 0x7f46f80b0b50 2023-12-19T05:50:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:27.459+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f46f8061910 con 0x7f46f80b0b50 2023-12-19T05:50:28.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.449+0000 7f46effff640 1 -- 172.21.15.49:0/4073287150 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v551) v1 ==== 132+0+0 (secure 0 0 0) 0x7f46e007a160 con 0x7f46f80b0b50 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 msgr2=0x7f46d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 0x7f46d806c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46f815a340 tx=0x7f46e8008040 comp rx=0 tx=0).stop 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 msgr2=0x7f46f814f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000f80 tx=0x7f46e0004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 shutdown_connections 2023-12-19T05:50:28.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46d806a430 0x7f46d806c8f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f81449e0 0x7f46f814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f80b0b50 0x7f46f814f8d0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 --2- 172.21.15.49:0/4073287150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f806b590 0x7f46f813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.453+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 >> 172.21.15.49:0/4073287150 conn(0x7f46f80cbb70 msgr2=0x7f46f80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.454+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 shutdown_connections 2023-12-19T05:50:28.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.454+0000 7f46fd8b2640 1 -- 172.21.15.49:0/4073287150 wait complete. 2023-12-19T05:50:28.477 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T05:50:28.478 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-12-19T05:50:28.478 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T05:50:28.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.714+0000 7ff140dce640 1 Processor -- start 2023-12-19T05:50:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.714+0000 7ff140dce640 1 -- start start 2023-12-19T05:50:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.715+0000 7ff140dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 0x7ff13c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.715+0000 7ff140dce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c0b0b50 0x7ff13c06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.715+0000 7ff140dce640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0afb10 con 0x7ff13c06b590 2023-12-19T05:50:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.715+0000 7ff140dce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c06bb30 con 0x7ff13c0b0b50 2023-12-19T05:50:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.715+0000 7ff140dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b0070 con 0x7ff13c1449e0 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c0b0b50 0x7ff13c06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c0b0b50 0x7ff13c06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59738/0 (socket says 172.21.15.49:59738) 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 -- 172.21.15.49:0/3670067006 learned_addr learned my addr 172.21.15.49:0/3670067006 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 -- 172.21.15.49:0/3670067006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 msgr2=0x7ff13c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff13a59c640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 0x7ff13c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 0x7ff13c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 -- 172.21.15.49:0/3670067006 >> v1:172.21.15.115:6789/0 conn(0x7ff13c06b590 legacy=0x7ff13c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff131d9b640 1 -- 172.21.15.49:0/3670067006 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0b0350 con 0x7ff13c0b0b50 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.716+0000 7ff13a59c640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 0x7ff13c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.717+0000 7ff131d9b640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0b0b50 0x7ff13c06bfa0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b72330adf22c694 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff139d9b640 1 -- 172.21.15.49:0/3670067006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124031640 con 0x7ff13c0b0b50 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff139d9b640 1 -- 172.21.15.49:0/3670067006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240317a0 con 0x7ff13c0b0b50 2023-12-19T05:50:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff139d9b640 1 -- 172.21.15.49:0/3670067006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124031b30 con 0x7ff13c0b0b50 2023-12-19T05:50:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 -- 172.21.15.49:0/3670067006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0b0b50 msgr2=0x7ff13c06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0b0b50 0x7ff13c06bfa0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 -- 172.21.15.49:0/3670067006 shutdown_connections 2023-12-19T05:50:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0b0b50 0x7ff13c06bfa0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 --2- 172.21.15.49:0/3670067006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c1449e0 0x7ff13c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.718+0000 7ff140dce640 1 -- 172.21.15.49:0/3670067006 >> 172.21.15.49:0/3670067006 conn(0x7ff13c0cbb70 msgr2=0x7ff13c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.719+0000 7ff140dce640 1 -- 172.21.15.49:0/3670067006 shutdown_connections 2023-12-19T05:50:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.719+0000 7ff140dce640 1 -- 172.21.15.49:0/3670067006 wait complete. 2023-12-19T05:50:28.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.720+0000 7ff140dce640 1 Processor -- start 2023-12-19T05:50:28.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.720+0000 7ff140dce640 1 -- start start 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.721+0000 7ff140dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 0x7ff13c1f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.721+0000 7ff140dce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 0x7ff13c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff140dce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff140dce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1f2aa0 con 0x7ff13c1449e0 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff140dce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15d6e0 con 0x7ff13c0b0b50 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff140dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15d9c0 con 0x7ff13c06b590 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59750/0 (socket says 172.21.15.49:59750) 2023-12-19T05:50:28.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 -- 172.21.15.49:0/2602559303 learned_addr learned my addr 172.21.15.49:0/2602559303 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13a59c640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 0x7ff13c1f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff131d9b640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 0x7ff13c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 -- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 msgr2=0x7ff13c1f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 0x7ff13c1f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 -- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 msgr2=0x7ff13c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 0x7ff13c0ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13ad9d640 1 -- 172.21.15.49:0/2602559303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094d0 con 0x7ff13c1449e0 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff13a59c640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 0x7ff13c1f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.722+0000 7ff131d9b640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 0x7ff13c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff13ad9d640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134004b60 con 0x7ff13c1449e0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400ce90 con 0x7ff13c1449e0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400a850 con 0x7ff13c1449e0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c15dca0 con 0x7ff13c1449e0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.723+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c1f3b30 con 0x7ff13c1449e0 2023-12-19T05:50:28.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.724+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c15e1c0 con 0x7ff13c1449e0 2023-12-19T05:50:28.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.725+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff13400a9b0 con 0x7ff13c1449e0 2023-12-19T05:50:28.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.726+0000 7ff1337fe640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 0x7ff11c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:28.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.726+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff1340888b0 con 0x7ff13c1449e0 2023-12-19T05:50:28.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.727+0000 7ff13a59c640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 0x7ff11c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.728+0000 7ff13a59c640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 0x7ff11c06c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006fd0 tx=0x7ff12c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.731+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff13c15e1c0 con 0x7ff13c1449e0 2023-12-19T05:50:28.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:28.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:28.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.931+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff13c15e1c0 con 0x7ff13c1449e0 2023-12-19T05:50:28.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.933+0000 7ff1337fe640 1 -- 172.21.15.49:0/2602559303 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+12527 (secure 0 0 0) 0x7ff13c15e1c0 con 0x7ff13c1449e0 2023-12-19T05:50:28.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:28.936 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":167,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:26.428635+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/508042264":"2023-12-20T05:50:22.927867+0000","172.21.15.49:6832/508042264":"2023-12-20T05:50:22.927867+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 msgr2=0x7ff11c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 0x7ff11c06c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006fd0 tx=0x7ff12c008040 comp rx=0 tx=0).stop 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 msgr2=0x7ff13c0ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400cc40 comp rx=0 tx=0).stop 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 shutdown_connections 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff11c06a430 0x7ff11c06c8f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c1449e0 0x7ff13c0ce7c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff13c0b0b50 0x7ff13c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 --2- 172.21.15.49:0/2602559303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13c06b590 0x7ff13c1f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:28.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 >> 172.21.15.49:0/2602559303 conn(0x7ff13c0cbb70 msgr2=0x7ff13c06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:28.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 shutdown_connections 2023-12-19T05:50:28.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:28.936+0000 7ff140dce640 1 -- 172.21.15.49:0/2602559303 wait complete. 2023-12-19T05:50:28.957 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:50:28.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.185+0000 7f157899e640 1 Processor -- start 2023-12-19T05:50:29.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.185+0000 7f157899e640 1 -- start start 2023-12-19T05:50:29.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157899e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f157406f490 0x7f157406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157899e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157406fe30 con 0x7f15740d1670 2023-12-19T05:50:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157899e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1574070260 con 0x7f1574146cd0 2023-12-19T05:50:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157899e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15741470b0 con 0x7f157406f490 2023-12-19T05:50:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157359e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15740d1670 0x7f15740d1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58988/0 (socket says 172.21.15.49:58988) 2023-12-19T05:50:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.187+0000 7f157359e640 1 -- 172.21.15.49:0/338590713 learned_addr learned my addr 172.21.15.49:0/338590713 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f156bfff640 1 --2- 172.21.15.49:0/338590713 >> v2:172.21.15.115:3300/0 conn(0x7f157406f490 0x7f157406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233330860 0 0) 0x7f157406fe30 con 0x7f15740d1670 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1560003520 con 0x7f15740d1670 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2811010940 0 0) 0x7f1560003520 con 0x7f15740d1670 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 >> v2:172.21.15.115:3300/0 conn(0x7f157406f490 msgr2=0x7f157406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 --2- 172.21.15.49:0/338590713 >> v2:172.21.15.115:3300/0 conn(0x7f157406f490 0x7f157406f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 >> v1:172.21.15.115:6789/0 conn(0x7f1574146cd0 legacy=0x7f15740b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740b6ea0 con 0x7f15740d1670 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f156c0019f0 con 0x7f15740d1670 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 >> v1:172.21.15.49:6789/0 conn(0x7f15740d1670 legacy=0x7f15740d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1560003970 0x7f1560003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15600047c0 0x7f1560004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f156000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15741470b0 con 0x7f15600052a0 2023-12-19T05:50:29.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156000c170 con 0x7f1560003970 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.188+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156000c330 con 0x7f15600047c0 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f156000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f1572d9d640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1560003970 0x7f1560003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f156bfff640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15600047c0 0x7f1560004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 -- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15600047c0 msgr2=0x7f1560004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15600047c0 0x7f1560004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 -- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1560003970 msgr2=0x7f1560003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1560003970 0x7f1560003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.189+0000 7f157359e640 1 -- 172.21.15.49:0/338590713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560003520 con 0x7f15600052a0 2023-12-19T05:50:29.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.190+0000 7f157359e640 1 -- 172.21.15.49:0/338590713 reap_dead start 2023-12-19T05:50:29.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.190+0000 7f157359e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f156000b980 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f156c00a800 tx=0x7f15600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb890d1f378131d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c0072d0 con 0x7f15600052a0 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c02f070 con 0x7f15600052a0 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157259c640 1 -- 172.21.15.49:0/338590713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c007670 con 0x7f15600052a0 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 -- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 msgr2=0x7f156000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f156000b980 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f156c00a800 tx=0x7f15600057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 -- 172.21.15.49:0/338590713 shutdown_connections 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 --2- 172.21.15.49:0/338590713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f156000b980 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 -- 172.21.15.49:0/338590713 >> 172.21.15.49:0/338590713 conn(0x7f15740d3200 msgr2=0x7f15740d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 -- 172.21.15.49:0/338590713 shutdown_connections 2023-12-19T05:50:29.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.191+0000 7f157899e640 1 -- 172.21.15.49:0/338590713 wait complete. 2023-12-19T05:50:29.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.193+0000 7f157899e640 1 Processor -- start 2023-12-19T05:50:29.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.193+0000 7f157899e640 1 -- start start 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1574160fa0 0x7f1574161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 0x7f15740b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740b6b20 con 0x7f15600052a0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574161960 con 0x7f15740b51e0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.194+0000 7f157899e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740b5fa0 con 0x7f1574160fa0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59762/0 (socket says 172.21.15.49:59762) 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 -- 172.21.15.49:0/4269547808 learned_addr learned my addr 172.21.15.49:0/4269547808 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f156bfff640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1574160fa0 0x7f1574161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f157359e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 0x7f15740b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 -- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1574160fa0 msgr2=0x7f1574161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1574160fa0 0x7f1574161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 -- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 msgr2=0x7f15740b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 0x7f15740b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f1572d9d640 1 -- 172.21.15.49:0/4269547808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740b6280 con 0x7f15600052a0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.195+0000 7f157359e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 0x7f15740b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f1572d9d640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f156400e4d0 tx=0x7f156400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640052e0 con 0x7f15600052a0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564005440 con 0x7f15600052a0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564003810 con 0x7f15600052a0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15740b6560 con 0x7f15600052a0 2023-12-19T05:50:29.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.196+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157413d4b0 con 0x7f15600052a0 2023-12-19T05:50:29.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.197+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1574061910 con 0x7f15600052a0 2023-12-19T05:50:29.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.198+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1564003970 con 0x7f15600052a0 2023-12-19T05:50:29.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.200+0000 7f156b7fe640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 0x7f155406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.200+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f15640883e0 con 0x7f15600052a0 2023-12-19T05:50:29.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.200+0000 7f156bfff640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 0x7f155406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.201+0000 7f156bfff640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 0x7f155406c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f15741f6270 tx=0x7f155c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.205+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1564053c30 con 0x7f15600052a0 2023-12-19T05:50:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.399+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f157415e710 con 0x7f15600052a0 2023-12-19T05:50:29.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.400+0000 7f156b7fe640 1 -- 172.21.15.49:0/4269547808 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1564057250 con 0x7f15600052a0 2023-12-19T05:50:29.401 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.402+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 msgr2=0x7f155406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.402+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 0x7f155406c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f15741f6270 tx=0x7f155c008040 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.402+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 msgr2=0x7f157413cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.402+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f156400e4d0 tx=0x7f156400e990 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 shutdown_connections 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f155406a460 0x7f155406c920 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1574160fa0 0x7f1574161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15740b51e0 0x7f15740b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 --2- 172.21.15.49:0/4269547808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15600052a0 0x7f157413cf70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 >> 172.21.15.49:0/4269547808 conn(0x7f15740d3200 msgr2=0x7f15740b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 shutdown_connections 2023-12-19T05:50:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.403+0000 7f157899e640 1 -- 172.21.15.49:0/4269547808 wait complete. 2023-12-19T05:50:29.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-19T05:50:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.655+0000 7ffa5f0b6640 1 Processor -- start 2023-12-19T05:50:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.655+0000 7ffa5f0b6640 1 -- start start 2023-12-19T05:50:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.656+0000 7ffa5f0b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa5815d620 0x7ffa580cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.656+0000 7ffa5f0b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815da00 0x7ffa580cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.656+0000 7ffa5f0b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 0x7ffa580b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5f0b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580b4120 con 0x7ffa5815d620 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5f0b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580b6ee0 con 0x7ffa580b6160 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5f0b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580b71c0 con 0x7ffa5815da00 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5e0b4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa5815d620 0x7ffa580cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5e0b4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa5815d620 0x7ffa580cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59766/0 (socket says 172.21.15.49:59766) 2023-12-19T05:50:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/2341742923 learned_addr learned my addr 172.21.15.49:0/2341742923 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5d8b3640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815da00 0x7ffa580cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5e8b5640 1 --2- 172.21.15.49:0/2341742923 >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 0x7ffa580b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.657+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/2341742923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815da00 msgr2=0x7ffa580cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.658+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815da00 0x7ffa580cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.658+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/2341742923 >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 msgr2=0x7ffa580b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.658+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/2341742923 >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 0x7ffa580b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.658+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/2341742923 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580b4370 con 0x7ffa5815d620 2023-12-19T05:50:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.658+0000 7ffa5e8b5640 1 --2- 172.21.15.49:0/2341742923 >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 0x7ffa580b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.659+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa5815d620 0x7ffa580cef60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ffa580d30a0 tx=0x7ffa4c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0228de8d89ea656 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.659+0000 7ffa5d0b2640 1 -- 172.21.15.49:0/2341742923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c02cb00 con 0x7ffa5815d620 2023-12-19T05:50:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.659+0000 7ffa5d0b2640 1 -- 172.21.15.49:0/2341742923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c02cc60 con 0x7ffa5815d620 2023-12-19T05:50:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.659+0000 7ffa5d0b2640 1 -- 172.21.15.49:0/2341742923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0343f0 con 0x7ffa5815d620 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/2341742923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa5815d620 msgr2=0x7ffa580cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa5815d620 0x7ffa580cef60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ffa580d30a0 tx=0x7ffa4c02bf60 comp rx=0 tx=0).stop 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/2341742923 shutdown_connections 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/2341742923 >> v2:172.21.15.115:3300/0 conn(0x7ffa580b6160 0x7ffa580b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815da00 0x7ffa580cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/2341742923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa5815d620 0x7ffa580cef60 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/2341742923 >> 172.21.15.49:0/2341742923 conn(0x7ffa580cfb90 msgr2=0x7ffa580cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/2341742923 shutdown_connections 2023-12-19T05:50:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.660+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/2341742923 wait complete. 2023-12-19T05:50:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.662+0000 7ffa5f0b6640 1 Processor -- start 2023-12-19T05:50:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.663+0000 7ffa5f0b6640 1 -- start start 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815d620 0x7ffa5814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5815da00 0x7ffa58156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815f7f0 con 0x7ffa580b6160 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58157440 con 0x7ffa5815da00 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5f0b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815f9e0 con 0x7ffa5815d620 2023-12-19T05:50:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5e0b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5e0b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59772/0 (socket says 172.21.15.49:59772) 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.664+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/1771028793 learned_addr learned my addr 172.21.15.49:0/1771028793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5d8b3640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815d620 0x7ffa5814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e8b5640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5815da00 0x7ffa58156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815d620 msgr2=0x7ffa5814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815d620 0x7ffa5814ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5815da00 msgr2=0x7ffa58156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5815da00 0x7ffa58156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 -- 172.21.15.49:0/1771028793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009b30 con 0x7ffa580b6160 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa5e0b4640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c000f80 tx=0x7ffa4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.665+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c009510 con 0x7ffa580b6160 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.666+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c03e450 con 0x7ffa580b6160 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.666+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c03e800 con 0x7ffa580b6160 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.666+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5815fcc0 con 0x7ffa580b6160 2023-12-19T05:50:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.666+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58160280 con 0x7ffa580b6160 2023-12-19T05:50:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.667+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa580d14c0 con 0x7ffa580b6160 2023-12-19T05:50:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.668+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa4c03e960 con 0x7ffa580b6160 2023-12-19T05:50:29.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.669+0000 7ffa56ffd640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 0x7ffa3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.669+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa4c0ab4c0 con 0x7ffa580b6160 2023-12-19T05:50:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.670+0000 7ffa5d8b3640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 0x7ffa3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.671+0000 7ffa5d8b3640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 0x7ffa3c06c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa44006fd0 tx=0x7ffa44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:29.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.674+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffa4c076d10 con 0x7ffa580b6160 2023-12-19T05:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:29.950+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7ffa58061910 con 0x7ffa580b6160 2023-12-19T05:50:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.463+0000 7ffa56ffd640 1 -- 172.21.15.49:0/1771028793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v553) v1 ==== 134+0+0 (secure 0 0 0) 0x7ffa4c07a330 con 0x7ffa580b6160 2023-12-19T05:50:30.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 msgr2=0x7ffa3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 0x7ffa3c06c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa44006fd0 tx=0x7ffa44008040 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 msgr2=0x7ffa58158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c000f80 tx=0x7ffa4c004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 shutdown_connections 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffa3c06a430 0x7ffa3c06c8f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa5815d620 0x7ffa5814ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5815da00 0x7ffa58156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 --2- 172.21.15.49:0/1771028793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa580b6160 0x7ffa58158770 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 >> 172.21.15.49:0/1771028793 conn(0x7ffa580cfb90 msgr2=0x7ffa58070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 shutdown_connections 2023-12-19T05:50:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.467+0000 7ffa5f0b6640 1 -- 172.21.15.49:0/1771028793 wait complete. 2023-12-19T05:50:30.492 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:50:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.728+0000 7fb3f5f88640 1 Processor -- start 2023-12-19T05:50:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.728+0000 7fb3f5f88640 1 -- start start 2023-12-19T05:50:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.729+0000 7fb3f5f88640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3f015b1d0 0x7fb3f00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3f5f88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3f00ceea0 0x7fb3f00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3f5f88640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f015fde0 con 0x7fb3f00b1ec0 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3f5f88640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f00cf870 con 0x7fb3f00ceea0 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3f5f88640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f015ef10 con 0x7fb3f015b1d0 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3effff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3f00ceea0 0x7fb3f00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3effff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3f00ceea0 0x7fb3f00cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59786/0 (socket says 172.21.15.49:59786) 2023-12-19T05:50:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3effff640 1 -- 172.21.15.49:0/436411325 learned_addr learned my addr 172.21.15.49:0/436411325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.730+0000 7fb3ef7fe640 1 --2- 172.21.15.49:0/436411325 >> v2:172.21.15.115:3300/0 conn(0x7fb3f015b1d0 0x7fb3f00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.731+0000 7fb3effff640 1 -- 172.21.15.49:0/436411325 >> v2:172.21.15.115:3300/0 conn(0x7fb3f015b1d0 msgr2=0x7fb3f00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.731+0000 7fb3effff640 1 --2- 172.21.15.49:0/436411325 >> v2:172.21.15.115:3300/0 conn(0x7fb3f015b1d0 0x7fb3f00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.731+0000 7fb3effff640 1 -- 172.21.15.49:0/436411325 >> v1:172.21.15.49:6789/0 conn(0x7fb3f00b1ec0 legacy=0x7fb3f015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.731+0000 7fb3ee7fc640 1 -- 172.21.15.49:0/436411325 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827127216 0 0) 0x7fb3f015fde0 con 0x7fb3f00b1ec0 2023-12-19T05:50:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.731+0000 7fb3effff640 1 -- 172.21.15.49:0/436411325 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00b2320 con 0x7fb3f00ceea0 2023-12-19T05:50:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.732+0000 7fb3effff640 1 --2- 172.21.15.49:0/436411325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cf330 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00ae020 tx=0x7fb3e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831d4857627dc02e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.732+0000 7fb3ee7fc640 1 -- 172.21.15.49:0/436411325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e802cb20 con 0x7fb3f00ceea0 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.732+0000 7fb3ee7fc640 1 -- 172.21.15.49:0/436411325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e802cc80 con 0x7fb3f00ceea0 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.732+0000 7fb3ee7fc640 1 -- 172.21.15.49:0/436411325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80343f0 con 0x7fb3f00ceea0 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 -- 172.21.15.49:0/436411325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f00ceea0 msgr2=0x7fb3f00cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/436411325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cf330 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00ae020 tx=0x7fb3e802bf80 comp rx=0 tx=0).stop 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 -- 172.21.15.49:0/436411325 shutdown_connections 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/436411325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cf330 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/436411325 >> v2:172.21.15.115:3300/0 conn(0x7fb3f015b1d0 0x7fb3f00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 -- 172.21.15.49:0/436411325 >> 172.21.15.49:0/436411325 conn(0x7fb3f0073150 msgr2=0x7fb3f00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 -- 172.21.15.49:0/436411325 shutdown_connections 2023-12-19T05:50:30.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.733+0000 7fb3f5f88640 1 -- 172.21.15.49:0/436411325 wait complete. 2023-12-19T05:50:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.735+0000 7fb3f5f88640 1 Processor -- start 2023-12-19T05:50:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.735+0000 7fb3f5f88640 1 -- start start 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3f00b1ec0 0x7fb3f015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00cd4f0 con 0x7fb3f015b1d0 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0148270 con 0x7fb3f00ceea0 2023-12-19T05:50:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3f5f88640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00c83d0 con 0x7fb3f00b1ec0 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59796/0 (socket says 172.21.15.49:59796) 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3effff640 1 -- 172.21.15.49:0/2845363690 learned_addr learned my addr 172.21.15.49:0/2845363690 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.736+0000 7fb3eeffd640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3ef7fe640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3f00b1ec0 0x7fb3f015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 -- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3f00b1ec0 msgr2=0x7fb3f015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3f00b1ec0 0x7fb3f015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 -- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 msgr2=0x7fb3f00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 -- 172.21.15.49:0/2845363690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009b30 con 0x7fb3f015b1d0 2023-12-19T05:50:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3eeffd640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3effff640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8036040 tx=0x7fb3e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8009510 con 0x7fb3f015b1d0 2023-12-19T05:50:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e803e450 con 0x7fb3f015b1d0 2023-12-19T05:50:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e803e5e0 con 0x7fb3f015b1d0 2023-12-19T05:50:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.737+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f00cc8e0 con 0x7fb3f015b1d0 2023-12-19T05:50:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.738+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f00cc320 con 0x7fb3f015b1d0 2023-12-19T05:50:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.739+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f00c8560 con 0x7fb3f015b1d0 2023-12-19T05:50:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.740+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3e803e740 con 0x7fb3f015b1d0 2023-12-19T05:50:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.740+0000 7fb3d7fff640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 0x7fb3dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.741+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb3e80aada0 con 0x7fb3f015b1d0 2023-12-19T05:50:30.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.741+0000 7fb3ef7fe640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 0x7fb3dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.742+0000 7fb3ef7fe640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 0x7fb3dc06c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0006fd0 tx=0x7fb3e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.745+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb3e8076690 con 0x7fb3f015b1d0 2023-12-19T05:50:30.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.943+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb3f0061910 con 0x7fb3f015b1d0 2023-12-19T05:50:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.951+0000 7fb3d7fff640 1 -- 172.21.15.49:0/2845363690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb3e8079cb0 con 0x7fb3f015b1d0 2023-12-19T05:50:30.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.953+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 msgr2=0x7fb3dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.953+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 0x7fb3dc06c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0006fd0 tx=0x7fb3e0008040 comp rx=0 tx=0).stop 2023-12-19T05:50:30.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 msgr2=0x7fb3f00c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8036040 tx=0x7fb3e8004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 shutdown_connections 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb3dc06a430 0x7fb3dc06c8f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3f015b1d0 0x7fb3f00c9e40 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3f00ceea0 0x7fb3f00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 --2- 172.21.15.49:0/2845363690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3f00b1ec0 0x7fb3f015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 >> 172.21.15.49:0/2845363690 conn(0x7fb3f0073150 msgr2=0x7fb3f00b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 shutdown_connections 2023-12-19T05:50:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:30.954+0000 7fb3f5f88640 1 -- 172.21.15.49:0/2845363690 wait complete. 2023-12-19T05:50:30.977 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:50:30.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:50:31.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:50:31.221 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:50:31.221 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:31.221 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:31.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:50:31.287 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:31.287 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:31.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:50:31.346 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:31.346 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:31.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:50:31.413 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:31.413 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:31.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:50:31.473 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:50:31.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:31.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.712+0000 7fb15a5c1640 1 Processor -- start 2023-12-19T05:50:31.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.713+0000 7fb15a5c1640 1 -- start start 2023-12-19T05:50:31.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb15a5c1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb15415e5a0 0x7fb1540b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb15a5c1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415f680 0x7fb1540b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb15a5c1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15415ec30 con 0x7fb1540cdbf0 2023-12-19T05:50:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb15a5c1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1540b2cc0 con 0x7fb15415e5a0 2023-12-19T05:50:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb15a5c1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15415e980 con 0x7fb15415f680 2023-12-19T05:50:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.714+0000 7fb1595bf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb15415e5a0 0x7fb1540b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb15415e5a0 0x7fb1540b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59804/0 (socket says 172.21.15.49:59804) 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 -- 172.21.15.49:0/2328417257 learned_addr learned my addr 172.21.15.49:0/2328417257 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb158dbe640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415f680 0x7fb1540b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 -- 172.21.15.49:0/2328417257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415f680 msgr2=0x7fb1540b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415f680 0x7fb1540b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 -- 172.21.15.49:0/2328417257 >> v1:172.21.15.49:6789/0 conn(0x7fb1540cdbf0 legacy=0x7fb15406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.715+0000 7fb1595bf640 1 -- 172.21.15.49:0/2328417257 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540b2f90 con 0x7fb15415e5a0 2023-12-19T05:50:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.716+0000 7fb1595bf640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15415e5a0 0x7fb1540b2030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb150009870 tx=0x7fb15002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657172d3e08f1bef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.716+0000 7fb14bfff640 1 -- 172.21.15.49:0/2328417257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150030840 con 0x7fb15415e5a0 2023-12-19T05:50:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb14bfff640 1 -- 172.21.15.49:0/2328417257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500309a0 con 0x7fb15415e5a0 2023-12-19T05:50:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb14bfff640 1 -- 172.21.15.49:0/2328417257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150030d30 con 0x7fb15415e5a0 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 -- 172.21.15.49:0/2328417257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15415e5a0 msgr2=0x7fb1540b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15415e5a0 0x7fb1540b2030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb150009870 tx=0x7fb15002b980 comp rx=0 tx=0).stop 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 -- 172.21.15.49:0/2328417257 shutdown_connections 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415f680 0x7fb1540b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/2328417257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15415e5a0 0x7fb1540b2030 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 -- 172.21.15.49:0/2328417257 >> 172.21.15.49:0/2328417257 conn(0x7fb1540b0100 msgr2=0x7fb1540b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 -- 172.21.15.49:0/2328417257 shutdown_connections 2023-12-19T05:50:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.717+0000 7fb15a5c1640 1 -- 172.21.15.49:0/2328417257 wait complete. 2023-12-19T05:50:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.719+0000 7fb15a5c1640 1 Processor -- start 2023-12-19T05:50:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.719+0000 7fb15a5c1640 1 -- start start 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415e5a0 0x7fb1540ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 0x7fb1540abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1541f16f0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540ac310 con 0x7fb15415f680 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb15a5c1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540a89b0 con 0x7fb15415e5a0 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.720+0000 7fb1595bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59816/0 (socket says 172.21.15.49:59816) 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 -- 172.21.15.49:0/314238180 learned_addr learned my addr 172.21.15.49:0/314238180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb158dbe640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415e5a0 0x7fb1540ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 -- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415e5a0 msgr2=0x7fb1540ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415e5a0 0x7fb1540ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 -- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 msgr2=0x7fb1540abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb159dc0640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 0x7fb1540abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 0x7fb1540abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb1595bf640 1 -- 172.21.15.49:0/314238180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500094d0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.721+0000 7fb159dc0640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 0x7fb1540abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb1595bf640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150039c90 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150039df0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150043640 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1541f1130 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.722+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1540a8640 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.723+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1540a84a0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.724+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb1500437a0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.725+0000 7fb149ffb640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 0x7fb13806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.725+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb15003e070 con 0x7fb1540cdbf0 2023-12-19T05:50:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.726+0000 7fb158dbe640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 0x7fb13806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.727+0000 7fb158dbe640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 0x7fb13806c920 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb144006fd0 tx=0x7fb144008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.730+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1540a84a0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.967+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1540a84a0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.968+0000 7fb149ffb640 1 -- 172.21.15.49:0/314238180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb150034de0 con 0x7fb1540cdbf0 2023-12-19T05:50:31.970 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:31.970 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1552481720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1552481720},{"type":"v1","addr":"172.21.15.115:6836","nonce":1552481720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4146470784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4146470784},{"type":"v1","addr":"172.21.15.115:6837","nonce":4146470784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/853263658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":853263658},{"type":"v1","addr":"172.21.15.49:6835","nonce":853263658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":8397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/3450047593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3450047593},{"type":"v1","addr":"172.21.15.49:6834","nonce":3450047593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[]} 2023-12-19T05:50:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 74 2023-12-19T05:50:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 msgr2=0x7fb13806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 0x7fb13806c920 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb144006fd0 tx=0x7fb144008040 comp rx=0 tx=0).stop 2023-12-19T05:50:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 msgr2=0x7fb1541f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150004730 comp rx=0 tx=0).stop 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 shutdown_connections 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb13806a460 0x7fb13806c920 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb15415e5a0 0x7fb1540ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb15415f680 0x7fb1540abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 --2- 172.21.15.49:0/314238180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1540cdbf0 0x7fb1541f0680 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.971+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 >> 172.21.15.49:0/314238180 conn(0x7fb1540b0100 msgr2=0x7fb1540b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.972+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 shutdown_connections 2023-12-19T05:50:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:31.972+0000 7fb15a5c1640 1 -- 172.21.15.49:0/314238180 wait complete. 2023-12-19T05:50:31.994 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:50:31.994 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:50:31.995 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:50:31.995 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:50:31.995 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:50:31.995 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:50:31.995 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:50:31.995 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:50:31.996 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:50:31.996 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:50:31.996 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:50:31.996 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:50:31.996 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:50:31.996 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:50:31.996 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:50:31.996 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:50:32.014 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:50:32.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:50:32.015 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:50:32.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:50:32.017 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:50:32.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:50:32.018 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:50:32.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:50:32.063 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:50:32.063 DEBUG:teuthology.parallel:result is None 2023-12-19T05:50:32.066 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:50:32.066 DEBUG:teuthology.parallel:result is None 2023-12-19T05:50:32.072 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:50:32.073 DEBUG:teuthology.parallel:result is None 2023-12-19T05:50:32.073 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:50:32.074 DEBUG:teuthology.parallel:result is None 2023-12-19T05:50:32.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:50:32.227 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:50:32.228 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:50:32.237 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:50:32.241 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:50:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.280+0000 7f480d1a4640 1 Processor -- start 2023-12-19T05:50:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.280+0000 7f480d1a4640 1 -- start start 2023-12-19T05:50:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480d1a4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480d1a4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48080ce110 0x7f48080ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480d1a4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080cd840 con 0x7f48080d2b00 2023-12-19T05:50:32.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480d1a4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48080d2430 con 0x7f48080ce110 2023-12-19T05:50:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480d1a4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48080ceae0 con 0x7f4808146e10 2023-12-19T05:50:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f48080d2b00 0x7f48080b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59032/0 (socket says 172.21.15.49:59032) 2023-12-19T05:50:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480659c640 1 -- 172.21.15.49:0/2707330186 learned_addr learned my addr 172.21.15.49:0/2707330186 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f480759e640 1 --2- 172.21.15.49:0/2707330186 >> v2:172.21.15.115:3300/0 conn(0x7f48080ce110 0x7f48080ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.282+0000 7f4806d9d640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f4805d9b640 1 -- 172.21.15.49:0/2707330186 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653726499 0 0) 0x7f48080cd840 con 0x7f48080d2b00 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f4805d9b640 1 -- 172.21.15.49:0/2707330186 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f0003520 con 0x7f48080d2b00 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f480759e640 1 -- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 msgr2=0x7f48080d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f480759e640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f480759e640 1 -- 172.21.15.49:0/2707330186 >> v1:172.21.15.49:6789/0 conn(0x7f48080d2b00 legacy=0x7f48080b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f480759e640 1 -- 172.21.15.49:0/2707330186 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080b6e90 con 0x7f48080ce110 2023-12-19T05:50:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.283+0000 7f4806d9d640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:50:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.284+0000 7f480759e640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080ce110 0x7f48080ce5a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4800009dc0 tx=0x7f480002be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d787dc82d5e70e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f4805d9b640 1 -- 172.21.15.49:0/2707330186 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480002cc30 con 0x7f48080ce110 2023-12-19T05:50:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f4805d9b640 1 -- 172.21.15.49:0/2707330186 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480002cd90 con 0x7f48080ce110 2023-12-19T05:50:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f4805d9b640 1 -- 172.21.15.49:0/2707330186 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800034660 con 0x7f48080ce110 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 -- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080ce110 msgr2=0x7f48080ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080ce110 0x7f48080ce5a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4800009dc0 tx=0x7f480002be80 comp rx=0 tx=0).stop 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 -- 172.21.15.49:0/2707330186 shutdown_connections 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080ce110 0x7f48080ce5a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 --2- 172.21.15.49:0/2707330186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.285+0000 7f480d1a4640 1 -- 172.21.15.49:0/2707330186 >> 172.21.15.49:0/2707330186 conn(0x7f48080b29c0 msgr2=0x7f48080b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.286+0000 7f480d1a4640 1 -- 172.21.15.49:0/2707330186 shutdown_connections 2023-12-19T05:50:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.286+0000 7f480d1a4640 1 -- 172.21.15.49:0/2707330186 wait complete. 2023-12-19T05:50:32.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.287+0000 7f480d1a4640 1 Processor -- start 2023-12-19T05:50:32.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.287+0000 7f480d1a4640 1 -- start start 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 0x7f4808070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48080b2290 con 0x7f48080ce110 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48081f6cc0 con 0x7f48080d2b00 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.288+0000 7f480d1a4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480813e030 con 0x7f4808146e10 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59858/0 (socket says 172.21.15.49:59858) 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 -- 172.21.15.49:0/3131993117 learned_addr learned my addr 172.21.15.49:0/3131993117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f480659c640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 0x7f4808070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 -- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 msgr2=0x7f48080709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 -- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 msgr2=0x7f4808070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 0x7f4808070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 -- 172.21.15.49:0/3131993117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009400 con 0x7f48080ce110 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f480659c640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 0x7f4808070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.289+0000 7f4806d9d640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f47f800ebe0 tx=0x7f47f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.290+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8009760 con 0x7f48080ce110 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.290+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f800cc30 con 0x7f48080ce110 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.290+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f800eee0 con 0x7f48080ce110 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.290+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4800009a70 con 0x7f48080ce110 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.290+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4808140590 con 0x7f48080ce110 2023-12-19T05:50:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.291+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4808061910 con 0x7f48080ce110 2023-12-19T05:50:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.292+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47f8013470 con 0x7f48080ce110 2023-12-19T05:50:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.293+0000 7f47ef7fe640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.294+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f47f8088ac0 con 0x7f48080ce110 2023-12-19T05:50:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.294+0000 7f480659c640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.295+0000 7f480659c640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 0x7f47f406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f480806e6c0 tx=0x7f47fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.298+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47f8054280 con 0x7f48080ce110 2023-12-19T05:50:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:32.511+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f48080ce740 con 0x7f48080ce110 2023-12-19T05:50:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.493+0000 7f47ef7fe640 1 -- 172.21.15.49:0/3131993117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v172) v1 ==== 97+0+0 (secure 0 0 0) 0x7f47f8017080 con 0x7f48080ce110 2023-12-19T05:50:33.495 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 msgr2=0x7f47f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 0x7f47f406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f480806e6c0 tx=0x7f47fc009040 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 msgr2=0x7f48081f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f47f800ebe0 tx=0x7f47f800c520 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 shutdown_connections 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f47f406a430 0x7f47f406c8f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4808146e10 0x7f48080709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48080d2b00 0x7f4808070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 --2- 172.21.15.49:0/3131993117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48080ce110 0x7f48081f6780 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 >> 172.21.15.49:0/3131993117 conn(0x7f48080b29c0 msgr2=0x7f48080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 shutdown_connections 2023-12-19T05:50:33.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.497+0000 7f480d1a4640 1 -- 172.21.15.49:0/3131993117 wait complete. 2023-12-19T05:50:33.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:50:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.751+0000 7fbbe6747640 1 Processor -- start 2023-12-19T05:50:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.751+0000 7fbbe6747640 1 -- start start 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe6747640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbe00d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe6747640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00cd840 con 0x7fbbe00ce110 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe6747640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00b6e90 con 0x7fbbe00d2b00 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe6747640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00d2430 con 0x7fbbe0146e10 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe4ce4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbbe00ce110 0x7fbbe00b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59034/0 (socket says 172.21.15.49:59034) 2023-12-19T05:50:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.753+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/3103193947 learned_addr learned my addr 172.21.15.49:0/3103193947 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdffff640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbe00d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393121562 0 0) 0x7fbbe00cd840 con 0x7fbbe00ce110 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc8003520 con 0x7fbbe00ce110 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103277721 0 0) 0x7fbbc8003520 con 0x7fbbe00ce110 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 msgr2=0x7fbbe00d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbe00d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 >> v1:172.21.15.115:6789/0 conn(0x7fbbe00d2b00 legacy=0x7fbbe00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00d2620 con 0x7fbbe00ce110 2023-12-19T05:50:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.754+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fbbd80019f0 con 0x7fbbe00ce110 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 >> v1:172.21.15.49:6789/0 conn(0x7fbbe00ce110 legacy=0x7fbbe00b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8003a10 0x7fbbc8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc8004d00 0x7fbbc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc800ba60 con 0x7fbbc8004d00 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc800bbd0 con 0x7fbbc8003a10 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc800bd90 con 0x7fbbe0146e10 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc8004d00 0x7fbbc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdffff640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8003a10 0x7fbbc8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbdf7fe640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 msgr2=0x7fbbc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe0146e10 0x7fbbc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.755+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8003a10 msgr2=0x7fbbc8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.756+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8003a10 0x7fbbc8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.756+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/3103193947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8003520 con 0x7fbbc8004d00 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc8004d00 0x7fbbc8005180 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a800 tx=0x7fbbc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4890fac32dbdb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80072d0 con 0x7fbbc8004d00 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd802f070 con 0x7fbbc8004d00 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbdeffd640 1 -- 172.21.15.49:0/3103193947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80076b0 con 0x7fbbc8004d00 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbe6747640 1 -- 172.21.15.49:0/3103193947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc8004d00 msgr2=0x7fbbc8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.757+0000 7fbbe6747640 1 --2- 172.21.15.49:0/3103193947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc8004d00 0x7fbbc8005180 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a800 tx=0x7fbbc80057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.758+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/3103193947 reap_dead start 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.758+0000 7fbbe6747640 1 -- 172.21.15.49:0/3103193947 shutdown_connections 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.758+0000 7fbbe6747640 1 -- 172.21.15.49:0/3103193947 >> 172.21.15.49:0/3103193947 conn(0x7fbbe00b29c0 msgr2=0x7fbbe00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.758+0000 7fbbe6747640 1 -- 172.21.15.49:0/3103193947 shutdown_connections 2023-12-19T05:50:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.758+0000 7fbbe6747640 1 -- 172.21.15.49:0/3103193947 wait complete. 2023-12-19T05:50:33.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.760+0000 7fbbe6747640 1 Processor -- start 2023-12-19T05:50:33.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.760+0000 7fbbe6747640 1 -- start start 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8004d00 0x7fbbe0160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe013b720 0x7fbbe013a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe013aed0 con 0x7fbbe013cef0 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe013ca60 con 0x7fbbc8004d00 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe6747640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe013bba0 con 0x7fbbe013b720 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe4ce4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe4ce4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59874/0 (socket says 172.21.15.49:59874) 2023-12-19T05:50:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.761+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/2339357014 learned_addr learned my addr 172.21.15.49:0/2339357014 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:33.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbdffff640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8004d00 0x7fbbe0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbdf7fe640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe013b720 0x7fbbe013a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe013b720 msgr2=0x7fbbe013a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe013b720 0x7fbbe013a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8004d00 msgr2=0x7fbbe0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8004d00 0x7fbbe0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 -- 172.21.15.49:0/2339357014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe013be50 con 0x7fbbe013cef0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe4ce4640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbbd802cb50 tx=0x7fbbd8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8004d60 con 0x7fbbe013cef0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd802ce90 con 0x7fbbe013cef0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80072d0 con 0x7fbbe013cef0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.762+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe013c130 con 0x7fbbe013cef0 2023-12-19T05:50:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.763+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe013c6f0 con 0x7fbbe013cef0 2023-12-19T05:50:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.764+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe0061910 con 0x7fbbe013cef0 2023-12-19T05:50:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.765+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbd8031030 con 0x7fbbe013cef0 2023-12-19T05:50:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.766+0000 7fbbdcff9640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 0x7fbbcc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.766+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbd80a90c0 con 0x7fbbe013cef0 2023-12-19T05:50:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.766+0000 7fbbdffff640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 0x7fbbcc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.767+0000 7fbbdffff640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 0x7fbbcc06c920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009a10 tx=0x7fbbd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:33.770+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbd8074960 con 0x7fbbe013cef0 2023-12-19T05:50:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.033+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbbe00d1f60 con 0x7fbbe013cef0 2023-12-19T05:50:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.034+0000 7fbbdcff9640 1 -- 172.21.15.49:0/2339357014 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbbd8077f80 con 0x7fbbe013cef0 2023-12-19T05:50:34.036 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:34.036 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:50:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:50:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:50:34.041 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:50:34.045 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:50:34.046 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:50:34.047 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:50:34.048 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:50:34.049 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 msgr2=0x7fbbcc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 0x7fbbcc06c920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009a10 tx=0x7fbbd0008040 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 msgr2=0x7fbbe013d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbbd802cb50 tx=0x7fbbd8001d80 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 shutdown_connections 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbcc06a460 0x7fbbcc06c920 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbe013b720 0x7fbbe013a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe013cef0 0x7fbbe013d370 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 --2- 172.21.15.49:0/2339357014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc8004d00 0x7fbbe0160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.037+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 >> 172.21.15.49:0/2339357014 conn(0x7fbbe00b29c0 msgr2=0x7fbbe01460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.038+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 shutdown_connections 2023-12-19T05:50:34.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.038+0000 7fbbe6747640 1 -- 172.21.15.49:0/2339357014 wait complete. 2023-12-19T05:50:34.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:34.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.294+0000 7f8dc079c640 1 Processor -- start 2023-12-19T05:50:34.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.295+0000 7f8dc079c640 1 -- start start 2023-12-19T05:50:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.296+0000 7f8dc079c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8db80b0b50 0x7f8db806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.296+0000 7f8dc079c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db806bb30 con 0x7f8db806b590 2023-12-19T05:50:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.296+0000 7f8dc079c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db80b0070 con 0x7f8db81449e0 2023-12-19T05:50:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.296+0000 7f8dc079c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db80b0350 con 0x7f8db80b0b50 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbed39640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8db806b590 0x7f8db80b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58700/0 (socket says 172.21.15.49:58700) 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbed39640 1 -- 172.21.15.49:0/3055649145 learned_addr learned my addr 172.21.15.49:0/3055649145 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbdd37640 1 --2- 172.21.15.49:0/3055649145 >> v2:172.21.15.49:3300/0 conn(0x7f8db80b0b50 0x7f8db806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3055649145 >> v1:172.21.15.115:6789/0 conn(0x7f8db81449e0 legacy=0x7f8db80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3055649145 >> v1:172.21.15.49:6789/0 conn(0x7f8db806b590 legacy=0x7f8db80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3055649145 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80b0630 con 0x7f8db80b0b50 2023-12-19T05:50:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.297+0000 7f8dbd536640 1 -- 172.21.15.49:0/3055649145 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015589797 0 0) 0x7f8db806bb30 con 0x7f8db806b590 2023-12-19T05:50:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.299+0000 7f8dbdd37640 1 --2- 172.21.15.49:0/3055649145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db806bfa0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097a0 tx=0x7f8dac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a21164c5c0c18c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.299+0000 7f8dbd536640 1 -- 172.21.15.49:0/3055649145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac031830 con 0x7f8db80b0b50 2023-12-19T05:50:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.299+0000 7f8dbd536640 1 -- 172.21.15.49:0/3055649145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac031990 con 0x7f8db80b0b50 2023-12-19T05:50:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.299+0000 7f8dbd536640 1 -- 172.21.15.49:0/3055649145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac031d20 con 0x7f8db80b0b50 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 -- 172.21.15.49:0/3055649145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 msgr2=0x7f8db806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3055649145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db806bfa0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097a0 tx=0x7f8dac02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 -- 172.21.15.49:0/3055649145 shutdown_connections 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3055649145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db806bfa0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 -- 172.21.15.49:0/3055649145 >> 172.21.15.49:0/3055649145 conn(0x7f8db80cbb70 msgr2=0x7f8db80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 -- 172.21.15.49:0/3055649145 shutdown_connections 2023-12-19T05:50:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.300+0000 7f8dc079c640 1 -- 172.21.15.49:0/3055649145 wait complete. 2023-12-19T05:50:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.302+0000 7f8dc079c640 1 Processor -- start 2023-12-19T05:50:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.302+0000 7f8dc079c640 1 -- start start 2023-12-19T05:50:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 0x7f8db813b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 0x7f8db81f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81f6f10 con 0x7f8db80b0b50 2023-12-19T05:50:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8152380 con 0x7f8db81449e0 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dc079c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81f6300 con 0x7f8db806b590 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dbdd37640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dbdd37640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51204/0 (socket says 172.21.15.49:51204) 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.303+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3126493178 learned_addr learned my addr 172.21.15.49:0/3126493178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbed39640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 0x7f8db81f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbe538640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 0x7f8db813b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 msgr2=0x7f8db813b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 0x7f8db813b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 msgr2=0x7f8db81f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 0x7f8db81f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 -- 172.21.15.49:0/3126493178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009400 con 0x7f8db80b0b50 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbe538640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 0x7f8db813b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbed39640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 0x7f8db81f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.304+0000 7f8dbdd37640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098c0 tx=0x7f8dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.305+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac03ba70 con 0x7f8db80b0b50 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.305+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac03bbd0 con 0x7f8db80b0b50 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.305+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0453f0 con 0x7f8db80b0b50 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.305+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db81f65e0 con 0x7f8db80b0b50 2023-12-19T05:50:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.305+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db81f6ba0 con 0x7f8db80b0b50 2023-12-19T05:50:34.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.306+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db815ccd0 con 0x7f8db80b0b50 2023-12-19T05:50:34.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.307+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8dac04e450 con 0x7f8db80b0b50 2023-12-19T05:50:34.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.308+0000 7f8db6ffd640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 0x7f8da406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.308+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8dac0aa920 con 0x7f8db80b0b50 2023-12-19T05:50:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.309+0000 7f8dbe538640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 0x7f8da406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.310+0000 7f8dbe538640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 0x7f8da406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8da8007e90 tx=0x7f8da80073a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.313+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8dac0762e0 con 0x7f8db80b0b50 2023-12-19T05:50:34.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.511+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8db8061910 con 0x7f8db80b0b50 2023-12-19T05:50:34.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.513+0000 7f8db6ffd640 1 -- 172.21.15.49:0/3126493178 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+12400 (secure 0 0 0) 0x7f8dac079900 con 0x7f8db80b0b50 2023-12-19T05:50:34.515 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:34.515 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:33.479230+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 msgr2=0x7f8da406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 0x7f8da406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8da8007e90 tx=0x7f8da80073a0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 msgr2=0x7f8db81437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098c0 tx=0x7f8dac0046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 shutdown_connections 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8da406a430 0x7f8da406c8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db81449e0 0x7f8db81f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db80b0b50 0x7f8db81437a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 --2- 172.21.15.49:0/3126493178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8db806b590 0x7f8db813b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 >> 172.21.15.49:0/3126493178 conn(0x7f8db80cbb70 msgr2=0x7f8db80ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:34.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 shutdown_connections 2023-12-19T05:50:34.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.516+0000 7f8dc079c640 1 -- 172.21.15.49:0/3126493178 wait complete. 2023-12-19T05:50:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:50:34.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:50:34.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.774+0000 7f9e9f45f640 1 Processor -- start 2023-12-19T05:50:34.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.774+0000 7f9e9f45f640 1 -- start start 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9f45f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e9815b1d0 0x7f9e980b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9f45f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e980cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9f45f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9815fde0 con 0x7f9e980b1ec0 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9f45f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980cf870 con 0x7f9e9815b1d0 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9f45f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9815ef10 con 0x7f9e980ceea0 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9c9fa640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9e980b1ec0 0x7f9e9815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58706/0 (socket says 172.21.15.49:58706) 2023-12-19T05:50:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.776+0000 7f9e9c9fa640 1 -- 172.21.15.49:0/4085230347 learned_addr learned my addr 172.21.15.49:0/4085230347 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:34.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e980cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e9d1fb640 1 --2- 172.21.15.49:0/4085230347 >> v2:172.21.15.115:3300/0 conn(0x7f9e9815b1d0 0x7f9e980b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882478800 0 0) 0x7f9e9815fde0 con 0x7f9e980b1ec0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e84003520 con 0x7f9e980b1ec0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898583080 0 0) 0x7f9e84003520 con 0x7f9e980b1ec0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 msgr2=0x7f9e980cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e980cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 >> v2:172.21.15.115:3300/0 conn(0x7f9e9815b1d0 msgr2=0x7f9e980b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 --2- 172.21.15.49:0/4085230347 >> v2:172.21.15.115:3300/0 conn(0x7f9e9815b1d0 0x7f9e980b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980b2320 con 0x7f9e980b1ec0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9e88001670 con 0x7f9e980b1ec0 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.777+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 >> v1:172.21.15.49:6789/0 conn(0x7f9e980b1ec0 legacy=0x7f9e9815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e84003f60 0x7f9e840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e84004d00 0x7f9e84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980cf870 con 0x7f9e84004d00 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9815ef10 con 0x7f9e84003f60 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8400b9b0 con 0x7f9e980ceea0 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e84004d00 0x7f9e84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d1fb640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9c9fa640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e84003f60 0x7f9e840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 msgr2=0x7f9e840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e980ceea0 0x7f9e840039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e84003f60 msgr2=0x7f9e840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e84003f60 0x7f9e840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.778+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/4085230347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84003520 con 0x7f9e84004d00 2023-12-19T05:50:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e84004d00 0x7f9e84005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ac0 tx=0x7f9e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32412fa26238a352 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002c6b0 con 0x7f9e84004d00 2023-12-19T05:50:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9002c810 con 0x7f9e84004d00 2023-12-19T05:50:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e8ffff640 1 -- 172.21.15.49:0/4085230347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002cba0 con 0x7f9e84004d00 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e9f45f640 1 -- 172.21.15.49:0/4085230347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e84004d00 msgr2=0x7f9e84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/4085230347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e84004d00 0x7f9e84005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ac0 tx=0x7f9e840057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.780+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/4085230347 reap_dead start 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.781+0000 7f9e9f45f640 1 -- 172.21.15.49:0/4085230347 shutdown_connections 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.781+0000 7f9e9f45f640 1 -- 172.21.15.49:0/4085230347 >> 172.21.15.49:0/4085230347 conn(0x7f9e98073150 msgr2=0x7f9e980659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.781+0000 7f9e9f45f640 1 -- 172.21.15.49:0/4085230347 shutdown_connections 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.781+0000 7f9e9f45f640 1 -- 172.21.15.49:0/4085230347 wait complete. 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.783+0000 7f9e9f45f640 1 Processor -- start 2023-12-19T05:50:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.783+0000 7f9e9f45f640 1 -- start start 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e84004d00 0x7f9e981558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e9815dce0 0x7f9e9815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981f4c20 con 0x7f9e9815ccc0 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9815e810 con 0x7f9e9815dce0 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9f45f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981f4790 con 0x7f9e84004d00 2023-12-19T05:50:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51228/0 (socket says 172.21.15.49:51228) 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/2736331942 learned_addr learned my addr 172.21.15.49:0/2736331942 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d1fb640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e84004d00 0x7f9e981558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e84004d00 msgr2=0x7f9e981558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e84004d00 0x7f9e981558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9c9fa640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e9815dce0 0x7f9e9815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e9815dce0 msgr2=0x7f9e9815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e9815dce0 0x7f9e9815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.784+0000 7f9e9d9fc640 1 -- 172.21.15.49:0/2736331942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e981f3e60 con 0x7f9e9815ccc0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e9d9fc640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ac0 tx=0x7f9e90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002c6b0 con 0x7f9e9815ccc0 2023-12-19T05:50:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90003810 con 0x7f9e9815ccc0 2023-12-19T05:50:34.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e981f4140 con 0x7f9e9815ccc0 2023-12-19T05:50:34.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003bc0 con 0x7f9e9815ccc0 2023-12-19T05:50:34.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.785+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9815d660 con 0x7f9e9815ccc0 2023-12-19T05:50:34.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.786+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e981f4920 con 0x7f9e9815ccc0 2023-12-19T05:50:34.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.787+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e90003d20 con 0x7f9e9815ccc0 2023-12-19T05:50:34.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.788+0000 7f9e8dffb640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 0x7f9e7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:34.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.789+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e900a9d30 con 0x7f9e9815ccc0 2023-12-19T05:50:34.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.789+0000 7f9e9d1fb640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 0x7f9e7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:34.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.790+0000 7f9e9d1fb640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 0x7f9e7c06c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007380 tx=0x7f9e9400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:34.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.793+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e90075660 con 0x7f9e9815ccc0 2023-12-19T05:50:34.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.984+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e98061910 con 0x7f9e9815ccc0 2023-12-19T05:50:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.985+0000 7f9e8dffb640 1 -- 172.21.15.49:0/2736331942 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e90078c80 con 0x7f9e9815ccc0 2023-12-19T05:50:34.987 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 msgr2=0x7f9e7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 0x7f9e7c06c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007380 tx=0x7f9e9400b040 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 msgr2=0x7f9e9815d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ac0 tx=0x7f9e90004730 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 shutdown_connections 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9e7c06a430 0x7f9e7c06c8f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e9815ccc0 0x7f9e9815d120 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e9815dce0 0x7f9e9815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 --2- 172.21.15.49:0/2736331942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e84004d00 0x7f9e981558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 >> 172.21.15.49:0/2736331942 conn(0x7f9e98073150 msgr2=0x7f9e98158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 shutdown_connections 2023-12-19T05:50:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:34.988+0000 7f9e9f45f640 1 -- 172.21.15.49:0/2736331942 wait complete. 2023-12-19T05:50:35.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:50:35.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.240+0000 7fc5863ae640 1 Processor -- start 2023-12-19T05:50:35.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.241+0000 7fc5863ae640 1 -- start start 2023-12-19T05:50:35.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.242+0000 7fc5863ae640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5800b05a0 0x7fc5800af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.242+0000 7fc5863ae640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc5800af8e0 0x7fc58015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.242+0000 7fc5863ae640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc580161b90 con 0x7fc5800b0980 2023-12-19T05:50:35.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.242+0000 7fc5863ae640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580160f80 con 0x7fc5800b05a0 2023-12-19T05:50:35.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.242+0000 7fc5863ae640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580161260 con 0x7fc5800af8e0 2023-12-19T05:50:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc585bad640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc5800b0980 0x7fc5800ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58722/0 (socket says 172.21.15.49:58722) 2023-12-19T05:50:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc585bad640 1 -- 172.21.15.49:0/2062023279 learned_addr learned my addr 172.21.15.49:0/2062023279 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc5853ac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5800b05a0 0x7fc5800af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc584bab640 1 --2- 172.21.15.49:0/2062023279 >> v2:172.21.15.115:3300/0 conn(0x7fc5800af8e0 0x7fc58015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc577fff640 1 -- 172.21.15.49:0/2062023279 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136360978 0 0) 0x7fc580161b90 con 0x7fc5800b0980 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.243+0000 7fc577fff640 1 -- 172.21.15.49:0/2062023279 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c003520 con 0x7fc5800b0980 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.244+0000 7fc5853ac640 1 -- 172.21.15.49:0/2062023279 >> v2:172.21.15.115:3300/0 conn(0x7fc5800af8e0 msgr2=0x7fc58015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.244+0000 7fc5853ac640 1 --2- 172.21.15.49:0/2062023279 >> v2:172.21.15.115:3300/0 conn(0x7fc5800af8e0 0x7fc58015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.244+0000 7fc5853ac640 1 -- 172.21.15.49:0/2062023279 >> v1:172.21.15.49:6789/0 conn(0x7fc5800b0980 legacy=0x7fc5800ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.244+0000 7fc5853ac640 1 -- 172.21.15.49:0/2062023279 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580161540 con 0x7fc5800b05a0 2023-12-19T05:50:35.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.245+0000 7fc5853ac640 1 --2- 172.21.15.49:0/2062023279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b05a0 0x7fc5800af3a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc5800cfe50 tx=0x7fc57c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1f20e844d8e75e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.245+0000 7fc577fff640 1 -- 172.21.15.49:0/2062023279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c02e070 con 0x7fc5800b05a0 2023-12-19T05:50:35.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.245+0000 7fc577fff640 1 -- 172.21.15.49:0/2062023279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0315a0 con 0x7fc5800b05a0 2023-12-19T05:50:35.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.245+0000 7fc577fff640 1 -- 172.21.15.49:0/2062023279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c031930 con 0x7fc5800b05a0 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 -- 172.21.15.49:0/2062023279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b05a0 msgr2=0x7fc5800af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 --2- 172.21.15.49:0/2062023279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b05a0 0x7fc5800af3a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc5800cfe50 tx=0x7fc57c02b840 comp rx=0 tx=0).stop 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 -- 172.21.15.49:0/2062023279 shutdown_connections 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 --2- 172.21.15.49:0/2062023279 >> v2:172.21.15.115:3300/0 conn(0x7fc5800af8e0 0x7fc58015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 --2- 172.21.15.49:0/2062023279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b05a0 0x7fc5800af3a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 -- 172.21.15.49:0/2062023279 >> 172.21.15.49:0/2062023279 conn(0x7fc5800659a0 msgr2=0x7fc580065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 -- 172.21.15.49:0/2062023279 shutdown_connections 2023-12-19T05:50:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.246+0000 7fc5863ae640 1 -- 172.21.15.49:0/2062023279 wait complete. 2023-12-19T05:50:35.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.248+0000 7fc5863ae640 1 Processor -- start 2023-12-19T05:50:35.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.248+0000 7fc5863ae640 1 -- start start 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5800af8e0 0x7fc580146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 0x7fc58015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006b2f0 con 0x7fc5800b0980 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006b590 con 0x7fc5800b05a0 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5863ae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006b870 con 0x7fc5800af8e0 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51242/0 (socket says 172.21.15.49:51242) 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 -- 172.21.15.49:0/1650070735 learned_addr learned my addr 172.21.15.49:0/1650070735 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc5853ac640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5800af8e0 0x7fc580146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 -- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5800af8e0 msgr2=0x7fc580146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5800af8e0 0x7fc580146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc584bab640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 0x7fc58015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.249+0000 7fc585bad640 1 -- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 msgr2=0x7fc58015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc585bad640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 0x7fc58015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc585bad640 1 -- 172.21.15.49:0/1650070735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009400 con 0x7fc5800b0980 2023-12-19T05:50:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc584bab640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 0x7fc58015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc585bad640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc57800caa0 tx=0x7fc57800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800ac00 con 0x7fc5800b0980 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800ad60 con 0x7fc5800b0980 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578012620 con 0x7fc5800b0980 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58006bb50 con 0x7fc5800b0980 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.250+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58006c110 con 0x7fc5800b0980 2023-12-19T05:50:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.251+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58006c300 con 0x7fc5800b0980 2023-12-19T05:50:35.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.252+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc578007070 con 0x7fc5800b0980 2023-12-19T05:50:35.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.253+0000 7fc575ffb640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 0x7fc56406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.254+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5780885f0 con 0x7fc5800b0980 2023-12-19T05:50:35.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.254+0000 7fc5853ac640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 0x7fc56406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.255+0000 7fc5853ac640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 0x7fc56406c920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc57c036000 tx=0x7fc57c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.258+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc578053e90 con 0x7fc5800b0980 2023-12-19T05:50:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.455+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc580061910 con 0x7fc5800b0980 2023-12-19T05:50:35.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.455+0000 7fc575ffb640 1 -- 172.21.15.49:0/1650070735 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc578017090 con 0x7fc5800b0980 2023-12-19T05:50:35.457 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:35.457 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:50:35.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:50:35.458 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:50:35.458 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:50:35.458 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:50:35.458 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:50:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.458+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 msgr2=0x7fc56406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.458+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 0x7fc56406c920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc57c036000 tx=0x7fc57c03d040 comp rx=0 tx=0).stop 2023-12-19T05:50:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.458+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 msgr2=0x7fc58015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.458+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc57800caa0 tx=0x7fc57800cf60 comp rx=0 tx=0).stop 2023-12-19T05:50:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 shutdown_connections 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc56406a460 0x7fc56406c920 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5800b0980 0x7fc58015be50 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5800b05a0 0x7fc58015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 --2- 172.21.15.49:0/1650070735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5800af8e0 0x7fc580146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 >> 172.21.15.49:0/1650070735 conn(0x7fc5800659a0 msgr2=0x7fc58006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 shutdown_connections 2023-12-19T05:50:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.459+0000 7fc5863ae640 1 -- 172.21.15.49:0/1650070735 wait complete. 2023-12-19T05:50:35.482 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:50:35.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:50:35.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.707+0000 7f67cd515640 1 Processor -- start 2023-12-19T05:50:35.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.707+0000 7f67cd515640 1 -- start start 2023-12-19T05:50:35.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.709+0000 7f67cd515640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f67c80b04c0 0x7f67c80ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.709+0000 7f67cd515640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67c806d070 0x7f67c806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.709+0000 7f67cd515640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c815f920 con 0x7f67c815afd0 2023-12-19T05:50:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.709+0000 7f67cd515640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c80adc40 con 0x7f67c806d070 2023-12-19T05:50:35.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.709+0000 7f67cd515640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c815ed10 con 0x7f67c80b04c0 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67c806d070 0x7f67c806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67c806d070 0x7f67c806b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51250/0 (socket says 172.21.15.49:51250) 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 -- 172.21.15.49:0/1577281026 learned_addr learned my addr 172.21.15.49:0/1577281026 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67c77fe640 1 --2- 172.21.15.49:0/1577281026 >> v2:172.21.15.115:3300/0 conn(0x7f67c80b04c0 0x7f67c80ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 -- 172.21.15.49:0/1577281026 >> v2:172.21.15.115:3300/0 conn(0x7f67c80b04c0 msgr2=0x7f67c80ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 --2- 172.21.15.49:0/1577281026 >> v2:172.21.15.115:3300/0 conn(0x7f67c80b04c0 0x7f67c80ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 -- 172.21.15.49:0/1577281026 >> v1:172.21.15.115:6789/0 conn(0x7f67c815afd0 legacy=0x7f67c80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.710+0000 7f67ccd14640 1 -- 172.21.15.49:0/1577281026 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c815eff0 con 0x7f67c806d070 2023-12-19T05:50:35.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.712+0000 7f67ccd14640 1 --2- 172.21.15.49:0/1577281026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c806d070 0x7f67c806b450 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f67c80666e0 tx=0x7f67c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9085e6354b844bc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.712+0000 7f67c6ffd640 1 -- 172.21.15.49:0/1577281026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c002c9f0 con 0x7f67c806d070 2023-12-19T05:50:35.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.712+0000 7f67c6ffd640 1 -- 172.21.15.49:0/1577281026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c002cb50 con 0x7f67c806d070 2023-12-19T05:50:35.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.712+0000 7f67c6ffd640 1 -- 172.21.15.49:0/1577281026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c00343f0 con 0x7f67c806d070 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 -- 172.21.15.49:0/1577281026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c806d070 msgr2=0x7f67c806b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 --2- 172.21.15.49:0/1577281026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c806d070 0x7f67c806b450 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f67c80666e0 tx=0x7f67c002be50 comp rx=0 tx=0).stop 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 -- 172.21.15.49:0/1577281026 shutdown_connections 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 --2- 172.21.15.49:0/1577281026 >> v2:172.21.15.115:3300/0 conn(0x7f67c80b04c0 0x7f67c80ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 --2- 172.21.15.49:0/1577281026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c806d070 0x7f67c806b450 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 -- 172.21.15.49:0/1577281026 >> 172.21.15.49:0/1577281026 conn(0x7f67c80b4750 msgr2=0x7f67c80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 -- 172.21.15.49:0/1577281026 shutdown_connections 2023-12-19T05:50:35.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.713+0000 7f67cd515640 1 -- 172.21.15.49:0/1577281026 wait complete. 2023-12-19T05:50:35.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.715+0000 7f67cd515640 1 Processor -- start 2023-12-19T05:50:35.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.715+0000 7f67cd515640 1 -- start start 2023-12-19T05:50:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c806d070 0x7f67c8148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c815afd0 0x7f67c806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c81f36c0 con 0x7f67c80b04c0 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c81f2b40 con 0x7f67c806d070 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67cd515640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c81f2e20 con 0x7f67c815afd0 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.716+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51256/0 (socket says 172.21.15.49:51256) 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 -- 172.21.15.49:0/1237007743 learned_addr learned my addr 172.21.15.49:0/1237007743 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:35.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c7fff640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c806d070 0x7f67c8148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67ccd14640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c815afd0 0x7f67c806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 -- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c815afd0 msgr2=0x7f67c806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c815afd0 0x7f67c806ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 -- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c806d070 msgr2=0x7f67c8148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c806d070 0x7f67c8148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 -- 172.21.15.49:0/1237007743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0009b30 con 0x7f67c80b04c0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.717+0000 7f67c77fe640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00d800 tx=0x7f67bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.718+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc00b6c0 con 0x7f67c80b04c0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.718+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc00b840 con 0x7f67c80b04c0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.718+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc00bbf0 con 0x7f67c80b04c0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.718+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c81f3100 con 0x7f67c80b04c0 2023-12-19T05:50:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.718+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c81f38d0 con 0x7f67c80b04c0 2023-12-19T05:50:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.719+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c8061910 con 0x7f67c80b04c0 2023-12-19T05:50:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.720+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67bc00bd50 con 0x7f67c80b04c0 2023-12-19T05:50:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.721+0000 7f67c4ff9640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 0x7f67b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.721+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67bc088bc0 con 0x7f67c80b04c0 2023-12-19T05:50:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.722+0000 7f67c7fff640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 0x7f67b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:35.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.723+0000 7f67c7fff640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 0x7f67b406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67b8004ea0 tx=0x7f67b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.726+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67bc0544f0 con 0x7f67c80b04c0 2023-12-19T05:50:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:35.918+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67c80b1bf0 con 0x7f67c80b04c0 2023-12-19T05:50:36.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.521+0000 7f67c4ff9640 1 -- 172.21.15.49:0/1237007743 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) v1 ==== 138+0+0 (secure 0 0 0) 0x7f67bc057b10 con 0x7f67c80b04c0 2023-12-19T05:50:36.523 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:50:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 msgr2=0x7f67b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 0x7f67b406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67b8004ea0 tx=0x7f67b8009040 comp rx=0 tx=0).stop 2023-12-19T05:50:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 msgr2=0x7f67c81563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00d800 tx=0x7f67bc00dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 shutdown_connections 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67b406a430 0x7f67b406c8f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c815afd0 0x7f67c806ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c80b04c0 0x7f67c81563f0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 --2- 172.21.15.49:0/1237007743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c806d070 0x7f67c8148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 >> 172.21.15.49:0/1237007743 conn(0x7f67c80b4750 msgr2=0x7f67c815a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 shutdown_connections 2023-12-19T05:50:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.526+0000 7f67cd515640 1 -- 172.21.15.49:0/1237007743 wait complete. 2023-12-19T05:50:36.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:50:36.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.770+0000 7f14f0604640 1 Processor -- start 2023-12-19T05:50:36.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.771+0000 7f14f0604640 1 -- start start 2023-12-19T05:50:36.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14f0604640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e8140cd0 0x7f14e80b8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14f0604640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e815dc20 con 0x7f14e80b8e90 2023-12-19T05:50:36.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14f0604640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e815df00 con 0x7f14e80b5130 2023-12-19T05:50:36.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14f0604640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e815da30 con 0x7f14e8140cd0 2023-12-19T05:50:36.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14eeba1640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f14e80b8e90 0x7f14e8142c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58728/0 (socket says 172.21.15.49:58728) 2023-12-19T05:50:36.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14eeba1640 1 -- 172.21.15.49:0/197709320 learned_addr learned my addr 172.21.15.49:0/197709320 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.773+0000 7f14edb9f640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e8140cd0 0x7f14e80b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565054870 0 0) 0x7f14e815dc20 con 0x7f14e80b8e90 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d4003520 con 0x7f14e80b8e90 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 332623003 0 0) 0x7f14d4003520 con 0x7f14e80b8e90 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e8140cd0 msgr2=0x7f14e80b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e8140cd0 0x7f14e80b8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 >> v1:172.21.15.115:6789/0 conn(0x7f14e80b5130 legacy=0x7f14e80b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e815e1e0 con 0x7f14e80b8e90 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f14e0001670 con 0x7f14e80b8e90 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 >> v1:172.21.15.49:6789/0 conn(0x7f14e80b8e90 legacy=0x7f14e8142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d40047c0 0x7f14d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d4005180 0x7f14d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400bff0 con 0x7f14d40039a0 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400c160 con 0x7f14d40047c0 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400c320 con 0x7f14d4005180 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.774+0000 7f14edb9f640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e8140cd0 0x7f14e80b8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14eeba1640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d4005180 0x7f14d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14edb9f640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d40047c0 0x7f14d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 -- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d4005180 msgr2=0x7f14d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d4005180 0x7f14d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 -- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d40047c0 msgr2=0x7f14d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d40047c0 0x7f14d4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.775+0000 7f14ee3a0640 1 -- 172.21.15.49:0/197709320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4003520 con 0x7f14d40039a0 2023-12-19T05:50:36.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.776+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14d4003d80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f14e4001f60 tx=0x7f14d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a94555a968e9a39 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:36.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e402c710 con 0x7f14d40039a0 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e402c890 con 0x7f14d40039a0 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14ed39e640 1 -- 172.21.15.49:0/197709320 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e402cc80 con 0x7f14d40039a0 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14f0604640 1 -- 172.21.15.49:0/197709320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 msgr2=0x7f14d4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14f0604640 1 --2- 172.21.15.49:0/197709320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14d4003d80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f14e4001f60 tx=0x7f14d40057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.777+0000 7f14eeba1640 1 -- 172.21.15.49:0/197709320 reap_dead start 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.778+0000 7f14f0604640 1 -- 172.21.15.49:0/197709320 shutdown_connections 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.778+0000 7f14f0604640 1 -- 172.21.15.49:0/197709320 >> 172.21.15.49:0/197709320 conn(0x7f14e80d3370 msgr2=0x7f14e80d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.778+0000 7f14f0604640 1 -- 172.21.15.49:0/197709320 shutdown_connections 2023-12-19T05:50:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.778+0000 7f14f0604640 1 -- 172.21.15.49:0/197709320 wait complete. 2023-12-19T05:50:36.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.779+0000 7f14f0604640 1 Processor -- start 2023-12-19T05:50:36.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.780+0000 7f14f0604640 1 -- start start 2023-12-19T05:50:36.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e815bc90 0x7f14e8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14e815c110 0x7f14e81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80702c0 con 0x7f14d40039a0 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806ff00 con 0x7f14e815c110 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14f0604640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8070510 con 0x7f14e815bc90 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14ee3a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14ee3a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51268/0 (socket says 172.21.15.49:51268) 2023-12-19T05:50:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14ee3a0640 1 -- 172.21.15.49:0/1849168998 learned_addr learned my addr 172.21.15.49:0/1849168998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14edb9f640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e815bc90 0x7f14e8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.781+0000 7f14eeba1640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14e815c110 0x7f14e81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 -- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e815bc90 msgr2=0x7f14e8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e815bc90 0x7f14e8156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 -- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14e815c110 msgr2=0x7f14e81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14e815c110 0x7f14e81569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 -- 172.21.15.49:0/1849168998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80707f0 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14ee3a0640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f14e402c180 tx=0x7f14e40015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4006d50 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e402de90 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40052e0 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.782+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8070ad0 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.783+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e806f370 con 0x7f14d40039a0 2023-12-19T05:50:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.784+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8070c60 con 0x7f14d40039a0 2023-12-19T05:50:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.785+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14e4005440 con 0x7f14d40039a0 2023-12-19T05:50:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.786+0000 7f14deffd640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 0x7f14cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.786+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f14e40aacd0 con 0x7f14d40039a0 2023-12-19T05:50:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.787+0000 7f14edb9f640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 0x7f14cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.788+0000 7f14edb9f640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 0x7f14cc06c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f14e80b5a10 tx=0x7f14d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.790+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14e40766a0 con 0x7f14d40039a0 2023-12-19T05:50:36.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:36.988+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14e8061910 con 0x7f14d40039a0 2023-12-19T05:50:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.525+0000 7f14deffd640 1 -- 172.21.15.49:0/1849168998 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) v1 ==== 170+0+0 (secure 0 0 0) 0x7f14e4079cc0 con 0x7f14d40039a0 2023-12-19T05:50:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:50:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.535+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 msgr2=0x7f14cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.535+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 0x7f14cc06c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f14e80b5a10 tx=0x7f14d8008040 comp rx=0 tx=0).stop 2023-12-19T05:50:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.535+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 msgr2=0x7f14e8070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.535+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f14e402c180 tx=0x7f14e40015b0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 shutdown_connections 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f14cc06a430 0x7f14cc06c8f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14e815bc90 0x7f14e8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14e815c110 0x7f14e81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 --2- 172.21.15.49:0/1849168998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14d40039a0 0x7f14e8070ff0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.536+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 >> 172.21.15.49:0/1849168998 conn(0x7f14e80d3370 msgr2=0x7f14e80b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.537+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 shutdown_connections 2023-12-19T05:50:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.538+0000 7f14f0604640 1 -- 172.21.15.49:0/1849168998 wait complete. 2023-12-19T05:50:37.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:50:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.771+0000 7fceab59e640 1 Processor -- start 2023-12-19T05:50:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.771+0000 7fceab59e640 1 -- start start 2023-12-19T05:50:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fceab59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceac0b0470 0x7fceac0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fceab59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac15dae0 con 0x7fceac15e580 2023-12-19T05:50:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fceab59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac15b000 con 0x7fceac0cd4e0 2023-12-19T05:50:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fceab59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac15ea30 con 0x7fceac0b0470 2023-12-19T05:50:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fcea3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fceac15e580 0x7fceac0afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58736/0 (socket says 172.21.15.49:58736) 2023-12-19T05:50:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.773+0000 7fcea3fff640 1 -- 172.21.15.49:0/977847761 learned_addr learned my addr 172.21.15.49:0/977847761 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fceaad9d640 1 --2- 172.21.15.49:0/977847761 >> v2:172.21.15.115:3300/0 conn(0x7fceac0b0470 0x7fceac0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723167428 0 0) 0x7fceac15dae0 con 0x7fceac15e580 2023-12-19T05:50:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce98003520 con 0x7fceac15e580 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91960798 0 0) 0x7fce98003520 con 0x7fceac15e580 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 >> v2:172.21.15.115:3300/0 conn(0x7fceac0b0470 msgr2=0x7fceac0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 --2- 172.21.15.49:0/977847761 >> v2:172.21.15.115:3300/0 conn(0x7fceac0b0470 0x7fceac0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 >> v1:172.21.15.115:6789/0 conn(0x7fceac0cd4e0 legacy=0x7fceac15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac15b2e0 con 0x7fceac15e580 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fce94001670 con 0x7fceac15e580 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 >> v1:172.21.15.49:6789/0 conn(0x7fceac15e580 legacy=0x7fceac0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 0x7fce98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce980047c0 0x7fce98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce98005180 0x7fce9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15ea30 con 0x7fce98003970 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800c020 con 0x7fce980047c0 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.774+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800c1e0 con 0x7fce98005180 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 0x7fce98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fcea3fff640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce980047c0 0x7fce98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 -- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce98005180 msgr2=0x7fce9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaad9d640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce98005180 0x7fce9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce98005180 0x7fce9800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 -- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce980047c0 msgr2=0x7fce98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce980047c0 0x7fce98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaa59c640 1 -- 172.21.15.49:0/977847761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98003520 con 0x7fce98003970 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fcea3fff640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce980047c0 0x7fce98004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaad9d640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce98005180 0x7fce9800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.775+0000 7fceaad9d640 1 -- 172.21.15.49:0/977847761 reap_dead start 2023-12-19T05:50:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.776+0000 7fceaa59c640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 0x7fce98003d90 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fce9c001750 tx=0x7fce980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c124e407b9283a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0052d0 con 0x7fce98003970 2023-12-19T05:50:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c02e050 con 0x7fce98003970 2023-12-19T05:50:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fcea9d9b640 1 -- 172.21.15.49:0/977847761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c003830 con 0x7fce98003970 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 -- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 msgr2=0x7fce98003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 0x7fce98003d90 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fce9c001750 tx=0x7fce980057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 -- 172.21.15.49:0/977847761 shutdown_connections 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 --2- 172.21.15.49:0/977847761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce98003970 0x7fce98003d90 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 -- 172.21.15.49:0/977847761 >> 172.21.15.49:0/977847761 conn(0x7fceac06f630 msgr2=0x7fceac06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 -- 172.21.15.49:0/977847761 shutdown_connections 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.777+0000 7fceab59e640 1 -- 172.21.15.49:0/977847761 wait complete. 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.779+0000 7fceab59e640 1 Processor -- start 2023-12-19T05:50:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.779+0000 7fceab59e640 1 -- start start 2023-12-19T05:50:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce98003970 0x7fceac0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 0x7fceac1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0a95c0 con 0x7fceac0aec30 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0a98a0 con 0x7fce98003970 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceab59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0a9b80 con 0x7fceac156b80 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceaad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceaad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51290/0 (socket says 172.21.15.49:51290) 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.780+0000 7fceaad9d640 1 -- 172.21.15.49:0/2521182344 learned_addr learned my addr 172.21.15.49:0/2521182344 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaa59c640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce98003970 0x7fceac0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fcea3fff640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 0x7fceac1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 -- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 msgr2=0x7fceac1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 0x7fceac1478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 -- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce98003970 msgr2=0x7fceac0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce98003970 0x7fceac0aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 -- 172.21.15.49:0/2521182344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0a9e60 con 0x7fceac0aec30 2023-12-19T05:50:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fcea3fff640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 0x7fceac1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceaad9d640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b0eb0 tx=0x7fcea400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4016420 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4016580 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.781+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0aa140 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.782+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40168f0 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.782+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac0af290 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.783+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac0aa380 con 0x7fceac0aec30 2023-12-19T05:50:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.784+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcea4016a50 con 0x7fceac0aec30 2023-12-19T05:50:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.785+0000 7fcea2ffd640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 0x7fce8c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.786+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcea4089540 con 0x7fceac0aec30 2023-12-19T05:50:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.786+0000 7fceaa59c640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 0x7fce8c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:37.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.787+0000 7fceaa59c640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 0x7fce8c06c910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce9c033000 tx=0x7fce9c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:37.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:37.791+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fceac0aa380 con 0x7fceac0aec30 2023-12-19T05:50:38.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.017+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fceac0aa330 con 0x7fceac0aec30 2023-12-19T05:50:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.030+0000 7fcea2ffd640 1 -- 172.21.15.49:0/2521182344 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v76) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcea4054af0 con 0x7fceac0aec30 2023-12-19T05:50:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 20 and data pool 21 2023-12-19T05:50:38.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.033+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 msgr2=0x7fce8c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.033+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 0x7fce8c06c910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce9c033000 tx=0x7fce9c009030 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.033+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 msgr2=0x7fceac0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.033+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b0eb0 tx=0x7fcea400f520 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 shutdown_connections 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce8c06a450 0x7fce8c06c910 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac156b80 0x7fceac1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceac0aec30 0x7fceac0ae070 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 --2- 172.21.15.49:0/2521182344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce98003970 0x7fceac0aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 >> 172.21.15.49:0/2521182344 conn(0x7fceac06f630 msgr2=0x7fceac0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.034+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 shutdown_connections 2023-12-19T05:50:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.036+0000 7fceab59e640 1 -- 172.21.15.49:0/2521182344 wait complete. 2023-12-19T05:50:38.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.251+0000 7f768e700640 1 Processor -- start 2023-12-19T05:50:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.252+0000 7f768e700640 1 -- start start 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.253+0000 7f768e700640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76880b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.253+0000 7f768e700640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768815e1a0 con 0x7f7688161020 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.253+0000 7f768e700640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768815e480 con 0x7f768815da30 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.253+0000 7f768e700640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768815e760 con 0x7f76880b89a0 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.254+0000 7f7687fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7688161020 0x7f7688143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58752/0 (socket says 172.21.15.49:58752) 2023-12-19T05:50:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.254+0000 7f7687fff640 1 -- 172.21.15.49:0/3119594647 learned_addr learned my addr 172.21.15.49:0/3119594647 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.254+0000 7f768cc9d640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76880b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.254+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325124811 0 0) 0x7f768815e1a0 con 0x7f7688161020 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.254+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7674003520 con 0x7f7688161020 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264135168 0 0) 0x7f7674003520 con 0x7f7688161020 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 msgr2=0x7f76880b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76880b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 >> v1:172.21.15.115:6789/0 conn(0x7f768815da30 legacy=0x7f76880b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688142d10 con 0x7f7688161020 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f76780019f0 con 0x7f7688161020 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 >> v1:172.21.15.49:6789/0 conn(0x7f7688161020 legacy=0x7f7688143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674003a10 0x7f7674003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674004d00 0x7f7674005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768815e760 con 0x7f7674003a10 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767400ba90 con 0x7f7674004d00 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767400bc50 con 0x7f76880b89a0 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f7687fff640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674003a10 0x7f7674003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.255+0000 7f76877fe640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f7687fff640 1 -- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 msgr2=0x7f76740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f7687fff640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f768cc9d640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674004d00 0x7f7674005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f7687fff640 1 -- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674004d00 msgr2=0x7f7674005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f7687fff640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674004d00 0x7f7674005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f7687fff640 1 -- 172.21.15.49:0/3119594647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674003520 con 0x7f7674003a10 2023-12-19T05:50:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.256+0000 7f76877fe640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76880b89a0 0x7f76740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.257+0000 7f7687fff640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674003a10 0x7f7674003e30 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f767800a800 tx=0x7f76740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e528698debb8392 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.257+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780072d0 con 0x7f7674003a10 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.257+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767802f070 con 0x7f7674003a10 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.257+0000 7f7686ffd640 1 -- 172.21.15.49:0/3119594647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780076b0 con 0x7f7674003a10 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 -- 172.21.15.49:0/3119594647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674003a10 msgr2=0x7f7674003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 --2- 172.21.15.49:0/3119594647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674003a10 0x7f7674003e30 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f767800a800 tx=0x7f76740057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768cc9d640 1 -- 172.21.15.49:0/3119594647 reap_dead start 2023-12-19T05:50:38.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 -- 172.21.15.49:0/3119594647 shutdown_connections 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 -- 172.21.15.49:0/3119594647 >> 172.21.15.49:0/3119594647 conn(0x7f76880b26f0 msgr2=0x7f76880b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 -- 172.21.15.49:0/3119594647 shutdown_connections 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.258+0000 7f768e700640 1 -- 172.21.15.49:0/3119594647 wait complete. 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.260+0000 7f768e700640 1 Processor -- start 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.260+0000 7f768e700640 1 -- start start 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674003a10 0x7f768815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f768813e480 0x7f768813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880d2670 con 0x7f7688156550 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880d1680 con 0x7f7674003a10 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f768e700640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7688156f10 con 0x7f768813e480 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f76877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f76877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51304/0 (socket says 172.21.15.49:51304) 2023-12-19T05:50:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.261+0000 7f76877fe640 1 -- 172.21.15.49:0/3436637117 learned_addr learned my addr 172.21.15.49:0/3436637117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:38.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f768cc9d640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f768813e480 0x7f768813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f7687fff640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674003a10 0x7f768815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 -- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f768813e480 msgr2=0x7f768813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f768813e480 0x7f768813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 -- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674003a10 msgr2=0x7f768815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674003a10 0x7f768815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 -- 172.21.15.49:0/3436637117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880d18d0 con 0x7f7688156550 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f76877fe640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f767000d7a0 tx=0x7f767000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670017070 con 0x7f7688156550 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670005070 con 0x7f7688156550 2023-12-19T05:50:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670005420 con 0x7f7688156550 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.262+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880d1bb0 con 0x7f7688156550 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.263+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880d2170 con 0x7f7688156550 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.264+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880d2330 con 0x7f7688156550 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.265+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7670007030 con 0x7f7688156550 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.266+0000 7f7684ff9640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 0x7f766806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.266+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76700881e0 con 0x7f7688156550 2023-12-19T05:50:38.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.266+0000 7f7687fff640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 0x7f766806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.268+0000 7f7687fff640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 0x7f766806c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7678034000 tx=0x7f7678007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.270+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76700537c0 con 0x7f7688156550 2023-12-19T05:50:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.458+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7688141d20 con 0x7f7688156550 2023-12-19T05:50:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.461+0000 7f7684ff9640 1 -- 172.21.15.49:0/3436637117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16125 (secure 0 0 0) 0x7f7670056de0 con 0x7f7688156550 2023-12-19T05:50:38.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:38.463 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":175,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:38.018871+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.463+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 msgr2=0x7f766806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.463+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 0x7f766806c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7678034000 tx=0x7f7678007000 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.463+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 msgr2=0x7f76881569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.463+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f767000d7a0 tx=0x7f767000dc60 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 shutdown_connections 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f766806a430 0x7f766806c8f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f768813e480 0x7f768813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688156550 0x7f76881569d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 --2- 172.21.15.49:0/3436637117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7674003a10 0x7f768815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 >> 172.21.15.49:0/3436637117 conn(0x7f76880b26f0 msgr2=0x7f76880b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 shutdown_connections 2023-12-19T05:50:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.464+0000 7f768e700640 1 -- 172.21.15.49:0/3436637117 wait complete. 2023-12-19T05:50:38.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:38.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.708+0000 7f5551acc640 1 Processor -- start 2023-12-19T05:50:38.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.708+0000 7f5551acc640 1 -- start start 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.710+0000 7f5551acc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f554c15aa70 0x7f554c164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.710+0000 7f5551acc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c06b520 con 0x7f554c15b1e0 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.710+0000 7f5551acc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0b2b20 con 0x7f554c159f80 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.710+0000 7f5551acc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0b2fb0 con 0x7f554c15aa70 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f554bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f554c15b1e0 0x7f554c15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58766/0 (socket says 172.21.15.49:58766) 2023-12-19T05:50:38.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f554bfff640 1 -- 172.21.15.49:0/484000782 learned_addr learned my addr 172.21.15.49:0/484000782 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:38.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f55512cb640 1 --2- 172.21.15.49:0/484000782 >> v2:172.21.15.49:3300/0 conn(0x7f554c15aa70 0x7f554c164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f55512cb640 1 -- 172.21.15.49:0/484000782 >> v1:172.21.15.115:6789/0 conn(0x7f554c159f80 legacy=0x7f554c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f55512cb640 1 -- 172.21.15.49:0/484000782 >> v1:172.21.15.49:6789/0 conn(0x7f554c15b1e0 legacy=0x7f554c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f55512cb640 1 -- 172.21.15.49:0/484000782 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0b1f10 con 0x7f554c15aa70 2023-12-19T05:50:38.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.711+0000 7f554b7fe640 1 -- 172.21.15.49:0/484000782 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695338254 0 0) 0x7f554c06b520 con 0x7f554c15b1e0 2023-12-19T05:50:38.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f55512cb640 1 --2- 172.21.15.49:0/484000782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c15aa70 0x7f554c164f30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f5544009d90 tx=0x7f554402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806dedb8e06e701c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f554b7fe640 1 -- 172.21.15.49:0/484000782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554402cd80 con 0x7f554c15aa70 2023-12-19T05:50:38.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f554b7fe640 1 -- 172.21.15.49:0/484000782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544034440 con 0x7f554c15aa70 2023-12-19T05:50:38.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f554b7fe640 1 -- 172.21.15.49:0/484000782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440347d0 con 0x7f554c15aa70 2023-12-19T05:50:38.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f5551acc640 1 -- 172.21.15.49:0/484000782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c15aa70 msgr2=0x7f554c164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.713+0000 7f5551acc640 1 --2- 172.21.15.49:0/484000782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c15aa70 0x7f554c164f30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f5544009d90 tx=0x7f554402bfd0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.714+0000 7f5551acc640 1 -- 172.21.15.49:0/484000782 shutdown_connections 2023-12-19T05:50:38.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.714+0000 7f5551acc640 1 --2- 172.21.15.49:0/484000782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c15aa70 0x7f554c164f30 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.714+0000 7f5551acc640 1 -- 172.21.15.49:0/484000782 >> 172.21.15.49:0/484000782 conn(0x7f554c0b0100 msgr2=0x7f554c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:38.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.714+0000 7f5551acc640 1 -- 172.21.15.49:0/484000782 shutdown_connections 2023-12-19T05:50:38.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.714+0000 7f5551acc640 1 -- 172.21.15.49:0/484000782 wait complete. 2023-12-19T05:50:38.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.715+0000 7f5551acc640 1 Processor -- start 2023-12-19T05:50:38.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.716+0000 7f5551acc640 1 -- start start 2023-12-19T05:50:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.716+0000 7f5551acc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.716+0000 7f5551acc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f554c15aa70 0x7f554c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5551acc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f554c15b1e0 0x7f554c06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5551acc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c06d930 con 0x7f554c159f80 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5551acc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c06e300 con 0x7f554c15b1e0 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5551acc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c156d70 con 0x7f554c15aa70 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51318/0 (socket says 172.21.15.49:51318) 2023-12-19T05:50:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 -- 172.21.15.49:0/2249986118 learned_addr learned my addr 172.21.15.49:0/2249986118 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 -- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f554c15aa70 msgr2=0x7f554c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f554c15aa70 0x7f554c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 -- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f554c15b1e0 msgr2=0x7f554c06baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f55512cb640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f554c15b1e0 0x7f554c06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f554c15b1e0 0x7f554c06baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.717+0000 7f5550aca640 1 -- 172.21.15.49:0/2249986118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544009a70 con 0x7f554c159f80 2023-12-19T05:50:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f5550aca640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f554000c450 tx=0x7f554000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400052d0 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540005430 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c157050 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540012870 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.718+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c06d550 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.719+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c06d710 con 0x7f554c159f80 2023-12-19T05:50:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.720+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55400129d0 con 0x7f554c159f80 2023-12-19T05:50:38.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.721+0000 7f55497fa640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 0x7f553006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:38.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.721+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5540088440 con 0x7f554c159f80 2023-12-19T05:50:38.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.722+0000 7f554bfff640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 0x7f553006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.723+0000 7f554bfff640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 0x7f553006c8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f55380079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.726+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5540053a30 con 0x7f554c159f80 2023-12-19T05:50:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.919+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f554c061910 con 0x7f554c159f80 2023-12-19T05:50:38.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.921+0000 7f55497fa640 1 -- 172.21.15.49:0/2249986118 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16125 (secure 0 0 0) 0x7f5540057050 con 0x7f554c159f80 2023-12-19T05:50:38.923 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:38.924 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":175,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:38.018871+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 msgr2=0x7f553006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 0x7f553006c8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f55380079c0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 msgr2=0x7f554c14e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f554000c450 tx=0x7f554000c910 comp rx=0 tx=0).stop 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 shutdown_connections 2023-12-19T05:50:38.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f553006a430 0x7f553006c8f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f554c15aa70 0x7f554c06ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f554c15b1e0 0x7f554c06baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 --2- 172.21.15.49:0/2249986118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f554c159f80 0x7f554c14e210 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.924+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 >> 172.21.15.49:0/2249986118 conn(0x7f554c0b0100 msgr2=0x7f554c158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.925+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 shutdown_connections 2023-12-19T05:50:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:38.925+0000 7f5551acc640 1 -- 172.21.15.49:0/2249986118 wait complete. 2023-12-19T05:50:38.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:50:39.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.163+0000 7f12d8b7e640 1 Processor -- start 2023-12-19T05:50:39.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.164+0000 7f12d8b7e640 1 -- start start 2023-12-19T05:50:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.165+0000 7f12d8b7e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12d40b0a00 0x7f12d406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.165+0000 7f12d8b7e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40b1870 con 0x7f12d41615b0 2023-12-19T05:50:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.165+0000 7f12d8b7e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40cc760 con 0x7f12d406dec0 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.165+0000 7f12d8b7e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d4165900 con 0x7f12d40b0a00 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12d40b0a00 0x7f12d406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12d40b0a00 0x7f12d406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51334/0 (socket says 172.21.15.49:51334) 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 -- 172.21.15.49:0/1334310180 learned_addr learned my addr 172.21.15.49:0/1334310180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12d37fe640 1 --1- 172.21.15.49:0/1334310180 >> v1:172.21.15.49:6789/0 conn(0x7f12d41615b0 0x7f12d40b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58772/0 (socket says 172.21.15.49:58772) 2023-12-19T05:50:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 -- 172.21.15.49:0/1334310180 >> v1:172.21.15.115:6789/0 conn(0x7f12d406dec0 legacy=0x7f12d40b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 -- 172.21.15.49:0/1334310180 >> v1:172.21.15.49:6789/0 conn(0x7f12d41615b0 legacy=0x7f12d40b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12cbfff640 1 -- 172.21.15.49:0/1334310180 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4165be0 con 0x7f12d40b0a00 2023-12-19T05:50:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.166+0000 7f12d2ffd640 1 -- 172.21.15.49:0/1334310180 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245342053 0 0) 0x7f12d40b1870 con 0x7f12d41615b0 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.167+0000 7f12cbfff640 1 --2- 172.21.15.49:0/1334310180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d40b0a00 0x7f12d406b2f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009870 tx=0x7f12bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe2f5267b0f4ba4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d2ffd640 1 -- 172.21.15.49:0/1334310180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc030860 con 0x7f12d40b0a00 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d2ffd640 1 -- 172.21.15.49:0/1334310180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0309c0 con 0x7f12d40b0a00 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d2ffd640 1 -- 172.21.15.49:0/1334310180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc030d50 con 0x7f12d40b0a00 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1334310180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d40b0a00 msgr2=0x7f12d406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1334310180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d40b0a00 0x7f12d406b2f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009870 tx=0x7f12bc02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:50:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1334310180 shutdown_connections 2023-12-19T05:50:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.168+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1334310180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d40b0a00 0x7f12d406b2f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.169+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1334310180 >> 172.21.15.49:0/1334310180 conn(0x7f12d40659a0 msgr2=0x7f12d4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.169+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1334310180 shutdown_connections 2023-12-19T05:50:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.169+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1334310180 wait complete. 2023-12-19T05:50:39.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.171+0000 7f12d8b7e640 1 Processor -- start 2023-12-19T05:50:39.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.171+0000 7f12d8b7e640 1 -- start start 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 0x7f12d4155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 0x7f12d41f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4159090 con 0x7f12d406dec0 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4156050 con 0x7f12d40b0a00 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d8b7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4155b50 con 0x7f12d41615b0 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51344/0 (socket says 172.21.15.49:51344) 2023-12-19T05:50:39.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.172+0000 7f12d37fe640 1 -- 172.21.15.49:0/1431437194 learned_addr learned my addr 172.21.15.49:0/1431437194 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d3fff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 0x7f12d41f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12cbfff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 0x7f12d4155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 -- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 msgr2=0x7f12d41f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 0x7f12d41f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 -- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 msgr2=0x7f12d4155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:39.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 0x7f12d4155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 -- 172.21.15.49:0/1431437194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0094d0 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d3fff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 0x7f12d41f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12cbfff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 0x7f12d4155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d37fe640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c430 tx=0x7f12c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40074e0 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4007660 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4004a20 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.173+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d4158510 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.174+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d4158ad0 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.175+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d4061910 con 0x7f12d406dec0 2023-12-19T05:50:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.176+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12c4004b80 con 0x7f12d406dec0 2023-12-19T05:50:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.177+0000 7f12d0ff9640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.177+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c40887f0 con 0x7f12d406dec0 2023-12-19T05:50:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.178+0000 7f12cbfff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.179+0000 7f12cbfff640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f12bc036000 tx=0x7f12bc03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.182+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12c4053d40 con 0x7f12d406dec0 2023-12-19T05:50:39.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:39.409+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12d415c1b0 con 0x7f12d406dec0 2023-12-19T05:50:40.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.038+0000 7f12d0ff9640 1 -- 172.21.15.49:0/1431437194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12c4057360 con 0x7f12d406dec0 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 msgr2=0x7f12b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f12bc036000 tx=0x7f12bc03b040 comp rx=0 tx=0).stop 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 msgr2=0x7f12d4157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c430 tx=0x7f12c400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 shutdown_connections 2023-12-19T05:50:40.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f12b406a430 0x7f12b406c8f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d41615b0 0x7f12d41f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d40b0a00 0x7f12d4155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 --2- 172.21.15.49:0/1431437194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d406dec0 0x7f12d4157f30 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.041+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 >> 172.21.15.49:0/1431437194 conn(0x7f12d40659a0 msgr2=0x7f12d406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.042+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 shutdown_connections 2023-12-19T05:50:40.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.042+0000 7f12d8b7e640 1 -- 172.21.15.49:0/1431437194 wait complete. 2023-12-19T05:50:40.063 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:50:40.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:50:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.290+0000 7f72b318f640 1 Processor -- start 2023-12-19T05:50:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.290+0000 7f72b318f640 1 -- start start 2023-12-19T05:50:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b318f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72ac146c40 0x7f72ac070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b318f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b318f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac0b7d00 con 0x7f72ac0b7360 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b318f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac0700c0 con 0x7f72ac146c40 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b318f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac06f160 con 0x7f72ac0d08f0 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72ac146c40 0x7f72ac070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72ac146c40 0x7f72ac070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51352/0 (socket says 172.21.15.49:51352) 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 -- 172.21.15.49:0/1109884544 learned_addr learned my addr 172.21.15.49:0/1109884544 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:40.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 -- 172.21.15.49:0/1109884544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 msgr2=0x7f72ac0b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:40.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 --2- 172.21.15.49:0/1109884544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 -- 172.21.15.49:0/1109884544 >> v1:172.21.15.115:6789/0 conn(0x7f72ac0b7360 legacy=0x7f72ac160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:40.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.292+0000 7f72b218d640 1 -- 172.21.15.49:0/1109884544 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac06f440 con 0x7f72ac146c40 2023-12-19T05:50:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.294+0000 7f72b218d640 1 --2- 172.21.15.49:0/1109884544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac070e70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f729c009e50 tx=0x7f729c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c51b08d5d1dc0e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.294+0000 7f72b118b640 1 -- 172.21.15.49:0/1109884544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c02caa0 con 0x7f72ac146c40 2023-12-19T05:50:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.294+0000 7f72b118b640 1 -- 172.21.15.49:0/1109884544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c02cc00 con 0x7f72ac146c40 2023-12-19T05:50:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.294+0000 7f72b118b640 1 -- 172.21.15.49:0/1109884544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0343f0 con 0x7f72ac146c40 2023-12-19T05:50:40.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 -- 172.21.15.49:0/1109884544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 msgr2=0x7f72ac070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 --2- 172.21.15.49:0/1109884544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac070e70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f729c009e50 tx=0x7f729c02bf00 comp rx=0 tx=0).stop 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 -- 172.21.15.49:0/1109884544 shutdown_connections 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 --2- 172.21.15.49:0/1109884544 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac0b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 --2- 172.21.15.49:0/1109884544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac070e70 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 -- 172.21.15.49:0/1109884544 >> 172.21.15.49:0/1109884544 conn(0x7f72ac0d31b0 msgr2=0x7f72ac0d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 -- 172.21.15.49:0/1109884544 shutdown_connections 2023-12-19T05:50:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.295+0000 7f72b318f640 1 -- 172.21.15.49:0/1109884544 wait complete. 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.297+0000 7f72b318f640 1 Processor -- start 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.297+0000 7f72b318f640 1 -- start start 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 0x7f72ac0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac1f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac132b40 con 0x7f72ac146c40 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0b20e0 con 0x7f72ac0b7360 2023-12-19T05:50:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b318f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac1f70c0 con 0x7f72ac0d08f0 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51356/0 (socket says 172.21.15.49:51356) 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 -- 172.21.15.49:0/4106749613 learned_addr learned my addr 172.21.15.49:0/4106749613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b198c640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac1f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b218d640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 0x7f72ac0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 -- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 msgr2=0x7f72ac1f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac1f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 -- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 msgr2=0x7f72ac0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 0x7f72ac0cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b298e640 1 -- 172.21.15.49:0/4106749613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c009b30 con 0x7f72ac146c40 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b198c640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac1f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.298+0000 7f72b218d640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 0x7f72ac0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72b298e640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b440 tx=0x7f72a400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011830 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a40119b0 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac0ca170 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011d60 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.299+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac0ca730 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.300+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac132cb0 con 0x7f72ac146c40 2023-12-19T05:50:40.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.301+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72a401a400 con 0x7f72ac146c40 2023-12-19T05:50:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.302+0000 7f72aaffd640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 0x7f729806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.302+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72a4088aa0 con 0x7f72ac146c40 2023-12-19T05:50:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.303+0000 7f72b218d640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 0x7f729806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.304+0000 7f72b218d640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 0x7f729806c8f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f729c035000 tx=0x7f729c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.306+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f72ac132cb0 con 0x7f72ac146c40 2023-12-19T05:50:40.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:40.544+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f72ac132c80 con 0x7f72ac146c40 2023-12-19T05:50:41.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.442+0000 7f72aaffd640 1 -- 172.21.15.49:0/4106749613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v80) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72a4015020 con 0x7f72ac146c40 2023-12-19T05:50:41.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 msgr2=0x7f729806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 0x7f729806c8f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f729c035000 tx=0x7f729c030000 comp rx=0 tx=0).stop 2023-12-19T05:50:41.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 msgr2=0x7f72ac1f6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b440 tx=0x7f72a400b900 comp rx=0 tx=0).stop 2023-12-19T05:50:41.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 shutdown_connections 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f729806a430 0x7f729806c8f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72ac0d08f0 0x7f72ac1f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72ac146c40 0x7f72ac1f6b80 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 --2- 172.21.15.49:0/4106749613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72ac0b7360 0x7f72ac0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.445+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 >> 172.21.15.49:0/4106749613 conn(0x7f72ac0d31b0 msgr2=0x7f72ac145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.446+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 shutdown_connections 2023-12-19T05:50:41.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.446+0000 7f72b318f640 1 -- 172.21.15.49:0/4106749613 wait complete. 2023-12-19T05:50:41.469 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:50:41.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:41.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.702+0000 7fd2de349640 1 Processor -- start 2023-12-19T05:50:41.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.702+0000 7fd2de349640 1 -- start start 2023-12-19T05:50:41.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2de349640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2d80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2de349640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2d80cdbf0 0x7fd2d80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2de349640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d815ec30 con 0x7fd2d815f680 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2de349640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80ce5c0 con 0x7fd2d80cdbf0 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2de349640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815e980 con 0x7fd2d815e5a0 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2dcb46640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2d815f680 0x7fd2d80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58780/0 (socket says 172.21.15.49:58780) 2023-12-19T05:50:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.704+0000 7fd2dcb46640 1 -- 172.21.15.49:0/539832761 learned_addr learned my addr 172.21.15.49:0/539832761 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2dd347640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2d80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2ddb48640 1 --2- 172.21.15.49:0/539832761 >> v2:172.21.15.115:3300/0 conn(0x7fd2d80cdbf0 0x7fd2d80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913756546 0 0) 0x7fd2d815ec30 con 0x7fd2d815f680 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c4003520 con 0x7fd2d815f680 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061190627 0 0) 0x7fd2c4003520 con 0x7fd2d815f680 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 msgr2=0x7fd2d80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2d80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 >> v2:172.21.15.115:3300/0 conn(0x7fd2d80cdbf0 msgr2=0x7fd2d80ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:41.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 --2- 172.21.15.49:0/539832761 >> v2:172.21.15.115:3300/0 conn(0x7fd2d80cdbf0 0x7fd2d80ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80b2f90 con 0x7fd2d815f680 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd2c8001670 con 0x7fd2d815f680 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 >> v1:172.21.15.49:6789/0 conn(0x7fd2d815f680 legacy=0x7fd2d80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2c4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4003f40 0x7fd2c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80ce5c0 con 0x7fd2c4004d00 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815e980 con 0x7fd2c4003f40 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.705+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c400b980 con 0x7fd2d815e5a0 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2dd347640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2c4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2dcb46640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4003f40 0x7fd2c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 -- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 msgr2=0x7fd2c4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:41.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d815e5a0 0x7fd2c4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 -- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4003f40 msgr2=0x7fd2c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:41.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4003f40 0x7fd2c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2ddb48640 1 -- 172.21.15.49:0/539832761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4003520 con 0x7fd2c4004d00 2023-12-19T05:50:41.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.706+0000 7fd2dcb46640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4003f40 0x7fd2c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2ddb48640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2c4005180 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e170 tx=0x7fd2c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1da64fcaad230b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d002cc20 con 0x7fd2c4004d00 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000f040 con 0x7fd2c4004d00 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2cffff640 1 -- 172.21.15.49:0/539832761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0034440 con 0x7fd2c4004d00 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2de349640 1 -- 172.21.15.49:0/539832761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 msgr2=0x7fd2c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.708+0000 7fd2de349640 1 --2- 172.21.15.49:0/539832761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2c4005180 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e170 tx=0x7fd2c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.709+0000 7fd2ddb48640 1 -- 172.21.15.49:0/539832761 reap_dead start 2023-12-19T05:50:41.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.709+0000 7fd2de349640 1 -- 172.21.15.49:0/539832761 shutdown_connections 2023-12-19T05:50:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.709+0000 7fd2de349640 1 -- 172.21.15.49:0/539832761 >> 172.21.15.49:0/539832761 conn(0x7fd2d80b0100 msgr2=0x7fd2d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.709+0000 7fd2de349640 1 -- 172.21.15.49:0/539832761 shutdown_connections 2023-12-19T05:50:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.709+0000 7fd2de349640 1 -- 172.21.15.49:0/539832761 wait complete. 2023-12-19T05:50:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.711+0000 7fd2de349640 1 Processor -- start 2023-12-19T05:50:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.711+0000 7fd2de349640 1 -- start start 2023-12-19T05:50:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2d80cb9e0 0x7fd2d80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d80cd400 0x7fd2d81f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cd8b0 con 0x7fd2c4004d00 2023-12-19T05:50:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8155680 con 0x7fd2d80cb9e0 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2de349640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cbea0 con 0x7fd2d80cd400 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2dd347640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2dd347640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51378/0 (socket says 172.21.15.49:51378) 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.712+0000 7fd2dd347640 1 -- 172.21.15.49:0/3759784620 learned_addr learned my addr 172.21.15.49:0/3759784620 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 -- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d80cd400 msgr2=0x7fd2d81f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d80cd400 0x7fd2d81f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 -- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2d80cb9e0 msgr2=0x7fd2d80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2d80cb9e0 0x7fd2d80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 -- 172.21.15.49:0/3759784620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80cc180 con 0x7fd2c4004d00 2023-12-19T05:50:41.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2dd347640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011600 tx=0x7fd2d4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400f920 con 0x7fd2c4004d00 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400fa80 con 0x7fd2c4004d00 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80cc460 con 0x7fd2c4004d00 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.713+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400fdf0 con 0x7fd2c4004d00 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.714+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80b2c40 con 0x7fd2c4004d00 2023-12-19T05:50:41.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.715+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8061910 con 0x7fd2c4004d00 2023-12-19T05:50:41.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.716+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2d4015460 con 0x7fd2c4004d00 2023-12-19T05:50:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.717+0000 7fd2cdffb640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 0x7fd2bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.717+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2d4089170 con 0x7fd2c4004d00 2023-12-19T05:50:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.717+0000 7fd2dcb46640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 0x7fd2bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:41.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.718+0000 7fd2dcb46640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 0x7fd2bc06c920 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80017a0 tx=0x7fd2c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.721+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2d40546c0 con 0x7fd2c4004d00 2023-12-19T05:50:41.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.952+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2d80c8c20 con 0x7fd2c4004d00 2023-12-19T05:50:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.953+0000 7fd2cdffb640 1 -- 172.21.15.49:0/3759784620 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fd2d4057ce0 con 0x7fd2c4004d00 2023-12-19T05:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:50:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:50:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 msgr2=0x7fd2bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 0x7fd2bc06c920 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80017a0 tx=0x7fd2c8009040 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 msgr2=0x7fd2d8155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011600 tx=0x7fd2d4011ac0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 shutdown_connections 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd2bc06a460 0x7fd2bc06c920 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2d80cd400 0x7fd2d81f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2d80cb9e0 0x7fd2d80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 --2- 172.21.15.49:0/3759784620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4004d00 0x7fd2d8155140 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 >> 172.21.15.49:0/3759784620 conn(0x7fd2d80b0100 msgr2=0x7fd2d815a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 shutdown_connections 2023-12-19T05:50:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:41.956+0000 7fd2de349640 1 -- 172.21.15.49:0/3759784620 wait complete. 2023-12-19T05:50:42.442 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:50:42.484 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-12-19T05:50:42.482+0000 7f7001669640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:50:42.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.686+0000 7fb804826640 1 Processor -- start 2023-12-19T05:50:42.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.686+0000 7fb804826640 1 -- start start 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb804826640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb800146e10 0x7fb8000d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb804826640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb8000ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb804826640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000cd840 con 0x7fb8000d2b00 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb804826640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000d2430 con 0x7fb800146e10 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb804826640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000ceac0 con 0x7fb8000ce110 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb7fe59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb800146e10 0x7fb8000d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb7fe59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb800146e10 0x7fb8000d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51386/0 (socket says 172.21.15.49:51386) 2023-12-19T05:50:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.688+0000 7fb7fe59c640 1 -- 172.21.15.49:0/4156946485 learned_addr learned my addr 172.21.15.49:0/4156946485 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fed9d640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb8000ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fe59c640 1 -- 172.21.15.49:0/4156946485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 msgr2=0x7fb8000ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb8000ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fe59c640 1 -- 172.21.15.49:0/4156946485 >> v1:172.21.15.115:6789/0 conn(0x7fb8000d2b00 legacy=0x7fb8000b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fe59c640 1 -- 172.21.15.49:0/4156946485 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000b6e90 con 0x7fb800146e10 2023-12-19T05:50:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.689+0000 7fb7fed9d640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb8000ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.690+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb800146e10 0x7fb8000d1ef0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009e80 tx=0x7fb7f002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f36ba980759208 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.690+0000 7fb7fd59a640 1 -- 172.21.15.49:0/4156946485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f002ca50 con 0x7fb800146e10 2023-12-19T05:50:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.690+0000 7fb7fd59a640 1 -- 172.21.15.49:0/4156946485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f002cbb0 con 0x7fb800146e10 2023-12-19T05:50:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.690+0000 7fb7fd59a640 1 -- 172.21.15.49:0/4156946485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00343f0 con 0x7fb800146e10 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 -- 172.21.15.49:0/4156946485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb800146e10 msgr2=0x7fb8000d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb800146e10 0x7fb8000d1ef0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009e80 tx=0x7fb7f002beb0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 -- 172.21.15.49:0/4156946485 shutdown_connections 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb8000ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 --2- 172.21.15.49:0/4156946485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb800146e10 0x7fb8000d1ef0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 -- 172.21.15.49:0/4156946485 >> 172.21.15.49:0/4156946485 conn(0x7fb8000b29c0 msgr2=0x7fb8000b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 -- 172.21.15.49:0/4156946485 shutdown_connections 2023-12-19T05:50:42.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.691+0000 7fb804826640 1 -- 172.21.15.49:0/4156946485 wait complete. 2023-12-19T05:50:42.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.693+0000 7fb804826640 1 Processor -- start 2023-12-19T05:50:42.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.693+0000 7fb804826640 1 -- start start 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb80015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb800146e10 0x7fb8000ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800143670 con 0x7fb8000d2b00 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001f2780 con 0x7fb800146e10 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.694+0000 7fb804826640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000ccc90 con 0x7fb8000ce110 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51392/0 (socket says 172.21.15.49:51392) 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 -- 172.21.15.49:0/1839746247 learned_addr learned my addr 172.21.15.49:0/1839746247 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fed9d640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb800146e10 0x7fb8000ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb80015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 -- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 msgr2=0x7fb80015c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb80015c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 -- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb800146e10 msgr2=0x7fb8000ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb800146e10 0x7fb8000ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 -- 172.21.15.49:0/1839746247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009b30 con 0x7fb8000d2b00 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb80015c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.695+0000 7fb7fdd9b640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c430 tx=0x7fb7e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.696+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011790 con 0x7fb8000d2b00 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.696+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80118f0 con 0x7fb8000d2b00 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.696+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000ccf70 con 0x7fb8000d2b00 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.696+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011ce0 con 0x7fb8000d2b00 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.696+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000cd250 con 0x7fb8000d2b00 2023-12-19T05:50:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.697+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb800143820 con 0x7fb8000d2b00 2023-12-19T05:50:42.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.698+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7e801c460 con 0x7fb8000d2b00 2023-12-19T05:50:42.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.699+0000 7fb7f6ffd640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 0x7fb7e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:42.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.699+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7e8088890 con 0x7fb8000d2b00 2023-12-19T05:50:42.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.700+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 0x7fb7e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.701+0000 7fb7fe59c640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 0x7fb7e006c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0035000 tx=0x7fb7f0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:42.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.703+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb800143820 con 0x7fb8000d2b00 2023-12-19T05:50:42.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.897+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb800143150 con 0x7fb8000d2b00 2023-12-19T05:50:42.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.900+0000 7fb7f6ffd640 1 -- 172.21.15.49:0/1839746247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+16112 (secure 0 0 0) 0x7fb7e8053e80 con 0x7fb8000d2b00 2023-12-19T05:50:42.902 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:42.902 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":176,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:50:39.024150+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:50:42.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.902+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 msgr2=0x7fb7e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.902+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 0x7fb7e006c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0035000 tx=0x7fb7f0030000 comp rx=0 tx=0).stop 2023-12-19T05:50:42.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.902+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 msgr2=0x7fb8000c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.902+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c430 tx=0x7fb7e800c8f0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 shutdown_connections 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb7e006a430 0x7fb7e006c8f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb800146e10 0x7fb8000ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8000d2b00 0x7fb8000c9ba0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 --2- 172.21.15.49:0/1839746247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8000ce110 0x7fb80015c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 >> 172.21.15.49:0/1839746247 conn(0x7fb8000b29c0 msgr2=0x7fb8000b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 shutdown_connections 2023-12-19T05:50:42.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:42.903+0000 7fb804826640 1 -- 172.21.15.49:0/1839746247 wait complete. 2023-12-19T05:50:42.923 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:50:42.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:50:43.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.204+0000 7f4444d16640 1 Processor -- start 2023-12-19T05:50:43.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.204+0000 7f4444d16640 1 -- start start 2023-12-19T05:50:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.205+0000 7f4444d16640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4440146e10 0x7f44400d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.205+0000 7f4444d16640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f44400ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.205+0000 7f4444d16640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400cd840 con 0x7f44400d2b00 2023-12-19T05:50:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.205+0000 7f4444d16640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400d2430 con 0x7f4440146e10 2023-12-19T05:50:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.205+0000 7f4444d16640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400ceac0 con 0x7f44400ce110 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443dd9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f44400d2b00 0x7f44400b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58794/0 (socket says 172.21.15.49:58794) 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443dd9b640 1 -- 172.21.15.49:0/3258929196 learned_addr learned my addr 172.21.15.49:0/3258929196 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443e59c640 1 --2- 172.21.15.49:0/3258929196 >> v2:172.21.15.115:3300/0 conn(0x7f4440146e10 0x7f44400d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443ed9d640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f44400ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293428972 0 0) 0x7f44400cd840 con 0x7f44400d2b00 2023-12-19T05:50:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.206+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442c003520 con 0x7f44400d2b00 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 869860829 0 0) 0x7f442c003520 con 0x7f44400d2b00 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 msgr2=0x7f44400ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f44400ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 >> v2:172.21.15.115:3300/0 conn(0x7f4440146e10 msgr2=0x7f44400d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 --2- 172.21.15.49:0/3258929196 >> v2:172.21.15.115:3300/0 conn(0x7f4440146e10 0x7f44400d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400b6e90 con 0x7f44400d2b00 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f4428001670 con 0x7f44400d2b00 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 >> v1:172.21.15.49:6789/0 conn(0x7f44400d2b00 legacy=0x7f44400b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f442c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c003fe0 0x7f442c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c004d00 0x7f442c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400ceac0 con 0x7f442c004d00 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c00b9b0 con 0x7f442c003fe0 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c00bb70 con 0x7f44400ce110 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.207+0000 7f443ed9d640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c004d00 0x7f442c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443e59c640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f442c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443dd9b640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c003fe0 0x7f442c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443ed9d640 1 -- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 msgr2=0x7f442c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443ed9d640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44400ce110 0x7f442c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443ed9d640 1 -- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c003fe0 msgr2=0x7f442c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443ed9d640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c003fe0 0x7f442c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.208+0000 7f443ed9d640 1 -- 172.21.15.49:0/3258929196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c003520 con 0x7f442c004d00 2023-12-19T05:50:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.209+0000 7f443ed9d640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c004d00 0x7f442c005180 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f4438009ac0 tx=0x7f442c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b07c676ab0677c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.209+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443802c6b0 con 0x7f442c004d00 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.209+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443802c810 con 0x7f442c004d00 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.209+0000 7f443d59a640 1 -- 172.21.15.49:0/3258929196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443802cba0 con 0x7f442c004d00 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 -- 172.21.15.49:0/3258929196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c004d00 msgr2=0x7f442c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 --2- 172.21.15.49:0/3258929196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c004d00 0x7f442c005180 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f4438009ac0 tx=0x7f442c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f443ed9d640 1 -- 172.21.15.49:0/3258929196 reap_dead start 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 -- 172.21.15.49:0/3258929196 shutdown_connections 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 -- 172.21.15.49:0/3258929196 >> 172.21.15.49:0/3258929196 conn(0x7f44400b29c0 msgr2=0x7f44400b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 -- 172.21.15.49:0/3258929196 shutdown_connections 2023-12-19T05:50:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.210+0000 7f4444d16640 1 -- 172.21.15.49:0/3258929196 wait complete. 2023-12-19T05:50:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.212+0000 7f4444d16640 1 Processor -- start 2023-12-19T05:50:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.212+0000 7f4444d16640 1 -- start start 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 0x7f44400c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 0x7f44401425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c9d40 con 0x7f4440141ab0 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440144a60 con 0x7f442c004d00 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.213+0000 7f4444d16640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44401458c0 con 0x7f4440145d50 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51416/0 (socket says 172.21.15.49:51416) 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 -- 172.21.15.49:0/2334565391 learned_addr learned my addr 172.21.15.49:0/2334565391 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443ed9d640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 0x7f44401425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443e59c640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 0x7f44400c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 -- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 msgr2=0x7f44401425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 0x7f44401425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 -- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 msgr2=0x7f44400c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 0x7f44400c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443dd9b640 1 -- 172.21.15.49:0/2334565391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444015c8d0 con 0x7f4440141ab0 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443ed9d640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 0x7f44401425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.214+0000 7f443e59c640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 0x7f44400c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f443dd9b640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f442800e760 tx=0x7f442800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800ee70 con 0x7f4440141ab0 2023-12-19T05:50:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800c8d0 con 0x7f4440141ab0 2023-12-19T05:50:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800cc80 con 0x7f4440141ab0 2023-12-19T05:50:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4440144cb0 con 0x7f4440141ab0 2023-12-19T05:50:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.215+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440145270 con 0x7f4440141ab0 2023-12-19T05:50:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.216+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440061910 con 0x7f4440141ab0 2023-12-19T05:50:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.217+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f442801d460 con 0x7f4440141ab0 2023-12-19T05:50:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.218+0000 7f4436ffd640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 0x7f442006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.218+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4428088850 con 0x7f4440141ab0 2023-12-19T05:50:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.219+0000 7f443e59c640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 0x7f442006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.220+0000 7f443e59c640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 0x7f442006c8f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4430007440 tx=0x7f443000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.222+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4428053ed0 con 0x7f4440141ab0 2023-12-19T05:50:43.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.415+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44400b41c0 con 0x7f442006a430 2023-12-19T05:50:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.438+0000 7f4436ffd640 1 -- 172.21.15.49:0/2334565391 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282525 (secure 0 0 0) 0x7f443000f040 con 0x7f442006a430 2023-12-19T05:50:43.441 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 msgr2=0x7f442006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 0x7f442006c8f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4430007440 tx=0x7f443000b040 comp rx=0 tx=0).stop 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 msgr2=0x7f444015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f442800e760 tx=0x7f442800ec20 comp rx=0 tx=0).stop 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 shutdown_connections 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f442006a430 0x7f442006c8f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4440145d50 0x7f44401425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4440141ab0 0x7f444015c390 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 --2- 172.21.15.49:0/2334565391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c004d00 0x7f44400c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 >> 172.21.15.49:0/2334565391 conn(0x7f44400b29c0 msgr2=0x7f444015d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 shutdown_connections 2023-12-19T05:50:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.445+0000 7f4444d16640 1 -- 172.21.15.49:0/2334565391 wait complete. 2023-12-19T05:50:43.470 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-19T05:50:42.751384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553606,"statfs":{"total":1600000000,"available":1590893404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001840"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041294+0000","last_change":"2023-12-19T05:50:38.041125+0000","last_active":"2023-12-19T05:50:38.041294+0000","last_peered":"2023-12-19T05:50:38.041294+0000","last_clean":"2023-12-19T05:50:38.041294+0000","last_became_active":"2023-12-19T05:50:38.040439+0000","last_became_peered":"2023-12-19T05:50:38.040439+0000","last_unstale":"2023-12-19T05:50:38.041294+0000","last_undegraded":"2023-12-19T05:50:38.041294+0000","last_fullsized":"2023-12-19T05:50:38.041294+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:32.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053849+0000","last_change":"2023-12-19T05:50:38.053750+0000","last_active":"2023-12-19T05:50:38.053849+0000","last_peered":"2023-12-19T05:50:38.053849+0000","last_clean":"2023-12-19T05:50:38.053849+0000","last_became_active":"2023-12-19T05:50:38.053330+0000","last_became_peered":"2023-12-19T05:50:38.053330+0000","last_unstale":"2023-12-19T05:50:38.053849+0000","last_undegraded":"2023-12-19T05:50:38.053849+0000","last_fullsized":"2023-12-19T05:50:38.053849+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:14:14.461139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057116+0000","last_change":"2023-12-19T05:50:38.056280+0000","last_active":"2023-12-19T05:50:38.057116+0000","last_peered":"2023-12-19T05:50:38.057116+0000","last_clean":"2023-12-19T05:50:38.057116+0000","last_became_active":"2023-12-19T05:50:38.055127+0000","last_became_peered":"2023-12-19T05:50:38.055127+0000","last_unstale":"2023-12-19T05:50:38.057116+0000","last_undegraded":"2023-12-19T05:50:38.057116+0000","last_fullsized":"2023-12-19T05:50:38.057116+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:49:43.566915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057278+0000","last_change":"2023-12-19T05:50:38.056243+0000","last_active":"2023-12-19T05:50:38.057278+0000","last_peered":"2023-12-19T05:50:38.057278+0000","last_clean":"2023-12-19T05:50:38.057278+0000","last_became_active":"2023-12-19T05:50:38.051669+0000","last_became_peered":"2023-12-19T05:50:38.051669+0000","last_unstale":"2023-12-19T05:50:38.057278+0000","last_undegraded":"2023-12-19T05:50:38.057278+0000","last_fullsized":"2023-12-19T05:50:38.057278+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:16.440190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.054718+0000","last_change":"2023-12-19T05:50:38.054477+0000","last_active":"2023-12-19T05:50:38.054718+0000","last_peered":"2023-12-19T05:50:38.054718+0000","last_clean":"2023-12-19T05:50:38.054718+0000","last_became_active":"2023-12-19T05:50:38.053663+0000","last_became_peered":"2023-12-19T05:50:38.053663+0000","last_unstale":"2023-12-19T05:50:38.054718+0000","last_undegraded":"2023-12-19T05:50:38.054718+0000","last_fullsized":"2023-12-19T05:50:38.054718+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:45:30.965851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061367+0000","last_change":"2023-12-19T05:50:38.061236+0000","last_active":"2023-12-19T05:50:38.061367+0000","last_peered":"2023-12-19T05:50:38.061367+0000","last_clean":"2023-12-19T05:50:38.061367+0000","last_became_active":"2023-12-19T05:50:38.060842+0000","last_became_peered":"2023-12-19T05:50:38.060842+0000","last_unstale":"2023-12-19T05:50:38.061367+0000","last_undegraded":"2023-12-19T05:50:38.061367+0000","last_fullsized":"2023-12-19T05:50:38.061367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.052657+0000","last_change":"2023-12-19T05:50:38.052532+0000","last_active":"2023-12-19T05:50:38.052657+0000","last_peered":"2023-12-19T05:50:38.052657+0000","last_clean":"2023-12-19T05:50:38.052657+0000","last_became_active":"2023-12-19T05:50:38.052230+0000","last_became_peered":"2023-12-19T05:50:38.052230+0000","last_unstale":"2023-12-19T05:50:38.052657+0000","last_undegraded":"2023-12-19T05:50:38.052657+0000","last_fullsized":"2023-12-19T05:50:38.052657+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:08:43.025182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.042586+0000","last_change":"2023-12-19T05:50:38.042309+0000","last_active":"2023-12-19T05:50:38.042586+0000","last_peered":"2023-12-19T05:50:38.042586+0000","last_clean":"2023-12-19T05:50:38.042586+0000","last_became_active":"2023-12-19T05:50:38.041676+0000","last_became_peered":"2023-12-19T05:50:38.041676+0000","last_unstale":"2023-12-19T05:50:38.042586+0000","last_undegraded":"2023-12-19T05:50:38.042586+0000","last_fullsized":"2023-12-19T05:50:38.042586+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:28:12.678246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057018+0000","last_change":"2023-12-19T05:50:38.056604+0000","last_active":"2023-12-19T05:50:38.057018+0000","last_peered":"2023-12-19T05:50:38.057018+0000","last_clean":"2023-12-19T05:50:38.057018+0000","last_became_active":"2023-12-19T05:50:38.056373+0000","last_became_peered":"2023-12-19T05:50:38.056373+0000","last_unstale":"2023-12-19T05:50:38.057018+0000","last_undegraded":"2023-12-19T05:50:38.057018+0000","last_fullsized":"2023-12-19T05:50:38.057018+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043218+0000","last_change":"2023-12-19T05:50:38.042950+0000","last_active":"2023-12-19T05:50:38.043218+0000","last_peered":"2023-12-19T05:50:38.043218+0000","last_clean":"2023-12-19T05:50:38.043218+0000","last_became_active":"2023-12-19T05:50:38.042710+0000","last_became_peered":"2023-12-19T05:50:38.042710+0000","last_unstale":"2023-12-19T05:50:38.043218+0000","last_undegraded":"2023-12-19T05:50:38.043218+0000","last_fullsized":"2023-12-19T05:50:38.043218+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:38:20.185384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055063+0000","last_change":"2023-12-19T05:50:38.054955+0000","last_active":"2023-12-19T05:50:38.055063+0000","last_peered":"2023-12-19T05:50:38.055063+0000","last_clean":"2023-12-19T05:50:38.055063+0000","last_became_active":"2023-12-19T05:50:38.054695+0000","last_became_peered":"2023-12-19T05:50:38.054695+0000","last_unstale":"2023-12-19T05:50:38.055063+0000","last_undegraded":"2023-12-19T05:50:38.055063+0000","last_fullsized":"2023-12-19T05:50:38.055063+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:17:39.315930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051861+0000","last_change":"2023-12-19T05:50:38.051286+0000","last_active":"2023-12-19T05:50:38.051861+0000","last_peered":"2023-12-19T05:50:38.051861+0000","last_clean":"2023-12-19T05:50:38.051861+0000","last_became_active":"2023-12-19T05:50:38.051028+0000","last_became_peered":"2023-12-19T05:50:38.051028+0000","last_unstale":"2023-12-19T05:50:38.051861+0000","last_undegraded":"2023-12-19T05:50:38.051861+0000","last_fullsized":"2023-12-19T05:50:38.051861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045955+0000","last_change":"2023-12-19T05:50:38.045191+0000","last_active":"2023-12-19T05:50:38.045955+0000","last_peered":"2023-12-19T05:50:38.045955+0000","last_clean":"2023-12-19T05:50:38.045955+0000","last_became_active":"2023-12-19T05:50:38.044960+0000","last_became_peered":"2023-12-19T05:50:38.044960+0000","last_unstale":"2023-12-19T05:50:38.045955+0000","last_undegraded":"2023-12-19T05:50:38.045955+0000","last_fullsized":"2023-12-19T05:50:38.045955+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:52.673282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046141+0000","last_change":"2023-12-19T05:50:38.045875+0000","last_active":"2023-12-19T05:50:38.046141+0000","last_peered":"2023-12-19T05:50:38.046141+0000","last_clean":"2023-12-19T05:50:38.046141+0000","last_became_active":"2023-12-19T05:50:38.045221+0000","last_became_peered":"2023-12-19T05:50:38.045221+0000","last_unstale":"2023-12-19T05:50:38.046141+0000","last_undegraded":"2023-12-19T05:50:38.046141+0000","last_fullsized":"2023-12-19T05:50:38.046141+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:16.440190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.054702+0000","last_change":"2023-12-19T05:50:38.054315+0000","last_active":"2023-12-19T05:50:38.054702+0000","last_peered":"2023-12-19T05:50:38.054702+0000","last_clean":"2023-12-19T05:50:38.054702+0000","last_became_active":"2023-12-19T05:50:38.052304+0000","last_became_peered":"2023-12-19T05:50:38.052304+0000","last_unstale":"2023-12-19T05:50:38.054702+0000","last_undegraded":"2023-12-19T05:50:38.054702+0000","last_fullsized":"2023-12-19T05:50:38.054702+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:50.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047979+0000","last_change":"2023-12-19T05:50:38.047868+0000","last_active":"2023-12-19T05:50:38.047979+0000","last_peered":"2023-12-19T05:50:38.047979+0000","last_clean":"2023-12-19T05:50:38.047979+0000","last_became_active":"2023-12-19T05:50:38.047622+0000","last_became_peered":"2023-12-19T05:50:38.047622+0000","last_unstale":"2023-12-19T05:50:38.047979+0000","last_undegraded":"2023-12-19T05:50:38.047979+0000","last_fullsized":"2023-12-19T05:50:38.047979+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:29.662995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047617+0000","last_change":"2023-12-19T05:50:38.047401+0000","last_active":"2023-12-19T05:50:38.047617+0000","last_peered":"2023-12-19T05:50:38.047617+0000","last_clean":"2023-12-19T05:50:38.047617+0000","last_became_active":"2023-12-19T05:50:38.047101+0000","last_became_peered":"2023-12-19T05:50:38.047101+0000","last_unstale":"2023-12-19T05:50:38.047617+0000","last_undegraded":"2023-12-19T05:50:38.047617+0000","last_fullsized":"2023-12-19T05:50:38.047617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:00:11.226536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057567+0000","last_change":"2023-12-19T05:50:38.057489+0000","last_active":"2023-12-19T05:50:38.057567+0000","last_peered":"2023-12-19T05:50:38.057567+0000","last_clean":"2023-12-19T05:50:38.057567+0000","last_became_active":"2023-12-19T05:50:38.057292+0000","last_became_peered":"2023-12-19T05:50:38.057292+0000","last_unstale":"2023-12-19T05:50:38.057567+0000","last_undegraded":"2023-12-19T05:50:38.057567+0000","last_fullsized":"2023-12-19T05:50:38.057567+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:07.308737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053790+0000","last_change":"2023-12-19T05:50:38.053149+0000","last_active":"2023-12-19T05:50:38.053790+0000","last_peered":"2023-12-19T05:50:38.053790+0000","last_clean":"2023-12-19T05:50:38.053790+0000","last_became_active":"2023-12-19T05:50:38.052527+0000","last_became_peered":"2023-12-19T05:50:38.052527+0000","last_unstale":"2023-12-19T05:50:38.053790+0000","last_undegraded":"2023-12-19T05:50:38.053790+0000","last_fullsized":"2023-12-19T05:50:38.053790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:46.929400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051937+0000","last_change":"2023-12-19T05:50:38.051192+0000","last_active":"2023-12-19T05:50:38.051937+0000","last_peered":"2023-12-19T05:50:38.051937+0000","last_clean":"2023-12-19T05:50:38.051937+0000","last_became_active":"2023-12-19T05:50:38.050775+0000","last_became_peered":"2023-12-19T05:50:38.050775+0000","last_unstale":"2023-12-19T05:50:38.051937+0000","last_undegraded":"2023-12-19T05:50:38.051937+0000","last_fullsized":"2023-12-19T05:50:38.051937+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:10.543852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041025+0000","last_change":"2023-12-19T05:50:38.039691+0000","last_active":"2023-12-19T05:50:38.041025+0000","last_peered":"2023-12-19T05:50:38.041025+0000","last_clean":"2023-12-19T05:50:38.041025+0000","last_became_active":"2023-12-19T05:50:38.039481+0000","last_became_peered":"2023-12-19T05:50:38.039481+0000","last_unstale":"2023-12-19T05:50:38.041025+0000","last_undegraded":"2023-12-19T05:50:38.041025+0000","last_fullsized":"2023-12-19T05:50:38.041025+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:35:57.097553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050363+0000","last_change":"2023-12-19T05:50:38.050150+0000","last_active":"2023-12-19T05:50:38.050363+0000","last_peered":"2023-12-19T05:50:38.050363+0000","last_clean":"2023-12-19T05:50:38.050363+0000","last_became_active":"2023-12-19T05:50:38.049871+0000","last_became_peered":"2023-12-19T05:50:38.049871+0000","last_unstale":"2023-12-19T05:50:38.050363+0000","last_undegraded":"2023-12-19T05:50:38.050363+0000","last_fullsized":"2023-12-19T05:50:38.050363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059430+0000","last_change":"2023-12-19T05:50:38.059359+0000","last_active":"2023-12-19T05:50:38.059430+0000","last_peered":"2023-12-19T05:50:38.059430+0000","last_clean":"2023-12-19T05:50:38.059430+0000","last_became_active":"2023-12-19T05:50:38.059034+0000","last_became_peered":"2023-12-19T05:50:38.059034+0000","last_unstale":"2023-12-19T05:50:38.059430+0000","last_undegraded":"2023-12-19T05:50:38.059430+0000","last_fullsized":"2023-12-19T05:50:38.059430+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:14:00.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.048301+0000","last_change":"2023-12-19T05:50:38.048183+0000","last_active":"2023-12-19T05:50:38.048301+0000","last_peered":"2023-12-19T05:50:38.048301+0000","last_clean":"2023-12-19T05:50:38.048301+0000","last_became_active":"2023-12-19T05:50:38.047938+0000","last_became_peered":"2023-12-19T05:50:38.047938+0000","last_unstale":"2023-12-19T05:50:38.048301+0000","last_undegraded":"2023-12-19T05:50:38.048301+0000","last_fullsized":"2023-12-19T05:50:38.048301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:44.421443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056615+0000","last_change":"2023-12-19T05:50:38.055514+0000","last_active":"2023-12-19T05:50:38.056615+0000","last_peered":"2023-12-19T05:50:38.056615+0000","last_clean":"2023-12-19T05:50:38.056615+0000","last_became_active":"2023-12-19T05:50:38.052749+0000","last_became_peered":"2023-12-19T05:50:38.052749+0000","last_unstale":"2023-12-19T05:50:38.056615+0000","last_undegraded":"2023-12-19T05:50:38.056615+0000","last_fullsized":"2023-12-19T05:50:38.056615+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:31:04.574215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053096+0000","last_change":"2023-12-19T05:50:38.052859+0000","last_active":"2023-12-19T05:50:38.053096+0000","last_peered":"2023-12-19T05:50:38.053096+0000","last_clean":"2023-12-19T05:50:38.053096+0000","last_became_active":"2023-12-19T05:50:38.050653+0000","last_became_peered":"2023-12-19T05:50:38.050653+0000","last_unstale":"2023-12-19T05:50:38.053096+0000","last_undegraded":"2023-12-19T05:50:38.053096+0000","last_fullsized":"2023-12-19T05:50:38.053096+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:14.083359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053832+0000","last_change":"2023-12-19T05:50:38.053592+0000","last_active":"2023-12-19T05:50:38.053832+0000","last_peered":"2023-12-19T05:50:38.053832+0000","last_clean":"2023-12-19T05:50:38.053832+0000","last_became_active":"2023-12-19T05:50:38.052993+0000","last_became_peered":"2023-12-19T05:50:38.052993+0000","last_unstale":"2023-12-19T05:50:38.053832+0000","last_undegraded":"2023-12-19T05:50:38.053832+0000","last_fullsized":"2023-12-19T05:50:38.053832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:41.217121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058991+0000","last_change":"2023-12-19T05:50:38.058921+0000","last_active":"2023-12-19T05:50:38.058991+0000","last_peered":"2023-12-19T05:50:38.058991+0000","last_clean":"2023-12-19T05:50:38.058991+0000","last_became_active":"2023-12-19T05:50:38.058370+0000","last_became_peered":"2023-12-19T05:50:38.058370+0000","last_unstale":"2023-12-19T05:50:38.058991+0000","last_undegraded":"2023-12-19T05:50:38.058991+0000","last_fullsized":"2023-12-19T05:50:38.058991+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:47.185767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050278+0000","last_change":"2023-12-19T05:50:38.050026+0000","last_active":"2023-12-19T05:50:38.050278+0000","last_peered":"2023-12-19T05:50:38.050278+0000","last_clean":"2023-12-19T05:50:38.050278+0000","last_became_active":"2023-12-19T05:50:38.048710+0000","last_became_peered":"2023-12-19T05:50:38.048710+0000","last_unstale":"2023-12-19T05:50:38.050278+0000","last_undegraded":"2023-12-19T05:50:38.050278+0000","last_fullsized":"2023-12-19T05:50:38.050278+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:23:36.893762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045005+0000","last_change":"2023-12-19T05:50:38.044941+0000","last_active":"2023-12-19T05:50:38.045005+0000","last_peered":"2023-12-19T05:50:38.045005+0000","last_clean":"2023-12-19T05:50:38.045005+0000","last_became_active":"2023-12-19T05:50:38.044696+0000","last_became_peered":"2023-12-19T05:50:38.044696+0000","last_unstale":"2023-12-19T05:50:38.045005+0000","last_undegraded":"2023-12-19T05:50:38.045005+0000","last_fullsized":"2023-12-19T05:50:38.045005+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:17:39.315930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046067+0000","last_change":"2023-12-19T05:50:38.044866+0000","last_active":"2023-12-19T05:50:38.046067+0000","last_peered":"2023-12-19T05:50:38.046067+0000","last_clean":"2023-12-19T05:50:38.046067+0000","last_became_active":"2023-12-19T05:50:38.044192+0000","last_became_peered":"2023-12-19T05:50:38.044192+0000","last_unstale":"2023-12-19T05:50:38.046067+0000","last_undegraded":"2023-12-19T05:50:38.046067+0000","last_fullsized":"2023-12-19T05:50:38.046067+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:08.150135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.049716+0000","last_change":"2023-12-19T05:50:38.049404+0000","last_active":"2023-12-19T05:50:38.049716+0000","last_peered":"2023-12-19T05:50:38.049716+0000","last_clean":"2023-12-19T05:50:38.049716+0000","last_became_active":"2023-12-19T05:50:38.049077+0000","last_became_peered":"2023-12-19T05:50:38.049077+0000","last_unstale":"2023-12-19T05:50:38.049716+0000","last_undegraded":"2023-12-19T05:50:38.049716+0000","last_fullsized":"2023-12-19T05:50:38.049716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:23.557874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053840+0000","last_change":"2023-12-19T05:50:38.053398+0000","last_active":"2023-12-19T05:50:38.053840+0000","last_peered":"2023-12-19T05:50:38.053840+0000","last_clean":"2023-12-19T05:50:38.053840+0000","last_became_active":"2023-12-19T05:50:38.053199+0000","last_became_peered":"2023-12-19T05:50:38.053199+0000","last_unstale":"2023-12-19T05:50:38.053840+0000","last_undegraded":"2023-12-19T05:50:38.053840+0000","last_fullsized":"2023-12-19T05:50:38.053840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:15.990075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"175'4","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060298+0000","last_change":"2023-12-19T05:50:37.534136+0000","last_active":"2023-12-19T05:50:38.060298+0000","last_peered":"2023-12-19T05:50:38.060298+0000","last_clean":"2023-12-19T05:50:38.060298+0000","last_became_active":"2023-12-19T05:50:37.533203+0000","last_became_peered":"2023-12-19T05:50:37.533203+0000","last_unstale":"2023-12-19T05:50:38.060298+0000","last_undegraded":"2023-12-19T05:50:38.060298+0000","last_fullsized":"2023-12-19T05:50:38.060298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:55:18.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.039921+0000","last_change":"2023-12-19T05:50:38.038890+0000","last_active":"2023-12-19T05:50:38.039921+0000","last_peered":"2023-12-19T05:50:38.039921+0000","last_clean":"2023-12-19T05:50:38.039921+0000","last_became_active":"2023-12-19T05:50:38.038185+0000","last_became_peered":"2023-12-19T05:50:38.038185+0000","last_unstale":"2023-12-19T05:50:38.039921+0000","last_undegraded":"2023-12-19T05:50:38.039921+0000","last_fullsized":"2023-12-19T05:50:38.039921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:16:11.091452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061527+0000","last_change":"2023-12-19T05:50:37.545546+0000","last_active":"2023-12-19T05:50:38.061527+0000","last_peered":"2023-12-19T05:50:38.061527+0000","last_clean":"2023-12-19T05:50:38.061527+0000","last_became_active":"2023-12-19T05:50:37.544759+0000","last_became_peered":"2023-12-19T05:50:37.544759+0000","last_unstale":"2023-12-19T05:50:38.061527+0000","last_undegraded":"2023-12-19T05:50:38.061527+0000","last_fullsized":"2023-12-19T05:50:38.061527+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:22.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053564+0000","last_change":"2023-12-19T05:50:38.052088+0000","last_active":"2023-12-19T05:50:38.053564+0000","last_peered":"2023-12-19T05:50:38.053564+0000","last_clean":"2023-12-19T05:50:38.053564+0000","last_became_active":"2023-12-19T05:50:38.051792+0000","last_became_peered":"2023-12-19T05:50:38.051792+0000","last_unstale":"2023-12-19T05:50:38.053564+0000","last_undegraded":"2023-12-19T05:50:38.053564+0000","last_fullsized":"2023-12-19T05:50:38.053564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:52.872226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059821+0000","last_change":"2023-12-19T05:50:37.531265+0000","last_active":"2023-12-19T05:50:38.059821+0000","last_peered":"2023-12-19T05:50:38.059821+0000","last_clean":"2023-12-19T05:50:38.059821+0000","last_became_active":"2023-12-19T05:50:37.530704+0000","last_became_peered":"2023-12-19T05:50:37.530704+0000","last_unstale":"2023-12-19T05:50:38.059821+0000","last_undegraded":"2023-12-19T05:50:38.059821+0000","last_fullsized":"2023-12-19T05:50:38.059821+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:17.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051604+0000","last_change":"2023-12-19T05:50:38.049771+0000","last_active":"2023-12-19T05:50:38.051604+0000","last_peered":"2023-12-19T05:50:38.051604+0000","last_clean":"2023-12-19T05:50:38.051604+0000","last_became_active":"2023-12-19T05:50:38.049494+0000","last_became_peered":"2023-12-19T05:50:38.049494+0000","last_unstale":"2023-12-19T05:50:38.051604+0000","last_undegraded":"2023-12-19T05:50:38.051604+0000","last_fullsized":"2023-12-19T05:50:38.051604+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:16.157782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061831+0000","last_change":"2023-12-19T05:50:37.546784+0000","last_active":"2023-12-19T05:50:38.061831+0000","last_peered":"2023-12-19T05:50:38.061831+0000","last_clean":"2023-12-19T05:50:38.061831+0000","last_became_active":"2023-12-19T05:50:37.545960+0000","last_became_peered":"2023-12-19T05:50:37.545960+0000","last_unstale":"2023-12-19T05:50:38.061831+0000","last_undegraded":"2023-12-19T05:50:38.061831+0000","last_fullsized":"2023-12-19T05:50:38.061831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:54.930694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056659+0000","last_change":"2023-12-19T05:50:38.055645+0000","last_active":"2023-12-19T05:50:38.056659+0000","last_peered":"2023-12-19T05:50:38.056659+0000","last_clean":"2023-12-19T05:50:38.056659+0000","last_became_active":"2023-12-19T05:50:38.050261+0000","last_became_peered":"2023-12-19T05:50:38.050261+0000","last_unstale":"2023-12-19T05:50:38.056659+0000","last_undegraded":"2023-12-19T05:50:38.056659+0000","last_fullsized":"2023-12-19T05:50:38.056659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.443722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060069+0000","last_change":"2023-12-19T05:50:37.534775+0000","last_active":"2023-12-19T05:50:38.060069+0000","last_peered":"2023-12-19T05:50:38.060069+0000","last_clean":"2023-12-19T05:50:38.060069+0000","last_became_active":"2023-12-19T05:50:37.534118+0000","last_became_peered":"2023-12-19T05:50:37.534118+0000","last_unstale":"2023-12-19T05:50:38.060069+0000","last_undegraded":"2023-12-19T05:50:38.060069+0000","last_fullsized":"2023-12-19T05:50:38.060069+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:16:10.085683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051666+0000","last_change":"2023-12-19T05:50:38.050536+0000","last_active":"2023-12-19T05:50:38.051666+0000","last_peered":"2023-12-19T05:50:38.051666+0000","last_clean":"2023-12-19T05:50:38.051666+0000","last_became_active":"2023-12-19T05:50:38.050291+0000","last_became_peered":"2023-12-19T05:50:38.050291+0000","last_unstale":"2023-12-19T05:50:38.051666+0000","last_undegraded":"2023-12-19T05:50:38.051666+0000","last_fullsized":"2023-12-19T05:50:38.051666+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:52.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059996+0000","last_change":"2023-12-19T05:50:37.543823+0000","last_active":"2023-12-19T05:50:38.059996+0000","last_peered":"2023-12-19T05:50:38.059996+0000","last_clean":"2023-12-19T05:50:38.059996+0000","last_became_active":"2023-12-19T05:50:37.543594+0000","last_became_peered":"2023-12-19T05:50:37.543594+0000","last_unstale":"2023-12-19T05:50:38.059996+0000","last_undegraded":"2023-12-19T05:50:38.059996+0000","last_fullsized":"2023-12-19T05:50:38.059996+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:35.511976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056862+0000","last_change":"2023-12-19T05:50:38.056785+0000","last_active":"2023-12-19T05:50:38.056862+0000","last_peered":"2023-12-19T05:50:38.056862+0000","last_clean":"2023-12-19T05:50:38.056862+0000","last_became_active":"2023-12-19T05:50:38.053543+0000","last_became_peered":"2023-12-19T05:50:38.053543+0000","last_unstale":"2023-12-19T05:50:38.056862+0000","last_undegraded":"2023-12-19T05:50:38.056862+0000","last_fullsized":"2023-12-19T05:50:38.056862+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:58:05.574159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051210+0000","last_change":"2023-12-19T05:50:37.543521+0000","last_active":"2023-12-19T05:50:38.051210+0000","last_peered":"2023-12-19T05:50:38.051210+0000","last_clean":"2023-12-19T05:50:38.051210+0000","last_became_active":"2023-12-19T05:50:37.543224+0000","last_became_peered":"2023-12-19T05:50:37.543224+0000","last_unstale":"2023-12-19T05:50:38.051210+0000","last_undegraded":"2023-12-19T05:50:38.051210+0000","last_fullsized":"2023-12-19T05:50:38.051210+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:52.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057339+0000","last_change":"2023-12-19T05:50:38.056559+0000","last_active":"2023-12-19T05:50:38.057339+0000","last_peered":"2023-12-19T05:50:38.057339+0000","last_clean":"2023-12-19T05:50:38.057339+0000","last_became_active":"2023-12-19T05:50:38.052490+0000","last_became_peered":"2023-12-19T05:50:38.052490+0000","last_unstale":"2023-12-19T05:50:38.057339+0000","last_undegraded":"2023-12-19T05:50:38.057339+0000","last_fullsized":"2023-12-19T05:50:38.057339+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.026574+0000","last_change":"2023-12-19T05:50:37.541956+0000","last_active":"2023-12-19T05:50:38.026574+0000","last_peered":"2023-12-19T05:50:38.026574+0000","last_clean":"2023-12-19T05:50:38.026574+0000","last_became_active":"2023-12-19T05:50:37.541386+0000","last_became_peered":"2023-12-19T05:50:37.541386+0000","last_unstale":"2023-12-19T05:50:38.026574+0000","last_undegraded":"2023-12-19T05:50:38.026574+0000","last_fullsized":"2023-12-19T05:50:38.026574+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:52:13.375166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057325+0000","last_change":"2023-12-19T05:50:38.056528+0000","last_active":"2023-12-19T05:50:38.057325+0000","last_peered":"2023-12-19T05:50:38.057325+0000","last_clean":"2023-12-19T05:50:38.057325+0000","last_became_active":"2023-12-19T05:50:38.056152+0000","last_became_peered":"2023-12-19T05:50:38.056152+0000","last_unstale":"2023-12-19T05:50:38.057325+0000","last_undegraded":"2023-12-19T05:50:38.057325+0000","last_fullsized":"2023-12-19T05:50:38.057325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:27.822972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.049354+0000","last_change":"2023-12-19T05:50:37.548902+0000","last_active":"2023-12-19T05:50:38.049354+0000","last_peered":"2023-12-19T05:50:38.049354+0000","last_clean":"2023-12-19T05:50:38.049354+0000","last_became_active":"2023-12-19T05:50:37.547592+0000","last_became_peered":"2023-12-19T05:50:37.547592+0000","last_unstale":"2023-12-19T05:50:38.049354+0000","last_undegraded":"2023-12-19T05:50:38.049354+0000","last_fullsized":"2023-12-19T05:50:38.049354+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:21.351114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.039471+0000","last_change":"2023-12-19T05:50:38.039378+0000","last_active":"2023-12-19T05:50:38.039471+0000","last_peered":"2023-12-19T05:50:38.039471+0000","last_clean":"2023-12-19T05:50:38.039471+0000","last_became_active":"2023-12-19T05:50:38.038813+0000","last_became_peered":"2023-12-19T05:50:38.038813+0000","last_unstale":"2023-12-19T05:50:38.039471+0000","last_undegraded":"2023-12-19T05:50:38.039471+0000","last_fullsized":"2023-12-19T05:50:38.039471+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:04.661807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.035829+0000","last_change":"2023-12-19T05:50:37.539636+0000","last_active":"2023-12-19T05:50:38.035829+0000","last_peered":"2023-12-19T05:50:38.035829+0000","last_clean":"2023-12-19T05:50:38.035829+0000","last_became_active":"2023-12-19T05:50:37.539137+0000","last_became_peered":"2023-12-19T05:50:37.539137+0000","last_unstale":"2023-12-19T05:50:38.035829+0000","last_undegraded":"2023-12-19T05:50:38.035829+0000","last_fullsized":"2023-12-19T05:50:38.035829+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:28.150927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051405+0000","last_change":"2023-12-19T05:50:38.051188+0000","last_active":"2023-12-19T05:50:38.051405+0000","last_peered":"2023-12-19T05:50:38.051405+0000","last_clean":"2023-12-19T05:50:38.051405+0000","last_became_active":"2023-12-19T05:50:38.050865+0000","last_became_peered":"2023-12-19T05:50:38.050865+0000","last_unstale":"2023-12-19T05:50:38.051405+0000","last_undegraded":"2023-12-19T05:50:38.051405+0000","last_fullsized":"2023-12-19T05:50:38.051405+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:32:09.564478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":17,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.063815+0000","last_change":"2023-12-19T05:50:37.544368+0000","last_active":"2023-12-19T05:50:38.063815+0000","last_peered":"2023-12-19T05:50:38.063815+0000","last_clean":"2023-12-19T05:50:38.063815+0000","last_became_active":"2023-12-19T05:50:37.544088+0000","last_became_peered":"2023-12-19T05:50:37.544088+0000","last_unstale":"2023-12-19T05:50:38.063815+0000","last_undegraded":"2023-12-19T05:50:38.063815+0000","last_fullsized":"2023-12-19T05:50:38.063815+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:50.995339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040612+0000","last_change":"2023-12-19T05:50:38.040447+0000","last_active":"2023-12-19T05:50:38.040612+0000","last_peered":"2023-12-19T05:50:38.040612+0000","last_clean":"2023-12-19T05:50:38.040612+0000","last_became_active":"2023-12-19T05:50:38.040218+0000","last_became_peered":"2023-12-19T05:50:38.040218+0000","last_unstale":"2023-12-19T05:50:38.040612+0000","last_undegraded":"2023-12-19T05:50:38.040612+0000","last_fullsized":"2023-12-19T05:50:38.040612+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:17:22.982208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060662+0000","last_change":"2023-12-19T05:50:37.531114+0000","last_active":"2023-12-19T05:50:38.060662+0000","last_peered":"2023-12-19T05:50:38.060662+0000","last_clean":"2023-12-19T05:50:38.060662+0000","last_became_active":"2023-12-19T05:50:37.530397+0000","last_became_peered":"2023-12-19T05:50:37.530397+0000","last_unstale":"2023-12-19T05:50:38.060662+0000","last_undegraded":"2023-12-19T05:50:38.060662+0000","last_fullsized":"2023-12-19T05:50:38.060662+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:48.047377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041746+0000","last_change":"2023-12-19T05:50:38.041585+0000","last_active":"2023-12-19T05:50:38.041746+0000","last_peered":"2023-12-19T05:50:38.041746+0000","last_clean":"2023-12-19T05:50:38.041746+0000","last_became_active":"2023-12-19T05:50:38.040831+0000","last_became_peered":"2023-12-19T05:50:38.040831+0000","last_unstale":"2023-12-19T05:50:38.041746+0000","last_undegraded":"2023-12-19T05:50:38.041746+0000","last_fullsized":"2023-12-19T05:50:38.041746+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:56:51.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037332+0000","last_change":"2023-12-19T05:50:37.542995+0000","last_active":"2023-12-19T05:50:38.037332+0000","last_peered":"2023-12-19T05:50:38.037332+0000","last_clean":"2023-12-19T05:50:38.037332+0000","last_became_active":"2023-12-19T05:50:37.542755+0000","last_became_peered":"2023-12-19T05:50:37.542755+0000","last_unstale":"2023-12-19T05:50:38.037332+0000","last_undegraded":"2023-12-19T05:50:38.037332+0000","last_fullsized":"2023-12-19T05:50:38.037332+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:05.104197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.044189+0000","last_change":"2023-12-19T05:50:38.044074+0000","last_active":"2023-12-19T05:50:38.044189+0000","last_peered":"2023-12-19T05:50:38.044189+0000","last_clean":"2023-12-19T05:50:38.044189+0000","last_became_active":"2023-12-19T05:50:38.043875+0000","last_became_peered":"2023-12-19T05:50:38.043875+0000","last_unstale":"2023-12-19T05:50:38.044189+0000","last_undegraded":"2023-12-19T05:50:38.044189+0000","last_fullsized":"2023-12-19T05:50:38.044189+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:58:21.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043303+0000","last_change":"2023-12-19T05:50:37.547184+0000","last_active":"2023-12-19T05:50:38.043303+0000","last_peered":"2023-12-19T05:50:38.043303+0000","last_clean":"2023-12-19T05:50:38.043303+0000","last_became_active":"2023-12-19T05:50:37.546563+0000","last_became_peered":"2023-12-19T05:50:37.546563+0000","last_unstale":"2023-12-19T05:50:38.043303+0000","last_undegraded":"2023-12-19T05:50:38.043303+0000","last_fullsized":"2023-12-19T05:50:38.043303+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:45:54.806824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057295+0000","last_change":"2023-12-19T05:50:38.056399+0000","last_active":"2023-12-19T05:50:38.057295+0000","last_peered":"2023-12-19T05:50:38.057295+0000","last_clean":"2023-12-19T05:50:38.057295+0000","last_became_active":"2023-12-19T05:50:38.055831+0000","last_became_peered":"2023-12-19T05:50:38.055831+0000","last_unstale":"2023-12-19T05:50:38.057295+0000","last_undegraded":"2023-12-19T05:50:38.057295+0000","last_fullsized":"2023-12-19T05:50:38.057295+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:23.151399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.064111+0000","last_change":"2023-12-19T05:50:37.538820+0000","last_active":"2023-12-19T05:50:38.064111+0000","last_peered":"2023-12-19T05:50:38.064111+0000","last_clean":"2023-12-19T05:50:38.064111+0000","last_became_active":"2023-12-19T05:50:37.538354+0000","last_became_peered":"2023-12-19T05:50:37.538354+0000","last_unstale":"2023-12-19T05:50:38.064111+0000","last_undegraded":"2023-12-19T05:50:38.064111+0000","last_fullsized":"2023-12-19T05:50:38.064111+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:30:38.335105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040919+0000","last_change":"2023-12-19T05:50:38.039911+0000","last_active":"2023-12-19T05:50:38.040919+0000","last_peered":"2023-12-19T05:50:38.040919+0000","last_clean":"2023-12-19T05:50:38.040919+0000","last_became_active":"2023-12-19T05:50:38.039688+0000","last_became_peered":"2023-12-19T05:50:38.039688+0000","last_unstale":"2023-12-19T05:50:38.040919+0000","last_undegraded":"2023-12-19T05:50:38.040919+0000","last_fullsized":"2023-12-19T05:50:38.040919+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:56.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.062283+0000","last_change":"2023-12-19T05:50:37.548461+0000","last_active":"2023-12-19T05:50:38.062283+0000","last_peered":"2023-12-19T05:50:38.062283+0000","last_clean":"2023-12-19T05:50:38.062283+0000","last_became_active":"2023-12-19T05:50:37.548194+0000","last_became_peered":"2023-12-19T05:50:37.548194+0000","last_unstale":"2023-12-19T05:50:38.062283+0000","last_undegraded":"2023-12-19T05:50:38.062283+0000","last_fullsized":"2023-12-19T05:50:38.062283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:43.415674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047269+0000","last_change":"2023-12-19T05:50:38.046743+0000","last_active":"2023-12-19T05:50:38.047269+0000","last_peered":"2023-12-19T05:50:38.047269+0000","last_clean":"2023-12-19T05:50:38.047269+0000","last_became_active":"2023-12-19T05:50:38.045290+0000","last_became_peered":"2023-12-19T05:50:38.045290+0000","last_unstale":"2023-12-19T05:50:38.047269+0000","last_undegraded":"2023-12-19T05:50:38.047269+0000","last_fullsized":"2023-12-19T05:50:38.047269+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:12.774141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060467+0000","last_change":"2023-12-19T05:50:37.529737+0000","last_active":"2023-12-19T05:50:38.060467+0000","last_peered":"2023-12-19T05:50:38.060467+0000","last_clean":"2023-12-19T05:50:38.060467+0000","last_became_active":"2023-12-19T05:50:37.529122+0000","last_became_peered":"2023-12-19T05:50:37.529122+0000","last_unstale":"2023-12-19T05:50:38.060467+0000","last_undegraded":"2023-12-19T05:50:38.060467+0000","last_fullsized":"2023-12-19T05:50:38.060467+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:32:08.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040971+0000","last_change":"2023-12-19T05:50:38.040432+0000","last_active":"2023-12-19T05:50:38.040971+0000","last_peered":"2023-12-19T05:50:38.040971+0000","last_clean":"2023-12-19T05:50:38.040971+0000","last_became_active":"2023-12-19T05:50:38.040244+0000","last_became_peered":"2023-12-19T05:50:38.040244+0000","last_unstale":"2023-12-19T05:50:38.040971+0000","last_undegraded":"2023-12-19T05:50:38.040971+0000","last_fullsized":"2023-12-19T05:50:38.040971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:00.383608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060798+0000","last_change":"2023-12-19T05:50:37.538035+0000","last_active":"2023-12-19T05:50:38.060798+0000","last_peered":"2023-12-19T05:50:38.060798+0000","last_clean":"2023-12-19T05:50:38.060798+0000","last_became_active":"2023-12-19T05:50:37.537499+0000","last_became_peered":"2023-12-19T05:50:37.537499+0000","last_unstale":"2023-12-19T05:50:38.060798+0000","last_undegraded":"2023-12-19T05:50:38.060798+0000","last_fullsized":"2023-12-19T05:50:38.060798+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:22.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050990+0000","last_change":"2023-12-19T05:50:38.050415+0000","last_active":"2023-12-19T05:50:38.050990+0000","last_peered":"2023-12-19T05:50:38.050990+0000","last_clean":"2023-12-19T05:50:38.050990+0000","last_became_active":"2023-12-19T05:50:38.050114+0000","last_became_peered":"2023-12-19T05:50:38.050114+0000","last_unstale":"2023-12-19T05:50:38.050990+0000","last_undegraded":"2023-12-19T05:50:38.050990+0000","last_fullsized":"2023-12-19T05:50:38.050990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043465+0000","last_change":"2023-12-19T05:50:37.547325+0000","last_active":"2023-12-19T05:50:38.043465+0000","last_peered":"2023-12-19T05:50:38.043465+0000","last_clean":"2023-12-19T05:50:38.043465+0000","last_became_active":"2023-12-19T05:50:37.546952+0000","last_became_peered":"2023-12-19T05:50:37.546952+0000","last_unstale":"2023-12-19T05:50:38.043465+0000","last_undegraded":"2023-12-19T05:50:38.043465+0000","last_fullsized":"2023-12-19T05:50:38.043465+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:05:51.948661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046158+0000","last_change":"2023-12-19T05:50:38.046059+0000","last_active":"2023-12-19T05:50:38.046158+0000","last_peered":"2023-12-19T05:50:38.046158+0000","last_clean":"2023-12-19T05:50:38.046158+0000","last_became_active":"2023-12-19T05:50:38.045537+0000","last_became_peered":"2023-12-19T05:50:38.045537+0000","last_unstale":"2023-12-19T05:50:38.046158+0000","last_undegraded":"2023-12-19T05:50:38.046158+0000","last_fullsized":"2023-12-19T05:50:38.046158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061887+0000","last_change":"2023-12-19T05:50:37.545094+0000","last_active":"2023-12-19T05:50:38.061887+0000","last_peered":"2023-12-19T05:50:38.061887+0000","last_clean":"2023-12-19T05:50:38.061887+0000","last_became_active":"2023-12-19T05:50:37.544811+0000","last_became_peered":"2023-12-19T05:50:37.544811+0000","last_unstale":"2023-12-19T05:50:38.061887+0000","last_undegraded":"2023-12-19T05:50:38.061887+0000","last_fullsized":"2023-12-19T05:50:38.061887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:58:20.550739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058843+0000","last_change":"2023-12-19T05:50:38.058738+0000","last_active":"2023-12-19T05:50:38.058843+0000","last_peered":"2023-12-19T05:50:38.058843+0000","last_clean":"2023-12-19T05:50:38.058843+0000","last_became_active":"2023-12-19T05:50:38.053414+0000","last_became_peered":"2023-12-19T05:50:38.053414+0000","last_unstale":"2023-12-19T05:50:38.058843+0000","last_undegraded":"2023-12-19T05:50:38.058843+0000","last_fullsized":"2023-12-19T05:50:38.058843+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:22:23.373655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045185+0000","last_change":"2023-12-19T05:50:37.544309+0000","last_active":"2023-12-19T05:50:38.045185+0000","last_peered":"2023-12-19T05:50:38.045185+0000","last_clean":"2023-12-19T05:50:38.045185+0000","last_became_active":"2023-12-19T05:50:37.544069+0000","last_became_peered":"2023-12-19T05:50:37.544069+0000","last_unstale":"2023-12-19T05:50:38.045185+0000","last_undegraded":"2023-12-19T05:50:38.045185+0000","last_fullsized":"2023-12-19T05:50:38.045185+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:06.302968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051879+0000","last_change":"2023-12-19T05:50:38.051255+0000","last_active":"2023-12-19T05:50:38.051879+0000","last_peered":"2023-12-19T05:50:38.051879+0000","last_clean":"2023-12-19T05:50:38.051879+0000","last_became_active":"2023-12-19T05:50:38.050868+0000","last_became_peered":"2023-12-19T05:50:38.050868+0000","last_unstale":"2023-12-19T05:50:38.051879+0000","last_undegraded":"2023-12-19T05:50:38.051879+0000","last_fullsized":"2023-12-19T05:50:38.051879+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:52.872226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038141+0000","last_change":"2023-12-19T05:50:37.548053+0000","last_active":"2023-12-19T05:50:38.038141+0000","last_peered":"2023-12-19T05:50:38.038141+0000","last_clean":"2023-12-19T05:50:38.038141+0000","last_became_active":"2023-12-19T05:50:37.547766+0000","last_became_peered":"2023-12-19T05:50:37.547766+0000","last_unstale":"2023-12-19T05:50:38.038141+0000","last_undegraded":"2023-12-19T05:50:38.038141+0000","last_fullsized":"2023-12-19T05:50:38.038141+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:55:59.377839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055427+0000","last_change":"2023-12-19T05:50:38.055182+0000","last_active":"2023-12-19T05:50:38.055427+0000","last_peered":"2023-12-19T05:50:38.055427+0000","last_clean":"2023-12-19T05:50:38.055427+0000","last_became_active":"2023-12-19T05:50:38.050659+0000","last_became_peered":"2023-12-19T05:50:38.050659+0000","last_unstale":"2023-12-19T05:50:38.055427+0000","last_undegraded":"2023-12-19T05:50:38.055427+0000","last_fullsized":"2023-12-19T05:50:38.055427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:00:25.020643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037353+0000","last_change":"2023-12-19T05:50:37.546588+0000","last_active":"2023-12-19T05:50:38.037353+0000","last_peered":"2023-12-19T05:50:38.037353+0000","last_clean":"2023-12-19T05:50:38.037353+0000","last_became_active":"2023-12-19T05:50:37.546321+0000","last_became_peered":"2023-12-19T05:50:37.546321+0000","last_unstale":"2023-12-19T05:50:38.037353+0000","last_undegraded":"2023-12-19T05:50:38.037353+0000","last_fullsized":"2023-12-19T05:50:38.037353+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:55.954755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055710+0000","last_change":"2023-12-19T05:50:38.055641+0000","last_active":"2023-12-19T05:50:38.055710+0000","last_peered":"2023-12-19T05:50:38.055710+0000","last_clean":"2023-12-19T05:50:38.055710+0000","last_became_active":"2023-12-19T05:50:38.052204+0000","last_became_peered":"2023-12-19T05:50:38.052204+0000","last_unstale":"2023-12-19T05:50:38.055710+0000","last_undegraded":"2023-12-19T05:50:38.055710+0000","last_fullsized":"2023-12-19T05:50:38.055710+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:40.661607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058887+0000","last_change":"2023-12-19T05:50:37.543024+0000","last_active":"2023-12-19T05:50:38.058887+0000","last_peered":"2023-12-19T05:50:38.058887+0000","last_clean":"2023-12-19T05:50:38.058887+0000","last_became_active":"2023-12-19T05:50:37.542416+0000","last_became_peered":"2023-12-19T05:50:37.542416+0000","last_unstale":"2023-12-19T05:50:38.058887+0000","last_undegraded":"2023-12-19T05:50:38.058887+0000","last_fullsized":"2023-12-19T05:50:38.058887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:14.984306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051651+0000","last_change":"2023-12-19T05:50:38.049797+0000","last_active":"2023-12-19T05:50:38.051651+0000","last_peered":"2023-12-19T05:50:38.051651+0000","last_clean":"2023-12-19T05:50:38.051651+0000","last_became_active":"2023-12-19T05:50:38.045008+0000","last_became_peered":"2023-12-19T05:50:38.045008+0000","last_unstale":"2023-12-19T05:50:38.051651+0000","last_undegraded":"2023-12-19T05:50:38.051651+0000","last_fullsized":"2023-12-19T05:50:38.051651+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:53.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"176'1","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-12-19T05:50:40.352000+0000","last_change":"2023-12-19T05:50:37.547044+0000","last_active":"2023-12-19T05:50:40.352000+0000","last_peered":"2023-12-19T05:50:40.352000+0000","last_clean":"2023-12-19T05:50:40.352000+0000","last_became_active":"2023-12-19T05:50:37.546755+0000","last_became_peered":"2023-12-19T05:50:37.546755+0000","last_unstale":"2023-12-19T05:50:40.352000+0000","last_undegraded":"2023-12-19T05:50:40.352000+0000","last_fullsized":"2023-12-19T05:50:40.352000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:05.779413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055668+0000","last_change":"2023-12-19T05:50:38.055267+0000","last_active":"2023-12-19T05:50:38.055668+0000","last_peered":"2023-12-19T05:50:38.055668+0000","last_clean":"2023-12-19T05:50:38.055668+0000","last_became_active":"2023-12-19T05:50:38.054942+0000","last_became_peered":"2023-12-19T05:50:38.054942+0000","last_unstale":"2023-12-19T05:50:38.055668+0000","last_undegraded":"2023-12-19T05:50:38.055668+0000","last_fullsized":"2023-12-19T05:50:38.055668+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:08:01.104339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.030035+0000","last_change":"2023-12-19T05:50:37.546958+0000","last_active":"2023-12-19T05:50:38.030035+0000","last_peered":"2023-12-19T05:50:38.030035+0000","last_clean":"2023-12-19T05:50:38.030035+0000","last_became_active":"2023-12-19T05:50:37.546564+0000","last_became_peered":"2023-12-19T05:50:37.546564+0000","last_unstale":"2023-12-19T05:50:38.030035+0000","last_undegraded":"2023-12-19T05:50:38.030035+0000","last_fullsized":"2023-12-19T05:50:38.030035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:13:59.986600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.062069+0000","last_change":"2023-12-19T05:50:38.060332+0000","last_active":"2023-12-19T05:50:38.062069+0000","last_peered":"2023-12-19T05:50:38.062069+0000","last_clean":"2023-12-19T05:50:38.062069+0000","last_became_active":"2023-12-19T05:50:38.057819+0000","last_became_peered":"2023-12-19T05:50:38.057819+0000","last_unstale":"2023-12-19T05:50:38.062069+0000","last_undegraded":"2023-12-19T05:50:38.062069+0000","last_fullsized":"2023-12-19T05:50:38.062069+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:59:34.028353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.031035+0000","last_change":"2023-12-19T05:50:37.547184+0000","last_active":"2023-12-19T05:50:38.031035+0000","last_peered":"2023-12-19T05:50:38.031035+0000","last_clean":"2023-12-19T05:50:38.031035+0000","last_became_active":"2023-12-19T05:50:37.546189+0000","last_became_peered":"2023-12-19T05:50:37.546189+0000","last_unstale":"2023-12-19T05:50:38.031035+0000","last_undegraded":"2023-12-19T05:50:38.031035+0000","last_fullsized":"2023-12-19T05:50:38.031035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:26.817203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046866+0000","last_change":"2023-12-19T05:50:38.046759+0000","last_active":"2023-12-19T05:50:38.046866+0000","last_peered":"2023-12-19T05:50:38.046866+0000","last_clean":"2023-12-19T05:50:38.046866+0000","last_became_active":"2023-12-19T05:50:38.044877+0000","last_became_peered":"2023-12-19T05:50:38.044877+0000","last_unstale":"2023-12-19T05:50:38.046866+0000","last_undegraded":"2023-12-19T05:50:38.046866+0000","last_fullsized":"2023-12-19T05:50:38.046866+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:09:23.514472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038287+0000","last_change":"2023-12-19T05:50:37.544202+0000","last_active":"2023-12-19T05:50:38.038287+0000","last_peered":"2023-12-19T05:50:38.038287+0000","last_clean":"2023-12-19T05:50:38.038287+0000","last_became_active":"2023-12-19T05:50:37.543953+0000","last_became_peered":"2023-12-19T05:50:37.543953+0000","last_unstale":"2023-12-19T05:50:38.038287+0000","last_undegraded":"2023-12-19T05:50:38.038287+0000","last_fullsized":"2023-12-19T05:50:38.038287+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:28.150927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.052187+0000","last_change":"2023-12-19T05:50:38.051444+0000","last_active":"2023-12-19T05:50:38.052187+0000","last_peered":"2023-12-19T05:50:38.052187+0000","last_clean":"2023-12-19T05:50:38.052187+0000","last_became_active":"2023-12-19T05:50:38.050982+0000","last_became_peered":"2023-12-19T05:50:38.050982+0000","last_unstale":"2023-12-19T05:50:38.052187+0000","last_undegraded":"2023-12-19T05:50:38.052187+0000","last_fullsized":"2023-12-19T05:50:38.052187+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:04.661807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.027887+0000","last_change":"2023-12-19T05:50:37.535431+0000","last_active":"2023-12-19T05:50:38.027887+0000","last_peered":"2023-12-19T05:50:38.027887+0000","last_clean":"2023-12-19T05:50:38.027887+0000","last_became_active":"2023-12-19T05:50:37.535085+0000","last_became_peered":"2023-12-19T05:50:37.535085+0000","last_unstale":"2023-12-19T05:50:38.027887+0000","last_undegraded":"2023-12-19T05:50:38.027887+0000","last_fullsized":"2023-12-19T05:50:38.027887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:05.835741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057310+0000","last_change":"2023-12-19T05:50:38.056410+0000","last_active":"2023-12-19T05:50:38.057310+0000","last_peered":"2023-12-19T05:50:38.057310+0000","last_clean":"2023-12-19T05:50:38.057310+0000","last_became_active":"2023-12-19T05:50:38.052159+0000","last_became_peered":"2023-12-19T05:50:38.052159+0000","last_unstale":"2023-12-19T05:50:38.057310+0000","last_undegraded":"2023-12-19T05:50:38.057310+0000","last_fullsized":"2023-12-19T05:50:38.057310+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038856+0000","last_change":"2023-12-19T05:50:37.544989+0000","last_active":"2023-12-19T05:50:38.038856+0000","last_peered":"2023-12-19T05:50:38.038856+0000","last_clean":"2023-12-19T05:50:38.038856+0000","last_became_active":"2023-12-19T05:50:37.544752+0000","last_became_peered":"2023-12-19T05:50:37.544752+0000","last_unstale":"2023-12-19T05:50:38.038856+0000","last_undegraded":"2023-12-19T05:50:38.038856+0000","last_fullsized":"2023-12-19T05:50:38.038856+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:21.351114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038187+0000","last_change":"2023-12-19T05:50:38.036943+0000","last_active":"2023-12-19T05:50:38.038187+0000","last_peered":"2023-12-19T05:50:38.038187+0000","last_clean":"2023-12-19T05:50:38.038187+0000","last_became_active":"2023-12-19T05:50:38.036706+0000","last_became_peered":"2023-12-19T05:50:38.036706+0000","last_unstale":"2023-12-19T05:50:38.038187+0000","last_undegraded":"2023-12-19T05:50:38.038187+0000","last_fullsized":"2023-12-19T05:50:38.038187+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:41:35.485359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051348+0000","last_change":"2023-12-19T05:50:37.541914+0000","last_active":"2023-12-19T05:50:38.051348+0000","last_peered":"2023-12-19T05:50:38.051348+0000","last_clean":"2023-12-19T05:50:38.051348+0000","last_became_active":"2023-12-19T05:50:37.541527+0000","last_became_peered":"2023-12-19T05:50:37.541527+0000","last_unstale":"2023-12-19T05:50:38.051348+0000","last_undegraded":"2023-12-19T05:50:38.051348+0000","last_fullsized":"2023-12-19T05:50:38.051348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:39.655838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037346+0000","last_change":"2023-12-19T05:50:38.037066+0000","last_active":"2023-12-19T05:50:38.037346+0000","last_peered":"2023-12-19T05:50:38.037346+0000","last_clean":"2023-12-19T05:50:38.037346+0000","last_became_active":"2023-12-19T05:50:38.036392+0000","last_became_peered":"2023-12-19T05:50:38.036392+0000","last_unstale":"2023-12-19T05:50:38.037346+0000","last_undegraded":"2023-12-19T05:50:38.037346+0000","last_fullsized":"2023-12-19T05:50:38.037346+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"175'3","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055695+0000","last_change":"2023-12-19T05:50:37.546430+0000","last_active":"2023-12-19T05:50:38.055695+0000","last_peered":"2023-12-19T05:50:38.055695+0000","last_clean":"2023-12-19T05:50:38.055695+0000","last_became_active":"2023-12-19T05:50:37.546100+0000","last_became_peered":"2023-12-19T05:50:37.546100+0000","last_unstale":"2023-12-19T05:50:38.055695+0000","last_undegraded":"2023-12-19T05:50:38.055695+0000","last_fullsized":"2023-12-19T05:50:38.055695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:52.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":308,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.034869+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:50:38.034869+0000","last_peered":"2023-12-19T05:50:38.034869+0000","last_clean":"2023-12-19T05:50:38.034869+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:50:38.034869+0000","last_undegraded":"2023-12-19T05:50:38.034869+0000","last_fullsized":"2023-12-19T05:50:38.034869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.125,"15min":1.085},"min":{"1min":0.80600000000000005,"5min":0.64400000000000002,"15min":0.56699999999999995},"max":{"1min":1.585,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":1.204},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0820000000000001,"15min":1.087},"min":{"1min":0.79300000000000004,"5min":0.73099999999999998,"15min":0.63300000000000001},"max":{"1min":1.611,"5min":1.768,"15min":3.976},"last":1.0269999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2,"15min":1.135},"min":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.60999999999999999},"max":{"1min":1.601,"5min":6.399,"15min":6.399},"last":1.373},{"interface":"front","average":{"1min":1.171,"5min":1.2010000000000001,"15min":1.1759999999999999},"min":{"1min":0.91400000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3700000000000001,"5min":3.1720000000000002,"15min":4.25},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.206,"15min":1.2210000000000001},"min":{"1min":0.90100000000000002,"5min":0.65500000000000003,"15min":0.63800000000000001},"max":{"1min":1.468,"5min":1.738,"15min":3.0249999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1279999999999999,"15min":1.113},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.64500000000000002},"max":{"1min":1.468,"5min":1.895,"15min":2.8250000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3520000000000001,"15min":1.248},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.622},"max":{"1min":1.575,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.145},{"interface":"front","average":{"1min":1.375,"5min":1.389,"15min":1.357},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.83299999999999996},"max":{"1min":1.7589999999999999,"5min":2.327,"15min":4.1529999999999996},"last":1.4039999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1910000000000001,"15min":1.1180000000000001},"min":{"1min":0.80400000000000005,"5min":0.64000000000000001,"15min":0.50800000000000001},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":2.9980000000000002},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.345,"15min":1.2889999999999999},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.48599999999999999},"max":{"1min":1.5529999999999999,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.425}]},{"osd":5,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3600000000000001,"15min":1.3380000000000001},"min":{"1min":0.91100000000000003,"5min":0.75900000000000001,"15min":0.51400000000000001},"max":{"1min":1.7,"5min":2.1480000000000001,"15min":6.3099999999999996},"last":1.329},{"interface":"front","average":{"1min":1.282,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":0.93000000000000005,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.6240000000000001,"5min":2.0550000000000002,"15min":3.1909999999999998},"last":1.089}]},{"osd":6,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.484,"15min":1.4119999999999999},"min":{"1min":1.194,"5min":0.77500000000000002,"15min":0.68600000000000005},"max":{"1min":1.776,"5min":2.121,"15min":3.0920000000000001},"last":1.254},{"interface":"front","average":{"1min":1.458,"5min":1.532,"15min":1.4610000000000001},"min":{"1min":0.996,"5min":0.93999999999999995,"15min":0.59999999999999998},"max":{"1min":1.6859999999999999,"5min":6.3369999999999997,"15min":7.7519999999999998},"last":1.292}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.05,"15min":1.1299999999999999},"min":{"1min":0.86099999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":4.7000000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0529999999999999},"min":{"1min":0.72599999999999998,"5min":0.621,"15min":0.46500000000000002},"max":{"1min":1.401,"5min":1.548,"15min":1.635},"last":1.0329999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.181},"min":{"1min":0.92600000000000005,"5min":0.66900000000000004,"15min":0.64900000000000002},"max":{"1min":1.4630000000000001,"5min":1.704,"15min":1.792},"last":1.323},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2729999999999999,"15min":1.28},"min":{"1min":1.151,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.498,"5min":1.9279999999999999,"15min":3.4670000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.159,"15min":1.171},"min":{"1min":0.92000000000000004,"5min":0.72899999999999998,"15min":0.71599999999999997},"max":{"1min":1.46,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2290000000000001,"15min":1.2569999999999999},"min":{"1min":0.873,"5min":0.74399999999999999,"15min":0.67700000000000005},"max":{"1min":1.5740000000000001,"5min":1.879,"15min":3.5859999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1599999999999999,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.329,"5min":1.8220000000000001,"15min":4.5220000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2509999999999999,"15min":1.3100000000000001},"min":{"1min":0.95799999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5580000000000001,"5min":1.885,"15min":4.452},"last":1.1160000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.266},"min":{"1min":0.82299999999999995,"5min":0.54900000000000004,"15min":0.48899999999999999},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":2.7130000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2250000000000001,"15min":1.3220000000000001},"min":{"1min":0.83399999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4730000000000001,"5min":1.7729999999999999,"15min":4.6689999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3160000000000001,"15min":1.4430000000000001},"min":{"1min":0.86299999999999999,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":1.504,"5min":2.2759999999999998,"15min":4.5670000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.46,"15min":1.5800000000000001},"min":{"1min":0.93400000000000005,"5min":0.65200000000000002,"15min":0.63400000000000001},"max":{"1min":1.732,"5min":2.2069999999999999,"15min":3.681},"last":1.29}]},{"osd":7,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4119999999999999,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9359999999999999,"5min":1.96,"15min":3.2719999999999998},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5269999999999999,"15min":1.569},"min":{"1min":1.1539999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8460000000000001,"5min":2.8570000000000002,"15min":4.7480000000000002},"last":1.4390000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.081,"15min":1.115},"min":{"1min":0.77100000000000002,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.8759999999999999,"5min":2.9620000000000002,"15min":6.9420000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1180000000000001,"15min":1.115},"min":{"1min":0.81799999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.464,"5min":2.1219999999999999,"15min":2.641},"last":1.3999999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.21,"15min":1.226},"min":{"1min":0.82599999999999996,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.635,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.288},{"interface":"front","average":{"1min":1.329,"5min":1.26,"15min":1.3320000000000001},"min":{"1min":1.111,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.8320000000000001,"5min":2.2890000000000001,"15min":6.8700000000000001},"last":1.4430000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.161,"15min":1.2010000000000001},"min":{"1min":0.86599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4990000000000001,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.319,"5min":1.2150000000000001,"15min":1.2110000000000001},"min":{"1min":1.123,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6080000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.0800000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2350000000000001,"15min":1.359},"min":{"1min":0.93600000000000005,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":2.774,"15min":6.9969999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2929999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.56299999999999994},"max":{"1min":1.6120000000000001,"5min":2.992,"15min":2.992},"last":1.145}]},{"osd":4,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2629999999999999,"15min":1.359},"min":{"1min":1.0620000000000001,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5549999999999999,"5min":3.2040000000000002,"15min":6.3559999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3080000000000001,"15min":1.4490000000000001},"min":{"1min":0.89400000000000002,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.782,"5min":3.0499999999999998,"15min":7.0469999999999997},"last":1.2390000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3280000000000001,"15min":1.4199999999999999},"min":{"1min":0.91200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.671,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.036},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.5169999999999999},"min":{"1min":1.03,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.7410000000000001,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.1779999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.48,"15min":1.599},"min":{"1min":1.042,"5min":0.70299999999999996,"15min":0.68200000000000005},"max":{"1min":1.9179999999999999,"5min":3.2639999999999998,"15min":7.0949999999999998},"last":1.516},{"interface":"front","average":{"1min":1.476,"5min":1.5209999999999999,"15min":1.5720000000000001},"min":{"1min":1.155,"5min":0.80100000000000005,"15min":0.53200000000000003},"max":{"1min":1.7210000000000001,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.3149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":969,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194343,"statfs":{"total":200000000,"available":199007690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.095,"15min":1.0469999999999999},"min":{"1min":0.83799999999999997,"5min":0.58599999999999997,"15min":0.40400000000000003},"max":{"1min":1.508,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.573},{"interface":"front","average":{"1min":1.149,"5min":1.163,"15min":1.1020000000000001},"min":{"1min":0.79500000000000004,"5min":0.66700000000000004,"15min":0.61899999999999999},"max":{"1min":1.5089999999999999,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.998}]},{"osd":1,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1279999999999999,"15min":1.089},"min":{"1min":0.82099999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.484,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.228},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.268,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":1.508,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.4470000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2270000000000001,"15min":1.206},"min":{"1min":0.98899999999999999,"5min":0.748,"15min":0.66100000000000003},"max":{"1min":1.5740000000000001,"5min":1.7609999999999999,"15min":1.8380000000000001},"last":1.407},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.323,"15min":1.258},"min":{"1min":0.996,"5min":0.77300000000000002,"15min":0.45600000000000002},"max":{"1min":1.76,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.048}]},{"osd":3,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.256,"15min":1.1579999999999999},"min":{"1min":1.026,"5min":0.66200000000000003,"15min":0.57599999999999996},"max":{"1min":1.631,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.323,"15min":1.3049999999999999},"min":{"1min":1.1539999999999999,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.7170000000000001,"5min":1.8400000000000001,"15min":1.8819999999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.383,"15min":1.3580000000000001},"min":{"1min":1.052,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6899999999999999,"5min":2.081,"15min":2.081},"last":1.712},{"interface":"front","average":{"1min":1.502,"5min":1.425,"15min":1.353},"min":{"1min":1.1779999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":0.88}]},{"osd":6,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.97899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6639999999999999,"5min":2.161,"15min":2.161},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4630000000000001,"15min":1.4259999999999999},"min":{"1min":1.1339999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8100000000000001,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.655}]},{"osd":7,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4670000000000001,"15min":1.409},"min":{"1min":1.238,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.891,"5min":5.484,"15min":5.484},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.4990000000000001,"15min":1.482},"min":{"1min":0.96099999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.98,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.617}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009242,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.93100000000000005,"15min":0.86599999999999999},"min":{"1min":0.754,"5min":0.39000000000000001,"15min":0.314},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.99},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.96799999999999997,"15min":0.88300000000000001},"min":{"1min":0.72399999999999998,"5min":0.502,"15min":0.34999999999999998},"max":{"1min":1.4299999999999999,"5min":1.5589999999999999,"15min":1.72},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.96799999999999997,"15min":0.92400000000000004},"min":{"1min":0.77700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":2.702},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.145,"5min":1.1160000000000001,"15min":1.0229999999999999},"min":{"1min":0.91700000000000004,"5min":0.47699999999999998,"15min":0.39100000000000001},"max":{"1min":1.605,"5min":1.651,"15min":2.3650000000000002},"last":1.2070000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.1679999999999999,"15min":1.036},"min":{"1min":0.90600000000000003,"5min":0.47299999999999998,"15min":0.45200000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.2789999999999999,"15min":1.1699999999999999},"min":{"1min":1.226,"5min":0.58599999999999997,"15min":0.45600000000000002},"max":{"1min":1.544,"5min":1.8700000000000001,"15min":2.931},"last":1.3759999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2170000000000001,"15min":1.179},"min":{"1min":0.998,"5min":0.58199999999999996,"15min":0.51400000000000001},"max":{"1min":1.8999999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.556},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3260000000000001,"15min":1.306},"min":{"1min":1.129,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7270000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.389,"15min":1.3560000000000001},"min":{"1min":1.177,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.861,"5min":2.391,"15min":4.8440000000000003},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.423,"15min":1.3839999999999999},"min":{"1min":1.1839999999999999,"5min":0.85399999999999998,"15min":0.46500000000000002},"max":{"1min":1.962,"5min":2.5449999999999999,"15min":4.4509999999999996},"last":1.6160000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.4610000000000001,"15min":1.407},"min":{"1min":1.2370000000000001,"5min":0.73599999999999999,"15min":0.71499999999999997},"max":{"1min":1.792,"5min":2.427,"15min":3.4300000000000002},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.365,"15min":1.3400000000000001},"min":{"1min":1.1160000000000001,"5min":0.74199999999999999,"15min":0.69199999999999995},"max":{"1min":1.7350000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.6879999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.4430000000000001,"15min":1.409},"min":{"1min":1.222,"5min":0.79300000000000004,"15min":0.55800000000000005},"max":{"1min":2.0339999999999998,"5min":2.093,"15min":2.1509999999999998},"last":1.843},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.502,"15min":1.4470000000000001},"min":{"1min":1.3100000000000001,"5min":0.81899999999999995,"15min":0.70099999999999996},"max":{"1min":1.8999999999999999,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.661}]}]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89200000000000002,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":1.673,"5min":3.407,"15min":3.407},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.95499999999999996,"15min":0.93799999999999994},"min":{"1min":0.69399999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6699999999999999,"5min":1.8660000000000001,"15min":1.9450000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.157,"15min":1.091},"min":{"1min":0.77500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.7150000000000001,"5min":3.476,"15min":3.476},"last":1.49},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.98199999999999998,"5min":0.60699999999999998,"15min":0.60399999999999998},"max":{"1min":1.768,"5min":1.927,"15min":1.927},"last":1.679}]},{"osd":3,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.008,"15min":0.96399999999999997},"min":{"1min":0.85899999999999999,"5min":0.52000000000000002,"15min":0.34599999999999997},"max":{"1min":1.635,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.258,"15min":1.159},"min":{"1min":0.97099999999999997,"5min":0.626,"15min":0.48199999999999998},"max":{"1min":1.71,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.3160000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.413,"15min":1.329},"min":{"1min":1.159,"5min":0.82399999999999995,"15min":0.52700000000000002},"max":{"1min":1.6060000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.28},"min":{"1min":1.056,"5min":0.88100000000000001,"15min":0.65100000000000002},"max":{"1min":1.8420000000000001,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.389}]},{"osd":5,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.369,"15min":1.3320000000000001},"min":{"1min":1.1719999999999999,"5min":0.80700000000000005,"15min":0.70299999999999996},"max":{"1min":1.746,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.548},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3700000000000001,"15min":1.323},"min":{"1min":1.1779999999999999,"5min":0.81100000000000005,"15min":0.72699999999999998},"max":{"1min":1.804,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.2729999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.3500000000000001,"15min":1.321},"min":{"1min":1.141,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.8999999999999999,"15min":2.0950000000000002},"last":1.089},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.54,"15min":1.417},"min":{"1min":1.103,"5min":1.008,"15min":0.58599999999999997},"max":{"1min":2.0760000000000001,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.7450000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5109999999999999,"15min":1.4610000000000001},"min":{"1min":1.3089999999999999,"5min":0.86099999999999999,"15min":0.84799999999999998},"max":{"1min":1.9059999999999999,"5min":2.3159999999999998,"15min":2.4350000000000001},"last":1.784},{"interface":"front","average":{"1min":1.591,"5min":1.5649999999999999,"15min":1.4690000000000001},"min":{"1min":1.3360000000000001,"5min":0.81299999999999994,"15min":0.71499999999999997},"max":{"1min":1.887,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.1970000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193768,"statfs":{"total":200000000,"available":198419420,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88300000000000001,"15min":0.91100000000000003},"min":{"1min":0.68200000000000005,"5min":0.33700000000000002,"15min":0.33100000000000002},"max":{"1min":1.383,"5min":1.4650000000000001,"15min":2.992},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":1.012},"min":{"1min":0.68799999999999994,"5min":0.496,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":3.5169999999999999},"last":1.026}]},{"osd":2,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.61099999999999999,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":1.575,"5min":1.5920000000000001,"15min":2.2789999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.157,"5min":1.1080000000000001,"15min":1.3500000000000001},"min":{"1min":0.82299999999999995,"5min":0.52300000000000002,"15min":0.40999999999999998},"max":{"1min":1.6299999999999999,"5min":1.879,"15min":70.206000000000003},"last":1.246}]},{"osd":3,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.329,"15min":1.335},"min":{"1min":1.2649999999999999,"5min":0.53200000000000003,"15min":0.46100000000000002},"max":{"1min":1.726,"5min":2.1429999999999998,"15min":3.5670000000000002},"last":1.361},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2030000000000001,"15min":1.234},"min":{"1min":0.90900000000000003,"5min":0.56499999999999995,"15min":0.39400000000000002},"max":{"1min":1.748,"5min":1.827,"15min":3.1920000000000002},"last":1.49}]},{"osd":4,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.254,"15min":1.256},"min":{"1min":1.0529999999999999,"5min":0.78600000000000003,"15min":0.74399999999999999},"max":{"1min":1.6140000000000001,"5min":1.893,"15min":5.3860000000000001},"last":1.893},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3680000000000001,"15min":1.3899999999999999},"min":{"1min":0.99199999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7310000000000001,"5min":2.117,"15min":4.306},"last":1.8029999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.331,"15min":1.3640000000000001},"min":{"1min":1.083,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.917,"5min":1.968,"15min":4.9880000000000004},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3520000000000001,"15min":1.377},"min":{"1min":1.0449999999999999,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.696,"5min":2.2069999999999999,"15min":5.4569999999999999},"last":1.5680000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4330000000000001,"15min":1.4530000000000001},"min":{"1min":0.95999999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9039999999999999,"5min":2.0179999999999998,"15min":5.1429999999999998},"last":1.968},{"interface":"front","average":{"1min":1.528,"5min":1.468,"15min":1.454},"min":{"1min":1.2829999999999999,"5min":0.80000000000000004,"15min":0.70199999999999996},"max":{"1min":1.796,"5min":2.3170000000000002,"15min":3.75},"last":1.7789999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.5489999999999999,"15min":1.5589999999999999},"min":{"1min":1.248,"5min":0.83399999999999996,"15min":0.76600000000000001},"max":{"1min":1.8939999999999999,"5min":2.6829999999999998,"15min":8.4039999999999999},"last":1.698},{"interface":"front","average":{"1min":1.657,"5min":1.546,"15min":1.603},"min":{"1min":1.268,"5min":0.82199999999999995,"15min":0.77000000000000002},"max":{"1min":1.9850000000000001,"5min":2.1019999999999999,"15min":8.2390000000000008},"last":1.8560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009768,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1930000000000001,"5min":1.5209999999999999,"15min":1.6499999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.97099999999999997,"15min":0.92900000000000005},"min":{"1min":0.76200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.681,"5min":1.806,"15min":2.0459999999999998},"last":1.1739999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.115,"15min":1.081},"min":{"1min":0.80500000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5640000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.236},{"interface":"front","average":{"1min":1.335,"5min":1.2,"15min":1.1679999999999999},"min":{"1min":1.089,"5min":0.51900000000000002,"15min":0.42699999999999999},"max":{"1min":1.7070000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.466}]},{"osd":3,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.95099999999999996,"15min":0.91200000000000003},"min":{"1min":0.64900000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4179999999999999,"5min":1.55,"15min":1.55},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.1659999999999999,"15min":1.107},"min":{"1min":0.98299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6919999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.556}]},{"osd":4,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.244,"15min":1.196},"min":{"1min":0.96199999999999997,"5min":0.75700000000000001,"15min":0.59499999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.845},"last":1.5},{"interface":"front","average":{"1min":1.508,"5min":1.377,"15min":1.3109999999999999},"min":{"1min":1.194,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.7849999999999999,"5min":2.149,"15min":2.149},"last":1.6739999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.3839999999999999,"15min":1.347},"min":{"1min":1.046,"5min":0.65700000000000003,"15min":0.63300000000000001},"max":{"1min":1.8720000000000001,"5min":1.885,"15min":2.173},"last":1.351},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3759999999999999,"15min":1.3260000000000001},"min":{"1min":1.2110000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.649,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.5920000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.4530000000000001,"15min":1.4139999999999999},"min":{"1min":1.3009999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.891,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.748},{"interface":"front","average":{"1min":1.419,"5min":1.379,"15min":1.3280000000000001},"min":{"1min":1.1120000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":2.016,"15min":2.2909999999999999},"last":1.77}]},{"osd":7,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.514,"15min":1.4590000000000001},"min":{"1min":1.28,"5min":0.89100000000000001,"15min":0.71899999999999997},"max":{"1min":1.8080000000000001,"5min":2.056,"15min":2.4060000000000001},"last":1.883},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4079999999999999,"15min":1.3939999999999999},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8899999999999999,"5min":2.177,"15min":2.2410000000000001},"last":1.7250000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:50:43.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:50:43.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.748+0000 7fc579e72640 1 Processor -- start 2023-12-19T05:50:43.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.748+0000 7fc579e72640 1 -- start start 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc574146e30 0x7fc5740b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5740b7ea0 0x7fc5740d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5740d0a90 0x7fc57406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc574147210 con 0x7fc5740b7ea0 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740b8330 con 0x7fc574146e30 2023-12-19T05:50:43.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc579e72640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740d2370 con 0x7fc5740d0a90 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.750+0000 7fc573fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5740b7ea0 0x7fc5740d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5740b7ea0 0x7fc5740d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51426/0 (socket says 172.21.15.49:51426) 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 -- 172.21.15.49:0/3137276505 learned_addr learned my addr 172.21.15.49:0/3137276505 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc579671640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5740d0a90 0x7fc57406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc578e70640 1 --2- 172.21.15.49:0/3137276505 >> v2:172.21.15.115:3300/0 conn(0x7fc574146e30 0x7fc5740b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 -- 172.21.15.49:0/3137276505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5740d0a90 msgr2=0x7fc57406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5740d0a90 0x7fc57406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 -- 172.21.15.49:0/3137276505 >> v2:172.21.15.115:3300/0 conn(0x7fc574146e30 msgr2=0x7fc5740b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:43.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 --2- 172.21.15.49:0/3137276505 >> v2:172.21.15.115:3300/0 conn(0x7fc574146e30 0x7fc5740b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.751+0000 7fc573fff640 1 -- 172.21.15.49:0/3137276505 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740d12d0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.752+0000 7fc573fff640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc5740d0550 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b85a0 tx=0x7fc56002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348f78481c065606 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.752+0000 7fc5737fe640 1 -- 172.21.15.49:0/3137276505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600317c0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc5737fe640 1 -- 172.21.15.49:0/3137276505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560031920 con 0x7fc5740b7ea0 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc5737fe640 1 -- 172.21.15.49:0/3137276505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560031cb0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 -- 172.21.15.49:0/3137276505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 msgr2=0x7fc5740d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc5740d0550 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b85a0 tx=0x7fc56002b860 comp rx=0 tx=0).stop 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 -- 172.21.15.49:0/3137276505 shutdown_connections 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5740d0a90 0x7fc57406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 --2- 172.21.15.49:0/3137276505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc5740d0550 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 --2- 172.21.15.49:0/3137276505 >> v2:172.21.15.115:3300/0 conn(0x7fc574146e30 0x7fc5740b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 -- 172.21.15.49:0/3137276505 >> 172.21.15.49:0/3137276505 conn(0x7fc5740b2990 msgr2=0x7fc5740b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:43.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 -- 172.21.15.49:0/3137276505 shutdown_connections 2023-12-19T05:50:43.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.753+0000 7fc579e72640 1 -- 172.21.15.49:0/3137276505 wait complete. 2023-12-19T05:50:43.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.755+0000 7fc579e72640 1 Processor -- start 2023-12-19T05:50:43.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.755+0000 7fc579e72640 1 -- start start 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5740d0a90 0x7fc5741d5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc574146e30 0x7fc5741e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57413e150 con 0x7fc5740b7ea0 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741e7330 con 0x7fc5740d0a90 2023-12-19T05:50:43.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.756+0000 7fc579e72640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741e75d0 con 0x7fc574146e30 2023-12-19T05:50:43.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51430/0 (socket says 172.21.15.49:51430) 2023-12-19T05:50:43.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 -- 172.21.15.49:0/136954111 learned_addr learned my addr 172.21.15.49:0/136954111 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:43.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 -- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc574146e30 msgr2=0x7fc5741e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc574146e30 0x7fc5741e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 -- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5740d0a90 msgr2=0x7fc5741d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5740d0a90 0x7fc5741d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 -- 172.21.15.49:0/136954111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600094d0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.757+0000 7fc578e70640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d800 tx=0x7fc56800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.758+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800b6c0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.758+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56800b820 con 0x7fc5740b7ea0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.758+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800bb90 con 0x7fc5740b7ea0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.758+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5741e78b0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.758+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5741e7e70 con 0x7fc5740b7ea0 2023-12-19T05:50:43.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.759+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc574061910 con 0x7fc5740b7ea0 2023-12-19T05:50:43.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.760+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc56800bcf0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.761+0000 7fc5717fa640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:43.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.761+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc568088fe0 con 0x7fc5740b7ea0 2023-12-19T05:50:43.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.761+0000 7fc573fff640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:43.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.763+0000 7fc573fff640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 0x7fc55806c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc560036000 tx=0x7fc560030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:43.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.765+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc568054500 con 0x7fc5740b7ea0 2023-12-19T05:50:43.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.959+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5740d1890 con 0x7fc55806a430 2023-12-19T05:50:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.982+0000 7fc5717fa640 1 -- 172.21.15.49:0/136954111 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282525 (secure 0 0 0) 0x7fc560031a90 con 0x7fc55806a430 2023-12-19T05:50:43.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:50:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 msgr2=0x7fc55806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 0x7fc55806c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc560036000 tx=0x7fc560030000 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 msgr2=0x7fc57413dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d800 tx=0x7fc56800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 shutdown_connections 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc574146e30 0x7fc5741e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5740d0a90 0x7fc5741d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 --2- 172.21.15.49:0/136954111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5740b7ea0 0x7fc57413dc10 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 >> 172.21.15.49:0/136954111 conn(0x7fc5740b2990 msgr2=0x7fc574146060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 shutdown_connections 2023-12-19T05:50:43.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:43.988+0000 7fc579e72640 1 -- 172.21.15.49:0/136954111 wait complete. 2023-12-19T05:50:44.011 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-19T05:50:42.751384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553606,"statfs":{"total":1600000000,"available":1590893404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001840"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041294+0000","last_change":"2023-12-19T05:50:38.041125+0000","last_active":"2023-12-19T05:50:38.041294+0000","last_peered":"2023-12-19T05:50:38.041294+0000","last_clean":"2023-12-19T05:50:38.041294+0000","last_became_active":"2023-12-19T05:50:38.040439+0000","last_became_peered":"2023-12-19T05:50:38.040439+0000","last_unstale":"2023-12-19T05:50:38.041294+0000","last_undegraded":"2023-12-19T05:50:38.041294+0000","last_fullsized":"2023-12-19T05:50:38.041294+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:14:32.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053849+0000","last_change":"2023-12-19T05:50:38.053750+0000","last_active":"2023-12-19T05:50:38.053849+0000","last_peered":"2023-12-19T05:50:38.053849+0000","last_clean":"2023-12-19T05:50:38.053849+0000","last_became_active":"2023-12-19T05:50:38.053330+0000","last_became_peered":"2023-12-19T05:50:38.053330+0000","last_unstale":"2023-12-19T05:50:38.053849+0000","last_undegraded":"2023-12-19T05:50:38.053849+0000","last_fullsized":"2023-12-19T05:50:38.053849+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:14:14.461139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057116+0000","last_change":"2023-12-19T05:50:38.056280+0000","last_active":"2023-12-19T05:50:38.057116+0000","last_peered":"2023-12-19T05:50:38.057116+0000","last_clean":"2023-12-19T05:50:38.057116+0000","last_became_active":"2023-12-19T05:50:38.055127+0000","last_became_peered":"2023-12-19T05:50:38.055127+0000","last_unstale":"2023-12-19T05:50:38.057116+0000","last_undegraded":"2023-12-19T05:50:38.057116+0000","last_fullsized":"2023-12-19T05:50:38.057116+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:49:43.566915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057278+0000","last_change":"2023-12-19T05:50:38.056243+0000","last_active":"2023-12-19T05:50:38.057278+0000","last_peered":"2023-12-19T05:50:38.057278+0000","last_clean":"2023-12-19T05:50:38.057278+0000","last_became_active":"2023-12-19T05:50:38.051669+0000","last_became_peered":"2023-12-19T05:50:38.051669+0000","last_unstale":"2023-12-19T05:50:38.057278+0000","last_undegraded":"2023-12-19T05:50:38.057278+0000","last_fullsized":"2023-12-19T05:50:38.057278+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:16.440190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.054718+0000","last_change":"2023-12-19T05:50:38.054477+0000","last_active":"2023-12-19T05:50:38.054718+0000","last_peered":"2023-12-19T05:50:38.054718+0000","last_clean":"2023-12-19T05:50:38.054718+0000","last_became_active":"2023-12-19T05:50:38.053663+0000","last_became_peered":"2023-12-19T05:50:38.053663+0000","last_unstale":"2023-12-19T05:50:38.054718+0000","last_undegraded":"2023-12-19T05:50:38.054718+0000","last_fullsized":"2023-12-19T05:50:38.054718+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:45:30.965851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061367+0000","last_change":"2023-12-19T05:50:38.061236+0000","last_active":"2023-12-19T05:50:38.061367+0000","last_peered":"2023-12-19T05:50:38.061367+0000","last_clean":"2023-12-19T05:50:38.061367+0000","last_became_active":"2023-12-19T05:50:38.060842+0000","last_became_peered":"2023-12-19T05:50:38.060842+0000","last_unstale":"2023-12-19T05:50:38.061367+0000","last_undegraded":"2023-12-19T05:50:38.061367+0000","last_fullsized":"2023-12-19T05:50:38.061367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.052657+0000","last_change":"2023-12-19T05:50:38.052532+0000","last_active":"2023-12-19T05:50:38.052657+0000","last_peered":"2023-12-19T05:50:38.052657+0000","last_clean":"2023-12-19T05:50:38.052657+0000","last_became_active":"2023-12-19T05:50:38.052230+0000","last_became_peered":"2023-12-19T05:50:38.052230+0000","last_unstale":"2023-12-19T05:50:38.052657+0000","last_undegraded":"2023-12-19T05:50:38.052657+0000","last_fullsized":"2023-12-19T05:50:38.052657+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:08:43.025182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.042586+0000","last_change":"2023-12-19T05:50:38.042309+0000","last_active":"2023-12-19T05:50:38.042586+0000","last_peered":"2023-12-19T05:50:38.042586+0000","last_clean":"2023-12-19T05:50:38.042586+0000","last_became_active":"2023-12-19T05:50:38.041676+0000","last_became_peered":"2023-12-19T05:50:38.041676+0000","last_unstale":"2023-12-19T05:50:38.042586+0000","last_undegraded":"2023-12-19T05:50:38.042586+0000","last_fullsized":"2023-12-19T05:50:38.042586+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:28:12.678246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057018+0000","last_change":"2023-12-19T05:50:38.056604+0000","last_active":"2023-12-19T05:50:38.057018+0000","last_peered":"2023-12-19T05:50:38.057018+0000","last_clean":"2023-12-19T05:50:38.057018+0000","last_became_active":"2023-12-19T05:50:38.056373+0000","last_became_peered":"2023-12-19T05:50:38.056373+0000","last_unstale":"2023-12-19T05:50:38.057018+0000","last_undegraded":"2023-12-19T05:50:38.057018+0000","last_fullsized":"2023-12-19T05:50:38.057018+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043218+0000","last_change":"2023-12-19T05:50:38.042950+0000","last_active":"2023-12-19T05:50:38.043218+0000","last_peered":"2023-12-19T05:50:38.043218+0000","last_clean":"2023-12-19T05:50:38.043218+0000","last_became_active":"2023-12-19T05:50:38.042710+0000","last_became_peered":"2023-12-19T05:50:38.042710+0000","last_unstale":"2023-12-19T05:50:38.043218+0000","last_undegraded":"2023-12-19T05:50:38.043218+0000","last_fullsized":"2023-12-19T05:50:38.043218+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:38:20.185384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055063+0000","last_change":"2023-12-19T05:50:38.054955+0000","last_active":"2023-12-19T05:50:38.055063+0000","last_peered":"2023-12-19T05:50:38.055063+0000","last_clean":"2023-12-19T05:50:38.055063+0000","last_became_active":"2023-12-19T05:50:38.054695+0000","last_became_peered":"2023-12-19T05:50:38.054695+0000","last_unstale":"2023-12-19T05:50:38.055063+0000","last_undegraded":"2023-12-19T05:50:38.055063+0000","last_fullsized":"2023-12-19T05:50:38.055063+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:17:39.315930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051861+0000","last_change":"2023-12-19T05:50:38.051286+0000","last_active":"2023-12-19T05:50:38.051861+0000","last_peered":"2023-12-19T05:50:38.051861+0000","last_clean":"2023-12-19T05:50:38.051861+0000","last_became_active":"2023-12-19T05:50:38.051028+0000","last_became_peered":"2023-12-19T05:50:38.051028+0000","last_unstale":"2023-12-19T05:50:38.051861+0000","last_undegraded":"2023-12-19T05:50:38.051861+0000","last_fullsized":"2023-12-19T05:50:38.051861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045955+0000","last_change":"2023-12-19T05:50:38.045191+0000","last_active":"2023-12-19T05:50:38.045955+0000","last_peered":"2023-12-19T05:50:38.045955+0000","last_clean":"2023-12-19T05:50:38.045955+0000","last_became_active":"2023-12-19T05:50:38.044960+0000","last_became_peered":"2023-12-19T05:50:38.044960+0000","last_unstale":"2023-12-19T05:50:38.045955+0000","last_undegraded":"2023-12-19T05:50:38.045955+0000","last_fullsized":"2023-12-19T05:50:38.045955+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:55:52.673282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046141+0000","last_change":"2023-12-19T05:50:38.045875+0000","last_active":"2023-12-19T05:50:38.046141+0000","last_peered":"2023-12-19T05:50:38.046141+0000","last_clean":"2023-12-19T05:50:38.046141+0000","last_became_active":"2023-12-19T05:50:38.045221+0000","last_became_peered":"2023-12-19T05:50:38.045221+0000","last_unstale":"2023-12-19T05:50:38.046141+0000","last_undegraded":"2023-12-19T05:50:38.046141+0000","last_fullsized":"2023-12-19T05:50:38.046141+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:12:16.440190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.054702+0000","last_change":"2023-12-19T05:50:38.054315+0000","last_active":"2023-12-19T05:50:38.054702+0000","last_peered":"2023-12-19T05:50:38.054702+0000","last_clean":"2023-12-19T05:50:38.054702+0000","last_became_active":"2023-12-19T05:50:38.052304+0000","last_became_peered":"2023-12-19T05:50:38.052304+0000","last_unstale":"2023-12-19T05:50:38.054702+0000","last_undegraded":"2023-12-19T05:50:38.054702+0000","last_fullsized":"2023-12-19T05:50:38.054702+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:51:50.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047979+0000","last_change":"2023-12-19T05:50:38.047868+0000","last_active":"2023-12-19T05:50:38.047979+0000","last_peered":"2023-12-19T05:50:38.047979+0000","last_clean":"2023-12-19T05:50:38.047979+0000","last_became_active":"2023-12-19T05:50:38.047622+0000","last_became_peered":"2023-12-19T05:50:38.047622+0000","last_unstale":"2023-12-19T05:50:38.047979+0000","last_undegraded":"2023-12-19T05:50:38.047979+0000","last_fullsized":"2023-12-19T05:50:38.047979+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:29.662995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047617+0000","last_change":"2023-12-19T05:50:38.047401+0000","last_active":"2023-12-19T05:50:38.047617+0000","last_peered":"2023-12-19T05:50:38.047617+0000","last_clean":"2023-12-19T05:50:38.047617+0000","last_became_active":"2023-12-19T05:50:38.047101+0000","last_became_peered":"2023-12-19T05:50:38.047101+0000","last_unstale":"2023-12-19T05:50:38.047617+0000","last_undegraded":"2023-12-19T05:50:38.047617+0000","last_fullsized":"2023-12-19T05:50:38.047617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:00:11.226536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057567+0000","last_change":"2023-12-19T05:50:38.057489+0000","last_active":"2023-12-19T05:50:38.057567+0000","last_peered":"2023-12-19T05:50:38.057567+0000","last_clean":"2023-12-19T05:50:38.057567+0000","last_became_active":"2023-12-19T05:50:38.057292+0000","last_became_peered":"2023-12-19T05:50:38.057292+0000","last_unstale":"2023-12-19T05:50:38.057567+0000","last_undegraded":"2023-12-19T05:50:38.057567+0000","last_fullsized":"2023-12-19T05:50:38.057567+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:07.308737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053790+0000","last_change":"2023-12-19T05:50:38.053149+0000","last_active":"2023-12-19T05:50:38.053790+0000","last_peered":"2023-12-19T05:50:38.053790+0000","last_clean":"2023-12-19T05:50:38.053790+0000","last_became_active":"2023-12-19T05:50:38.052527+0000","last_became_peered":"2023-12-19T05:50:38.052527+0000","last_unstale":"2023-12-19T05:50:38.053790+0000","last_undegraded":"2023-12-19T05:50:38.053790+0000","last_fullsized":"2023-12-19T05:50:38.053790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:46.929400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051937+0000","last_change":"2023-12-19T05:50:38.051192+0000","last_active":"2023-12-19T05:50:38.051937+0000","last_peered":"2023-12-19T05:50:38.051937+0000","last_clean":"2023-12-19T05:50:38.051937+0000","last_became_active":"2023-12-19T05:50:38.050775+0000","last_became_peered":"2023-12-19T05:50:38.050775+0000","last_unstale":"2023-12-19T05:50:38.051937+0000","last_undegraded":"2023-12-19T05:50:38.051937+0000","last_fullsized":"2023-12-19T05:50:38.051937+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:10.543852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041025+0000","last_change":"2023-12-19T05:50:38.039691+0000","last_active":"2023-12-19T05:50:38.041025+0000","last_peered":"2023-12-19T05:50:38.041025+0000","last_clean":"2023-12-19T05:50:38.041025+0000","last_became_active":"2023-12-19T05:50:38.039481+0000","last_became_peered":"2023-12-19T05:50:38.039481+0000","last_unstale":"2023-12-19T05:50:38.041025+0000","last_undegraded":"2023-12-19T05:50:38.041025+0000","last_fullsized":"2023-12-19T05:50:38.041025+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:35:57.097553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050363+0000","last_change":"2023-12-19T05:50:38.050150+0000","last_active":"2023-12-19T05:50:38.050363+0000","last_peered":"2023-12-19T05:50:38.050363+0000","last_clean":"2023-12-19T05:50:38.050363+0000","last_became_active":"2023-12-19T05:50:38.049871+0000","last_became_peered":"2023-12-19T05:50:38.049871+0000","last_unstale":"2023-12-19T05:50:38.050363+0000","last_undegraded":"2023-12-19T05:50:38.050363+0000","last_fullsized":"2023-12-19T05:50:38.050363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059430+0000","last_change":"2023-12-19T05:50:38.059359+0000","last_active":"2023-12-19T05:50:38.059430+0000","last_peered":"2023-12-19T05:50:38.059430+0000","last_clean":"2023-12-19T05:50:38.059430+0000","last_became_active":"2023-12-19T05:50:38.059034+0000","last_became_peered":"2023-12-19T05:50:38.059034+0000","last_unstale":"2023-12-19T05:50:38.059430+0000","last_undegraded":"2023-12-19T05:50:38.059430+0000","last_fullsized":"2023-12-19T05:50:38.059430+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:14:00.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.048301+0000","last_change":"2023-12-19T05:50:38.048183+0000","last_active":"2023-12-19T05:50:38.048301+0000","last_peered":"2023-12-19T05:50:38.048301+0000","last_clean":"2023-12-19T05:50:38.048301+0000","last_became_active":"2023-12-19T05:50:38.047938+0000","last_became_peered":"2023-12-19T05:50:38.047938+0000","last_unstale":"2023-12-19T05:50:38.048301+0000","last_undegraded":"2023-12-19T05:50:38.048301+0000","last_fullsized":"2023-12-19T05:50:38.048301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:44.421443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056615+0000","last_change":"2023-12-19T05:50:38.055514+0000","last_active":"2023-12-19T05:50:38.056615+0000","last_peered":"2023-12-19T05:50:38.056615+0000","last_clean":"2023-12-19T05:50:38.056615+0000","last_became_active":"2023-12-19T05:50:38.052749+0000","last_became_peered":"2023-12-19T05:50:38.052749+0000","last_unstale":"2023-12-19T05:50:38.056615+0000","last_undegraded":"2023-12-19T05:50:38.056615+0000","last_fullsized":"2023-12-19T05:50:38.056615+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:31:04.574215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053096+0000","last_change":"2023-12-19T05:50:38.052859+0000","last_active":"2023-12-19T05:50:38.053096+0000","last_peered":"2023-12-19T05:50:38.053096+0000","last_clean":"2023-12-19T05:50:38.053096+0000","last_became_active":"2023-12-19T05:50:38.050653+0000","last_became_peered":"2023-12-19T05:50:38.050653+0000","last_unstale":"2023-12-19T05:50:38.053096+0000","last_undegraded":"2023-12-19T05:50:38.053096+0000","last_fullsized":"2023-12-19T05:50:38.053096+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:52:14.083359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053832+0000","last_change":"2023-12-19T05:50:38.053592+0000","last_active":"2023-12-19T05:50:38.053832+0000","last_peered":"2023-12-19T05:50:38.053832+0000","last_clean":"2023-12-19T05:50:38.053832+0000","last_became_active":"2023-12-19T05:50:38.052993+0000","last_became_peered":"2023-12-19T05:50:38.052993+0000","last_unstale":"2023-12-19T05:50:38.053832+0000","last_undegraded":"2023-12-19T05:50:38.053832+0000","last_fullsized":"2023-12-19T05:50:38.053832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:41:41.217121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058991+0000","last_change":"2023-12-19T05:50:38.058921+0000","last_active":"2023-12-19T05:50:38.058991+0000","last_peered":"2023-12-19T05:50:38.058991+0000","last_clean":"2023-12-19T05:50:38.058991+0000","last_became_active":"2023-12-19T05:50:38.058370+0000","last_became_peered":"2023-12-19T05:50:38.058370+0000","last_unstale":"2023-12-19T05:50:38.058991+0000","last_undegraded":"2023-12-19T05:50:38.058991+0000","last_fullsized":"2023-12-19T05:50:38.058991+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:28:47.185767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050278+0000","last_change":"2023-12-19T05:50:38.050026+0000","last_active":"2023-12-19T05:50:38.050278+0000","last_peered":"2023-12-19T05:50:38.050278+0000","last_clean":"2023-12-19T05:50:38.050278+0000","last_became_active":"2023-12-19T05:50:38.048710+0000","last_became_peered":"2023-12-19T05:50:38.048710+0000","last_unstale":"2023-12-19T05:50:38.050278+0000","last_undegraded":"2023-12-19T05:50:38.050278+0000","last_fullsized":"2023-12-19T05:50:38.050278+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:23:36.893762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045005+0000","last_change":"2023-12-19T05:50:38.044941+0000","last_active":"2023-12-19T05:50:38.045005+0000","last_peered":"2023-12-19T05:50:38.045005+0000","last_clean":"2023-12-19T05:50:38.045005+0000","last_became_active":"2023-12-19T05:50:38.044696+0000","last_became_peered":"2023-12-19T05:50:38.044696+0000","last_unstale":"2023-12-19T05:50:38.045005+0000","last_undegraded":"2023-12-19T05:50:38.045005+0000","last_fullsized":"2023-12-19T05:50:38.045005+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:17:39.315930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046067+0000","last_change":"2023-12-19T05:50:38.044866+0000","last_active":"2023-12-19T05:50:38.046067+0000","last_peered":"2023-12-19T05:50:38.046067+0000","last_clean":"2023-12-19T05:50:38.046067+0000","last_became_active":"2023-12-19T05:50:38.044192+0000","last_became_peered":"2023-12-19T05:50:38.044192+0000","last_unstale":"2023-12-19T05:50:38.046067+0000","last_undegraded":"2023-12-19T05:50:38.046067+0000","last_fullsized":"2023-12-19T05:50:38.046067+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:18:08.150135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.049716+0000","last_change":"2023-12-19T05:50:38.049404+0000","last_active":"2023-12-19T05:50:38.049716+0000","last_peered":"2023-12-19T05:50:38.049716+0000","last_clean":"2023-12-19T05:50:38.049716+0000","last_became_active":"2023-12-19T05:50:38.049077+0000","last_became_peered":"2023-12-19T05:50:38.049077+0000","last_unstale":"2023-12-19T05:50:38.049716+0000","last_undegraded":"2023-12-19T05:50:38.049716+0000","last_fullsized":"2023-12-19T05:50:38.049716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:23.557874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053840+0000","last_change":"2023-12-19T05:50:38.053398+0000","last_active":"2023-12-19T05:50:38.053840+0000","last_peered":"2023-12-19T05:50:38.053840+0000","last_clean":"2023-12-19T05:50:38.053840+0000","last_became_active":"2023-12-19T05:50:38.053199+0000","last_became_peered":"2023-12-19T05:50:38.053199+0000","last_unstale":"2023-12-19T05:50:38.053840+0000","last_undegraded":"2023-12-19T05:50:38.053840+0000","last_fullsized":"2023-12-19T05:50:38.053840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:15.990075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"175'4","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060298+0000","last_change":"2023-12-19T05:50:37.534136+0000","last_active":"2023-12-19T05:50:38.060298+0000","last_peered":"2023-12-19T05:50:38.060298+0000","last_clean":"2023-12-19T05:50:38.060298+0000","last_became_active":"2023-12-19T05:50:37.533203+0000","last_became_peered":"2023-12-19T05:50:37.533203+0000","last_unstale":"2023-12-19T05:50:38.060298+0000","last_undegraded":"2023-12-19T05:50:38.060298+0000","last_fullsized":"2023-12-19T05:50:38.060298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:55:18.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.039921+0000","last_change":"2023-12-19T05:50:38.038890+0000","last_active":"2023-12-19T05:50:38.039921+0000","last_peered":"2023-12-19T05:50:38.039921+0000","last_clean":"2023-12-19T05:50:38.039921+0000","last_became_active":"2023-12-19T05:50:38.038185+0000","last_became_peered":"2023-12-19T05:50:38.038185+0000","last_unstale":"2023-12-19T05:50:38.039921+0000","last_undegraded":"2023-12-19T05:50:38.039921+0000","last_fullsized":"2023-12-19T05:50:38.039921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:16:11.091452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061527+0000","last_change":"2023-12-19T05:50:37.545546+0000","last_active":"2023-12-19T05:50:38.061527+0000","last_peered":"2023-12-19T05:50:38.061527+0000","last_clean":"2023-12-19T05:50:38.061527+0000","last_became_active":"2023-12-19T05:50:37.544759+0000","last_became_peered":"2023-12-19T05:50:37.544759+0000","last_unstale":"2023-12-19T05:50:38.061527+0000","last_undegraded":"2023-12-19T05:50:38.061527+0000","last_fullsized":"2023-12-19T05:50:38.061527+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:22.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.053564+0000","last_change":"2023-12-19T05:50:38.052088+0000","last_active":"2023-12-19T05:50:38.053564+0000","last_peered":"2023-12-19T05:50:38.053564+0000","last_clean":"2023-12-19T05:50:38.053564+0000","last_became_active":"2023-12-19T05:50:38.051792+0000","last_became_peered":"2023-12-19T05:50:38.051792+0000","last_unstale":"2023-12-19T05:50:38.053564+0000","last_undegraded":"2023-12-19T05:50:38.053564+0000","last_fullsized":"2023-12-19T05:50:38.053564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:52.872226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059821+0000","last_change":"2023-12-19T05:50:37.531265+0000","last_active":"2023-12-19T05:50:38.059821+0000","last_peered":"2023-12-19T05:50:38.059821+0000","last_clean":"2023-12-19T05:50:38.059821+0000","last_became_active":"2023-12-19T05:50:37.530704+0000","last_became_peered":"2023-12-19T05:50:37.530704+0000","last_unstale":"2023-12-19T05:50:38.059821+0000","last_undegraded":"2023-12-19T05:50:38.059821+0000","last_fullsized":"2023-12-19T05:50:38.059821+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:17.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051604+0000","last_change":"2023-12-19T05:50:38.049771+0000","last_active":"2023-12-19T05:50:38.051604+0000","last_peered":"2023-12-19T05:50:38.051604+0000","last_clean":"2023-12-19T05:50:38.051604+0000","last_became_active":"2023-12-19T05:50:38.049494+0000","last_became_peered":"2023-12-19T05:50:38.049494+0000","last_unstale":"2023-12-19T05:50:38.051604+0000","last_undegraded":"2023-12-19T05:50:38.051604+0000","last_fullsized":"2023-12-19T05:50:38.051604+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:19:16.157782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061831+0000","last_change":"2023-12-19T05:50:37.546784+0000","last_active":"2023-12-19T05:50:38.061831+0000","last_peered":"2023-12-19T05:50:38.061831+0000","last_clean":"2023-12-19T05:50:38.061831+0000","last_became_active":"2023-12-19T05:50:37.545960+0000","last_became_peered":"2023-12-19T05:50:37.545960+0000","last_unstale":"2023-12-19T05:50:38.061831+0000","last_undegraded":"2023-12-19T05:50:38.061831+0000","last_fullsized":"2023-12-19T05:50:38.061831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:54.930694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056659+0000","last_change":"2023-12-19T05:50:38.055645+0000","last_active":"2023-12-19T05:50:38.056659+0000","last_peered":"2023-12-19T05:50:38.056659+0000","last_clean":"2023-12-19T05:50:38.056659+0000","last_became_active":"2023-12-19T05:50:38.050261+0000","last_became_peered":"2023-12-19T05:50:38.050261+0000","last_unstale":"2023-12-19T05:50:38.056659+0000","last_undegraded":"2023-12-19T05:50:38.056659+0000","last_fullsized":"2023-12-19T05:50:38.056659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:02:39.443722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060069+0000","last_change":"2023-12-19T05:50:37.534775+0000","last_active":"2023-12-19T05:50:38.060069+0000","last_peered":"2023-12-19T05:50:38.060069+0000","last_clean":"2023-12-19T05:50:38.060069+0000","last_became_active":"2023-12-19T05:50:37.534118+0000","last_became_peered":"2023-12-19T05:50:37.534118+0000","last_unstale":"2023-12-19T05:50:38.060069+0000","last_undegraded":"2023-12-19T05:50:38.060069+0000","last_fullsized":"2023-12-19T05:50:38.060069+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:16:10.085683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051666+0000","last_change":"2023-12-19T05:50:38.050536+0000","last_active":"2023-12-19T05:50:38.051666+0000","last_peered":"2023-12-19T05:50:38.051666+0000","last_clean":"2023-12-19T05:50:38.051666+0000","last_became_active":"2023-12-19T05:50:38.050291+0000","last_became_peered":"2023-12-19T05:50:38.050291+0000","last_unstale":"2023-12-19T05:50:38.051666+0000","last_undegraded":"2023-12-19T05:50:38.051666+0000","last_fullsized":"2023-12-19T05:50:38.051666+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:52.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.059996+0000","last_change":"2023-12-19T05:50:37.543823+0000","last_active":"2023-12-19T05:50:38.059996+0000","last_peered":"2023-12-19T05:50:38.059996+0000","last_clean":"2023-12-19T05:50:38.059996+0000","last_became_active":"2023-12-19T05:50:37.543594+0000","last_became_peered":"2023-12-19T05:50:37.543594+0000","last_unstale":"2023-12-19T05:50:38.059996+0000","last_undegraded":"2023-12-19T05:50:38.059996+0000","last_fullsized":"2023-12-19T05:50:38.059996+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:45:35.511976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.056862+0000","last_change":"2023-12-19T05:50:38.056785+0000","last_active":"2023-12-19T05:50:38.056862+0000","last_peered":"2023-12-19T05:50:38.056862+0000","last_clean":"2023-12-19T05:50:38.056862+0000","last_became_active":"2023-12-19T05:50:38.053543+0000","last_became_peered":"2023-12-19T05:50:38.053543+0000","last_unstale":"2023-12-19T05:50:38.056862+0000","last_undegraded":"2023-12-19T05:50:38.056862+0000","last_fullsized":"2023-12-19T05:50:38.056862+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:58:05.574159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051210+0000","last_change":"2023-12-19T05:50:37.543521+0000","last_active":"2023-12-19T05:50:38.051210+0000","last_peered":"2023-12-19T05:50:38.051210+0000","last_clean":"2023-12-19T05:50:38.051210+0000","last_became_active":"2023-12-19T05:50:37.543224+0000","last_became_peered":"2023-12-19T05:50:37.543224+0000","last_unstale":"2023-12-19T05:50:38.051210+0000","last_undegraded":"2023-12-19T05:50:38.051210+0000","last_fullsized":"2023-12-19T05:50:38.051210+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:52.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057339+0000","last_change":"2023-12-19T05:50:38.056559+0000","last_active":"2023-12-19T05:50:38.057339+0000","last_peered":"2023-12-19T05:50:38.057339+0000","last_clean":"2023-12-19T05:50:38.057339+0000","last_became_active":"2023-12-19T05:50:38.052490+0000","last_became_peered":"2023-12-19T05:50:38.052490+0000","last_unstale":"2023-12-19T05:50:38.057339+0000","last_undegraded":"2023-12-19T05:50:38.057339+0000","last_fullsized":"2023-12-19T05:50:38.057339+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.026574+0000","last_change":"2023-12-19T05:50:37.541956+0000","last_active":"2023-12-19T05:50:38.026574+0000","last_peered":"2023-12-19T05:50:38.026574+0000","last_clean":"2023-12-19T05:50:38.026574+0000","last_became_active":"2023-12-19T05:50:37.541386+0000","last_became_peered":"2023-12-19T05:50:37.541386+0000","last_unstale":"2023-12-19T05:50:38.026574+0000","last_undegraded":"2023-12-19T05:50:38.026574+0000","last_fullsized":"2023-12-19T05:50:38.026574+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:52:13.375166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057325+0000","last_change":"2023-12-19T05:50:38.056528+0000","last_active":"2023-12-19T05:50:38.057325+0000","last_peered":"2023-12-19T05:50:38.057325+0000","last_clean":"2023-12-19T05:50:38.057325+0000","last_became_active":"2023-12-19T05:50:38.056152+0000","last_became_peered":"2023-12-19T05:50:38.056152+0000","last_unstale":"2023-12-19T05:50:38.057325+0000","last_undegraded":"2023-12-19T05:50:38.057325+0000","last_fullsized":"2023-12-19T05:50:38.057325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:27.822972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.049354+0000","last_change":"2023-12-19T05:50:37.548902+0000","last_active":"2023-12-19T05:50:38.049354+0000","last_peered":"2023-12-19T05:50:38.049354+0000","last_clean":"2023-12-19T05:50:38.049354+0000","last_became_active":"2023-12-19T05:50:37.547592+0000","last_became_peered":"2023-12-19T05:50:37.547592+0000","last_unstale":"2023-12-19T05:50:38.049354+0000","last_undegraded":"2023-12-19T05:50:38.049354+0000","last_fullsized":"2023-12-19T05:50:38.049354+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:21.351114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.039471+0000","last_change":"2023-12-19T05:50:38.039378+0000","last_active":"2023-12-19T05:50:38.039471+0000","last_peered":"2023-12-19T05:50:38.039471+0000","last_clean":"2023-12-19T05:50:38.039471+0000","last_became_active":"2023-12-19T05:50:38.038813+0000","last_became_peered":"2023-12-19T05:50:38.038813+0000","last_unstale":"2023-12-19T05:50:38.039471+0000","last_undegraded":"2023-12-19T05:50:38.039471+0000","last_fullsized":"2023-12-19T05:50:38.039471+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:04.661807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.035829+0000","last_change":"2023-12-19T05:50:37.539636+0000","last_active":"2023-12-19T05:50:38.035829+0000","last_peered":"2023-12-19T05:50:38.035829+0000","last_clean":"2023-12-19T05:50:38.035829+0000","last_became_active":"2023-12-19T05:50:37.539137+0000","last_became_peered":"2023-12-19T05:50:37.539137+0000","last_unstale":"2023-12-19T05:50:38.035829+0000","last_undegraded":"2023-12-19T05:50:38.035829+0000","last_fullsized":"2023-12-19T05:50:38.035829+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:28.150927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051405+0000","last_change":"2023-12-19T05:50:38.051188+0000","last_active":"2023-12-19T05:50:38.051405+0000","last_peered":"2023-12-19T05:50:38.051405+0000","last_clean":"2023-12-19T05:50:38.051405+0000","last_became_active":"2023-12-19T05:50:38.050865+0000","last_became_peered":"2023-12-19T05:50:38.050865+0000","last_unstale":"2023-12-19T05:50:38.051405+0000","last_undegraded":"2023-12-19T05:50:38.051405+0000","last_fullsized":"2023-12-19T05:50:38.051405+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:32:09.564478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":17,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.063815+0000","last_change":"2023-12-19T05:50:37.544368+0000","last_active":"2023-12-19T05:50:38.063815+0000","last_peered":"2023-12-19T05:50:38.063815+0000","last_clean":"2023-12-19T05:50:38.063815+0000","last_became_active":"2023-12-19T05:50:37.544088+0000","last_became_peered":"2023-12-19T05:50:37.544088+0000","last_unstale":"2023-12-19T05:50:38.063815+0000","last_undegraded":"2023-12-19T05:50:38.063815+0000","last_fullsized":"2023-12-19T05:50:38.063815+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:38:50.995339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040612+0000","last_change":"2023-12-19T05:50:38.040447+0000","last_active":"2023-12-19T05:50:38.040612+0000","last_peered":"2023-12-19T05:50:38.040612+0000","last_clean":"2023-12-19T05:50:38.040612+0000","last_became_active":"2023-12-19T05:50:38.040218+0000","last_became_peered":"2023-12-19T05:50:38.040218+0000","last_unstale":"2023-12-19T05:50:38.040612+0000","last_undegraded":"2023-12-19T05:50:38.040612+0000","last_fullsized":"2023-12-19T05:50:38.040612+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:17:22.982208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060662+0000","last_change":"2023-12-19T05:50:37.531114+0000","last_active":"2023-12-19T05:50:38.060662+0000","last_peered":"2023-12-19T05:50:38.060662+0000","last_clean":"2023-12-19T05:50:38.060662+0000","last_became_active":"2023-12-19T05:50:37.530397+0000","last_became_peered":"2023-12-19T05:50:37.530397+0000","last_unstale":"2023-12-19T05:50:38.060662+0000","last_undegraded":"2023-12-19T05:50:38.060662+0000","last_fullsized":"2023-12-19T05:50:38.060662+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:21:48.047377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.041746+0000","last_change":"2023-12-19T05:50:38.041585+0000","last_active":"2023-12-19T05:50:38.041746+0000","last_peered":"2023-12-19T05:50:38.041746+0000","last_clean":"2023-12-19T05:50:38.041746+0000","last_became_active":"2023-12-19T05:50:38.040831+0000","last_became_peered":"2023-12-19T05:50:38.040831+0000","last_unstale":"2023-12-19T05:50:38.041746+0000","last_undegraded":"2023-12-19T05:50:38.041746+0000","last_fullsized":"2023-12-19T05:50:38.041746+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:56:51.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037332+0000","last_change":"2023-12-19T05:50:37.542995+0000","last_active":"2023-12-19T05:50:38.037332+0000","last_peered":"2023-12-19T05:50:38.037332+0000","last_clean":"2023-12-19T05:50:38.037332+0000","last_became_active":"2023-12-19T05:50:37.542755+0000","last_became_peered":"2023-12-19T05:50:37.542755+0000","last_unstale":"2023-12-19T05:50:38.037332+0000","last_undegraded":"2023-12-19T05:50:38.037332+0000","last_fullsized":"2023-12-19T05:50:38.037332+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:05.104197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.044189+0000","last_change":"2023-12-19T05:50:38.044074+0000","last_active":"2023-12-19T05:50:38.044189+0000","last_peered":"2023-12-19T05:50:38.044189+0000","last_clean":"2023-12-19T05:50:38.044189+0000","last_became_active":"2023-12-19T05:50:38.043875+0000","last_became_peered":"2023-12-19T05:50:38.043875+0000","last_unstale":"2023-12-19T05:50:38.044189+0000","last_undegraded":"2023-12-19T05:50:38.044189+0000","last_fullsized":"2023-12-19T05:50:38.044189+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:58:21.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043303+0000","last_change":"2023-12-19T05:50:37.547184+0000","last_active":"2023-12-19T05:50:38.043303+0000","last_peered":"2023-12-19T05:50:38.043303+0000","last_clean":"2023-12-19T05:50:38.043303+0000","last_became_active":"2023-12-19T05:50:37.546563+0000","last_became_peered":"2023-12-19T05:50:37.546563+0000","last_unstale":"2023-12-19T05:50:38.043303+0000","last_undegraded":"2023-12-19T05:50:38.043303+0000","last_fullsized":"2023-12-19T05:50:38.043303+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:45:54.806824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057295+0000","last_change":"2023-12-19T05:50:38.056399+0000","last_active":"2023-12-19T05:50:38.057295+0000","last_peered":"2023-12-19T05:50:38.057295+0000","last_clean":"2023-12-19T05:50:38.057295+0000","last_became_active":"2023-12-19T05:50:38.055831+0000","last_became_peered":"2023-12-19T05:50:38.055831+0000","last_unstale":"2023-12-19T05:50:38.057295+0000","last_undegraded":"2023-12-19T05:50:38.057295+0000","last_fullsized":"2023-12-19T05:50:38.057295+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:23.151399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.064111+0000","last_change":"2023-12-19T05:50:37.538820+0000","last_active":"2023-12-19T05:50:38.064111+0000","last_peered":"2023-12-19T05:50:38.064111+0000","last_clean":"2023-12-19T05:50:38.064111+0000","last_became_active":"2023-12-19T05:50:37.538354+0000","last_became_peered":"2023-12-19T05:50:37.538354+0000","last_unstale":"2023-12-19T05:50:38.064111+0000","last_undegraded":"2023-12-19T05:50:38.064111+0000","last_fullsized":"2023-12-19T05:50:38.064111+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:30:38.335105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040919+0000","last_change":"2023-12-19T05:50:38.039911+0000","last_active":"2023-12-19T05:50:38.040919+0000","last_peered":"2023-12-19T05:50:38.040919+0000","last_clean":"2023-12-19T05:50:38.040919+0000","last_became_active":"2023-12-19T05:50:38.039688+0000","last_became_peered":"2023-12-19T05:50:38.039688+0000","last_unstale":"2023-12-19T05:50:38.040919+0000","last_undegraded":"2023-12-19T05:50:38.040919+0000","last_fullsized":"2023-12-19T05:50:38.040919+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:56.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.062283+0000","last_change":"2023-12-19T05:50:37.548461+0000","last_active":"2023-12-19T05:50:38.062283+0000","last_peered":"2023-12-19T05:50:38.062283+0000","last_clean":"2023-12-19T05:50:38.062283+0000","last_became_active":"2023-12-19T05:50:37.548194+0000","last_became_peered":"2023-12-19T05:50:37.548194+0000","last_unstale":"2023-12-19T05:50:38.062283+0000","last_undegraded":"2023-12-19T05:50:38.062283+0000","last_fullsized":"2023-12-19T05:50:38.062283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:42:43.415674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.047269+0000","last_change":"2023-12-19T05:50:38.046743+0000","last_active":"2023-12-19T05:50:38.047269+0000","last_peered":"2023-12-19T05:50:38.047269+0000","last_clean":"2023-12-19T05:50:38.047269+0000","last_became_active":"2023-12-19T05:50:38.045290+0000","last_became_peered":"2023-12-19T05:50:38.045290+0000","last_unstale":"2023-12-19T05:50:38.047269+0000","last_undegraded":"2023-12-19T05:50:38.047269+0000","last_fullsized":"2023-12-19T05:50:38.047269+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:12.774141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060467+0000","last_change":"2023-12-19T05:50:37.529737+0000","last_active":"2023-12-19T05:50:38.060467+0000","last_peered":"2023-12-19T05:50:38.060467+0000","last_clean":"2023-12-19T05:50:38.060467+0000","last_became_active":"2023-12-19T05:50:37.529122+0000","last_became_peered":"2023-12-19T05:50:37.529122+0000","last_unstale":"2023-12-19T05:50:38.060467+0000","last_undegraded":"2023-12-19T05:50:38.060467+0000","last_fullsized":"2023-12-19T05:50:38.060467+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:32:08.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.040971+0000","last_change":"2023-12-19T05:50:38.040432+0000","last_active":"2023-12-19T05:50:38.040971+0000","last_peered":"2023-12-19T05:50:38.040971+0000","last_clean":"2023-12-19T05:50:38.040971+0000","last_became_active":"2023-12-19T05:50:38.040244+0000","last_became_peered":"2023-12-19T05:50:38.040244+0000","last_unstale":"2023-12-19T05:50:38.040971+0000","last_undegraded":"2023-12-19T05:50:38.040971+0000","last_fullsized":"2023-12-19T05:50:38.040971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:00.383608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.060798+0000","last_change":"2023-12-19T05:50:37.538035+0000","last_active":"2023-12-19T05:50:38.060798+0000","last_peered":"2023-12-19T05:50:38.060798+0000","last_clean":"2023-12-19T05:50:38.060798+0000","last_became_active":"2023-12-19T05:50:37.537499+0000","last_became_peered":"2023-12-19T05:50:37.537499+0000","last_unstale":"2023-12-19T05:50:38.060798+0000","last_undegraded":"2023-12-19T05:50:38.060798+0000","last_fullsized":"2023-12-19T05:50:38.060798+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:31:22.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.050990+0000","last_change":"2023-12-19T05:50:38.050415+0000","last_active":"2023-12-19T05:50:38.050990+0000","last_peered":"2023-12-19T05:50:38.050990+0000","last_clean":"2023-12-19T05:50:38.050990+0000","last_became_active":"2023-12-19T05:50:38.050114+0000","last_became_peered":"2023-12-19T05:50:38.050114+0000","last_unstale":"2023-12-19T05:50:38.050990+0000","last_undegraded":"2023-12-19T05:50:38.050990+0000","last_fullsized":"2023-12-19T05:50:38.050990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:37:43.144014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.043465+0000","last_change":"2023-12-19T05:50:37.547325+0000","last_active":"2023-12-19T05:50:38.043465+0000","last_peered":"2023-12-19T05:50:38.043465+0000","last_clean":"2023-12-19T05:50:38.043465+0000","last_became_active":"2023-12-19T05:50:37.546952+0000","last_became_peered":"2023-12-19T05:50:37.546952+0000","last_unstale":"2023-12-19T05:50:38.043465+0000","last_undegraded":"2023-12-19T05:50:38.043465+0000","last_fullsized":"2023-12-19T05:50:38.043465+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:05:51.948661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046158+0000","last_change":"2023-12-19T05:50:38.046059+0000","last_active":"2023-12-19T05:50:38.046158+0000","last_peered":"2023-12-19T05:50:38.046158+0000","last_clean":"2023-12-19T05:50:38.046158+0000","last_became_active":"2023-12-19T05:50:38.045537+0000","last_became_peered":"2023-12-19T05:50:38.045537+0000","last_unstale":"2023-12-19T05:50:38.046158+0000","last_undegraded":"2023-12-19T05:50:38.046158+0000","last_fullsized":"2023-12-19T05:50:38.046158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.061887+0000","last_change":"2023-12-19T05:50:37.545094+0000","last_active":"2023-12-19T05:50:38.061887+0000","last_peered":"2023-12-19T05:50:38.061887+0000","last_clean":"2023-12-19T05:50:38.061887+0000","last_became_active":"2023-12-19T05:50:37.544811+0000","last_became_peered":"2023-12-19T05:50:37.544811+0000","last_unstale":"2023-12-19T05:50:38.061887+0000","last_undegraded":"2023-12-19T05:50:38.061887+0000","last_fullsized":"2023-12-19T05:50:38.061887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:58:20.550739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058843+0000","last_change":"2023-12-19T05:50:38.058738+0000","last_active":"2023-12-19T05:50:38.058843+0000","last_peered":"2023-12-19T05:50:38.058843+0000","last_clean":"2023-12-19T05:50:38.058843+0000","last_became_active":"2023-12-19T05:50:38.053414+0000","last_became_peered":"2023-12-19T05:50:38.053414+0000","last_unstale":"2023-12-19T05:50:38.058843+0000","last_undegraded":"2023-12-19T05:50:38.058843+0000","last_fullsized":"2023-12-19T05:50:38.058843+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:22:23.373655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.045185+0000","last_change":"2023-12-19T05:50:37.544309+0000","last_active":"2023-12-19T05:50:38.045185+0000","last_peered":"2023-12-19T05:50:38.045185+0000","last_clean":"2023-12-19T05:50:38.045185+0000","last_became_active":"2023-12-19T05:50:37.544069+0000","last_became_peered":"2023-12-19T05:50:37.544069+0000","last_unstale":"2023-12-19T05:50:38.045185+0000","last_undegraded":"2023-12-19T05:50:38.045185+0000","last_fullsized":"2023-12-19T05:50:38.045185+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:06.302968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051879+0000","last_change":"2023-12-19T05:50:38.051255+0000","last_active":"2023-12-19T05:50:38.051879+0000","last_peered":"2023-12-19T05:50:38.051879+0000","last_clean":"2023-12-19T05:50:38.051879+0000","last_became_active":"2023-12-19T05:50:38.050868+0000","last_became_peered":"2023-12-19T05:50:38.050868+0000","last_unstale":"2023-12-19T05:50:38.051879+0000","last_undegraded":"2023-12-19T05:50:38.051879+0000","last_fullsized":"2023-12-19T05:50:38.051879+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:41:52.872226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038141+0000","last_change":"2023-12-19T05:50:37.548053+0000","last_active":"2023-12-19T05:50:38.038141+0000","last_peered":"2023-12-19T05:50:38.038141+0000","last_clean":"2023-12-19T05:50:38.038141+0000","last_became_active":"2023-12-19T05:50:37.547766+0000","last_became_peered":"2023-12-19T05:50:37.547766+0000","last_unstale":"2023-12-19T05:50:38.038141+0000","last_undegraded":"2023-12-19T05:50:38.038141+0000","last_fullsized":"2023-12-19T05:50:38.038141+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:55:59.377839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055427+0000","last_change":"2023-12-19T05:50:38.055182+0000","last_active":"2023-12-19T05:50:38.055427+0000","last_peered":"2023-12-19T05:50:38.055427+0000","last_clean":"2023-12-19T05:50:38.055427+0000","last_became_active":"2023-12-19T05:50:38.050659+0000","last_became_peered":"2023-12-19T05:50:38.050659+0000","last_unstale":"2023-12-19T05:50:38.055427+0000","last_undegraded":"2023-12-19T05:50:38.055427+0000","last_fullsized":"2023-12-19T05:50:38.055427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:00:25.020643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037353+0000","last_change":"2023-12-19T05:50:37.546588+0000","last_active":"2023-12-19T05:50:38.037353+0000","last_peered":"2023-12-19T05:50:38.037353+0000","last_clean":"2023-12-19T05:50:38.037353+0000","last_became_active":"2023-12-19T05:50:37.546321+0000","last_became_peered":"2023-12-19T05:50:37.546321+0000","last_unstale":"2023-12-19T05:50:38.037353+0000","last_undegraded":"2023-12-19T05:50:38.037353+0000","last_fullsized":"2023-12-19T05:50:38.037353+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:55.954755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055710+0000","last_change":"2023-12-19T05:50:38.055641+0000","last_active":"2023-12-19T05:50:38.055710+0000","last_peered":"2023-12-19T05:50:38.055710+0000","last_clean":"2023-12-19T05:50:38.055710+0000","last_became_active":"2023-12-19T05:50:38.052204+0000","last_became_peered":"2023-12-19T05:50:38.052204+0000","last_unstale":"2023-12-19T05:50:38.055710+0000","last_undegraded":"2023-12-19T05:50:38.055710+0000","last_fullsized":"2023-12-19T05:50:38.055710+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:40.661607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"175'2","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.058887+0000","last_change":"2023-12-19T05:50:37.543024+0000","last_active":"2023-12-19T05:50:38.058887+0000","last_peered":"2023-12-19T05:50:38.058887+0000","last_clean":"2023-12-19T05:50:38.058887+0000","last_became_active":"2023-12-19T05:50:37.542416+0000","last_became_peered":"2023-12-19T05:50:37.542416+0000","last_unstale":"2023-12-19T05:50:38.058887+0000","last_undegraded":"2023-12-19T05:50:38.058887+0000","last_fullsized":"2023-12-19T05:50:38.058887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:48:14.984306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051651+0000","last_change":"2023-12-19T05:50:38.049797+0000","last_active":"2023-12-19T05:50:38.051651+0000","last_peered":"2023-12-19T05:50:38.051651+0000","last_clean":"2023-12-19T05:50:38.051651+0000","last_became_active":"2023-12-19T05:50:38.045008+0000","last_became_peered":"2023-12-19T05:50:38.045008+0000","last_unstale":"2023-12-19T05:50:38.051651+0000","last_undegraded":"2023-12-19T05:50:38.051651+0000","last_fullsized":"2023-12-19T05:50:38.051651+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:53.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"176'1","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-12-19T05:50:40.352000+0000","last_change":"2023-12-19T05:50:37.547044+0000","last_active":"2023-12-19T05:50:40.352000+0000","last_peered":"2023-12-19T05:50:40.352000+0000","last_clean":"2023-12-19T05:50:40.352000+0000","last_became_active":"2023-12-19T05:50:37.546755+0000","last_became_peered":"2023-12-19T05:50:37.546755+0000","last_unstale":"2023-12-19T05:50:40.352000+0000","last_undegraded":"2023-12-19T05:50:40.352000+0000","last_fullsized":"2023-12-19T05:50:40.352000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:17:05.779413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055668+0000","last_change":"2023-12-19T05:50:38.055267+0000","last_active":"2023-12-19T05:50:38.055668+0000","last_peered":"2023-12-19T05:50:38.055668+0000","last_clean":"2023-12-19T05:50:38.055668+0000","last_became_active":"2023-12-19T05:50:38.054942+0000","last_became_peered":"2023-12-19T05:50:38.054942+0000","last_unstale":"2023-12-19T05:50:38.055668+0000","last_undegraded":"2023-12-19T05:50:38.055668+0000","last_fullsized":"2023-12-19T05:50:38.055668+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:08:01.104339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.030035+0000","last_change":"2023-12-19T05:50:37.546958+0000","last_active":"2023-12-19T05:50:38.030035+0000","last_peered":"2023-12-19T05:50:38.030035+0000","last_clean":"2023-12-19T05:50:38.030035+0000","last_became_active":"2023-12-19T05:50:37.546564+0000","last_became_peered":"2023-12-19T05:50:37.546564+0000","last_unstale":"2023-12-19T05:50:38.030035+0000","last_undegraded":"2023-12-19T05:50:38.030035+0000","last_fullsized":"2023-12-19T05:50:38.030035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:13:59.986600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.062069+0000","last_change":"2023-12-19T05:50:38.060332+0000","last_active":"2023-12-19T05:50:38.062069+0000","last_peered":"2023-12-19T05:50:38.062069+0000","last_clean":"2023-12-19T05:50:38.062069+0000","last_became_active":"2023-12-19T05:50:38.057819+0000","last_became_peered":"2023-12-19T05:50:38.057819+0000","last_unstale":"2023-12-19T05:50:38.062069+0000","last_undegraded":"2023-12-19T05:50:38.062069+0000","last_fullsized":"2023-12-19T05:50:38.062069+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:59:34.028353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.031035+0000","last_change":"2023-12-19T05:50:37.547184+0000","last_active":"2023-12-19T05:50:38.031035+0000","last_peered":"2023-12-19T05:50:38.031035+0000","last_clean":"2023-12-19T05:50:38.031035+0000","last_became_active":"2023-12-19T05:50:37.546189+0000","last_became_peered":"2023-12-19T05:50:37.546189+0000","last_unstale":"2023-12-19T05:50:38.031035+0000","last_undegraded":"2023-12-19T05:50:38.031035+0000","last_fullsized":"2023-12-19T05:50:38.031035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:39:26.817203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.046866+0000","last_change":"2023-12-19T05:50:38.046759+0000","last_active":"2023-12-19T05:50:38.046866+0000","last_peered":"2023-12-19T05:50:38.046866+0000","last_clean":"2023-12-19T05:50:38.046866+0000","last_became_active":"2023-12-19T05:50:38.044877+0000","last_became_peered":"2023-12-19T05:50:38.044877+0000","last_unstale":"2023-12-19T05:50:38.046866+0000","last_undegraded":"2023-12-19T05:50:38.046866+0000","last_fullsized":"2023-12-19T05:50:38.046866+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:09:23.514472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038287+0000","last_change":"2023-12-19T05:50:37.544202+0000","last_active":"2023-12-19T05:50:38.038287+0000","last_peered":"2023-12-19T05:50:38.038287+0000","last_clean":"2023-12-19T05:50:38.038287+0000","last_became_active":"2023-12-19T05:50:37.543953+0000","last_became_peered":"2023-12-19T05:50:37.543953+0000","last_unstale":"2023-12-19T05:50:38.038287+0000","last_undegraded":"2023-12-19T05:50:38.038287+0000","last_fullsized":"2023-12-19T05:50:38.038287+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:28.150927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.052187+0000","last_change":"2023-12-19T05:50:38.051444+0000","last_active":"2023-12-19T05:50:38.052187+0000","last_peered":"2023-12-19T05:50:38.052187+0000","last_clean":"2023-12-19T05:50:38.052187+0000","last_became_active":"2023-12-19T05:50:38.050982+0000","last_became_peered":"2023-12-19T05:50:38.050982+0000","last_unstale":"2023-12-19T05:50:38.052187+0000","last_undegraded":"2023-12-19T05:50:38.052187+0000","last_fullsized":"2023-12-19T05:50:38.052187+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:40:04.661807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.027887+0000","last_change":"2023-12-19T05:50:37.535431+0000","last_active":"2023-12-19T05:50:38.027887+0000","last_peered":"2023-12-19T05:50:38.027887+0000","last_clean":"2023-12-19T05:50:38.027887+0000","last_became_active":"2023-12-19T05:50:37.535085+0000","last_became_peered":"2023-12-19T05:50:37.535085+0000","last_unstale":"2023-12-19T05:50:38.027887+0000","last_undegraded":"2023-12-19T05:50:38.027887+0000","last_fullsized":"2023-12-19T05:50:38.027887+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:33:05.835741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.057310+0000","last_change":"2023-12-19T05:50:38.056410+0000","last_active":"2023-12-19T05:50:38.057310+0000","last_peered":"2023-12-19T05:50:38.057310+0000","last_clean":"2023-12-19T05:50:38.057310+0000","last_became_active":"2023-12-19T05:50:38.052159+0000","last_became_peered":"2023-12-19T05:50:38.052159+0000","last_unstale":"2023-12-19T05:50:38.057310+0000","last_undegraded":"2023-12-19T05:50:38.057310+0000","last_fullsized":"2023-12-19T05:50:38.057310+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:49:45.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038856+0000","last_change":"2023-12-19T05:50:37.544989+0000","last_active":"2023-12-19T05:50:38.038856+0000","last_peered":"2023-12-19T05:50:38.038856+0000","last_clean":"2023-12-19T05:50:38.038856+0000","last_became_active":"2023-12-19T05:50:37.544752+0000","last_became_peered":"2023-12-19T05:50:37.544752+0000","last_unstale":"2023-12-19T05:50:38.038856+0000","last_undegraded":"2023-12-19T05:50:38.038856+0000","last_fullsized":"2023-12-19T05:50:38.038856+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:21.351114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.038187+0000","last_change":"2023-12-19T05:50:38.036943+0000","last_active":"2023-12-19T05:50:38.038187+0000","last_peered":"2023-12-19T05:50:38.038187+0000","last_clean":"2023-12-19T05:50:38.038187+0000","last_became_active":"2023-12-19T05:50:38.036706+0000","last_became_peered":"2023-12-19T05:50:38.036706+0000","last_unstale":"2023-12-19T05:50:38.038187+0000","last_undegraded":"2023-12-19T05:50:38.038187+0000","last_fullsized":"2023-12-19T05:50:38.038187+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:41:35.485359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.051348+0000","last_change":"2023-12-19T05:50:37.541914+0000","last_active":"2023-12-19T05:50:38.051348+0000","last_peered":"2023-12-19T05:50:38.051348+0000","last_clean":"2023-12-19T05:50:38.051348+0000","last_became_active":"2023-12-19T05:50:37.541527+0000","last_became_peered":"2023-12-19T05:50:37.541527+0000","last_unstale":"2023-12-19T05:50:38.051348+0000","last_undegraded":"2023-12-19T05:50:38.051348+0000","last_fullsized":"2023-12-19T05:50:38.051348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:02:39.655838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.037346+0000","last_change":"2023-12-19T05:50:38.037066+0000","last_active":"2023-12-19T05:50:38.037346+0000","last_peered":"2023-12-19T05:50:38.037346+0000","last_clean":"2023-12-19T05:50:38.037346+0000","last_became_active":"2023-12-19T05:50:38.036392+0000","last_became_peered":"2023-12-19T05:50:38.036392+0000","last_unstale":"2023-12-19T05:50:38.037346+0000","last_undegraded":"2023-12-19T05:50:38.037346+0000","last_fullsized":"2023-12-19T05:50:38.037346+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:37.507868+0000","last_clean_scrub_stamp":"2023-12-19T05:50:37.507868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:12:02.596649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"175'3","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.055695+0000","last_change":"2023-12-19T05:50:37.546430+0000","last_active":"2023-12-19T05:50:38.055695+0000","last_peered":"2023-12-19T05:50:38.055695+0000","last_clean":"2023-12-19T05:50:38.055695+0000","last_became_active":"2023-12-19T05:50:37.546100+0000","last_became_peered":"2023-12-19T05:50:37.546100+0000","last_unstale":"2023-12-19T05:50:38.055695+0000","last_undegraded":"2023-12-19T05:50:38.055695+0000","last_fullsized":"2023-12-19T05:50:38.055695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:50:36.502099+0000","last_clean_scrub_stamp":"2023-12-19T05:50:36.502099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:52.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":308,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-12-19T05:50:38.034869+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:50:38.034869+0000","last_peered":"2023-12-19T05:50:38.034869+0000","last_clean":"2023-12-19T05:50:38.034869+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:50:38.034869+0000","last_undegraded":"2023-12-19T05:50:38.034869+0000","last_fullsized":"2023-12-19T05:50:38.034869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.125,"15min":1.085},"min":{"1min":0.80600000000000005,"5min":0.64400000000000002,"15min":0.56699999999999995},"max":{"1min":1.585,"5min":6.4429999999999996,"15min":6.4429999999999996},"last":1.204},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0820000000000001,"15min":1.087},"min":{"1min":0.79300000000000004,"5min":0.73099999999999998,"15min":0.63300000000000001},"max":{"1min":1.611,"5min":1.768,"15min":3.976},"last":1.0269999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2,"15min":1.135},"min":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.60999999999999999},"max":{"1min":1.601,"5min":6.399,"15min":6.399},"last":1.373},{"interface":"front","average":{"1min":1.171,"5min":1.2010000000000001,"15min":1.1759999999999999},"min":{"1min":0.91400000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3700000000000001,"5min":3.1720000000000002,"15min":4.25},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.206,"15min":1.2210000000000001},"min":{"1min":0.90100000000000002,"5min":0.65500000000000003,"15min":0.63800000000000001},"max":{"1min":1.468,"5min":1.738,"15min":3.0249999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1279999999999999,"15min":1.113},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.64500000000000002},"max":{"1min":1.468,"5min":1.895,"15min":2.8250000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3520000000000001,"15min":1.248},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.622},"max":{"1min":1.575,"5min":6.5259999999999998,"15min":6.5259999999999998},"last":1.145},{"interface":"front","average":{"1min":1.375,"5min":1.389,"15min":1.357},"min":{"1min":1.0669999999999999,"5min":0.94799999999999995,"15min":0.83299999999999996},"max":{"1min":1.7589999999999999,"5min":2.327,"15min":4.1529999999999996},"last":1.4039999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1910000000000001,"15min":1.1180000000000001},"min":{"1min":0.80400000000000005,"5min":0.64000000000000001,"15min":0.50800000000000001},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":2.9980000000000002},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.345,"15min":1.2889999999999999},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.48599999999999999},"max":{"1min":1.5529999999999999,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":1.425}]},{"osd":5,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3600000000000001,"15min":1.3380000000000001},"min":{"1min":0.91100000000000003,"5min":0.75900000000000001,"15min":0.51400000000000001},"max":{"1min":1.7,"5min":2.1480000000000001,"15min":6.3099999999999996},"last":1.329},{"interface":"front","average":{"1min":1.282,"5min":1.3340000000000001,"15min":1.284},"min":{"1min":0.93000000000000005,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.6240000000000001,"5min":2.0550000000000002,"15min":3.1909999999999998},"last":1.089}]},{"osd":6,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.484,"15min":1.4119999999999999},"min":{"1min":1.194,"5min":0.77500000000000002,"15min":0.68600000000000005},"max":{"1min":1.776,"5min":2.121,"15min":3.0920000000000001},"last":1.254},{"interface":"front","average":{"1min":1.458,"5min":1.532,"15min":1.4610000000000001},"min":{"1min":0.996,"5min":0.93999999999999995,"15min":0.59999999999999998},"max":{"1min":1.6859999999999999,"5min":6.3369999999999997,"15min":7.7519999999999998},"last":1.292}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.05,"15min":1.1299999999999999},"min":{"1min":0.86099999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":4.7000000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0529999999999999},"min":{"1min":0.72599999999999998,"5min":0.621,"15min":0.46500000000000002},"max":{"1min":1.401,"5min":1.548,"15min":1.635},"last":1.0329999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.181},"min":{"1min":0.92600000000000005,"5min":0.66900000000000004,"15min":0.64900000000000002},"max":{"1min":1.4630000000000001,"5min":1.704,"15min":1.792},"last":1.323},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2729999999999999,"15min":1.28},"min":{"1min":1.151,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.498,"5min":1.9279999999999999,"15min":3.4670000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.159,"15min":1.171},"min":{"1min":0.92000000000000004,"5min":0.72899999999999998,"15min":0.71599999999999997},"max":{"1min":1.46,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2290000000000001,"15min":1.2569999999999999},"min":{"1min":0.873,"5min":0.74399999999999999,"15min":0.67700000000000005},"max":{"1min":1.5740000000000001,"5min":1.879,"15min":3.5859999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1599999999999999,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.329,"5min":1.8220000000000001,"15min":4.5220000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2509999999999999,"15min":1.3100000000000001},"min":{"1min":0.95799999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5580000000000001,"5min":1.885,"15min":4.452},"last":1.1160000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.266},"min":{"1min":0.82299999999999995,"5min":0.54900000000000004,"15min":0.48899999999999999},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":2.7130000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2250000000000001,"15min":1.3220000000000001},"min":{"1min":0.83399999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4730000000000001,"5min":1.7729999999999999,"15min":4.6689999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3160000000000001,"15min":1.4430000000000001},"min":{"1min":0.86299999999999999,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":1.504,"5min":2.2759999999999998,"15min":4.5670000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.46,"15min":1.5800000000000001},"min":{"1min":0.93400000000000005,"5min":0.65200000000000002,"15min":0.63400000000000001},"max":{"1min":1.732,"5min":2.2069999999999999,"15min":3.681},"last":1.29}]},{"osd":7,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4119999999999999,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9359999999999999,"5min":1.96,"15min":3.2719999999999998},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5269999999999999,"15min":1.569},"min":{"1min":1.1539999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8460000000000001,"5min":2.8570000000000002,"15min":4.7480000000000002},"last":1.4390000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.081,"15min":1.115},"min":{"1min":0.77100000000000002,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.8759999999999999,"5min":2.9620000000000002,"15min":6.9420000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1180000000000001,"15min":1.115},"min":{"1min":0.81799999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.464,"5min":2.1219999999999999,"15min":2.641},"last":1.3999999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.21,"15min":1.226},"min":{"1min":0.82599999999999996,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.635,"5min":2.2050000000000001,"15min":3.9540000000000002},"last":1.288},{"interface":"front","average":{"1min":1.329,"5min":1.26,"15min":1.3320000000000001},"min":{"1min":1.111,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.8320000000000001,"5min":2.2890000000000001,"15min":6.8700000000000001},"last":1.4430000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.161,"15min":1.2010000000000001},"min":{"1min":0.86599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4990000000000001,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.319,"5min":1.2150000000000001,"15min":1.2110000000000001},"min":{"1min":1.123,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6080000000000001,"5min":2.6360000000000001,"15min":2.8250000000000002},"last":1.0800000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2350000000000001,"15min":1.359},"min":{"1min":0.93600000000000005,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":2.774,"15min":6.9969999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2929999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.56299999999999994},"max":{"1min":1.6120000000000001,"5min":2.992,"15min":2.992},"last":1.145}]},{"osd":4,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2629999999999999,"15min":1.359},"min":{"1min":1.0620000000000001,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5549999999999999,"5min":3.2040000000000002,"15min":6.3559999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3080000000000001,"15min":1.4490000000000001},"min":{"1min":0.89400000000000002,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.782,"5min":3.0499999999999998,"15min":7.0469999999999997},"last":1.2390000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3280000000000001,"15min":1.4199999999999999},"min":{"1min":0.91200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.671,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.036},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4119999999999999,"15min":1.5169999999999999},"min":{"1min":1.03,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.7410000000000001,"5min":3.0710000000000002,"15min":6.3579999999999997},"last":1.1779999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.48,"15min":1.599},"min":{"1min":1.042,"5min":0.70299999999999996,"15min":0.68200000000000005},"max":{"1min":1.9179999999999999,"5min":3.2639999999999998,"15min":7.0949999999999998},"last":1.516},{"interface":"front","average":{"1min":1.476,"5min":1.5209999999999999,"15min":1.5720000000000001},"min":{"1min":1.155,"5min":0.80100000000000005,"15min":0.53200000000000003},"max":{"1min":1.7210000000000001,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.3149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":969,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194343,"statfs":{"total":200000000,"available":199007690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.095,"15min":1.0469999999999999},"min":{"1min":0.83799999999999997,"5min":0.58599999999999997,"15min":0.40400000000000003},"max":{"1min":1.508,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.573},{"interface":"front","average":{"1min":1.149,"5min":1.163,"15min":1.1020000000000001},"min":{"1min":0.79500000000000004,"5min":0.66700000000000004,"15min":0.61899999999999999},"max":{"1min":1.5089999999999999,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.998}]},{"osd":1,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1279999999999999,"15min":1.089},"min":{"1min":0.82099999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.484,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.228},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.268,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":1.508,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.4470000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2270000000000001,"15min":1.206},"min":{"1min":0.98899999999999999,"5min":0.748,"15min":0.66100000000000003},"max":{"1min":1.5740000000000001,"5min":1.7609999999999999,"15min":1.8380000000000001},"last":1.407},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.323,"15min":1.258},"min":{"1min":0.996,"5min":0.77300000000000002,"15min":0.45600000000000002},"max":{"1min":1.76,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.048}]},{"osd":3,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.256,"15min":1.1579999999999999},"min":{"1min":1.026,"5min":0.66200000000000003,"15min":0.57599999999999996},"max":{"1min":1.631,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.323,"15min":1.3049999999999999},"min":{"1min":1.1539999999999999,"5min":0.82499999999999996,"15min":0.76500000000000001},"max":{"1min":1.7170000000000001,"5min":1.8400000000000001,"15min":1.8819999999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.383,"15min":1.3580000000000001},"min":{"1min":1.052,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6899999999999999,"5min":2.081,"15min":2.081},"last":1.712},{"interface":"front","average":{"1min":1.502,"5min":1.425,"15min":1.353},"min":{"1min":1.1779999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":0.88}]},{"osd":6,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.97899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6639999999999999,"5min":2.161,"15min":2.161},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4630000000000001,"15min":1.4259999999999999},"min":{"1min":1.1339999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.8100000000000001,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.655}]},{"osd":7,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4670000000000001,"15min":1.409},"min":{"1min":1.238,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.891,"5min":5.484,"15min":5.484},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.4990000000000001,"15min":1.482},"min":{"1min":0.96099999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.98,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.617}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009242,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.93100000000000005,"15min":0.86599999999999999},"min":{"1min":0.754,"5min":0.39000000000000001,"15min":0.314},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.99},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.96799999999999997,"15min":0.88300000000000001},"min":{"1min":0.72399999999999998,"5min":0.502,"15min":0.34999999999999998},"max":{"1min":1.4299999999999999,"5min":1.5589999999999999,"15min":1.72},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.96799999999999997,"15min":0.92400000000000004},"min":{"1min":0.77700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":2.702},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.145,"5min":1.1160000000000001,"15min":1.0229999999999999},"min":{"1min":0.91700000000000004,"5min":0.47699999999999998,"15min":0.39100000000000001},"max":{"1min":1.605,"5min":1.651,"15min":2.3650000000000002},"last":1.2070000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.1679999999999999,"15min":1.036},"min":{"1min":0.90600000000000003,"5min":0.47299999999999998,"15min":0.45200000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.2789999999999999,"15min":1.1699999999999999},"min":{"1min":1.226,"5min":0.58599999999999997,"15min":0.45600000000000002},"max":{"1min":1.544,"5min":1.8700000000000001,"15min":2.931},"last":1.3759999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2170000000000001,"15min":1.179},"min":{"1min":0.998,"5min":0.58199999999999996,"15min":0.51400000000000001},"max":{"1min":1.8999999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.556},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3260000000000001,"15min":1.306},"min":{"1min":1.129,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7270000000000001,"5min":2.1560000000000001,"15min":2.5859999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.389,"15min":1.3560000000000001},"min":{"1min":1.177,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.861,"5min":2.391,"15min":4.8440000000000003},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.423,"15min":1.3839999999999999},"min":{"1min":1.1839999999999999,"5min":0.85399999999999998,"15min":0.46500000000000002},"max":{"1min":1.962,"5min":2.5449999999999999,"15min":4.4509999999999996},"last":1.6160000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.4610000000000001,"15min":1.407},"min":{"1min":1.2370000000000001,"5min":0.73599999999999999,"15min":0.71499999999999997},"max":{"1min":1.792,"5min":2.427,"15min":3.4300000000000002},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.365,"15min":1.3400000000000001},"min":{"1min":1.1160000000000001,"5min":0.74199999999999999,"15min":0.69199999999999995},"max":{"1min":1.7350000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.6879999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.4430000000000001,"15min":1.409},"min":{"1min":1.222,"5min":0.79300000000000004,"15min":0.55800000000000005},"max":{"1min":2.0339999999999998,"5min":2.093,"15min":2.1509999999999998},"last":1.843},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.502,"15min":1.4470000000000001},"min":{"1min":1.3100000000000001,"5min":0.81899999999999995,"15min":0.70099999999999996},"max":{"1min":1.8999999999999999,"5min":2.5099999999999998,"15min":2.8900000000000001},"last":1.661}]}]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":966,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89200000000000002,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":1.673,"5min":3.407,"15min":3.407},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.95499999999999996,"15min":0.93799999999999994},"min":{"1min":0.69399999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6699999999999999,"5min":1.8660000000000001,"15min":1.9450000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.157,"15min":1.091},"min":{"1min":0.77500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.7150000000000001,"5min":3.476,"15min":3.476},"last":1.49},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.98199999999999998,"5min":0.60699999999999998,"15min":0.60399999999999998},"max":{"1min":1.768,"5min":1.927,"15min":1.927},"last":1.679}]},{"osd":3,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.008,"15min":0.96399999999999997},"min":{"1min":0.85899999999999999,"5min":0.52000000000000002,"15min":0.34599999999999997},"max":{"1min":1.635,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.258,"15min":1.159},"min":{"1min":0.97099999999999997,"5min":0.626,"15min":0.48199999999999998},"max":{"1min":1.71,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.3160000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.413,"15min":1.329},"min":{"1min":1.159,"5min":0.82399999999999995,"15min":0.52700000000000002},"max":{"1min":1.6060000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.28},"min":{"1min":1.056,"5min":0.88100000000000001,"15min":0.65100000000000002},"max":{"1min":1.8420000000000001,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.389}]},{"osd":5,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.369,"15min":1.3320000000000001},"min":{"1min":1.1719999999999999,"5min":0.80700000000000005,"15min":0.70299999999999996},"max":{"1min":1.746,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.548},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3700000000000001,"15min":1.323},"min":{"1min":1.1779999999999999,"5min":0.81100000000000005,"15min":0.72699999999999998},"max":{"1min":1.804,"5min":2.2170000000000001,"15min":2.5960000000000001},"last":1.2729999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.3500000000000001,"15min":1.321},"min":{"1min":1.141,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.8999999999999999,"15min":2.0950000000000002},"last":1.089},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.54,"15min":1.417},"min":{"1min":1.103,"5min":1.008,"15min":0.58599999999999997},"max":{"1min":2.0760000000000001,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.7450000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5109999999999999,"15min":1.4610000000000001},"min":{"1min":1.3089999999999999,"5min":0.86099999999999999,"15min":0.84799999999999998},"max":{"1min":1.9059999999999999,"5min":2.3159999999999998,"15min":2.4350000000000001},"last":1.784},{"interface":"front","average":{"1min":1.591,"5min":1.5649999999999999,"15min":1.4690000000000001},"min":{"1min":1.3360000000000001,"5min":0.81299999999999994,"15min":0.71499999999999997},"max":{"1min":1.887,"5min":9.5359999999999996,"15min":9.5359999999999996},"last":1.1970000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193768,"statfs":{"total":200000000,"available":198419420,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88300000000000001,"15min":0.91100000000000003},"min":{"1min":0.68200000000000005,"5min":0.33700000000000002,"15min":0.33100000000000002},"max":{"1min":1.383,"5min":1.4650000000000001,"15min":2.992},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":1.012},"min":{"1min":0.68799999999999994,"5min":0.496,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":3.5169999999999999},"last":1.026}]},{"osd":2,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.61099999999999999,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":1.575,"5min":1.5920000000000001,"15min":2.2789999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.157,"5min":1.1080000000000001,"15min":1.3500000000000001},"min":{"1min":0.82299999999999995,"5min":0.52300000000000002,"15min":0.40999999999999998},"max":{"1min":1.6299999999999999,"5min":1.879,"15min":70.206000000000003},"last":1.246}]},{"osd":3,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.329,"15min":1.335},"min":{"1min":1.2649999999999999,"5min":0.53200000000000003,"15min":0.46100000000000002},"max":{"1min":1.726,"5min":2.1429999999999998,"15min":3.5670000000000002},"last":1.361},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2030000000000001,"15min":1.234},"min":{"1min":0.90900000000000003,"5min":0.56499999999999995,"15min":0.39400000000000002},"max":{"1min":1.748,"5min":1.827,"15min":3.1920000000000002},"last":1.49}]},{"osd":4,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.254,"15min":1.256},"min":{"1min":1.0529999999999999,"5min":0.78600000000000003,"15min":0.74399999999999999},"max":{"1min":1.6140000000000001,"5min":1.893,"15min":5.3860000000000001},"last":1.893},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3680000000000001,"15min":1.3899999999999999},"min":{"1min":0.99199999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7310000000000001,"5min":2.117,"15min":4.306},"last":1.8029999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.331,"15min":1.3640000000000001},"min":{"1min":1.083,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.917,"5min":1.968,"15min":4.9880000000000004},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3520000000000001,"15min":1.377},"min":{"1min":1.0449999999999999,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.696,"5min":2.2069999999999999,"15min":5.4569999999999999},"last":1.5680000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4330000000000001,"15min":1.4530000000000001},"min":{"1min":0.95999999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9039999999999999,"5min":2.0179999999999998,"15min":5.1429999999999998},"last":1.968},{"interface":"front","average":{"1min":1.528,"5min":1.468,"15min":1.454},"min":{"1min":1.2829999999999999,"5min":0.80000000000000004,"15min":0.70199999999999996},"max":{"1min":1.796,"5min":2.3170000000000002,"15min":3.75},"last":1.7789999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.5489999999999999,"15min":1.5589999999999999},"min":{"1min":1.248,"5min":0.83399999999999996,"15min":0.76600000000000001},"max":{"1min":1.8939999999999999,"5min":2.6829999999999998,"15min":8.4039999999999999},"last":1.698},{"interface":"front","average":{"1min":1.657,"5min":1.546,"15min":1.603},"min":{"1min":1.268,"5min":0.82199999999999995,"15min":0.77000000000000002},"max":{"1min":1.9850000000000001,"5min":2.1019999999999999,"15min":8.2390000000000008},"last":1.8560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009768,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1930000000000001,"5min":1.5209999999999999,"15min":1.6499999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.97099999999999997,"15min":0.92900000000000005},"min":{"1min":0.76200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.681,"5min":1.806,"15min":2.0459999999999998},"last":1.1739999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.115,"15min":1.081},"min":{"1min":0.80500000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5640000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.236},{"interface":"front","average":{"1min":1.335,"5min":1.2,"15min":1.1679999999999999},"min":{"1min":1.089,"5min":0.51900000000000002,"15min":0.42699999999999999},"max":{"1min":1.7070000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.466}]},{"osd":3,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.95099999999999996,"15min":0.91200000000000003},"min":{"1min":0.64900000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4179999999999999,"5min":1.55,"15min":1.55},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.1659999999999999,"15min":1.107},"min":{"1min":0.98299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6919999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.556}]},{"osd":4,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.244,"15min":1.196},"min":{"1min":0.96199999999999997,"5min":0.75700000000000001,"15min":0.59499999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.845},"last":1.5},{"interface":"front","average":{"1min":1.508,"5min":1.377,"15min":1.3109999999999999},"min":{"1min":1.194,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.7849999999999999,"5min":2.149,"15min":2.149},"last":1.6739999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.3839999999999999,"15min":1.347},"min":{"1min":1.046,"5min":0.65700000000000003,"15min":0.63300000000000001},"max":{"1min":1.8720000000000001,"5min":1.885,"15min":2.173},"last":1.351},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3759999999999999,"15min":1.3260000000000001},"min":{"1min":1.2110000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.649,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.5920000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.4530000000000001,"15min":1.4139999999999999},"min":{"1min":1.3009999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.891,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.748},{"interface":"front","average":{"1min":1.419,"5min":1.379,"15min":1.3280000000000001},"min":{"1min":1.1120000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":2.016,"15min":2.2909999999999999},"last":1.77}]},{"osd":7,"last update":"Tue Dec 19 05:50:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.514,"15min":1.4590000000000001},"min":{"1min":1.28,"5min":0.89100000000000001,"15min":0.71899999999999997},"max":{"1min":1.8080000000000001,"5min":2.056,"15min":2.4060000000000001},"last":1.883},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4079999999999999,"15min":1.3939999999999999},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8899999999999999,"5min":2.177,"15min":2.2410000000000001},"last":1.7250000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:50:44.053 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:50:44.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:50:44.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.301+0000 7ff5b21f9640 1 Processor -- start 2023-12-19T05:50:44.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.302+0000 7ff5b21f9640 1 -- start start 2023-12-19T05:50:44.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b21f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 0x7ff5ac0b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b21f9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5ac0b7a70 0x7ff5ac166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b21f9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac070cf0 con 0x7ff5ac06fb70 2023-12-19T05:50:44.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b21f9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b3200 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b21f9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac147140 con 0x7ff5ac146d60 2023-12-19T05:50:44.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b11f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 0x7ff5ac0b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b09f6640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff5ac06fb70 0x7ff5ac0b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:43900/0 (socket says 172.21.15.49:43900) 2023-12-19T05:50:44.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.304+0000 7ff5b09f6640 1 -- 172.21.15.49:0/4025026162 learned_addr learned my addr 172.21.15.49:0/4025026162 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:44.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/4025026162 >> v2:172.21.15.115:3300/0 conn(0x7ff5ac0b7a70 0x7ff5ac166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5a3fff640 1 -- 172.21.15.49:0/4025026162 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297310542 0 0) 0x7ff5ac070cf0 con 0x7ff5ac06fb70 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5a3fff640 1 -- 172.21.15.49:0/4025026162 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff598003520 con 0x7ff5ac06fb70 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b19f8640 1 -- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 msgr2=0x7ff5ac0b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 0x7ff5ac0b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b19f8640 1 -- 172.21.15.49:0/4025026162 >> v1:172.21.15.115:6789/0 conn(0x7ff5ac06fb70 legacy=0x7ff5ac0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b19f8640 1 -- 172.21.15.49:0/4025026162 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0b1470 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.305+0000 7ff5b11f7640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 0x7ff5ac0b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:50:44.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.307+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac0b7a70 0x7ff5ac166fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9211a1b53f0177a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.307+0000 7ff5a3fff640 1 -- 172.21.15.49:0/4025026162 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a402cce0 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.307+0000 7ff5a3fff640 1 -- 172.21.15.49:0/4025026162 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a402ce40 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.307+0000 7ff5a3fff640 1 -- 172.21.15.49:0/4025026162 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4034660 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 -- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac0b7a70 msgr2=0x7ff5ac166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac0b7a70 0x7ff5ac166fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a402bf30 comp rx=0 tx=0).stop 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 -- 172.21.15.49:0/4025026162 shutdown_connections 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac0b7a70 0x7ff5ac166fb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/4025026162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac146d60 0x7ff5ac0b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 -- 172.21.15.49:0/4025026162 >> 172.21.15.49:0/4025026162 conn(0x7ff5ac0b2390 msgr2=0x7ff5ac0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.308+0000 7ff5b21f9640 1 -- 172.21.15.49:0/4025026162 shutdown_connections 2023-12-19T05:50:44.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.309+0000 7ff5b21f9640 1 -- 172.21.15.49:0/4025026162 wait complete. 2023-12-19T05:50:44.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.311+0000 7ff5b21f9640 1 Processor -- start 2023-12-19T05:50:44.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.311+0000 7ff5b21f9640 1 -- start start 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac06fb70 0x7ff5ac137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 0x7ff5ac09e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0a0000 con 0x7ff5ac146d60 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac09f3f0 con 0x7ff5ac06fb70 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b21f9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac09f6d0 con 0x7ff5ac0b7a70 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b19f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b19f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42536/0 (socket says 172.21.15.49:42536) 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b19f8640 1 -- 172.21.15.49:0/1009827050 learned_addr learned my addr 172.21.15.49:0/1009827050 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b11f7640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac06fb70 0x7ff5ac137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.313+0000 7ff5b09f6640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 0x7ff5ac09e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 -- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 msgr2=0x7ff5ac09e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 0x7ff5ac09e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 -- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac06fb70 msgr2=0x7ff5ac137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac06fb70 0x7ff5ac137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 -- 172.21.15.49:0/1009827050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80093a0 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b09f6640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 0x7ff5ac09e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5b19f8640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a403d600 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a403d780 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.314+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a403db30 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.315+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.315+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac09fc90 con 0x7ff5ac146d60 2023-12-19T05:50:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.316+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac0a01b0 con 0x7ff5ac146d60 2023-12-19T05:50:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.317+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5a403b040 con 0x7ff5ac146d60 2023-12-19T05:50:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.318+0000 7ff5a1ffb640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 0x7ff59006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.318+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5a40aa9c0 con 0x7ff5ac146d60 2023-12-19T05:50:44.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.319+0000 7ff5b11f7640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 0x7ff59006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.320+0000 7ff5b11f7640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 0x7ff59006c920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009c50 tx=0x7ff5a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.322+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5ac0a01b0 con 0x7ff5ac146d60 2023-12-19T05:50:44.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.597+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff5ac061910 con 0x7ff5ac146d60 2023-12-19T05:50:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.606+0000 7ff5a1ffb640 1 -- 172.21.15.49:0/1009827050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff5a4076040 con 0x7ff5ac146d60 2023-12-19T05:50:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:50:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 msgr2=0x7ff59006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 0x7ff59006c920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009c50 tx=0x7ff5a8008040 comp rx=0 tx=0).stop 2023-12-19T05:50:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 msgr2=0x7ff5ac09eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a4004a40 comp rx=0 tx=0).stop 2023-12-19T05:50:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 shutdown_connections 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff59006a460 0x7ff59006c920 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.609+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5ac0b7a70 0x7ff5ac09e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.610+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ac146d60 0x7ff5ac09eb70 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.610+0000 7ff5b21f9640 1 --2- 172.21.15.49:0/1009827050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5ac06fb70 0x7ff5ac137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.610+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 >> 172.21.15.49:0/1009827050 conn(0x7ff5ac0b2390 msgr2=0x7ff5ac15fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.610+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 shutdown_connections 2023-12-19T05:50:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.610+0000 7ff5b21f9640 1 -- 172.21.15.49:0/1009827050 wait complete. 2023-12-19T05:50:44.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:44.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.866+0000 7fa3f2b7e640 1 Processor -- start 2023-12-19T05:50:44.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.866+0000 7fa3f2b7e640 1 -- start start 2023-12-19T05:50:44.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f2b7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3ec0b8070 0x7fa3ec0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f2b7e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3ec0d0a90 0x7fa3ec15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f2b7e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0d12d0 con 0x7fa3ec146e30 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f2b7e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec147210 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f2b7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0d2370 con 0x7fa3ec0b8070 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f237d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3ec0d0a90 0x7fa3ec15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f237d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3ec0d0a90 0x7fa3ec15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42540/0 (socket says 172.21.15.49:42540) 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.868+0000 7fa3f237d640 1 -- 172.21.15.49:0/384672382 learned_addr learned my addr 172.21.15.49:0/384672382 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.869+0000 7fa3f137b640 1 --2- 172.21.15.49:0/384672382 >> v2:172.21.15.115:3300/0 conn(0x7fa3ec0b8070 0x7fa3ec0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.869+0000 7fa3f237d640 1 -- 172.21.15.49:0/384672382 >> v2:172.21.15.115:3300/0 conn(0x7fa3ec0b8070 msgr2=0x7fa3ec0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.869+0000 7fa3f237d640 1 --2- 172.21.15.49:0/384672382 >> v2:172.21.15.115:3300/0 conn(0x7fa3ec0b8070 0x7fa3ec0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.869+0000 7fa3f237d640 1 -- 172.21.15.49:0/384672382 >> v1:172.21.15.115:6789/0 conn(0x7fa3ec146e30 legacy=0x7fa3ec0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:44.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.869+0000 7fa3f237d640 1 -- 172.21.15.49:0/384672382 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0d15b0 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.870+0000 7fa3f237d640 1 --2- 172.21.15.49:0/384672382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0d0a90 0x7fa3ec15d870 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0b6450 tx=0x7fa3e402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38473d7fb9110407 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.870+0000 7fa3f0b7a640 1 -- 172.21.15.49:0/384672382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e402c9f0 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f0b7a640 1 -- 172.21.15.49:0/384672382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e402cb50 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f0b7a640 1 -- 172.21.15.49:0/384672382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40343f0 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/384672382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0d0a90 msgr2=0x7fa3ec15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/384672382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0d0a90 0x7fa3ec15d870 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0b6450 tx=0x7fa3e402be50 comp rx=0 tx=0).stop 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/384672382 shutdown_connections 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/384672382 >> v2:172.21.15.115:3300/0 conn(0x7fa3ec0b8070 0x7fa3ec0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/384672382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0d0a90 0x7fa3ec15d870 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/384672382 >> 172.21.15.49:0/384672382 conn(0x7fa3ec0b2990 msgr2=0x7fa3ec0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:44.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/384672382 shutdown_connections 2023-12-19T05:50:44.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.871+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/384672382 wait complete. 2023-12-19T05:50:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.873+0000 7fa3f2b7e640 1 Processor -- start 2023-12-19T05:50:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.873+0000 7fa3f2b7e640 1 -- start start 2023-12-19T05:50:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ec0d0a90 0x7fa3ec13c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec146e30 0x7fa3ec1e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec13be80 con 0x7fa3ec0b8070 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec13b550 con 0x7fa3ec146e30 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.874+0000 7fa3f2b7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec13b830 con 0x7fa3ec0d0a90 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42548/0 (socket says 172.21.15.49:42548) 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 -- 172.21.15.49:0/3499174830 learned_addr learned my addr 172.21.15.49:0/3499174830 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 -- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ec0d0a90 msgr2=0x7fa3ec13c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ec0d0a90 0x7fa3ec13c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 -- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec146e30 msgr2=0x7fa3ec1e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec146e30 0x7fa3ec1e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 -- 172.21.15.49:0/3499174830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009b30 con 0x7fa3ec0b8070 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.875+0000 7fa3f1b7c640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800b3f0 tx=0x7fa3e800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.876+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8011830 con 0x7fa3ec0b8070 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.876+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8011990 con 0x7fa3ec0b8070 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.876+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8011d40 con 0x7fa3ec0b8070 2023-12-19T05:50:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.876+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec13bb10 con 0x7fa3ec0b8070 2023-12-19T05:50:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.876+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec13c850 con 0x7fa3ec0b8070 2023-12-19T05:50:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.877+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec061910 con 0x7fa3ec0b8070 2023-12-19T05:50:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.878+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3e801a400 con 0x7fa3ec0b8070 2023-12-19T05:50:44.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.879+0000 7fa3e27fc640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 0x7fa3d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:44.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.879+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e8088750 con 0x7fa3ec0b8070 2023-12-19T05:50:44.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.880+0000 7fa3f137b640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 0x7fa3d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:44.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.881+0000 7fa3f137b640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 0x7fa3d006c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:44.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:44.883+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3e8053d30 con 0x7fa3ec0b8070 2023-12-19T05:50:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.112+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3ec0b7bf0 con 0x7fa3ec0b8070 2023-12-19T05:50:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.113+0000 7fa3e27fc640 1 -- 172.21.15.49:0/3499174830 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fa3e8057350 con 0x7fa3ec0b8070 2023-12-19T05:50:45.115 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:45.115 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:50:45.116 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 msgr2=0x7fa3d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 0x7fa3d006c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc008040 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 msgr2=0x7fa3ec1f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800b3f0 tx=0x7fa3e800b8b0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 shutdown_connections 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa3d006a430 0x7fa3d006c8f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ec0d0a90 0x7fa3ec13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec146e30 0x7fa3ec1e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 --2- 172.21.15.49:0/3499174830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3ec0b8070 0x7fa3ec1f2600 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 >> 172.21.15.49:0/3499174830 conn(0x7fa3ec0b2990 msgr2=0x7fa3ec0b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 shutdown_connections 2023-12-19T05:50:45.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.116+0000 7fa3f2b7e640 1 -- 172.21.15.49:0/3499174830 wait complete. 2023-12-19T05:50:45.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:50:38.019724+0000', 'modified': '2023-12-19T05:50:41.435501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8490': {'gid': 8490, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2314443722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 2314443722}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2314443722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:50:45.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:50:45.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:50:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.784+0000 7f191d538640 1 Processor -- start 2023-12-19T05:50:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.784+0000 7f191d538640 1 -- start start 2023-12-19T05:50:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.786+0000 7f191d538640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1918141a70 0x7f191806df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.786+0000 7f191d538640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 0x7f19180b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.786+0000 7f191d538640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180ceab0 con 0x7f19180b1aa0 2023-12-19T05:50:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.786+0000 7f191d538640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191815fe00 con 0x7f1918141a70 2023-12-19T05:50:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.786+0000 7f191d538640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19180b1f30 con 0x7f191806e4a0 2023-12-19T05:50:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.787+0000 7f190ffff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 0x7f19180b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.787+0000 7f1916ffd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1918141a70 0x7f191806df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.787+0000 7f19177fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f19180b1aa0 0x7f19180aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:43928/0 (socket says 172.21.15.49:43928) 2023-12-19T05:50:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.787+0000 7f19177fe640 1 -- 172.21.15.49:0/3542954531 learned_addr learned my addr 172.21.15.49:0/3542954531 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.787+0000 7f19167fc640 1 -- 172.21.15.49:0/3542954531 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015164433 0 0) 0x7f19180ceab0 con 0x7f19180b1aa0 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f19167fc640 1 -- 172.21.15.49:0/3542954531 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1904003520 con 0x7f19180b1aa0 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f1916ffd640 1 -- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 msgr2=0x7f19180b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f1916ffd640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 0x7f19180b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f1916ffd640 1 -- 172.21.15.49:0/3542954531 >> v1:172.21.15.115:6789/0 conn(0x7f19180b1aa0 legacy=0x7f19180aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f1916ffd640 1 -- 172.21.15.49:0/3542954531 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918141e50 con 0x7f1918141a70 2023-12-19T05:50:45.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.788+0000 7f190ffff640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 0x7f19180b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:50:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.789+0000 7f1916ffd640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f191806df60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f19080097a0 tx=0x7f190802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fdee55365f1c0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f19167fc640 1 -- 172.21.15.49:0/3542954531 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190802d040 con 0x7f1918141a70 2023-12-19T05:50:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f19167fc640 1 -- 172.21.15.49:0/3542954531 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908031810 con 0x7f1918141a70 2023-12-19T05:50:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f19167fc640 1 -- 172.21.15.49:0/3542954531 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908031b80 con 0x7f1918141a70 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f191d538640 1 -- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 msgr2=0x7f191806df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f191d538640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f191806df60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f19080097a0 tx=0x7f190802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.790+0000 7f191d538640 1 -- 172.21.15.49:0/3542954531 shutdown_connections 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.791+0000 7f191d538640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f191806e4a0 0x7f19180b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.791+0000 7f191d538640 1 --2- 172.21.15.49:0/3542954531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f191806df60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.791+0000 7f191d538640 1 -- 172.21.15.49:0/3542954531 >> 172.21.15.49:0/3542954531 conn(0x7f19180cef20 msgr2=0x7f19180cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.791+0000 7f191d538640 1 -- 172.21.15.49:0/3542954531 shutdown_connections 2023-12-19T05:50:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.791+0000 7f191d538640 1 -- 172.21.15.49:0/3542954531 wait complete. 2023-12-19T05:50:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.793+0000 7f191d538640 1 Processor -- start 2023-12-19T05:50:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.793+0000 7f191d538640 1 -- start start 2023-12-19T05:50:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.794+0000 7f191d538640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.794+0000 7f191d538640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19180b1aa0 0x7f1918158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.794+0000 7f191d538640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f19180cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f191d538640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19180cd3c0 con 0x7f191806e4a0 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f191d538640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191815c390 con 0x7f1918141a70 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f191d538640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191815c630 con 0x7f19180b1aa0 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42562/0 (socket says 172.21.15.49:42562) 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 -- 172.21.15.49:0/1351563040 learned_addr learned my addr 172.21.15.49:0/1351563040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f190ffff640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19180b1aa0 0x7f1918158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f19177fe640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f19180cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 -- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19180b1aa0 msgr2=0x7f1918158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19180b1aa0 0x7f1918158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 -- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 msgr2=0x7f19180cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f19180cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f1916ffd640 1 -- 172.21.15.49:0/1351563040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009400 con 0x7f191806e4a0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.795+0000 7f19177fe640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f19180cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f1916ffd640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f190802b8f0 tx=0x7f19080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f190f7fe640 1 -- 172.21.15.49:0/1351563040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908031e20 con 0x7f191806e4a0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f190f7fe640 1 -- 172.21.15.49:0/1351563040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190803ad60 con 0x7f191806e4a0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f190f7fe640 1 -- 172.21.15.49:0/1351563040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908044610 con 0x7f191806e4a0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908009400 con 0x7f191806e4a0 2023-12-19T05:50:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.796+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191815cbf0 con 0x7f191806e4a0 2023-12-19T05:50:45.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.799+0000 7f190f7fe640 1 -- 172.21.15.49:0/1351563040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f190804d450 con 0x7f191806e4a0 2023-12-19T05:50:45.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.800+0000 7f190f7fe640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 0x7f18f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.800+0000 7f190f7fe640 1 -- 172.21.15.49:0/1351563040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19080aaaf0 con 0x7f191806e4a0 2023-12-19T05:50:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.800+0000 7f1920177740 1 Processor -- start 2023-12-19T05:50:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.801+0000 7f190ffff640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 0x7f18f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.801+0000 7f1920177740 1 -- start start 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.801+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.801+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f1920177740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f1920177740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632524d7f80 con 0x56325256d3a0 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632524d5710 con 0x5632525a9780 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5632524d1000 con 0x5632525a93a0 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f190ffff640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 0x7f18f806c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f19180cadc0 tx=0x7f1900008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42574/0 (socket says 172.21.15.49:42574) 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 -- 172.21.15.49:0/2014687624 learned_addr learned my addr 172.21.15.49:0/2014687624 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f190ffff640 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 -- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 msgr2=0x5632525b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 -- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 msgr2=0x56325256ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.802+0000 7f19177fe640 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.803+0000 7f19177fe640 1 -- 172.21.15.49:0/2014687624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563252498690 con 0x56325256d3a0 2023-12-19T05:50:45.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.803+0000 7f19177fe640 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f19100020b0 tx=0x7f191000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db11db9af68d3d01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.803+0000 7f190cff9640 1 -- 172.21.15.49:0/2014687624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000b070 con 0x56325256d3a0 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.803+0000 7f190cff9640 1 -- 172.21.15.49:0/2014687624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910013470 con 0x56325256d3a0 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.803+0000 7f190cff9640 1 -- 172.21.15.49:0/2014687624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19100137e0 con 0x56325256d3a0 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 -- 172.21.15.49:0/2014687624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 msgr2=0x56325256d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f19100020b0 tx=0x7f191000d520 comp rx=0 tx=0).stop 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 -- 172.21.15.49:0/2014687624 shutdown_connections 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56325256d3a0 0x56325256d820 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 --2- 172.21.15.49:0/2014687624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 -- 172.21.15.49:0/2014687624 >> 172.21.15.49:0/2014687624 conn(0x563252569fc0 msgr2=0x5632525b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 -- 172.21.15.49:0/2014687624 shutdown_connections 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.804+0000 7f1920177740 1 -- 172.21.15.49:0/2014687624 wait complete. 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.805+0000 7f1920177740 1 -- start start 2023-12-19T05:50:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.805+0000 7f1920177740 1 Processor -- start 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x56325259b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252583a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632524727d0 con 0x563252595110 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563252472470 con 0x5632525a9780 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563252238f20 con 0x5632525a93a0 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f1920177740 10 client.0 _ll_register_callbacks cb 0x5632524c11b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f19177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.806+0000 7f19177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42590/0 (socket says 172.21.15.49:42590) 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 -- 172.21.15.49:0/4221155505 learned_addr learned my addr 172.21.15.49:0/4221155505 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f1916ffd640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x56325259b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f190ffff640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252583a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 -- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 msgr2=0x56325259b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x56325259b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 -- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 msgr2=0x563252583a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252583a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 -- 172.21.15.49:0/4221155505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904003520 con 0x563252595110 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f190ffff640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252583a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f19177fe640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1910001720 tx=0x7f1910001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb10df8755465474 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.807+0000 7f18f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:50:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19100070d0 con 0x563252595110 2023-12-19T05:50:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1910007230 con 0x563252595110 2023-12-19T05:50:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632524fb550 con 0x563252595110 2023-12-19T05:50:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19100073f0 con 0x563252595110 2023-12-19T05:50:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 10 client.8616 fetch_fsmap learned FSMap version 80 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x5632524cf680 con 0x563252595110 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5632524fb550 con 0x563252595110 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f191001d040 con 0x563252595110 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 10 client.8616 fetch_fsmap finished waiting for FSMap version 80 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 10 client.8616 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 20 client.8616 populate_metadata read hostname 'smithi049' 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252582f60 0x5632525a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 4 client.8616 mds_command: new command op to 8490 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.808+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 --> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632524c3b50 con 0x563252582f60 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.809+0000 7f1916ffd640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252582f60 0x5632525a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.809+0000 7f1916ffd640 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252582f60 0x5632525a4c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea007cf8e41b4d24 server_cookie=3d05ec0b2b80dfb8 in_seq=0 out_seq=0 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.809+0000 7f18f5ffb640 10 client.8616 ms_handle_connect on v2:172.21.15.49:6834/2314443722 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f18f5ffb640 1 -- 172.21.15.49:0/4221155505 <== mds.0 v2:172.21.15.49:6834/2314443722 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5632524c3b50 con 0x563252582f60 2023-12-19T05:50:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f18f5ffb640 10 client.8616 handle_command_reply: tid=0 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 client.8616 shutdown 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 msgr2=0x563252566e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1910001720 tx=0x7f1910001250 comp rx=0 tx=0).stop 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 shutdown_connections 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252582f60 0x5632525a4c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x563252566e30 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252583a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 --2- 172.21.15.49:0/4221155505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x56325259b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 >> 172.21.15.49:0/4221155505 conn(0x56325256d3a0 msgr2=0x5632525b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.810+0000 7f18f5ffb640 0 client.8616 ms_handle_reset on v2:172.21.15.49:6834/2314443722 2023-12-19T05:50:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.811+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 shutdown_connections 2023-12-19T05:50:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.811+0000 7f1920177740 1 -- 172.21.15.49:0/4221155505 wait complete. 2023-12-19T05:50:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.811+0000 7f1920177740 20 client.8616 trim_cache size 0 max 16384 2023-12-19T05:50:45.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.827+0000 7f1920177740 1 Processor -- start 2023-12-19T05:50:45.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.828+0000 7f1920177740 1 -- start start 2023-12-19T05:50:45.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563252597710 con 0x563252595110 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632525b50d0 con 0x5632525a9780 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563252583b10 con 0x5632525a93a0 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42598/0 (socket says 172.21.15.49:42598) 2023-12-19T05:50:45.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 -- 172.21.15.49:0/2842407906 learned_addr learned my addr 172.21.15.49:0/2842407906 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 -- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 msgr2=0x5632525b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 -- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 msgr2=0x56325256c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.829+0000 7f1916ffd640 1 -- 172.21.15.49:0/2842407906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632524719e0 con 0x563252595110 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.830+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1908076290 tx=0x7f1908009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2060321095a94ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.830+0000 7f190d7fa640 1 -- 172.21.15.49:0/2842407906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908095070 con 0x563252595110 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.830+0000 7f190d7fa640 1 -- 172.21.15.49:0/2842407906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908081d70 con 0x563252595110 2023-12-19T05:50:45.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.830+0000 7f190d7fa640 1 -- 172.21.15.49:0/2842407906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080a9090 con 0x563252595110 2023-12-19T05:50:45.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 -- 172.21.15.49:0/2842407906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 msgr2=0x5632525971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1908076290 tx=0x7f1908009720 comp rx=0 tx=0).stop 2023-12-19T05:50:45.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 -- 172.21.15.49:0/2842407906 shutdown_connections 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5632525a93a0 0x5632525b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x56325256c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 --2- 172.21.15.49:0/2842407906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563252595110 0x5632525971d0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 -- 172.21.15.49:0/2842407906 >> 172.21.15.49:0/2842407906 conn(0x56325256d3a0 msgr2=0x56325256ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 -- 172.21.15.49:0/2842407906 shutdown_connections 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.831+0000 7f1920177740 1 -- 172.21.15.49:0/2842407906 wait complete. 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.832+0000 7f1920177740 1 -- start start 2023-12-19T05:50:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.832+0000 7f1920177740 1 Processor -- start 2023-12-19T05:50:45.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563252595110 0x56325256c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252606470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563252618e80 con 0x5632525a93a0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325259baf0 con 0x5632525a9780 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56325256cd30 con 0x563252595110 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f1920177740 10 client.0 _ll_register_callbacks cb 0x7f1910001a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f190ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f190ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42600/0 (socket says 172.21.15.49:42600) 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.833+0000 7f190ffff640 1 -- 172.21.15.49:0/2387205273 learned_addr learned my addr 172.21.15.49:0/2387205273 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563252595110 0x56325256c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f19177fe640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252606470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 -- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563252595110 msgr2=0x56325256c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563252595110 0x56325256c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 -- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 msgr2=0x563252606470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252606470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 -- 172.21.15.49:0/2387205273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191815cbf0 con 0x5632525a93a0 2023-12-19T05:50:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f19177fe640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252606470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f190ffff640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f1900015920 tx=0x7f1900009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4350d8b1d4ca6c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.834+0000 7f18f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011b30 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1900014960 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1910013470 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1900014b20 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 10 client.8622 fetch_fsmap learned FSMap version 80 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x563252496ef0 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910013470 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1900014c80 con 0x5632525a93a0 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 10 client.8622 fetch_fsmap finished waiting for FSMap version 80 2023-12-19T05:50:45.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 10 client.8622 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 20 client.8622 populate_metadata read hostname 'smithi049' 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252617fb0 0x563252618390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 4 client.8622 mds_command: new command op to 8490 tid=0[{"prefix": "status"}] 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.835+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 --> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5632524ca080 con 0x563252617fb0 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252617fb0 0x563252618390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f1916ffd640 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252617fb0 0x563252618390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989bd766dc4860db server_cookie=cfa8fe7a8115a468 in_seq=0 out_seq=0 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f18f5ffb640 10 client.8622 ms_handle_connect on v2:172.21.15.49:6834/2314443722 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f18f5ffb640 1 -- 172.21.15.49:0/2387205273 <== mds.0 v2:172.21.15.49:6834/2314443722 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5632524ca080 con 0x563252617fb0 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f18f5ffb640 10 client.8622 handle_command_reply: tid=0 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.836+0000 7f1920177740 1 client.8622 shutdown 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 msgr2=0x56325259b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f1900015920 tx=0x7f1900009190 comp rx=0 tx=0).stop 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 shutdown_connections 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:6834/2314443722,v1:172.21.15.49:6835/2314443722] conn(0x563252617fb0 0x563252618390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5632525a9780 0x563252606470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5632525a93a0 0x56325259b230 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 --2- 172.21.15.49:0/2387205273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563252595110 0x56325256c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f18f5ffb640 0 client.8622 ms_handle_reset on v2:172.21.15.49:6834/2314443722 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 >> 172.21.15.49:0/2387205273 conn(0x56325256d3a0 msgr2=0x563252596fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 shutdown_connections 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 1 -- 172.21.15.49:0/2387205273 wait complete. 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.837+0000 7f1920177740 20 client.8622 trim_cache size 0 max 16384 2023-12-19T05:50:45.841 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8490, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.8121090239999997, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 80, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 176, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 176, 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.589743414999999 2023-12-19T05:50:45.842 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 msgr2=0x7f18f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 0x7f18f806c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f19180cadc0 tx=0x7f1900008040 comp rx=0 tx=0).stop 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 msgr2=0x7f19181f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f190802b8f0 tx=0x7f19080046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 shutdown_connections 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f18f806a430 0x7f18f806c8f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19180b1aa0 0x7f1918158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1918141a70 0x7f19180cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 --2- 172.21.15.49:0/1351563040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f191806e4a0 0x7f19181f3420 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 >> 172.21.15.49:0/1351563040 conn(0x7f19180cef20 msgr2=0x7f191806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 shutdown_connections 2023-12-19T05:50:45.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:45.838+0000 7f191d538640 1 -- 172.21.15.49:0/1351563040 wait complete. 2023-12-19T05:50:45.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:50:46.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.090+0000 7fce07fff640 1 Processor -- start 2023-12-19T05:50:46.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.090+0000 7fce07fff640 1 -- start start 2023-12-19T05:50:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce07fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce080b8070 0x7fce080d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce07fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce080d12d0 con 0x7fce08146e30 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce07fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce080d15b0 con 0x7fce080d0a90 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce07fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce08147210 con 0x7fce080b8070 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce06ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce08146e30 0x7fce080b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45674/0 (socket says 172.21.15.49:45674) 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce067fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce080b8070 0x7fce080d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce06ffd640 1 -- 172.21.15.49:0/1595958514 learned_addr learned my addr 172.21.15.49:0/1595958514 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce067fc640 1 -- 172.21.15.49:0/1595958514 >> v1:172.21.15.115:6789/0 conn(0x7fce080d0a90 legacy=0x7fce0815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:46.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce067fc640 1 -- 172.21.15.49:0/1595958514 >> v1:172.21.15.49:6789/0 conn(0x7fce08146e30 legacy=0x7fce080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.092+0000 7fce067fc640 1 -- 172.21.15.49:0/1595958514 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce080d1890 con 0x7fce080b8070 2023-12-19T05:50:46.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce067fc640 1 --2- 172.21.15.49:0/1595958514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce080d0550 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bf68ba29ecbcc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:46.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce05ffb640 1 -- 172.21.15.49:0/1595958514 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf002e070 con 0x7fce080b8070 2023-12-19T05:50:46.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce05ffb640 1 -- 172.21.15.49:0/1595958514 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00315a0 con 0x7fce080b8070 2023-12-19T05:50:46.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce05ffb640 1 -- 172.21.15.49:0/1595958514 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0031930 con 0x7fce080b8070 2023-12-19T05:50:46.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce07fff640 1 -- 172.21.15.49:0/1595958514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 msgr2=0x7fce080d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.094+0000 7fce07fff640 1 --2- 172.21.15.49:0/1595958514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce080d0550 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002b840 comp rx=0 tx=0).stop 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.095+0000 7fce07fff640 1 -- 172.21.15.49:0/1595958514 shutdown_connections 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.095+0000 7fce07fff640 1 --2- 172.21.15.49:0/1595958514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce080d0550 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.095+0000 7fce07fff640 1 -- 172.21.15.49:0/1595958514 >> 172.21.15.49:0/1595958514 conn(0x7fce080b2990 msgr2=0x7fce080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.095+0000 7fce07fff640 1 -- 172.21.15.49:0/1595958514 shutdown_connections 2023-12-19T05:50:46.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.095+0000 7fce07fff640 1 -- 172.21.15.49:0/1595958514 wait complete. 2023-12-19T05:50:46.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.097+0000 7fce07fff640 1 Processor -- start 2023-12-19T05:50:46.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.097+0000 7fce07fff640 1 -- start start 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 0x7fce0813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 0x7fce081e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081ceda0 con 0x7fce080b8070 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081ce190 con 0x7fce080d0a90 2023-12-19T05:50:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce07fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce081ce470 con 0x7fce08146e30 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42626/0 (socket says 172.21.15.49:42626) 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 -- 172.21.15.49:0/3537430665 learned_addr learned my addr 172.21.15.49:0/3537430665 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce077fe640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 0x7fce081e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce067fc640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 0x7fce0813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 -- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 msgr2=0x7fce081e1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 0x7fce081e1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 -- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 msgr2=0x7fce0813b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 0x7fce0813b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce06ffd640 1 -- 172.21.15.49:0/3537430665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0009400 con 0x7fce080b8070 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce077fe640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 0x7fce081e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.098+0000 7fce067fc640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 0x7fce0813b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:46.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fce06ffd640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cbc0 tx=0x7fcdf800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800aca0 con 0x7fce080b8070 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800ae00 con 0x7fce080b8070 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce081ce750 con 0x7fce080b8070 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8012600 con 0x7fce080b8070 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.099+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0813b8f0 con 0x7fce080b8070 2023-12-19T05:50:46.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.101+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce08061910 con 0x7fce080b8070 2023-12-19T05:50:46.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.102+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcdf8007070 con 0x7fce080b8070 2023-12-19T05:50:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.102+0000 7fcdff7fe640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 0x7fcde806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.103+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf8088720 con 0x7fce080b8070 2023-12-19T05:50:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.103+0000 7fce067fc640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 0x7fcde806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:46.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.104+0000 7fce067fc640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 0x7fcde806c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0036000 tx=0x7fcdf003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:46.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.109+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcdf8053e50 con 0x7fce080b8070 2023-12-19T05:50:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.336+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce0806fa20 con 0x7fce080b8070 2023-12-19T05:50:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.337+0000 7fcdff7fe640 1 -- 172.21.15.49:0/3537430665 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcdf8017070 con 0x7fce080b8070 2023-12-19T05:50:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:50:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 msgr2=0x7fcde806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 0x7fcde806c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0036000 tx=0x7fcdf003d040 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 msgr2=0x7fce081f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cbc0 tx=0x7fcdf800a060 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 shutdown_connections 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcde806a430 0x7fcde806c8f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce08146e30 0x7fce081e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce080d0a90 0x7fce0813b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 --2- 172.21.15.49:0/3537430665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce080b8070 0x7fce081f5b40 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 >> 172.21.15.49:0/3537430665 conn(0x7fce080b2990 msgr2=0x7fce080b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 shutdown_connections 2023-12-19T05:50:46.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:46.340+0000 7fce07fff640 1 -- 172.21.15.49:0/3537430665 wait complete. 2023-12-19T05:50:46.358 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:50:46.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:50:46.359 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:50:46.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.359 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:50:46.409 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41646sec preferred_lft 41646sec 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:50:46.410 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:50:46.411 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:46.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.412 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:50:46.512 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:50:46.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.517 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:50:46.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:50:46.574 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:50:46.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.786 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:50:46.843 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:50:46.844 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:50:46.845 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:50:46.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:46.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:50:46.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:50:46.953 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:50:47.009 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:50:47.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:50:47.009 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:50:47.070 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:50:47.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:47.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:47.229 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:47.229 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:50:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:50:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:50:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:50:47.264 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:50:47.268 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:50:47.268 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:50:47.268 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:50:47.269 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:50:47.269 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:50:47.273 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:50:47.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:47.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:50:47.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:47.376 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:50:47.446 INFO:teuthology.orchestra.run.smithi049.stdout:client8634 2023-12-19T05:50:47.446 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:50:47.447 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:47.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:50:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.731+0000 7f39624ef640 1 Processor -- start 2023-12-19T05:50:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.732+0000 7f39624ef640 1 -- start start 2023-12-19T05:50:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.733+0000 7f39624ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.733+0000 7f39624ef640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f395c0b7ea0 0x7f395c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f39624ef640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c0b8300 con 0x7f395c0d0a90 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f39624ef640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c147210 con 0x7f395c0b7ea0 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f39624ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0d2370 con 0x7f395c146e30 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f3960cec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f395c0b7ea0 0x7f395c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f3961cee640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f395c0d0a90 0x7f395c06f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45684/0 (socket says 172.21.15.49:45684) 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f3961cee640 1 -- 172.21.15.49:0/802000234 learned_addr learned my addr 172.21.15.49:0/802000234 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.734+0000 7f39614ed640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f3960cec640 1 -- 172.21.15.49:0/802000234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 msgr2=0x7f395c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f3960cec640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f3960cec640 1 -- 172.21.15.49:0/802000234 >> v1:172.21.15.49:6789/0 conn(0x7f395c0d0a90 legacy=0x7f395c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f3960cec640 1 -- 172.21.15.49:0/802000234 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0d12d0 con 0x7f395c0b7ea0 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f395bfff640 1 -- 172.21.15.49:0/802000234 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957372579 0 0) 0x7f395c0b8300 con 0x7f395c0d0a90 2023-12-19T05:50:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.735+0000 7f39614ed640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.736+0000 7f3960cec640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0b7ea0 0x7f395c0d0550 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f39500097d0 tx=0x7f395002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531357146928053d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.736+0000 7f395bfff640 1 -- 172.21.15.49:0/802000234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950031770 con 0x7f395c0b7ea0 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.736+0000 7f395bfff640 1 -- 172.21.15.49:0/802000234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39500318d0 con 0x7f395c0b7ea0 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.736+0000 7f395bfff640 1 -- 172.21.15.49:0/802000234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950031c60 con 0x7f395c0b7ea0 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 -- 172.21.15.49:0/802000234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0b7ea0 msgr2=0x7f395c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0b7ea0 0x7f395c0d0550 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f39500097d0 tx=0x7f395002b810 comp rx=0 tx=0).stop 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 -- 172.21.15.49:0/802000234 shutdown_connections 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0b7ea0 0x7f395c0d0550 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 --2- 172.21.15.49:0/802000234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 -- 172.21.15.49:0/802000234 >> 172.21.15.49:0/802000234 conn(0x7f395c0b2990 msgr2=0x7f395c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 -- 172.21.15.49:0/802000234 shutdown_connections 2023-12-19T05:50:47.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.737+0000 7f39624ef640 1 -- 172.21.15.49:0/802000234 wait complete. 2023-12-19T05:50:47.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.739+0000 7f39624ef640 1 Processor -- start 2023-12-19T05:50:47.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.739+0000 7f39624ef640 1 -- start start 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 0x7f395c13d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c1df840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1f2610 con 0x7f395c0d0a90 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c140cd0 con 0x7f395c0b7ea0 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f39624ef640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c140fb0 con 0x7f395c146e30 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.740+0000 7f3960cec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42646/0 (socket says 172.21.15.49:42646) 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 -- 172.21.15.49:0/835785297 learned_addr learned my addr 172.21.15.49:0/835785297 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3961cee640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c1df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f39614ed640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 0x7f395c13d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 -- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 msgr2=0x7f395c1df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c1df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 -- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 msgr2=0x7f395c13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 0x7f395c13d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 -- 172.21.15.49:0/835785297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950009400 con 0x7f395c0d0a90 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3961cee640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c1df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f39614ed640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 0x7f395c13d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:50:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.741+0000 7f3960cec640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f3950034040 tx=0x7f39500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.742+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950032810 con 0x7f395c0d0a90 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.742+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950032970 con 0x7f395c0d0a90 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.742+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950032d20 con 0x7f395c0d0a90 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.742+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c141290 con 0x7f395c0d0a90 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.742+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c13d9d0 con 0x7f395c0d0a90 2023-12-19T05:50:47.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.743+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c1417b0 con 0x7f395c0d0a90 2023-12-19T05:50:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.744+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f395004e440 con 0x7f395c0d0a90 2023-12-19T05:50:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.745+0000 7f3959ffb640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 0x7f394806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.745+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39500aa9d0 con 0x7f395c0d0a90 2023-12-19T05:50:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.746+0000 7f39614ed640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 0x7f394806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:47.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.747+0000 7f39614ed640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 0x7f394806c8f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f394c009540 tx=0x7f394c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:47.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.750+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3950075fd0 con 0x7f395c0d0a90 2023-12-19T05:50:47.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.985+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f395c061910 con 0x7f395c0d0a90 2023-12-19T05:50:47.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.985+0000 7f3959ffb640 1 -- 172.21.15.49:0/835785297 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7f39500795f0 con 0x7f395c0d0a90 2023-12-19T05:50:47.987 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:50:47.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 msgr2=0x7f394806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 0x7f394806c8f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f394c009540 tx=0x7f394c00b040 comp rx=0 tx=0).stop 2023-12-19T05:50:47.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 msgr2=0x7f395c1e4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:47.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f3950034040 tx=0x7f39500046c0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 shutdown_connections 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f394806a430 0x7f394806c8f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f395c146e30 0x7f395c1df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f395c0d0a90 0x7f395c1e4890 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 --2- 172.21.15.49:0/835785297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f395c0b7ea0 0x7f395c13d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.988+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 >> 172.21.15.49:0/835785297 conn(0x7f395c0b2990 msgr2=0x7f395c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.989+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 shutdown_connections 2023-12-19T05:50:47.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:47.989+0000 7f39624ef640 1 -- 172.21.15.49:0/835785297 wait complete. 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:50:48.011 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:50:48.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.012 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:50:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41662sec preferred_lft 41662sec 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:50:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:50:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:50:48.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.077 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:50:48.166 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:50:48.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.169 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:50:48.224 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:50:48.224 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:50:48.224 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:50:48.224 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:50:48.224 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:50:48.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:50:48.225 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:50:48.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.412 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:50:48.464 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:50:48.464 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:50:48.465 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:50:48.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.465 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:50:48.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:50:48.559 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:50:48.613 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:50:48.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:50:48.613 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:50:48.661 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:50:48.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.661 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:48.799 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:48.799 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:50:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:50:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:50:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:50:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:50:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:50:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:50:48.835 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:50:48.836 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:50:48.836 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:50:48.836 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:50:48.840 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:50:48.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:50:48.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:50:48.919 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:50:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:client7021 2023-12-19T05:50:48.976 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:50:48.976 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:50:49.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:50:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.265+0000 7f46cdbe0640 1 Processor -- start 2023-12-19T05:50:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.265+0000 7f46cdbe0640 1 -- start start 2023-12-19T05:50:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.267+0000 7f46cdbe0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46c80b0810 0x7f46c8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.267+0000 7f46cdbe0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c80ae640 con 0x7f46c8157bf0 2023-12-19T05:50:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.267+0000 7f46cdbe0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c80ae920 con 0x7f46c80ae110 2023-12-19T05:50:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.267+0000 7f46cdbe0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c806b8c0 con 0x7f46c80b0810 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.268+0000 7f46c77fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46c8157bf0 0x7f46c815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45696/0 (socket says 172.21.15.49:45696) 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.268+0000 7f46c77fe640 1 -- 172.21.15.49:0/4154820980 learned_addr learned my addr 172.21.15.49:0/4154820980 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.268+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115404957 0 0) 0x7f46c80ae640 con 0x7f46c8157bf0 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.268+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b0003520 con 0x7f46c8157bf0 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.268+0000 7f46c7fff640 1 --2- 172.21.15.49:0/4154820980 >> v2:172.21.15.115:3300/0 conn(0x7f46c80b0810 0x7f46c8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3572326914 0 0) 0x7f46b0003520 con 0x7f46c8157bf0 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 >> v2:172.21.15.115:3300/0 conn(0x7f46c80b0810 msgr2=0x7f46c8164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 --2- 172.21.15.49:0/4154820980 >> v2:172.21.15.115:3300/0 conn(0x7f46c80b0810 0x7f46c8164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 >> v1:172.21.15.115:6789/0 conn(0x7f46c80ae110 legacy=0x7f46c80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80aec00 con 0x7f46c8157bf0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f46b8001670 con 0x7f46c8157bf0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 >> v1:172.21.15.49:6789/0 conn(0x7f46c8157bf0 legacy=0x7f46c815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 0x7f46b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00047c0 0x7f46b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b00051f0 0x7f46b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806b8c0 con 0x7f46b00039e0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b000c150 con 0x7f46b00047c0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b000c310 con 0x7f46b00051f0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c77fe640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 0x7f46b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.269+0000 7f46c6ffd640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00047c0 0x7f46b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c7fff640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b00051f0 0x7f46b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c77fe640 1 -- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b00051f0 msgr2=0x7f46b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c77fe640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46b00051f0 0x7f46b000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c77fe640 1 -- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00047c0 msgr2=0x7f46b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c77fe640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00047c0 0x7f46b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c77fe640 1 -- 172.21.15.49:0/4154820980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0003520 con 0x7f46b00039e0 2023-12-19T05:50:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.270+0000 7f46c7fff640 1 -- 172.21.15.49:0/4154820980 reap_dead start 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.271+0000 7f46c77fe640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 0x7f46b0003e00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c240 tx=0x7f46b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892fcd671def6d09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.271+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8005ad0 con 0x7f46b00039e0 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.271+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b8005c30 con 0x7f46b00039e0 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.271+0000 7f46c67fc640 1 -- 172.21.15.49:0/4154820980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b802c870 con 0x7f46b00039e0 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 -- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 msgr2=0x7f46b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 0x7f46b0003e00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c240 tx=0x7f46b00057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 -- 172.21.15.49:0/4154820980 shutdown_connections 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/4154820980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46b00039e0 0x7f46b0003e00 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 -- 172.21.15.49:0/4154820980 >> 172.21.15.49:0/4154820980 conn(0x7f46c80cbb70 msgr2=0x7f46c80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 -- 172.21.15.49:0/4154820980 shutdown_connections 2023-12-19T05:50:49.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.272+0000 7f46cdbe0640 1 -- 172.21.15.49:0/4154820980 wait complete. 2023-12-19T05:50:49.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.274+0000 7f46cdbe0640 1 Processor -- start 2023-12-19T05:50:49.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.274+0000 7f46cdbe0640 1 -- start start 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00039e0 0x7f46c814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c81f26b0 0x7f46c8155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c815d490 con 0x7f46c81f3c80 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81f2be0 con 0x7f46b00039e0 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46cdbe0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81f2ec0 con 0x7f46c81f26b0 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46c6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46c6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42670/0 (socket says 172.21.15.49:42670) 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.275+0000 7f46c6ffd640 1 -- 172.21.15.49:0/452563128 learned_addr learned my addr 172.21.15.49:0/452563128 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c77fe640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00039e0 0x7f46c814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c7fff640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c81f26b0 0x7f46c8155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 -- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c81f26b0 msgr2=0x7f46c8155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c81f26b0 0x7f46c8155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 -- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00039e0 msgr2=0x7f46c814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00039e0 0x7f46c814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 -- 172.21.15.49:0/452563128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c81f31a0 con 0x7f46c81f3c80 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46c6ffd640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f46bc007fd0 tx=0x7f46bc00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0052e0 con 0x7f46c81f3c80 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.276+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc005440 con 0x7f46c81f3c80 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.277+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c81f3480 con 0x7f46c81f3c80 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.277+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003810 con 0x7f46c81f3c80 2023-12-19T05:50:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.277+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c8155bd0 con 0x7f46c81f3c80 2023-12-19T05:50:49.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.278+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8061910 con 0x7f46c81f3c80 2023-12-19T05:50:49.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.279+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f46bc003970 con 0x7f46c81f3c80 2023-12-19T05:50:49.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.280+0000 7f46affff640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 0x7f46b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:49.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.280+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46bc0880d0 con 0x7f46c81f3c80 2023-12-19T05:50:49.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.281+0000 7f46c77fe640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 0x7f46b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:49.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.282+0000 7f46c77fe640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 0x7f46b406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f46b8034000 tx=0x7f46b8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.285+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f46bc053770 con 0x7f46c81f3c80 2023-12-19T05:50:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.513+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c815ec40 con 0x7f46c81f3c80 2023-12-19T05:50:49.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.514+0000 7f46affff640 1 -- 172.21.15.49:0/452563128 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f46bc056d90 con 0x7f46c81f3c80 2023-12-19T05:50:49.517 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:50:49.517 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:50:49.517 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:50:49.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 msgr2=0x7f46b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 0x7f46b406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f46b8034000 tx=0x7f46b8009030 comp rx=0 tx=0).stop 2023-12-19T05:50:49.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 msgr2=0x7f46c815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:49.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f46bc007fd0 tx=0x7f46bc00e8a0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 shutdown_connections 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f46b406a430 0x7f46b406c8f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c81f26b0 0x7f46c8155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c81f3c80 0x7f46c815c9e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 --2- 172.21.15.49:0/452563128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46b00039e0 0x7f46c814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 >> 172.21.15.49:0/452563128 conn(0x7f46c80cbb70 msgr2=0x7f46c815dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 shutdown_connections 2023-12-19T05:50:49.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:49.517+0000 7f46cdbe0640 1 -- 172.21.15.49:0/452563128 wait complete. 2023-12-19T05:50:49.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-19T05:50:49.788 INFO:teuthology.orchestra.run.smithi049.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":8490,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.746206638,"mdsmap_epoch":80,"osdmap_epoch":176,"osdmap_epoch_barrier":176,"uptime":17.523833566} 2023-12-19T05:50:49.789 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 8490, "mdsmap_epoch": 80, "osdmap_epoch": 176, "osdmap_epoch_barrier": 176, "rank_uptime": 11.746206638, "state": "up:active", "uptime": 17.523833566, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:50:49.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T05:50:50.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.021+0000 7f20a2177640 1 Processor -- start 2023-12-19T05:50:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.022+0000 7f20a2177640 1 -- start start 2023-12-19T05:50:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.023+0000 7f20a2177640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f209c146800 0x7f209c0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.023+0000 7f20a2177640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f209c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.023+0000 7f20a2177640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c147060 con 0x7f209c0ab150 2023-12-19T05:50:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.023+0000 7f20a2177640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c146be0 con 0x7f209c146800 2023-12-19T05:50:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.023+0000 7f20a2177640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0ab710 con 0x7f209c0ac7b0 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f2092ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f209c0ab150 0x7f209c0a9940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45712/0 (socket says 172.21.15.49:45712) 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f2092ffd640 1 -- 172.21.15.49:0/688892676 learned_addr learned my addr 172.21.15.49:0/688892676 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f209b7fe640 1 --2- 172.21.15.49:0/688892676 >> v2:172.21.15.115:3300/0 conn(0x7f209c146800 0x7f209c0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f209bfff640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f209c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419291872 0 0) 0x7f209c147060 con 0x7f209c0ab150 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.024+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2088003520 con 0x7f209c0ab150 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422051878 0 0) 0x7f2088003520 con 0x7f209c0ab150 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 msgr2=0x7f209c0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f209c0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 >> v2:172.21.15.115:3300/0 conn(0x7f209c146800 msgr2=0x7f209c0a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 --2- 172.21.15.49:0/688892676 >> v2:172.21.15.115:3300/0 conn(0x7f209c146800 0x7f209c0a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0ab9f0 con 0x7f209c0ab150 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f2084001670 con 0x7f209c0ab150 2023-12-19T05:50:50.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 >> v1:172.21.15.49:6789/0 conn(0x7f209c0ab150 legacy=0x7f209c0a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20880039e0 0x7f2088003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f20880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2088004d00 0x7f2088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c146be0 con 0x7f2088004d00 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0ab710 con 0x7f20880039e0 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208800bae0 con 0x7f209c0ac7b0 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f209bfff640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2088004d00 0x7f2088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.025+0000 7f2092ffd640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f20880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209b7fe640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20880039e0 0x7f2088003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209bfff640 1 -- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 msgr2=0x7f20880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:50.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209bfff640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c0ac7b0 0x7f20880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209bfff640 1 -- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20880039e0 msgr2=0x7f2088003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:50:50.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209bfff640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20880039e0 0x7f2088003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.026+0000 7f209bfff640 1 -- 172.21.15.49:0/688892676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088003520 con 0x7f2088004d00 2023-12-19T05:50:50.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.027+0000 7f209bfff640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2088004d00 0x7f2088005180 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2094009ac0 tx=0x7f20880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94288c8993a55fc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:50.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.027+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209402c6b0 con 0x7f2088004d00 2023-12-19T05:50:50.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.027+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209402c810 con 0x7f2088004d00 2023-12-19T05:50:50.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.027+0000 7f209affd640 1 -- 172.21.15.49:0/688892676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209402cba0 con 0x7f2088004d00 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 -- 172.21.15.49:0/688892676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2088004d00 msgr2=0x7f2088005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 --2- 172.21.15.49:0/688892676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2088004d00 0x7f2088005180 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2094009ac0 tx=0x7f20880057f0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f209bfff640 1 -- 172.21.15.49:0/688892676 reap_dead start 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 -- 172.21.15.49:0/688892676 shutdown_connections 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 -- 172.21.15.49:0/688892676 >> 172.21.15.49:0/688892676 conn(0x7f209c06f5a0 msgr2=0x7f209c06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 -- 172.21.15.49:0/688892676 shutdown_connections 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.028+0000 7f20a2177640 1 -- 172.21.15.49:0/688892676 wait complete. 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.030+0000 7f20a2177640 1 Processor -- start 2023-12-19T05:50:50.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.030+0000 7f20a2177640 1 -- start start 2023-12-19T05:50:50.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2088004d00 0x7f209c15ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c1f6b80 0x7f209c139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c139fa0 con 0x7f209c139740 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c139cc0 con 0x7f2088004d00 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f20a2177640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1f60a0 con 0x7f209c1f6b80 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f209bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f209bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42692/0 (socket says 172.21.15.49:42692) 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.031+0000 7f209bfff640 1 -- 172.21.15.49:0/156119499 learned_addr learned my addr 172.21.15.49:0/156119499 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f2092ffd640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c1f6b80 0x7f209c139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 -- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c1f6b80 msgr2=0x7f209c139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209b7fe640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2088004d00 0x7f209c15ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c1f6b80 0x7f209c139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 -- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2088004d00 msgr2=0x7f209c15ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2088004d00 0x7f209c15ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 -- 172.21.15.49:0/156119499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c1f6380 con 0x7f209c139740 2023-12-19T05:50:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f209bfff640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f2094009ac0 tx=0x7f2094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209402c6b0 con 0x7f209c139740 2023-12-19T05:50:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094003830 con 0x7f209c139740 2023-12-19T05:50:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094003be0 con 0x7f209c139740 2023-12-19T05:50:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.032+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c1f6660 con 0x7f209c139740 2023-12-19T05:50:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.033+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c13def0 con 0x7f209c139740 2023-12-19T05:50:50.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.034+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c061910 con 0x7f209c139740 2023-12-19T05:50:50.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.035+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2094003d40 con 0x7f209c139740 2023-12-19T05:50:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.036+0000 7f2098ff9640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 0x7f207c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:50:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.036+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20940aa090 con 0x7f209c139740 2023-12-19T05:50:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.036+0000 7f209b7fe640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 0x7f207c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:50:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.037+0000 7f209b7fe640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 0x7f207c06c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fc0 tx=0x7f208c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:50:50.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.040+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2094075710 con 0x7f209c139740 2023-12-19T05:50:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.239+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f209c0af840 con 0x7f209c139740 2023-12-19T05:50:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.641+0000 7f2098ff9640 1 -- 172.21.15.49:0/156119499 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v177) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2094078d30 con 0x7f209c139740 2023-12-19T05:50:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T05:50:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 msgr2=0x7f207c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 0x7f207c06c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fc0 tx=0x7f208c00b040 comp rx=0 tx=0).stop 2023-12-19T05:50:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 msgr2=0x7f209c0a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:50:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f2094009ac0 tx=0x7f2094004730 comp rx=0 tx=0).stop 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 shutdown_connections 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f207c06a430 0x7f207c06c8f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f209c1f6b80 0x7f209c139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c139740 0x7f209c0a9b30 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 --2- 172.21.15.49:0/156119499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2088004d00 0x7f209c15ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 >> 172.21.15.49:0/156119499 conn(0x7f209c06f5a0 msgr2=0x7f209c0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 shutdown_connections 2023-12-19T05:50:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:50:50.645+0000 7f20a2177640 1 -- 172.21.15.49:0/156119499 wait complete. 2023-12-19T05:50:50.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:50:50.902 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:50:50.902 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:50:50.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-19T05:50:51.142 INFO:teuthology.orchestra.run.smithi049.stdout:{"mon_tick_interval":"5"} 2023-12-19T05:50:51.142 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-19T05:50:51.142 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> import time 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> import datetime 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> # Write some buffered data through before going full, all should be well 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> print("writing some data through which we expect to succeed") 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> bytes = 0 2023-12-19T05:50:51.143 DEBUG:teuthology.orchestra.run.smithi049:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> # buffered IO, the error should always only appear from fsync and not 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> # from write 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> full = False 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> for n in range(0, int(32 * 1.1)): 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:50:51.144 DEBUG:teuthology.orchestra.run.smithi049:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> raise 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> full = True 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> break 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> try: 2023-12-19T05:50:51.145 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f) 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> print("fsync'"'"'ed successfully") 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> full = True 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> break 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> else: 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> if n > 32 * 0.9: 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> # Be cautious in the last region where we expect to hit 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-19T05:50:51.146 DEBUG:teuthology.orchestra.run.smithi049:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> time.sleep(15.0) 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> if not full: 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> # close() should not raise an error because we already caught it in 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> # since then because all IOs got cancelled on the full flag. 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> print("calling close") 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> os.close(f) 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> print("close() did not raise error") 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-19T05:50:51.147 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-12-19T05:50:58.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:58.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:29.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:29.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:52.822 INFO:teuthology.orchestra.run.smithi049.stdout:writing some data through which we expect to succeed 2023-12-19T05:51:52.822 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 1.00 MB 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 2.00 MB 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 3.00 MB 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 4.00 MB 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 5.00 MB 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 6.00 MB 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 7.00 MB 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 8.00 MB 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 9.00 MB 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.824 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 10.00 MB 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 11.00 MB 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 12.00 MB 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 13.00 MB 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 14.00 MB 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.825 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 15.00 MB 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 16.00 MB 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 17.00 MB 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 18.00 MB 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 19.00 MB 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.826 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 20.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 21.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 22.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 23.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 24.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 25.00 MB 2023-12-19T05:51:52.827 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 26.00 MB 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 27.00 MB 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 28.00 MB 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 29.00 MB 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 30.00 MB 2023-12-19T05:51:52.828 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 31.00 MB 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 32.00 MB 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:fsync'ed successfully 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:Not full yet after 33.00 MB 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:Reached fullness after 33.00 MB 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:calling close 2023-12-19T05:51:52.829 INFO:teuthology.orchestra.run.smithi049.stdout:close() did not raise error 2023-12-19T05:51:52.988 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:51:52.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:51:53.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:51:53.259 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:51:53.259 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:51:53.259 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:53.324 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:51:53.324 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:53.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:51:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.614+0000 7fd90f2a8640 1 Processor -- start 2023-12-19T05:51:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.615+0000 7fd90f2a8640 1 -- start start 2023-12-19T05:51:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.616+0000 7fd90f2a8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd9080b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.616+0000 7fd90f2a8640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9080b58c0 0x7fd90815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.616+0000 7fd90f2a8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080b6640 con 0x7fd9080b2a80 2023-12-19T05:51:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.616+0000 7fd90f2a8640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9080b5da0 con 0x7fd9080b58c0 2023-12-19T05:51:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.616+0000 7fd90f2a8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b6080 con 0x7fd908144c20 2023-12-19T05:51:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90daa5640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd9080b2a80 0x7fd9080cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44142/0 (socket says 172.21.15.49:44142) 2023-12-19T05:51:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90daa5640 1 -- 172.21.15.49:0/4228652766 learned_addr learned my addr 172.21.15.49:0/4228652766 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:51:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90e2a6640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd9080b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803667595 0 0) 0x7fd9080b6640 con 0x7fd9080b2a80 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90eaa7640 1 --2- 172.21.15.49:0/4228652766 >> v2:172.21.15.115:3300/0 conn(0x7fd9080b58c0 0x7fd90815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.617+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f0003520 con 0x7fd9080b2a80 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1977705553 0 0) 0x7fd8f0003520 con 0x7fd9080b2a80 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 msgr2=0x7fd9080b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd9080b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 >> v2:172.21.15.115:3300/0 conn(0x7fd9080b58c0 msgr2=0x7fd90815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 --2- 172.21.15.49:0/4228652766 >> v2:172.21.15.115:3300/0 conn(0x7fd9080b58c0 0x7fd90815bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080b6360 con 0x7fd9080b2a80 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd8fc001670 con 0x7fd9080b2a80 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 >> v1:172.21.15.49:6789/0 conn(0x7fd9080b2a80 legacy=0x7fd9080cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd8f0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd8f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0004d00 0x7fd8f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b5da0 con 0x7fd8f0003ef0 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b6080 con 0x7fd8f0004d00 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f000b980 con 0x7fd908144c20 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.618+0000 7fd90daa5640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd8f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90e2a6640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd8f0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90daa5640 1 -- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 msgr2=0x7fd8f0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90daa5640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd908144c20 0x7fd8f0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90daa5640 1 -- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0004d00 msgr2=0x7fd8f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90daa5640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0004d00 0x7fd8f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.619+0000 7fd90daa5640 1 -- 172.21.15.49:0/4228652766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0003520 con 0x7fd8f0003ef0 2023-12-19T05:51:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.620+0000 7fd90daa5640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd8f00047c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b2e60 tx=0x7fd8f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2163e1e2c376d885 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.620+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc005ad0 con 0x7fd8f0003ef0 2023-12-19T05:51:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.620+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc005c30 con 0x7fd8f0003ef0 2023-12-19T05:51:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.620+0000 7fd90d2a4640 1 -- 172.21.15.49:0/4228652766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc02c880 con 0x7fd8f0003ef0 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 -- 172.21.15.49:0/4228652766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 msgr2=0x7fd8f00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/4228652766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd8f00047c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b2e60 tx=0x7fd8f00057f0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90eaa7640 1 -- 172.21.15.49:0/4228652766 reap_dead start 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 -- 172.21.15.49:0/4228652766 shutdown_connections 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 -- 172.21.15.49:0/4228652766 >> 172.21.15.49:0/4228652766 conn(0x7fd90806b8f0 msgr2=0x7fd90806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 -- 172.21.15.49:0/4228652766 shutdown_connections 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.621+0000 7fd90f2a8640 1 -- 172.21.15.49:0/4228652766 wait complete. 2023-12-19T05:51:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.623+0000 7fd90f2a8640 1 Processor -- start 2023-12-19T05:51:53.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.623+0000 7fd90f2a8640 1 -- start start 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd90815afe0 0x7fd9080ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9080ca9e0 0x7fd9081422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90815ae50 con 0x7fd8f0003ef0 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080cae60 con 0x7fd9080ca9e0 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90f2a8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081f2e30 con 0x7fd90815afe0 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90e2a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90e2a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39550/0 (socket says 172.21.15.49:39550) 2023-12-19T05:51:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.624+0000 7fd90e2a6640 1 -- 172.21.15.49:0/1464427436 learned_addr learned my addr 172.21.15.49:0/1464427436 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:53.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 -- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd90815afe0 msgr2=0x7fd9080ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd90815afe0 0x7fd9080ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 -- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9080ca9e0 msgr2=0x7fd9081422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9080ca9e0 0x7fd9081422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080ce200 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90e2a6640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8007f60 tx=0x7fd8f8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800e030 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8016470 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8016820 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.625+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd908071cd0 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.626+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9081417e0 con 0x7fd8f0003ef0 2023-12-19T05:51:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.627+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9080735f0 con 0x7fd8f0003ef0 2023-12-19T05:51:53.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.628+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8f8016980 con 0x7fd8f0003ef0 2023-12-19T05:51:53.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.629+0000 7fd906ffd640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 0x7fd8f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:53.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.629+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd8f800f070 con 0x7fd8f0003ef0 2023-12-19T05:51:53.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.629+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7fd8f4072050 con 0x7fd8f0003ef0 2023-12-19T05:51:53.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.630+0000 7fd90daa5640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 0x7fd8f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:53.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.631+0000 7fd90daa5640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 0x7fd8f406c920 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc034000 tx=0x7fd8fc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.633+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd8f8054d50 con 0x7fd8f0003ef0 2023-12-19T05:51:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.827+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd908061910 con 0x7fd8f0003ef0 2023-12-19T05:51:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.828+0000 7fd906ffd640 1 -- 172.21.15.49:0/1464427436 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16234 (secure 0 0 0) 0x7fd8f8058370 con 0x7fd8f0003ef0 2023-12-19T05:51:53.830 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:51:53.830 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":180,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:51:30.453607+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 msgr2=0x7fd8f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 0x7fd8f406c920 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc034000 tx=0x7fd8fc02e000 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 msgr2=0x7fd90813dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8007f60 tx=0x7fd8f8007f90 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 shutdown_connections 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd8f406a460 0x7fd8f406c920 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd90815afe0 0x7fd9080ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9080ca9e0 0x7fd9081422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 --2- 172.21.15.49:0/1464427436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8f0003ef0 0x7fd90813dc40 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:53.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 >> 172.21.15.49:0/1464427436 conn(0x7fd90806b8f0 msgr2=0x7fd9080cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 shutdown_connections 2023-12-19T05:51:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:53.831+0000 7fd90f2a8640 1 -- 172.21.15.49:0/1464427436 wait complete. 2023-12-19T05:51:53.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:50:35.985173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:50:37.054976+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:51:53.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:51:54.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.085+0000 7f0df1ee7640 1 Processor -- start 2023-12-19T05:51:54.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.086+0000 7f0df1ee7640 1 -- start start 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.087+0000 7f0df1ee7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0dec146ff0 0x7f0dec0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.087+0000 7f0df1ee7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dec0b6430 0x7f0dec06f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.087+0000 7f0df1ee7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec161e70 con 0x7f0dec06fa70 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.087+0000 7f0df1ee7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dec161080 con 0x7f0dec0b6430 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.087+0000 7f0df1ee7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dec06ff20 con 0x7f0dec146ff0 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dec0b6430 0x7f0dec06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dec0b6430 0x7f0dec06f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50100/0 (socket says 172.21.15.49:50100) 2023-12-19T05:51:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 -- 172.21.15.49:0/139175959 learned_addr learned my addr 172.21.15.49:0/139175959 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 -- 172.21.15.49:0/139175959 >> v2:172.21.15.115:3300/0 conn(0x7f0dec146ff0 msgr2=0x7f0dec0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 --2- 172.21.15.49:0/139175959 >> v2:172.21.15.115:3300/0 conn(0x7f0dec146ff0 0x7f0dec0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 -- 172.21.15.49:0/139175959 >> v1:172.21.15.115:6789/0 conn(0x7f0dec06fa70 legacy=0x7f0dec15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.088+0000 7f0deaffd640 1 -- 172.21.15.49:0/139175959 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec161260 con 0x7f0dec0b6430 2023-12-19T05:51:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.089+0000 7f0deaffd640 1 --2- 172.21.15.49:0/139175959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec0b6430 0x7f0dec06f530 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0b7250 tx=0x7f0dd402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871148d8e3482e2b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0dea7fc640 1 -- 172.21.15.49:0/139175959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4031860 con 0x7f0dec0b6430 2023-12-19T05:51:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0dea7fc640 1 -- 172.21.15.49:0/139175959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40319c0 con 0x7f0dec0b6430 2023-12-19T05:51:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0dea7fc640 1 -- 172.21.15.49:0/139175959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4031d50 con 0x7f0dec0b6430 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 -- 172.21.15.49:0/139175959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec0b6430 msgr2=0x7f0dec06f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/139175959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec0b6430 0x7f0dec06f530 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0b7250 tx=0x7f0dd402b900 comp rx=0 tx=0).stop 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 -- 172.21.15.49:0/139175959 shutdown_connections 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/139175959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec0b6430 0x7f0dec06f530 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/139175959 >> v2:172.21.15.115:3300/0 conn(0x7f0dec146ff0 0x7f0dec0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 -- 172.21.15.49:0/139175959 >> 172.21.15.49:0/139175959 conn(0x7f0dec0d3520 msgr2=0x7f0dec0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.090+0000 7f0df1ee7640 1 -- 172.21.15.49:0/139175959 shutdown_connections 2023-12-19T05:51:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.091+0000 7f0df1ee7640 1 -- 172.21.15.49:0/139175959 wait complete. 2023-12-19T05:51:54.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.092+0000 7f0df1ee7640 1 Processor -- start 2023-12-19T05:51:54.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.093+0000 7f0df1ee7640 1 -- start start 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dec06fa70 0x7f0dec143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0dec0b6430 0x7f0dec0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec143880 con 0x7f0dec146ff0 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0c9ae0 con 0x7f0dec0b6430 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0df1ee7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0c9dc0 con 0x7f0dec06fa70 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0debfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0debfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50114/0 (socket says 172.21.15.49:50114) 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0debfff640 1 -- 172.21.15.49:0/1853164485 learned_addr learned my addr 172.21.15.49:0/1853164485 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0deaffd640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0dec0b6430 0x7f0dec0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.094+0000 7f0deb7fe640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dec06fa70 0x7f0dec143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 -- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dec06fa70 msgr2=0x7f0dec143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dec06fa70 0x7f0dec143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 -- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0dec0b6430 msgr2=0x7f0dec0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0dec0b6430 0x7f0dec0ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40094d0 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0debfff640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c390 tx=0x7f0de400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40035f0 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4003750 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4003b00 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.095+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec0ca320 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.096+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec0ca8e0 con 0x7f0dec146ff0 2023-12-19T05:51:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.097+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec061910 con 0x7f0dec146ff0 2023-12-19T05:51:54.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.098+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0de4003c60 con 0x7f0dec146ff0 2023-12-19T05:51:54.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.099+0000 7f0de3fff640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 0x7f0dcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.099+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0de4087bd0 con 0x7f0dec146ff0 2023-12-19T05:51:54.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.099+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f0dcc072020 con 0x7f0dec146ff0 2023-12-19T05:51:54.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.099+0000 7f0deb7fe640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 0x7f0dcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.100+0000 7f0deb7fe640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 0x7f0dcc06c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009f20 tx=0x7f0ddc0094f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.103+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0de4017060 con 0x7f0dec146ff0 2023-12-19T05:51:54.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.294+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dec15e6e0 con 0x7f0dec146ff0 2023-12-19T05:51:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.296+0000 7f0de3fff640 1 -- 172.21.15.49:0/1853164485 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0de4053170 con 0x7f0dec146ff0 2023-12-19T05:51:54.298 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:51:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 msgr2=0x7f0dcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 0x7f0dcc06c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009f20 tx=0x7f0ddc0094f0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 msgr2=0x7f0dec0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c390 tx=0x7f0de400c850 comp rx=0 tx=0).stop 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 shutdown_connections 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0dcc06a430 0x7f0dcc06c8f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dec146ff0 0x7f0dec0cd0e0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0dec0b6430 0x7f0dec0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.298+0000 7f0df1ee7640 1 --2- 172.21.15.49:0/1853164485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dec06fa70 0x7f0dec143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.299+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 >> 172.21.15.49:0/1853164485 conn(0x7f0dec0d3520 msgr2=0x7f0dec0b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.299+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 shutdown_connections 2023-12-19T05:51:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.299+0000 7f0df1ee7640 1 -- 172.21.15.49:0/1853164485 wait complete. 2023-12-19T05:51:54.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:51:54.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.557+0000 7efddf39b640 1 Processor -- start 2023-12-19T05:51:54.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.558+0000 7efddf39b640 1 -- start start 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddf39b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd80b0a00 0x7efdd806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddf39b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdd806ca80 0x7efdd80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddf39b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd815c9c0 con 0x7efdd8155460 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddf39b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd806d270 con 0x7efdd806ca80 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddf39b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd806d550 con 0x7efdd80b0a00 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddeb9a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdd806ca80 0x7efdd80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddeb9a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdd806ca80 0x7efdd80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50128/0 (socket says 172.21.15.49:50128) 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efddeb9a640 1 -- 172.21.15.49:0/1173946487 learned_addr learned my addr 172.21.15.49:0/1173946487 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:54.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.560+0000 7efdddb98640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd80b0a00 0x7efdd806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.561+0000 7efddeb9a640 1 -- 172.21.15.49:0/1173946487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd80b0a00 msgr2=0x7efdd806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.561+0000 7efddeb9a640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd80b0a00 0x7efdd806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.561+0000 7efddeb9a640 1 -- 172.21.15.49:0/1173946487 >> v1:172.21.15.115:6789/0 conn(0x7efdd8155460 legacy=0x7efdd80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.561+0000 7efddeb9a640 1 -- 172.21.15.49:0/1173946487 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd806d830 con 0x7efdd806ca80 2023-12-19T05:51:54.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.562+0000 7efddeb9a640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd806ca80 0x7efdd80cdcf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009e50 tx=0x7efdd002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f15f34bf7da0292 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.562+0000 7efddd397640 1 -- 172.21.15.49:0/1173946487 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd002cb00 con 0x7efdd806ca80 2023-12-19T05:51:54.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.562+0000 7efddd397640 1 -- 172.21.15.49:0/1173946487 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd002cc60 con 0x7efdd806ca80 2023-12-19T05:51:54.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.562+0000 7efddd397640 1 -- 172.21.15.49:0/1173946487 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00343f0 con 0x7efdd806ca80 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 -- 172.21.15.49:0/1173946487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd806ca80 msgr2=0x7efdd80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd806ca80 0x7efdd80cdcf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009e50 tx=0x7efdd002bf60 comp rx=0 tx=0).stop 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 -- 172.21.15.49:0/1173946487 shutdown_connections 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd80b0a00 0x7efdd806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 --2- 172.21.15.49:0/1173946487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd806ca80 0x7efdd80cdcf0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 -- 172.21.15.49:0/1173946487 >> 172.21.15.49:0/1173946487 conn(0x7efdd80659a0 msgr2=0x7efdd8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 -- 172.21.15.49:0/1173946487 shutdown_connections 2023-12-19T05:51:54.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.563+0000 7efddf39b640 1 -- 172.21.15.49:0/1173946487 wait complete. 2023-12-19T05:51:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.565+0000 7efddf39b640 1 Processor -- start 2023-12-19T05:51:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.565+0000 7efddf39b640 1 -- start start 2023-12-19T05:51:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 0x7efdd81f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd8155460 0x7efdd8157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81f6a80 con 0x7efdd80b0a00 2023-12-19T05:51:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81f5fd0 con 0x7efdd806ca80 2023-12-19T05:51:54.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efddf39b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8070ed0 con 0x7efdd8155460 2023-12-19T05:51:54.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.566+0000 7efdddb98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50144/0 (socket says 172.21.15.49:50144) 2023-12-19T05:51:54.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 -- 172.21.15.49:0/3852063972 learned_addr learned my addr 172.21.15.49:0/3852063972 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:54.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 -- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd8155460 msgr2=0x7efdd8157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdde399640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 0x7efdd81f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efddeb9a640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd8155460 0x7efdd8157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd8155460 0x7efdd8157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 -- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 msgr2=0x7efdd81f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 0x7efdd81f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0009b30 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdde399640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 0x7efdd81f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.567+0000 7efdddb98640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7efdc800d800 tx=0x7efdc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.568+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800b660 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.568+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800b7c0 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.568+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800bb50 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.568+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd81f61e0 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.568+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd81f67a0 con 0x7efdd80b0a00 2023-12-19T05:51:54.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.569+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd8061910 con 0x7efdd80b0a00 2023-12-19T05:51:54.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.570+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efdc800bcb0 con 0x7efdd80b0a00 2023-12-19T05:51:54.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.571+0000 7efdceffd640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 0x7efdbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:54.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.571+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efdc8088ec0 con 0x7efdd80b0a00 2023-12-19T05:51:54.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.571+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7efdbc072050 con 0x7efdd80b0a00 2023-12-19T05:51:54.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.572+0000 7efdde399640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 0x7efdbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:54.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.573+0000 7efdde399640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 0x7efdbc06c920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efdd4000f60 tx=0x7efdd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.575+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efdc80543d0 con 0x7efdd80b0a00 2023-12-19T05:51:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.771+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdd80afaf0 con 0x7efdd80b0a00 2023-12-19T05:51:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.772+0000 7efdceffd640 1 -- 172.21.15.49:0/3852063972 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7efdc80579f0 con 0x7efdd80b0a00 2023-12-19T05:51:54.774 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.774+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 msgr2=0x7efdbc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.774+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 0x7efdbc06c920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efdd4000f60 tx=0x7efdd4009040 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.774+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 msgr2=0x7efdd8156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.774+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7efdc800d800 tx=0x7efdc800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 shutdown_connections 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efdbc06a460 0x7efdbc06c920 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd8155460 0x7efdd8157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd80b0a00 0x7efdd8156110 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 --2- 172.21.15.49:0/3852063972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd806ca80 0x7efdd81f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 >> 172.21.15.49:0/3852063972 conn(0x7efdd80659a0 msgr2=0x7efdd815e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 shutdown_connections 2023-12-19T05:51:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:54.775+0000 7efddf39b640 1 -- 172.21.15.49:0/3852063972 wait complete. 2023-12-19T05:51:54.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:51:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.032+0000 7f058a73d640 1 Processor -- start 2023-12-19T05:51:55.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.032+0000 7f058a73d640 1 -- start start 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.034+0000 7f058a73d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f05840afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.034+0000 7f058a73d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058406e220 con 0x7f058406dc00 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.034+0000 7f058a73d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05840b0700 con 0x7f05840b02a0 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.034+0000 7f058a73d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05840cbea0 con 0x7f0584141900 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.035+0000 7f0589f3c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f058406dc00 0x7f05840ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52712/0 (socket says 172.21.15.49:52712) 2023-12-19T05:51:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.035+0000 7f0589f3c640 1 -- 172.21.15.49:0/2950176905 learned_addr learned my addr 172.21.15.49:0/2950176905 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.035+0000 7f058973b640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f05840afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.035+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896077044 0 0) 0x7f058406e220 con 0x7f058406dc00 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.035+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0570003520 con 0x7f058406dc00 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437392035 0 0) 0x7f0570003520 con 0x7f058406dc00 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 msgr2=0x7f05840afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f05840afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 >> v1:172.21.15.115:6789/0 conn(0x7f05840b02a0 legacy=0x7f058406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840cc180 con 0x7f058406dc00 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f057c0019f0 con 0x7f058406dc00 2023-12-19T05:51:55.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 >> v1:172.21.15.49:6789/0 conn(0x7f058406dc00 legacy=0x7f05840ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05700039a0 0x7f0570003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700047c0 0x7f0570004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f0570005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05840cbea0 con 0x7f05700039a0 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057000ba30 con 0x7f05700047c0 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057000bba0 con 0x7f0584141900 2023-12-19T05:51:55.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.036+0000 7f058973b640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05700039a0 0x7f0570003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f0588f3a640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700047c0 0x7f0570004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f0589f3c640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f0570005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f058973b640 1 -- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 msgr2=0x7f0570005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f058973b640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f0570005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f058973b640 1 -- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700047c0 msgr2=0x7f0570004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:55.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f058973b640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700047c0 0x7f0570004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f058973b640 1 -- 172.21.15.49:0/2950176905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570003520 con 0x7f05700039a0 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.037+0000 7f0589f3c640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0584141900 0x7f0570005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.038+0000 7f058973b640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05700039a0 0x7f0570003d80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0580009a90 tx=0x7f05700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2341af82d18e8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.038+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058002c650 con 0x7f05700039a0 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058002c7b0 con 0x7f05700039a0 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f057bfff640 1 -- 172.21.15.49:0/2950176905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058002cb40 con 0x7f05700039a0 2023-12-19T05:51:55.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 -- 172.21.15.49:0/2950176905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05700039a0 msgr2=0x7f0570003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 --2- 172.21.15.49:0/2950176905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05700039a0 0x7f0570003d80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0580009a90 tx=0x7f05700057f0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f0589f3c640 1 -- 172.21.15.49:0/2950176905 reap_dead start 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 -- 172.21.15.49:0/2950176905 shutdown_connections 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 -- 172.21.15.49:0/2950176905 >> 172.21.15.49:0/2950176905 conn(0x7f058406f630 msgr2=0x7f058406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 -- 172.21.15.49:0/2950176905 shutdown_connections 2023-12-19T05:51:55.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.039+0000 7f058a73d640 1 -- 172.21.15.49:0/2950176905 wait complete. 2023-12-19T05:51:55.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.041+0000 7f058a73d640 1 Processor -- start 2023-12-19T05:51:55.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.041+0000 7f058a73d640 1 -- start start 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700039a0 0x7f0584134960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05840c42f0 0x7f05841f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0584134ea0 con 0x7f058415a2e0 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05841338c0 con 0x7f05700039a0 2023-12-19T05:51:55.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.042+0000 7f058a73d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0584133ba0 con 0x7f05840c42f0 2023-12-19T05:51:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50172/0 (socket says 172.21.15.49:50172) 2023-12-19T05:51:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 -- 172.21.15.49:0/598756489 learned_addr learned my addr 172.21.15.49:0/598756489 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f058973b640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700039a0 0x7f0584134960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0589f3c640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05840c42f0 0x7f05841f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 -- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05840c42f0 msgr2=0x7f05841f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05840c42f0 0x7f05841f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 -- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700039a0 msgr2=0x7f0584134960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700039a0 0x7f0584134960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.043+0000 7f0588f3a640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584133e80 con 0x7f058415a2e0 2023-12-19T05:51:55.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f0588f3a640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f057400e560 tx=0x7f057400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05740052e0 con 0x7f058415a2e0 2023-12-19T05:51:55.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0574005460 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574003830 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0584134160 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.044+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058415a760 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.045+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584134680 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.046+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0574003990 con 0x7f058415a2e0 2023-12-19T05:51:55.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.047+0000 7f0579ffb640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 0x7f056806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.047+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0574088840 con 0x7f058415a2e0 2023-12-19T05:51:55.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.048+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f0568072020 con 0x7f058415a2e0 2023-12-19T05:51:55.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.048+0000 7f058973b640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 0x7f056806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.049+0000 7f058973b640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 0x7f056806c8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0580036000 tx=0x7f0580030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.051+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0584134680 con 0x7f058415a2e0 2023-12-19T05:51:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.249+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0584134680 con 0x7f058415a2e0 2023-12-19T05:51:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.250+0000 7f0579ffb640 1 -- 172.21.15.49:0/598756489 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0584134680 con 0x7f058415a2e0 2023-12-19T05:51:55.252 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 msgr2=0x7f056806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 0x7f056806c8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0580036000 tx=0x7f0580030000 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 msgr2=0x7f05840c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f057400e560 tx=0x7f057400ea20 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 shutdown_connections 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f056806a430 0x7f056806c8f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05840c42f0 0x7f05841f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f058415a2e0 0x7f05840c3db0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 --2- 172.21.15.49:0/598756489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05700039a0 0x7f0584134960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.253+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 >> 172.21.15.49:0/598756489 conn(0x7f058406f630 msgr2=0x7f058415c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.254+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 shutdown_connections 2023-12-19T05:51:55.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.254+0000 7f058a73d640 1 -- 172.21.15.49:0/598756489 wait complete. 2023-12-19T05:51:55.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:51:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.510+0000 7fcef5fb8640 1 Processor -- start 2023-12-19T05:51:55.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.511+0000 7fcef5fb8640 1 -- start start 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.512+0000 7fcef5fb8640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcef015bc20 0x7fcef015c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.512+0000 7fcef5fb8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcef00ce8c0 0x7fcef01656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.512+0000 7fcef5fb8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef0162d40 con 0x7fcef00ce430 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.512+0000 7fcef5fb8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef006e920 con 0x7fcef00ce8c0 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.512+0000 7fcef5fb8640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef0161f20 con 0x7fcef015bc20 2023-12-19T05:51:55.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcef00ce8c0 0x7fcef01656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcef00ce8c0 0x7fcef01656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50178/0 (socket says 172.21.15.49:50178) 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 -- 172.21.15.49:0/2737716401 learned_addr learned my addr 172.21.15.49:0/2737716401 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef4fb6640 1 --2- 172.21.15.49:0/2737716401 >> v2:172.21.15.115:3300/0 conn(0x7fcef015bc20 0x7fcef015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 -- 172.21.15.49:0/2737716401 >> v2:172.21.15.115:3300/0 conn(0x7fcef015bc20 msgr2=0x7fcef015c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 --2- 172.21.15.49:0/2737716401 >> v2:172.21.15.115:3300/0 conn(0x7fcef015bc20 0x7fcef015c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 -- 172.21.15.49:0/2737716401 >> v1:172.21.15.115:6789/0 conn(0x7fcef00ce430 legacy=0x7fcef00d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:55.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.513+0000 7fcef57b7640 1 -- 172.21.15.49:0/2737716401 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0162130 con 0x7fcef00ce8c0 2023-12-19T05:51:55.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.514+0000 7fcef57b7640 1 --2- 172.21.15.49:0/2737716401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce8c0 0x7fcef01656c0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcef006b2c0 tx=0x7fcee802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125cbacc4264f91a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fceef7fe640 1 -- 172.21.15.49:0/2737716401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee802ca80 con 0x7fcef00ce8c0 2023-12-19T05:51:55.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fceef7fe640 1 -- 172.21.15.49:0/2737716401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee802cbe0 con 0x7fcef00ce8c0 2023-12-19T05:51:55.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fceef7fe640 1 -- 172.21.15.49:0/2737716401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80343f0 con 0x7fcef00ce8c0 2023-12-19T05:51:55.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 -- 172.21.15.49:0/2737716401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce8c0 msgr2=0x7fcef01656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/2737716401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce8c0 0x7fcef01656c0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcef006b2c0 tx=0x7fcee802bee0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 -- 172.21.15.49:0/2737716401 shutdown_connections 2023-12-19T05:51:55.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/2737716401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce8c0 0x7fcef01656c0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/2737716401 >> v2:172.21.15.115:3300/0 conn(0x7fcef015bc20 0x7fcef015c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.515+0000 7fcef5fb8640 1 -- 172.21.15.49:0/2737716401 >> 172.21.15.49:0/2737716401 conn(0x7fcef006f160 msgr2=0x7fcef006f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.516+0000 7fcef5fb8640 1 -- 172.21.15.49:0/2737716401 shutdown_connections 2023-12-19T05:51:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.516+0000 7fcef5fb8640 1 -- 172.21.15.49:0/2737716401 wait complete. 2023-12-19T05:51:55.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.517+0000 7fcef5fb8640 1 Processor -- start 2023-12-19T05:51:55.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.517+0000 7fcef5fb8640 1 -- start start 2023-12-19T05:51:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.518+0000 7fcef5fb8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.518+0000 7fcef5fb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 0x7fcef00b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.518+0000 7fcef5fb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef015bc20 0x7fcef00b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef5fb8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00b2f20 con 0x7fcef00ce430 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef5fb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00b0bd0 con 0x7fcef015bc20 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef5fb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00b2c50 con 0x7fcef00ce8c0 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50184/0 (socket says 172.21.15.49:50184) 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 -- 172.21.15.49:0/1972070451 learned_addr learned my addr 172.21.15.49:0/1972070451 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fceeffff640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 0x7fcef00b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef57b7640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef015bc20 0x7fcef00b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 -- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 msgr2=0x7fcef00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 0x7fcef00b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 -- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef015bc20 msgr2=0x7fcef00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef015bc20 0x7fcef00b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fcef4fb6640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009b30 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.519+0000 7fceeffff640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 0x7fcef00b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fcef4fb6640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c7f0 tx=0x7fcee000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004220 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0004380 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0007840 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef00b0e70 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.520+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef00b1150 con 0x7fcef00ce430 2023-12-19T05:51:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.521+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef0066a60 con 0x7fcef00ce430 2023-12-19T05:51:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.522+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcee0007bb0 con 0x7fcef00ce430 2023-12-19T05:51:55.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.524+0000 7fceed7fa640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:55.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.524+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcee0088830 con 0x7fcef00ce430 2023-12-19T05:51:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.524+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7fcedc072020 con 0x7fcef00ce430 2023-12-19T05:51:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.525+0000 7fceeffff640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:55.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.526+0000 7fceeffff640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a810 tx=0x7fcee4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.529+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcee0053e70 con 0x7fcef00ce430 2023-12-19T05:51:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.739+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcef015fe80 con 0x7fcef00ce430 2023-12-19T05:51:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.740+0000 7fceed7fa640 1 -- 172.21.15.49:0/1972070451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcef015fe80 con 0x7fcef00ce430 2023-12-19T05:51:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:51:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 msgr2=0x7fcedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a810 tx=0x7fcee4008040 comp rx=0 tx=0).stop 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 msgr2=0x7fcef0153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c7f0 tx=0x7fcee000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 shutdown_connections 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcef00ce8c0 0x7fcef00b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcef015bc20 0x7fcef00b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 --2- 172.21.15.49:0/1972070451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcef00ce430 0x7fcef0153330 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 >> 172.21.15.49:0/1972070451 conn(0x7fcef006f160 msgr2=0x7fcef015a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 shutdown_connections 2023-12-19T05:51:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:55.743+0000 7fcef5fb8640 1 -- 172.21.15.49:0/1972070451 wait complete. 2023-12-19T05:51:55.765 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:51:55.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:51:55.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:51:55.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:51:55.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:51:55.889 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:51:55.951 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:51:55.951 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:56.012 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:51:56.012 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:56.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:51:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.313+0000 7f1e3350a640 1 Processor -- start 2023-12-19T05:51:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.313+0000 7f1e3350a640 1 -- start start 2023-12-19T05:51:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e3350a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e2c157aa0 0x7f1e2c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e3350a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e2c15e040 0x7f1e2c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e3350a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c06e8c0 con 0x7f1e2c06e410 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e3350a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c15e9f0 con 0x7f1e2c157aa0 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e3350a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b2600 con 0x7f1e2c15e040 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.315+0000 7f1e312a6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e2c157aa0 0x7f1e2c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e2c157aa0 0x7f1e2c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50192/0 (socket says 172.21.15.49:50192) 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 -- 172.21.15.49:0/3720819875 learned_addr learned my addr 172.21.15.49:0/3720819875 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e31aa7640 1 --2- 172.21.15.49:0/3720819875 >> v2:172.21.15.115:3300/0 conn(0x7f1e2c15e040 0x7f1e2c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 -- 172.21.15.49:0/3720819875 >> v2:172.21.15.115:3300/0 conn(0x7f1e2c15e040 msgr2=0x7f1e2c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 --2- 172.21.15.49:0/3720819875 >> v2:172.21.15.115:3300/0 conn(0x7f1e2c15e040 0x7f1e2c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 -- 172.21.15.49:0/3720819875 >> v1:172.21.15.115:6789/0 conn(0x7f1e2c06e410 legacy=0x7f1e2c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.316+0000 7f1e312a6640 1 -- 172.21.15.49:0/3720819875 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0b1d60 con 0x7f1e2c157aa0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.318+0000 7f1e312a6640 1 --2- 172.21.15.49:0/3720819875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c157aa0 0x7f1e2c0b1710 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b1c50 tx=0x7f1e2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dc73e88d0ad753 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.318+0000 7f1e23fff640 1 -- 172.21.15.49:0/3720819875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28030860 con 0x7f1e2c157aa0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.318+0000 7f1e23fff640 1 -- 172.21.15.49:0/3720819875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e280309c0 con 0x7f1e2c157aa0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.318+0000 7f1e23fff640 1 -- 172.21.15.49:0/3720819875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28030d50 con 0x7f1e2c157aa0 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 -- 172.21.15.49:0/3720819875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c157aa0 msgr2=0x7f1e2c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 --2- 172.21.15.49:0/3720819875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c157aa0 0x7f1e2c0b1710 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b1c50 tx=0x7f1e2802b9a0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 -- 172.21.15.49:0/3720819875 shutdown_connections 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 --2- 172.21.15.49:0/3720819875 >> v2:172.21.15.115:3300/0 conn(0x7f1e2c15e040 0x7f1e2c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 --2- 172.21.15.49:0/3720819875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c157aa0 0x7f1e2c0b1710 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 -- 172.21.15.49:0/3720819875 >> 172.21.15.49:0/3720819875 conn(0x7f1e2c0cbb70 msgr2=0x7f1e2c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:56.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 -- 172.21.15.49:0/3720819875 shutdown_connections 2023-12-19T05:51:56.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.319+0000 7f1e3350a640 1 -- 172.21.15.49:0/3720819875 wait complete. 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.321+0000 7f1e3350a640 1 Processor -- start 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.321+0000 7f1e3350a640 1 -- start start 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e2c157aa0 0x7f1e2c15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c15e040 0x7f1e2c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c15fba0 con 0x7f1e2c06e410 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c15fe80 con 0x7f1e2c15e040 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e3350a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c160160 con 0x7f1e2c157aa0 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e312a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e312a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50194/0 (socket says 172.21.15.49:50194) 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.322+0000 7f1e312a6640 1 -- 172.21.15.49:0/1933988876 learned_addr learned my addr 172.21.15.49:0/1933988876 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e30aa5640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e2c157aa0 0x7f1e2c15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e31aa7640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c15e040 0x7f1e2c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 -- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e2c157aa0 msgr2=0x7f1e2c15f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e2c157aa0 0x7f1e2c15f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 -- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c15e040 msgr2=0x7f1e2c157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c15e040 0x7f1e2c157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280094d0 con 0x7f1e2c06e410 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.323+0000 7f1e312a6640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f1e2802b9e0 tx=0x7f1e28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.324+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28039d60 con 0x7f1e2c06e410 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.324+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28043400 con 0x7f1e2c06e410 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.324+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280437b0 con 0x7f1e2c06e410 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.324+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c160440 con 0x7f1e2c06e410 2023-12-19T05:51:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.324+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c1487c0 con 0x7f1e2c06e410 2023-12-19T05:51:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.325+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c061910 con 0x7f1e2c06e410 2023-12-19T05:51:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.326+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e28043910 con 0x7f1e2c06e410 2023-12-19T05:51:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.327+0000 7f1e21ffb640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 0x7f1e1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.327+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1e2803e070 con 0x7f1e2c06e410 2023-12-19T05:51:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.327+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f1e10072020 con 0x7f1e2c06e410 2023-12-19T05:51:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.328+0000 7f1e30aa5640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 0x7f1e1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.329+0000 7f1e30aa5640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 0x7f1e1006c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ac370 tx=0x7f1e1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.331+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e28034060 con 0x7f1e2c06e410 2023-12-19T05:51:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.526+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e2c0af250 con 0x7f1e2c06e410 2023-12-19T05:51:56.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.528+0000 7f1e21ffb640 1 -- 172.21.15.49:0/1933988876 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16234 (secure 0 0 0) 0x7f1e28034070 con 0x7f1e2c06e410 2023-12-19T05:51:56.531 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:51:56.531 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":180,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:51:30.453607+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.531+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 msgr2=0x7f1e1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.531+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 0x7f1e1006c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ac370 tx=0x7f1e1c009040 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.531+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 msgr2=0x7f1e2c148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.531+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f1e2802b9e0 tx=0x7f1e28004730 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 shutdown_connections 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1e1006a430 0x7f1e1006c8f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e2c157aa0 0x7f1e2c15f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c15e040 0x7f1e2c157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 --2- 172.21.15.49:0/1933988876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e2c06e410 0x7f1e2c148280 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 >> 172.21.15.49:0/1933988876 conn(0x7f1e2c0cbb70 msgr2=0x7f1e2c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 shutdown_connections 2023-12-19T05:51:56.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.532+0000 7f1e3350a640 1 -- 172.21.15.49:0/1933988876 wait complete. 2023-12-19T05:51:56.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:50:35.985173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:50:37.054976+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:51:56.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:51:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.787+0000 7f91eb054640 1 Processor -- start 2023-12-19T05:51:56.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.787+0000 7f91eb054640 1 -- start start 2023-12-19T05:51:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.789+0000 7f91eb054640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91e41595c0 0x7f91e40cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.789+0000 7f91eb054640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e41599a0 con 0x7f91e40c9af0 2023-12-19T05:51:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.789+0000 7f91eb054640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40ca070 con 0x7f91e406f970 2023-12-19T05:51:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.789+0000 7f91eb054640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40ca350 con 0x7f91e41595c0 2023-12-19T05:51:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.789+0000 7f91e9851640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f91e40c9af0 0x7f91e406f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52716/0 (socket says 172.21.15.49:52716) 2023-12-19T05:51:56.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9851640 1 -- 172.21.15.49:0/1387653411 learned_addr learned my addr 172.21.15.49:0/1387653411 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:51:56.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91ea052640 1 --2- 172.21.15.49:0/1387653411 >> v2:172.21.15.115:3300/0 conn(0x7f91e41595c0 0x7f91e40cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280712669 0 0) 0x7f91e41599a0 con 0x7f91e40c9af0 2023-12-19T05:51:56.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d0003520 con 0x7f91e40c9af0 2023-12-19T05:51:56.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049330122 0 0) 0x7f91d0003520 con 0x7f91e40c9af0 2023-12-19T05:51:56.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 >> v2:172.21.15.115:3300/0 conn(0x7f91e41595c0 msgr2=0x7f91e40cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:56.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 --2- 172.21.15.49:0/1387653411 >> v2:172.21.15.115:3300/0 conn(0x7f91e41595c0 0x7f91e40cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.790+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 >> v1:172.21.15.115:6789/0 conn(0x7f91e406f970 legacy=0x7f91e40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40ca630 con 0x7f91e40c9af0 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f91d4001670 con 0x7f91e40c9af0 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 >> v1:172.21.15.49:6789/0 conn(0x7f91e40c9af0 legacy=0x7f91e406f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91d0003a30 0x7f91d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 0x7f91d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00051d0 0x7f91d000ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40ca350 con 0x7f91d00047c0 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d000d210 con 0x7f91d00051d0 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d000d3d0 con 0x7f91d0003a30 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 0x7f91d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 -- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91d0003a30 msgr2=0x7f91d0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91d0003a30 0x7f91d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 -- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00051d0 msgr2=0x7f91d000ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00051d0 0x7f91d000ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.791+0000 7f91e9851640 1 -- 172.21.15.49:0/1387653411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0003520 con 0x7f91d00047c0 2023-12-19T05:51:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.792+0000 7f91ea853640 1 -- 172.21.15.49:0/1387653411 reap_dead start 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91e9851640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 0x7f91d0004c40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f91d400c0e0 tx=0x7f91d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b3c9c7fc3a02b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4005ad0 con 0x7f91d00047c0 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4005c50 con 0x7f91d00047c0 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91e9050640 1 -- 172.21.15.49:0/1387653411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d402c7d0 con 0x7f91d00047c0 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91eb054640 1 -- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 msgr2=0x7f91d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.793+0000 7f91eb054640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 0x7f91d0004c40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f91d400c0e0 tx=0x7f91d00057f0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.794+0000 7f91eb054640 1 -- 172.21.15.49:0/1387653411 shutdown_connections 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.794+0000 7f91eb054640 1 --2- 172.21.15.49:0/1387653411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d00047c0 0x7f91d0004c40 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.794+0000 7f91eb054640 1 -- 172.21.15.49:0/1387653411 >> 172.21.15.49:0/1387653411 conn(0x7f91e40cb6c0 msgr2=0x7f91e40cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.794+0000 7f91eb054640 1 -- 172.21.15.49:0/1387653411 shutdown_connections 2023-12-19T05:51:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.794+0000 7f91eb054640 1 -- 172.21.15.49:0/1387653411 wait complete. 2023-12-19T05:51:56.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.796+0000 7f91eb054640 1 Processor -- start 2023-12-19T05:51:56.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.796+0000 7f91eb054640 1 -- start start 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00047c0 0x7f91e413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91e40acb20 0x7f91e4144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4144e10 con 0x7f91e40acf80 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4141d60 con 0x7f91d00047c0 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91eb054640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e406ca20 con 0x7f91e40acb20 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91ea853640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91ea853640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50204/0 (socket says 172.21.15.49:50204) 2023-12-19T05:51:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.797+0000 7f91ea853640 1 -- 172.21.15.49:0/725998397 learned_addr learned my addr 172.21.15.49:0/725998397 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91e9851640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91e40acb20 0x7f91e4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea052640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00047c0 0x7f91e413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 -- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91e40acb20 msgr2=0x7f91e4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91e40acb20 0x7f91e4144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 -- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00047c0 msgr2=0x7f91e413ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00047c0 0x7f91e413ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e406cd00 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91ea853640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b0e60 tx=0x7f91dc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc007070 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc0071d0 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e406cfe0 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.798+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc007580 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.799+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e41f2070 con 0x7f91e40acf80 2023-12-19T05:51:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.800+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e406c820 con 0x7f91e40acf80 2023-12-19T05:51:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.801+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91dc0076e0 con 0x7f91e40acf80 2023-12-19T05:51:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.802+0000 7f91daffd640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 0x7f91c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.802+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f91dc087e80 con 0x7f91e40acf80 2023-12-19T05:51:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.802+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f91c8072020 con 0x7f91e40acf80 2023-12-19T05:51:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.803+0000 7f91ea052640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 0x7f91c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.804+0000 7f91ea052640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 0x7f91c806c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f91e0004770 tx=0x7f91e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:56.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:56.806+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91dc017030 con 0x7f91e40acf80 2023-12-19T05:51:57.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.004+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91e4061910 con 0x7f91e40acf80 2023-12-19T05:51:57.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.005+0000 7f91daffd640 1 -- 172.21.15.49:0/725998397 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91dc017030 con 0x7f91e40acf80 2023-12-19T05:51:57.007 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 msgr2=0x7f91c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 0x7f91c806c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f91e0004770 tx=0x7f91e0008040 comp rx=0 tx=0).stop 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 msgr2=0x7f91e41448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b0e60 tx=0x7f91dc00c960 comp rx=0 tx=0).stop 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 shutdown_connections 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f91c806a430 0x7f91c806c8f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91e40acb20 0x7f91e4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e40acf80 0x7f91e41448d0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 --2- 172.21.15.49:0/725998397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91d00047c0 0x7f91e413ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.008+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 >> 172.21.15.49:0/725998397 conn(0x7f91e40cb6c0 msgr2=0x7f91e4159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:57.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.009+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 shutdown_connections 2023-12-19T05:51:57.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.009+0000 7f91eb054640 1 -- 172.21.15.49:0/725998397 wait complete. 2023-12-19T05:51:57.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:51:57.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.264+0000 7fdff7177640 1 Processor -- start 2023-12-19T05:51:57.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.265+0000 7fdff7177640 1 -- start start 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.266+0000 7fdff7177640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdff0157aa0 0x7fdff00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.266+0000 7fdff7177640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff006e8c0 con 0x7fdff015e040 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.266+0000 7fdff7177640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00b2600 con 0x7fdff006e410 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.266+0000 7fdff7177640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00b1d60 con 0x7fdff0157aa0 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.267+0000 7fdff5714640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdff015e040 0x7fdff00b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52730/0 (socket says 172.21.15.49:52730) 2023-12-19T05:51:57.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.267+0000 7fdff5714640 1 -- 172.21.15.49:0/73756615 learned_addr learned my addr 172.21.15.49:0/73756615 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:51:57.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.267+0000 7fdff4f13640 1 --2- 172.21.15.49:0/73756615 >> v2:172.21.15.115:3300/0 conn(0x7fdff0157aa0 0x7fdff00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.267+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611878686 0 0) 0x7fdff006e8c0 con 0x7fdff015e040 2023-12-19T05:51:57.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.267+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd8003520 con 0x7fdff015e040 2023-12-19T05:51:57.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 645754493 0 0) 0x7fdfd8003520 con 0x7fdff015e040 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 >> v2:172.21.15.115:3300/0 conn(0x7fdff0157aa0 msgr2=0x7fdff00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 --2- 172.21.15.49:0/73756615 >> v2:172.21.15.115:3300/0 conn(0x7fdff0157aa0 0x7fdff00b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 >> v1:172.21.15.115:6789/0 conn(0x7fdff006e410 legacy=0x7fdff0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00b2040 con 0x7fdff015e040 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fdfe80019f0 con 0x7fdff015e040 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 >> v1:172.21.15.49:6789/0 conn(0x7fdff015e040 legacy=0x7fdff00b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdfd8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfd80047c0 0x7fdfd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfd8005180 0x7fdfd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b1d60 con 0x7fdfd80039e0 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd800c0b0 con 0x7fdfd8005180 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd800c270 con 0x7fdfd80047c0 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.268+0000 7fdff4f13640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdfd8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdfeffff640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfd80047c0 0x7fdfd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff5714640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfd8005180 0x7fdfd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff4f13640 1 -- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfd80047c0 msgr2=0x7fdfd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff4f13640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfd80047c0 0x7fdfd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff4f13640 1 -- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfd8005180 msgr2=0x7fdfd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff4f13640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfd8005180 0x7fdfd800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff4f13640 1 -- 172.21.15.49:0/73756615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8003520 con 0x7fdfd80039e0 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdfeffff640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdfd80047c0 0x7fdfd8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff5714640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfd8005180 0x7fdfd800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.269+0000 7fdff5714640 1 -- 172.21.15.49:0/73756615 reap_dead start 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.270+0000 7fdff4f13640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdfd8003e00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ac0 tx=0x7fdfd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74821f76c3b8bd27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.270+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe402c6b0 con 0x7fdfd80039e0 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.270+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe402c810 con 0x7fdfd80039e0 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.270+0000 7fdfef7fe640 1 -- 172.21.15.49:0/73756615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe402cba0 con 0x7fdfd80039e0 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 -- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 msgr2=0x7fdfd8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdfd8003e00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ac0 tx=0x7fdfd80057f0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 -- 172.21.15.49:0/73756615 shutdown_connections 2023-12-19T05:51:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 --2- 172.21.15.49:0/73756615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdfd8003e00 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 -- 172.21.15.49:0/73756615 >> 172.21.15.49:0/73756615 conn(0x7fdff00cbb70 msgr2=0x7fdff00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 -- 172.21.15.49:0/73756615 shutdown_connections 2023-12-19T05:51:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.271+0000 7fdff7177640 1 -- 172.21.15.49:0/73756615 wait complete. 2023-12-19T05:51:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.273+0000 7fdff7177640 1 Processor -- start 2023-12-19T05:51:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.273+0000 7fdff7177640 1 -- start start 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 0x7fdff0148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff0158090 0x7fdff006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0158970 con 0x7fdfd80039e0 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0158c50 con 0x7fdff0156230 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff7177640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0158f30 con 0x7fdff0158090 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.274+0000 7fdff4f13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50228/0 (socket says 172.21.15.49:50228) 2023-12-19T05:51:57.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 -- 172.21.15.49:0/708410577 learned_addr learned my addr 172.21.15.49:0/708410577 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdfeffff640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 0x7fdff0148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff5714640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff0158090 0x7fdff006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 -- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff0158090 msgr2=0x7fdff006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff0158090 0x7fdff006c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 -- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 msgr2=0x7fdff0148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 0x7fdff0148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0159210 con 0x7fdfd80039e0 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdfeffff640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 0x7fdff0148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.275+0000 7fdff4f13640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdfe402c250 tx=0x7fdfe4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.276+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4003810 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.276+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4003970 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.276+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4003d00 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.276+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01594f0 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.276+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01586f0 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.277+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0061910 con 0x7fdfd80039e0 2023-12-19T05:51:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.278+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfe4034440 con 0x7fdfd80039e0 2023-12-19T05:51:57.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.279+0000 7fdfed7fa640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 0x7fdfdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.279+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdfe40aac00 con 0x7fdfd80039e0 2023-12-19T05:51:57.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.279+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7fdfdc072020 con 0x7fdfd80039e0 2023-12-19T05:51:57.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.280+0000 7fdfeffff640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 0x7fdfdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.281+0000 7fdfeffff640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 0x7fdfdc06c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdff00ac980 tx=0x7fdfe0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.283+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdfe404c060 con 0x7fdfd80039e0 2023-12-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.478+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdff00af250 con 0x7fdfd80039e0 2023-12-19T05:51:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.479+0000 7fdfed7fa640 1 -- 172.21.15.49:0/708410577 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfe4039020 con 0x7fdfd80039e0 2023-12-19T05:51:57.481 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:51:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 msgr2=0x7fdfdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 0x7fdfdc06c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdff00ac980 tx=0x7fdfe0009040 comp rx=0 tx=0).stop 2023-12-19T05:51:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 msgr2=0x7fdff0159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdfe402c250 tx=0x7fdfe4004730 comp rx=0 tx=0).stop 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 shutdown_connections 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdfdc06a430 0x7fdfdc06c8f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff0158090 0x7fdff006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0156230 0x7fdff0148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 --2- 172.21.15.49:0/708410577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfd80039e0 0x7fdff0159a10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.481+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 >> 172.21.15.49:0/708410577 conn(0x7fdff00cbb70 msgr2=0x7fdff00cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.482+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 shutdown_connections 2023-12-19T05:51:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.482+0000 7fdff7177640 1 -- 172.21.15.49:0/708410577 wait complete. 2023-12-19T05:51:57.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:51:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.737+0000 7f8b891f6640 1 Processor -- start 2023-12-19T05:51:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.737+0000 7f8b891f6640 1 -- start start 2023-12-19T05:51:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.738+0000 7f8b891f6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b84157bc0 0x7f8b840cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.738+0000 7f8b891f6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b840cfc20 0x7f8b840af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.738+0000 7f8b891f6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840b2ad0 con 0x7f8b840b2f60 2023-12-19T05:51:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.738+0000 7f8b891f6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840b24c0 con 0x7f8b840cfc20 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.738+0000 7f8b891f6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840d00a0 con 0x7f8b84157bc0 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b840cfc20 0x7f8b840af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b840cfc20 0x7f8b840af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50230/0 (socket says 172.21.15.49:50230) 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 -- 172.21.15.49:0/3967435611 learned_addr learned my addr 172.21.15.49:0/3967435611 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b82d9d640 1 --2- 172.21.15.49:0/3967435611 >> v2:172.21.15.115:3300/0 conn(0x7f8b84157bc0 0x7f8b840cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 -- 172.21.15.49:0/3967435611 >> v2:172.21.15.115:3300/0 conn(0x7f8b84157bc0 msgr2=0x7f8b840cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 --2- 172.21.15.49:0/3967435611 >> v2:172.21.15.115:3300/0 conn(0x7f8b84157bc0 0x7f8b840cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 -- 172.21.15.49:0/3967435611 >> v1:172.21.15.115:6789/0 conn(0x7f8b840b2f60 legacy=0x7f8b8406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.739+0000 7f8b8259c640 1 -- 172.21.15.49:0/3967435611 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840b2760 con 0x7f8b840cfc20 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.740+0000 7f8b8259c640 1 --2- 172.21.15.49:0/3967435611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840af720 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8b840b34a0 tx=0x7f8b7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65112bcd008770 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.741+0000 7f8b81d9b640 1 -- 172.21.15.49:0/3967435611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78031870 con 0x7f8b840cfc20 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.741+0000 7f8b81d9b640 1 -- 172.21.15.49:0/3967435611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b780319d0 con 0x7f8b840cfc20 2023-12-19T05:51:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.741+0000 7f8b81d9b640 1 -- 172.21.15.49:0/3967435611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78031d60 con 0x7f8b840cfc20 2023-12-19T05:51:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.741+0000 7f8b891f6640 1 -- 172.21.15.49:0/3967435611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 msgr2=0x7f8b840af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.741+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3967435611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840af720 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8b840b34a0 tx=0x7f8b7802b910 comp rx=0 tx=0).stop 2023-12-19T05:51:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 -- 172.21.15.49:0/3967435611 shutdown_connections 2023-12-19T05:51:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3967435611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840af720 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3967435611 >> v2:172.21.15.115:3300/0 conn(0x7f8b84157bc0 0x7f8b840cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 -- 172.21.15.49:0/3967435611 >> 172.21.15.49:0/3967435611 conn(0x7f8b8406b950 msgr2=0x7f8b8406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 -- 172.21.15.49:0/3967435611 shutdown_connections 2023-12-19T05:51:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.742+0000 7f8b891f6640 1 -- 172.21.15.49:0/3967435611 wait complete. 2023-12-19T05:51:57.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.743+0000 7f8b891f6640 1 Processor -- start 2023-12-19T05:51:57.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.744+0000 7f8b891f6640 1 -- start start 2023-12-19T05:51:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b840b2f60 0x7f8b8415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 0x7f8b840cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840b5330 con 0x7f8b840cfc20 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840b57c0 con 0x7f8b84157bc0 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b891f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840b4e50 con 0x7f8b840b2f60 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50246/0 (socket says 172.21.15.49:50246) 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8259c640 1 -- 172.21.15.49:0/3910554306 learned_addr learned my addr 172.21.15.49:0/3910554306 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b82d9d640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b840b2f60 0x7f8b8415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8259c640 1 -- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b840b2f60 msgr2=0x7f8b8415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8359e640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 0x7f8b840cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.745+0000 7f8b8259c640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b840b2f60 0x7f8b8415cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b8259c640 1 -- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 msgr2=0x7f8b840cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b8259c640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 0x7f8b840cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b8259c640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780094d0 con 0x7f8b840cfc20 2023-12-19T05:51:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b8359e640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 0x7f8b840cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:51:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b8259c640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8b7802b950 tx=0x7f8b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7803abe0 con 0x7f8b840cfc20 2023-12-19T05:51:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7803ad60 con 0x7f8b840cfc20 2023-12-19T05:51:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78044630 con 0x7f8b840cfc20 2023-12-19T05:51:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b84155990 con 0x7f8b840cfc20 2023-12-19T05:51:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.746+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b840b4a00 con 0x7f8b840cfc20 2023-12-19T05:51:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.748+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b840b4bf0 con 0x7f8b840cfc20 2023-12-19T05:51:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.749+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b7804d450 con 0x7f8b840cfc20 2023-12-19T05:51:57.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.750+0000 7f8b6b7fe640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 0x7f8b7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:57.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.750+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8b7802d040 con 0x7f8b840cfc20 2023-12-19T05:51:57.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.750+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f8b70072020 con 0x7f8b840cfc20 2023-12-19T05:51:57.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.750+0000 7f8b82d9d640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 0x7f8b7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:57.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.752+0000 7f8b82d9d640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 0x7f8b7006c8f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009fd0 tx=0x7f8b7400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:57.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.754+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b78035060 con 0x7f8b840cfc20 2023-12-19T05:51:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.948+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b84061910 con 0x7f8b840cfc20 2023-12-19T05:51:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.949+0000 7f8b6b7fe640 1 -- 172.21.15.49:0/3910554306 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b78035020 con 0x7f8b840cfc20 2023-12-19T05:51:57.951 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:51:57.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.951+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 msgr2=0x7f8b7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.951+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 0x7f8b7006c8f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009fd0 tx=0x7f8b7400b040 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.951+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 msgr2=0x7f8b840cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.951+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8b7802b950 tx=0x7f8b780046c0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 shutdown_connections 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8b7006a430 0x7f8b7006c8f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b84157bc0 0x7f8b840cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b840cfc20 0x7f8b840cc780 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 --2- 172.21.15.49:0/3910554306 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b840b2f60 0x7f8b8415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 >> 172.21.15.49:0/3910554306 conn(0x7f8b8406b950 msgr2=0x7f8b8406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 shutdown_connections 2023-12-19T05:51:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:57.952+0000 7f8b891f6640 1 -- 172.21.15.49:0/3910554306 wait complete. 2023-12-19T05:51:57.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:51:58.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.203+0000 7f28cd56e640 1 Processor -- start 2023-12-19T05:51:58.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.204+0000 7f28cd56e640 1 -- start start 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.205+0000 7f28cd56e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f28c80ae110 0x7f28c80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.205+0000 7f28cd56e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b0a60 con 0x7f28c8157bf0 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.205+0000 7f28cd56e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80ae640 con 0x7f28c80b0640 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.205+0000 7f28cd56e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c806b8c0 con 0x7f28c80ae110 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c6ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f28c8157bf0 0x7f28c815b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52732/0 (socket says 172.21.15.49:52732) 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c6ffd640 1 -- 172.21.15.49:0/1199238702 learned_addr learned my addr 172.21.15.49:0/1199238702 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:51:58.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c67fc640 1 --2- 172.21.15.49:0/1199238702 >> v2:172.21.15.49:3300/0 conn(0x7f28c80ae110 0x7f28c80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c5ffb640 1 -- 172.21.15.49:0/1199238702 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579381448 0 0) 0x7f28c80b0a60 con 0x7f28c8157bf0 2023-12-19T05:51:58.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c5ffb640 1 -- 172.21.15.49:0/1199238702 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b4005730 con 0x7f28c8157bf0 2023-12-19T05:51:58.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c67fc640 1 -- 172.21.15.49:0/1199238702 >> v1:172.21.15.115:6789/0 conn(0x7f28c80b0640 legacy=0x7f28c806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c67fc640 1 -- 172.21.15.49:0/1199238702 >> v1:172.21.15.49:6789/0 conn(0x7f28c8157bf0 legacy=0x7f28c815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.206+0000 7f28c67fc640 1 -- 172.21.15.49:0/1199238702 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80ae920 con 0x7f28c80ae110 2023-12-19T05:51:58.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.207+0000 7f28c67fc640 1 --2- 172.21.15.49:0/1199238702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c80ae110 0x7f28c80b0100 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a2b36cef06e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:58.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28c5ffb640 1 -- 172.21.15.49:0/1199238702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0030610 con 0x7f28c80ae110 2023-12-19T05:51:58.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28c5ffb640 1 -- 172.21.15.49:0/1199238702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0030770 con 0x7f28c80ae110 2023-12-19T05:51:58.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28c5ffb640 1 -- 172.21.15.49:0/1199238702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0030b00 con 0x7f28c80ae110 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 -- 172.21.15.49:0/1199238702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c80ae110 msgr2=0x7f28c80b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 --2- 172.21.15.49:0/1199238702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c80ae110 0x7f28c80b0100 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002b960 comp rx=0 tx=0).stop 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 -- 172.21.15.49:0/1199238702 shutdown_connections 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 --2- 172.21.15.49:0/1199238702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c80ae110 0x7f28c80b0100 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 -- 172.21.15.49:0/1199238702 >> 172.21.15.49:0/1199238702 conn(0x7f28c80cbb70 msgr2=0x7f28c80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:58.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.208+0000 7f28cd56e640 1 -- 172.21.15.49:0/1199238702 shutdown_connections 2023-12-19T05:51:58.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.209+0000 7f28cd56e640 1 -- 172.21.15.49:0/1199238702 wait complete. 2023-12-19T05:51:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.210+0000 7f28cd56e640 1 Processor -- start 2023-12-19T05:51:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.210+0000 7f28cd56e640 1 -- start start 2023-12-19T05:51:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28c80ae110 0x7f28c81f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28c80b0640 0x7f28c81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c814b4d0 con 0x7f28c8157bf0 2023-12-19T05:51:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81f2bb0 con 0x7f28c80b0640 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.211+0000 7f28cd56e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80cdc30 con 0x7f28c80ae110 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50268/0 (socket says 172.21.15.49:50268) 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 -- 172.21.15.49:0/3273250810 learned_addr learned my addr 172.21.15.49:0/3273250810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c67fc640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28c80b0640 0x7f28c81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c6ffd640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28c80ae110 0x7f28c81f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 -- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28c80ae110 msgr2=0x7f28c81f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28c80ae110 0x7f28c81f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 -- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28c80b0640 msgr2=0x7f28c81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28c80b0640 0x7f28c81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009400 con 0x7f28c8157bf0 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.212+0000 7f28c77fe640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f28c0001eb0 tx=0x7f28c000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.213+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00052d0 con 0x7f28c8157bf0 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.213+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0005430 con 0x7f28c8157bf0 2023-12-19T05:51:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.213+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0003810 con 0x7f28c8157bf0 2023-12-19T05:51:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.213+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c80cdf10 con 0x7f28c8157bf0 2023-12-19T05:51:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.213+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c80ce4d0 con 0x7f28c8157bf0 2023-12-19T05:51:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.214+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8061910 con 0x7f28c8157bf0 2023-12-19T05:51:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.215+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f28c0003970 con 0x7f28c8157bf0 2023-12-19T05:51:58.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.216+0000 7f28bf7fe640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 0x7f28a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.216+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f28c0087fa0 con 0x7f28c8157bf0 2023-12-19T05:51:58.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.216+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f28a8072020 con 0x7f28c8157bf0 2023-12-19T05:51:58.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.217+0000 7f28c6ffd640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 0x7f28a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.218+0000 7f28c6ffd640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 0x7f28a806c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f28b8001560 tx=0x7f28b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:58.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.221+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f28c00bac80 con 0x7f28c8157bf0 2023-12-19T05:51:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.430+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28c80cb240 con 0x7f28c8157bf0 2023-12-19T05:51:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.431+0000 7f28bf7fe640 1 -- 172.21.15.49:0/3273250810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28c0059080 con 0x7f28c8157bf0 2023-12-19T05:51:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 msgr2=0x7f28a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 0x7f28a806c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f28b8001560 tx=0x7f28b8009040 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 msgr2=0x7f28c8158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f28c0001eb0 tx=0x7f28c000c890 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 shutdown_connections 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f28a806a430 0x7f28a806c8f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c8157bf0 0x7f28c8158f00 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28c80b0640 0x7f28c81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 --2- 172.21.15.49:0/3273250810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28c80ae110 0x7f28c81f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 >> 172.21.15.49:0/3273250810 conn(0x7f28c80cbb70 msgr2=0x7f28c80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 shutdown_connections 2023-12-19T05:51:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.434+0000 7f28cd56e640 1 -- 172.21.15.49:0/3273250810 wait complete. 2023-12-19T05:51:58.455 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:51:58.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:51:58.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:51:58.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:51:58.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:51:58.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:51:58.615 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:51:58.616 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:58.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:51:58.680 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:51:58.681 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:51:58.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:51:58.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:51:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.984+0000 7f5023100640 1 Processor -- start 2023-12-19T05:51:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.984+0000 7f5023100640 1 -- start start 2023-12-19T05:51:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5023100640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0b1710 0x7f501c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5023100640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5023100640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c15e9c0 con 0x7f501c157aa0 2023-12-19T05:51:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5023100640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0b2600 con 0x7f501c0b1710 2023-12-19T05:51:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5023100640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b1d60 con 0x7f501c15e040 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5013fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0b1710 0x7f501c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5013fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f501c0b1710 0x7f501c06e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50282/0 (socket says 172.21.15.49:50282) 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.986+0000 7f5013fff640 1 -- 172.21.15.49:0/3603864960 learned_addr learned my addr 172.21.15.49:0/3603864960 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.987+0000 7f502169d640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.987+0000 7f5013fff640 1 -- 172.21.15.49:0/3603864960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 msgr2=0x7f501c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.987+0000 7f5013fff640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.987+0000 7f5013fff640 1 -- 172.21.15.49:0/3603864960 >> v1:172.21.15.115:6789/0 conn(0x7f501c157aa0 legacy=0x7f501c161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.987+0000 7f5013fff640 1 -- 172.21.15.49:0/3603864960 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0b2040 con 0x7f501c0b1710 2023-12-19T05:51:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.988+0000 7f5013fff640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c06e410 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f500c009870 tx=0x7f500c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276441263051f2b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f50137fe640 1 -- 172.21.15.49:0/3603864960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c030840 con 0x7f501c0b1710 2023-12-19T05:51:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f50137fe640 1 -- 172.21.15.49:0/3603864960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0309a0 con 0x7f501c0b1710 2023-12-19T05:51:58.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f50137fe640 1 -- 172.21.15.49:0/3603864960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c030d30 con 0x7f501c0b1710 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 -- 172.21.15.49:0/3603864960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 msgr2=0x7f501c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c06e410 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f500c009870 tx=0x7f500c02b980 comp rx=0 tx=0).stop 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 -- 172.21.15.49:0/3603864960 shutdown_connections 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 --2- 172.21.15.49:0/3603864960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c06e410 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 -- 172.21.15.49:0/3603864960 >> 172.21.15.49:0/3603864960 conn(0x7f501c0cbb70 msgr2=0x7f501c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.989+0000 7f5023100640 1 -- 172.21.15.49:0/3603864960 shutdown_connections 2023-12-19T05:51:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.990+0000 7f5023100640 1 -- 172.21.15.49:0/3603864960 wait complete. 2023-12-19T05:51:58.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.991+0000 7f5023100640 1 Processor -- start 2023-12-19T05:51:58.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.991+0000 7f5023100640 1 -- start start 2023-12-19T05:51:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c157aa0 0x7f501c1f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c14d3d0 con 0x7f501c0b1710 2023-12-19T05:51:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c1f3d10 con 0x7f501c157aa0 2023-12-19T05:51:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.992+0000 7f5023100640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c1515f0 con 0x7f501c15e040 2023-12-19T05:51:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50294/0 (socket says 172.21.15.49:50294) 2023-12-19T05:51:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 -- 172.21.15.49:0/2059336489 learned_addr learned my addr 172.21.15.49:0/2059336489 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f502169d640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5013fff640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c157aa0 0x7f501c1f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 -- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 msgr2=0x7f501c1f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c1f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 -- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c157aa0 msgr2=0x7f501c1f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c157aa0 0x7f501c1f37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.993+0000 7f5020e9c640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0094d0 con 0x7f501c0b1710 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f5020e9c640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f501800c870 tx=0x7f501800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018003b70 con 0x7f501c0b1710 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018003cf0 con 0x7f501c0b1710 2023-12-19T05:51:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800aa90 con 0x7f501c0b1710 2023-12-19T05:51:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c154750 con 0x7f501c0b1710 2023-12-19T05:51:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.994+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c154d10 con 0x7f501c0b1710 2023-12-19T05:51:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.995+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c061910 con 0x7f501c0b1710 2023-12-19T05:51:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.996+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f501800abf0 con 0x7f501c0b1710 2023-12-19T05:51:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.997+0000 7f50117fa640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 0x7f500806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.997+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f50180888d0 con 0x7f501c0b1710 2023-12-19T05:51:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.997+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f5008072020 con 0x7f501c0b1710 2023-12-19T05:51:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.998+0000 7f5013fff640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 0x7f500806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:58.999+0000 7f5013fff640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 0x7f500806c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f500c036000 tx=0x7f500c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.002+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5018003e60 con 0x7f501c0b1710 2023-12-19T05:51:59.217 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:59.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.238+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f501c071ae0 con 0x7f501c0b1710 2023-12-19T05:51:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.239+0000 7f50117fa640 1 -- 172.21.15.49:0/2059336489 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f5018053de0 con 0x7f501c0b1710 2023-12-19T05:51:59.241 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:51:59.241 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:51:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:51:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 msgr2=0x7f500806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 0x7f500806c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f500c036000 tx=0x7f500c03b040 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 msgr2=0x7f501c155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f501800c870 tx=0x7f501800cd30 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 shutdown_connections 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f500806a430 0x7f500806c8f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c15e040 0x7f501c1f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c157aa0 0x7f501c1f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 --2- 172.21.15.49:0/2059336489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f501c0b1710 0x7f501c155230 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 >> 172.21.15.49:0/2059336489 conn(0x7f501c0cbb70 msgr2=0x7f501c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 shutdown_connections 2023-12-19T05:51:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.242+0000 7f5023100640 1 -- 172.21.15.49:0/2059336489 wait complete. 2023-12-19T05:51:59.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:51:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.523+0000 7fcd18f3d640 1 Processor -- start 2023-12-19T05:51:59.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.523+0000 7fcd18f3d640 1 -- start start 2023-12-19T05:51:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd18f3d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd1415e5a0 0x7fcd140b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd18f3d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1415ec30 con 0x7fcd1415f680 2023-12-19T05:51:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd18f3d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1415e980 con 0x7fcd140cdbf0 2023-12-19T05:51:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd18f3d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd140b2f90 con 0x7fcd1415e5a0 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd1415e5a0 0x7fcd140b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd1415e5a0 0x7fcd140b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50306/0 (socket says 172.21.15.49:50306) 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd137fe640 1 -- 172.21.15.49:0/1984607576 learned_addr learned my addr 172.21.15.49:0/1984607576 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.525+0000 7fcd0affd640 1 --1- 172.21.15.49:0/1984607576 >> v1:172.21.15.49:6789/0 conn(0x7fcd1415f680 0x7fcd140b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52742/0 (socket says 172.21.15.49:52742) 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.526+0000 7fcd137fe640 1 -- 172.21.15.49:0/1984607576 >> v1:172.21.15.115:6789/0 conn(0x7fcd140cdbf0 legacy=0x7fcd1406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.526+0000 7fcd137fe640 1 -- 172.21.15.49:0/1984607576 >> v1:172.21.15.49:6789/0 conn(0x7fcd1415f680 legacy=0x7fcd140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.526+0000 7fcd137fe640 1 -- 172.21.15.49:0/1984607576 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140b3270 con 0x7fcd1415e5a0 2023-12-19T05:51:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.527+0000 7fcd137fe640 1 --2- 172.21.15.49:0/1984607576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140b2030 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009e80 tx=0x7fcd0402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d988d38de5ec68d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.527+0000 7fcd12ffd640 1 -- 172.21.15.49:0/1984607576 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0402cb00 con 0x7fcd1415e5a0 2023-12-19T05:51:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.527+0000 7fcd12ffd640 1 -- 172.21.15.49:0/1984607576 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0402cc60 con 0x7fcd1415e5a0 2023-12-19T05:51:59.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.527+0000 7fcd12ffd640 1 -- 172.21.15.49:0/1984607576 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040343f0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 -- 172.21.15.49:0/1984607576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 msgr2=0x7fcd140b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/1984607576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140b2030 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009e80 tx=0x7fcd0402bf60 comp rx=0 tx=0).stop 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 -- 172.21.15.49:0/1984607576 shutdown_connections 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/1984607576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140b2030 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 -- 172.21.15.49:0/1984607576 >> 172.21.15.49:0/1984607576 conn(0x7fcd140b0100 msgr2=0x7fcd140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 -- 172.21.15.49:0/1984607576 shutdown_connections 2023-12-19T05:51:59.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.528+0000 7fcd18f3d640 1 -- 172.21.15.49:0/1984607576 wait complete. 2023-12-19T05:51:59.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.530+0000 7fcd18f3d640 1 Processor -- start 2023-12-19T05:51:59.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.530+0000 7fcd18f3d640 1 -- start start 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd140cdbf0 0x7fcd140ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd1415f680 0x7fcd140b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c9900 con 0x7fcd1415e5a0 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c8c80 con 0x7fcd140cdbf0 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.531+0000 7fcd18f3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c8f60 con 0x7fcd1415f680 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:59.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50308/0 (socket says 172.21.15.49:50308) 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 -- 172.21.15.49:0/2825464388 learned_addr learned my addr 172.21.15.49:0/2825464388 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd137fe640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd140cdbf0 0x7fcd140ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 -- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd1415f680 msgr2=0x7fcd140b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd1415f680 0x7fcd140b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 -- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd140cdbf0 msgr2=0x7fcd140ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd140cdbf0 0x7fcd140ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.532+0000 7fcd0affd640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04009b30 con 0x7fcd1415e5a0 2023-12-19T05:51:59.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd0affd640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c4d0 tx=0x7fccfc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc007480 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc0075e0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0049e0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd140c9240 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.533+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140cacf0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.534+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd141f32e0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.535+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fccfc004b40 con 0x7fcd1415e5a0 2023-12-19T05:51:59.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.536+0000 7fcd10ff9640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 0x7fccf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:51:59.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.536+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fccfc087a10 con 0x7fcd1415e5a0 2023-12-19T05:51:59.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.536+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7fccf4072020 con 0x7fcd1415e5a0 2023-12-19T05:51:59.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.537+0000 7fcd137fe640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 0x7fccf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:51:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.538+0000 7fcd137fe640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 0x7fccf406c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcd04035000 tx=0x7fcd04030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:51:59.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.540+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fccfc018020 con 0x7fcd1415e5a0 2023-12-19T05:51:59.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.739+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd14061910 con 0x7fcd1415e5a0 2023-12-19T05:51:59.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.742+0000 7fcd10ff9640 1 -- 172.21.15.49:0/2825464388 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16234 (secure 0 0 0) 0x7fcd141f32e0 con 0x7fcd1415e5a0 2023-12-19T05:51:59.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:51:59.745 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":180,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:51:30.453607+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:51:59.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.745+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 msgr2=0x7fccf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.745+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 0x7fccf406c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcd04035000 tx=0x7fcd04030000 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 msgr2=0x7fcd140c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c4d0 tx=0x7fccfc00c990 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 shutdown_connections 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fccf406a430 0x7fccf406c8f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd1415f680 0x7fcd140b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd1415e5a0 0x7fcd140c8310 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 --2- 172.21.15.49:0/2825464388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd140cdbf0 0x7fcd140ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 >> 172.21.15.49:0/2825464388 conn(0x7fcd140b0100 msgr2=0x7fcd1415b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 shutdown_connections 2023-12-19T05:51:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:51:59.746+0000 7fcd18f3d640 1 -- 172.21.15.49:0/2825464388 wait complete. 2023-12-19T05:51:59.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:50:35.985173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:50:37.054976+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:51:59.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:52:00.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.003+0000 7f45549a2640 1 Processor -- start 2023-12-19T05:52:00.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.003+0000 7f45549a2640 1 -- start start 2023-12-19T05:52:00.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.005+0000 7f45549a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45500b0470 0x7f45500b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.005+0000 7f45549a2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f455014b0b0 0x7f45500b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.005+0000 7f45549a2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500b21d0 con 0x7f455014acd0 2023-12-19T05:52:00.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.005+0000 7f45549a2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500b2410 con 0x7f455014b0b0 2023-12-19T05:52:00.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.005+0000 7f45549a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b26f0 con 0x7f45500b0470 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.006+0000 7f454ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f455014b0b0 0x7f45500b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.006+0000 7f4547fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45500b0470 0x7f45500b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.006+0000 7f454ffff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f455014b0b0 0x7f45500b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:45722/0 (socket says 172.21.15.49:45722) 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.006+0000 7f454ffff640 1 -- 172.21.15.49:0/1112662808 learned_addr learned my addr 172.21.15.49:0/1112662808 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.007+0000 7f454ffff640 1 -- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45500b0470 msgr2=0x7f45500b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.007+0000 7f454ffff640 1 --2- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45500b0470 0x7f45500b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.007+0000 7f454ffff640 1 -- 172.21.15.49:0/1112662808 >> v1:172.21.15.115:6789/0 conn(0x7f455014acd0 legacy=0x7f45500afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.007+0000 7f454ffff640 1 -- 172.21.15.49:0/1112662808 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500ce030 con 0x7f455014b0b0 2023-12-19T05:52:00.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.009+0000 7f454ffff640 1 --2- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f455014b0b0 0x7f45500b1c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f454802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace6d43d995790d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.009+0000 7f454effd640 1 -- 172.21.15.49:0/1112662808 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454802cb00 con 0x7f455014b0b0 2023-12-19T05:52:00.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.009+0000 7f454effd640 1 -- 172.21.15.49:0/1112662808 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454802cc60 con 0x7f455014b0b0 2023-12-19T05:52:00.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.009+0000 7f454effd640 1 -- 172.21.15.49:0/1112662808 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480343f0 con 0x7f455014b0b0 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 -- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f455014b0b0 msgr2=0x7f45500b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 --2- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f455014b0b0 0x7f45500b1c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f454802bf60 comp rx=0 tx=0).stop 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 -- 172.21.15.49:0/1112662808 shutdown_connections 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 --2- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f455014b0b0 0x7f45500b1c90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 --2- 172.21.15.49:0/1112662808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45500b0470 0x7f45500b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 -- 172.21.15.49:0/1112662808 >> 172.21.15.49:0/1112662808 conn(0x7f455006f630 msgr2=0x7f455006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 -- 172.21.15.49:0/1112662808 shutdown_connections 2023-12-19T05:52:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.010+0000 7f45549a2640 1 -- 172.21.15.49:0/1112662808 wait complete. 2023-12-19T05:52:00.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.012+0000 7f45549a2640 1 Processor -- start 2023-12-19T05:52:00.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.012+0000 7f45549a2640 1 -- start start 2023-12-19T05:52:00.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45500b0470 0x7f4550160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f455014acd0 0x7f45500aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500aaf20 con 0x7f455014b0b0 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500ad340 con 0x7f45500b0470 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f45549a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500ad060 con 0x7f455014acd0 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f454ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f454ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50320/0 (socket says 172.21.15.49:50320) 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.013+0000 7f454ffff640 1 -- 172.21.15.49:0/1135991467 learned_addr learned my addr 172.21.15.49:0/1135991467 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f4547fff640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f455014acd0 0x7f45500aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454f7fe640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45500b0470 0x7f4550160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 -- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f455014acd0 msgr2=0x7f45500aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f455014acd0 0x7f45500aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 -- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45500b0470 msgr2=0x7f4550160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45500b0470 0x7f4550160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009b30 con 0x7f455014b0b0 2023-12-19T05:52:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.014+0000 7f454ffff640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f4548004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.015+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548009510 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.015+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454803e450 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.015+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454803e800 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.015+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500aa8d0 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.015+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4550148a50 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.016+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500ab090 con 0x7f455014b0b0 2023-12-19T05:52:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.017+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f454803e960 con 0x7f455014b0b0 2023-12-19T05:52:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.018+0000 7f454cff9640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 0x7f453006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.018+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f45480ab7a0 con 0x7f455014b0b0 2023-12-19T05:52:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.018+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f4530072020 con 0x7f455014b0b0 2023-12-19T05:52:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.019+0000 7f454f7fe640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 0x7f453006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.020+0000 7f454f7fe640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 0x7f453006c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f60 tx=0x7f4540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.022+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4548076c20 con 0x7f455014b0b0 2023-12-19T05:52:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.215+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4550061910 con 0x7f455014b0b0 2023-12-19T05:52:00.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.216+0000 7f454cff9640 1 -- 172.21.15.49:0/1135991467 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f454807a240 con 0x7f455014b0b0 2023-12-19T05:52:00.218 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:52:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 msgr2=0x7f453006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 0x7f453006c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f60 tx=0x7f4540009040 comp rx=0 tx=0).stop 2023-12-19T05:52:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 msgr2=0x7f4550148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f4548004a40 comp rx=0 tx=0).stop 2023-12-19T05:52:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 shutdown_connections 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f453006a430 0x7f453006c8f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f455014acd0 0x7f45500aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455014b0b0 0x7f4550148510 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 --2- 172.21.15.49:0/1135991467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45500b0470 0x7f4550160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.219+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 >> 172.21.15.49:0/1135991467 conn(0x7f455006f630 msgr2=0x7f45500b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.220+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 shutdown_connections 2023-12-19T05:52:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.220+0000 7f45549a2640 1 -- 172.21.15.49:0/1135991467 wait complete. 2023-12-19T05:52:00.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:52:00.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.482+0000 7f3657641640 1 Processor -- start 2023-12-19T05:52:00.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.482+0000 7f3657641640 1 -- start start 2023-12-19T05:52:00.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f3657641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f365015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f3657641640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365015caf0 con 0x7f3650158f30 2023-12-19T05:52:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f3657641640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650071370 con 0x7f36500cdd20 2023-12-19T05:52:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f3657641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cf290 con 0x7f365006dc60 2023-12-19T05:52:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f36553dd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3650158f30 0x7f36500cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52758/0 (socket says 172.21.15.49:52758) 2023-12-19T05:52:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f36553dd640 1 -- 172.21.15.49:0/3688423392 learned_addr learned my addr 172.21.15.49:0/3688423392 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.484+0000 7f3655bde640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f365015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562244713 0 0) 0x7f365015caf0 con 0x7f3650158f30 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f363c003520 con 0x7f3650158f30 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653213846 0 0) 0x7f363c003520 con 0x7f3650158f30 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 msgr2=0x7f365015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f365015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 >> v1:172.21.15.115:6789/0 conn(0x7f36500cdd20 legacy=0x7f365006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365006bf10 con 0x7f3650158f30 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f364c0019f0 con 0x7f3650158f30 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 >> v1:172.21.15.49:6789/0 conn(0x7f3650158f30 legacy=0x7f36500cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f363c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f363c003fe0 0x7f363c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c004d00 0x7f363c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cf290 con 0x7f363c003fe0 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c00bb40 con 0x7f363c004d00 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c00bd00 con 0x7f365006dc60 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.485+0000 7f3654bdc640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f363c003fe0 0x7f363c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f36553dd640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f363c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3655bde640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c004d00 0x7f363c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3654bdc640 1 -- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 msgr2=0x7f363c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3654bdc640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f365006dc60 0x7f363c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3654bdc640 1 -- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c004d00 msgr2=0x7f363c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3654bdc640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c004d00 0x7f363c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.486+0000 7f3654bdc640 1 -- 172.21.15.49:0/3688423392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c003520 con 0x7f363c003fe0 2023-12-19T05:52:00.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.487+0000 7f3654bdc640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f363c003fe0 0x7f363c0047c0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f3640001750 tx=0x7f363c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ded5002d68b6cb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400052d0 con 0x7f363c003fe0 2023-12-19T05:52:00.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364002e050 con 0x7f363c003fe0 2023-12-19T05:52:00.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3647fff640 1 -- 172.21.15.49:0/3688423392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640003830 con 0x7f363c003fe0 2023-12-19T05:52:00.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3657641640 1 -- 172.21.15.49:0/3688423392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f363c003fe0 msgr2=0x7f363c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3657641640 1 --2- 172.21.15.49:0/3688423392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f363c003fe0 0x7f363c0047c0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f3640001750 tx=0x7f363c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3655bde640 1 -- 172.21.15.49:0/3688423392 reap_dead start 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3657641640 1 -- 172.21.15.49:0/3688423392 shutdown_connections 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.488+0000 7f3657641640 1 -- 172.21.15.49:0/3688423392 >> 172.21.15.49:0/3688423392 conn(0x7f36500cf8e0 msgr2=0x7f36500cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.489+0000 7f3657641640 1 -- 172.21.15.49:0/3688423392 shutdown_connections 2023-12-19T05:52:00.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.489+0000 7f3657641640 1 -- 172.21.15.49:0/3688423392 wait complete. 2023-12-19T05:52:00.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.490+0000 7f3657641640 1 Processor -- start 2023-12-19T05:52:00.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.491+0000 7f3657641640 1 -- start start 2023-12-19T05:52:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.491+0000 7f3657641640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c003fe0 0x7f3650159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.491+0000 7f3657641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3657641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3650150ff0 0x7f3650151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3657641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501519c0 con 0x7f365014d1f0 2023-12-19T05:52:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3657641640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365014c470 con 0x7f363c003fe0 2023-12-19T05:52:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3657641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365014c710 con 0x7f3650150ff0 2023-12-19T05:52:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50348/0 (socket says 172.21.15.49:50348) 2023-12-19T05:52:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 -- 172.21.15.49:0/2647615060 learned_addr learned my addr 172.21.15.49:0/2647615060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f36553dd640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c003fe0 0x7f3650159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3655bde640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3650150ff0 0x7f3650151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 -- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3650150ff0 msgr2=0x7f3650151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3650150ff0 0x7f3650151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 -- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c003fe0 msgr2=0x7f3650159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c003fe0 0x7f3650159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.492+0000 7f3654bdc640 1 -- 172.21.15.49:0/2647615060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365014c9f0 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3654bdc640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3640008fd0 tx=0x7f3640001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400076c0 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640007a30 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640006c00 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365014ccd0 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.493+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365015ac00 con 0x7f365014d1f0 2023-12-19T05:52:00.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.495+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650074770 con 0x7f365014d1f0 2023-12-19T05:52:00.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.495+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36400035f0 con 0x7f365014d1f0 2023-12-19T05:52:00.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.496+0000 7f3645ffb640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 0x7f363406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.496+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f36400aaa60 con 0x7f365014d1f0 2023-12-19T05:52:00.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.497+0000 7f36553dd640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 0x7f363406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.498+0000 7f36553dd640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 0x7f363406c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f364c0013d0 tx=0x7f364c001ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.501+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3640075f70 con 0x7f365014d1f0 2023-12-19T05:52:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.696+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f365014ce60 con 0x7f365014d1f0 2023-12-19T05:52:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.697+0000 7f3645ffb640 1 -- 172.21.15.49:0/2647615060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3640079590 con 0x7f365014d1f0 2023-12-19T05:52:00.698 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.699+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 msgr2=0x7f363406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.699+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 0x7f363406c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f364c0013d0 tx=0x7f364c001ea0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.699+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 msgr2=0x7f365014a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.699+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3640008fd0 tx=0x7f3640001120 comp rx=0 tx=0).stop 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 shutdown_connections 2023-12-19T05:52:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f363406a430 0x7f363406c8f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3650150ff0 0x7f3650151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f365014d1f0 0x7f365014a420 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 --2- 172.21.15.49:0/2647615060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f363c003fe0 0x7f3650159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 >> 172.21.15.49:0/2647615060 conn(0x7f36500cf8e0 msgr2=0x7f36500aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 shutdown_connections 2023-12-19T05:52:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.700+0000 7f3657641640 1 -- 172.21.15.49:0/2647615060 wait complete. 2023-12-19T05:52:00.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:52:00.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.953+0000 7f87e0e7d640 1 Processor -- start 2023-12-19T05:52:00.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.953+0000 7f87e0e7d640 1 -- start start 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.955+0000 7f87e0e7d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87dc15b1d0 0x7f87dc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.955+0000 7f87e0e7d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 0x7f87dc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.955+0000 7f87e0e7d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc15ef10 con 0x7f87dc0ceea0 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.955+0000 7f87e0e7d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2320 con 0x7f87dc15b1d0 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.955+0000 7f87e0e7d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2e40 con 0x7f87dc0b1ec0 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87dad9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f87dc0ceea0 0x7f87dc06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52774/0 (socket says 172.21.15.49:52774) 2023-12-19T05:52:00.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87dad9d640 1 -- 172.21.15.49:0/1667841804 learned_addr learned my addr 172.21.15.49:0/1667841804 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:00.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87da59c640 1 --2- 172.21.15.49:0/1667841804 >> v2:172.21.15.115:3300/0 conn(0x7f87dc15b1d0 0x7f87dc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87d3fff640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 0x7f87dc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543179107 0 0) 0x7f87dc15ef10 con 0x7f87dc0ceea0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c8003520 con 0x7f87dc0ceea0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.956+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617150400 0 0) 0x7f87c8003520 con 0x7f87dc0ceea0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 msgr2=0x7f87dc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 0x7f87dc15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 >> v2:172.21.15.115:3300/0 conn(0x7f87dc15b1d0 msgr2=0x7f87dc0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 --2- 172.21.15.49:0/1667841804 >> v2:172.21.15.115:3300/0 conn(0x7f87dc15b1d0 0x7f87dc0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0b3120 con 0x7f87dc0ceea0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f87d40019f0 con 0x7f87dc0ceea0 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 >> v1:172.21.15.49:6789/0 conn(0x7f87dc0ceea0 legacy=0x7f87dc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c80039e0 0x7f87c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c80047c0 0x7f87c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 0x7f87c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2320 con 0x7f87c80039e0 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2e40 con 0x7f87c80047c0 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c800b980 con 0x7f87dc0b1ec0 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.957+0000 7f87da59c640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c80039e0 0x7f87c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87d3fff640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c80047c0 0x7f87c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87da59c640 1 -- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 msgr2=0x7f87c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87da59c640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87dc0b1ec0 0x7f87c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87da59c640 1 -- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c80047c0 msgr2=0x7f87c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87da59c640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c80047c0 0x7f87c8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.958+0000 7f87da59c640 1 -- 172.21.15.49:0/1667841804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8003520 con 0x7f87c80039e0 2023-12-19T05:52:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.959+0000 7f87da59c640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c80039e0 0x7f87c8003e00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009af0 tx=0x7f87c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5494bec5909f92f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.959+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc02c710 con 0x7f87c80039e0 2023-12-19T05:52:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc02c870 con 0x7f87c80039e0 2023-12-19T05:52:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87d9d9b640 1 -- 172.21.15.49:0/1667841804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc02cc00 con 0x7f87c80039e0 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 -- 172.21.15.49:0/1667841804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c80039e0 msgr2=0x7f87c8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/1667841804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c80039e0 0x7f87c8003e00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009af0 tx=0x7f87c80057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87dad9d640 1 -- 172.21.15.49:0/1667841804 reap_dead start 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 -- 172.21.15.49:0/1667841804 shutdown_connections 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 -- 172.21.15.49:0/1667841804 >> 172.21.15.49:0/1667841804 conn(0x7f87dc073150 msgr2=0x7f87dc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 -- 172.21.15.49:0/1667841804 shutdown_connections 2023-12-19T05:52:00.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.960+0000 7f87e0e7d640 1 -- 172.21.15.49:0/1667841804 wait complete. 2023-12-19T05:52:00.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.962+0000 7f87e0e7d640 1 Processor -- start 2023-12-19T05:52:00.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.962+0000 7f87e0e7d640 1 -- start start 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c80039e0 0x7f87dc153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 0x7f87dc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc149f60 con 0x7f87dc0caae0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc153ca0 con 0x7f87dc149ae0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.963+0000 7f87e0e7d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0c9d20 con 0x7f87c80039e0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50356/0 (socket says 172.21.15.49:50356) 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 -- 172.21.15.49:0/842947898 learned_addr learned my addr 172.21.15.49:0/842947898 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87da59c640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c80039e0 0x7f87dc153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87dad9d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 0x7f87dc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 -- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c80039e0 msgr2=0x7f87dc153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c80039e0 0x7f87dc153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 -- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 msgr2=0x7f87dc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:00.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 0x7f87dc155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:00.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87d3fff640 1 -- 172.21.15.49:0/842947898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0ca000 con 0x7f87dc0caae0 2023-12-19T05:52:00.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.964+0000 7f87dad9d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 0x7f87dc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87d3fff640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f87c4010860 tx=0x7f87c4010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4009610 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400eb60 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c401c400 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0ca2e0 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.965+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc0c9960 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.966+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc061910 con 0x7f87dc0caae0 2023-12-19T05:52:00.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.967+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87c401c560 con 0x7f87dc0caae0 2023-12-19T05:52:00.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.968+0000 7f87d2ffd640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 0x7f87bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:00.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.969+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f87c4088f10 con 0x7f87dc0caae0 2023-12-19T05:52:00.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.969+0000 7f87da59c640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 0x7f87bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:00.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.970+0000 7f87da59c640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 0x7f87bc06c920 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f87cc036000 tx=0x7f87cc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:00.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:00.973+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87c40544d0 con 0x7f87dc0caae0 2023-12-19T05:52:01.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.164+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87dc0cdc90 con 0x7f87dc0caae0 2023-12-19T05:52:01.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.165+0000 7f87d2ffd640 1 -- 172.21.15.49:0/842947898 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87c4057af0 con 0x7f87dc0caae0 2023-12-19T05:52:01.167 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 msgr2=0x7f87bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 0x7f87bc06c920 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f87cc036000 tx=0x7f87cc030000 comp rx=0 tx=0).stop 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 msgr2=0x7f87dc1f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f87c4010860 tx=0x7f87c4010d20 comp rx=0 tx=0).stop 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 shutdown_connections 2023-12-19T05:52:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f87bc06a460 0x7f87bc06c920 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87dc149ae0 0x7f87dc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87dc0caae0 0x7f87dc1f3490 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 --2- 172.21.15.49:0/842947898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c80039e0 0x7f87dc153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 >> 172.21.15.49:0/842947898 conn(0x7f87dc073150 msgr2=0x7f87dc154560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.168+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 shutdown_connections 2023-12-19T05:52:01.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.169+0000 7f87e0e7d640 1 -- 172.21.15.49:0/842947898 wait complete. 2023-12-19T05:52:01.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.412+0000 7ffbbd363640 1 Processor -- start 2023-12-19T05:52:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.412+0000 7ffbbd363640 1 -- start start 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbbd363640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbb81449e0 0x7ffbb80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbbd363640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 0x7ffbb80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbbd363640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb80afb10 con 0x7ffbb80b0b50 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbbd363640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb806bb30 con 0x7ffbb81449e0 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbbd363640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b0070 con 0x7ffbb806c6b0 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbb6ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbb81449e0 0x7ffbb80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbb6ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbb81449e0 0x7ffbb80af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50362/0 (socket says 172.21.15.49:50362) 2023-12-19T05:52:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.414+0000 7ffbb6ffd640 1 -- 172.21.15.49:0/2466810095 learned_addr learned my addr 172.21.15.49:0/2466810095 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb77fe640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 0x7ffbb80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb6ffd640 1 -- 172.21.15.49:0/2466810095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 msgr2=0x7ffbb80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb6ffd640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 0x7ffbb80b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb6ffd640 1 -- 172.21.15.49:0/2466810095 >> v1:172.21.15.115:6789/0 conn(0x7ffbb80b0b50 legacy=0x7ffbb806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb6ffd640 1 -- 172.21.15.49:0/2466810095 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80b0350 con 0x7ffbb81449e0 2023-12-19T05:52:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.415+0000 7ffbb77fe640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 0x7ffbb80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.416+0000 7ffbb6ffd640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb81449e0 0x7ffbb80af5d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009870 tx=0x7ffba802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c292c08957068ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.416+0000 7ffbb5ffb640 1 -- 172.21.15.49:0/2466810095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8031640 con 0x7ffbb81449e0 2023-12-19T05:52:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.416+0000 7ffbb5ffb640 1 -- 172.21.15.49:0/2466810095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba80317a0 con 0x7ffbb81449e0 2023-12-19T05:52:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.416+0000 7ffbb5ffb640 1 -- 172.21.15.49:0/2466810095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8031b30 con 0x7ffbb81449e0 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 -- 172.21.15.49:0/2466810095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb81449e0 msgr2=0x7ffbb80af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb81449e0 0x7ffbb80af5d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009870 tx=0x7ffba802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 -- 172.21.15.49:0/2466810095 shutdown_connections 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb806c6b0 0x7ffbb80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2466810095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb81449e0 0x7ffbb80af5d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 -- 172.21.15.49:0/2466810095 >> 172.21.15.49:0/2466810095 conn(0x7ffbb80cbb70 msgr2=0x7ffbb80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 -- 172.21.15.49:0/2466810095 shutdown_connections 2023-12-19T05:52:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.417+0000 7ffbbd363640 1 -- 172.21.15.49:0/2466810095 wait complete. 2023-12-19T05:52:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.419+0000 7ffbbd363640 1 Processor -- start 2023-12-19T05:52:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.419+0000 7ffbbd363640 1 -- start start 2023-12-19T05:52:01.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb806c6b0 0x7ffbb81f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb81449e0 0x7ffbb81439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80c9700 con 0x7ffbb80b0b50 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80c9380 con 0x7ffbb806c6b0 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbbd363640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81f3000 con 0x7ffbb81449e0 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50374/0 (socket says 172.21.15.49:50374) 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.420+0000 7ffbb67fc640 1 -- 172.21.15.49:0/2394927206 learned_addr learned my addr 172.21.15.49:0/2394927206 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb6ffd640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb806c6b0 0x7ffbb81f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb77fe640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb81449e0 0x7ffbb81439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 -- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb81449e0 msgr2=0x7ffbb81439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb81449e0 0x7ffbb81439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 -- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb806c6b0 msgr2=0x7ffbb81f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb806c6b0 0x7ffbb81f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 -- 172.21.15.49:0/2394927206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80094d0 con 0x7ffbb80b0b50 2023-12-19T05:52:01.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffbb67fc640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c430 tx=0x7ffbac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011790 con 0x7ffbb80b0b50 2023-12-19T05:52:01.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.421+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0118f0 con 0x7ffbb80b0b50 2023-12-19T05:52:01.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.422+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011ce0 con 0x7ffbb80b0b50 2023-12-19T05:52:01.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.422+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb8143f30 con 0x7ffbb80b0b50 2023-12-19T05:52:01.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.422+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb81f3580 con 0x7ffbb80b0b50 2023-12-19T05:52:01.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.423+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb8061910 con 0x7ffbb80b0b50 2023-12-19T05:52:01.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.424+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffbac01c460 con 0x7ffbb80b0b50 2023-12-19T05:52:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.425+0000 7ffb9f7fe640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 0x7ffba406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.425+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffbac088950 con 0x7ffbb80b0b50 2023-12-19T05:52:01.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.425+0000 7ffbb6ffd640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 0x7ffba406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.426+0000 7ffbb6ffd640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 0x7ffba406c8f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ffba8036000 tx=0x7ffba803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.428+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffbac053e60 con 0x7ffbb80b0b50 2023-12-19T05:52:01.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.658+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbb80ae560 con 0x7ffbb80b0b50 2023-12-19T05:52:01.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.660+0000 7ffb9f7fe640 1 -- 172.21.15.49:0/2394927206 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7ffbac057480 con 0x7ffbb80b0b50 2023-12-19T05:52:01.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:01.662 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:52:01.662 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:52:01.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 msgr2=0x7ffba406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 0x7ffba406c8f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ffba8036000 tx=0x7ffba803c040 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 msgr2=0x7ffbb81f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c430 tx=0x7ffbac00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 shutdown_connections 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ffba406a430 0x7ffba406c8f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbb81449e0 0x7ffbb81439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbb80b0b50 0x7ffbb81f2ac0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 --2- 172.21.15.49:0/2394927206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb806c6b0 0x7ffbb81f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 >> 172.21.15.49:0/2394927206 conn(0x7ffbb80cbb70 msgr2=0x7ffbb80b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:01.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 shutdown_connections 2023-12-19T05:52:01.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.663+0000 7ffbbd363640 1 -- 172.21.15.49:0/2394927206 wait complete. 2023-12-19T05:52:01.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:01.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.910+0000 7f4c9701b640 1 Processor -- start 2023-12-19T05:52:01.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.910+0000 7f4c9701b640 1 -- start start 2023-12-19T05:52:01.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.912+0000 7f4c9701b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c900b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.912+0000 7f4c9701b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9015ec30 con 0x7f4c900cdbf0 2023-12-19T05:52:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.912+0000 7f4c9701b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9015e980 con 0x7f4c9015f680 2023-12-19T05:52:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.912+0000 7f4c9701b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b2f90 con 0x7f4c9015e5a0 2023-12-19T05:52:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.913+0000 7f4c9681a640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c900cdbf0 0x7f4c9006c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52788/0 (socket says 172.21.15.49:52788) 2023-12-19T05:52:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.913+0000 7f4c9681a640 1 -- 172.21.15.49:0/129220140 learned_addr learned my addr 172.21.15.49:0/129220140 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.913+0000 7f4c96019640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c900b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.913+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221412923 0 0) 0x7f4c9015ec30 con 0x7f4c900cdbf0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.913+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c003520 con 0x7f4c900cdbf0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404310120 0 0) 0x7f4c7c003520 con 0x7f4c900cdbf0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 msgr2=0x7f4c900b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c900b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 >> v1:172.21.15.115:6789/0 conn(0x7f4c9015f680 legacy=0x7f4c900b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900b3270 con 0x7f4c900cdbf0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f4c880019f0 con 0x7f4c900cdbf0 2023-12-19T05:52:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 >> v1:172.21.15.49:6789/0 conn(0x7f4c900cdbf0 legacy=0x7f4c9006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c7c0039a0 0x7f4c7c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c004350 0x7f4c7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c7c005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b2f90 con 0x7f4c7c0039a0 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c00b980 con 0x7f4c7c004350 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c00bb10 con 0x7f4c9015e5a0 2023-12-19T05:52:01.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.914+0000 7f4c96019640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c7c0039a0 0x7f4c7c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c95818640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c004350 0x7f4c7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c9681a640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c7c005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c96019640 1 -- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 msgr2=0x7f4c7c005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c96019640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c7c005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c96019640 1 -- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c004350 msgr2=0x7f4c7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c96019640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c004350 0x7f4c7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c96019640 1 -- 172.21.15.49:0/129220140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c003520 con 0x7f4c7c0039a0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.915+0000 7f4c9681a640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c9015e5a0 0x7f4c7c005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.916+0000 7f4c96019640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c7c0039a0 0x7f4c7c003d80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009ac0 tx=0x7f4c7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c873f2f346f5a36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.916+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c02c6b0 con 0x7f4c7c0039a0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.916+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c02c810 con 0x7f4c7c0039a0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.916+0000 7f4c95017640 1 -- 172.21.15.49:0/129220140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c02cba0 con 0x7f4c7c0039a0 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 -- 172.21.15.49:0/129220140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c7c0039a0 msgr2=0x7f4c7c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 --2- 172.21.15.49:0/129220140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c7c0039a0 0x7f4c7c003d80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009ac0 tx=0x7f4c7c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9681a640 1 -- 172.21.15.49:0/129220140 reap_dead start 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 -- 172.21.15.49:0/129220140 shutdown_connections 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 -- 172.21.15.49:0/129220140 >> 172.21.15.49:0/129220140 conn(0x7f4c900b0100 msgr2=0x7f4c900b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 -- 172.21.15.49:0/129220140 shutdown_connections 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.917+0000 7f4c9701b640 1 -- 172.21.15.49:0/129220140 wait complete. 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.919+0000 7f4c9701b640 1 Processor -- start 2023-12-19T05:52:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.919+0000 7f4c9701b640 1 -- start start 2023-12-19T05:52:01.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c0039a0 0x7f4c9014aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 0x7f4c900aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900abf40 con 0x7f4c901f0bb0 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c901f1d70 con 0x7f4c7c0039a0 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c9701b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c901f16e0 con 0x7f4c900ab580 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c95818640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c95818640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50394/0 (socket says 172.21.15.49:50394) 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.920+0000 7f4c95818640 1 -- 172.21.15.49:0/3690105767 learned_addr learned my addr 172.21.15.49:0/3690105767 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c96019640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c0039a0 0x7f4c9014aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c9681a640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 0x7f4c900aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 -- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 msgr2=0x7f4c900aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 0x7f4c900aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 -- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c0039a0 msgr2=0x7f4c9014aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c0039a0 0x7f4c9014aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 -- 172.21.15.49:0/3690105767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c901f19c0 con 0x7f4c901f0bb0 2023-12-19T05:52:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c9681a640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 0x7f4c900aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c95818640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e800 tx=0x7f4c8000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.921+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800050d0 con 0x7f4c901f0bb0 2023-12-19T05:52:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.922+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80005250 con 0x7f4c901f0bb0 2023-12-19T05:52:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.922+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900ad930 con 0x7f4c901f0bb0 2023-12-19T05:52:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.922+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000c6c0 con 0x7f4c901f0bb0 2023-12-19T05:52:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.922+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9014b000 con 0x7f4c901f0bb0 2023-12-19T05:52:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.923+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900ade50 con 0x7f4c901f0bb0 2023-12-19T05:52:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.924+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c8000c820 con 0x7f4c901f0bb0 2023-12-19T05:52:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.925+0000 7f4c86ffd640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 0x7f4c7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.925+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4c800887a0 con 0x7f4c901f0bb0 2023-12-19T05:52:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.926+0000 7f4c96019640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 0x7f4c7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.927+0000 7f4c96019640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 0x7f4c7406c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c036000 tx=0x7f4c8c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:01.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:01.929+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4c900ade50 con 0x7f4c901f0bb0 2023-12-19T05:52:02.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.129+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c900ade50 con 0x7f4c901f0bb0 2023-12-19T05:52:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.131+0000 7f4c86ffd640 1 -- 172.21.15.49:0/3690105767 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+16215 (secure 0 0 0) 0x7f4c900ade50 con 0x7f4c901f0bb0 2023-12-19T05:52:02.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:02.133 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":181,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:00.465442+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:02.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.133+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 msgr2=0x7f4c7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.133+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 0x7f4c7406c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c036000 tx=0x7f4c8c030000 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.133+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 msgr2=0x7f4c901f1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.133+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e800 tx=0x7f4c8000ecc0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 shutdown_connections 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4c7406a460 0x7f4c7406c920 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c900ab580 0x7f4c900aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c901f0bb0 0x7f4c901f1030 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 --2- 172.21.15.49:0/3690105767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c7c0039a0 0x7f4c9014aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 >> 172.21.15.49:0/3690105767 conn(0x7f4c900b0100 msgr2=0x7f4c9015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 shutdown_connections 2023-12-19T05:52:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.134+0000 7f4c9701b640 1 -- 172.21.15.49:0/3690105767 wait complete. 2023-12-19T05:52:02.156 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:52:02.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:02.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.387+0000 7f7a43095640 1 Processor -- start 2023-12-19T05:52:02.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.387+0000 7f7a43095640 1 -- start start 2023-12-19T05:52:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.389+0000 7f7a43095640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a3c15e5a0 0x7f7a3c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.389+0000 7f7a43095640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a3c15f680 0x7f7a3c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.389+0000 7f7a43095640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3c15ec30 con 0x7f7a3c0cdbf0 2023-12-19T05:52:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.389+0000 7f7a43095640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0b2cc0 con 0x7f7a3c15f680 2023-12-19T05:52:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.389+0000 7f7a43095640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c15e980 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a3c15f680 0x7f7a3c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a42093640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a3c15e5a0 0x7f7a3c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a3c15f680 0x7f7a3c0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50400/0 (socket says 172.21.15.49:50400) 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 -- 172.21.15.49:0/3788073619 learned_addr learned my addr 172.21.15.49:0/3788073619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 -- 172.21.15.49:0/3788073619 >> v2:172.21.15.115:3300/0 conn(0x7f7a3c15e5a0 msgr2=0x7f7a3c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 --2- 172.21.15.49:0/3788073619 >> v2:172.21.15.115:3300/0 conn(0x7f7a3c15e5a0 0x7f7a3c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 -- 172.21.15.49:0/3788073619 >> v1:172.21.15.49:6789/0 conn(0x7f7a3c0cdbf0 legacy=0x7f7a3c06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41892640 1 -- 172.21.15.49:0/3788073619 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c0b2f90 con 0x7f7a3c15f680 2023-12-19T05:52:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.390+0000 7f7a41091640 1 -- 172.21.15.49:0/3788073619 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917905366 0 0) 0x7f7a3c15ec30 con 0x7f7a3c0cdbf0 2023-12-19T05:52:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.392+0000 7f7a41892640 1 --2- 172.21.15.49:0/3788073619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15f680 0x7f7a3c0b2780 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009870 tx=0x7f7a2c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a8323d2856c7db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.392+0000 7f7a41091640 1 -- 172.21.15.49:0/3788073619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c030860 con 0x7f7a3c15f680 2023-12-19T05:52:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.392+0000 7f7a41091640 1 -- 172.21.15.49:0/3788073619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0309c0 con 0x7f7a3c15f680 2023-12-19T05:52:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.392+0000 7f7a41091640 1 -- 172.21.15.49:0/3788073619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c030d50 con 0x7f7a3c15f680 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 -- 172.21.15.49:0/3788073619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15f680 msgr2=0x7f7a3c0b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 --2- 172.21.15.49:0/3788073619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15f680 0x7f7a3c0b2780 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009870 tx=0x7f7a2c02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 -- 172.21.15.49:0/3788073619 shutdown_connections 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 --2- 172.21.15.49:0/3788073619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15f680 0x7f7a3c0b2780 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 --2- 172.21.15.49:0/3788073619 >> v2:172.21.15.115:3300/0 conn(0x7f7a3c15e5a0 0x7f7a3c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 -- 172.21.15.49:0/3788073619 >> 172.21.15.49:0/3788073619 conn(0x7f7a3c0b0100 msgr2=0x7f7a3c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 -- 172.21.15.49:0/3788073619 shutdown_connections 2023-12-19T05:52:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.393+0000 7f7a43095640 1 -- 172.21.15.49:0/3788073619 wait complete. 2023-12-19T05:52:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.395+0000 7f7a43095640 1 Processor -- start 2023-12-19T05:52:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.395+0000 7f7a43095640 1 -- start start 2023-12-19T05:52:02.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a3c0cdbf0 0x7f7a3c1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 0x7f7a3c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0ca970 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c159450 con 0x7f7a3c0cdbf0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a43095640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0cd9b0 con 0x7f7a3c15f680 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a41892640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a41892640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50402/0 (socket says 172.21.15.49:50402) 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a41892640 1 -- 172.21.15.49:0/249504475 learned_addr learned my addr 172.21.15.49:0/249504475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a42093640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a3c0cdbf0 0x7f7a3c1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a42894640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 0x7f7a3c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.396+0000 7f7a41892640 1 -- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 msgr2=0x7f7a3c14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a41892640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 0x7f7a3c14ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a41892640 1 -- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a3c0cdbf0 msgr2=0x7f7a3c1f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a41892640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a3c0cdbf0 0x7f7a3c1f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a41892640 1 -- 172.21.15.49:0/249504475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0094d0 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a42894640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 0x7f7a3c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:02.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a41892640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c02b9e0 tx=0x7f7a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c03e070 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c039a10 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c039da0 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.397+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c0cad90 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.398+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c0c9fd0 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.399+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c061910 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.400+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a2c04b400 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.401+0000 7f7a32ffd640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 0x7f7a2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.401+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7a2c0aaf60 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.402+0000 7f7a42093640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 0x7f7a2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.403+0000 7f7a42093640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 0x7f7a2006c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009ad0 tx=0x7f7a38008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.406+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a2c0765a0 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.638+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a3c0ce980 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.639+0000 7f7a32ffd640 1 -- 172.21.15.49:0/249504475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f7a2c034090 con 0x7f7a3c15e5a0 2023-12-19T05:52:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:02.641 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:52:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.641+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 msgr2=0x7f7a2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.641+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 0x7f7a2006c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009ad0 tx=0x7f7a38008040 comp rx=0 tx=0).stop 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.641+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 msgr2=0x7f7a3c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.641+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c02b9e0 tx=0x7f7a2c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 shutdown_connections 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f7a2006a430 0x7f7a2006c8f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a3c15f680 0x7f7a3c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c15e5a0 0x7f7a3c0cd470 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 --2- 172.21.15.49:0/249504475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a3c0cdbf0 0x7f7a3c1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 >> 172.21.15.49:0/249504475 conn(0x7f7a3c0b0100 msgr2=0x7f7a3c157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 shutdown_connections 2023-12-19T05:52:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.642+0000 7f7a43095640 1 -- 172.21.15.49:0/249504475 wait complete. 2023-12-19T05:52:02.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:02.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.882+0000 7ffa02c2d640 1 Processor -- start 2023-12-19T05:52:02.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.882+0000 7ffa02c2d640 1 -- start start 2023-12-19T05:52:02.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.884+0000 7ffa02c2d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.884+0000 7ffa02c2d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9fc0cdbf0 0x7ff9fc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.884+0000 7ffa02c2d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc15ec30 con 0x7ff9fc15f680 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.884+0000 7ffa02c2d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc0ce5c0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.884+0000 7ffa02c2d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc15e980 con 0x7ff9fc15e5a0 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0142a640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff9fc15f680 0x7ff9fc0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52806/0 (socket says 172.21.15.49:52806) 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0142a640 1 -- 172.21.15.49:0/2733839407 learned_addr learned my addr 172.21.15.49:0/2733839407 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0242c640 1 --2- 172.21.15.49:0/2733839407 >> v2:172.21.15.49:3300/0 conn(0x7ff9fc0cdbf0 0x7ff9fc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa01c2b640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa00c29640 1 -- 172.21.15.49:0/2733839407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445943004 0 0) 0x7ff9fc15ec30 con 0x7ff9fc15f680 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa00c29640 1 -- 172.21.15.49:0/2733839407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e8003520 con 0x7ff9fc15f680 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0242c640 1 -- 172.21.15.49:0/2733839407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 msgr2=0x7ff9fc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0242c640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0242c640 1 -- 172.21.15.49:0/2733839407 >> v1:172.21.15.49:6789/0 conn(0x7ff9fc15f680 legacy=0x7ff9fc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.885+0000 7ffa0242c640 1 -- 172.21.15.49:0/2733839407 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc0b2f90 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa0242c640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc0ce080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009d90 tx=0x7ff9f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e94ddabc478e1ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa00c29640 1 -- 172.21.15.49:0/2733839407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f402cc50 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa00c29640 1 -- 172.21.15.49:0/2733839407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f402cdb0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa00c29640 1 -- 172.21.15.49:0/2733839407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4034660 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa02c2d640 1 -- 172.21.15.49:0/2733839407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 msgr2=0x7ff9fc0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.887+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc0ce080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009d90 tx=0x7ff9f402bea0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 -- 172.21.15.49:0/2733839407 shutdown_connections 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc0ce080 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/2733839407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 -- 172.21.15.49:0/2733839407 >> 172.21.15.49:0/2733839407 conn(0x7ff9fc0b0100 msgr2=0x7ff9fc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 -- 172.21.15.49:0/2733839407 shutdown_connections 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.888+0000 7ffa02c2d640 1 -- 172.21.15.49:0/2733839407 wait complete. 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.889+0000 7ffa02c2d640 1 Processor -- start 2023-12-19T05:52:02.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.890+0000 7ffa02c2d640 1 -- start start 2023-12-19T05:52:02.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.890+0000 7ffa02c2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa02c2d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa02c2d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc15f680 0x7ff9fc15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa02c2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0a9c60 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa02c2d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0a90e0 con 0x7ff9fc15f680 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa02c2d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0a93c0 con 0x7ff9fc15e5a0 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50430/0 (socket says 172.21.15.49:50430) 2023-12-19T05:52:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 -- 172.21.15.49:0/3482431952 learned_addr learned my addr 172.21.15.49:0/3482431952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 -- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 msgr2=0x7ff9fc15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa0142a640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 -- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc15f680 msgr2=0x7ff9fc15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc15f680 0x7ff9fc15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.891+0000 7ffa01c2b640 1 -- 172.21.15.49:0/3482431952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4009a70 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ffa01c2b640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800d800 tx=0x7ff9f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800b6c0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f800b820 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc0a96a0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800bbb0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.892+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc0a8660 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.894+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc061910 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.894+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9f800bd10 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.896+0000 7ff9f27fc640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 0x7ff9e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:02.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.896+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff9f8088fe0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:02.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.897+0000 7ffa0142a640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 0x7ff9e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:02.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.898+0000 7ffa0142a640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 0x7ff9e006c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc070ac0 tx=0x7ff9ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:02.901+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9f80544c0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:03.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.131+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9fc0ce150 con 0x7ff9fc0cdbf0 2023-12-19T05:52:03.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.132+0000 7ff9f27fc640 1 -- 172.21.15.49:0/3482431952 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4658 (secure 0 0 0) 0x7ff9f8057ae0 con 0x7ff9fc0cdbf0 2023-12-19T05:52:03.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:03.134 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:50:38.019724+0000","modified":"2023-12-19T05:50:41.435501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8490":{"gid":8490,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2314443722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2314443722},{"type":"v1","addr":"172.21.15.49:6835","nonce":2314443722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-19T05:52:03.134 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 80 2023-12-19T05:52:03.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.134+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 msgr2=0x7ff9e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.134+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 0x7ff9e006c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc070ac0 tx=0x7ff9ec009040 comp rx=0 tx=0).stop 2023-12-19T05:52:03.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 msgr2=0x7ff9fc1521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800d800 tx=0x7ff9f800dcc0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 shutdown_connections 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff9e006a430 0x7ff9e006c8f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9fc15e5a0 0x7ff9fc15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9fc15f680 0x7ff9fc15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 --2- 172.21.15.49:0/3482431952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9fc0cdbf0 0x7ff9fc1521c0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 >> 172.21.15.49:0/3482431952 conn(0x7ff9fc0b0100 msgr2=0x7ff9fc06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 shutdown_connections 2023-12-19T05:52:03.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.135+0000 7ffa02c2d640 1 -- 172.21.15.49:0/3482431952 wait complete. 2023-12-19T05:52:03.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:03.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.376+0000 7ff6f0b7e640 1 Processor -- start 2023-12-19T05:52:03.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.376+0000 7ff6f0b7e640 1 -- start start 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 0x7ff6ec0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec0ce5c0 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec15ec30 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6f0b7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0b2cc0 con 0x7ff6ec15f680 2023-12-19T05:52:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6eb7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6eb7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50434/0 (socket says 172.21.15.49:50434) 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2985921822 learned_addr learned my addr 172.21.15.49:0/2985921822 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6e3fff640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.378+0000 7ff6ebfff640 1 --2- 172.21.15.49:0/2985921822 >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 0x7ff6ec0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2985921822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 msgr2=0x7ff6ec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2985921822 >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 msgr2=0x7ff6ec0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2985921822 >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 0x7ff6ec0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2985921822 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec15e980 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6e3fff640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.379+0000 7ff6ebfff640 1 --2- 172.21.15.49:0/2985921822 >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 0x7ff6ec0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.380+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec06b310 tx=0x7ff6dc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9345284cf5dbb34 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.380+0000 7ff6eaffd640 1 -- 172.21.15.49:0/2985921822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc031860 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.380+0000 7ff6eaffd640 1 -- 172.21.15.49:0/2985921822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0319c0 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.380+0000 7ff6eaffd640 1 -- 172.21.15.49:0/2985921822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc031d50 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2985921822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec15e5a0 msgr2=0x7ff6ec0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec06b310 tx=0x7ff6dc02b900 comp rx=0 tx=0).stop 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2985921822 shutdown_connections 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2985921822 >> v2:172.21.15.115:3300/0 conn(0x7ff6ec0cdbf0 0x7ff6ec0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2985921822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec0b2030 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2985921822 >> 172.21.15.49:0/2985921822 conn(0x7ff6ec0b0100 msgr2=0x7ff6ec0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2985921822 shutdown_connections 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.381+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2985921822 wait complete. 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.383+0000 7ff6f0b7e640 1 Processor -- start 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.383+0000 7ff6f0b7e640 1 -- start start 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec154ae0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec154520 con 0x7ff6ec15e5a0 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6f0b7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec154800 con 0x7ff6ec15f680 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50444/0 (socket says 172.21.15.49:50444) 2023-12-19T05:52:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2350795999 learned_addr learned my addr 172.21.15.49:0/2350795999 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 msgr2=0x7ff6ec157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6e3fff640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6ec15e5a0 msgr2=0x7ff6ec153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.384+0000 7ff6eb7fe640 1 -- 172.21.15.49:0/2350795999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0094d0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6eb7fe640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc031830 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0443f0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0447a0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec1557b0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.385+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec150ca0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.387+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec155cd0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.387+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6dc04d450 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.388+0000 7ff6e8ff9640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.389+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff6dc0ab120 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.389+0000 7ff6e3fff640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.390+0000 7ff6e3fff640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec15dfb0 tx=0x7ff6d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.393+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6dc0767f0 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.590+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6ec061910 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.593+0000 7ff6e8ff9640 1 -- 172.21.15.49:0/2350795999 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+16215 (secure 0 0 0) 0x7ff6dc079e10 con 0x7ff6ec0cdbf0 2023-12-19T05:52:03.595 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:03.595 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":181,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:00.465442+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:50:35.985173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-19T05:50:37.054976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 msgr2=0x7ff6cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec15dfb0 tx=0x7ff6d4008040 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 msgr2=0x7ff6ec150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 shutdown_connections 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff6cc06a430 0x7ff6cc06c8f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6ec15f680 0x7ff6ec157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6ec15e5a0 0x7ff6ec153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 --2- 172.21.15.49:0/2350795999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ec0cdbf0 0x7ff6ec150760 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.595+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 >> 172.21.15.49:0/2350795999 conn(0x7ff6ec0b0100 msgr2=0x7ff6ec0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.596+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 shutdown_connections 2023-12-19T05:52:03.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.596+0000 7ff6f0b7e640 1 -- 172.21.15.49:0/2350795999 wait complete. 2023-12-19T05:52:03.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:52:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.846+0000 7f82ad2e5640 1 Processor -- start 2023-12-19T05:52:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.847+0000 7f82ad2e5640 1 -- start start 2023-12-19T05:52:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.848+0000 7f82ad2e5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82a8155460 0x7f82a80b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.848+0000 7f82ad2e5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82a80b0830 0x7f82a806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f82ad2e5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a815c9c0 con 0x7f82a806ca80 2023-12-19T05:52:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f82ad2e5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a80b0ce0 con 0x7f82a80b0830 2023-12-19T05:52:03.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f82ad2e5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a806d270 con 0x7f82a8155460 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f829f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82a80b0830 0x7f82a806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f829f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82a80b0830 0x7f82a806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50450/0 (socket says 172.21.15.49:50450) 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f829f7fe640 1 -- 172.21.15.49:0/89958048 learned_addr learned my addr 172.21.15.49:0/89958048 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f82acae4640 1 --1- 172.21.15.49:0/89958048 >> v1:172.21.15.49:6789/0 conn(0x7f82a806ca80 0x7f82a80cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52820/0 (socket says 172.21.15.49:52820) 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f82a7fff640 1 --2- 172.21.15.49:0/89958048 >> v2:172.21.15.115:3300/0 conn(0x7f82a8155460 0x7f82a80b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f829f7fe640 1 -- 172.21.15.49:0/89958048 >> v2:172.21.15.115:3300/0 conn(0x7f82a8155460 msgr2=0x7f82a80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.849+0000 7f829f7fe640 1 --2- 172.21.15.49:0/89958048 >> v2:172.21.15.115:3300/0 conn(0x7f82a8155460 0x7f82a80b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.850+0000 7f829f7fe640 1 -- 172.21.15.49:0/89958048 >> v1:172.21.15.49:6789/0 conn(0x7f82a806ca80 legacy=0x7f82a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.850+0000 7f829f7fe640 1 -- 172.21.15.49:0/89958048 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a806d550 con 0x7f82a80b0830 2023-12-19T05:52:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.850+0000 7f82a77fe640 1 -- 172.21.15.49:0/89958048 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270516839 0 0) 0x7f82a815c9c0 con 0x7f82a806ca80 2023-12-19T05:52:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.851+0000 7f829f7fe640 1 --2- 172.21.15.49:0/89958048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a80b0830 0x7f82a806c540 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f82a80717b0 tx=0x7f829002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf956989766d6cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.851+0000 7f82a77fe640 1 -- 172.21.15.49:0/89958048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290030860 con 0x7f82a80b0830 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.851+0000 7f82a77fe640 1 -- 172.21.15.49:0/89958048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82900309c0 con 0x7f82a80b0830 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.851+0000 7f82a77fe640 1 -- 172.21.15.49:0/89958048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290030d50 con 0x7f82a80b0830 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 -- 172.21.15.49:0/89958048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a80b0830 msgr2=0x7f82a806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/89958048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a80b0830 0x7f82a806c540 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f82a80717b0 tx=0x7f829002b9a0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 -- 172.21.15.49:0/89958048 shutdown_connections 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/89958048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a80b0830 0x7f82a806c540 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/89958048 >> v2:172.21.15.115:3300/0 conn(0x7f82a8155460 0x7f82a80b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 -- 172.21.15.49:0/89958048 >> 172.21.15.49:0/89958048 conn(0x7f82a80659a0 msgr2=0x7f82a8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 -- 172.21.15.49:0/89958048 shutdown_connections 2023-12-19T05:52:03.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.852+0000 7f82ad2e5640 1 -- 172.21.15.49:0/89958048 wait complete. 2023-12-19T05:52:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.854+0000 7f82ad2e5640 1 Processor -- start 2023-12-19T05:52:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.854+0000 7f82ad2e5640 1 -- start start 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82a80b0830 0x7f82a8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82a8155460 0x7f82a81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a81f4cd0 con 0x7f82a806ca80 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a81f49f0 con 0x7f82a80b0830 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82ad2e5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a81440e0 con 0x7f82a8155460 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50454/0 (socket says 172.21.15.49:50454) 2023-12-19T05:52:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82a7fff640 1 -- 172.21.15.49:0/2239027371 learned_addr learned my addr 172.21.15.49:0/2239027371 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82a7fff640 1 -- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82a8155460 msgr2=0x7f82a81541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.855+0000 7f82a7fff640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82a8155460 0x7f82a81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a7fff640 1 -- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82a80b0830 msgr2=0x7f82a8153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f829f7fe640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82a80b0830 0x7f82a8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a7fff640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82a80b0830 0x7f82a8153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a7fff640 1 -- 172.21.15.49:0/2239027371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900094d0 con 0x7f82a806ca80 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a7fff640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f829800d5f0 tx=0x7f829800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980125f0 con 0x7f82a806ca80 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298012750 con 0x7f82a806ca80 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a81443c0 con 0x7f82a806ca80 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298012b00 con 0x7f82a806ca80 2023-12-19T05:52:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.856+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a81f0460 con 0x7f82a806ca80 2023-12-19T05:52:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.858+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a8143f50 con 0x7f82a806ca80 2023-12-19T05:52:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.859+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8298012c60 con 0x7f82a806ca80 2023-12-19T05:52:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.860+0000 7f82a57fa640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 0x7f828806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:03.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.860+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8298088e70 con 0x7f82a806ca80 2023-12-19T05:52:03.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.860+0000 7f829f7fe640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 0x7f828806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:03.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.861+0000 7f829f7fe640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 0x7f828806c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8290036000 tx=0x7f829003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:03.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:03.864+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8298054380 con 0x7f82a806ca80 2023-12-19T05:52:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.096+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f82a8061910 con 0x7f82a806ca80 2023-12-19T05:52:04.099 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:52:04.098+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:52:04.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.117+0000 7f82a57fa640 1 -- 172.21.15.49:0/2239027371 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f82980579a0 con 0x7f82a806ca80 2023-12-19T05:52:04.119 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 msgr2=0x7f828806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 0x7f828806c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8290036000 tx=0x7f829003b040 comp rx=0 tx=0).stop 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 msgr2=0x7f82a81eff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f829800d5f0 tx=0x7f829800dab0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 shutdown_connections 2023-12-19T05:52:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f828806a430 0x7f828806c8f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82a8155460 0x7f82a81541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82a80b0830 0x7f82a8153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 --2- 172.21.15.49:0/2239027371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82a806ca80 0x7f82a81eff20 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 >> 172.21.15.49:0/2239027371 conn(0x7f82a80659a0 msgr2=0x7f82a806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 shutdown_connections 2023-12-19T05:52:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.120+0000 7f82ad2e5640 1 -- 172.21.15.49:0/2239027371 wait complete. 2023-12-19T05:52:04.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:52:04.224 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:52:04.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.350+0000 7fbbd8ffd640 1 Processor -- start 2023-12-19T05:52:04.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.350+0000 7fbbd8ffd640 1 -- start start 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.351+0000 7fbbd8ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40b02b0 0x7fbbd40b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.351+0000 7fbbd8ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbd40ce420 0x7fbbd40ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.351+0000 7fbbd8ffd640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40b0c50 con 0x7fbbd415a190 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.351+0000 7fbbd8ffd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40af110 con 0x7fbbd40ce420 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.351+0000 7fbbd8ffd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40ad960 con 0x7fbbd40b02b0 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbd40ce420 0x7fbbd40ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbd40ce420 0x7fbbd40ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50446/0 (socket says 172.21.15.49:50446) 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/590894992 learned_addr learned my addr 172.21.15.49:0/590894992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbcbfff640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40b02b0 0x7fbbd40b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/590894992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40b02b0 msgr2=0x7fbbd40b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40b02b0 0x7fbbd40b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/590894992 >> v1:172.21.15.115:6789/0 conn(0x7fbbd415a190 legacy=0x7fbbd40aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.352+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/590894992 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40adc40 con 0x7fbbd40ce420 2023-12-19T05:52:04.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.354+0000 7fbbd2d9d640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd40ce420 0x7fbbd40ce890 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00d150 tx=0x7fbbcc02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bd1822ca04f946 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.354+0000 7fbbd1d9b640 1 -- 172.21.15.49:0/590894992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02e9e0 con 0x7fbbd40ce420 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.354+0000 7fbbd1d9b640 1 -- 172.21.15.49:0/590894992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc02eb40 con 0x7fbbd40ce420 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.354+0000 7fbbd1d9b640 1 -- 172.21.15.49:0/590894992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc009600 con 0x7fbbd40ce420 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/590894992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd40ce420 msgr2=0x7fbbd40ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd40ce420 0x7fbbd40ce890 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00d150 tx=0x7fbbcc02e040 comp rx=0 tx=0).stop 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/590894992 shutdown_connections 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40b02b0 0x7fbbd40b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/590894992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd40ce420 0x7fbbd40ce890 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/590894992 >> 172.21.15.49:0/590894992 conn(0x7fbbd4066160 msgr2=0x7fbbd40cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/590894992 shutdown_connections 2023-12-19T05:52:04.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.355+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/590894992 wait complete. 2023-12-19T05:52:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.357+0000 7fbbd8ffd640 1 Processor -- start 2023-12-19T05:52:04.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.357+0000 7fbbd8ffd640 1 -- start start 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 0x7fbbd414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40ce420 0x7fbbd415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd415d250 con 0x7fbbd415a190 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd414df60 con 0x7fbbd40b02b0 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd8ffd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd415d4a0 con 0x7fbbd40ce420 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50456/0 (socket says 172.21.15.49:50456) 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.358+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/1174191705 learned_addr learned my addr 172.21.15.49:0/1174191705 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbcbfff640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40ce420 0x7fbbd415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd259c640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 0x7fbbd414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40ce420 msgr2=0x7fbbd415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40ce420 0x7fbbd415cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 msgr2=0x7fbbd414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 0x7fbbd414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 -- 172.21.15.49:0/1174191705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc00bd40 con 0x7fbbd415a190 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd259c640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 0x7fbbd414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:04.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.359+0000 7fbbd2d9d640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00d150 tx=0x7fbbcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.360+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02e9e0 con 0x7fbbd415a190 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.360+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc036820 con 0x7fbbd415a190 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.360+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc036c10 con 0x7fbbd415a190 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.360+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd415d780 con 0x7fbbd415a190 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.360+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd406c9f0 con 0x7fbbd415a190 2023-12-19T05:52:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.361+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd4061910 con 0x7fbbd415a190 2023-12-19T05:52:04.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.362+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbcc04a460 con 0x7fbbd415a190 2023-12-19T05:52:04.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.363+0000 7fbbcaffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 0x7fbbb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:04.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.363+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fbbcc0abe30 con 0x7fbbd415a190 2023-12-19T05:52:04.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.364+0000 7fbbd259c640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 0x7fbbb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:04.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.365+0000 7fbbd259c640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 0x7fbbb406c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbbd414f470 tx=0x7fbbc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:04.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.367+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbcc077420 con 0x7fbbd415a190 2023-12-19T05:52:04.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:04.601+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbbd4061910 con 0x7fbbd415a190 2023-12-19T05:52:05.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.120+0000 7fbbcaffd640 1 -- 172.21.15.49:0/1174191705 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbbcc00b720 con 0x7fbbd415a190 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 msgr2=0x7fbbb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 0x7fbbb406c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbbd414f470 tx=0x7fbbc4009040 comp rx=0 tx=0).stop 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 msgr2=0x7fbbd40ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00d150 tx=0x7fbbcc004a40 comp rx=0 tx=0).stop 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 shutdown_connections 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fbbb406a430 0x7fbbb406c8f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.123+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbd40ce420 0x7fbbd415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.124+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbd415a190 0x7fbbd40ccc00 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.124+0000 7fbbd8ffd640 1 --2- 172.21.15.49:0/1174191705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbd40b02b0 0x7fbbd414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.124+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 >> 172.21.15.49:0/1174191705 conn(0x7fbbd4066160 msgr2=0x7fbbd40aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:05.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.124+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 shutdown_connections 2023-12-19T05:52:05.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.124+0000 7fbbd8ffd640 1 -- 172.21.15.49:0/1174191705 wait complete. 2023-12-19T05:52:05.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:52:05.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.379+0000 7fd4dce50640 1 Processor -- start 2023-12-19T05:52:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.379+0000 7fd4dce50640 1 -- start start 2023-12-19T05:52:05.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4dce50640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4d80d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4dce50640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80d07c0 con 0x7fd4d815d4e0 2023-12-19T05:52:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4dce50640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d815d8c0 con 0x7fd4d80d3650 2023-12-19T05:52:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4dce50640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ce7b0 con 0x7fd4d80b1d90 2023-12-19T05:52:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4d77fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd4d815d4e0 0x7fd4d80b8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46288/0 (socket says 172.21.15.49:46288) 2023-12-19T05:52:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4d77fe640 1 -- 172.21.15.49:0/3703544212 learned_addr learned my addr 172.21.15.49:0/3703544212 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420863813 0 0) 0x7fd4d80d07c0 con 0x7fd4d815d4e0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4d80d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.381+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c0003520 con 0x7fd4d815d4e0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681146057 0 0) 0x7fd4c0003520 con 0x7fd4d815d4e0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 msgr2=0x7fd4d80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4d80d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 >> v1:172.21.15.115:6789/0 conn(0x7fd4d80d3650 legacy=0x7fd4d80d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80cfbb0 con 0x7fd4d815d4e0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fd4c8001670 con 0x7fd4d815d4e0 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 >> v1:172.21.15.49:6789/0 conn(0x7fd4d815d4e0 legacy=0x7fd4d80b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c00039a0 0x7fd4c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4c00047c0 0x7fd4c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ce7b0 con 0x7fd4c00039a0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000ba30 con 0x7fd4c00047c0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000bbf0 con 0x7fd4d80b1d90 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.382+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c00039a0 0x7fd4c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4c00047c0 0x7fd4c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d77fe640 1 -- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 msgr2=0x7fd4c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d7fff640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d77fe640 1 -- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4c00047c0 msgr2=0x7fd4c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4c00047c0 0x7fd4c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d77fe640 1 -- 172.21.15.49:0/3703544212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0003520 con 0x7fd4c00039a0 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d7fff640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4d80b1d90 0x7fd4c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.383+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4c00047c0 0x7fd4c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.384+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c00039a0 0x7fd4c0003dc0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c210 tx=0x7fd4c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26c3817f40049bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.384+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8005ad0 con 0x7fd4c00039a0 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.384+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8005c50 con 0x7fd4c00039a0 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.384+0000 7fd4d67fc640 1 -- 172.21.15.49:0/3703544212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c802c870 con 0x7fd4c00039a0 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 -- 172.21.15.49:0/3703544212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c00039a0 msgr2=0x7fd4c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 --2- 172.21.15.49:0/3703544212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c00039a0 0x7fd4c0003dc0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c210 tx=0x7fd4c00057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4d7fff640 1 -- 172.21.15.49:0/3703544212 reap_dead start 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 -- 172.21.15.49:0/3703544212 shutdown_connections 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 -- 172.21.15.49:0/3703544212 >> 172.21.15.49:0/3703544212 conn(0x7fd4d8072f40 msgr2=0x7fd4d8073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 -- 172.21.15.49:0/3703544212 shutdown_connections 2023-12-19T05:52:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.385+0000 7fd4dce50640 1 -- 172.21.15.49:0/3703544212 wait complete. 2023-12-19T05:52:05.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.387+0000 7fd4dce50640 1 Processor -- start 2023-12-19T05:52:05.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.387+0000 7fd4dce50640 1 -- start start 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4c00039a0 0x7fd4d814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d81e5c00 0x7fd4d80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81e7260 con 0x7fd4d815c000 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80b0d30 con 0x7fd4d81e5c00 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4dce50640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81e65e0 con 0x7fd4c00039a0 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50480/0 (socket says 172.21.15.49:50480) 2023-12-19T05:52:05.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.388+0000 7fd4d6ffd640 1 -- 172.21.15.49:0/2802454313 learned_addr learned my addr 172.21.15.49:0/2802454313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d7fff640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d81e5c00 0x7fd4d80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4c00039a0 0x7fd4d814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 -- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4c00039a0 msgr2=0x7fd4d814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4c00039a0 0x7fd4d814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 -- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d81e5c00 msgr2=0x7fd4d80cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d81e5c00 0x7fd4d80cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 -- 172.21.15.49:0/2802454313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d81e68c0 con 0x7fd4d815c000 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4d6ffd640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc010880 tx=0x7fd4cc010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00eb60 con 0x7fd4d815c000 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00ecc0 con 0x7fd4d815c000 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc01c400 con 0x7fd4d815c000 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.389+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d81e6ba0 con 0x7fd4d815c000 2023-12-19T05:52:05.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.390+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d81e60b0 con 0x7fd4d815c000 2023-12-19T05:52:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.391+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d80d0430 con 0x7fd4d815c000 2023-12-19T05:52:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.392+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd4cc01c560 con 0x7fd4d815c000 2023-12-19T05:52:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.393+0000 7fd4bffff640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 0x7fd4c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.393+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd4cc088f20 con 0x7fd4d815c000 2023-12-19T05:52:05.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.393+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 0x7fd4c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.394+0000 7fd4d77fe640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 0x7fd4c406c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8034000 tx=0x7fd4c8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:05.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.397+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd4d80d0430 con 0x7fd4d815c000 2023-12-19T05:52:05.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:05.584+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4d80d0430 con 0x7fd4d815c000 2023-12-19T05:52:06.483 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:52:06.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.481+0000 7fd4bffff640 1 -- 172.21.15.49:0/2802454313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v183) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd4d80d0430 con 0x7fd4d815c000 2023-12-19T05:52:06.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.485+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 msgr2=0x7fd4c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:06.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.485+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 0x7fd4c406c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8034000 tx=0x7fd4c8009030 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 msgr2=0x7fd4d80b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc010880 tx=0x7fd4cc010d40 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 shutdown_connections 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd4c406a460 0x7fd4c406c920 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4d81e5c00 0x7fd4d80cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4d815c000 0x7fd4d80b07f0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 --2- 172.21.15.49:0/2802454313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4c00039a0 0x7fd4d814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 >> 172.21.15.49:0/2802454313 conn(0x7fd4d8072f40 msgr2=0x7fd4d80b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:06.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 shutdown_connections 2023-12-19T05:52:06.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.486+0000 7fd4dce50640 1 -- 172.21.15.49:0/2802454313 wait complete. 2023-12-19T05:52:06.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:52:06.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.743+0000 7fd117023640 1 Processor -- start 2023-12-19T05:52:06.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.743+0000 7fd117023640 1 -- start start 2023-12-19T05:52:06.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.745+0000 7fd117023640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd11006dac0 0x7fd1100af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.745+0000 7fd117023640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd11015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.745+0000 7fd117023640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1100b0770 con 0x7fd11006dea0 2023-12-19T05:52:06.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.745+0000 7fd117023640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1100af290 con 0x7fd11006dac0 2023-12-19T05:52:06.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.745+0000 7fd117023640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100b0490 con 0x7fd1100aee40 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd11006dac0 0x7fd1100af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd11006dac0 0x7fd1100af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50490/0 (socket says 172.21.15.49:50490) 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 -- 172.21.15.49:0/2529922167 learned_addr learned my addr 172.21.15.49:0/2529922167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd1155c0640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd11015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 -- 172.21.15.49:0/2529922167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 msgr2=0x7fd11015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd11015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 -- 172.21.15.49:0/2529922167 >> v1:172.21.15.115:6789/0 conn(0x7fd11006dea0 legacy=0x7fd1100ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:06.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.746+0000 7fd114dbf640 1 -- 172.21.15.49:0/2529922167 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11015ca00 con 0x7fd11006dac0 2023-12-19T05:52:06.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.748+0000 7fd114dbf640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd1100af4a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd10402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491bca275a7bb5dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.748+0000 7fd10f7fe640 1 -- 172.21.15.49:0/2529922167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104031640 con 0x7fd11006dac0 2023-12-19T05:52:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.748+0000 7fd10f7fe640 1 -- 172.21.15.49:0/2529922167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1040317a0 con 0x7fd11006dac0 2023-12-19T05:52:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.748+0000 7fd10f7fe640 1 -- 172.21.15.49:0/2529922167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104031b30 con 0x7fd11006dac0 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 -- 172.21.15.49:0/2529922167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 msgr2=0x7fd1100af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd1100af4a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd10402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 -- 172.21.15.49:0/2529922167 shutdown_connections 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd11015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 --2- 172.21.15.49:0/2529922167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd1100af4a0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 -- 172.21.15.49:0/2529922167 >> 172.21.15.49:0/2529922167 conn(0x7fd1100cf2f0 msgr2=0x7fd1100cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 -- 172.21.15.49:0/2529922167 shutdown_connections 2023-12-19T05:52:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.749+0000 7fd117023640 1 -- 172.21.15.49:0/2529922167 wait complete. 2023-12-19T05:52:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.751+0000 7fd117023640 1 Processor -- start 2023-12-19T05:52:06.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.751+0000 7fd117023640 1 -- start start 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11006dea0 0x7fd110156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd110158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110143e10 con 0x7fd11006dac0 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110156fe0 con 0x7fd11006dea0 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.752+0000 7fd117023640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd110157880 con 0x7fd1100aee40 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50498/0 (socket says 172.21.15.49:50498) 2023-12-19T05:52:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 -- 172.21.15.49:0/3989113438 learned_addr learned my addr 172.21.15.49:0/3989113438 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd10ffff640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11006dea0 0x7fd110156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd1155c0640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd110158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 -- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 msgr2=0x7fd110158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd110158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 -- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11006dea0 msgr2=0x7fd110156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11006dea0 0x7fd110156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.753+0000 7fd114dbf640 1 -- 172.21.15.49:0/3989113438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040094d0 con 0x7fd11006dac0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd114dbf640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd1040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10403ac60 con 0x7fd11006dac0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10403adc0 con 0x7fd11006dac0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104044630 con 0x7fd11006dac0 2023-12-19T05:52:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd110157b60 con 0x7fd11006dac0 2023-12-19T05:52:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.754+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd110158120 con 0x7fd11006dac0 2023-12-19T05:52:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.755+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110074770 con 0x7fd11006dac0 2023-12-19T05:52:06.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.757+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd10402f050 con 0x7fd11006dac0 2023-12-19T05:52:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.758+0000 7fd10d7fa640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 0x7fd0f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.758+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fd1040aaae0 con 0x7fd11006dac0 2023-12-19T05:52:06.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.759+0000 7fd10ffff640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 0x7fd0f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.760+0000 7fd10ffff640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 0x7fd0f406c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd1100ccb40 tx=0x7fd0fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.762+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd104076480 con 0x7fd11006dac0 2023-12-19T05:52:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:06.963+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd110061910 con 0x7fd11006dac0 2023-12-19T05:52:07.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.483+0000 7fd10d7fa640 1 -- 172.21.15.49:0/3989113438 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v184) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd104031e60 con 0x7fd11006dac0 2023-12-19T05:52:07.485 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:52:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 msgr2=0x7fd0f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 0x7fd0f406c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd1100ccb40 tx=0x7fd0fc009040 comp rx=0 tx=0).stop 2023-12-19T05:52:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 msgr2=0x7fd11013abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd1040046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 shutdown_connections 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd0f406a430 0x7fd0f406c8f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100aee40 0x7fd110158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11006dea0 0x7fd110156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 --2- 172.21.15.49:0/3989113438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd11006dac0 0x7fd11013abf0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.487+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 >> 172.21.15.49:0/3989113438 conn(0x7fd1100cf2f0 msgr2=0x7fd110144780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.488+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 shutdown_connections 2023-12-19T05:52:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.488+0000 7fd117023640 1 -- 172.21.15.49:0/3989113438 wait complete. 2023-12-19T05:52:07.513 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:52:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.747+0000 7f9945e38640 1 Processor -- start 2023-12-19T05:52:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.747+0000 7f9945e38640 1 -- start start 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f9945e38640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f994006f160 0x7f99400d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f9945e38640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400d2d20 con 0x7f9940146d60 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f9945e38640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400d3000 con 0x7f99400d1c60 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f9945e38640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99400d2110 con 0x7f994006f160 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f993f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9940146d60 0x7f99400b6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46290/0 (socket says 172.21.15.49:46290) 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f993f7fe640 1 -- 172.21.15.49:0/2155809877 learned_addr learned my addr 172.21.15.49:0/2155809877 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.749+0000 7f9936ffd640 1 --2- 172.21.15.49:0/2155809877 >> v2:172.21.15.49:3300/0 conn(0x7f994006f160 0x7f99400d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.750+0000 7f9936ffd640 1 -- 172.21.15.49:0/2155809877 >> v1:172.21.15.115:6789/0 conn(0x7f99400d1c60 legacy=0x7f994015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.750+0000 7f9936ffd640 1 -- 172.21.15.49:0/2155809877 >> v1:172.21.15.49:6789/0 conn(0x7f9940146d60 legacy=0x7f99400b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.750+0000 7f9936ffd640 1 -- 172.21.15.49:0/2155809877 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400b8c70 con 0x7f994006f160 2023-12-19T05:52:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.751+0000 7f9936ffd640 1 --2- 172.21.15.49:0/2155809877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f994006f160 0x7f99400d1720 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f99280097a0 tx=0x7f992802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c675960189c37cfe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:07.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.751+0000 7f993effd640 1 -- 172.21.15.49:0/2155809877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928031830 con 0x7f994006f160 2023-12-19T05:52:07.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.752+0000 7f993effd640 1 -- 172.21.15.49:0/2155809877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9928031990 con 0x7f994006f160 2023-12-19T05:52:07.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.752+0000 7f993effd640 1 -- 172.21.15.49:0/2155809877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928031d20 con 0x7f994006f160 2023-12-19T05:52:07.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.752+0000 7f9945e38640 1 -- 172.21.15.49:0/2155809877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f994006f160 msgr2=0x7f99400d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.752+0000 7f9945e38640 1 --2- 172.21.15.49:0/2155809877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f994006f160 0x7f99400d1720 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f99280097a0 tx=0x7f992802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.753+0000 7f9945e38640 1 -- 172.21.15.49:0/2155809877 shutdown_connections 2023-12-19T05:52:07.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.753+0000 7f9945e38640 1 --2- 172.21.15.49:0/2155809877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f994006f160 0x7f99400d1720 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.753+0000 7f9945e38640 1 -- 172.21.15.49:0/2155809877 >> 172.21.15.49:0/2155809877 conn(0x7f99400cfe10 msgr2=0x7f99400d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:07.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.753+0000 7f9945e38640 1 -- 172.21.15.49:0/2155809877 shutdown_connections 2023-12-19T05:52:07.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.753+0000 7f9945e38640 1 -- 172.21.15.49:0/2155809877 wait complete. 2023-12-19T05:52:07.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.754+0000 7f9945e38640 1 Processor -- start 2023-12-19T05:52:07.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.755+0000 7f9945e38640 1 -- start start 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994006f160 0x7f9940160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99400d1c60 0x7f994013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994013edf0 con 0x7f9940146d60 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994013e1b0 con 0x7f994006f160 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9945e38640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994013e450 con 0x7f99400d1c60 2023-12-19T05:52:07.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f993ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f993ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50508/0 (socket says 172.21.15.49:50508) 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f993ffff640 1 -- 172.21.15.49:0/3081647602 learned_addr learned my addr 172.21.15.49:0/3081647602 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f993f7fe640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994006f160 0x7f9940160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.756+0000 7f9936ffd640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99400d1c60 0x7f994013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 -- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99400d1c60 msgr2=0x7f994013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99400d1c60 0x7f994013ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 -- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994006f160 msgr2=0x7f9940160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994006f160 0x7f9940160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 -- 172.21.15.49:0/3081647602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928009400 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993ffff640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f993800c780 tx=0x7f993800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938003d80 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993800ce90 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380052b0 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.757+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994013e730 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.758+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99401f7330 con 0x7f9940146d60 2023-12-19T05:52:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.759+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994013ef30 con 0x7f9940146d60 2023-12-19T05:52:07.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.760+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9938005410 con 0x7f9940146d60 2023-12-19T05:52:07.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.761+0000 7f993cff9640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 0x7f992006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:07.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.761+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9938087b00 con 0x7f9940146d60 2023-12-19T05:52:07.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.762+0000 7f993f7fe640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 0x7f992006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:07.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.763+0000 7f993f7fe640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 0x7f992006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9930005880 tx=0x7f9930009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:07.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.766+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f994013ef30 con 0x7f9940146d60 2023-12-19T05:52:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.963+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f994013ef30 con 0x7f9940146d60 2023-12-19T05:52:07.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.969+0000 7f993cff9640 1 -- 172.21.15.49:0/3081647602 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f994013ef30 con 0x7f9940146d60 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 msgr2=0x7f992006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 0x7f992006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9930005880 tx=0x7f9930009040 comp rx=0 tx=0).stop 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 msgr2=0x7f9940140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f993800c780 tx=0x7f993800cc40 comp rx=0 tx=0).stop 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 shutdown_connections 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f992006a430 0x7f992006c8f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99400d1c60 0x7f994013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940146d60 0x7f9940140510 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 --2- 172.21.15.49:0/3081647602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994006f160 0x7f9940160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 >> 172.21.15.49:0/3081647602 conn(0x7f99400cfe10 msgr2=0x7f9940145cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 shutdown_connections 2023-12-19T05:52:07.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:07.972+0000 7f9945e38640 1 -- 172.21.15.49:0/3081647602 wait complete. 2023-12-19T05:52:07.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-19T05:52:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.228+0000 7f02b6d47640 1 Processor -- start 2023-12-19T05:52:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.228+0000 7f02b6d47640 1 -- start start 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.230+0000 7f02b6d47640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02b01449e0 0x7f02b00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.230+0000 7f02b6d47640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02b006c6b0 0x7f02b00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.230+0000 7f02b6d47640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b00afb10 con 0x7f02b00b0b50 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.230+0000 7f02b6d47640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b006bb30 con 0x7f02b006c6b0 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.230+0000 7f02b6d47640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00b0070 con 0x7f02b01449e0 2023-12-19T05:52:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02b006c6b0 0x7f02b00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02b006c6b0 0x7f02b00b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50514/0 (socket says 172.21.15.49:50514) 2023-12-19T05:52:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 -- 172.21.15.49:0/464027059 learned_addr learned my addr 172.21.15.49:0/464027059 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b4ae3640 1 --2- 172.21.15.49:0/464027059 >> v2:172.21.15.115:3300/0 conn(0x7f02b01449e0 0x7f02b00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 -- 172.21.15.49:0/464027059 >> v2:172.21.15.115:3300/0 conn(0x7f02b01449e0 msgr2=0x7f02b00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 --2- 172.21.15.49:0/464027059 >> v2:172.21.15.115:3300/0 conn(0x7f02b01449e0 0x7f02b00af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.231+0000 7f02b52e4640 1 -- 172.21.15.49:0/464027059 >> v1:172.21.15.115:6789/0 conn(0x7f02b00b0b50 legacy=0x7f02b006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.232+0000 7f02b52e4640 1 -- 172.21.15.49:0/464027059 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00b0350 con 0x7f02b006c6b0 2023-12-19T05:52:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.233+0000 7f02b52e4640 1 --2- 172.21.15.49:0/464027059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b006c6b0 0x7f02b00b1710 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f02b0071cd0 tx=0x7f02a802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae56e1435a656808 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.233+0000 7f02af7fe640 1 -- 172.21.15.49:0/464027059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a802cb10 con 0x7f02b006c6b0 2023-12-19T05:52:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.233+0000 7f02af7fe640 1 -- 172.21.15.49:0/464027059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a802cc70 con 0x7f02b006c6b0 2023-12-19T05:52:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.233+0000 7f02af7fe640 1 -- 172.21.15.49:0/464027059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a80343f0 con 0x7f02b006c6b0 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 -- 172.21.15.49:0/464027059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b006c6b0 msgr2=0x7f02b00b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 --2- 172.21.15.49:0/464027059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b006c6b0 0x7f02b00b1710 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f02b0071cd0 tx=0x7f02a802bf70 comp rx=0 tx=0).stop 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 -- 172.21.15.49:0/464027059 shutdown_connections 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 --2- 172.21.15.49:0/464027059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b006c6b0 0x7f02b00b1710 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 --2- 172.21.15.49:0/464027059 >> v2:172.21.15.115:3300/0 conn(0x7f02b01449e0 0x7f02b00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 -- 172.21.15.49:0/464027059 >> 172.21.15.49:0/464027059 conn(0x7f02b00cbb70 msgr2=0x7f02b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 -- 172.21.15.49:0/464027059 shutdown_connections 2023-12-19T05:52:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.234+0000 7f02b6d47640 1 -- 172.21.15.49:0/464027059 wait complete. 2023-12-19T05:52:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.236+0000 7f02b6d47640 1 Processor -- start 2023-12-19T05:52:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.236+0000 7f02b6d47640 1 -- start start 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b006c6b0 0x7f02b01405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02b01449e0 0x7f02b00adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01f6f30 con 0x7f02b00b0b50 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b0140b20 con 0x7f02b006c6b0 2023-12-19T05:52:08.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b6d47640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015d370 con 0x7f02b01449e0 2023-12-19T05:52:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02affff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02affff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50520/0 (socket says 172.21.15.49:50520) 2023-12-19T05:52:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02affff640 1 -- 172.21.15.49:0/526492311 learned_addr learned my addr 172.21.15.49:0/526492311 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.237+0000 7f02b4ae3640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b006c6b0 0x7f02b01405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02b52e4640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02b01449e0 0x7f02b00adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 -- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02b01449e0 msgr2=0x7f02b00adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02b01449e0 0x7f02b00adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 -- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b006c6b0 msgr2=0x7f02b01405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b006c6b0 0x7f02b01405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 -- 172.21.15.49:0/526492311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8009b30 con 0x7f02b00b0b50 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02affff640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c480 tx=0x7f029c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0052d0 con 0x7f02b00b0b50 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c005430 con 0x7f02b00b0b50 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c012870 con 0x7f02b00b0b50 2023-12-19T05:52:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b01f63b0 con 0x7f02b00b0b50 2023-12-19T05:52:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.238+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b01f6970 con 0x7f02b00b0b50 2023-12-19T05:52:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.240+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0061910 con 0x7f02b00b0b50 2023-12-19T05:52:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.240+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f029c0129d0 con 0x7f02b00b0b50 2023-12-19T05:52:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.241+0000 7f02ad7fa640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 0x7f029406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.242+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f029c088120 con 0x7f02b00b0b50 2023-12-19T05:52:08.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.242+0000 7f02b4ae3640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 0x7f029406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:08.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.243+0000 7f02b4ae3640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 0x7f029406c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009a30 tx=0x7f02a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.246+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f029c053aa0 con 0x7f02b00b0b50 2023-12-19T05:52:08.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:08.521+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f02b006e880 con 0x7f02b00b0b50 2023-12-19T05:52:09.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.502+0000 7f02ad7fa640 1 -- 172.21.15.49:0/526492311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v619) v1 ==== 131+0+0 (secure 0 0 0) 0x7f029c0570c0 con 0x7f02b00b0b50 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 msgr2=0x7f029406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 0x7f029406c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009a30 tx=0x7f02a4008040 comp rx=0 tx=0).stop 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 msgr2=0x7f02b015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c480 tx=0x7f029c00c940 comp rx=0 tx=0).stop 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 shutdown_connections 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f029406a430 0x7f029406c8f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02b01449e0 0x7f02b00adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b00b0b50 0x7f02b015ce30 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 --2- 172.21.15.49:0/526492311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b006c6b0 0x7f02b01405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 >> 172.21.15.49:0/526492311 conn(0x7f02b00cbb70 msgr2=0x7f02b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 shutdown_connections 2023-12-19T05:52:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.506+0000 7f02b6d47640 1 -- 172.21.15.49:0/526492311 wait complete. 2023-12-19T05:52:09.530 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-19T05:52:09.530 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-19T05:52:09.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:09.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.765+0000 7f2591a2d640 1 Processor -- start 2023-12-19T05:52:09.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.765+0000 7f2591a2d640 1 -- start start 2023-12-19T05:52:09.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f2591a2d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f258c0b2030 0x7f258c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f2591a2d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f258c0cdbf0 0x7f258c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f2591a2d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c15ec30 con 0x7f258c15e5a0 2023-12-19T05:52:09.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f2591a2d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c15fbc0 con 0x7f258c0cdbf0 2023-12-19T05:52:09.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f2591a2d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c0ce560 con 0x7f258c0b2030 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f259122c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f258c0cdbf0 0x7f258c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.767+0000 7f259122c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f258c0cdbf0 0x7f258c0ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50526/0 (socket says 172.21.15.49:50526) 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f259122c640 1 -- 172.21.15.49:0/842364906 learned_addr learned my addr 172.21.15.49:0/842364906 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f258bfff640 1 --2- 172.21.15.49:0/842364906 >> v2:172.21.15.115:3300/0 conn(0x7f258c0b2030 0x7f258c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f259122c640 1 -- 172.21.15.49:0/842364906 >> v2:172.21.15.115:3300/0 conn(0x7f258c0b2030 msgr2=0x7f258c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f259122c640 1 --2- 172.21.15.49:0/842364906 >> v2:172.21.15.115:3300/0 conn(0x7f258c0b2030 0x7f258c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f259122c640 1 -- 172.21.15.49:0/842364906 >> v1:172.21.15.115:6789/0 conn(0x7f258c15e5a0 legacy=0x7f258c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.768+0000 7f259122c640 1 -- 172.21.15.49:0/842364906 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c15e980 con 0x7f258c0cdbf0 2023-12-19T05:52:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.769+0000 7f259122c640 1 --2- 172.21.15.49:0/842364906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0cdbf0 0x7f258c0ce020 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f258402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c1b7bfe30a9a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f258b7fe640 1 -- 172.21.15.49:0/842364906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584030850 con 0x7f258c0cdbf0 2023-12-19T05:52:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f258b7fe640 1 -- 172.21.15.49:0/842364906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840309b0 con 0x7f258c0cdbf0 2023-12-19T05:52:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f258b7fe640 1 -- 172.21.15.49:0/842364906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584030d40 con 0x7f258c0cdbf0 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 -- 172.21.15.49:0/842364906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0cdbf0 msgr2=0x7f258c0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 --2- 172.21.15.49:0/842364906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0cdbf0 0x7f258c0ce020 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f258402b990 comp rx=0 tx=0).stop 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 -- 172.21.15.49:0/842364906 shutdown_connections 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 --2- 172.21.15.49:0/842364906 >> v2:172.21.15.115:3300/0 conn(0x7f258c0b2030 0x7f258c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 --2- 172.21.15.49:0/842364906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0cdbf0 0x7f258c0ce020 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.770+0000 7f2591a2d640 1 -- 172.21.15.49:0/842364906 >> 172.21.15.49:0/842364906 conn(0x7f258c0b0100 msgr2=0x7f258c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:09.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.771+0000 7f2591a2d640 1 -- 172.21.15.49:0/842364906 shutdown_connections 2023-12-19T05:52:09.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.771+0000 7f2591a2d640 1 -- 172.21.15.49:0/842364906 wait complete. 2023-12-19T05:52:09.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.773+0000 7f2591a2d640 1 Processor -- start 2023-12-19T05:52:09.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.773+0000 7f2591a2d640 1 -- start start 2023-12-19T05:52:09.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f258c0cdbf0 0x7f258c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f258c15e5a0 0x7f258c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cc910 con 0x7f258c0b2030 2023-12-19T05:52:09.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cc350 con 0x7f258c15e5a0 2023-12-19T05:52:09.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.774+0000 7f2591a2d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cc630 con 0x7f258c0cdbf0 2023-12-19T05:52:09.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50532/0 (socket says 172.21.15.49:50532) 2023-12-19T05:52:09.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 -- 172.21.15.49:0/4063598131 learned_addr learned my addr 172.21.15.49:0/4063598131 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:09.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 -- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f258c0cdbf0 msgr2=0x7f258c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f259122c640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f258c15e5a0 0x7f258c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f258bfff640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f258c0cdbf0 0x7f258c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f258c0cdbf0 0x7f258c156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 -- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f258c15e5a0 msgr2=0x7f258c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f258c15e5a0 0x7f258c1570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.775+0000 7f2590a2b640 1 -- 172.21.15.49:0/4063598131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840094d0 con 0x7f258c0b2030 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f2590a2b640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c870 tx=0x7f257c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c003b70 con 0x7f258c0b2030 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c003cf0 con 0x7f258c0b2030 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00aa90 con 0x7f258c0b2030 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c0c8440 con 0x7f258c0b2030 2023-12-19T05:52:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.776+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c0cbf20 con 0x7f258c0b2030 2023-12-19T05:52:09.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.777+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c061910 con 0x7f258c0b2030 2023-12-19T05:52:09.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.778+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f257c00abf0 con 0x7f258c0b2030 2023-12-19T05:52:09.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.779+0000 7f25897fa640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 0x7f257806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:09.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.780+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f257c088500 con 0x7f258c0b2030 2023-12-19T05:52:09.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.780+0000 7f258bfff640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 0x7f257806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:09.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.781+0000 7f258bfff640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 0x7f257806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2580006fd0 tx=0x7f2580008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:09.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.784+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f257c053de0 con 0x7f258c0b2030 2023-12-19T05:52:09.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.981+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f258c0ce980 con 0x7f258c0b2030 2023-12-19T05:52:09.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.983+0000 7f25897fa640 1 -- 172.21.15.49:0/4063598131 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+12529 (secure 0 0 0) 0x7f257c080e60 con 0x7f258c0b2030 2023-12-19T05:52:09.985 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:09.986 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:07.474473+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/2314443722":"2023-12-20T05:52:04.098373+0000","172.21.15.49:6834/2314443722":"2023-12-20T05:52:04.098373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 msgr2=0x7f257806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 0x7f257806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2580006fd0 tx=0x7f2580008040 comp rx=0 tx=0).stop 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 msgr2=0x7f258c0cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c870 tx=0x7f257c00cd30 comp rx=0 tx=0).stop 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 shutdown_connections 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f257806a430 0x7f257806c8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f258c0cdbf0 0x7f258c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f258c15e5a0 0x7f258c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 --2- 172.21.15.49:0/4063598131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f258c0b2030 0x7f258c0cb9e0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 >> 172.21.15.49:0/4063598131 conn(0x7f258c0b0100 msgr2=0x7f258c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 shutdown_connections 2023-12-19T05:52:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:09.986+0000 7f2591a2d640 1 -- 172.21.15.49:0/4063598131 wait complete. 2023-12-19T05:52:10.007 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:52:10.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:52:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.235+0000 7fd4071c4640 1 Processor -- start 2023-12-19T05:52:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.235+0000 7fd4071c4640 1 -- start start 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4071c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd40015ebc0 0x7fd4000ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4071c4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4000b2020 0x7fd4000b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4071c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000cfc90 con 0x7fd40015b040 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4071c4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b29d0 con 0x7fd4000b2020 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4071c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40015b420 con 0x7fd40015ebc0 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4061c2640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd40015b040 0x7fd4000b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46298/0 (socket says 172.21.15.49:46298) 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4061c2640 1 -- 172.21.15.49:0/2701087319 learned_addr learned my addr 172.21.15.49:0/2701087319 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.237+0000 7fd4069c3640 1 --2- 172.21.15.49:0/2701087319 >> v2:172.21.15.49:3300/0 conn(0x7fd4000b2020 0x7fd4000b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4059c1640 1 --2- 172.21.15.49:0/2701087319 >> v2:172.21.15.115:3300/0 conn(0x7fd40015ebc0 0x7fd4000ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4069c3640 1 -- 172.21.15.49:0/2701087319 >> v2:172.21.15.115:3300/0 conn(0x7fd40015ebc0 msgr2=0x7fd4000ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4069c3640 1 --2- 172.21.15.49:0/2701087319 >> v2:172.21.15.115:3300/0 conn(0x7fd40015ebc0 0x7fd4000ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4069c3640 1 -- 172.21.15.49:0/2701087319 >> v1:172.21.15.49:6789/0 conn(0x7fd40015b040 legacy=0x7fd4000b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4069c3640 1 -- 172.21.15.49:0/2701087319 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000cf080 con 0x7fd4000b2020 2023-12-19T05:52:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.238+0000 7fd4051c0640 1 -- 172.21.15.49:0/2701087319 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088935823 0 0) 0x7fd4000cfc90 con 0x7fd40015b040 2023-12-19T05:52:10.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.239+0000 7fd4069c3640 1 --2- 172.21.15.49:0/2701087319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd4000b2490 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fd4000afe40 tx=0x7fd3f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92381288f5fd72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.240+0000 7fd4051c0640 1 -- 172.21.15.49:0/2701087319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8031830 con 0x7fd4000b2020 2023-12-19T05:52:10.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.240+0000 7fd4051c0640 1 -- 172.21.15.49:0/2701087319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8031990 con 0x7fd4000b2020 2023-12-19T05:52:10.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.240+0000 7fd4051c0640 1 -- 172.21.15.49:0/2701087319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8031d20 con 0x7fd4000b2020 2023-12-19T05:52:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.240+0000 7fd4071c4640 1 -- 172.21.15.49:0/2701087319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 msgr2=0x7fd4000b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.240+0000 7fd4071c4640 1 --2- 172.21.15.49:0/2701087319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd4000b2490 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fd4000afe40 tx=0x7fd3f802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 -- 172.21.15.49:0/2701087319 shutdown_connections 2023-12-19T05:52:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 --2- 172.21.15.49:0/2701087319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd4000b2490 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 --2- 172.21.15.49:0/2701087319 >> v2:172.21.15.115:3300/0 conn(0x7fd40015ebc0 0x7fd4000ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 -- 172.21.15.49:0/2701087319 >> 172.21.15.49:0/2701087319 conn(0x7fd400071370 msgr2=0x7fd400071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:10.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 -- 172.21.15.49:0/2701087319 shutdown_connections 2023-12-19T05:52:10.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.241+0000 7fd4071c4640 1 -- 172.21.15.49:0/2701087319 wait complete. 2023-12-19T05:52:10.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.243+0000 7fd4071c4640 1 Processor -- start 2023-12-19T05:52:10.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.243+0000 7fd4071c4640 1 -- start start 2023-12-19T05:52:10.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40015b040 0x7fd4001f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40015ebc0 0x7fd4001f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd400153db0 con 0x7fd4000b2020 2023-12-19T05:52:10.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40015e310 con 0x7fd40015b040 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4071c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ae300 con 0x7fd40015ebc0 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4061c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4061c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50548/0 (socket says 172.21.15.49:50548) 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4061c2640 1 -- 172.21.15.49:0/198068968 learned_addr learned my addr 172.21.15.49:0/198068968 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4059c1640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40015b040 0x7fd4001f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4061c2640 1 -- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40015ebc0 msgr2=0x7fd4001f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.244+0000 7fd4069c3640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40015ebc0 0x7fd4001f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4061c2640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40015ebc0 0x7fd4001f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4061c2640 1 -- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40015b040 msgr2=0x7fd4001f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4061c2640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40015b040 0x7fd4001f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4061c2640 1 -- 172.21.15.49:0/198068968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009400 con 0x7fd4000b2020 2023-12-19T05:52:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4061c2640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c890 tx=0x7fd3fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00a5e0 con 0x7fd4000b2020 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00a760 con 0x7fd4000b2020 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00ab10 con 0x7fd4000b2020 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000ada30 con 0x7fd4000b2020 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.245+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000adff0 con 0x7fd4000b2020 2023-12-19T05:52:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.247+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400061910 con 0x7fd4000b2020 2023-12-19T05:52:10.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.248+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3fc00ac70 con 0x7fd4000b2020 2023-12-19T05:52:10.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.249+0000 7fd3f6ffd640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 0x7fd3e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.249+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd3fc087ba0 con 0x7fd4000b2020 2023-12-19T05:52:10.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.250+0000 7fd4059c1640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 0x7fd3e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.251+0000 7fd4059c1640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 0x7fd3e406c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd4000b0a30 tx=0x7fd3f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.254+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3fc0533f0 con 0x7fd4000b2020 2023-12-19T05:52:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.445+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd40006dab0 con 0x7fd4000b2020 2023-12-19T05:52:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.447+0000 7fd3f6ffd640 1 -- 172.21.15.49:0/198068968 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3fc0180a0 con 0x7fd4000b2020 2023-12-19T05:52:10.448 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:52:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 msgr2=0x7fd3e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 0x7fd3e406c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd4000b0a30 tx=0x7fd3f0008040 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 msgr2=0x7fd40015d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c890 tx=0x7fd3fc00cd50 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 shutdown_connections 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fd3e406a430 0x7fd3e406c8f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40015ebc0 0x7fd4001f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40015b040 0x7fd4001f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 --2- 172.21.15.49:0/198068968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4000b2020 0x7fd40015d6e0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.449+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 >> 172.21.15.49:0/198068968 conn(0x7fd400071370 msgr2=0x7fd4000b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.450+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 shutdown_connections 2023-12-19T05:52:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.450+0000 7fd4071c4640 1 -- 172.21.15.49:0/198068968 wait complete. 2023-12-19T05:52:10.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-19T05:52:10.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.704+0000 7f9337592640 1 Processor -- start 2023-12-19T05:52:10.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.704+0000 7f9337592640 1 -- start start 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f9337592640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93301449e0 0x7f93300af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f9337592640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f93300b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f9337592640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93300afb10 con 0x7f93300b0b50 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f9337592640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933006bb30 con 0x7f93301449e0 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f9337592640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300b0070 con 0x7f933006c6b0 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f933532e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93301449e0 0x7f93300af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f933532e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93301449e0 0x7f93300af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50562/0 (socket says 172.21.15.49:50562) 2023-12-19T05:52:10.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.706+0000 7f933532e640 1 -- 172.21.15.49:0/2884169959 learned_addr learned my addr 172.21.15.49:0/2884169959 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f9335b2f640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f93300b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f933532e640 1 -- 172.21.15.49:0/2884169959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 msgr2=0x7f93300b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f933532e640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f93300b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f933532e640 1 -- 172.21.15.49:0/2884169959 >> v1:172.21.15.115:6789/0 conn(0x7f93300b0b50 legacy=0x7f933006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f933532e640 1 -- 172.21.15.49:0/2884169959 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93300b0350 con 0x7f93301449e0 2023-12-19T05:52:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.707+0000 7f9335b2f640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f93300b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.708+0000 7f933532e640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93301449e0 0x7f93300af5d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9324009e50 tx=0x7f932402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad96404d9058fe26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.708+0000 7f932ffff640 1 -- 172.21.15.49:0/2884169959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932402ca80 con 0x7f93301449e0 2023-12-19T05:52:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.708+0000 7f932ffff640 1 -- 172.21.15.49:0/2884169959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932402cbe0 con 0x7f93301449e0 2023-12-19T05:52:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.708+0000 7f932ffff640 1 -- 172.21.15.49:0/2884169959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240343f0 con 0x7f93301449e0 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 -- 172.21.15.49:0/2884169959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93301449e0 msgr2=0x7f93300af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93301449e0 0x7f93300af5d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9324009e50 tx=0x7f932402bee0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 -- 172.21.15.49:0/2884169959 shutdown_connections 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f93300b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 --2- 172.21.15.49:0/2884169959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93301449e0 0x7f93300af5d0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 -- 172.21.15.49:0/2884169959 >> 172.21.15.49:0/2884169959 conn(0x7f93300cbb70 msgr2=0x7f93300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 -- 172.21.15.49:0/2884169959 shutdown_connections 2023-12-19T05:52:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.709+0000 7f9337592640 1 -- 172.21.15.49:0/2884169959 wait complete. 2023-12-19T05:52:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.711+0000 7f9337592640 1 Processor -- start 2023-12-19T05:52:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.711+0000 7f9337592640 1 -- start start 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f9330158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 0x7f93300c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300c7040 con 0x7f93300b0b50 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300c7320 con 0x7f93301449e0 2023-12-19T05:52:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9337592640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300c7600 con 0x7f933006c6b0 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50574/0 (socket says 172.21.15.49:50574) 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 -- 172.21.15.49:0/4012819746 learned_addr learned my addr 172.21.15.49:0/4012819746 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9335b2f640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 0x7f93300c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f933532e640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f9330158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 -- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 msgr2=0x7f9330158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f9330158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 -- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 msgr2=0x7f93300c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 0x7f93300c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9334b2d640 1 -- 172.21.15.49:0/4012819746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9324009b30 con 0x7f93300b0b50 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.713+0000 7f9335b2f640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 0x7f93300c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f9334b2d640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c430 tx=0x7f931c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011790 con 0x7f93300b0b50 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0118f0 con 0x7f93300b0b50 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011ce0 con 0x7f93300b0b50 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93300c78e0 con 0x7f93300b0b50 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.714+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93301593d0 con 0x7f93300b0b50 2023-12-19T05:52:10.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.715+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9330159590 con 0x7f93300b0b50 2023-12-19T05:52:10.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.717+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f931c01c460 con 0x7f93300b0b50 2023-12-19T05:52:10.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.718+0000 7f932dffb640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 0x7f931406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:10.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.718+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f931c088630 con 0x7f93300b0b50 2023-12-19T05:52:10.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.718+0000 7f933532e640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 0x7f931406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:10.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.720+0000 7f933532e640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 0x7f931406c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9324035000 tx=0x7f9324030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.723+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f931c053e80 con 0x7f93300b0b50 2023-12-19T05:52:10.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:10.990+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f9330061910 con 0x7f93300b0b50 2023-12-19T05:52:11.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.507+0000 7f932dffb640 1 -- 172.21.15.49:0/4012819746 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v621) v1 ==== 138+0+0 (secure 0 0 0) 0x7f931c0574a0 con 0x7f93300b0b50 2023-12-19T05:52:11.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 msgr2=0x7f931406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:11.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 0x7f931406c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9324035000 tx=0x7f9324030000 comp rx=0 tx=0).stop 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 msgr2=0x7f9330158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c430 tx=0x7f931c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 shutdown_connections 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f931406a430 0x7f931406c8f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93301449e0 0x7f93300c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93300b0b50 0x7f9330158e90 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 --2- 172.21.15.49:0/4012819746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f933006c6b0 0x7f9330158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 >> 172.21.15.49:0/4012819746 conn(0x7f93300cbb70 msgr2=0x7f93300af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 shutdown_connections 2023-12-19T05:52:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.511+0000 7f9337592640 1 -- 172.21.15.49:0/4012819746 wait complete. 2023-12-19T05:52:11.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:52:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.781+0000 7f6c1359e640 1 Processor -- start 2023-12-19T05:52:11.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.782+0000 7f6c1359e640 1 -- start start 2023-12-19T05:52:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.783+0000 7f6c1359e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6c14141900 0x7f6c140afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.783+0000 7f6c1359e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c140b02a0 0x7f6c1406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.783+0000 7f6c1359e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1406e220 con 0x7f6c1406da30 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.783+0000 7f6c1359e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140b0730 con 0x7f6c140b02a0 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.783+0000 7f6c1359e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140cbea0 con 0x7f6c14141900 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c140b02a0 0x7f6c1406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c140b02a0 0x7f6c1406d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50582/0 (socket says 172.21.15.49:50582) 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 -- 172.21.15.49:0/3446155603 learned_addr learned my addr 172.21.15.49:0/3446155603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c1259c640 1 --2- 172.21.15.49:0/3446155603 >> v2:172.21.15.115:3300/0 conn(0x7f6c14141900 0x7f6c140afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 -- 172.21.15.49:0/3446155603 >> v2:172.21.15.115:3300/0 conn(0x7f6c14141900 msgr2=0x7f6c140afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 --2- 172.21.15.49:0/3446155603 >> v2:172.21.15.115:3300/0 conn(0x7f6c14141900 0x7f6c140afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 -- 172.21.15.49:0/3446155603 >> v1:172.21.15.115:6789/0 conn(0x7f6c1406da30 legacy=0x7f6c140ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.784+0000 7f6c0bfff640 1 -- 172.21.15.49:0/3446155603 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140cc180 con 0x7f6c140b02a0 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.785+0000 7f6c0bfff640 1 --2- 172.21.15.49:0/3446155603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c140b02a0 0x7f6c1406d4f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6c14067480 tx=0x7f6bfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2a6803157cf1ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.786+0000 7f6c11d9b640 1 -- 172.21.15.49:0/3446155603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031870 con 0x7f6c140b02a0 2023-12-19T05:52:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.786+0000 7f6c11d9b640 1 -- 172.21.15.49:0/3446155603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0319d0 con 0x7f6c140b02a0 2023-12-19T05:52:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.786+0000 7f6c11d9b640 1 -- 172.21.15.49:0/3446155603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031d60 con 0x7f6c140b02a0 2023-12-19T05:52:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 -- 172.21.15.49:0/3446155603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c140b02a0 msgr2=0x7f6c1406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3446155603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c140b02a0 0x7f6c1406d4f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6c14067480 tx=0x7f6bfc02b910 comp rx=0 tx=0).stop 2023-12-19T05:52:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 -- 172.21.15.49:0/3446155603 shutdown_connections 2023-12-19T05:52:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3446155603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c140b02a0 0x7f6c1406d4f0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3446155603 >> v2:172.21.15.115:3300/0 conn(0x7f6c14141900 0x7f6c140afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 -- 172.21.15.49:0/3446155603 >> 172.21.15.49:0/3446155603 conn(0x7f6c1406f630 msgr2=0x7f6c1406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 -- 172.21.15.49:0/3446155603 shutdown_connections 2023-12-19T05:52:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.787+0000 7f6c1359e640 1 -- 172.21.15.49:0/3446155603 wait complete. 2023-12-19T05:52:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.789+0000 7f6c1359e640 1 Processor -- start 2023-12-19T05:52:11.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.789+0000 7f6c1359e640 1 -- start start 2023-12-19T05:52:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.790+0000 7f6c1359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.790+0000 7f6c1359e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c140b02a0 0x7f6c1413f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.790+0000 7f6c1359e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c14141900 0x7f6c140b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.790+0000 7f6c1359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140b1230 con 0x7f6c1406da30 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1359e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140b2090 con 0x7f6c14141900 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1359e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140b1480 con 0x7f6c140b02a0 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50588/0 (socket says 172.21.15.49:50588) 2023-12-19T05:52:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 -- 172.21.15.49:0/3065265496 learned_addr learned my addr 172.21.15.49:0/3065265496 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 -- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c140b02a0 msgr2=0x7f6c1413f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c140b02a0 0x7f6c1413f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 -- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c14141900 msgr2=0x7f6c140b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c14141900 0x7f6c140b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.791+0000 7f6c1259c640 1 -- 172.21.15.49:0/3065265496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0094d0 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c1259c640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d600 tx=0x7f6c0400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c040125f0 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04012770 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140b1760 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04012b20 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.792+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c140b1d20 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.793+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1404e160 con 0x7f6c1406da30 2023-12-19T05:52:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.794+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c04012c80 con 0x7f6c1406da30 2023-12-19T05:52:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.795+0000 7f6c0affd640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 0x7f6bf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.795+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c04088b20 con 0x7f6c1406da30 2023-12-19T05:52:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.796+0000 7f6c0bfff640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 0x7f6bf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.797+0000 7f6c0bfff640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 0x7f6bf406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc036000 tx=0x7f6bfc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.799+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c1404e160 con 0x7f6c1406da30 2023-12-19T05:52:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:11.991+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c1404e160 con 0x7f6c1406da30 2023-12-19T05:52:12.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.000+0000 7f6c0affd640 1 -- 172.21.15.49:0/3065265496 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c1404e160 con 0x7f6c1406da30 2023-12-19T05:52:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 msgr2=0x7f6bf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 0x7f6bf406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc036000 tx=0x7f6bfc030000 comp rx=0 tx=0).stop 2023-12-19T05:52:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 msgr2=0x7f6c14156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400d600 tx=0x7f6c0400dac0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 shutdown_connections 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f6bf406a430 0x7f6bf406c8f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c140b02a0 0x7f6c1413f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c14141900 0x7f6c140b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 --2- 172.21.15.49:0/3065265496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c1406da30 0x7f6c14156df0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 >> 172.21.15.49:0/3065265496 conn(0x7f6c1406f630 msgr2=0x7f6c1415ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 shutdown_connections 2023-12-19T05:52:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.003+0000 7f6c1359e640 1 -- 172.21.15.49:0/3065265496 wait complete. 2023-12-19T05:52:12.026 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:52:12.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:52:12.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:52:12.278 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:52:12.279 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:12.279 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:12.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:52:12.342 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:12.342 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:12.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:52:12.404 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:12.404 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:12.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:52:12.468 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:12.468 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:12.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:52:12.526 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T05:52:12.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:12.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.767+0000 7f0a6feb6640 1 Processor -- start 2023-12-19T05:52:12.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.767+0000 7f0a6feb6640 1 -- start start 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.769+0000 7f0a6feb6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.769+0000 7f0a6feb6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a6815e040 0x7f0a6815e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.769+0000 7f0a6feb6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6806e890 con 0x7f0a6806e410 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.769+0000 7f0a6feb6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6815e9c0 con 0x7f0a6815e040 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.769+0000 7f0a6feb6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b2600 con 0x7f0a68157aa0 2023-12-19T05:52:12.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.770+0000 7f0a6e453640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a6815e040 0x7f0a6815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.770+0000 7f0a6dc52640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.770+0000 7f0a6d451640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0a6806e410 0x7f0a68161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54606/0 (socket says 172.21.15.49:54606) 2023-12-19T05:52:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.770+0000 7f0a6dc52640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:34624/0 (socket says 172.21.15.49:34624) 2023-12-19T05:52:12.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.770+0000 7f0a6d451640 1 -- 172.21.15.49:0/208885975 learned_addr learned my addr 172.21.15.49:0/208885975 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6cc50640 1 -- 172.21.15.49:0/208885975 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052553252 0 0) 0x7f0a6806e890 con 0x7f0a6806e410 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6cc50640 1 -- 172.21.15.49:0/208885975 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a54003520 con 0x7f0a6806e410 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6dc52640 1 -- 172.21.15.49:0/208885975 >> v2:172.21.15.115:3300/0 conn(0x7f0a6815e040 msgr2=0x7f0a6815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6dc52640 1 --2- 172.21.15.49:0/208885975 >> v2:172.21.15.115:3300/0 conn(0x7f0a6815e040 0x7f0a6815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6dc52640 1 -- 172.21.15.49:0/208885975 >> v1:172.21.15.115:6789/0 conn(0x7f0a6806e410 legacy=0x7f0a68161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.771+0000 7f0a6dc52640 1 -- 172.21.15.49:0/208885975 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680b1d60 con 0x7f0a68157aa0 2023-12-19T05:52:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.772+0000 7f0a6dc52640 1 --2- 172.21.15.49:0/208885975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a640097a0 tx=0x7f0a6402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e528a85f0bed05a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.772+0000 7f0a6cc50640 1 -- 172.21.15.49:0/208885975 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6402d040 con 0x7f0a68157aa0 2023-12-19T05:52:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.772+0000 7f0a6cc50640 1 -- 172.21.15.49:0/208885975 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64031810 con 0x7f0a68157aa0 2023-12-19T05:52:12.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6cc50640 1 -- 172.21.15.49:0/208885975 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64031ba0 con 0x7f0a68157aa0 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 -- 172.21.15.49:0/208885975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 msgr2=0x7f0a680b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/208885975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a640097a0 tx=0x7f0a6402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 -- 172.21.15.49:0/208885975 shutdown_connections 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/208885975 >> v2:172.21.15.115:3300/0 conn(0x7f0a6815e040 0x7f0a6815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/208885975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68157aa0 0x7f0a680b1710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 -- 172.21.15.49:0/208885975 >> 172.21.15.49:0/208885975 conn(0x7f0a680cbb70 msgr2=0x7f0a680cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 -- 172.21.15.49:0/208885975 shutdown_connections 2023-12-19T05:52:12.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.773+0000 7f0a6feb6640 1 -- 172.21.15.49:0/208885975 wait complete. 2023-12-19T05:52:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.776+0000 7f0a6feb6640 1 Processor -- start 2023-12-19T05:52:12.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.776+0000 7f0a6feb6640 1 -- start start 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a6806e410 0x7f0a680aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a68157aa0 0x7f0a6815f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6814de90 con 0x7f0a6815e040 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680adde0 con 0x7f0a68157aa0 2023-12-19T05:52:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.777+0000 7f0a6feb6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680ae0c0 con 0x7f0a6806e410 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50596/0 (socket says 172.21.15.49:50596) 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 -- 172.21.15.49:0/3573138011 learned_addr learned my addr 172.21.15.49:0/3573138011 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6dc52640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a6806e410 0x7f0a680aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6d451640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a68157aa0 0x7f0a6815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 -- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a6806e410 msgr2=0x7f0a680aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a6806e410 0x7f0a680aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 -- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a68157aa0 msgr2=0x7f0a6815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a68157aa0 0x7f0a6815f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:12.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.778+0000 7f0a6e453640 1 -- 172.21.15.49:0/3573138011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009400 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a6e453640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000efc0 tx=0x7f0a6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60014480 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000f040 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60014820 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6815ec30 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.779+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6814dad0 con 0x7f0a6815e040 2023-12-19T05:52:12.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.780+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6815f150 con 0x7f0a6815e040 2023-12-19T05:52:12.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.781+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a60014980 con 0x7f0a6815e040 2023-12-19T05:52:12.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.782+0000 7f0a5e7fc640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:12.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.782+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a60089250 con 0x7f0a6815e040 2023-12-19T05:52:12.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.783+0000 7f0a6dc52640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:12.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.784+0000 7f0a6dc52640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0a64036000 tx=0x7f0a6403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:12.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:12.787+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a6815f150 con 0x7f0a6815e040 2023-12-19T05:52:13.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.021+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a6815f150 con 0x7f0a6815e040 2023-12-19T05:52:13.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.022+0000 7f0a5e7fc640 1 -- 172.21.15.49:0/3573138011 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0a60018de0 con 0x7f0a6815e040 2023-12-19T05:52:13.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:13.025 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2911922040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2911922040},{"type":"v1","addr":"172.21.15.115:6836","nonce":2911922040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3485262812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3485262812},{"type":"v1","addr":"172.21.15.115:6837","nonce":3485262812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2677346416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2677346416},{"type":"v1","addr":"172.21.15.49:6833","nonce":2677346416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3435016457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3435016457},{"type":"v1","addr":"172.21.15.49:6835","nonce":3435016457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-12-19T05:52:13.025 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 82 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 msgr2=0x7f0a4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0a64036000 tx=0x7f0a6403c040 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 msgr2=0x7f0a6806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000efc0 tx=0x7f0a6000c490 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 shutdown_connections 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a6815e040 0x7f0a6806c4e0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a68157aa0 0x7f0a6815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 --2- 172.21.15.49:0/3573138011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a6806e410 0x7f0a680aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 >> 172.21.15.49:0/3573138011 conn(0x7f0a680cbb70 msgr2=0x7f0a680ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:13.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 shutdown_connections 2023-12-19T05:52:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.025+0000 7f0a6feb6640 1 -- 172.21.15.49:0/3573138011 wait complete. 2023-12-19T05:52:13.049 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:52:13.049 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:52:13.049 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:52:13.049 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:52:13.050 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:52:13.050 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:52:13.050 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:52:13.050 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:52:13.050 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:52:13.050 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:52:13.050 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:52:13.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:52:13.051 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T05:52:13.051 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T05:52:13.051 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:52:13.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:52:13.069 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:52:13.069 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:52:13.070 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:52:13.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T05:52:13.076 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:52:13.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:52:13.083 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:52:13.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:52:13.121 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:52:13.122 DEBUG:teuthology.parallel:result is None 2023-12-19T05:52:13.129 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:52:13.129 DEBUG:teuthology.parallel:result is None 2023-12-19T05:52:13.133 INFO:tasks.ceph.mds.d:Started 2023-12-19T05:52:13.135 DEBUG:teuthology.parallel:result is None 2023-12-19T05:52:13.140 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:52:13.140 DEBUG:teuthology.parallel:result is None 2023-12-19T05:52:13.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:52:13.296 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-12-19T05:52:13.296 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-12-19T05:52:13.301 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-12-19T05:52:13.301 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:52:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.345+0000 7f8cdadd0640 1 Processor -- start 2023-12-19T05:52:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.345+0000 7f8cdadd0640 1 -- start start 2023-12-19T05:52:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cdadd0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cdadd0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8cd40d2b00 0x7f8cd40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cdadd0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd40cd840 con 0x7f8cd40ce110 2023-12-19T05:52:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cdadd0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40d2430 con 0x7f8cd40d2b00 2023-12-19T05:52:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cdadd0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40d2620 con 0x7f8cd4146e10 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cd8b6c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cd936d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8cd40ce110 0x7f8cd40b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54630/0 (socket says 172.21.15.49:54630) 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cd8b6c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:34668/0 (socket says 172.21.15.49:34668) 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cd936d640 1 -- 172.21.15.49:0/497043447 learned_addr learned my addr 172.21.15.49:0/497043447 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.347+0000 7f8cd3fff640 1 --2- 172.21.15.49:0/497043447 >> v2:172.21.15.115:3300/0 conn(0x7f8cd40d2b00 0x7f8cd40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.348+0000 7f8cd8b6c640 1 -- 172.21.15.49:0/497043447 >> v2:172.21.15.115:3300/0 conn(0x7f8cd40d2b00 msgr2=0x7f8cd40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.348+0000 7f8cd8b6c640 1 --2- 172.21.15.49:0/497043447 >> v2:172.21.15.115:3300/0 conn(0x7f8cd40d2b00 0x7f8cd40b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.348+0000 7f8cd8b6c640 1 -- 172.21.15.49:0/497043447 >> v1:172.21.15.115:6789/0 conn(0x7f8cd40ce110 legacy=0x7f8cd40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.348+0000 7f8cd37fe640 1 -- 172.21.15.49:0/497043447 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169631159 0 0) 0x7f8cd40cd840 con 0x7f8cd40ce110 2023-12-19T05:52:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.348+0000 7f8cd8b6c640 1 -- 172.21.15.49:0/497043447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40b41c0 con 0x7f8cd4146e10 2023-12-19T05:52:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.349+0000 7f8cd8b6c640 1 --2- 172.21.15.49:0/497043447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097a0 tx=0x7f8cc802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e231116b7e1cc5ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.349+0000 7f8cd37fe640 1 -- 172.21.15.49:0/497043447 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8031830 con 0x7f8cd4146e10 2023-12-19T05:52:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.349+0000 7f8cd37fe640 1 -- 172.21.15.49:0/497043447 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8031990 con 0x7f8cd4146e10 2023-12-19T05:52:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.349+0000 7f8cd37fe640 1 -- 172.21.15.49:0/497043447 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8031d20 con 0x7f8cd4146e10 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 -- 172.21.15.49:0/497043447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 msgr2=0x7f8cd40d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/497043447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097a0 tx=0x7f8cc802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 -- 172.21.15.49:0/497043447 shutdown_connections 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/497043447 >> v2:172.21.15.115:3300/0 conn(0x7f8cd40d2b00 0x7f8cd40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/497043447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd4146e10 0x7f8cd40d1ef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 -- 172.21.15.49:0/497043447 >> 172.21.15.49:0/497043447 conn(0x7f8cd40b29c0 msgr2=0x7f8cd40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 -- 172.21.15.49:0/497043447 shutdown_connections 2023-12-19T05:52:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.350+0000 7f8cdadd0640 1 -- 172.21.15.49:0/497043447 wait complete. 2023-12-19T05:52:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.352+0000 7f8cdadd0640 1 Processor -- start 2023-12-19T05:52:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.352+0000 7f8cdadd0640 1 -- start start 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cd40ce110 0x7f8cd41f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd40d2b00 0x7f8cd4145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41f2720 con 0x7f8cd4146e10 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41451f0 con 0x7f8cd40ce110 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cdadd0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4142e10 con 0x7f8cd40d2b00 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cd936d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cd936d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50636/0 (socket says 172.21.15.49:50636) 2023-12-19T05:52:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cd936d640 1 -- 172.21.15.49:0/343081141 learned_addr learned my addr 172.21.15.49:0/343081141 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.353+0000 7f8cd8b6c640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cd40ce110 0x7f8cd41f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd3fff640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd40d2b00 0x7f8cd4145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 -- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd40d2b00 msgr2=0x7f8cd4145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd40d2b00 0x7f8cd4145590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 -- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cd40ce110 msgr2=0x7f8cd41f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cd40ce110 0x7f8cd41f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 -- 172.21.15.49:0/343081141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009400 con 0x7f8cd4146e10 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.354+0000 7f8cd936d640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c7e0 tx=0x7f8ccc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.355+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00a640 con 0x7f8cd4146e10 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.355+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00a7c0 con 0x7f8cd4146e10 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.355+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00ab70 con 0x7f8cd4146e10 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.355+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd413c760 con 0x7f8cd4146e10 2023-12-19T05:52:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.355+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd413cd20 con 0x7f8cd4146e10 2023-12-19T05:52:13.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.356+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4143030 con 0x7f8cd4146e10 2023-12-19T05:52:13.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.357+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ccc00acd0 con 0x7f8cd4146e10 2023-12-19T05:52:13.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.358+0000 7f8cd17fa640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:13.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.358+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8ccc087a70 con 0x7f8cd4146e10 2023-12-19T05:52:13.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.358+0000 7f8cd8b6c640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:13.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.359+0000 7f8cd8b6c640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 0x7f8cb806c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8036000 tx=0x7f8cc803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:13.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.362+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8cd4143030 con 0x7f8cd4146e10 2023-12-19T05:52:13.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:13.574+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8cd4061910 con 0x7f8cd4146e10 2023-12-19T05:52:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.532+0000 7f8cd17fa640 1 -- 172.21.15.49:0/343081141 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v189) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8ccc018080 con 0x7f8cd4146e10 2023-12-19T05:52:14.536 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 msgr2=0x7f8cb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 0x7f8cb806c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8036000 tx=0x7f8cc803c040 comp rx=0 tx=0).stop 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 msgr2=0x7f8cd4145ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c7e0 tx=0x7f8ccc00cca0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 shutdown_connections 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cd40d2b00 0x7f8cd4145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cd4146e10 0x7f8cd4145ad0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 --2- 172.21.15.49:0/343081141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cd40ce110 0x7f8cd41f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 >> 172.21.15.49:0/343081141 conn(0x7f8cd40b29c0 msgr2=0x7f8cd40b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:14.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 shutdown_connections 2023-12-19T05:52:14.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.536+0000 7f8cdadd0640 1 -- 172.21.15.49:0/343081141 wait complete. 2023-12-19T05:52:14.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:52:14.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.790+0000 7f122aea1640 1 Processor -- start 2023-12-19T05:52:14.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.790+0000 7f122aea1640 1 -- start start 2023-12-19T05:52:14.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.791+0000 7f122aea1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12241449e0 0x7f12240af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.791+0000 7f122aea1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f12240b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f122aea1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12240afb10 con 0x7f12240b0b50 2023-12-19T05:52:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f122aea1640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122406bb30 con 0x7f12241449e0 2023-12-19T05:52:14.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f122aea1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12240b0070 con 0x7f122406c6b0 2023-12-19T05:52:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f122943e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f12240b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f1228c3d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12241449e0 0x7f12240af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f1223fff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12240b0b50 0x7f122406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:52978/0 (socket says 172.21.15.49:52978) 2023-12-19T05:52:14.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.792+0000 7f1223fff640 1 -- 172.21.15.49:0/2117613569 learned_addr learned my addr 172.21.15.49:0/2117613569 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.793+0000 7f1228c3d640 1 -- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 msgr2=0x7f12240b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.793+0000 7f1228c3d640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f12240b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.793+0000 7f1228c3d640 1 -- 172.21.15.49:0/2117613569 >> v1:172.21.15.115:6789/0 conn(0x7f12240b0b50 legacy=0x7f122406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.793+0000 7f1228c3d640 1 -- 172.21.15.49:0/2117613569 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12240b0350 con 0x7f12241449e0 2023-12-19T05:52:14.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.793+0000 7f122943e640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f12240b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:52:14.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.795+0000 7f1228c3d640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12240af5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31eb01532f9c917e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:14.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.795+0000 7f12237fe640 1 -- 172.21.15.49:0/2117613569 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121402cc50 con 0x7f12241449e0 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.795+0000 7f12237fe640 1 -- 172.21.15.49:0/2117613569 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121402cdb0 con 0x7f12241449e0 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.795+0000 7f12237fe640 1 -- 172.21.15.49:0/2117613569 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214034660 con 0x7f12241449e0 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 -- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 msgr2=0x7f12240af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12240af5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121402bea0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 -- 172.21.15.49:0/2117613569 shutdown_connections 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f12240b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 --2- 172.21.15.49:0/2117613569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12240af5d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 -- 172.21.15.49:0/2117613569 >> 172.21.15.49:0/2117613569 conn(0x7f12240cbb70 msgr2=0x7f12240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:14.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 -- 172.21.15.49:0/2117613569 shutdown_connections 2023-12-19T05:52:14.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.796+0000 7f122aea1640 1 -- 172.21.15.49:0/2117613569 wait complete. 2023-12-19T05:52:14.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.799+0000 7f122aea1640 1 Processor -- start 2023-12-19T05:52:14.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.799+0000 7f122aea1640 1 -- start start 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f122415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12241f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12241433d0 con 0x7f12240b0b50 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122415d860 con 0x7f12241449e0 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.800+0000 7f122aea1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12241f3a00 con 0x7f122406c6b0 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45936/0 (socket says 172.21.15.49:45936) 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 -- 172.21.15.49:0/3339739283 learned_addr learned my addr 172.21.15.49:0/3339739283 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1228c3d640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f122415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f122943e640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12241f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 -- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 msgr2=0x7f122415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f122415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 -- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 msgr2=0x7f12241f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12241f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f1223fff640 1 -- 172.21.15.49:0/3339739283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c009400 con 0x7f12240b0b50 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.801+0000 7f122943e640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12241f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f1223fff640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f121800c4a0 tx=0x7f121800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218005ce0 con 0x7f12240b0b50 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218005e40 con 0x7f12240b0b50 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1214009a70 con 0x7f12240b0b50 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218007270 con 0x7f12240b0b50 2023-12-19T05:52:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.802+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122415cb20 con 0x7f12240b0b50 2023-12-19T05:52:14.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.803+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1224061910 con 0x7f12240b0b50 2023-12-19T05:52:14.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.804+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1218007490 con 0x7f12240b0b50 2023-12-19T05:52:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.805+0000 7f12217fa640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 0x7f121006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.805+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1218087a90 con 0x7f12240b0b50 2023-12-19T05:52:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.806+0000 7f1228c3d640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 0x7f121006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:14.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.807+0000 7f1228c3d640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 0x7f121006c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1214036000 tx=0x7f1214030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:14.810+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1218053470 con 0x7f12240b0b50 2023-12-19T05:52:15.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.078+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12240ae560 con 0x7f12240b0b50 2023-12-19T05:52:15.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.079+0000 7f12217fa640 1 -- 172.21.15.49:0/3339739283 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1218017090 con 0x7f12240b0b50 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlFyE6IxAA/IPSW8NPdi5WnkYORwtaAQ==", 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:52:15.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlLSQRDhAAR6ts4EXEXHyWgLjbNKPU8g==", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlHBA1NxAA61FU7owHToFitbVzzDlhAw==", 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.083 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlXzBxHhAAwkGkn6qRgcFxRN6haHcCEQ==", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlS4DgGBAAJBDw4s2aiFE5axeb/bkNLQ==", 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-12-19T05:52:15.085 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFljis3KhAAbPq/+f1xWJAYjG/gVrzVpw==", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBZLIFlm/5LOxAAh5+cGGwOA8Bdj68Sg3DXbg==", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.086 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBaLIFlwcrVDxAAeg/5atBiLCDAWBXn8lGONA==", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlIsx+DxAAMw3SDT+aAmatNNit1uxZVA==", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.087 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFldI2RHhAAFWQ1v8tiIQ/saVO8dpxYvA==", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBeLIFlo8L0LhAAvESYJV46ENm0PbgOHH2hzw==", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBfLIFlBblQAxAAWAex3H7wkA+DtD7hNF/uDg==", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFluvluLRAARmxWyKzmcuDCi5R3fFWrZQ==", 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.089 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFl/+LWChAAjRMUaNOEIq0c00ktYPaWhw==", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-12-19T05:52:15.090 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBWLIFlN1KjOhAAXLwWWP+3D5ELHSV3IpKz/A==", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBXLIFlTnU4FRAAUt3lUDz/LqEu1f4zWwatCA==", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-12-19T05:52:15.091 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBULIFlzwCbDxAAVx8ppSITRqQaYPa04FD3QQ==", 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-12-19T05:52:15.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlCNqEFRAAgDj9VhZXjUxMGyN36jHXvA==", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBVLIFlaOUiCBAAGplHgPTcjmNXT+coUcJg8A==", 2023-12-19T05:52:15.093 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:15.094 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 msgr2=0x7f121006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 0x7f121006c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1214036000 tx=0x7f1214030000 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 msgr2=0x7f122406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f121800c4a0 tx=0x7f121800c960 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 shutdown_connections 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f121006a430 0x7f121006c8f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12241449e0 0x7f12241f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12240b0b50 0x7f122406f390 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 --2- 172.21.15.49:0/3339739283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f122406c6b0 0x7f122415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 >> 172.21.15.49:0/3339739283 conn(0x7f12240cbb70 msgr2=0x7f122406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:15.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.081+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 shutdown_connections 2023-12-19T05:52:15.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.082+0000 7f122aea1640 1 -- 172.21.15.49:0/3339739283 wait complete. 2023-12-19T05:52:15.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:15.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.335+0000 7f81e1fb9640 1 Processor -- start 2023-12-19T05:52:15.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.336+0000 7f81e1fb9640 1 -- start start 2023-12-19T05:52:15.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.337+0000 7f81e1fb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81dc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.337+0000 7f81e1fb9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f81dc06c6b0 0x7f81dc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.337+0000 7f81e1fb9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0afb10 con 0x7f81dc0b0b50 2023-12-19T05:52:15.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81e1fb9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc06bb30 con 0x7f81dc06c6b0 2023-12-19T05:52:15.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81e1fb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0b0070 con 0x7f81dc1449e0 2023-12-19T05:52:15.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81d3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f81dc0b0b50 0x7f81dc06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48836/0 (socket says 172.21.15.49:48836) 2023-12-19T05:52:15.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81d3fff640 1 -- 172.21.15.49:0/550664326 learned_addr learned my addr 172.21.15.49:0/550664326 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81db7fe640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81dc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81dbfff640 1 --2- 172.21.15.49:0/550664326 >> v2:172.21.15.115:3300/0 conn(0x7f81dc06c6b0 0x7f81dc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393784991 0 0) 0x7f81dc0afb10 con 0x7f81dc0b0b50 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.338+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003520 con 0x7f81dc0b0b50 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809933553 0 0) 0x7f81c8003520 con 0x7f81dc0b0b50 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 msgr2=0x7f81dc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81dc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 >> v2:172.21.15.115:3300/0 conn(0x7f81dc06c6b0 msgr2=0x7f81dc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 --2- 172.21.15.49:0/550664326 >> v2:172.21.15.115:3300/0 conn(0x7f81dc06c6b0 0x7f81dc0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0b0350 con 0x7f81dc0b0b50 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f81c4001670 con 0x7f81dc0b0b50 2023-12-19T05:52:15.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 >> v1:172.21.15.49:6789/0 conn(0x7f81dc0b0b50 legacy=0x7f81dc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81c80039e0 0x7f81c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c80047c0 0x7f81c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc06bb30 con 0x7f81c80047c0 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0b0070 con 0x7f81c80039e0 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800b9b0 con 0x7f81dc1449e0 2023-12-19T05:52:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.339+0000 7f81d3fff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c80047c0 0x7f81c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81db7fe640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81c80039e0 0x7f81c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81dbfff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81d3fff640 1 -- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 msgr2=0x7f81c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81d3fff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81d3fff640 1 -- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81c80039e0 msgr2=0x7f81c8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81d3fff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81c80039e0 0x7f81c8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81d3fff640 1 -- 172.21.15.49:0/550664326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003520 con 0x7f81c80047c0 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81db7fe640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81c80039e0 0x7f81c8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.340+0000 7f81dbfff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81dc1449e0 0x7f81c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.341+0000 7f81d3fff640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c80047c0 0x7f81c8004c40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c110 tx=0x7f81c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187a9d8bd210893b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.341+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4005ad0 con 0x7f81c80047c0 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.341+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4005c50 con 0x7f81c80047c0 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.341+0000 7f81daffd640 1 -- 172.21.15.49:0/550664326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c402c830 con 0x7f81c80047c0 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 -- 172.21.15.49:0/550664326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c80047c0 msgr2=0x7f81c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/550664326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c80047c0 0x7f81c8004c40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c110 tx=0x7f81c80057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81dbfff640 1 -- 172.21.15.49:0/550664326 reap_dead start 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 -- 172.21.15.49:0/550664326 shutdown_connections 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 -- 172.21.15.49:0/550664326 >> 172.21.15.49:0/550664326 conn(0x7f81dc0cbb70 msgr2=0x7f81dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 -- 172.21.15.49:0/550664326 shutdown_connections 2023-12-19T05:52:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.342+0000 7f81e1fb9640 1 -- 172.21.15.49:0/550664326 wait complete. 2023-12-19T05:52:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.344+0000 7f81e1fb9640 1 Processor -- start 2023-12-19T05:52:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.344+0000 7f81e1fb9640 1 -- start start 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81c80047c0 0x7f81dc0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81dc0cd670 0x7f81dc1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0ce610 con 0x7f81dc1f63e0 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc1f6890 con 0x7f81dc0cd670 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.345+0000 7f81e1fb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0cdaf0 con 0x7f81c80047c0 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45958/0 (socket says 172.21.15.49:45958) 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 -- 172.21.15.49:0/3678522643 learned_addr learned my addr 172.21.15.49:0/3678522643 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81d3fff640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81dc0cd670 0x7f81dc1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81db7fe640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81c80047c0 0x7f81dc0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 -- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81c80047c0 msgr2=0x7f81dc0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81c80047c0 0x7f81dc0c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 -- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81dc0cd670 msgr2=0x7f81dc1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81dc0cd670 0x7f81dc1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 -- 172.21.15.49:0/3678522643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0cdd70 con 0x7f81dc1f63e0 2023-12-19T05:52:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.346+0000 7f81dbfff640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f81dc071cd0 tx=0x7f81d400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.347+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4017400 con 0x7f81dc1f63e0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.347+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4011040 con 0x7f81dc1f63e0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.347+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4017780 con 0x7f81dc1f63e0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.347+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc0ce050 con 0x7f81dc1f63e0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.347+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc1f3c10 con 0x7f81dc1f63e0 2023-12-19T05:52:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.348+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc1f3a70 con 0x7f81dc1f63e0 2023-12-19T05:52:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.349+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81d40203b0 con 0x7f81dc1f63e0 2023-12-19T05:52:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.350+0000 7f81d8ff9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.350+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81d4088940 con 0x7f81dc1f63e0 2023-12-19T05:52:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.351+0000 7f81db7fe640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.352+0000 7f81db7fe640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 0x7f81bc06c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009850 tx=0x7f81cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.354+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81dc1f3a70 con 0x7f81dc1f63e0 2023-12-19T05:52:15.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.553+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81dc1f3a70 con 0x7f81dc1f63e0 2023-12-19T05:52:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.555+0000 7f81d8ff9640 1 -- 172.21.15.49:0/3678522643 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+12400 (secure 0 0 0) 0x7f81dc1f3a70 con 0x7f81dc1f63e0 2023-12-19T05:52:15.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:15.557 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":189,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:14.518556+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 msgr2=0x7f81bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 0x7f81bc06c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009850 tx=0x7f81cc008040 comp rx=0 tx=0).stop 2023-12-19T05:52:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 msgr2=0x7f81dc137170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f81dc071cd0 tx=0x7f81d400f4a0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 shutdown_connections 2023-12-19T05:52:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81dc1f63e0 0x7f81dc137170 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81dc0cd670 0x7f81dc1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 --2- 172.21.15.49:0/3678522643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81c80047c0 0x7f81dc0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.558+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 >> 172.21.15.49:0/3678522643 conn(0x7f81dc0cbb70 msgr2=0x7f81dc0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.559+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 shutdown_connections 2023-12-19T05:52:15.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.559+0000 7f81e1fb9640 1 -- 172.21.15.49:0/3678522643 wait complete. 2023-12-19T05:52:15.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:52:15.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:52:15.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.817+0000 7f40f5aec640 1 Processor -- start 2023-12-19T05:52:15.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.818+0000 7f40f5aec640 1 -- start start 2023-12-19T05:52:15.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.819+0000 7f40f5aec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 0x7f40f00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40f5aec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40f006fc40 0x7f40f015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40f5aec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f0161e70 con 0x7f40f00b6430 2023-12-19T05:52:15.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40f5aec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f0161080 con 0x7f40f006fc40 2023-12-19T05:52:15.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40f5aec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f0161260 con 0x7f40f0146ff0 2023-12-19T05:52:15.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40effff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40f006fc40 0x7f40f015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40effff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40f006fc40 0x7f40f015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45966/0 (socket says 172.21.15.49:45966) 2023-12-19T05:52:15.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40effff640 1 -- 172.21.15.49:0/2718177424 learned_addr learned my addr 172.21.15.49:0/2718177424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40ef7fe640 1 --2- 172.21.15.49:0/2718177424 >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 0x7f40f00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40effff640 1 -- 172.21.15.49:0/2718177424 >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 msgr2=0x7f40f00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.820+0000 7f40effff640 1 --2- 172.21.15.49:0/2718177424 >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 0x7f40f00d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.821+0000 7f40effff640 1 -- 172.21.15.49:0/2718177424 >> v1:172.21.15.115:6789/0 conn(0x7f40f00b6430 legacy=0x7f40f006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.821+0000 7f40effff640 1 -- 172.21.15.49:0/2718177424 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0161540 con 0x7f40f006fc40 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.821+0000 7f40ef7fe640 1 --2- 172.21.15.49:0/2718177424 >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 0x7f40f00d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.822+0000 7f40effff640 1 --2- 172.21.15.49:0/2718177424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015dd40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009870 tx=0x7f40e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bad6e23df7ef282 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.822+0000 7f40ee7fc640 1 -- 172.21.15.49:0/2718177424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8031870 con 0x7f40f006fc40 2023-12-19T05:52:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.822+0000 7f40ee7fc640 1 -- 172.21.15.49:0/2718177424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80319d0 con 0x7f40f006fc40 2023-12-19T05:52:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.822+0000 7f40ee7fc640 1 -- 172.21.15.49:0/2718177424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8031d60 con 0x7f40f006fc40 2023-12-19T05:52:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 -- 172.21.15.49:0/2718177424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 msgr2=0x7f40f015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 --2- 172.21.15.49:0/2718177424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015dd40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009870 tx=0x7f40e802b910 comp rx=0 tx=0).stop 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 -- 172.21.15.49:0/2718177424 shutdown_connections 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 --2- 172.21.15.49:0/2718177424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015dd40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 --2- 172.21.15.49:0/2718177424 >> v2:172.21.15.115:3300/0 conn(0x7f40f0146ff0 0x7f40f00d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 -- 172.21.15.49:0/2718177424 >> 172.21.15.49:0/2718177424 conn(0x7f40f00d3520 msgr2=0x7f40f00d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 -- 172.21.15.49:0/2718177424 shutdown_connections 2023-12-19T05:52:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.823+0000 7f40f5aec640 1 -- 172.21.15.49:0/2718177424 wait complete. 2023-12-19T05:52:15.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.825+0000 7f40f5aec640 1 Processor -- start 2023-12-19T05:52:15.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.826+0000 7f40f5aec640 1 -- start start 2023-12-19T05:52:15.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40f00b6430 0x7f40f0160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40f0146ff0 0x7f40f015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f015d620 con 0x7f40f006fc40 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0160970 con 0x7f40f0146ff0 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40f5aec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00cf4f0 con 0x7f40f00b6430 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40ef7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40ef7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45980/0 (socket says 172.21.15.49:45980) 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.827+0000 7f40ef7fe640 1 -- 172.21.15.49:0/1824368127 learned_addr learned my addr 172.21.15.49:0/1824368127 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 -- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40f00b6430 msgr2=0x7f40f0160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40f00b6430 0x7f40f0160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 -- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40f0146ff0 msgr2=0x7f40f015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40f0146ff0 0x7f40f015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 -- 172.21.15.49:0/1824368127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80094d0 con 0x7f40f006fc40 2023-12-19T05:52:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40ef7fe640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c7f0 tx=0x7f40d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8007820 con 0x7f40f006fc40 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8007980 con 0x7f40f006fc40 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8007cf0 con 0x7f40f006fc40 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.828+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f01f6340 con 0x7f40f006fc40 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.829+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f01f6900 con 0x7f40f006fc40 2023-12-19T05:52:15.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.830+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f00c85b0 con 0x7f40f006fc40 2023-12-19T05:52:15.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.831+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40d80113f0 con 0x7f40f006fc40 2023-12-19T05:52:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.832+0000 7f40e7fff640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 0x7f40d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.832+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40d8088830 con 0x7f40f006fc40 2023-12-19T05:52:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.833+0000 7f40eeffd640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 0x7f40d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.834+0000 7f40eeffd640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 0x7f40d006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40f006f750 tx=0x7f40e0007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:15.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:15.837+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f40d8054200 con 0x7f40f006fc40 2023-12-19T05:52:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.030+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40f00c83a0 con 0x7f40f006fc40 2023-12-19T05:52:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.031+0000 7f40e7fff640 1 -- 172.21.15.49:0/1824368127 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40d801f0a0 con 0x7f40f006fc40 2023-12-19T05:52:16.033 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:52:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 msgr2=0x7f40d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 0x7f40d006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40f006f750 tx=0x7f40e0007d30 comp rx=0 tx=0).stop 2023-12-19T05:52:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 msgr2=0x7f40f015d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c7f0 tx=0x7f40d800ccb0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 shutdown_connections 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f40d006a430 0x7f40d006c8f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40f00b6430 0x7f40f0160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40f0146ff0 0x7f40f015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.034+0000 7f40f5aec640 1 --2- 172.21.15.49:0/1824368127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40f006fc40 0x7f40f015d0e0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.035+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 >> 172.21.15.49:0/1824368127 conn(0x7f40f00d3520 msgr2=0x7f40f0144aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.035+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 shutdown_connections 2023-12-19T05:52:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.035+0000 7f40f5aec640 1 -- 172.21.15.49:0/1824368127 wait complete. 2023-12-19T05:52:16.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:52:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.289+0000 7fbaa759e640 1 Processor -- start 2023-12-19T05:52:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.290+0000 7fbaa759e640 1 -- start start 2023-12-19T05:52:16.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.291+0000 7fbaa759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbaa815e2d0 0x7fbaa80d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.291+0000 7fbaa759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa80d2a60 0x7fbaa80b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.291+0000 7fbaa759e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa815e730 con 0x7fbaa80b86e0 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.291+0000 7fbaa759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa8142df0 con 0x7fbaa815e2d0 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.291+0000 7fbaa759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa81430d0 con 0x7fbaa80d2a60 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbaa815e2d0 0x7fbaa80d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbaa815e2d0 0x7fbaa80d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45984/0 (socket says 172.21.15.49:45984) 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 -- 172.21.15.49:0/1330564905 learned_addr learned my addr 172.21.15.49:0/1330564905 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa6d9d640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa80d2a60 0x7fbaa80b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 -- 172.21.15.49:0/1330564905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa80d2a60 msgr2=0x7fbaa80b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa80d2a60 0x7fbaa80b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 -- 172.21.15.49:0/1330564905 >> v1:172.21.15.115:6789/0 conn(0x7fbaa80b86e0 legacy=0x7fbaa80b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.292+0000 7fbaa5d9b640 1 -- 172.21.15.49:0/1330564905 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa81433b0 con 0x7fbaa815e2d0 2023-12-19T05:52:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.293+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa815e2d0 0x7fbaa80d2520 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fba90009870 tx=0x7fba9002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d992934ee94916 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.294+0000 7fbaa559a640 1 -- 172.21.15.49:0/1330564905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900317c0 con 0x7fbaa815e2d0 2023-12-19T05:52:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.294+0000 7fbaa559a640 1 -- 172.21.15.49:0/1330564905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90031920 con 0x7fbaa815e2d0 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.294+0000 7fbaa559a640 1 -- 172.21.15.49:0/1330564905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90031cb0 con 0x7fbaa815e2d0 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.294+0000 7fbaa759e640 1 -- 172.21.15.49:0/1330564905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa815e2d0 msgr2=0x7fbaa80d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.294+0000 7fbaa759e640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa815e2d0 0x7fbaa80d2520 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fba90009870 tx=0x7fba9002b860 comp rx=0 tx=0).stop 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 -- 172.21.15.49:0/1330564905 shutdown_connections 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa80d2a60 0x7fbaa80b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 --2- 172.21.15.49:0/1330564905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa815e2d0 0x7fbaa80d2520 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 -- 172.21.15.49:0/1330564905 >> 172.21.15.49:0/1330564905 conn(0x7fbaa80d3230 msgr2=0x7fbaa80d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 -- 172.21.15.49:0/1330564905 shutdown_connections 2023-12-19T05:52:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.295+0000 7fbaa759e640 1 -- 172.21.15.49:0/1330564905 wait complete. 2023-12-19T05:52:16.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.297+0000 7fbaa759e640 1 Processor -- start 2023-12-19T05:52:16.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.297+0000 7fbaa759e640 1 -- start start 2023-12-19T05:52:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 0x7fbaa81420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa815e2d0 0x7fbaa813e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa8144530 con 0x7fbaa80b86e0 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa81438d0 con 0x7fbaa80d2a60 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa813c600 con 0x7fbaa815e2d0 2023-12-19T05:52:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46000/0 (socket says 172.21.15.49:46000) 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 -- 172.21.15.49:0/976442611 learned_addr learned my addr 172.21.15.49:0/976442611 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 -- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa815e2d0 msgr2=0x7fbaa813e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa815e2d0 0x7fbaa813e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 -- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 msgr2=0x7fbaa81420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 0x7fbaa81420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 0x7fbaa81420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa659c640 1 -- 172.21.15.49:0/976442611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900094d0 con 0x7fbaa80b86e0 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.298+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 0x7fbaa81420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fbaa659c640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c7c0 tx=0x7fba9800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800aa50 con 0x7fbaa80b86e0 2023-12-19T05:52:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800abb0 con 0x7fbaa80b86e0 2023-12-19T05:52:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98012420 con 0x7fbaa80b86e0 2023-12-19T05:52:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa8143b90 con 0x7fbaa80b86e0 2023-12-19T05:52:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.299+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa8144150 con 0x7fbaa80b86e0 2023-12-19T05:52:16.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.301+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa8061910 con 0x7fbaa80b86e0 2023-12-19T05:52:16.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.301+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba98012580 con 0x7fbaa80b86e0 2023-12-19T05:52:16.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.302+0000 7fba9effd640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 0x7fba8806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.302+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba98088740 con 0x7fbaa80b86e0 2023-12-19T05:52:16.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.303+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 0x7fba8806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.304+0000 7fbaa5d9b640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 0x7fba8806c940 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba90036000 tx=0x7fba9003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.307+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba980541f0 con 0x7fbaa80b86e0 2023-12-19T05:52:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.502+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbaa80b74f0 con 0x7fbaa80b86e0 2023-12-19T05:52:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.503+0000 7fba9effd640 1 -- 172.21.15.49:0/976442611 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v189) v1 ==== 84+0+65 (secure 0 0 0) 0x7fba98016060 con 0x7fbaa80b86e0 2023-12-19T05:52:16.505 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:16.506 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.506+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 msgr2=0x7fba8806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.506+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 0x7fba8806c940 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba90036000 tx=0x7fba9003d040 comp rx=0 tx=0).stop 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.506+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 msgr2=0x7fbaa813c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.506+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c7c0 tx=0x7fba9800cc80 comp rx=0 tx=0).stop 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 shutdown_connections 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fba8806a480 0x7fba8806c940 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaa815e2d0 0x7fbaa813e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaa80d2a60 0x7fbaa81420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 --2- 172.21.15.49:0/976442611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbaa80b86e0 0x7fbaa813c0c0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 >> 172.21.15.49:0/976442611 conn(0x7fbaa80d3230 msgr2=0x7fbaa806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 shutdown_connections 2023-12-19T05:52:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.507+0000 7fbaa759e640 1 -- 172.21.15.49:0/976442611 wait complete. 2023-12-19T05:52:16.527 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:52:16.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:52:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.756+0000 7fe44880f640 1 Processor -- start 2023-12-19T05:52:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.756+0000 7fe44880f640 1 -- start start 2023-12-19T05:52:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.758+0000 7fe44880f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe44415afd0 0x7fe4440ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.758+0000 7fe44880f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe44406d070 0x7fe4440afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.758+0000 7fe44880f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44415f920 con 0x7fe4440b02f0 2023-12-19T05:52:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.758+0000 7fe44880f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440adc40 con 0x7fe44415afd0 2023-12-19T05:52:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.758+0000 7fe44880f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440b0780 con 0x7fe44406d070 2023-12-19T05:52:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe44415afd0 0x7fe4440ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe44415afd0 0x7fe4440ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46014/0 (socket says 172.21.15.49:46014) 2023-12-19T05:52:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 -- 172.21.15.49:0/3371682014 learned_addr learned my addr 172.21.15.49:0/3371682014 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe44259c640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe44406d070 0x7fe4440afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 -- 172.21.15.49:0/3371682014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe44406d070 msgr2=0x7fe4440afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe44406d070 0x7fe4440afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 -- 172.21.15.49:0/3371682014 >> v1:172.21.15.115:6789/0 conn(0x7fe4440b02f0 legacy=0x7fe4440ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.759+0000 7fe442d9d640 1 -- 172.21.15.49:0/3371682014 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44415ed10 con 0x7fe44415afd0 2023-12-19T05:52:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.760+0000 7fe442d9d640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44415afd0 0x7fe4440ad700 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fe434009870 tx=0x7fe43402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7703eeb76a7bda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.761+0000 7fe441d9b640 1 -- 172.21.15.49:0/3371682014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434030840 con 0x7fe44415afd0 2023-12-19T05:52:16.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.761+0000 7fe441d9b640 1 -- 172.21.15.49:0/3371682014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4340309a0 con 0x7fe44415afd0 2023-12-19T05:52:16.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.761+0000 7fe441d9b640 1 -- 172.21.15.49:0/3371682014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434030d30 con 0x7fe44415afd0 2023-12-19T05:52:16.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.761+0000 7fe44880f640 1 -- 172.21.15.49:0/3371682014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44415afd0 msgr2=0x7fe4440ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.761+0000 7fe44880f640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44415afd0 0x7fe4440ad700 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fe434009870 tx=0x7fe43402b980 comp rx=0 tx=0).stop 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 -- 172.21.15.49:0/3371682014 shutdown_connections 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe44406d070 0x7fe4440afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 --2- 172.21.15.49:0/3371682014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44415afd0 0x7fe4440ad700 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 -- 172.21.15.49:0/3371682014 >> 172.21.15.49:0/3371682014 conn(0x7fe4440b4750 msgr2=0x7fe4440659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 -- 172.21.15.49:0/3371682014 shutdown_connections 2023-12-19T05:52:16.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.762+0000 7fe44880f640 1 -- 172.21.15.49:0/3371682014 wait complete. 2023-12-19T05:52:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.763+0000 7fe44880f640 1 Processor -- start 2023-12-19T05:52:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.764+0000 7fe44880f640 1 -- start start 2023-12-19T05:52:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4440b02f0 0x7fe44406b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 0x7fe44406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441f3340 con 0x7fe44406d070 2023-12-19T05:52:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444155e80 con 0x7fe44415afd0 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44880f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe444158140 con 0x7fe4440b02f0 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe442d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe442d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46016/0 (socket says 172.21.15.49:46016) 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe442d9d640 1 -- 172.21.15.49:0/2707660276 learned_addr learned my addr 172.21.15.49:0/2707660276 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44259c640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4440b02f0 0x7fe44406b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.765+0000 7fe44359e640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 0x7fe44406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 -- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4440b02f0 msgr2=0x7fe44406b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4440b02f0 0x7fe44406b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 -- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 msgr2=0x7fe44406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 0x7fe44406bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 -- 172.21.15.49:0/2707660276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340094d0 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe44359e640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 0x7fe44406bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe442d9d640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe434009870 tx=0x7fe434004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434039c90 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434039df0 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe444158400 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.766+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434043640 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.767+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4440cb3f0 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.767+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444061910 con 0x7fe44406d070 2023-12-19T05:52:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.768+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4340437a0 con 0x7fe44406d070 2023-12-19T05:52:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.769+0000 7fe42b7fe640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 0x7fe43006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.770+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe43403e070 con 0x7fe44406d070 2023-12-19T05:52:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.770+0000 7fe44259c640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 0x7fe43006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.772+0000 7fe44259c640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 0x7fe43006c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe438006fd0 tx=0x7fe438008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.774+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe434077090 con 0x7fe44406d070 2023-12-19T05:52:16.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:16.967+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe444155720 con 0x7fe44406d070 2023-12-19T05:52:17.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.564+0000 7fe42b7fe640 1 -- 172.21.15.49:0/2707660276 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v190) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe43407a6b0 con 0x7fe44406d070 2023-12-19T05:52:17.569 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-12-19T05:52:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.571+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 msgr2=0x7fe43006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.571+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 0x7fe43006c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe438006fd0 tx=0x7fe438008040 comp rx=0 tx=0).stop 2023-12-19T05:52:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.571+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 msgr2=0x7fe444155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.571+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe434009870 tx=0x7fe434004730 comp rx=0 tx=0).stop 2023-12-19T05:52:17.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 shutdown_connections 2023-12-19T05:52:17.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe43006a430 0x7fe43006c8f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4440b02f0 0x7fe44406b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44415afd0 0x7fe44406bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 --2- 172.21.15.49:0/2707660276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe44406d070 0x7fe444155940 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 >> 172.21.15.49:0/2707660276 conn(0x7fe4440b4750 msgr2=0x7fe44406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 shutdown_connections 2023-12-19T05:52:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.573+0000 7fe44880f640 1 -- 172.21.15.49:0/2707660276 wait complete. 2023-12-19T05:52:17.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:52:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.825+0000 7f725e56e640 1 Processor -- start 2023-12-19T05:52:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.825+0000 7f725e56e640 1 -- start start 2023-12-19T05:52:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725e56e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f725815d120 0x7f72580cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725e56e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72580ce7b0 0x7f72580ca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725e56e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725806f160 con 0x7f725815d500 2023-12-19T05:52:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725e56e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580ccb10 con 0x7f72580ce7b0 2023-12-19T05:52:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725e56e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580ccdf0 con 0x7f725815d120 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.827+0000 7f725cd6b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72580ce7b0 0x7f72580ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72580ce7b0 0x7f72580ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46022/0 (socket says 172.21.15.49:46022) 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 -- 172.21.15.49:0/82511841 learned_addr learned my addr 172.21.15.49:0/82511841 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725d56c640 1 --2- 172.21.15.49:0/82511841 >> v2:172.21.15.115:3300/0 conn(0x7f725815d120 0x7f72580cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 -- 172.21.15.49:0/82511841 >> v2:172.21.15.115:3300/0 conn(0x7f725815d120 msgr2=0x7f72580cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 --2- 172.21.15.49:0/82511841 >> v2:172.21.15.115:3300/0 conn(0x7f725815d120 0x7f72580cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 -- 172.21.15.49:0/82511841 >> v1:172.21.15.115:6789/0 conn(0x7f725815d500 legacy=0x7f7258160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.828+0000 7f725cd6b640 1 -- 172.21.15.49:0/82511841 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580cd0d0 con 0x7f72580ce7b0 2023-12-19T05:52:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.829+0000 7f725cd6b640 1 --2- 172.21.15.49:0/82511841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580ca220 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f72580cf780 tx=0x7f724802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af00defd085eacd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f724ffff640 1 -- 172.21.15.49:0/82511841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480317e0 con 0x7f72580ce7b0 2023-12-19T05:52:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f724ffff640 1 -- 172.21.15.49:0/82511841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248031940 con 0x7f72580ce7b0 2023-12-19T05:52:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f724ffff640 1 -- 172.21.15.49:0/82511841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248031cd0 con 0x7f72580ce7b0 2023-12-19T05:52:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 -- 172.21.15.49:0/82511841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 msgr2=0x7f72580ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 --2- 172.21.15.49:0/82511841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580ca220 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f72580cf780 tx=0x7f724802b880 comp rx=0 tx=0).stop 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 -- 172.21.15.49:0/82511841 shutdown_connections 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 --2- 172.21.15.49:0/82511841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580ca220 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 --2- 172.21.15.49:0/82511841 >> v2:172.21.15.115:3300/0 conn(0x7f725815d120 0x7f72580cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 -- 172.21.15.49:0/82511841 >> 172.21.15.49:0/82511841 conn(0x7f72580cfbd0 msgr2=0x7f72580cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 -- 172.21.15.49:0/82511841 shutdown_connections 2023-12-19T05:52:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.830+0000 7f725e56e640 1 -- 172.21.15.49:0/82511841 wait complete. 2023-12-19T05:52:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.832+0000 7f725e56e640 1 Processor -- start 2023-12-19T05:52:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.832+0000 7f725e56e640 1 -- start start 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725815d120 0x7f72580d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 0x7f725815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580d27a0 con 0x7f72580ce7b0 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580d2a80 con 0x7f725815d500 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.833+0000 7f725e56e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c6e00 con 0x7f725815d120 2023-12-19T05:52:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46038/0 (socket says 172.21.15.49:46038) 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 -- 172.21.15.49:0/1438982458 learned_addr learned my addr 172.21.15.49:0/1438982458 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725cd6b640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725815d120 0x7f72580d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725dd6d640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 0x7f725815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 -- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725815d120 msgr2=0x7f72580d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725815d120 0x7f72580d1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 -- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 msgr2=0x7f725815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 0x7f725815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 -- 172.21.15.49:0/1438982458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480094d0 con 0x7f72580ce7b0 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725dd6d640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 0x7f725815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.834+0000 7f725d56c640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f725400d800 tx=0x7f725400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.835+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400b6c0 con 0x7f72580ce7b0 2023-12-19T05:52:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.835+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400b820 con 0x7f72580ce7b0 2023-12-19T05:52:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.835+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580c70e0 con 0x7f72580ce7b0 2023-12-19T05:52:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.835+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400bbb0 con 0x7f72580ce7b0 2023-12-19T05:52:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.835+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725815e640 con 0x7f72580ce7b0 2023-12-19T05:52:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.836+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580d2ca0 con 0x7f72580ce7b0 2023-12-19T05:52:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.837+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f725400bd10 con 0x7f72580ce7b0 2023-12-19T05:52:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.838+0000 7f724dffb640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 0x7f723c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.838+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7254089670 con 0x7f72580ce7b0 2023-12-19T05:52:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.839+0000 7f725cd6b640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 0x7f723c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.840+0000 7f725cd6b640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 0x7f723c06c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7248036000 tx=0x7f724803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:17.842+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7254054fb0 con 0x7f72580ce7b0 2023-12-19T05:52:18.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.037+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7258061910 con 0x7f72580ce7b0 2023-12-19T05:52:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.579+0000 7f724dffb640 1 -- 172.21.15.49:0/1438982458 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v191) v1 ==== 170+0+0 (secure 0 0 0) 0x7f72540585d0 con 0x7f72580ce7b0 2023-12-19T05:52:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-12-19T05:52:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.588+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 msgr2=0x7f723c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.588+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 0x7f723c06c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7248036000 tx=0x7f724803d040 comp rx=0 tx=0).stop 2023-12-19T05:52:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.588+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 msgr2=0x7f72580c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.588+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f725400d800 tx=0x7f725400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 shutdown_connections 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f723c06a430 0x7f723c06c8f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725815d120 0x7f72580d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725815d500 0x7f725815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 --2- 172.21.15.49:0/1438982458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72580ce7b0 0x7f72580c5b90 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 >> 172.21.15.49:0/1438982458 conn(0x7f72580cfbd0 msgr2=0x7f72580709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.591+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 shutdown_connections 2023-12-19T05:52:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.592+0000 7f725e56e640 1 -- 172.21.15.49:0/1438982458 wait complete. 2023-12-19T05:52:18.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:52:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.819+0000 7fce7d669640 1 Processor -- start 2023-12-19T05:52:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.819+0000 7fce7d669640 1 -- start start 2023-12-19T05:52:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.821+0000 7fce7d669640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce780b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.821+0000 7fce7d669640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce780ceea0 0x7fce780cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.821+0000 7fce7d669640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7815fde0 con 0x7fce780b1ec0 2023-12-19T05:52:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.821+0000 7fce7d669640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce780cf870 con 0x7fce780ceea0 2023-12-19T05:52:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.821+0000 7fce7d669640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7815ef10 con 0x7fce7815b1d0 2023-12-19T05:52:18.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce767fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce780b1ec0 0x7fce7815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48846/0 (socket says 172.21.15.49:48846) 2023-12-19T05:52:18.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce767fc640 1 -- 172.21.15.49:0/1374055432 learned_addr learned my addr 172.21.15.49:0/1374055432 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce76ffd640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce780b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce777fe640 1 --2- 172.21.15.49:0/1374055432 >> v2:172.21.15.115:3300/0 conn(0x7fce780ceea0 0x7fce780cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602776517 0 0) 0x7fce7815fde0 con 0x7fce780b1ec0 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce60003520 con 0x7fce780b1ec0 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.822+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879647619 0 0) 0x7fce60003520 con 0x7fce780b1ec0 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 msgr2=0x7fce780b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce780b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 >> v2:172.21.15.115:3300/0 conn(0x7fce780ceea0 msgr2=0x7fce780cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 --2- 172.21.15.49:0/1374055432 >> v2:172.21.15.115:3300/0 conn(0x7fce780ceea0 0x7fce780cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780b2320 con 0x7fce780b1ec0 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fce6c001670 con 0x7fce780b1ec0 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 >> v1:172.21.15.49:6789/0 conn(0x7fce780b1ec0 legacy=0x7fce7815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce60003f60 0x7fce600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780cf870 con 0x7fce60004d00 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7815ef10 con 0x7fce60003f60 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6000b9b0 con 0x7fce7815b1d0 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.823+0000 7fce777fe640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce767fc640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce60003f60 0x7fce600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce76ffd640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce777fe640 1 -- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 msgr2=0x7fce600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce777fe640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7815b1d0 0x7fce600039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce777fe640 1 -- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce60003f60 msgr2=0x7fce600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce777fe640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce60003f60 0x7fce600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce777fe640 1 -- 172.21.15.49:0/1374055432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60003520 con 0x7fce60004d00 2023-12-19T05:52:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.824+0000 7fce767fc640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce60003f60 0x7fce600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.825+0000 7fce777fe640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce60005180 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fce70009fc0 tx=0x7fce600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746600d5d822a1f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.825+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7002cc60 con 0x7fce60004d00 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.825+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000f040 con 0x7fce60004d00 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.825+0000 7fce75ffb640 1 -- 172.21.15.49:0/1374055432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70034440 con 0x7fce60004d00 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 -- 172.21.15.49:0/1374055432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 msgr2=0x7fce60005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 --2- 172.21.15.49:0/1374055432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce60005180 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fce70009fc0 tx=0x7fce600057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce777fe640 1 -- 172.21.15.49:0/1374055432 reap_dead start 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 -- 172.21.15.49:0/1374055432 shutdown_connections 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 -- 172.21.15.49:0/1374055432 >> 172.21.15.49:0/1374055432 conn(0x7fce78073150 msgr2=0x7fce780659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 -- 172.21.15.49:0/1374055432 shutdown_connections 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.826+0000 7fce7d669640 1 -- 172.21.15.49:0/1374055432 wait complete. 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.828+0000 7fce7d669640 1 Processor -- start 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.828+0000 7fce7d669640 1 -- start start 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce780a84a0 0x7fce780ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce780b0060 0x7fce780b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780b0a20 con 0x7fce60004d00 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce78145640 con 0x7fce780a84a0 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce7d669640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce78154fc0 con 0x7fce780b0060 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce76ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce76ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46044/0 (socket says 172.21.15.49:46044) 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce76ffd640 1 -- 172.21.15.49:0/259756006 learned_addr learned my addr 172.21.15.49:0/259756006 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.829+0000 7fce76ffd640 1 -- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce780b0060 msgr2=0x7fce780b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce76ffd640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce780b0060 0x7fce780b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce76ffd640 1 -- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce780a84a0 msgr2=0x7fce780ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce767fc640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce780a84a0 0x7fce780ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce76ffd640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce780a84a0 0x7fce780ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce76ffd640 1 -- 172.21.15.49:0/259756006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78142700 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce76ffd640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fce680107e0 tx=0x7fce68010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68009610 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6800eb60 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6801c400 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.830+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce781429e0 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.831+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce78142fa0 con 0x7fce60004d00 2023-12-19T05:52:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.832+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce78143160 con 0x7fce60004d00 2023-12-19T05:52:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.833+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce6801c560 con 0x7fce60004d00 2023-12-19T05:52:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.834+0000 7fce5f7fe640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 0x7fce6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.834+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fce68088e80 con 0x7fce60004d00 2023-12-19T05:52:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.835+0000 7fce767fc640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 0x7fce6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.836+0000 7fce767fc640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 0x7fce6406c920 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0017a0 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:18.839+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce68054450 con 0x7fce60004d00 2023-12-19T05:52:19.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.073+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fce78061910 con 0x7fce60004d00 2023-12-19T05:52:19.084 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 22 and data pool 23 2023-12-19T05:52:19.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.082+0000 7fce5f7fe640 1 -- 172.21.15.49:0/259756006 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v84) v1 ==== 174+0+0 (secure 0 0 0) 0x7fce68057a70 con 0x7fce60004d00 2023-12-19T05:52:19.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.086+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 msgr2=0x7fce6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.086+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 0x7fce6406c920 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0017a0 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2023-12-19T05:52:19.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.086+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 msgr2=0x7fce78145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.086+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fce680107e0 tx=0x7fce68010ca0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 shutdown_connections 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fce6406a460 0x7fce6406c920 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce780b0060 0x7fce780b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce780a84a0 0x7fce780ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 --2- 172.21.15.49:0/259756006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce60004d00 0x7fce78145100 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.090+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 >> 172.21.15.49:0/259756006 conn(0x7fce78073150 msgr2=0x7fce78158450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.091+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 shutdown_connections 2023-12-19T05:52:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.093+0000 7fce7d669640 1 -- 172.21.15.49:0/259756006 wait complete. 2023-12-19T05:52:19.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.315+0000 7f181ec3f640 1 Processor -- start 2023-12-19T05:52:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.316+0000 7f181ec3f640 1 -- start start 2023-12-19T05:52:19.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.317+0000 7f181ec3f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f18180b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181ec3f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18180b7ea0 0x7f18180d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181ec3f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180b8300 con 0x7f18180d0a90 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181ec3f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1818147210 con 0x7f18180b7ea0 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181ec3f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18180d2370 con 0x7f1818146e30 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181d43c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18180b7ea0 0x7f18180d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181d43c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18180b7ea0 0x7f18180d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46054/0 (socket says 172.21.15.49:46054) 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181d43c640 1 -- 172.21.15.49:0/2790156275 learned_addr learned my addr 172.21.15.49:0/2790156275 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.318+0000 7f181dc3d640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f18180b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.319+0000 7f181d43c640 1 -- 172.21.15.49:0/2790156275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 msgr2=0x7f18180b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.319+0000 7f181d43c640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f18180b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.319+0000 7f181d43c640 1 -- 172.21.15.49:0/2790156275 >> v1:172.21.15.115:6789/0 conn(0x7f18180d0a90 legacy=0x7f181806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.319+0000 7f181d43c640 1 -- 172.21.15.49:0/2790156275 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180d12d0 con 0x7f18180b7ea0 2023-12-19T05:52:19.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.319+0000 7f181dc3d640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f18180b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.320+0000 7f181d43c640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18180d0550 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f18040098a0 tx=0x7f180402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa26f0351c2f4a0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.320+0000 7f181cc3b640 1 -- 172.21.15.49:0/2790156275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804031640 con 0x7f18180b7ea0 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181cc3b640 1 -- 172.21.15.49:0/2790156275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040317a0 con 0x7f18180b7ea0 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181cc3b640 1 -- 172.21.15.49:0/2790156275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804031b30 con 0x7f18180b7ea0 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 -- 172.21.15.49:0/2790156275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 msgr2=0x7f18180d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18180d0550 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f18040098a0 tx=0x7f180402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 -- 172.21.15.49:0/2790156275 shutdown_connections 2023-12-19T05:52:19.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18180d0550 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 --2- 172.21.15.49:0/2790156275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f18180b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 -- 172.21.15.49:0/2790156275 >> 172.21.15.49:0/2790156275 conn(0x7f18180b2990 msgr2=0x7f18180b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:19.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 -- 172.21.15.49:0/2790156275 shutdown_connections 2023-12-19T05:52:19.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.321+0000 7f181ec3f640 1 -- 172.21.15.49:0/2790156275 wait complete. 2023-12-19T05:52:19.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.323+0000 7f181ec3f640 1 Processor -- start 2023-12-19T05:52:19.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.323+0000 7f181ec3f640 1 -- start start 2023-12-19T05:52:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18180d0a90 0x7f18181e2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f1818142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18181e2680 con 0x7f18180b7ea0 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18181439d0 con 0x7f18180d0a90 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.324+0000 7f181ec3f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18180b1f90 con 0x7f1818146e30 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46062/0 (socket says 172.21.15.49:46062) 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 -- 172.21.15.49:0/3510401519 learned_addr learned my addr 172.21.15.49:0/3510401519 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181e43e640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f1818142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181d43c640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18180d0a90 0x7f18181e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 -- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 msgr2=0x7f1818142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f1818142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 -- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18180d0a90 msgr2=0x7f18181e2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18180d0a90 0x7f18181e2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.325+0000 7f181dc3d640 1 -- 172.21.15.49:0/3510401519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040094d0 con 0x7f18180b7ea0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f181dc3d640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f180c009fc0 tx=0x7f180c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c003b90 con 0x7f18180b7ea0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00f040 con 0x7f18180b7ea0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c004030 con 0x7f18180b7ea0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18180b19d0 con 0x7f18180b7ea0 2023-12-19T05:52:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.326+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18181dfed0 con 0x7f18180b7ea0 2023-12-19T05:52:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.327+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1818061910 con 0x7f18180b7ea0 2023-12-19T05:52:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.328+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f180c004190 con 0x7f18180b7ea0 2023-12-19T05:52:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.330+0000 7f18167fc640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 0x7f17fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.330+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f180c088ba0 con 0x7f18180b7ea0 2023-12-19T05:52:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.330+0000 7f181d43c640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 0x7f17fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.332+0000 7f181d43c640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 0x7f17fc06c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1804036000 tx=0x7f180403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.334+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f180c0542d0 con 0x7f18180b7ea0 2023-12-19T05:52:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.532+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18180d1860 con 0x7f18180b7ea0 2023-12-19T05:52:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.535+0000 7f18167fc640 1 -- 172.21.15.49:0/3510401519 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16125 (secure 0 0 0) 0x7f180c01a090 con 0x7f18180b7ea0 2023-12-19T05:52:19.538 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:19.538 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":192,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:19.075727+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 msgr2=0x7f17fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 0x7f17fc06c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1804036000 tx=0x7f180403c040 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 msgr2=0x7f18181e4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f180c009fc0 tx=0x7f180c00d560 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 shutdown_connections 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f17fc06a430 0x7f17fc06c8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1818146e30 0x7f1818142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18180d0a90 0x7f18181e2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 --2- 172.21.15.49:0/3510401519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18180b7ea0 0x7f18181e4ed0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 >> 172.21.15.49:0/3510401519 conn(0x7f18180b2990 msgr2=0x7f18181e88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 shutdown_connections 2023-12-19T05:52:19.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.539+0000 7f181ec3f640 1 -- 172.21.15.49:0/3510401519 wait complete. 2023-12-19T05:52:19.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.790+0000 7f7896bb8640 1 Processor -- start 2023-12-19T05:52:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.790+0000 7f7896bb8640 1 -- start start 2023-12-19T05:52:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7896bb8640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78900b2030 0x7f789015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7896bb8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789015ec30 con 0x7f789015e5a0 2023-12-19T05:52:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7896bb8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789015fbc0 con 0x7f78900cdbf0 2023-12-19T05:52:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7896bb8640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789015e980 con 0x7f78900b2030 2023-12-19T05:52:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7895bb6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f789015e5a0 0x7f78900b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48862/0 (socket says 172.21.15.49:48862) 2023-12-19T05:52:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.792+0000 7f7895bb6640 1 -- 172.21.15.49:0/3773551783 learned_addr learned my addr 172.21.15.49:0/3773551783 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110355627 0 0) 0x7f789015ec30 con 0x7f789015e5a0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c003520 con 0x7f789015e5a0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f78953b5640 1 --2- 172.21.15.49:0/3773551783 >> v2:172.21.15.115:3300/0 conn(0x7f78900b2030 0x7f789015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138251619 0 0) 0x7f787c003520 con 0x7f789015e5a0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 >> v2:172.21.15.115:3300/0 conn(0x7f78900b2030 msgr2=0x7f789015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 --2- 172.21.15.49:0/3773551783 >> v2:172.21.15.115:3300/0 conn(0x7f78900b2030 0x7f789015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 >> v1:172.21.15.115:6789/0 conn(0x7f78900cdbf0 legacy=0x7f789006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900b2f90 con 0x7f789015e5a0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f788c001670 con 0x7f789015e5a0 2023-12-19T05:52:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 >> v1:172.21.15.49:6789/0 conn(0x7f789015e5a0 legacy=0x7f78900b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 0x7f787c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0047c0 0x7f787c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f787c0051d0 0x7f787c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789015e980 con 0x7f787c0039a0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c00c100 con 0x7f787c0047c0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.793+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c00c2c0 con 0x7f787c0051d0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 0x7f787c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f78953b5640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0047c0 0x7f787c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f78963b7640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f787c0051d0 0x7f787c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 -- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f787c0051d0 msgr2=0x7f787c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f787c0051d0 0x7f787c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 -- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0047c0 msgr2=0x7f787c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0047c0 0x7f787c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f7895bb6640 1 -- 172.21.15.49:0/3773551783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c003520 con 0x7f787c0039a0 2023-12-19T05:52:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.794+0000 7f78963b7640 1 -- 172.21.15.49:0/3773551783 reap_dead start 2023-12-19T05:52:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.795+0000 7f7895bb6640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 0x7f787c003dc0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f788c007fd0 tx=0x7f787c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e208e841e57c2d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c005ad0 con 0x7f787c0039a0 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c005c50 con 0x7f787c0039a0 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7894bb4640 1 -- 172.21.15.49:0/3773551783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c02c830 con 0x7f787c0039a0 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7896bb8640 1 -- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 msgr2=0x7f787c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7896bb8640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 0x7f787c003dc0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f788c007fd0 tx=0x7f787c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7896bb8640 1 -- 172.21.15.49:0/3773551783 shutdown_connections 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7896bb8640 1 --2- 172.21.15.49:0/3773551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f787c0039a0 0x7f787c003dc0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.796+0000 7f7896bb8640 1 -- 172.21.15.49:0/3773551783 >> 172.21.15.49:0/3773551783 conn(0x7f78900b0100 msgr2=0x7f78900b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.797+0000 7f7896bb8640 1 -- 172.21.15.49:0/3773551783 shutdown_connections 2023-12-19T05:52:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.797+0000 7f7896bb8640 1 -- 172.21.15.49:0/3773551783 wait complete. 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.798+0000 7f7896bb8640 1 Processor -- start 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.799+0000 7f7896bb8640 1 -- start start 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.799+0000 7f7896bb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0039a0 0x7f789015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.799+0000 7f7896bb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7890154730 0x7f78900b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.799+0000 7f7896bb8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f7896bb8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b1b80 con 0x7f78900b16f0 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f7896bb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890155f40 con 0x7f787c0039a0 2023-12-19T05:52:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f7896bb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789015ced0 con 0x7f7890154730 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46086/0 (socket says 172.21.15.49:46086) 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 -- 172.21.15.49:0/433650278 learned_addr learned my addr 172.21.15.49:0/433650278 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f7895bb6640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0039a0 0x7f789015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 -- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7890154730 msgr2=0x7f78900b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7890154730 0x7f78900b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 -- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0039a0 msgr2=0x7f789015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0039a0 0x7f789015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.800+0000 7f78963b7640 1 -- 172.21.15.49:0/433650278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890155980 con 0x7f78900b16f0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f78963b7640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f78900b1180 tx=0x7f788800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888003b70 con 0x7f78900b16f0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888003cd0 con 0x7f78900b16f0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880052b0 con 0x7f78900b16f0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890155c60 con 0x7f78900b16f0 2023-12-19T05:52:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.801+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900c4380 con 0x7f78900b16f0 2023-12-19T05:52:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.802+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78900c3f00 con 0x7f78900b16f0 2023-12-19T05:52:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.803+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7888005410 con 0x7f78900b16f0 2023-12-19T05:52:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.804+0000 7f78867fc640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 0x7f787406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.804+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7888088320 con 0x7f78900b16f0 2023-12-19T05:52:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.805+0000 7f7895bb6640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 0x7f787406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.806+0000 7f7895bb6640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 0x7f787406c8f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f788c034000 tx=0x7f788c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:19.809+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f78900c3f00 con 0x7f78900b16f0 2023-12-19T05:52:20.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.006+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78900c3f00 con 0x7f78900b16f0 2023-12-19T05:52:20.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.009+0000 7f78867fc640 1 -- 172.21.15.49:0/433650278 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16125 (secure 0 0 0) 0x7f78900c3f00 con 0x7f78900b16f0 2023-12-19T05:52:20.012 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:20.012 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":192,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:19.075727+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 msgr2=0x7f787406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 0x7f787406c8f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f788c034000 tx=0x7f788c009030 comp rx=0 tx=0).stop 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 msgr2=0x7f78900ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f78900b1180 tx=0x7f788800dc00 comp rx=0 tx=0).stop 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 shutdown_connections 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f787406a430 0x7f787406c8f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7890154730 0x7f78900b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78900b16f0 0x7f78900ac8b0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 --2- 172.21.15.49:0/433650278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f787c0039a0 0x7f789015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 >> 172.21.15.49:0/433650278 conn(0x7f78900b0100 msgr2=0x7f78900af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.012+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 shutdown_connections 2023-12-19T05:52:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.013+0000 7f7896bb8640 1 -- 172.21.15.49:0/433650278 wait complete. 2023-12-19T05:52:20.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:52:20.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.272+0000 7fb020cfa640 1 Processor -- start 2023-12-19T05:52:20.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.272+0000 7fb020cfa640 1 -- start start 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb020cfa640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb01c0cdad0 0x7fb01c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb020cfa640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0cdf10 con 0x7fb01c0ce860 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb020cfa640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0d18a0 con 0x7fb01c0d1470 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb020cfa640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0cec40 con 0x7fb01c0cdad0 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb01b7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb01c0ce860 0x7fb01c0cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48872/0 (socket says 172.21.15.49:48872) 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb01b7fe640 1 -- 172.21.15.49:0/4181631103 learned_addr learned my addr 172.21.15.49:0/4181631103 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.274+0000 7fb01affd640 1 --2- 172.21.15.49:0/4181631103 >> v2:172.21.15.49:3300/0 conn(0x7fb01c0cdad0 0x7fb01c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.275+0000 7fb01a7fc640 1 -- 172.21.15.49:0/4181631103 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765655168 0 0) 0x7fb01c0cdf10 con 0x7fb01c0ce860 2023-12-19T05:52:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.275+0000 7fb01a7fc640 1 -- 172.21.15.49:0/4181631103 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb008003520 con 0x7fb01c0ce860 2023-12-19T05:52:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.275+0000 7fb01affd640 1 -- 172.21.15.49:0/4181631103 >> v1:172.21.15.115:6789/0 conn(0x7fb01c0d1470 legacy=0x7fb01c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.275+0000 7fb01affd640 1 -- 172.21.15.49:0/4181631103 >> v1:172.21.15.49:6789/0 conn(0x7fb01c0ce860 legacy=0x7fb01c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.275+0000 7fb01affd640 1 -- 172.21.15.49:0/4181631103 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c15fd20 con 0x7fb01c0cdad0 2023-12-19T05:52:20.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.276+0000 7fb01affd640 1 --2- 172.21.15.49:0/4181631103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0cdad0 0x7fb01c0d0f30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097a0 tx=0x7fb00402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114f91ebb8ac03fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:20.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.276+0000 7fb01a7fc640 1 -- 172.21.15.49:0/4181631103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004031830 con 0x7fb01c0cdad0 2023-12-19T05:52:20.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.276+0000 7fb01a7fc640 1 -- 172.21.15.49:0/4181631103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004031990 con 0x7fb01c0cdad0 2023-12-19T05:52:20.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.276+0000 7fb01a7fc640 1 -- 172.21.15.49:0/4181631103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004031d20 con 0x7fb01c0cdad0 2023-12-19T05:52:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 -- 172.21.15.49:0/4181631103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0cdad0 msgr2=0x7fb01c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 --2- 172.21.15.49:0/4181631103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0cdad0 0x7fb01c0d0f30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097a0 tx=0x7fb00402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 -- 172.21.15.49:0/4181631103 shutdown_connections 2023-12-19T05:52:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 --2- 172.21.15.49:0/4181631103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0cdad0 0x7fb01c0d0f30 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 -- 172.21.15.49:0/4181631103 >> 172.21.15.49:0/4181631103 conn(0x7fb01c06f160 msgr2=0x7fb01c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:20.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 -- 172.21.15.49:0/4181631103 shutdown_connections 2023-12-19T05:52:20.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.277+0000 7fb020cfa640 1 -- 172.21.15.49:0/4181631103 wait complete. 2023-12-19T05:52:20.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.279+0000 7fb020cfa640 1 Processor -- start 2023-12-19T05:52:20.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.279+0000 7fb020cfa640 1 -- start start 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c0cdad0 0x7fb01c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c0d1470 0x7fb01c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15e630 con 0x7fb01c0ce860 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c070c30 con 0x7fb01c0d1470 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.280+0000 7fb020cfa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0b0f10 con 0x7fb01c0cdad0 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46102/0 (socket says 172.21.15.49:46102) 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 -- 172.21.15.49:0/3947600220 learned_addr learned my addr 172.21.15.49:0/3947600220 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01b7fe640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c0cdad0 0x7fb01c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01bfff640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c0d1470 0x7fb01c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 -- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c0cdad0 msgr2=0x7fb01c15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c0cdad0 0x7fb01c15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 -- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c0d1470 msgr2=0x7fb01c0b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c0d1470 0x7fb01c0b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.281+0000 7fb01affd640 1 -- 172.21.15.49:0/3947600220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004009400 con 0x7fb01c0ce860 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb01affd640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb004034040 tx=0x7fb0040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00403a8f0 con 0x7fb01c0ce860 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00403aa70 con 0x7fb01c0ce860 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0b11f0 con 0x7fb01c0ce860 2023-12-19T05:52:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00403ae20 con 0x7fb01c0ce860 2023-12-19T05:52:20.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.282+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c071170 con 0x7fb01c0ce860 2023-12-19T05:52:20.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.283+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c066a60 con 0x7fb01c0ce860 2023-12-19T05:52:20.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.284+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb00404d440 con 0x7fb01c0ce860 2023-12-19T05:52:20.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.285+0000 7fb013fff640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 0x7faffc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:20.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.285+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0040aa9a0 con 0x7fb01c0ce860 2023-12-19T05:52:20.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.286+0000 7fb01b7fe640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 0x7faffc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:20.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.287+0000 7fb01b7fe640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 0x7faffc06c8f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb00c001560 tx=0x7fb00c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.289+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb004075f90 con 0x7fb01c0ce860 2023-12-19T05:52:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:20.521+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb01c071360 con 0x7fb01c0ce860 2023-12-19T05:52:21.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.483+0000 7fb013fff640 1 -- 172.21.15.49:0/3947600220 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb0040350b0 con 0x7fb01c0ce860 2023-12-19T05:52:21.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 msgr2=0x7faffc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 0x7faffc06c8f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb00c001560 tx=0x7fb00c009040 comp rx=0 tx=0).stop 2023-12-19T05:52:21.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 msgr2=0x7fb01c0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb004034040 tx=0x7fb0040046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 shutdown_connections 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7faffc06a430 0x7faffc06c8f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c0d1470 0x7fb01c0b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb01c0ce860 0x7fb01c0b28a0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 --2- 172.21.15.49:0/3947600220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c0cdad0 0x7fb01c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 >> 172.21.15.49:0/3947600220 conn(0x7fb01c06f160 msgr2=0x7fb01c151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 shutdown_connections 2023-12-19T05:52:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.487+0000 7fb020cfa640 1 -- 172.21.15.49:0/3947600220 wait complete. 2023-12-19T05:52:21.511 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:52:21.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:52:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.750+0000 7feae1fae640 1 Processor -- start 2023-12-19T05:52:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.750+0000 7feae1fae640 1 -- start start 2023-12-19T05:52:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feae1fae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feadc15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feae1fae640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feadc0ae110 0x7feadc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feae1fae640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0b0a90 con 0x7feadc0b0640 2023-12-19T05:52:21.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feae1fae640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc06b8c0 con 0x7feadc0ae110 2023-12-19T05:52:21.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feae1fae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15b740 con 0x7feadc157bf0 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feadbfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feadc0b0640 0x7feadc15dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48882/0 (socket says 172.21.15.49:48882) 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feadbfff640 1 -- 172.21.15.49:0/664977473 learned_addr learned my addr 172.21.15.49:0/664977473 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.752+0000 7feadb7fe640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feadc15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feadaffd640 1 --2- 172.21.15.49:0/664977473 >> v2:172.21.15.115:3300/0 conn(0x7feadc0ae110 0x7feadc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061534682 0 0) 0x7fead4001110 con 0x7feadc0b0640 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac4005730 con 0x7feadc0b0640 2023-12-19T05:52:21.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857364830 0 0) 0x7feac4005730 con 0x7feadc0b0640 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 msgr2=0x7feadc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feadc15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 >> v2:172.21.15.115:3300/0 conn(0x7feadc0ae110 msgr2=0x7feadc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 --2- 172.21.15.49:0/664977473 >> v2:172.21.15.115:3300/0 conn(0x7feadc0ae110 0x7feadc0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0ae640 con 0x7feadc0b0640 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fead4001800 con 0x7feadc0b0640 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 >> v1:172.21.15.49:6789/0 conn(0x7feadc0b0640 legacy=0x7feadc15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.753+0000 7feada7fc640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac4005bf0 0x7feac4006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feada7fc640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feac40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feada7fc640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feac4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc06b8c0 con 0x7feac4006f10 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15b740 con 0x7feac4005bf0 2023-12-19T05:52:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac400db90 con 0x7feadc157bf0 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feac4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadaffd640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feac40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadb7fe640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac4005bf0 0x7feac4006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 -- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 msgr2=0x7feac40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feac40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 -- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac4005bf0 msgr2=0x7feac4006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac4005bf0 0x7feac4006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadbfff640 1 -- 172.21.15.49:0/664977473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005730 con 0x7feac4006f10 2023-12-19T05:52:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.754+0000 7feadaffd640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc157bf0 0x7feac40069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.755+0000 7feadbfff640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feac4007390 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fead400c210 tx=0x7feac4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b25b2d1839c891 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4005ad0 con 0x7feac4006f10 2023-12-19T05:52:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4005c30 con 0x7feac4006f10 2023-12-19T05:52:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feada7fc640 1 -- 172.21.15.49:0/664977473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead402c8d0 con 0x7feac4006f10 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feae1fae640 1 -- 172.21.15.49:0/664977473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 msgr2=0x7feac4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feae1fae640 1 --2- 172.21.15.49:0/664977473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feac4007390 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fead400c210 tx=0x7feac4007a00 comp rx=0 tx=0).stop 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feadbfff640 1 -- 172.21.15.49:0/664977473 reap_dead start 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feae1fae640 1 -- 172.21.15.49:0/664977473 shutdown_connections 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.756+0000 7feae1fae640 1 -- 172.21.15.49:0/664977473 >> 172.21.15.49:0/664977473 conn(0x7feadc0cbb70 msgr2=0x7feadc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.757+0000 7feae1fae640 1 -- 172.21.15.49:0/664977473 shutdown_connections 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.757+0000 7feae1fae640 1 -- 172.21.15.49:0/664977473 wait complete. 2023-12-19T05:52:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.758+0000 7feae1fae640 1 Processor -- start 2023-12-19T05:52:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.759+0000 7feae1fae640 1 -- start start 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.759+0000 7feae1fae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feae1fae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 0x7feadc15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feae1fae640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 0x7feadc158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feae1fae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15d220 con 0x7feac4006f10 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feae1fae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14aad0 con 0x7feadc14ae00 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feae1fae640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15c5a0 con 0x7feadc15c100 2023-12-19T05:52:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feadb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feadb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46114/0 (socket says 172.21.15.49:46114) 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feadb7fe640 1 -- 172.21.15.49:0/2662937260 learned_addr learned my addr 172.21.15.49:0/2662937260 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feadaffd640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 0x7feadc15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.760+0000 7feadbfff640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 0x7feadc158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 -- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 msgr2=0x7feadc158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 0x7feadc158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 -- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 msgr2=0x7feadc15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 0x7feadc15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 -- 172.21.15.49:0/2662937260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc15c880 con 0x7feac4006f10 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadaffd640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 0x7feadc15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:21.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadbfff640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 0x7feadc158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feadb7fe640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7feacc009fb0 tx=0x7feacc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00e030 con 0x7feac4006f10 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc016470 con 0x7feac4006f10 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc016820 con 0x7feac4006f10 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc15cb60 con 0x7feac4006f10 2023-12-19T05:52:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.761+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc15d640 con 0x7feac4006f10 2023-12-19T05:52:21.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.763+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc061910 con 0x7feac4006f10 2023-12-19T05:52:21.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.764+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feacc016980 con 0x7feac4006f10 2023-12-19T05:52:21.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.765+0000 7feac3fff640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 0x7feac806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:21.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.765+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feacc00f070 con 0x7feac4006f10 2023-12-19T05:52:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.765+0000 7feadaffd640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 0x7feac806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:21.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.766+0000 7feadaffd640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 0x7feac806c920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feadc14b200 tx=0x7fead0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:21.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:21.769+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feacc054df0 con 0x7feac4006f10 2023-12-19T05:52:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.003+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feadc0af1b0 con 0x7feac4006f10 2023-12-19T05:52:22.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.610+0000 7feac3fff640 1 -- 172.21.15.49:0/2662937260 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) v1 ==== 122+0+0 (secure 0 0 0) 0x7feacc058410 con 0x7feac4006f10 2023-12-19T05:52:22.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 msgr2=0x7feac806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:22.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 0x7feac806c920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feadc14b200 tx=0x7fead0008040 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 msgr2=0x7feadc14a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7feacc009fb0 tx=0x7feacc0115a0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 shutdown_connections 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7feac806a460 0x7feac806c920 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feadc15c100 0x7feadc158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feadc14ae00 0x7feadc15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 --2- 172.21.15.49:0/2662937260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac4006f10 0x7feadc14a590 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.613+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 >> 172.21.15.49:0/2662937260 conn(0x7feadc0cbb70 msgr2=0x7feadc0ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.614+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 shutdown_connections 2023-12-19T05:52:22.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.614+0000 7feae1fae640 1 -- 172.21.15.49:0/2662937260 wait complete. 2023-12-19T05:52:22.638 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:52:22.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.870+0000 7fe026c15640 1 Processor -- start 2023-12-19T05:52:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.871+0000 7fe026c15640 1 -- start start 2023-12-19T05:52:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.872+0000 7fe026c15640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe020159f80 0x7fe02006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.872+0000 7fe026c15640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe02015b1e0 0x7fe02015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.872+0000 7fe026c15640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02006b520 con 0x7fe02015a8a0 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.872+0000 7fe026c15640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200b2b20 con 0x7fe020159f80 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe026c15640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200b2fb0 con 0x7fe02015b1e0 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe020159f80 0x7fe02006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe020159f80 0x7fe02006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46118/0 (socket says 172.21.15.49:46118) 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 -- 172.21.15.49:0/2022154268 learned_addr learned my addr 172.21.15.49:0/2022154268 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025412640 1 --2- 172.21.15.49:0/2022154268 >> v2:172.21.15.115:3300/0 conn(0x7fe02015b1e0 0x7fe02015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 -- 172.21.15.49:0/2022154268 >> v2:172.21.15.115:3300/0 conn(0x7fe02015b1e0 msgr2=0x7fe02015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 --2- 172.21.15.49:0/2022154268 >> v2:172.21.15.115:3300/0 conn(0x7fe02015b1e0 0x7fe02015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 -- 172.21.15.49:0/2022154268 >> v1:172.21.15.115:6789/0 conn(0x7fe02015a8a0 legacy=0x7fe02015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.873+0000 7fe025c13640 1 -- 172.21.15.49:0/2022154268 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200b1f10 con 0x7fe020159f80 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.875+0000 7fe025c13640 1 --2- 172.21.15.49:0/2022154268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02006f160 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fe0200cff10 tx=0x7fe01c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17c56c04e590ced server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.875+0000 7fe024c11640 1 -- 172.21.15.49:0/2022154268 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c030860 con 0x7fe020159f80 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.875+0000 7fe024c11640 1 -- 172.21.15.49:0/2022154268 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c0309c0 con 0x7fe020159f80 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.875+0000 7fe024c11640 1 -- 172.21.15.49:0/2022154268 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c030d50 con 0x7fe020159f80 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 -- 172.21.15.49:0/2022154268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 msgr2=0x7fe02006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 --2- 172.21.15.49:0/2022154268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02006f160 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fe0200cff10 tx=0x7fe01c02b9a0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 -- 172.21.15.49:0/2022154268 shutdown_connections 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 --2- 172.21.15.49:0/2022154268 >> v2:172.21.15.115:3300/0 conn(0x7fe02015b1e0 0x7fe02015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 --2- 172.21.15.49:0/2022154268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02006f160 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 -- 172.21.15.49:0/2022154268 >> 172.21.15.49:0/2022154268 conn(0x7fe0200b0100 msgr2=0x7fe0200b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 -- 172.21.15.49:0/2022154268 shutdown_connections 2023-12-19T05:52:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.876+0000 7fe026c15640 1 -- 172.21.15.49:0/2022154268 wait complete. 2023-12-19T05:52:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.879+0000 7fe026c15640 1 Processor -- start 2023-12-19T05:52:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.879+0000 7fe026c15640 1 -- start start 2023-12-19T05:52:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe02015a8a0 0x7fe02015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02015b1e0 0x7fe0200cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02014c3e0 con 0x7fe020159f80 2023-12-19T05:52:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015c0a0 con 0x7fe02015b1e0 2023-12-19T05:52:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.880+0000 7fe026c15640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015c380 con 0x7fe02015a8a0 2023-12-19T05:52:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46128/0 (socket says 172.21.15.49:46128) 2023-12-19T05:52:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 -- 172.21.15.49:0/3777157201 learned_addr learned my addr 172.21.15.49:0/3777157201 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 -- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe02015a8a0 msgr2=0x7fe02015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe02015a8a0 0x7fe02015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 -- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02015b1e0 msgr2=0x7fe0200cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02015b1e0 0x7fe0200cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 -- 172.21.15.49:0/3777157201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0094d0 con 0x7fe020159f80 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.881+0000 7fe025c13640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000c00 tx=0x7fe01c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.882+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c030830 con 0x7fe020159f80 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.882+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c043400 con 0x7fe020159f80 2023-12-19T05:52:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.882+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02015c660 con 0x7fe020159f80 2023-12-19T05:52:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.882+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0437b0 con 0x7fe020159f80 2023-12-19T05:52:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.882+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02015cc20 con 0x7fe020159f80 2023-12-19T05:52:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.883+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02015ce10 con 0x7fe020159f80 2023-12-19T05:52:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.884+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe01c043910 con 0x7fe020159f80 2023-12-19T05:52:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.885+0000 7fe0167fc640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 0x7fe00406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.885+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe01c03e070 con 0x7fe020159f80 2023-12-19T05:52:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.886+0000 7fe025412640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 0x7fe00406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:22.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.887+0000 7fe025412640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 0x7fe00406c920 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe0201591d0 tx=0x7fe010008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:22.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:22.889+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe01c077340 con 0x7fe020159f80 2023-12-19T05:52:23.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.122+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe020061910 con 0x7fe020159f80 2023-12-19T05:52:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.123+0000 7fe0167fc640 1 -- 172.21.15.49:0/3777157201 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fe01c07a960 con 0x7fe020159f80 2023-12-19T05:52:23.125 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:23.125 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:52:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:52:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.126+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 msgr2=0x7fe00406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.126+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 0x7fe00406c920 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe0201591d0 tx=0x7fe010008040 comp rx=0 tx=0).stop 2023-12-19T05:52:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.126+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 msgr2=0x7fe02014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.126+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000c00 tx=0x7fe01c004730 comp rx=0 tx=0).stop 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.126+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 shutdown_connections 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe00406a460 0x7fe00406c920 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe02015a8a0 0x7fe02015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02015b1e0 0x7fe0200cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 --2- 172.21.15.49:0/3777157201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe020159f80 0x7fe02014bea0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 >> 172.21.15.49:0/3777157201 conn(0x7fe0200b0100 msgr2=0x7fe0200cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 shutdown_connections 2023-12-19T05:52:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.127+0000 7fe026c15640 1 -- 172.21.15.49:0/3777157201 wait complete. 2023-12-19T05:52:23.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.375+0000 7fa74c9a4640 1 Processor -- start 2023-12-19T05:52:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.376+0000 7fa74c9a4640 1 -- start start 2023-12-19T05:52:23.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.377+0000 7fa74c9a4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7480b2ea0 0x7fa74815c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74c9a4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa748140d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74c9a4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa74806c810 0x7fa74806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74c9a4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74806d180 con 0x7fa74806c810 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74c9a4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74813e590 con 0x7fa7480b2ea0 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74c9a4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815b810 con 0x7fa7481408f0 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa746d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa74806c810 0x7fa74806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa746d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa74806c810 0x7fa74806cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46134/0 (socket says 172.21.15.49:46134) 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa746d9d640 1 -- 172.21.15.49:0/490610347 learned_addr learned my addr 172.21.15.49:0/490610347 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa73ffff640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa748140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.378+0000 7fa74659c640 1 --2- 172.21.15.49:0/490610347 >> v2:172.21.15.115:3300/0 conn(0x7fa7480b2ea0 0x7fa74815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.379+0000 7fa746d9d640 1 -- 172.21.15.49:0/490610347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 msgr2=0x7fa748140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.379+0000 7fa746d9d640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa748140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.379+0000 7fa746d9d640 1 -- 172.21.15.49:0/490610347 >> v2:172.21.15.115:3300/0 conn(0x7fa7480b2ea0 msgr2=0x7fa74815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.379+0000 7fa746d9d640 1 --2- 172.21.15.49:0/490610347 >> v2:172.21.15.115:3300/0 conn(0x7fa7480b2ea0 0x7fa74815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.379+0000 7fa746d9d640 1 -- 172.21.15.49:0/490610347 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74815c7d0 con 0x7fa74806c810 2023-12-19T05:52:23.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.380+0000 7fa746d9d640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa74806c810 0x7fa74806cc40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa74806d750 tx=0x7fa74002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6135c81e9ef52046 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.380+0000 7fa745d9b640 1 -- 172.21.15.49:0/490610347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74002ca70 con 0x7fa74806c810 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.380+0000 7fa745d9b640 1 -- 172.21.15.49:0/490610347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74002cbd0 con 0x7fa74806c810 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.380+0000 7fa745d9b640 1 -- 172.21.15.49:0/490610347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400343f0 con 0x7fa74806c810 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 -- 172.21.15.49:0/490610347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa74806c810 msgr2=0x7fa74806cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa74806c810 0x7fa74806cc40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa74806d750 tx=0x7fa74002bed0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 -- 172.21.15.49:0/490610347 shutdown_connections 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa74806c810 0x7fa74806cc40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/490610347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa748140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/490610347 >> v2:172.21.15.115:3300/0 conn(0x7fa7480b2ea0 0x7fa74815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 -- 172.21.15.49:0/490610347 >> 172.21.15.49:0/490610347 conn(0x7fa7480659d0 msgr2=0x7fa748065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 -- 172.21.15.49:0/490610347 shutdown_connections 2023-12-19T05:52:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.381+0000 7fa74c9a4640 1 -- 172.21.15.49:0/490610347 wait complete. 2023-12-19T05:52:23.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.383+0000 7fa74c9a4640 1 Processor -- start 2023-12-19T05:52:23.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.383+0000 7fa74c9a4640 1 -- start start 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa74806c810 0x7fa7481f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa7480cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748145e00 con 0x7fa7480b2ea0 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481460e0 con 0x7fa74806c810 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa74c9a4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481463c0 con 0x7fa7481408f0 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.384+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46144/0 (socket says 172.21.15.49:46144) 2023-12-19T05:52:23.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 -- 172.21.15.49:0/1157763078 learned_addr learned my addr 172.21.15.49:0/1157763078 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa74659c640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa74806c810 0x7fa7481f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 -- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 msgr2=0x7fa7480cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa7480cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 -- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa74806c810 msgr2=0x7fa7481f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa74806c810 0x7fa7481f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 -- 172.21.15.49:0/1157763078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009b30 con 0x7fa7480b2ea0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73ffff640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa73000d5f0 tx=0x7fa73000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.385+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300125f0 con 0x7fa7480b2ea0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.386+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730012750 con 0x7fa7480b2ea0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.386+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730012b00 con 0x7fa7480b2ea0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.386+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7481466a0 con 0x7fa7480b2ea0 2023-12-19T05:52:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.386+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7480713b0 con 0x7fa7480b2ea0 2023-12-19T05:52:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.387+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa748074770 con 0x7fa7480b2ea0 2023-12-19T05:52:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.388+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa730012c60 con 0x7fa7480b2ea0 2023-12-19T05:52:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.389+0000 7fa73effd640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 0x7fa72806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.389+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa730088c30 con 0x7fa7480b2ea0 2023-12-19T05:52:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.390+0000 7fa74659c640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 0x7fa72806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.391+0000 7fa74659c640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 0x7fa72806c940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa738006fd0 tx=0x7fa738008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.394+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa730054390 con 0x7fa7480b2ea0 2023-12-19T05:52:23.531 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-12-19T05:52:23.529+0000 7fe1fab9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:52:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.589+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa748061910 con 0x7fa7480b2ea0 2023-12-19T05:52:23.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.592+0000 7fa73effd640 1 -- 172.21.15.49:0/1157763078 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16112 (secure 0 0 0) 0x7fa7300579b0 con 0x7fa7480b2ea0 2023-12-19T05:52:23.594 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:23.594 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":193,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:20.080194+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 msgr2=0x7fa72806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 0x7fa72806c940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa738006fd0 tx=0x7fa738008040 comp rx=0 tx=0).stop 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 msgr2=0x7fa748070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa73000d5f0 tx=0x7fa73000dab0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 shutdown_connections 2023-12-19T05:52:23.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa72806a480 0x7fa72806c940 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7481408f0 0x7fa7480cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7480b2ea0 0x7fa748070e70 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 --2- 172.21.15.49:0/1157763078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa74806c810 0x7fa7481f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 >> 172.21.15.49:0/1157763078 conn(0x7fa7480659d0 msgr2=0x7fa74813efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 shutdown_connections 2023-12-19T05:52:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.595+0000 7fa74c9a4640 1 -- 172.21.15.49:0/1157763078 wait complete. 2023-12-19T05:52:23.616 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:52:23.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:52:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.838+0000 7f47be6d7640 1 Processor -- start 2023-12-19T05:52:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.838+0000 7f47be6d7640 1 -- start start 2023-12-19T05:52:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.839+0000 7f47be6d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815e5a0 0x7f47b80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47be6d7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47b80cdbf0 0x7f47b80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47be6d7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b815ec30 con 0x7f47b815f680 2023-12-19T05:52:23.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47be6d7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b80ce5c0 con 0x7f47b80cdbf0 2023-12-19T05:52:23.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47be6d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b815e980 con 0x7f47b815e5a0 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47bded6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47b80cdbf0 0x7f47b80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47bced4640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f47b815f680 0x7f47b80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48884/0 (socket says 172.21.15.49:48884) 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47bced4640 1 -- 172.21.15.49:0/1895425518 learned_addr learned my addr 172.21.15.49:0/1895425518 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.840+0000 7f47bd6d5640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815e5a0 0x7f47b80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47affff640 1 -- 172.21.15.49:0/1895425518 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201857606 0 0) 0x7f47b815ec30 con 0x7f47b815f680 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47affff640 1 -- 172.21.15.49:0/1895425518 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a4003520 con 0x7f47b815f680 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47bded6640 1 -- 172.21.15.49:0/1895425518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815e5a0 msgr2=0x7f47b80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47bded6640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815e5a0 0x7f47b80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47bded6640 1 -- 172.21.15.49:0/1895425518 >> v1:172.21.15.49:6789/0 conn(0x7f47b815f680 legacy=0x7f47b80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.841+0000 7f47bded6640 1 -- 172.21.15.49:0/1895425518 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80b2f90 con 0x7f47b80cdbf0 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.842+0000 7f47bded6640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b80ce080 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37580aeb0d0a24ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.842+0000 7f47affff640 1 -- 172.21.15.49:0/1895425518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b002cc50 con 0x7f47b80cdbf0 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.842+0000 7f47affff640 1 -- 172.21.15.49:0/1895425518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b002cdb0 con 0x7f47b80cdbf0 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.842+0000 7f47affff640 1 -- 172.21.15.49:0/1895425518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0034640 con 0x7f47b80cdbf0 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 -- 172.21.15.49:0/1895425518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 msgr2=0x7f47b80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b80ce080 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b002bea0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 -- 172.21.15.49:0/1895425518 shutdown_connections 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b80ce080 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1895425518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815e5a0 0x7f47b80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 -- 172.21.15.49:0/1895425518 >> 172.21.15.49:0/1895425518 conn(0x7f47b80b0100 msgr2=0x7f47b80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 -- 172.21.15.49:0/1895425518 shutdown_connections 2023-12-19T05:52:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.843+0000 7f47be6d7640 1 -- 172.21.15.49:0/1895425518 wait complete. 2023-12-19T05:52:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.845+0000 7f47be6d7640 1 Processor -- start 2023-12-19T05:52:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.845+0000 7f47be6d7640 1 -- start start 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47b815e5a0 0x7f47b81f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815f680 0x7f47b80c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81f6a70 con 0x7f47b80cdbf0 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c4270 con 0x7f47b815e5a0 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47be6d7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80cd9c0 con 0x7f47b815f680 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46170/0 (socket says 172.21.15.49:46170) 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 -- 172.21.15.49:0/1913403470 learned_addr learned my addr 172.21.15.49:0/1913403470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 -- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815f680 msgr2=0x7f47b80c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815f680 0x7f47b80c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 -- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47b815e5a0 msgr2=0x7f47b81f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47b815e5a0 0x7f47b81f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.846+0000 7f47bd6d5640 1 -- 172.21.15.49:0/1913403470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009a70 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47bd6d5640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9e0 tx=0x7f47b400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4009670 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400c970 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b80cce40 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400cd20 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.847+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b80cd400 con 0x7f47b80cdbf0 2023-12-19T05:52:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.848+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b8061910 con 0x7f47b80cdbf0 2023-12-19T05:52:23.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.849+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47b4013470 con 0x7f47b80cdbf0 2023-12-19T05:52:23.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.850+0000 7f47adffb640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 0x7f479c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:23.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.850+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b4088b40 con 0x7f47b80cdbf0 2023-12-19T05:52:23.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.851+0000 7f47bced4640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 0x7f479c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:23.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.852+0000 7f47bced4640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 0x7f479c06c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f60 tx=0x7f47a80078f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:23.855+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47b4054120 con 0x7f47b80cdbf0 2023-12-19T05:52:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.045+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47b815ee80 con 0x7f479c06a430 2023-12-19T05:52:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.069+0000 7f47adffb640 1 -- 172.21.15.49:0/1913403470 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283086 (secure 0 0 0) 0x7f47a8005890 con 0x7f479c06a430 2023-12-19T05:52:24.075 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:52:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 msgr2=0x7f479c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 0x7f479c06c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f60 tx=0x7f47a80078f0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 msgr2=0x7f47b81f6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9e0 tx=0x7f47b400eea0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 shutdown_connections 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f479c06a430 0x7f479c06c8f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47b815f680 0x7f47b80c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47b815e5a0 0x7f47b81f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 --2- 172.21.15.49:0/1913403470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47b80cdbf0 0x7f47b81f6530 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 >> 172.21.15.49:0/1913403470 conn(0x7f47b80b0100 msgr2=0x7f47b8158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 shutdown_connections 2023-12-19T05:52:24.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.076+0000 7f47be6d7640 1 -- 172.21.15.49:0/1913403470 wait complete. 2023-12-19T05:52:24.099 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2023-12-19T05:52:22.789225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9671,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552828,"statfs":{"total":1600000000,"available":1590095892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.229272"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701833+0000","last_change":"2023-12-19T05:52:19.100498+0000","last_active":"2023-12-19T05:52:21.701833+0000","last_peered":"2023-12-19T05:52:21.701833+0000","last_clean":"2023-12-19T05:52:21.701833+0000","last_became_active":"2023-12-19T05:52:19.099857+0000","last_became_peered":"2023-12-19T05:52:19.099857+0000","last_unstale":"2023-12-19T05:52:21.701833+0000","last_undegraded":"2023-12-19T05:52:21.701833+0000","last_fullsized":"2023-12-19T05:52:21.701833+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701617+0000","last_change":"2023-12-19T05:52:19.102075+0000","last_active":"2023-12-19T05:52:21.701617+0000","last_peered":"2023-12-19T05:52:21.701617+0000","last_clean":"2023-12-19T05:52:21.701617+0000","last_became_active":"2023-12-19T05:52:19.101830+0000","last_became_peered":"2023-12-19T05:52:19.101830+0000","last_unstale":"2023-12-19T05:52:21.701617+0000","last_undegraded":"2023-12-19T05:52:21.701617+0000","last_fullsized":"2023-12-19T05:52:21.701617+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:46.263398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702492+0000","last_change":"2023-12-19T05:52:19.107332+0000","last_active":"2023-12-19T05:52:21.702492+0000","last_peered":"2023-12-19T05:52:21.702492+0000","last_clean":"2023-12-19T05:52:21.702492+0000","last_became_active":"2023-12-19T05:52:19.105965+0000","last_became_peered":"2023-12-19T05:52:19.105965+0000","last_unstale":"2023-12-19T05:52:21.702492+0000","last_undegraded":"2023-12-19T05:52:21.702492+0000","last_fullsized":"2023-12-19T05:52:21.702492+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:24.687837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093897+0000","last_change":"2023-12-19T05:52:19.100418+0000","last_active":"2023-12-19T05:52:21.093897+0000","last_peered":"2023-12-19T05:52:21.093897+0000","last_clean":"2023-12-19T05:52:21.093897+0000","last_became_active":"2023-12-19T05:52:19.099793+0000","last_became_peered":"2023-12-19T05:52:19.099793+0000","last_unstale":"2023-12-19T05:52:21.093897+0000","last_undegraded":"2023-12-19T05:52:21.093897+0000","last_fullsized":"2023-12-19T05:52:21.093897+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:39:11.956833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844993+0000","last_change":"2023-12-19T05:52:19.108277+0000","last_active":"2023-12-19T05:52:20.844993+0000","last_peered":"2023-12-19T05:52:20.844993+0000","last_clean":"2023-12-19T05:52:20.844993+0000","last_became_active":"2023-12-19T05:52:19.107403+0000","last_became_peered":"2023-12-19T05:52:19.107403+0000","last_unstale":"2023-12-19T05:52:20.844993+0000","last_undegraded":"2023-12-19T05:52:20.844993+0000","last_fullsized":"2023-12-19T05:52:20.844993+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:56.981760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089947+0000","last_change":"2023-12-19T05:52:19.105143+0000","last_active":"2023-12-19T05:52:20.089947+0000","last_peered":"2023-12-19T05:52:20.089947+0000","last_clean":"2023-12-19T05:52:20.089947+0000","last_became_active":"2023-12-19T05:52:19.104599+0000","last_became_peered":"2023-12-19T05:52:19.104599+0000","last_unstale":"2023-12-19T05:52:20.089947+0000","last_undegraded":"2023-12-19T05:52:20.089947+0000","last_fullsized":"2023-12-19T05:52:20.089947+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:23.272220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702220+0000","last_change":"2023-12-19T05:52:19.105165+0000","last_active":"2023-12-19T05:52:21.702220+0000","last_peered":"2023-12-19T05:52:21.702220+0000","last_clean":"2023-12-19T05:52:21.702220+0000","last_became_active":"2023-12-19T05:52:19.104890+0000","last_became_peered":"2023-12-19T05:52:19.104890+0000","last_unstale":"2023-12-19T05:52:21.702220+0000","last_undegraded":"2023-12-19T05:52:21.702220+0000","last_fullsized":"2023-12-19T05:52:21.702220+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702173+0000","last_change":"2023-12-19T05:52:19.090570+0000","last_active":"2023-12-19T05:52:21.702173+0000","last_peered":"2023-12-19T05:52:21.702173+0000","last_clean":"2023-12-19T05:52:21.702173+0000","last_became_active":"2023-12-19T05:52:19.090355+0000","last_became_peered":"2023-12-19T05:52:19.090355+0000","last_unstale":"2023-12-19T05:52:21.702173+0000","last_undegraded":"2023-12-19T05:52:21.702173+0000","last_fullsized":"2023-12-19T05:52:21.702173+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:11.717178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702441+0000","last_change":"2023-12-19T05:52:19.099688+0000","last_active":"2023-12-19T05:52:21.702441+0000","last_peered":"2023-12-19T05:52:21.702441+0000","last_clean":"2023-12-19T05:52:21.702441+0000","last_became_active":"2023-12-19T05:52:19.099418+0000","last_became_peered":"2023-12-19T05:52:19.099418+0000","last_unstale":"2023-12-19T05:52:21.702441+0000","last_undegraded":"2023-12-19T05:52:21.702441+0000","last_fullsized":"2023-12-19T05:52:21.702441+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:40.363977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703640+0000","last_change":"2023-12-19T05:52:19.098931+0000","last_active":"2023-12-19T05:52:21.703640+0000","last_peered":"2023-12-19T05:52:21.703640+0000","last_clean":"2023-12-19T05:52:21.703640+0000","last_became_active":"2023-12-19T05:52:19.098583+0000","last_became_peered":"2023-12-19T05:52:19.098583+0000","last_unstale":"2023-12-19T05:52:21.703640+0000","last_undegraded":"2023-12-19T05:52:21.703640+0000","last_fullsized":"2023-12-19T05:52:21.703640+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:57.108650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844605+0000","last_change":"2023-12-19T05:52:19.107012+0000","last_active":"2023-12-19T05:52:20.844605+0000","last_peered":"2023-12-19T05:52:20.844605+0000","last_clean":"2023-12-19T05:52:20.844605+0000","last_became_active":"2023-12-19T05:52:19.106733+0000","last_became_peered":"2023-12-19T05:52:19.106733+0000","last_unstale":"2023-12-19T05:52:20.844605+0000","last_undegraded":"2023-12-19T05:52:20.844605+0000","last_fullsized":"2023-12-19T05:52:20.844605+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:24.456722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084565+0000","last_change":"2023-12-19T05:52:19.096494+0000","last_active":"2023-12-19T05:52:20.084565+0000","last_peered":"2023-12-19T05:52:20.084565+0000","last_clean":"2023-12-19T05:52:20.084565+0000","last_became_active":"2023-12-19T05:52:19.096183+0000","last_became_peered":"2023-12-19T05:52:19.096183+0000","last_unstale":"2023-12-19T05:52:20.084565+0000","last_undegraded":"2023-12-19T05:52:20.084565+0000","last_fullsized":"2023-12-19T05:52:20.084565+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:36:12.230742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084486+0000","last_change":"2023-12-19T05:52:19.089730+0000","last_active":"2023-12-19T05:52:20.084486+0000","last_peered":"2023-12-19T05:52:20.084486+0000","last_clean":"2023-12-19T05:52:20.084486+0000","last_became_active":"2023-12-19T05:52:19.089373+0000","last_became_peered":"2023-12-19T05:52:19.089373+0000","last_unstale":"2023-12-19T05:52:20.084486+0000","last_undegraded":"2023-12-19T05:52:20.084486+0000","last_fullsized":"2023-12-19T05:52:20.084486+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:18:03.084016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702619+0000","last_change":"2023-12-19T05:52:19.101233+0000","last_active":"2023-12-19T05:52:21.702619+0000","last_peered":"2023-12-19T05:52:21.702619+0000","last_clean":"2023-12-19T05:52:21.702619+0000","last_became_active":"2023-12-19T05:52:19.100840+0000","last_became_peered":"2023-12-19T05:52:19.100840+0000","last_unstale":"2023-12-19T05:52:21.702619+0000","last_undegraded":"2023-12-19T05:52:21.702619+0000","last_fullsized":"2023-12-19T05:52:21.702619+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:12.842228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703865+0000","last_change":"2023-12-19T05:52:19.093546+0000","last_active":"2023-12-19T05:52:21.703865+0000","last_peered":"2023-12-19T05:52:21.703865+0000","last_clean":"2023-12-19T05:52:21.703865+0000","last_became_active":"2023-12-19T05:52:19.092265+0000","last_became_peered":"2023-12-19T05:52:19.092265+0000","last_unstale":"2023-12-19T05:52:21.703865+0000","last_undegraded":"2023-12-19T05:52:21.703865+0000","last_fullsized":"2023-12-19T05:52:21.703865+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:24.312058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702035+0000","last_change":"2023-12-19T05:52:19.099249+0000","last_active":"2023-12-19T05:52:21.702035+0000","last_peered":"2023-12-19T05:52:21.702035+0000","last_clean":"2023-12-19T05:52:21.702035+0000","last_became_active":"2023-12-19T05:52:19.098770+0000","last_became_peered":"2023-12-19T05:52:19.098770+0000","last_unstale":"2023-12-19T05:52:21.702035+0000","last_undegraded":"2023-12-19T05:52:21.702035+0000","last_fullsized":"2023-12-19T05:52:21.702035+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:05.581605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090263+0000","last_change":"2023-12-19T05:52:19.102294+0000","last_active":"2023-12-19T05:52:20.090263+0000","last_peered":"2023-12-19T05:52:20.090263+0000","last_clean":"2023-12-19T05:52:20.090263+0000","last_became_active":"2023-12-19T05:52:19.102058+0000","last_became_peered":"2023-12-19T05:52:19.102058+0000","last_unstale":"2023-12-19T05:52:20.090263+0000","last_undegraded":"2023-12-19T05:52:20.090263+0000","last_fullsized":"2023-12-19T05:52:20.090263+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:38:27.474581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093457+0000","last_change":"2023-12-19T05:52:19.095162+0000","last_active":"2023-12-19T05:52:21.093457+0000","last_peered":"2023-12-19T05:52:21.093457+0000","last_clean":"2023-12-19T05:52:21.093457+0000","last_became_active":"2023-12-19T05:52:19.094944+0000","last_became_peered":"2023-12-19T05:52:19.094944+0000","last_unstale":"2023-12-19T05:52:21.093457+0000","last_undegraded":"2023-12-19T05:52:21.093457+0000","last_fullsized":"2023-12-19T05:52:21.093457+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702527+0000","last_change":"2023-12-19T05:52:19.099109+0000","last_active":"2023-12-19T05:52:21.702527+0000","last_peered":"2023-12-19T05:52:21.702527+0000","last_clean":"2023-12-19T05:52:21.702527+0000","last_became_active":"2023-12-19T05:52:19.098807+0000","last_became_peered":"2023-12-19T05:52:19.098807+0000","last_unstale":"2023-12-19T05:52:21.702527+0000","last_undegraded":"2023-12-19T05:52:21.702527+0000","last_fullsized":"2023-12-19T05:52:21.702527+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084878+0000","last_change":"2023-12-19T05:52:19.105732+0000","last_active":"2023-12-19T05:52:20.084878+0000","last_peered":"2023-12-19T05:52:20.084878+0000","last_clean":"2023-12-19T05:52:20.084878+0000","last_became_active":"2023-12-19T05:52:19.105512+0000","last_became_peered":"2023-12-19T05:52:19.105512+0000","last_unstale":"2023-12-19T05:52:20.084878+0000","last_undegraded":"2023-12-19T05:52:20.084878+0000","last_fullsized":"2023-12-19T05:52:20.084878+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:03.334713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090177+0000","last_change":"2023-12-19T05:52:19.111142+0000","last_active":"2023-12-19T05:52:20.090177+0000","last_peered":"2023-12-19T05:52:20.090177+0000","last_clean":"2023-12-19T05:52:20.090177+0000","last_became_active":"2023-12-19T05:52:19.110941+0000","last_became_peered":"2023-12-19T05:52:19.110941+0000","last_unstale":"2023-12-19T05:52:20.090177+0000","last_undegraded":"2023-12-19T05:52:20.090177+0000","last_fullsized":"2023-12-19T05:52:20.090177+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:44.364054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.843853+0000","last_change":"2023-12-19T05:52:19.100653+0000","last_active":"2023-12-19T05:52:20.843853+0000","last_peered":"2023-12-19T05:52:20.843853+0000","last_clean":"2023-12-19T05:52:20.843853+0000","last_became_active":"2023-12-19T05:52:19.099988+0000","last_became_peered":"2023-12-19T05:52:19.099988+0000","last_unstale":"2023-12-19T05:52:20.843853+0000","last_undegraded":"2023-12-19T05:52:20.843853+0000","last_fullsized":"2023-12-19T05:52:20.843853+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:28:47.405930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090571+0000","last_change":"2023-12-19T05:52:19.093409+0000","last_active":"2023-12-19T05:52:20.090571+0000","last_peered":"2023-12-19T05:52:20.090571+0000","last_clean":"2023-12-19T05:52:20.090571+0000","last_became_active":"2023-12-19T05:52:19.092976+0000","last_became_peered":"2023-12-19T05:52:19.092976+0000","last_unstale":"2023-12-19T05:52:20.090571+0000","last_undegraded":"2023-12-19T05:52:20.090571+0000","last_fullsized":"2023-12-19T05:52:20.090571+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844175+0000","last_change":"2023-12-19T05:52:19.101416+0000","last_active":"2023-12-19T05:52:20.844175+0000","last_peered":"2023-12-19T05:52:20.844175+0000","last_clean":"2023-12-19T05:52:20.844175+0000","last_became_active":"2023-12-19T05:52:19.101181+0000","last_became_peered":"2023-12-19T05:52:19.101181+0000","last_unstale":"2023-12-19T05:52:20.844175+0000","last_undegraded":"2023-12-19T05:52:20.844175+0000","last_fullsized":"2023-12-19T05:52:20.844175+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:25.128907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.845219+0000","last_change":"2023-12-19T05:52:19.105889+0000","last_active":"2023-12-19T05:52:20.845219+0000","last_peered":"2023-12-19T05:52:20.845219+0000","last_clean":"2023-12-19T05:52:20.845219+0000","last_became_active":"2023-12-19T05:52:19.098444+0000","last_became_peered":"2023-12-19T05:52:19.098444+0000","last_unstale":"2023-12-19T05:52:20.845219+0000","last_undegraded":"2023-12-19T05:52:20.845219+0000","last_fullsized":"2023-12-19T05:52:20.845219+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:47.140342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091305+0000","last_change":"2023-12-19T05:52:19.101119+0000","last_active":"2023-12-19T05:52:20.091305+0000","last_peered":"2023-12-19T05:52:20.091305+0000","last_clean":"2023-12-19T05:52:20.091305+0000","last_became_active":"2023-12-19T05:52:19.100719+0000","last_became_peered":"2023-12-19T05:52:19.100719+0000","last_unstale":"2023-12-19T05:52:20.091305+0000","last_undegraded":"2023-12-19T05:52:20.091305+0000","last_fullsized":"2023-12-19T05:52:20.091305+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:31.348227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844146+0000","last_change":"2023-12-19T05:52:19.104035+0000","last_active":"2023-12-19T05:52:20.844146+0000","last_peered":"2023-12-19T05:52:20.844146+0000","last_clean":"2023-12-19T05:52:20.844146+0000","last_became_active":"2023-12-19T05:52:19.100397+0000","last_became_peered":"2023-12-19T05:52:19.100397+0000","last_unstale":"2023-12-19T05:52:20.844146+0000","last_undegraded":"2023-12-19T05:52:20.844146+0000","last_fullsized":"2023-12-19T05:52:20.844146+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:47:14.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702104+0000","last_change":"2023-12-19T05:52:19.099344+0000","last_active":"2023-12-19T05:52:21.702104+0000","last_peered":"2023-12-19T05:52:21.702104+0000","last_clean":"2023-12-19T05:52:21.702104+0000","last_became_active":"2023-12-19T05:52:19.098940+0000","last_became_peered":"2023-12-19T05:52:19.098940+0000","last_unstale":"2023-12-19T05:52:21.702104+0000","last_undegraded":"2023-12-19T05:52:21.702104+0000","last_fullsized":"2023-12-19T05:52:21.702104+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701705+0000","last_change":"2023-12-19T05:52:19.104882+0000","last_active":"2023-12-19T05:52:21.701705+0000","last_peered":"2023-12-19T05:52:21.701705+0000","last_clean":"2023-12-19T05:52:21.701705+0000","last_became_active":"2023-12-19T05:52:19.104331+0000","last_became_peered":"2023-12-19T05:52:19.104331+0000","last_unstale":"2023-12-19T05:52:21.701705+0000","last_undegraded":"2023-12-19T05:52:21.701705+0000","last_fullsized":"2023-12-19T05:52:21.701705+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:19.413815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.704132+0000","last_change":"2023-12-19T05:52:19.102031+0000","last_active":"2023-12-19T05:52:21.704132+0000","last_peered":"2023-12-19T05:52:21.704132+0000","last_clean":"2023-12-19T05:52:21.704132+0000","last_became_active":"2023-12-19T05:52:19.101722+0000","last_became_peered":"2023-12-19T05:52:19.101722+0000","last_unstale":"2023-12-19T05:52:21.704132+0000","last_undegraded":"2023-12-19T05:52:21.704132+0000","last_fullsized":"2023-12-19T05:52:21.704132+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:25.691691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701950+0000","last_change":"2023-12-19T05:52:19.107894+0000","last_active":"2023-12-19T05:52:21.701950+0000","last_peered":"2023-12-19T05:52:21.701950+0000","last_clean":"2023-12-19T05:52:21.701950+0000","last_became_active":"2023-12-19T05:52:19.107637+0000","last_became_peered":"2023-12-19T05:52:19.107637+0000","last_unstale":"2023-12-19T05:52:21.701950+0000","last_undegraded":"2023-12-19T05:52:21.701950+0000","last_fullsized":"2023-12-19T05:52:21.701950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089331+0000","last_change":"2023-12-19T05:52:19.096850+0000","last_active":"2023-12-19T05:52:20.089331+0000","last_peered":"2023-12-19T05:52:20.089331+0000","last_clean":"2023-12-19T05:52:20.089331+0000","last_became_active":"2023-12-19T05:52:19.095947+0000","last_became_peered":"2023-12-19T05:52:19.095947+0000","last_unstale":"2023-12-19T05:52:20.089331+0000","last_undegraded":"2023-12-19T05:52:20.089331+0000","last_fullsized":"2023-12-19T05:52:20.089331+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:38:16.859514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094134+0000","last_change":"2023-12-19T05:52:19.100284+0000","last_active":"2023-12-19T05:52:21.094134+0000","last_peered":"2023-12-19T05:52:21.094134+0000","last_clean":"2023-12-19T05:52:21.094134+0000","last_became_active":"2023-12-19T05:52:19.099417+0000","last_became_peered":"2023-12-19T05:52:19.099417+0000","last_unstale":"2023-12-19T05:52:21.094134+0000","last_undegraded":"2023-12-19T05:52:21.094134+0000","last_fullsized":"2023-12-19T05:52:21.094134+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:39.489921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"192'4","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108576+0000","last_change":"2023-12-19T05:52:18.596086+0000","last_active":"2023-12-19T05:52:19.108576+0000","last_peered":"2023-12-19T05:52:19.108576+0000","last_clean":"2023-12-19T05:52:19.108576+0000","last_became_active":"2023-12-19T05:52:18.595180+0000","last_became_peered":"2023-12-19T05:52:18.595180+0000","last_unstale":"2023-12-19T05:52:19.108576+0000","last_undegraded":"2023-12-19T05:52:19.108576+0000","last_fullsized":"2023-12-19T05:52:19.108576+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:38.820617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701968+0000","last_change":"2023-12-19T05:52:19.105627+0000","last_active":"2023-12-19T05:52:21.701968+0000","last_peered":"2023-12-19T05:52:21.701968+0000","last_clean":"2023-12-19T05:52:21.701968+0000","last_became_active":"2023-12-19T05:52:19.103316+0000","last_became_peered":"2023-12-19T05:52:19.103316+0000","last_unstale":"2023-12-19T05:52:21.701968+0000","last_undegraded":"2023-12-19T05:52:21.701968+0000","last_fullsized":"2023-12-19T05:52:21.701968+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.104599+0000","last_change":"2023-12-19T05:52:18.576203+0000","last_active":"2023-12-19T05:52:19.104599+0000","last_peered":"2023-12-19T05:52:19.104599+0000","last_clean":"2023-12-19T05:52:19.104599+0000","last_became_active":"2023-12-19T05:52:18.575383+0000","last_became_peered":"2023-12-19T05:52:18.575383+0000","last_unstale":"2023-12-19T05:52:19.104599+0000","last_undegraded":"2023-12-19T05:52:19.104599+0000","last_fullsized":"2023-12-19T05:52:19.104599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:53.093740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090389+0000","last_change":"2023-12-19T05:52:19.106303+0000","last_active":"2023-12-19T05:52:20.090389+0000","last_peered":"2023-12-19T05:52:20.090389+0000","last_clean":"2023-12-19T05:52:20.090389+0000","last_became_active":"2023-12-19T05:52:19.104988+0000","last_became_peered":"2023-12-19T05:52:19.104988+0000","last_unstale":"2023-12-19T05:52:20.090389+0000","last_undegraded":"2023-12-19T05:52:20.090389+0000","last_fullsized":"2023-12-19T05:52:20.090389+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:02.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.111973+0000","last_change":"2023-12-19T05:52:18.599310+0000","last_active":"2023-12-19T05:52:19.111973+0000","last_peered":"2023-12-19T05:52:19.111973+0000","last_clean":"2023-12-19T05:52:19.111973+0000","last_became_active":"2023-12-19T05:52:18.599016+0000","last_became_peered":"2023-12-19T05:52:18.599016+0000","last_unstale":"2023-12-19T05:52:19.111973+0000","last_undegraded":"2023-12-19T05:52:19.111973+0000","last_fullsized":"2023-12-19T05:52:19.111973+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:46.150853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.704354+0000","last_change":"2023-12-19T05:52:19.098239+0000","last_active":"2023-12-19T05:52:21.704354+0000","last_peered":"2023-12-19T05:52:21.704354+0000","last_clean":"2023-12-19T05:52:21.704354+0000","last_became_active":"2023-12-19T05:52:19.092714+0000","last_became_peered":"2023-12-19T05:52:19.092714+0000","last_unstale":"2023-12-19T05:52:21.704354+0000","last_undegraded":"2023-12-19T05:52:21.704354+0000","last_fullsized":"2023-12-19T05:52:21.704354+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:11.124114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108239+0000","last_change":"2023-12-19T05:52:18.589340+0000","last_active":"2023-12-19T05:52:19.108239+0000","last_peered":"2023-12-19T05:52:19.108239+0000","last_clean":"2023-12-19T05:52:19.108239+0000","last_became_active":"2023-12-19T05:52:18.588835+0000","last_became_peered":"2023-12-19T05:52:18.588835+0000","last_unstale":"2023-12-19T05:52:19.108239+0000","last_undegraded":"2023-12-19T05:52:19.108239+0000","last_fullsized":"2023-12-19T05:52:19.108239+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:10.109404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093788+0000","last_change":"2023-12-19T05:52:19.100236+0000","last_active":"2023-12-19T05:52:21.093788+0000","last_peered":"2023-12-19T05:52:21.093788+0000","last_clean":"2023-12-19T05:52:21.093788+0000","last_became_active":"2023-12-19T05:52:19.100001+0000","last_became_peered":"2023-12-19T05:52:19.100001+0000","last_unstale":"2023-12-19T05:52:21.093788+0000","last_undegraded":"2023-12-19T05:52:21.093788+0000","last_fullsized":"2023-12-19T05:52:21.093788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:52.626234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.104796+0000","last_change":"2023-12-19T05:52:18.591945+0000","last_active":"2023-12-19T05:52:19.104796+0000","last_peered":"2023-12-19T05:52:19.104796+0000","last_clean":"2023-12-19T05:52:19.104796+0000","last_became_active":"2023-12-19T05:52:18.591548+0000","last_became_peered":"2023-12-19T05:52:18.591548+0000","last_unstale":"2023-12-19T05:52:19.104796+0000","last_undegraded":"2023-12-19T05:52:19.104796+0000","last_fullsized":"2023-12-19T05:52:19.104796+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:44:16.892374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089625+0000","last_change":"2023-12-19T05:52:19.101601+0000","last_active":"2023-12-19T05:52:20.089625+0000","last_peered":"2023-12-19T05:52:20.089625+0000","last_clean":"2023-12-19T05:52:20.089625+0000","last_became_active":"2023-12-19T05:52:19.096311+0000","last_became_peered":"2023-12-19T05:52:19.096311+0000","last_unstale":"2023-12-19T05:52:20.089625+0000","last_undegraded":"2023-12-19T05:52:20.089625+0000","last_fullsized":"2023-12-19T05:52:20.089625+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:54.108451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.107880+0000","last_change":"2023-12-19T05:52:18.597591+0000","last_active":"2023-12-19T05:52:19.107880+0000","last_peered":"2023-12-19T05:52:19.107880+0000","last_clean":"2023-12-19T05:52:19.107880+0000","last_became_active":"2023-12-19T05:52:18.595758+0000","last_became_peered":"2023-12-19T05:52:18.595758+0000","last_unstale":"2023-12-19T05:52:19.107880+0000","last_undegraded":"2023-12-19T05:52:19.107880+0000","last_fullsized":"2023-12-19T05:52:19.107880+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:24.676980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.092647+0000","last_change":"2023-12-19T05:52:19.102280+0000","last_active":"2023-12-19T05:52:20.092647+0000","last_peered":"2023-12-19T05:52:20.092647+0000","last_clean":"2023-12-19T05:52:20.092647+0000","last_became_active":"2023-12-19T05:52:19.101694+0000","last_became_peered":"2023-12-19T05:52:19.101694+0000","last_unstale":"2023-12-19T05:52:20.092647+0000","last_undegraded":"2023-12-19T05:52:20.092647+0000","last_fullsized":"2023-12-19T05:52:20.092647+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092390+0000","last_change":"2023-12-19T05:52:18.596653+0000","last_active":"2023-12-19T05:52:19.092390+0000","last_peered":"2023-12-19T05:52:19.092390+0000","last_clean":"2023-12-19T05:52:19.092390+0000","last_became_active":"2023-12-19T05:52:18.595475+0000","last_became_peered":"2023-12-19T05:52:18.595475+0000","last_unstale":"2023-12-19T05:52:19.092390+0000","last_undegraded":"2023-12-19T05:52:19.092390+0000","last_fullsized":"2023-12-19T05:52:19.092390+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:18.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094269+0000","last_change":"2023-12-19T05:52:19.100047+0000","last_active":"2023-12-19T05:52:21.094269+0000","last_peered":"2023-12-19T05:52:21.094269+0000","last_clean":"2023-12-19T05:52:21.094269+0000","last_became_active":"2023-12-19T05:52:19.097222+0000","last_became_peered":"2023-12-19T05:52:19.097222+0000","last_unstale":"2023-12-19T05:52:21.094269+0000","last_undegraded":"2023-12-19T05:52:21.094269+0000","last_fullsized":"2023-12-19T05:52:21.094269+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:53.807577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.086249+0000","last_change":"2023-12-19T05:52:18.591116+0000","last_active":"2023-12-19T05:52:19.086249+0000","last_peered":"2023-12-19T05:52:19.086249+0000","last_clean":"2023-12-19T05:52:19.086249+0000","last_became_active":"2023-12-19T05:52:18.587413+0000","last_became_peered":"2023-12-19T05:52:18.587413+0000","last_unstale":"2023-12-19T05:52:19.086249+0000","last_undegraded":"2023-12-19T05:52:19.086249+0000","last_fullsized":"2023-12-19T05:52:19.086249+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:56.093939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702188+0000","last_change":"2023-12-19T05:52:19.106243+0000","last_active":"2023-12-19T05:52:21.702188+0000","last_peered":"2023-12-19T05:52:21.702188+0000","last_clean":"2023-12-19T05:52:21.702188+0000","last_became_active":"2023-12-19T05:52:19.105975+0000","last_became_peered":"2023-12-19T05:52:19.105975+0000","last_unstale":"2023-12-19T05:52:21.702188+0000","last_undegraded":"2023-12-19T05:52:21.702188+0000","last_fullsized":"2023-12-19T05:52:21.702188+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092164+0000","last_change":"2023-12-19T05:52:18.595002+0000","last_active":"2023-12-19T05:52:19.092164+0000","last_peered":"2023-12-19T05:52:19.092164+0000","last_clean":"2023-12-19T05:52:19.092164+0000","last_became_active":"2023-12-19T05:52:18.594726+0000","last_became_peered":"2023-12-19T05:52:18.594726+0000","last_unstale":"2023-12-19T05:52:19.092164+0000","last_undegraded":"2023-12-19T05:52:19.092164+0000","last_fullsized":"2023-12-19T05:52:19.092164+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:16.949526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701745+0000","last_change":"2023-12-19T05:52:19.107145+0000","last_active":"2023-12-19T05:52:21.701745+0000","last_peered":"2023-12-19T05:52:21.701745+0000","last_clean":"2023-12-19T05:52:21.701745+0000","last_became_active":"2023-12-19T05:52:19.106866+0000","last_became_peered":"2023-12-19T05:52:19.106866+0000","last_unstale":"2023-12-19T05:52:21.701745+0000","last_undegraded":"2023-12-19T05:52:21.701745+0000","last_fullsized":"2023-12-19T05:52:21.701745+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.112566+0000","last_change":"2023-12-19T05:52:18.593681+0000","last_active":"2023-12-19T05:52:19.112566+0000","last_peered":"2023-12-19T05:52:19.112566+0000","last_clean":"2023-12-19T05:52:19.112566+0000","last_became_active":"2023-12-19T05:52:18.593124+0000","last_became_peered":"2023-12-19T05:52:18.593124+0000","last_unstale":"2023-12-19T05:52:19.112566+0000","last_undegraded":"2023-12-19T05:52:19.112566+0000","last_fullsized":"2023-12-19T05:52:19.112566+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:42.978868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702245+0000","last_change":"2023-12-19T05:52:19.107662+0000","last_active":"2023-12-19T05:52:21.702245+0000","last_peered":"2023-12-19T05:52:21.702245+0000","last_clean":"2023-12-19T05:52:21.702245+0000","last_became_active":"2023-12-19T05:52:19.106271+0000","last_became_peered":"2023-12-19T05:52:19.106271+0000","last_unstale":"2023-12-19T05:52:21.702245+0000","last_undegraded":"2023-12-19T05:52:21.702245+0000","last_fullsized":"2023-12-19T05:52:21.702245+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:05.581605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"192'6","reported_seq":17,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.114443+0000","last_change":"2023-12-19T05:52:18.589063+0000","last_active":"2023-12-19T05:52:19.114443+0000","last_peered":"2023-12-19T05:52:19.114443+0000","last_clean":"2023-12-19T05:52:19.114443+0000","last_became_active":"2023-12-19T05:52:18.588666+0000","last_became_peered":"2023-12-19T05:52:18.588666+0000","last_unstale":"2023-12-19T05:52:19.114443+0000","last_undegraded":"2023-12-19T05:52:19.114443+0000","last_fullsized":"2023-12-19T05:52:19.114443+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:46:23.863072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702327+0000","last_change":"2023-12-19T05:52:19.099039+0000","last_active":"2023-12-19T05:52:21.702327+0000","last_peered":"2023-12-19T05:52:21.702327+0000","last_clean":"2023-12-19T05:52:21.702327+0000","last_became_active":"2023-12-19T05:52:19.098443+0000","last_became_peered":"2023-12-19T05:52:19.098443+0000","last_unstale":"2023-12-19T05:52:21.702327+0000","last_undegraded":"2023-12-19T05:52:21.702327+0000","last_fullsized":"2023-12-19T05:52:21.702327+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:19.413815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.105508+0000","last_change":"2023-12-19T05:52:18.593123+0000","last_active":"2023-12-19T05:52:19.105508+0000","last_peered":"2023-12-19T05:52:19.105508+0000","last_clean":"2023-12-19T05:52:19.105508+0000","last_became_active":"2023-12-19T05:52:18.592413+0000","last_became_peered":"2023-12-19T05:52:18.592413+0000","last_unstale":"2023-12-19T05:52:19.105508+0000","last_undegraded":"2023-12-19T05:52:19.105508+0000","last_fullsized":"2023-12-19T05:52:19.105508+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:39.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.092893+0000","last_change":"2023-12-19T05:52:19.094185+0000","last_active":"2023-12-19T05:52:20.092893+0000","last_peered":"2023-12-19T05:52:20.092893+0000","last_clean":"2023-12-19T05:52:20.092893+0000","last_became_active":"2023-12-19T05:52:19.093941+0000","last_became_peered":"2023-12-19T05:52:19.093941+0000","last_unstale":"2023-12-19T05:52:20.092893+0000","last_undegraded":"2023-12-19T05:52:20.092893+0000","last_fullsized":"2023-12-19T05:52:20.092893+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.099084+0000","last_change":"2023-12-19T05:52:18.597020+0000","last_active":"2023-12-19T05:52:19.099084+0000","last_peered":"2023-12-19T05:52:19.099084+0000","last_clean":"2023-12-19T05:52:19.099084+0000","last_became_active":"2023-12-19T05:52:18.596806+0000","last_became_peered":"2023-12-19T05:52:18.596806+0000","last_unstale":"2023-12-19T05:52:19.099084+0000","last_undegraded":"2023-12-19T05:52:19.099084+0000","last_fullsized":"2023-12-19T05:52:19.099084+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:20.360085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089520+0000","last_change":"2023-12-19T05:52:19.103825+0000","last_active":"2023-12-19T05:52:20.089520+0000","last_peered":"2023-12-19T05:52:20.089520+0000","last_clean":"2023-12-19T05:52:20.089520+0000","last_became_active":"2023-12-19T05:52:19.103487+0000","last_became_peered":"2023-12-19T05:52:19.103487+0000","last_unstale":"2023-12-19T05:52:20.089520+0000","last_undegraded":"2023-12-19T05:52:20.089520+0000","last_fullsized":"2023-12-19T05:52:20.089520+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:47.431387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091368+0000","last_change":"2023-12-19T05:52:18.595346+0000","last_active":"2023-12-19T05:52:19.091368+0000","last_peered":"2023-12-19T05:52:19.091368+0000","last_clean":"2023-12-19T05:52:19.091368+0000","last_became_active":"2023-12-19T05:52:18.595034+0000","last_became_peered":"2023-12-19T05:52:18.595034+0000","last_unstale":"2023-12-19T05:52:19.091368+0000","last_undegraded":"2023-12-19T05:52:19.091368+0000","last_fullsized":"2023-12-19T05:52:19.091368+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:18.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703127+0000","last_change":"2023-12-19T05:52:19.099768+0000","last_active":"2023-12-19T05:52:21.703127+0000","last_peered":"2023-12-19T05:52:21.703127+0000","last_clean":"2023-12-19T05:52:21.703127+0000","last_became_active":"2023-12-19T05:52:19.099503+0000","last_became_peered":"2023-12-19T05:52:19.099503+0000","last_unstale":"2023-12-19T05:52:21.703127+0000","last_undegraded":"2023-12-19T05:52:21.703127+0000","last_fullsized":"2023-12-19T05:52:21.703127+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:43.993579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"192'8","reported_seq":19,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.116349+0000","last_change":"2023-12-19T05:52:18.589960+0000","last_active":"2023-12-19T05:52:19.116349+0000","last_peered":"2023-12-19T05:52:19.116349+0000","last_clean":"2023-12-19T05:52:19.116349+0000","last_became_active":"2023-12-19T05:52:18.589394+0000","last_became_peered":"2023-12-19T05:52:18.589394+0000","last_unstale":"2023-12-19T05:52:19.116349+0000","last_undegraded":"2023-12-19T05:52:19.116349+0000","last_fullsized":"2023-12-19T05:52:19.116349+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:47:07.131558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702278+0000","last_change":"2023-12-19T05:52:19.105652+0000","last_active":"2023-12-19T05:52:21.702278+0000","last_peered":"2023-12-19T05:52:21.702278+0000","last_clean":"2023-12-19T05:52:21.702278+0000","last_became_active":"2023-12-19T05:52:19.105406+0000","last_became_peered":"2023-12-19T05:52:19.105406+0000","last_unstale":"2023-12-19T05:52:21.702278+0000","last_undegraded":"2023-12-19T05:52:21.702278+0000","last_fullsized":"2023-12-19T05:52:21.702278+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:12.842228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.112663+0000","last_change":"2023-12-19T05:52:18.588893+0000","last_active":"2023-12-19T05:52:19.112663+0000","last_peered":"2023-12-19T05:52:19.112663+0000","last_clean":"2023-12-19T05:52:19.112663+0000","last_became_active":"2023-12-19T05:52:18.588225+0000","last_became_peered":"2023-12-19T05:52:18.588225+0000","last_unstale":"2023-12-19T05:52:19.112663+0000","last_undegraded":"2023-12-19T05:52:19.112663+0000","last_fullsized":"2023-12-19T05:52:19.112663+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:11:57.445905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094390+0000","last_change":"2023-12-19T05:52:19.104071+0000","last_active":"2023-12-19T05:52:21.094390+0000","last_peered":"2023-12-19T05:52:21.094390+0000","last_clean":"2023-12-19T05:52:21.094390+0000","last_became_active":"2023-12-19T05:52:19.103425+0000","last_became_peered":"2023-12-19T05:52:19.103425+0000","last_unstale":"2023-12-19T05:52:21.094390+0000","last_undegraded":"2023-12-19T05:52:21.094390+0000","last_fullsized":"2023-12-19T05:52:21.094390+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:01:44.577848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.109759+0000","last_change":"2023-12-19T05:52:18.597439+0000","last_active":"2023-12-19T05:52:19.109759+0000","last_peered":"2023-12-19T05:52:19.109759+0000","last_clean":"2023-12-19T05:52:19.109759+0000","last_became_active":"2023-12-19T05:52:18.597198+0000","last_became_peered":"2023-12-19T05:52:18.597198+0000","last_unstale":"2023-12-19T05:52:19.109759+0000","last_undegraded":"2023-12-19T05:52:19.109759+0000","last_fullsized":"2023-12-19T05:52:19.109759+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:38:15.844803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094254+0000","last_change":"2023-12-19T05:52:19.098382+0000","last_active":"2023-12-19T05:52:21.094254+0000","last_peered":"2023-12-19T05:52:21.094254+0000","last_clean":"2023-12-19T05:52:21.094254+0000","last_became_active":"2023-12-19T05:52:19.098156+0000","last_became_peered":"2023-12-19T05:52:19.098156+0000","last_unstale":"2023-12-19T05:52:21.094254+0000","last_undegraded":"2023-12-19T05:52:21.094254+0000","last_fullsized":"2023-12-19T05:52:21.094254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.113128+0000","last_change":"2023-12-19T05:52:18.598771+0000","last_active":"2023-12-19T05:52:19.113128+0000","last_peered":"2023-12-19T05:52:19.113128+0000","last_clean":"2023-12-19T05:52:19.113128+0000","last_became_active":"2023-12-19T05:52:18.598384+0000","last_became_peered":"2023-12-19T05:52:18.598384+0000","last_unstale":"2023-12-19T05:52:19.113128+0000","last_undegraded":"2023-12-19T05:52:19.113128+0000","last_fullsized":"2023-12-19T05:52:19.113128+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:20.360085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091096+0000","last_change":"2023-12-19T05:52:19.100266+0000","last_active":"2023-12-19T05:52:20.091096+0000","last_peered":"2023-12-19T05:52:20.091096+0000","last_clean":"2023-12-19T05:52:20.091096+0000","last_became_active":"2023-12-19T05:52:19.100043+0000","last_became_peered":"2023-12-19T05:52:19.100043+0000","last_unstale":"2023-12-19T05:52:20.091096+0000","last_undegraded":"2023-12-19T05:52:20.091096+0000","last_fullsized":"2023-12-19T05:52:20.091096+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082526+0000","last_change":"2023-12-19T05:52:18.586281+0000","last_active":"2023-12-19T05:52:19.082526+0000","last_peered":"2023-12-19T05:52:19.082526+0000","last_clean":"2023-12-19T05:52:19.082526+0000","last_became_active":"2023-12-19T05:52:18.586047+0000","last_became_peered":"2023-12-19T05:52:18.586047+0000","last_unstale":"2023-12-19T05:52:19.082526+0000","last_undegraded":"2023-12-19T05:52:19.082526+0000","last_fullsized":"2023-12-19T05:52:19.082526+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:23.314385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702029+0000","last_change":"2023-12-19T05:52:19.098836+0000","last_active":"2023-12-19T05:52:21.702029+0000","last_peered":"2023-12-19T05:52:21.702029+0000","last_clean":"2023-12-19T05:52:21.702029+0000","last_became_active":"2023-12-19T05:52:19.098606+0000","last_became_peered":"2023-12-19T05:52:19.098606+0000","last_unstale":"2023-12-19T05:52:21.702029+0000","last_undegraded":"2023-12-19T05:52:21.702029+0000","last_fullsized":"2023-12-19T05:52:21.702029+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108413+0000","last_change":"2023-12-19T05:52:18.593428+0000","last_active":"2023-12-19T05:52:19.108413+0000","last_peered":"2023-12-19T05:52:19.108413+0000","last_clean":"2023-12-19T05:52:19.108413+0000","last_became_active":"2023-12-19T05:52:18.590314+0000","last_became_peered":"2023-12-19T05:52:18.590314+0000","last_unstale":"2023-12-19T05:52:19.108413+0000","last_undegraded":"2023-12-19T05:52:19.108413+0000","last_fullsized":"2023-12-19T05:52:19.108413+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:10.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090808+0000","last_change":"2023-12-19T05:52:19.095363+0000","last_active":"2023-12-19T05:52:20.090808+0000","last_peered":"2023-12-19T05:52:20.090808+0000","last_clean":"2023-12-19T05:52:20.090808+0000","last_became_active":"2023-12-19T05:52:19.094959+0000","last_became_peered":"2023-12-19T05:52:19.094959+0000","last_unstale":"2023-12-19T05:52:20.090808+0000","last_undegraded":"2023-12-19T05:52:20.090808+0000","last_fullsized":"2023-12-19T05:52:20.090808+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082342+0000","last_change":"2023-12-19T05:52:18.597190+0000","last_active":"2023-12-19T05:52:19.082342+0000","last_peered":"2023-12-19T05:52:19.082342+0000","last_clean":"2023-12-19T05:52:19.082342+0000","last_became_active":"2023-12-19T05:52:18.596946+0000","last_became_peered":"2023-12-19T05:52:18.596946+0000","last_unstale":"2023-12-19T05:52:19.082342+0000","last_undegraded":"2023-12-19T05:52:19.082342+0000","last_fullsized":"2023-12-19T05:52:19.082342+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:52.970451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702049+0000","last_change":"2023-12-19T05:52:19.098064+0000","last_active":"2023-12-19T05:52:21.702049+0000","last_peered":"2023-12-19T05:52:21.702049+0000","last_clean":"2023-12-19T05:52:21.702049+0000","last_became_active":"2023-12-19T05:52:19.097817+0000","last_became_peered":"2023-12-19T05:52:19.097817+0000","last_unstale":"2023-12-19T05:52:21.702049+0000","last_undegraded":"2023-12-19T05:52:21.702049+0000","last_fullsized":"2023-12-19T05:52:21.702049+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:21.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.089419+0000","last_change":"2023-12-19T05:52:18.598740+0000","last_active":"2023-12-19T05:52:19.089419+0000","last_peered":"2023-12-19T05:52:19.089419+0000","last_clean":"2023-12-19T05:52:19.089419+0000","last_became_active":"2023-12-19T05:52:18.598492+0000","last_became_peered":"2023-12-19T05:52:18.598492+0000","last_unstale":"2023-12-19T05:52:19.089419+0000","last_undegraded":"2023-12-19T05:52:19.089419+0000","last_fullsized":"2023-12-19T05:52:19.089419+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:11.827518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702424+0000","last_change":"2023-12-19T05:52:19.109299+0000","last_active":"2023-12-19T05:52:21.702424+0000","last_peered":"2023-12-19T05:52:21.702424+0000","last_clean":"2023-12-19T05:52:21.702424+0000","last_became_active":"2023-12-19T05:52:19.108404+0000","last_became_peered":"2023-12-19T05:52:19.108404+0000","last_unstale":"2023-12-19T05:52:21.702424+0000","last_undegraded":"2023-12-19T05:52:21.702424+0000","last_fullsized":"2023-12-19T05:52:21.702424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:21.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082225+0000","last_change":"2023-12-19T05:52:18.584006+0000","last_active":"2023-12-19T05:52:19.082225+0000","last_peered":"2023-12-19T05:52:19.082225+0000","last_clean":"2023-12-19T05:52:19.082225+0000","last_became_active":"2023-12-19T05:52:18.583627+0000","last_became_peered":"2023-12-19T05:52:18.583627+0000","last_unstale":"2023-12-19T05:52:19.082225+0000","last_undegraded":"2023-12-19T05:52:19.082225+0000","last_fullsized":"2023-12-19T05:52:19.082225+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:09.221868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091034+0000","last_change":"2023-12-19T05:52:19.104633+0000","last_active":"2023-12-19T05:52:20.091034+0000","last_peered":"2023-12-19T05:52:20.091034+0000","last_clean":"2023-12-19T05:52:20.091034+0000","last_became_active":"2023-12-19T05:52:19.104391+0000","last_became_peered":"2023-12-19T05:52:19.104391+0000","last_unstale":"2023-12-19T05:52:20.091034+0000","last_undegraded":"2023-12-19T05:52:20.091034+0000","last_fullsized":"2023-12-19T05:52:20.091034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.110589+0000","last_change":"2023-12-19T05:52:18.598354+0000","last_active":"2023-12-19T05:52:19.110589+0000","last_peered":"2023-12-19T05:52:19.110589+0000","last_clean":"2023-12-19T05:52:19.110589+0000","last_became_active":"2023-12-19T05:52:18.598111+0000","last_became_peered":"2023-12-19T05:52:18.598111+0000","last_unstale":"2023-12-19T05:52:19.110589+0000","last_undegraded":"2023-12-19T05:52:19.110589+0000","last_fullsized":"2023-12-19T05:52:19.110589+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:25.793839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094504+0000","last_change":"2023-12-19T05:52:19.092975+0000","last_active":"2023-12-19T05:52:21.094504+0000","last_peered":"2023-12-19T05:52:21.094504+0000","last_clean":"2023-12-19T05:52:21.094504+0000","last_became_active":"2023-12-19T05:52:19.091914+0000","last_became_peered":"2023-12-19T05:52:19.091914+0000","last_unstale":"2023-12-19T05:52:21.094504+0000","last_undegraded":"2023-12-19T05:52:21.094504+0000","last_fullsized":"2023-12-19T05:52:21.094504+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.083488+0000","last_change":"2023-12-19T05:52:18.592179+0000","last_active":"2023-12-19T05:52:19.083488+0000","last_peered":"2023-12-19T05:52:19.083488+0000","last_clean":"2023-12-19T05:52:19.083488+0000","last_became_active":"2023-12-19T05:52:18.591948+0000","last_became_peered":"2023-12-19T05:52:18.591948+0000","last_unstale":"2023-12-19T05:52:19.083488+0000","last_undegraded":"2023-12-19T05:52:19.083488+0000","last_fullsized":"2023-12-19T05:52:19.083488+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:15.936760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093750+0000","last_change":"2023-12-19T05:52:19.106217+0000","last_active":"2023-12-19T05:52:21.093750+0000","last_peered":"2023-12-19T05:52:21.093750+0000","last_clean":"2023-12-19T05:52:21.093750+0000","last_became_active":"2023-12-19T05:52:19.106003+0000","last_became_peered":"2023-12-19T05:52:19.106003+0000","last_unstale":"2023-12-19T05:52:21.093750+0000","last_undegraded":"2023-12-19T05:52:21.093750+0000","last_fullsized":"2023-12-19T05:52:21.093750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:49.147559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092483+0000","last_change":"2023-12-19T05:52:18.594716+0000","last_active":"2023-12-19T05:52:19.092483+0000","last_peered":"2023-12-19T05:52:19.092483+0000","last_clean":"2023-12-19T05:52:19.092483+0000","last_became_active":"2023-12-19T05:52:18.594194+0000","last_became_peered":"2023-12-19T05:52:18.594194+0000","last_unstale":"2023-12-19T05:52:19.092483+0000","last_undegraded":"2023-12-19T05:52:19.092483+0000","last_fullsized":"2023-12-19T05:52:19.092483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:04.910129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094511+0000","last_change":"2023-12-19T05:52:19.103711+0000","last_active":"2023-12-19T05:52:21.094511+0000","last_peered":"2023-12-19T05:52:21.094511+0000","last_clean":"2023-12-19T05:52:21.094511+0000","last_became_active":"2023-12-19T05:52:19.102258+0000","last_became_peered":"2023-12-19T05:52:19.102258+0000","last_unstale":"2023-12-19T05:52:21.094511+0000","last_undegraded":"2023-12-19T05:52:21.094511+0000","last_fullsized":"2023-12-19T05:52:21.094511+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:06.286566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.086361+0000","last_change":"2023-12-19T05:52:18.594005+0000","last_active":"2023-12-19T05:52:19.086361+0000","last_peered":"2023-12-19T05:52:19.086361+0000","last_clean":"2023-12-19T05:52:19.086361+0000","last_became_active":"2023-12-19T05:52:18.588452+0000","last_became_peered":"2023-12-19T05:52:18.588452+0000","last_unstale":"2023-12-19T05:52:19.086361+0000","last_undegraded":"2023-12-19T05:52:19.086361+0000","last_fullsized":"2023-12-19T05:52:19.086361+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:23.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089845+0000","last_change":"2023-12-19T05:52:19.101788+0000","last_active":"2023-12-19T05:52:20.089845+0000","last_peered":"2023-12-19T05:52:20.089845+0000","last_clean":"2023-12-19T05:52:20.089845+0000","last_became_active":"2023-12-19T05:52:19.096632+0000","last_became_peered":"2023-12-19T05:52:19.096632+0000","last_unstale":"2023-12-19T05:52:20.089845+0000","last_undegraded":"2023-12-19T05:52:20.089845+0000","last_fullsized":"2023-12-19T05:52:20.089845+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:45.174625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.103995+0000","last_change":"2023-12-19T05:52:18.588640+0000","last_active":"2023-12-19T05:52:19.103995+0000","last_peered":"2023-12-19T05:52:19.103995+0000","last_clean":"2023-12-19T05:52:19.103995+0000","last_became_active":"2023-12-19T05:52:18.588363+0000","last_became_peered":"2023-12-19T05:52:18.588363+0000","last_unstale":"2023-12-19T05:52:19.103995+0000","last_undegraded":"2023-12-19T05:52:19.103995+0000","last_fullsized":"2023-12-19T05:52:19.103995+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.962413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702151+0000","last_change":"2023-12-19T05:52:19.096025+0000","last_active":"2023-12-19T05:52:21.702151+0000","last_peered":"2023-12-19T05:52:21.702151+0000","last_clean":"2023-12-19T05:52:21.702151+0000","last_became_active":"2023-12-19T05:52:19.095819+0000","last_became_peered":"2023-12-19T05:52:19.095819+0000","last_unstale":"2023-12-19T05:52:21.702151+0000","last_undegraded":"2023-12-19T05:52:21.702151+0000","last_fullsized":"2023-12-19T05:52:21.702151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091459+0000","last_change":"2023-12-19T05:52:18.594016+0000","last_active":"2023-12-19T05:52:19.091459+0000","last_peered":"2023-12-19T05:52:19.091459+0000","last_clean":"2023-12-19T05:52:19.091459+0000","last_became_active":"2023-12-19T05:52:18.590614+0000","last_became_peered":"2023-12-19T05:52:18.590614+0000","last_unstale":"2023-12-19T05:52:19.091459+0000","last_undegraded":"2023-12-19T05:52:19.091459+0000","last_fullsized":"2023-12-19T05:52:19.091459+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:44:16.892374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702050+0000","last_change":"2023-12-19T05:52:19.102810+0000","last_active":"2023-12-19T05:52:21.702050+0000","last_peered":"2023-12-19T05:52:21.702050+0000","last_clean":"2023-12-19T05:52:21.702050+0000","last_became_active":"2023-12-19T05:52:19.102561+0000","last_became_peered":"2023-12-19T05:52:19.102561+0000","last_unstale":"2023-12-19T05:52:21.702050+0000","last_undegraded":"2023-12-19T05:52:21.702050+0000","last_fullsized":"2023-12-19T05:52:21.702050+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.097581+0000","last_change":"2023-12-19T05:52:18.594780+0000","last_active":"2023-12-19T05:52:19.097581+0000","last_peered":"2023-12-19T05:52:19.097581+0000","last_clean":"2023-12-19T05:52:19.097581+0000","last_became_active":"2023-12-19T05:52:18.593894+0000","last_became_peered":"2023-12-19T05:52:18.593894+0000","last_unstale":"2023-12-19T05:52:19.097581+0000","last_undegraded":"2023-12-19T05:52:19.097581+0000","last_fullsized":"2023-12-19T05:52:19.097581+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:31:14.472551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702933+0000","last_change":"2023-12-19T05:52:19.108085+0000","last_active":"2023-12-19T05:52:21.702933+0000","last_peered":"2023-12-19T05:52:21.702933+0000","last_clean":"2023-12-19T05:52:21.702933+0000","last_became_active":"2023-12-19T05:52:19.106553+0000","last_became_peered":"2023-12-19T05:52:19.106553+0000","last_unstale":"2023-12-19T05:52:21.702933+0000","last_undegraded":"2023-12-19T05:52:21.702933+0000","last_fullsized":"2023-12-19T05:52:21.702933+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092579+0000","last_change":"2023-12-19T05:52:18.597203+0000","last_active":"2023-12-19T05:52:19.092579+0000","last_peered":"2023-12-19T05:52:19.092579+0000","last_clean":"2023-12-19T05:52:19.092579+0000","last_became_active":"2023-12-19T05:52:18.596410+0000","last_became_peered":"2023-12-19T05:52:18.596410+0000","last_unstale":"2023-12-19T05:52:19.092579+0000","last_undegraded":"2023-12-19T05:52:19.092579+0000","last_fullsized":"2023-12-19T05:52:19.092579+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:43.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702072+0000","last_change":"2023-12-19T05:52:19.095383+0000","last_active":"2023-12-19T05:52:21.702072+0000","last_peered":"2023-12-19T05:52:21.702072+0000","last_clean":"2023-12-19T05:52:21.702072+0000","last_became_active":"2023-12-19T05:52:19.095133+0000","last_became_peered":"2023-12-19T05:52:19.095133+0000","last_unstale":"2023-12-19T05:52:21.702072+0000","last_undegraded":"2023-12-19T05:52:21.702072+0000","last_fullsized":"2023-12-19T05:52:21.702072+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:46.263398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091409+0000","last_change":"2023-12-19T05:52:18.598616+0000","last_active":"2023-12-19T05:52:19.091409+0000","last_peered":"2023-12-19T05:52:19.091409+0000","last_clean":"2023-12-19T05:52:19.091409+0000","last_became_active":"2023-12-19T05:52:18.597992+0000","last_became_peered":"2023-12-19T05:52:18.597992+0000","last_unstale":"2023-12-19T05:52:19.091409+0000","last_undegraded":"2023-12-19T05:52:19.091409+0000","last_fullsized":"2023-12-19T05:52:19.091409+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:00:20.517433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":323,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.090875+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:52:19.090875+0000","last_peered":"2023-12-19T05:52:19.090875+0000","last_clean":"2023-12-19T05:52:19.090875+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:52:19.090875+0000","last_undegraded":"2023-12-19T05:52:19.090875+0000","last_fullsized":"2023-12-19T05:52:19.090875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910169,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.105,"15min":1.0920000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.56699999999999995},"max":{"1min":1.4830000000000001,"5min":1.635,"15min":6.4429999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.77400000000000002,"5min":0.77000000000000002,"15min":0.63300000000000001},"max":{"1min":1.444,"5min":1.768,"15min":3.976},"last":1.2290000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1799999999999999,"15min":1.157},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":6.399},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1699999999999999,"15min":1.1759999999999999},"min":{"1min":0.70199999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.577,"5min":1.74,"15min":4.25},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.222},"min":{"1min":0.96299999999999997,"5min":0.69799999999999995,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.042},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1519999999999999,"15min":1.1220000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.64500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":1.361}]},{"osd":3,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3080000000000001,"15min":1.272},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.622},"max":{"1min":1.595,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.3680000000000001},"min":{"1min":1.091,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.804,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":0.92000000000000004}]},{"osd":4,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":1.756,"5min":1.756,"15min":2.9980000000000002},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.2789999999999999,"15min":1.2969999999999999},"min":{"1min":0.96299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":6.4850000000000003},"last":1.2769999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.335,"15min":1.343},"min":{"1min":0.97499999999999998,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.774,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.331,"15min":1.3},"min":{"1min":0.94299999999999995,"5min":0.72599999999999998,"15min":0.55600000000000005},"max":{"1min":1.734,"5min":1.9970000000000001,"15min":3.1909999999999998},"last":1.6990000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.476,"15min":1.4359999999999999},"min":{"1min":1.2809999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.863,"5min":1.883,"15min":3.0920000000000001},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.4670000000000001,"15min":1.4770000000000001},"min":{"1min":1.0740000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":7.7519999999999998},"last":1.4630000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.4330000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.387},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":1.22}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":1.2809999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":1.304},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":1.462}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":1.504},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.542}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":1.617}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193671,"statfs":{"total":200000000,"available":198319129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":1.2869999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.724}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.421},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":1.1659999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":1.627}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":1.3520000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":1.778},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":1.659}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":1.829},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":1.923}]}]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.1120000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.026},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.165}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.393}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":1.256},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.3129999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.7829999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.3460000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.524}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.476}]}]},{"osd":3,"up_from":13,"seq":55834575013,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194246,"statfs":{"total":200000000,"available":198908583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.878},"min":{"1min":0.47499999999999998,"5min":0.42899999999999999,"15min":0.314},"max":{"1min":1.8129999999999999,"5min":1.8220000000000001,"15min":1.99},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.095,"5min":0.995,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.499,"15min":0.34999999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.72},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.93100000000000005},"min":{"1min":0.623,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.702},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1399999999999999,"15min":1.048},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.39100000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.3650000000000002},"last":0.85799999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.0760000000000001},"min":{"1min":0.69699999999999995,"5min":0.49399999999999999,"15min":0.45200000000000001},"max":{"1min":1.6519999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.196},{"interface":"front","average":{"1min":1.401,"5min":1.3109999999999999,"15min":1.2030000000000001},"min":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.45600000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.931},"last":0.94399999999999995}]},{"osd":4,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":1.0069999999999999,"5min":0.70199999999999996,"15min":0.51400000000000001},"max":{"1min":1.4710000000000001,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.171},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.351,"15min":1.3120000000000001},"min":{"1min":0.77200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":1.9359999999999999,"15min":2.5859999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.452,"15min":1.3779999999999999},"min":{"1min":0.82899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.052,"5min":2.052,"15min":4.8440000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.4510000000000001,"15min":1.3939999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.306}]},{"osd":6,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4970000000000001,"15min":1.4259999999999999},"min":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.71499999999999997},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3879999999999999,"15min":1.3480000000000001},"min":{"1min":0.84699999999999998,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.877,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.4399999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.458,"15min":1.417},"min":{"1min":0.89300000000000002,"5min":0.82599999999999996,"15min":0.55800000000000005},"max":{"1min":1.7350000000000001,"5min":2.093,"15min":2.1509999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.532,"15min":1.462},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.70099999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.8900000000000001},"last":1.595}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194247,"statfs":{"total":200000000,"available":198909587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.83699999999999997},"min":{"1min":0.65900000000000003,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":1.304,"5min":3.407,"15min":3.407},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.95199999999999996},"min":{"1min":0.69199999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6519999999999999,"5min":1.764,"15min":1.9450000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.147,"15min":1.107},"min":{"1min":0.90600000000000003,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.631,"5min":3.476,"15min":3.476},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.2509999999999999,"15min":1.2050000000000001},"min":{"1min":0.97599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.736,"5min":1.927,"15min":1.927},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.67400000000000004,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.3879999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.753},{"interface":"front","average":{"1min":1.29,"5min":1.246,"15min":1.179},"min":{"1min":0.95499999999999996,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.6080000000000001,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":1.1080000000000001,"5min":0.872,"15min":0.52700000000000002},"max":{"1min":1.8540000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":0.998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.306,"15min":1.2889999999999999},"min":{"1min":0.97699999999999998,"5min":0.76300000000000001,"15min":0.65100000000000002},"max":{"1min":1.6930000000000001,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.018}]},{"osd":5,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3919999999999999,"15min":1.349},"min":{"1min":1.216,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.77,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.3779999999999999,"15min":1.331},"min":{"1min":0.92300000000000004,"5min":0.82999999999999996,"15min":0.72699999999999998},"max":{"1min":1.9910000000000001,"5min":2.028,"15min":2.5960000000000001},"last":1.554}]},{"osd":6,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.373,"15min":1.327},"min":{"1min":1.0089999999999999,"5min":0.77400000000000002,"15min":0.67700000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.526,"15min":1.4430000000000001},"min":{"1min":1.181,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.921,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.075}]},{"osd":7,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5029999999999999,"15min":1.4750000000000001},"min":{"1min":1.153,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.8460000000000001,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.139},{"interface":"front","average":{"1min":1.494,"5min":1.5029999999999999,"15min":1.474},"min":{"1min":1.1399999999999999,"5min":0.81299999999999994,"15min":0.71499999999999997},"max":{"1min":1.9810000000000001,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.3859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1642,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193669,"statfs":{"total":200000000,"available":198318055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":1.052}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.141}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.8360000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.29}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.742},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.48}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.9319999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.615},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.5620000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.5209999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910099,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":14.063000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":1.7789999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":14.003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":3.8940000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":8.6560000000000006},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":14.725}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.8819999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":3.6989999999999998},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":8.5830000000000002}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":13.949999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":2.0190000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":2.2570000000000001},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":8.2260000000000009}]}]}],"pool_statfs":[]}} 2023-12-19T05:52:24.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:52:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.381+0000 7f830cc9e640 1 Processor -- start 2023-12-19T05:52:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.382+0000 7f830cc9e640 1 -- start start 2023-12-19T05:52:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.383+0000 7f830cc9e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 0x7f83080b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.383+0000 7f830cc9e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 0x7f830815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.383+0000 7f830cc9e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080d12d0 con 0x7f83080b7ea0 2023-12-19T05:52:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.383+0000 7f830cc9e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8308147210 con 0x7f8308146e30 2023-12-19T05:52:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.383+0000 7f830cc9e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080b8330 con 0x7f83080d0c60 2023-12-19T05:52:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f8306ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f83080b7ea0 0x7f83080d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49512/0 (socket says 172.21.15.49:49512) 2023-12-19T05:52:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f8306ffd640 1 -- 172.21.15.49:0/1285140614 learned_addr learned my addr 172.21.15.49:0/1285140614 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f83077fe640 1 --2- 172.21.15.49:0/1285140614 >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 0x7f83080b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f8307fff640 1 --2- 172.21.15.49:0/1285140614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 0x7f830815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442644215 0 0) 0x7f83080d12d0 con 0x7f83080b7ea0 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.384+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f4003520 con 0x7f83080b7ea0 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f8307fff640 1 -- 172.21.15.49:0/1285140614 >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 msgr2=0x7f83080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479639836 0 0) 0x7f82f4003520 con 0x7f83080b7ea0 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f8307fff640 1 --2- 172.21.15.49:0/1285140614 >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 0x7f83080b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f8307fff640 1 -- 172.21.15.49:0/1285140614 >> v1:172.21.15.49:6789/0 conn(0x7f83080b7ea0 legacy=0x7f83080d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f8307fff640 1 -- 172.21.15.49:0/1285140614 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080d15b0 con 0x7f83080d0c60 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.385+0000 7f83077fe640 1 --2- 172.21.15.49:0/1285140614 >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 0x7f83080b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:52:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.386+0000 7f8307fff640 1 --2- 172.21.15.49:0/1285140614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 0x7f830815d870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83000097a0 tx=0x7f830002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76fd65dc90610989 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.387+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0001670 con 0x7f83080d0c60 2023-12-19T05:52:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.387+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830002e050 con 0x7f83080d0c60 2023-12-19T05:52:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.387+0000 7f83067fc640 1 -- 172.21.15.49:0/1285140614 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300030730 con 0x7f83080d0c60 2023-12-19T05:52:24.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.387+0000 7f830cc9e640 1 -- 172.21.15.49:0/1285140614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 msgr2=0x7f830815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.387+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1285140614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 0x7f830815d870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83000097a0 tx=0x7f830002b710 comp rx=0 tx=0).stop 2023-12-19T05:52:24.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 -- 172.21.15.49:0/1285140614 shutdown_connections 2023-12-19T05:52:24.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1285140614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080d0c60 0x7f830815d870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1285140614 >> v2:172.21.15.115:3300/0 conn(0x7f8308146e30 0x7f83080b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 -- 172.21.15.49:0/1285140614 >> 172.21.15.49:0/1285140614 conn(0x7f83080b2990 msgr2=0x7f83080b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 -- 172.21.15.49:0/1285140614 shutdown_connections 2023-12-19T05:52:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.388+0000 7f830cc9e640 1 -- 172.21.15.49:0/1285140614 wait complete. 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.390+0000 7f830cc9e640 1 Processor -- start 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.390+0000 7f830cc9e640 1 -- start start 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 0x7f830813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 0x7f83081e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830813b140 con 0x7f8308146e30 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081e6450 con 0x7f83080d0c60 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f830cc9e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83081e5840 con 0x7f83080b7ea0 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f8307fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f8307fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38710/0 (socket says 172.21.15.49:38710) 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.391+0000 7f8307fff640 1 -- 172.21.15.49:0/1370023156 learned_addr learned my addr 172.21.15.49:0/1370023156 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f83077fe640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 0x7f830813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8306ffd640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 0x7f83081e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 -- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 msgr2=0x7f830813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 0x7f830813ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 -- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 msgr2=0x7f83081e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 0x7f83081e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 -- 172.21.15.49:0/1370023156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009a70 con 0x7f8308146e30 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8306ffd640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 0x7f83081e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f83077fe640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 0x7f830813ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.392+0000 7f8307fff640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f83000098c0 tx=0x7f83000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.393+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830003b810 con 0x7f8308146e30 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.393+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830003b970 con 0x7f8308146e30 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.393+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8300009400 con 0x7f8308146e30 2023-12-19T05:52:24.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.393+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830003bce0 con 0x7f8308146e30 2023-12-19T05:52:24.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.393+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83081e5e00 con 0x7f8308146e30 2023-12-19T05:52:24.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.394+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83081e65e0 con 0x7f8308146e30 2023-12-19T05:52:24.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.395+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8300039040 con 0x7f8308146e30 2023-12-19T05:52:24.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.397+0000 7f82fffff640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 0x7f82e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.397+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83000a9ff0 con 0x7f8308146e30 2023-12-19T05:52:24.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.397+0000 7f83077fe640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 0x7f82e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.398+0000 7f83077fe640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 0x7f82e806c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82f8007640 tx=0x7f82f800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.401+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f83000dcc80 con 0x7f8308146e30 2023-12-19T05:52:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.595+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83080d10b0 con 0x7f82e806a430 2023-12-19T05:52:24.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.618+0000 7f82fffff640 1 -- 172.21.15.49:0/1370023156 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283086 (secure 0 0 0) 0x7f82f800f050 con 0x7f82e806a430 2023-12-19T05:52:24.623 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.623+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 msgr2=0x7f82e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.623+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 0x7f82e806c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82f8007640 tx=0x7f82f800b040 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 msgr2=0x7f83081e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f83000098c0 tx=0x7f83000046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 shutdown_connections 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f82e806a430 0x7f82e806c8f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8308146e30 0x7f83081e7750 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83080d0c60 0x7f83081e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 --2- 172.21.15.49:0/1370023156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f83080b7ea0 0x7f830813ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 >> 172.21.15.49:0/1370023156 conn(0x7f83080b2990 msgr2=0x7f83081e4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 shutdown_connections 2023-12-19T05:52:24.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.624+0000 7f830cc9e640 1 -- 172.21.15.49:0/1370023156 wait complete. 2023-12-19T05:52:24.647 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2023-12-19T05:52:22.789225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9671,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552828,"statfs":{"total":1600000000,"available":1590095892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.229272"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701833+0000","last_change":"2023-12-19T05:52:19.100498+0000","last_active":"2023-12-19T05:52:21.701833+0000","last_peered":"2023-12-19T05:52:21.701833+0000","last_clean":"2023-12-19T05:52:21.701833+0000","last_became_active":"2023-12-19T05:52:19.099857+0000","last_became_peered":"2023-12-19T05:52:19.099857+0000","last_unstale":"2023-12-19T05:52:21.701833+0000","last_undegraded":"2023-12-19T05:52:21.701833+0000","last_fullsized":"2023-12-19T05:52:21.701833+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701617+0000","last_change":"2023-12-19T05:52:19.102075+0000","last_active":"2023-12-19T05:52:21.701617+0000","last_peered":"2023-12-19T05:52:21.701617+0000","last_clean":"2023-12-19T05:52:21.701617+0000","last_became_active":"2023-12-19T05:52:19.101830+0000","last_became_peered":"2023-12-19T05:52:19.101830+0000","last_unstale":"2023-12-19T05:52:21.701617+0000","last_undegraded":"2023-12-19T05:52:21.701617+0000","last_fullsized":"2023-12-19T05:52:21.701617+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:46.263398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702492+0000","last_change":"2023-12-19T05:52:19.107332+0000","last_active":"2023-12-19T05:52:21.702492+0000","last_peered":"2023-12-19T05:52:21.702492+0000","last_clean":"2023-12-19T05:52:21.702492+0000","last_became_active":"2023-12-19T05:52:19.105965+0000","last_became_peered":"2023-12-19T05:52:19.105965+0000","last_unstale":"2023-12-19T05:52:21.702492+0000","last_undegraded":"2023-12-19T05:52:21.702492+0000","last_fullsized":"2023-12-19T05:52:21.702492+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:13:24.687837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093897+0000","last_change":"2023-12-19T05:52:19.100418+0000","last_active":"2023-12-19T05:52:21.093897+0000","last_peered":"2023-12-19T05:52:21.093897+0000","last_clean":"2023-12-19T05:52:21.093897+0000","last_became_active":"2023-12-19T05:52:19.099793+0000","last_became_peered":"2023-12-19T05:52:19.099793+0000","last_unstale":"2023-12-19T05:52:21.093897+0000","last_undegraded":"2023-12-19T05:52:21.093897+0000","last_fullsized":"2023-12-19T05:52:21.093897+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:39:11.956833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844993+0000","last_change":"2023-12-19T05:52:19.108277+0000","last_active":"2023-12-19T05:52:20.844993+0000","last_peered":"2023-12-19T05:52:20.844993+0000","last_clean":"2023-12-19T05:52:20.844993+0000","last_became_active":"2023-12-19T05:52:19.107403+0000","last_became_peered":"2023-12-19T05:52:19.107403+0000","last_unstale":"2023-12-19T05:52:20.844993+0000","last_undegraded":"2023-12-19T05:52:20.844993+0000","last_fullsized":"2023-12-19T05:52:20.844993+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:56.981760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089947+0000","last_change":"2023-12-19T05:52:19.105143+0000","last_active":"2023-12-19T05:52:20.089947+0000","last_peered":"2023-12-19T05:52:20.089947+0000","last_clean":"2023-12-19T05:52:20.089947+0000","last_became_active":"2023-12-19T05:52:19.104599+0000","last_became_peered":"2023-12-19T05:52:19.104599+0000","last_unstale":"2023-12-19T05:52:20.089947+0000","last_undegraded":"2023-12-19T05:52:20.089947+0000","last_fullsized":"2023-12-19T05:52:20.089947+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:23.272220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702220+0000","last_change":"2023-12-19T05:52:19.105165+0000","last_active":"2023-12-19T05:52:21.702220+0000","last_peered":"2023-12-19T05:52:21.702220+0000","last_clean":"2023-12-19T05:52:21.702220+0000","last_became_active":"2023-12-19T05:52:19.104890+0000","last_became_peered":"2023-12-19T05:52:19.104890+0000","last_unstale":"2023-12-19T05:52:21.702220+0000","last_undegraded":"2023-12-19T05:52:21.702220+0000","last_fullsized":"2023-12-19T05:52:21.702220+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702173+0000","last_change":"2023-12-19T05:52:19.090570+0000","last_active":"2023-12-19T05:52:21.702173+0000","last_peered":"2023-12-19T05:52:21.702173+0000","last_clean":"2023-12-19T05:52:21.702173+0000","last_became_active":"2023-12-19T05:52:19.090355+0000","last_became_peered":"2023-12-19T05:52:19.090355+0000","last_unstale":"2023-12-19T05:52:21.702173+0000","last_undegraded":"2023-12-19T05:52:21.702173+0000","last_fullsized":"2023-12-19T05:52:21.702173+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:11.717178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702441+0000","last_change":"2023-12-19T05:52:19.099688+0000","last_active":"2023-12-19T05:52:21.702441+0000","last_peered":"2023-12-19T05:52:21.702441+0000","last_clean":"2023-12-19T05:52:21.702441+0000","last_became_active":"2023-12-19T05:52:19.099418+0000","last_became_peered":"2023-12-19T05:52:19.099418+0000","last_unstale":"2023-12-19T05:52:21.702441+0000","last_undegraded":"2023-12-19T05:52:21.702441+0000","last_fullsized":"2023-12-19T05:52:21.702441+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:40.363977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703640+0000","last_change":"2023-12-19T05:52:19.098931+0000","last_active":"2023-12-19T05:52:21.703640+0000","last_peered":"2023-12-19T05:52:21.703640+0000","last_clean":"2023-12-19T05:52:21.703640+0000","last_became_active":"2023-12-19T05:52:19.098583+0000","last_became_peered":"2023-12-19T05:52:19.098583+0000","last_unstale":"2023-12-19T05:52:21.703640+0000","last_undegraded":"2023-12-19T05:52:21.703640+0000","last_fullsized":"2023-12-19T05:52:21.703640+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:57.108650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844605+0000","last_change":"2023-12-19T05:52:19.107012+0000","last_active":"2023-12-19T05:52:20.844605+0000","last_peered":"2023-12-19T05:52:20.844605+0000","last_clean":"2023-12-19T05:52:20.844605+0000","last_became_active":"2023-12-19T05:52:19.106733+0000","last_became_peered":"2023-12-19T05:52:19.106733+0000","last_unstale":"2023-12-19T05:52:20.844605+0000","last_undegraded":"2023-12-19T05:52:20.844605+0000","last_fullsized":"2023-12-19T05:52:20.844605+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:01:24.456722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084565+0000","last_change":"2023-12-19T05:52:19.096494+0000","last_active":"2023-12-19T05:52:20.084565+0000","last_peered":"2023-12-19T05:52:20.084565+0000","last_clean":"2023-12-19T05:52:20.084565+0000","last_became_active":"2023-12-19T05:52:19.096183+0000","last_became_peered":"2023-12-19T05:52:19.096183+0000","last_unstale":"2023-12-19T05:52:20.084565+0000","last_undegraded":"2023-12-19T05:52:20.084565+0000","last_fullsized":"2023-12-19T05:52:20.084565+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:36:12.230742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084486+0000","last_change":"2023-12-19T05:52:19.089730+0000","last_active":"2023-12-19T05:52:20.084486+0000","last_peered":"2023-12-19T05:52:20.084486+0000","last_clean":"2023-12-19T05:52:20.084486+0000","last_became_active":"2023-12-19T05:52:19.089373+0000","last_became_peered":"2023-12-19T05:52:19.089373+0000","last_unstale":"2023-12-19T05:52:20.084486+0000","last_undegraded":"2023-12-19T05:52:20.084486+0000","last_fullsized":"2023-12-19T05:52:20.084486+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:18:03.084016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702619+0000","last_change":"2023-12-19T05:52:19.101233+0000","last_active":"2023-12-19T05:52:21.702619+0000","last_peered":"2023-12-19T05:52:21.702619+0000","last_clean":"2023-12-19T05:52:21.702619+0000","last_became_active":"2023-12-19T05:52:19.100840+0000","last_became_peered":"2023-12-19T05:52:19.100840+0000","last_unstale":"2023-12-19T05:52:21.702619+0000","last_undegraded":"2023-12-19T05:52:21.702619+0000","last_fullsized":"2023-12-19T05:52:21.702619+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:12.842228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703865+0000","last_change":"2023-12-19T05:52:19.093546+0000","last_active":"2023-12-19T05:52:21.703865+0000","last_peered":"2023-12-19T05:52:21.703865+0000","last_clean":"2023-12-19T05:52:21.703865+0000","last_became_active":"2023-12-19T05:52:19.092265+0000","last_became_peered":"2023-12-19T05:52:19.092265+0000","last_unstale":"2023-12-19T05:52:21.703865+0000","last_undegraded":"2023-12-19T05:52:21.703865+0000","last_fullsized":"2023-12-19T05:52:21.703865+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:24.312058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702035+0000","last_change":"2023-12-19T05:52:19.099249+0000","last_active":"2023-12-19T05:52:21.702035+0000","last_peered":"2023-12-19T05:52:21.702035+0000","last_clean":"2023-12-19T05:52:21.702035+0000","last_became_active":"2023-12-19T05:52:19.098770+0000","last_became_peered":"2023-12-19T05:52:19.098770+0000","last_unstale":"2023-12-19T05:52:21.702035+0000","last_undegraded":"2023-12-19T05:52:21.702035+0000","last_fullsized":"2023-12-19T05:52:21.702035+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:05.581605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090263+0000","last_change":"2023-12-19T05:52:19.102294+0000","last_active":"2023-12-19T05:52:20.090263+0000","last_peered":"2023-12-19T05:52:20.090263+0000","last_clean":"2023-12-19T05:52:20.090263+0000","last_became_active":"2023-12-19T05:52:19.102058+0000","last_became_peered":"2023-12-19T05:52:19.102058+0000","last_unstale":"2023-12-19T05:52:20.090263+0000","last_undegraded":"2023-12-19T05:52:20.090263+0000","last_fullsized":"2023-12-19T05:52:20.090263+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:38:27.474581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093457+0000","last_change":"2023-12-19T05:52:19.095162+0000","last_active":"2023-12-19T05:52:21.093457+0000","last_peered":"2023-12-19T05:52:21.093457+0000","last_clean":"2023-12-19T05:52:21.093457+0000","last_became_active":"2023-12-19T05:52:19.094944+0000","last_became_peered":"2023-12-19T05:52:19.094944+0000","last_unstale":"2023-12-19T05:52:21.093457+0000","last_undegraded":"2023-12-19T05:52:21.093457+0000","last_fullsized":"2023-12-19T05:52:21.093457+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702527+0000","last_change":"2023-12-19T05:52:19.099109+0000","last_active":"2023-12-19T05:52:21.702527+0000","last_peered":"2023-12-19T05:52:21.702527+0000","last_clean":"2023-12-19T05:52:21.702527+0000","last_became_active":"2023-12-19T05:52:19.098807+0000","last_became_peered":"2023-12-19T05:52:19.098807+0000","last_unstale":"2023-12-19T05:52:21.702527+0000","last_undegraded":"2023-12-19T05:52:21.702527+0000","last_fullsized":"2023-12-19T05:52:21.702527+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.084878+0000","last_change":"2023-12-19T05:52:19.105732+0000","last_active":"2023-12-19T05:52:20.084878+0000","last_peered":"2023-12-19T05:52:20.084878+0000","last_clean":"2023-12-19T05:52:20.084878+0000","last_became_active":"2023-12-19T05:52:19.105512+0000","last_became_peered":"2023-12-19T05:52:19.105512+0000","last_unstale":"2023-12-19T05:52:20.084878+0000","last_undegraded":"2023-12-19T05:52:20.084878+0000","last_fullsized":"2023-12-19T05:52:20.084878+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:12:03.334713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090177+0000","last_change":"2023-12-19T05:52:19.111142+0000","last_active":"2023-12-19T05:52:20.090177+0000","last_peered":"2023-12-19T05:52:20.090177+0000","last_clean":"2023-12-19T05:52:20.090177+0000","last_became_active":"2023-12-19T05:52:19.110941+0000","last_became_peered":"2023-12-19T05:52:19.110941+0000","last_unstale":"2023-12-19T05:52:20.090177+0000","last_undegraded":"2023-12-19T05:52:20.090177+0000","last_fullsized":"2023-12-19T05:52:20.090177+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:44.364054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.843853+0000","last_change":"2023-12-19T05:52:19.100653+0000","last_active":"2023-12-19T05:52:20.843853+0000","last_peered":"2023-12-19T05:52:20.843853+0000","last_clean":"2023-12-19T05:52:20.843853+0000","last_became_active":"2023-12-19T05:52:19.099988+0000","last_became_peered":"2023-12-19T05:52:19.099988+0000","last_unstale":"2023-12-19T05:52:20.843853+0000","last_undegraded":"2023-12-19T05:52:20.843853+0000","last_fullsized":"2023-12-19T05:52:20.843853+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:28:47.405930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090571+0000","last_change":"2023-12-19T05:52:19.093409+0000","last_active":"2023-12-19T05:52:20.090571+0000","last_peered":"2023-12-19T05:52:20.090571+0000","last_clean":"2023-12-19T05:52:20.090571+0000","last_became_active":"2023-12-19T05:52:19.092976+0000","last_became_peered":"2023-12-19T05:52:19.092976+0000","last_unstale":"2023-12-19T05:52:20.090571+0000","last_undegraded":"2023-12-19T05:52:20.090571+0000","last_fullsized":"2023-12-19T05:52:20.090571+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:21:24.128734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844175+0000","last_change":"2023-12-19T05:52:19.101416+0000","last_active":"2023-12-19T05:52:20.844175+0000","last_peered":"2023-12-19T05:52:20.844175+0000","last_clean":"2023-12-19T05:52:20.844175+0000","last_became_active":"2023-12-19T05:52:19.101181+0000","last_became_peered":"2023-12-19T05:52:19.101181+0000","last_unstale":"2023-12-19T05:52:20.844175+0000","last_undegraded":"2023-12-19T05:52:20.844175+0000","last_fullsized":"2023-12-19T05:52:20.844175+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:19:25.128907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.845219+0000","last_change":"2023-12-19T05:52:19.105889+0000","last_active":"2023-12-19T05:52:20.845219+0000","last_peered":"2023-12-19T05:52:20.845219+0000","last_clean":"2023-12-19T05:52:20.845219+0000","last_became_active":"2023-12-19T05:52:19.098444+0000","last_became_peered":"2023-12-19T05:52:19.098444+0000","last_unstale":"2023-12-19T05:52:20.845219+0000","last_undegraded":"2023-12-19T05:52:20.845219+0000","last_fullsized":"2023-12-19T05:52:20.845219+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:47.140342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091305+0000","last_change":"2023-12-19T05:52:19.101119+0000","last_active":"2023-12-19T05:52:20.091305+0000","last_peered":"2023-12-19T05:52:20.091305+0000","last_clean":"2023-12-19T05:52:20.091305+0000","last_became_active":"2023-12-19T05:52:19.100719+0000","last_became_peered":"2023-12-19T05:52:19.100719+0000","last_unstale":"2023-12-19T05:52:20.091305+0000","last_undegraded":"2023-12-19T05:52:20.091305+0000","last_fullsized":"2023-12-19T05:52:20.091305+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:53:31.348227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.844146+0000","last_change":"2023-12-19T05:52:19.104035+0000","last_active":"2023-12-19T05:52:20.844146+0000","last_peered":"2023-12-19T05:52:20.844146+0000","last_clean":"2023-12-19T05:52:20.844146+0000","last_became_active":"2023-12-19T05:52:19.100397+0000","last_became_peered":"2023-12-19T05:52:19.100397+0000","last_unstale":"2023-12-19T05:52:20.844146+0000","last_undegraded":"2023-12-19T05:52:20.844146+0000","last_fullsized":"2023-12-19T05:52:20.844146+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:47:14.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702104+0000","last_change":"2023-12-19T05:52:19.099344+0000","last_active":"2023-12-19T05:52:21.702104+0000","last_peered":"2023-12-19T05:52:21.702104+0000","last_clean":"2023-12-19T05:52:21.702104+0000","last_became_active":"2023-12-19T05:52:19.098940+0000","last_became_peered":"2023-12-19T05:52:19.098940+0000","last_unstale":"2023-12-19T05:52:21.702104+0000","last_undegraded":"2023-12-19T05:52:21.702104+0000","last_fullsized":"2023-12-19T05:52:21.702104+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701705+0000","last_change":"2023-12-19T05:52:19.104882+0000","last_active":"2023-12-19T05:52:21.701705+0000","last_peered":"2023-12-19T05:52:21.701705+0000","last_clean":"2023-12-19T05:52:21.701705+0000","last_became_active":"2023-12-19T05:52:19.104331+0000","last_became_peered":"2023-12-19T05:52:19.104331+0000","last_unstale":"2023-12-19T05:52:21.701705+0000","last_undegraded":"2023-12-19T05:52:21.701705+0000","last_fullsized":"2023-12-19T05:52:21.701705+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:19.413815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.704132+0000","last_change":"2023-12-19T05:52:19.102031+0000","last_active":"2023-12-19T05:52:21.704132+0000","last_peered":"2023-12-19T05:52:21.704132+0000","last_clean":"2023-12-19T05:52:21.704132+0000","last_became_active":"2023-12-19T05:52:19.101722+0000","last_became_peered":"2023-12-19T05:52:19.101722+0000","last_unstale":"2023-12-19T05:52:21.704132+0000","last_undegraded":"2023-12-19T05:52:21.704132+0000","last_fullsized":"2023-12-19T05:52:21.704132+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:25.691691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701950+0000","last_change":"2023-12-19T05:52:19.107894+0000","last_active":"2023-12-19T05:52:21.701950+0000","last_peered":"2023-12-19T05:52:21.701950+0000","last_clean":"2023-12-19T05:52:21.701950+0000","last_became_active":"2023-12-19T05:52:19.107637+0000","last_became_peered":"2023-12-19T05:52:19.107637+0000","last_unstale":"2023-12-19T05:52:21.701950+0000","last_undegraded":"2023-12-19T05:52:21.701950+0000","last_fullsized":"2023-12-19T05:52:21.701950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089331+0000","last_change":"2023-12-19T05:52:19.096850+0000","last_active":"2023-12-19T05:52:20.089331+0000","last_peered":"2023-12-19T05:52:20.089331+0000","last_clean":"2023-12-19T05:52:20.089331+0000","last_became_active":"2023-12-19T05:52:19.095947+0000","last_became_peered":"2023-12-19T05:52:19.095947+0000","last_unstale":"2023-12-19T05:52:20.089331+0000","last_undegraded":"2023-12-19T05:52:20.089331+0000","last_fullsized":"2023-12-19T05:52:20.089331+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:38:16.859514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094134+0000","last_change":"2023-12-19T05:52:19.100284+0000","last_active":"2023-12-19T05:52:21.094134+0000","last_peered":"2023-12-19T05:52:21.094134+0000","last_clean":"2023-12-19T05:52:21.094134+0000","last_became_active":"2023-12-19T05:52:19.099417+0000","last_became_peered":"2023-12-19T05:52:19.099417+0000","last_unstale":"2023-12-19T05:52:21.094134+0000","last_undegraded":"2023-12-19T05:52:21.094134+0000","last_fullsized":"2023-12-19T05:52:21.094134+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:08:39.489921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"192'4","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108576+0000","last_change":"2023-12-19T05:52:18.596086+0000","last_active":"2023-12-19T05:52:19.108576+0000","last_peered":"2023-12-19T05:52:19.108576+0000","last_clean":"2023-12-19T05:52:19.108576+0000","last_became_active":"2023-12-19T05:52:18.595180+0000","last_became_peered":"2023-12-19T05:52:18.595180+0000","last_unstale":"2023-12-19T05:52:19.108576+0000","last_undegraded":"2023-12-19T05:52:19.108576+0000","last_fullsized":"2023-12-19T05:52:19.108576+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:38.820617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701968+0000","last_change":"2023-12-19T05:52:19.105627+0000","last_active":"2023-12-19T05:52:21.701968+0000","last_peered":"2023-12-19T05:52:21.701968+0000","last_clean":"2023-12-19T05:52:21.701968+0000","last_became_active":"2023-12-19T05:52:19.103316+0000","last_became_peered":"2023-12-19T05:52:19.103316+0000","last_unstale":"2023-12-19T05:52:21.701968+0000","last_undegraded":"2023-12-19T05:52:21.701968+0000","last_fullsized":"2023-12-19T05:52:21.701968+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.104599+0000","last_change":"2023-12-19T05:52:18.576203+0000","last_active":"2023-12-19T05:52:19.104599+0000","last_peered":"2023-12-19T05:52:19.104599+0000","last_clean":"2023-12-19T05:52:19.104599+0000","last_became_active":"2023-12-19T05:52:18.575383+0000","last_became_peered":"2023-12-19T05:52:18.575383+0000","last_unstale":"2023-12-19T05:52:19.104599+0000","last_undegraded":"2023-12-19T05:52:19.104599+0000","last_fullsized":"2023-12-19T05:52:19.104599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:53.093740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090389+0000","last_change":"2023-12-19T05:52:19.106303+0000","last_active":"2023-12-19T05:52:20.090389+0000","last_peered":"2023-12-19T05:52:20.090389+0000","last_clean":"2023-12-19T05:52:20.090389+0000","last_became_active":"2023-12-19T05:52:19.104988+0000","last_became_peered":"2023-12-19T05:52:19.104988+0000","last_unstale":"2023-12-19T05:52:20.090389+0000","last_undegraded":"2023-12-19T05:52:20.090389+0000","last_fullsized":"2023-12-19T05:52:20.090389+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:56:02.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.111973+0000","last_change":"2023-12-19T05:52:18.599310+0000","last_active":"2023-12-19T05:52:19.111973+0000","last_peered":"2023-12-19T05:52:19.111973+0000","last_clean":"2023-12-19T05:52:19.111973+0000","last_became_active":"2023-12-19T05:52:18.599016+0000","last_became_peered":"2023-12-19T05:52:18.599016+0000","last_unstale":"2023-12-19T05:52:19.111973+0000","last_undegraded":"2023-12-19T05:52:19.111973+0000","last_fullsized":"2023-12-19T05:52:19.111973+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:46.150853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.704354+0000","last_change":"2023-12-19T05:52:19.098239+0000","last_active":"2023-12-19T05:52:21.704354+0000","last_peered":"2023-12-19T05:52:21.704354+0000","last_clean":"2023-12-19T05:52:21.704354+0000","last_became_active":"2023-12-19T05:52:19.092714+0000","last_became_peered":"2023-12-19T05:52:19.092714+0000","last_unstale":"2023-12-19T05:52:21.704354+0000","last_undegraded":"2023-12-19T05:52:21.704354+0000","last_fullsized":"2023-12-19T05:52:21.704354+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:11.124114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108239+0000","last_change":"2023-12-19T05:52:18.589340+0000","last_active":"2023-12-19T05:52:19.108239+0000","last_peered":"2023-12-19T05:52:19.108239+0000","last_clean":"2023-12-19T05:52:19.108239+0000","last_became_active":"2023-12-19T05:52:18.588835+0000","last_became_peered":"2023-12-19T05:52:18.588835+0000","last_unstale":"2023-12-19T05:52:19.108239+0000","last_undegraded":"2023-12-19T05:52:19.108239+0000","last_fullsized":"2023-12-19T05:52:19.108239+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:38:10.109404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093788+0000","last_change":"2023-12-19T05:52:19.100236+0000","last_active":"2023-12-19T05:52:21.093788+0000","last_peered":"2023-12-19T05:52:21.093788+0000","last_clean":"2023-12-19T05:52:21.093788+0000","last_became_active":"2023-12-19T05:52:19.100001+0000","last_became_peered":"2023-12-19T05:52:19.100001+0000","last_unstale":"2023-12-19T05:52:21.093788+0000","last_undegraded":"2023-12-19T05:52:21.093788+0000","last_fullsized":"2023-12-19T05:52:21.093788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:52.626234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.104796+0000","last_change":"2023-12-19T05:52:18.591945+0000","last_active":"2023-12-19T05:52:19.104796+0000","last_peered":"2023-12-19T05:52:19.104796+0000","last_clean":"2023-12-19T05:52:19.104796+0000","last_became_active":"2023-12-19T05:52:18.591548+0000","last_became_peered":"2023-12-19T05:52:18.591548+0000","last_unstale":"2023-12-19T05:52:19.104796+0000","last_undegraded":"2023-12-19T05:52:19.104796+0000","last_fullsized":"2023-12-19T05:52:19.104796+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:44:16.892374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089625+0000","last_change":"2023-12-19T05:52:19.101601+0000","last_active":"2023-12-19T05:52:20.089625+0000","last_peered":"2023-12-19T05:52:20.089625+0000","last_clean":"2023-12-19T05:52:20.089625+0000","last_became_active":"2023-12-19T05:52:19.096311+0000","last_became_peered":"2023-12-19T05:52:19.096311+0000","last_unstale":"2023-12-19T05:52:20.089625+0000","last_undegraded":"2023-12-19T05:52:20.089625+0000","last_fullsized":"2023-12-19T05:52:20.089625+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:54.108451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.107880+0000","last_change":"2023-12-19T05:52:18.597591+0000","last_active":"2023-12-19T05:52:19.107880+0000","last_peered":"2023-12-19T05:52:19.107880+0000","last_clean":"2023-12-19T05:52:19.107880+0000","last_became_active":"2023-12-19T05:52:18.595758+0000","last_became_peered":"2023-12-19T05:52:18.595758+0000","last_unstale":"2023-12-19T05:52:19.107880+0000","last_undegraded":"2023-12-19T05:52:19.107880+0000","last_fullsized":"2023-12-19T05:52:19.107880+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:03:24.676980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.092647+0000","last_change":"2023-12-19T05:52:19.102280+0000","last_active":"2023-12-19T05:52:20.092647+0000","last_peered":"2023-12-19T05:52:20.092647+0000","last_clean":"2023-12-19T05:52:20.092647+0000","last_became_active":"2023-12-19T05:52:19.101694+0000","last_became_peered":"2023-12-19T05:52:19.101694+0000","last_unstale":"2023-12-19T05:52:20.092647+0000","last_undegraded":"2023-12-19T05:52:20.092647+0000","last_fullsized":"2023-12-19T05:52:20.092647+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092390+0000","last_change":"2023-12-19T05:52:18.596653+0000","last_active":"2023-12-19T05:52:19.092390+0000","last_peered":"2023-12-19T05:52:19.092390+0000","last_clean":"2023-12-19T05:52:19.092390+0000","last_became_active":"2023-12-19T05:52:18.595475+0000","last_became_peered":"2023-12-19T05:52:18.595475+0000","last_unstale":"2023-12-19T05:52:19.092390+0000","last_undegraded":"2023-12-19T05:52:19.092390+0000","last_fullsized":"2023-12-19T05:52:19.092390+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:18.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094269+0000","last_change":"2023-12-19T05:52:19.100047+0000","last_active":"2023-12-19T05:52:21.094269+0000","last_peered":"2023-12-19T05:52:21.094269+0000","last_clean":"2023-12-19T05:52:21.094269+0000","last_became_active":"2023-12-19T05:52:19.097222+0000","last_became_peered":"2023-12-19T05:52:19.097222+0000","last_unstale":"2023-12-19T05:52:21.094269+0000","last_undegraded":"2023-12-19T05:52:21.094269+0000","last_fullsized":"2023-12-19T05:52:21.094269+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:35:53.807577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.086249+0000","last_change":"2023-12-19T05:52:18.591116+0000","last_active":"2023-12-19T05:52:19.086249+0000","last_peered":"2023-12-19T05:52:19.086249+0000","last_clean":"2023-12-19T05:52:19.086249+0000","last_became_active":"2023-12-19T05:52:18.587413+0000","last_became_peered":"2023-12-19T05:52:18.587413+0000","last_unstale":"2023-12-19T05:52:19.086249+0000","last_undegraded":"2023-12-19T05:52:19.086249+0000","last_fullsized":"2023-12-19T05:52:19.086249+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:56.093939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702188+0000","last_change":"2023-12-19T05:52:19.106243+0000","last_active":"2023-12-19T05:52:21.702188+0000","last_peered":"2023-12-19T05:52:21.702188+0000","last_clean":"2023-12-19T05:52:21.702188+0000","last_became_active":"2023-12-19T05:52:19.105975+0000","last_became_peered":"2023-12-19T05:52:19.105975+0000","last_unstale":"2023-12-19T05:52:21.702188+0000","last_undegraded":"2023-12-19T05:52:21.702188+0000","last_fullsized":"2023-12-19T05:52:21.702188+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092164+0000","last_change":"2023-12-19T05:52:18.595002+0000","last_active":"2023-12-19T05:52:19.092164+0000","last_peered":"2023-12-19T05:52:19.092164+0000","last_clean":"2023-12-19T05:52:19.092164+0000","last_became_active":"2023-12-19T05:52:18.594726+0000","last_became_peered":"2023-12-19T05:52:18.594726+0000","last_unstale":"2023-12-19T05:52:19.092164+0000","last_undegraded":"2023-12-19T05:52:19.092164+0000","last_fullsized":"2023-12-19T05:52:19.092164+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:16.949526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.701745+0000","last_change":"2023-12-19T05:52:19.107145+0000","last_active":"2023-12-19T05:52:21.701745+0000","last_peered":"2023-12-19T05:52:21.701745+0000","last_clean":"2023-12-19T05:52:21.701745+0000","last_became_active":"2023-12-19T05:52:19.106866+0000","last_became_peered":"2023-12-19T05:52:19.106866+0000","last_unstale":"2023-12-19T05:52:21.701745+0000","last_undegraded":"2023-12-19T05:52:21.701745+0000","last_fullsized":"2023-12-19T05:52:21.701745+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.112566+0000","last_change":"2023-12-19T05:52:18.593681+0000","last_active":"2023-12-19T05:52:19.112566+0000","last_peered":"2023-12-19T05:52:19.112566+0000","last_clean":"2023-12-19T05:52:19.112566+0000","last_became_active":"2023-12-19T05:52:18.593124+0000","last_became_peered":"2023-12-19T05:52:18.593124+0000","last_unstale":"2023-12-19T05:52:19.112566+0000","last_undegraded":"2023-12-19T05:52:19.112566+0000","last_fullsized":"2023-12-19T05:52:19.112566+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:42.978868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702245+0000","last_change":"2023-12-19T05:52:19.107662+0000","last_active":"2023-12-19T05:52:21.702245+0000","last_peered":"2023-12-19T05:52:21.702245+0000","last_clean":"2023-12-19T05:52:21.702245+0000","last_became_active":"2023-12-19T05:52:19.106271+0000","last_became_peered":"2023-12-19T05:52:19.106271+0000","last_unstale":"2023-12-19T05:52:21.702245+0000","last_undegraded":"2023-12-19T05:52:21.702245+0000","last_fullsized":"2023-12-19T05:52:21.702245+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:02:05.581605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"192'6","reported_seq":17,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.114443+0000","last_change":"2023-12-19T05:52:18.589063+0000","last_active":"2023-12-19T05:52:19.114443+0000","last_peered":"2023-12-19T05:52:19.114443+0000","last_clean":"2023-12-19T05:52:19.114443+0000","last_became_active":"2023-12-19T05:52:18.588666+0000","last_became_peered":"2023-12-19T05:52:18.588666+0000","last_unstale":"2023-12-19T05:52:19.114443+0000","last_undegraded":"2023-12-19T05:52:19.114443+0000","last_fullsized":"2023-12-19T05:52:19.114443+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:46:23.863072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702327+0000","last_change":"2023-12-19T05:52:19.099039+0000","last_active":"2023-12-19T05:52:21.702327+0000","last_peered":"2023-12-19T05:52:21.702327+0000","last_clean":"2023-12-19T05:52:21.702327+0000","last_became_active":"2023-12-19T05:52:19.098443+0000","last_became_peered":"2023-12-19T05:52:19.098443+0000","last_unstale":"2023-12-19T05:52:21.702327+0000","last_undegraded":"2023-12-19T05:52:21.702327+0000","last_fullsized":"2023-12-19T05:52:21.702327+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:14:19.413815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.105508+0000","last_change":"2023-12-19T05:52:18.593123+0000","last_active":"2023-12-19T05:52:19.105508+0000","last_peered":"2023-12-19T05:52:19.105508+0000","last_clean":"2023-12-19T05:52:19.105508+0000","last_became_active":"2023-12-19T05:52:18.592413+0000","last_became_peered":"2023-12-19T05:52:18.592413+0000","last_unstale":"2023-12-19T05:52:19.105508+0000","last_undegraded":"2023-12-19T05:52:19.105508+0000","last_fullsized":"2023-12-19T05:52:19.105508+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:01:39.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.092893+0000","last_change":"2023-12-19T05:52:19.094185+0000","last_active":"2023-12-19T05:52:20.092893+0000","last_peered":"2023-12-19T05:52:20.092893+0000","last_clean":"2023-12-19T05:52:20.092893+0000","last_became_active":"2023-12-19T05:52:19.093941+0000","last_became_peered":"2023-12-19T05:52:19.093941+0000","last_unstale":"2023-12-19T05:52:20.092893+0000","last_undegraded":"2023-12-19T05:52:20.092893+0000","last_fullsized":"2023-12-19T05:52:20.092893+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:19:09.355962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.099084+0000","last_change":"2023-12-19T05:52:18.597020+0000","last_active":"2023-12-19T05:52:19.099084+0000","last_peered":"2023-12-19T05:52:19.099084+0000","last_clean":"2023-12-19T05:52:19.099084+0000","last_became_active":"2023-12-19T05:52:18.596806+0000","last_became_peered":"2023-12-19T05:52:18.596806+0000","last_unstale":"2023-12-19T05:52:19.099084+0000","last_undegraded":"2023-12-19T05:52:19.099084+0000","last_fullsized":"2023-12-19T05:52:19.099084+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:20.360085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089520+0000","last_change":"2023-12-19T05:52:19.103825+0000","last_active":"2023-12-19T05:52:20.089520+0000","last_peered":"2023-12-19T05:52:20.089520+0000","last_clean":"2023-12-19T05:52:20.089520+0000","last_became_active":"2023-12-19T05:52:19.103487+0000","last_became_peered":"2023-12-19T05:52:19.103487+0000","last_unstale":"2023-12-19T05:52:20.089520+0000","last_undegraded":"2023-12-19T05:52:20.089520+0000","last_fullsized":"2023-12-19T05:52:20.089520+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:55:47.431387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091368+0000","last_change":"2023-12-19T05:52:18.595346+0000","last_active":"2023-12-19T05:52:19.091368+0000","last_peered":"2023-12-19T05:52:19.091368+0000","last_clean":"2023-12-19T05:52:19.091368+0000","last_became_active":"2023-12-19T05:52:18.595034+0000","last_became_peered":"2023-12-19T05:52:18.595034+0000","last_unstale":"2023-12-19T05:52:19.091368+0000","last_undegraded":"2023-12-19T05:52:19.091368+0000","last_fullsized":"2023-12-19T05:52:19.091368+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:23:18.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.703127+0000","last_change":"2023-12-19T05:52:19.099768+0000","last_active":"2023-12-19T05:52:21.703127+0000","last_peered":"2023-12-19T05:52:21.703127+0000","last_clean":"2023-12-19T05:52:21.703127+0000","last_became_active":"2023-12-19T05:52:19.099503+0000","last_became_peered":"2023-12-19T05:52:19.099503+0000","last_unstale":"2023-12-19T05:52:21.703127+0000","last_undegraded":"2023-12-19T05:52:21.703127+0000","last_fullsized":"2023-12-19T05:52:21.703127+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:10:43.993579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"192'8","reported_seq":19,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.116349+0000","last_change":"2023-12-19T05:52:18.589960+0000","last_active":"2023-12-19T05:52:19.116349+0000","last_peered":"2023-12-19T05:52:19.116349+0000","last_clean":"2023-12-19T05:52:19.116349+0000","last_became_active":"2023-12-19T05:52:18.589394+0000","last_became_peered":"2023-12-19T05:52:18.589394+0000","last_unstale":"2023-12-19T05:52:19.116349+0000","last_undegraded":"2023-12-19T05:52:19.116349+0000","last_fullsized":"2023-12-19T05:52:19.116349+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:47:07.131558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702278+0000","last_change":"2023-12-19T05:52:19.105652+0000","last_active":"2023-12-19T05:52:21.702278+0000","last_peered":"2023-12-19T05:52:21.702278+0000","last_clean":"2023-12-19T05:52:21.702278+0000","last_became_active":"2023-12-19T05:52:19.105406+0000","last_became_peered":"2023-12-19T05:52:19.105406+0000","last_unstale":"2023-12-19T05:52:21.702278+0000","last_undegraded":"2023-12-19T05:52:21.702278+0000","last_fullsized":"2023-12-19T05:52:21.702278+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:12.842228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.112663+0000","last_change":"2023-12-19T05:52:18.588893+0000","last_active":"2023-12-19T05:52:19.112663+0000","last_peered":"2023-12-19T05:52:19.112663+0000","last_clean":"2023-12-19T05:52:19.112663+0000","last_became_active":"2023-12-19T05:52:18.588225+0000","last_became_peered":"2023-12-19T05:52:18.588225+0000","last_unstale":"2023-12-19T05:52:19.112663+0000","last_undegraded":"2023-12-19T05:52:19.112663+0000","last_fullsized":"2023-12-19T05:52:19.112663+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:11:57.445905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094390+0000","last_change":"2023-12-19T05:52:19.104071+0000","last_active":"2023-12-19T05:52:21.094390+0000","last_peered":"2023-12-19T05:52:21.094390+0000","last_clean":"2023-12-19T05:52:21.094390+0000","last_became_active":"2023-12-19T05:52:19.103425+0000","last_became_peered":"2023-12-19T05:52:19.103425+0000","last_unstale":"2023-12-19T05:52:21.094390+0000","last_undegraded":"2023-12-19T05:52:21.094390+0000","last_fullsized":"2023-12-19T05:52:21.094390+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:01:44.577848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.109759+0000","last_change":"2023-12-19T05:52:18.597439+0000","last_active":"2023-12-19T05:52:19.109759+0000","last_peered":"2023-12-19T05:52:19.109759+0000","last_clean":"2023-12-19T05:52:19.109759+0000","last_became_active":"2023-12-19T05:52:18.597198+0000","last_became_peered":"2023-12-19T05:52:18.597198+0000","last_unstale":"2023-12-19T05:52:19.109759+0000","last_undegraded":"2023-12-19T05:52:19.109759+0000","last_fullsized":"2023-12-19T05:52:19.109759+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:38:15.844803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094254+0000","last_change":"2023-12-19T05:52:19.098382+0000","last_active":"2023-12-19T05:52:21.094254+0000","last_peered":"2023-12-19T05:52:21.094254+0000","last_clean":"2023-12-19T05:52:21.094254+0000","last_became_active":"2023-12-19T05:52:19.098156+0000","last_became_peered":"2023-12-19T05:52:19.098156+0000","last_unstale":"2023-12-19T05:52:21.094254+0000","last_undegraded":"2023-12-19T05:52:21.094254+0000","last_fullsized":"2023-12-19T05:52:21.094254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"192'1","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.113128+0000","last_change":"2023-12-19T05:52:18.598771+0000","last_active":"2023-12-19T05:52:19.113128+0000","last_peered":"2023-12-19T05:52:19.113128+0000","last_clean":"2023-12-19T05:52:19.113128+0000","last_became_active":"2023-12-19T05:52:18.598384+0000","last_became_peered":"2023-12-19T05:52:18.598384+0000","last_unstale":"2023-12-19T05:52:19.113128+0000","last_undegraded":"2023-12-19T05:52:19.113128+0000","last_fullsized":"2023-12-19T05:52:19.113128+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:41:20.360085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091096+0000","last_change":"2023-12-19T05:52:19.100266+0000","last_active":"2023-12-19T05:52:20.091096+0000","last_peered":"2023-12-19T05:52:20.091096+0000","last_clean":"2023-12-19T05:52:20.091096+0000","last_became_active":"2023-12-19T05:52:19.100043+0000","last_became_peered":"2023-12-19T05:52:19.100043+0000","last_unstale":"2023-12-19T05:52:20.091096+0000","last_undegraded":"2023-12-19T05:52:20.091096+0000","last_fullsized":"2023-12-19T05:52:20.091096+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:35.973286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082526+0000","last_change":"2023-12-19T05:52:18.586281+0000","last_active":"2023-12-19T05:52:19.082526+0000","last_peered":"2023-12-19T05:52:19.082526+0000","last_clean":"2023-12-19T05:52:19.082526+0000","last_became_active":"2023-12-19T05:52:18.586047+0000","last_became_peered":"2023-12-19T05:52:18.586047+0000","last_unstale":"2023-12-19T05:52:19.082526+0000","last_undegraded":"2023-12-19T05:52:19.082526+0000","last_fullsized":"2023-12-19T05:52:19.082526+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:43:23.314385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702029+0000","last_change":"2023-12-19T05:52:19.098836+0000","last_active":"2023-12-19T05:52:21.702029+0000","last_peered":"2023-12-19T05:52:21.702029+0000","last_clean":"2023-12-19T05:52:21.702029+0000","last_became_active":"2023-12-19T05:52:19.098606+0000","last_became_peered":"2023-12-19T05:52:19.098606+0000","last_unstale":"2023-12-19T05:52:21.702029+0000","last_undegraded":"2023-12-19T05:52:21.702029+0000","last_fullsized":"2023-12-19T05:52:21.702029+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.108413+0000","last_change":"2023-12-19T05:52:18.593428+0000","last_active":"2023-12-19T05:52:19.108413+0000","last_peered":"2023-12-19T05:52:19.108413+0000","last_clean":"2023-12-19T05:52:19.108413+0000","last_became_active":"2023-12-19T05:52:18.590314+0000","last_became_peered":"2023-12-19T05:52:18.590314+0000","last_unstale":"2023-12-19T05:52:19.108413+0000","last_undegraded":"2023-12-19T05:52:19.108413+0000","last_fullsized":"2023-12-19T05:52:19.108413+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:28:10.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.090808+0000","last_change":"2023-12-19T05:52:19.095363+0000","last_active":"2023-12-19T05:52:20.090808+0000","last_peered":"2023-12-19T05:52:20.090808+0000","last_clean":"2023-12-19T05:52:20.090808+0000","last_became_active":"2023-12-19T05:52:19.094959+0000","last_became_peered":"2023-12-19T05:52:19.094959+0000","last_unstale":"2023-12-19T05:52:20.090808+0000","last_undegraded":"2023-12-19T05:52:20.090808+0000","last_fullsized":"2023-12-19T05:52:20.090808+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082342+0000","last_change":"2023-12-19T05:52:18.597190+0000","last_active":"2023-12-19T05:52:19.082342+0000","last_peered":"2023-12-19T05:52:19.082342+0000","last_clean":"2023-12-19T05:52:19.082342+0000","last_became_active":"2023-12-19T05:52:18.596946+0000","last_became_peered":"2023-12-19T05:52:18.596946+0000","last_unstale":"2023-12-19T05:52:19.082342+0000","last_undegraded":"2023-12-19T05:52:19.082342+0000","last_fullsized":"2023-12-19T05:52:19.082342+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:56:52.970451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702049+0000","last_change":"2023-12-19T05:52:19.098064+0000","last_active":"2023-12-19T05:52:21.702049+0000","last_peered":"2023-12-19T05:52:21.702049+0000","last_clean":"2023-12-19T05:52:21.702049+0000","last_became_active":"2023-12-19T05:52:19.097817+0000","last_became_peered":"2023-12-19T05:52:19.097817+0000","last_unstale":"2023-12-19T05:52:21.702049+0000","last_undegraded":"2023-12-19T05:52:21.702049+0000","last_fullsized":"2023-12-19T05:52:21.702049+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:21.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.089419+0000","last_change":"2023-12-19T05:52:18.598740+0000","last_active":"2023-12-19T05:52:19.089419+0000","last_peered":"2023-12-19T05:52:19.089419+0000","last_clean":"2023-12-19T05:52:19.089419+0000","last_became_active":"2023-12-19T05:52:18.598492+0000","last_became_peered":"2023-12-19T05:52:18.598492+0000","last_unstale":"2023-12-19T05:52:19.089419+0000","last_undegraded":"2023-12-19T05:52:19.089419+0000","last_fullsized":"2023-12-19T05:52:19.089419+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:11.827518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702424+0000","last_change":"2023-12-19T05:52:19.109299+0000","last_active":"2023-12-19T05:52:21.702424+0000","last_peered":"2023-12-19T05:52:21.702424+0000","last_clean":"2023-12-19T05:52:21.702424+0000","last_became_active":"2023-12-19T05:52:19.108404+0000","last_became_peered":"2023-12-19T05:52:19.108404+0000","last_unstale":"2023-12-19T05:52:21.702424+0000","last_undegraded":"2023-12-19T05:52:21.702424+0000","last_fullsized":"2023-12-19T05:52:21.702424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:58:21.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.082225+0000","last_change":"2023-12-19T05:52:18.584006+0000","last_active":"2023-12-19T05:52:19.082225+0000","last_peered":"2023-12-19T05:52:19.082225+0000","last_clean":"2023-12-19T05:52:19.082225+0000","last_became_active":"2023-12-19T05:52:18.583627+0000","last_became_peered":"2023-12-19T05:52:18.583627+0000","last_unstale":"2023-12-19T05:52:19.082225+0000","last_undegraded":"2023-12-19T05:52:19.082225+0000","last_fullsized":"2023-12-19T05:52:19.082225+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:51:09.221868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.091034+0000","last_change":"2023-12-19T05:52:19.104633+0000","last_active":"2023-12-19T05:52:20.091034+0000","last_peered":"2023-12-19T05:52:20.091034+0000","last_clean":"2023-12-19T05:52:20.091034+0000","last_became_active":"2023-12-19T05:52:19.104391+0000","last_became_peered":"2023-12-19T05:52:19.104391+0000","last_unstale":"2023-12-19T05:52:20.091034+0000","last_undegraded":"2023-12-19T05:52:20.091034+0000","last_fullsized":"2023-12-19T05:52:20.091034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.110589+0000","last_change":"2023-12-19T05:52:18.598354+0000","last_active":"2023-12-19T05:52:19.110589+0000","last_peered":"2023-12-19T05:52:19.110589+0000","last_clean":"2023-12-19T05:52:19.110589+0000","last_became_active":"2023-12-19T05:52:18.598111+0000","last_became_peered":"2023-12-19T05:52:18.598111+0000","last_unstale":"2023-12-19T05:52:19.110589+0000","last_undegraded":"2023-12-19T05:52:19.110589+0000","last_fullsized":"2023-12-19T05:52:19.110589+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:55:25.793839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094504+0000","last_change":"2023-12-19T05:52:19.092975+0000","last_active":"2023-12-19T05:52:21.094504+0000","last_peered":"2023-12-19T05:52:21.094504+0000","last_clean":"2023-12-19T05:52:21.094504+0000","last_became_active":"2023-12-19T05:52:19.091914+0000","last_became_peered":"2023-12-19T05:52:19.091914+0000","last_unstale":"2023-12-19T05:52:21.094504+0000","last_undegraded":"2023-12-19T05:52:21.094504+0000","last_fullsized":"2023-12-19T05:52:21.094504+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:22:10.006821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.083488+0000","last_change":"2023-12-19T05:52:18.592179+0000","last_active":"2023-12-19T05:52:19.083488+0000","last_peered":"2023-12-19T05:52:19.083488+0000","last_clean":"2023-12-19T05:52:19.083488+0000","last_became_active":"2023-12-19T05:52:18.591948+0000","last_became_peered":"2023-12-19T05:52:18.591948+0000","last_unstale":"2023-12-19T05:52:19.083488+0000","last_undegraded":"2023-12-19T05:52:19.083488+0000","last_fullsized":"2023-12-19T05:52:19.083488+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:26:15.936760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.093750+0000","last_change":"2023-12-19T05:52:19.106217+0000","last_active":"2023-12-19T05:52:21.093750+0000","last_peered":"2023-12-19T05:52:21.093750+0000","last_clean":"2023-12-19T05:52:21.093750+0000","last_became_active":"2023-12-19T05:52:19.106003+0000","last_became_peered":"2023-12-19T05:52:19.106003+0000","last_unstale":"2023-12-19T05:52:21.093750+0000","last_undegraded":"2023-12-19T05:52:21.093750+0000","last_fullsized":"2023-12-19T05:52:21.093750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:49.147559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092483+0000","last_change":"2023-12-19T05:52:18.594716+0000","last_active":"2023-12-19T05:52:19.092483+0000","last_peered":"2023-12-19T05:52:19.092483+0000","last_clean":"2023-12-19T05:52:19.092483+0000","last_became_active":"2023-12-19T05:52:18.594194+0000","last_became_peered":"2023-12-19T05:52:18.594194+0000","last_unstale":"2023-12-19T05:52:19.092483+0000","last_undegraded":"2023-12-19T05:52:19.092483+0000","last_fullsized":"2023-12-19T05:52:19.092483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:31:04.910129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.094511+0000","last_change":"2023-12-19T05:52:19.103711+0000","last_active":"2023-12-19T05:52:21.094511+0000","last_peered":"2023-12-19T05:52:21.094511+0000","last_clean":"2023-12-19T05:52:21.094511+0000","last_became_active":"2023-12-19T05:52:19.102258+0000","last_became_peered":"2023-12-19T05:52:19.102258+0000","last_unstale":"2023-12-19T05:52:21.094511+0000","last_undegraded":"2023-12-19T05:52:21.094511+0000","last_fullsized":"2023-12-19T05:52:21.094511+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:53:06.286566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.086361+0000","last_change":"2023-12-19T05:52:18.594005+0000","last_active":"2023-12-19T05:52:19.086361+0000","last_peered":"2023-12-19T05:52:19.086361+0000","last_clean":"2023-12-19T05:52:19.086361+0000","last_became_active":"2023-12-19T05:52:18.588452+0000","last_became_peered":"2023-12-19T05:52:18.588452+0000","last_unstale":"2023-12-19T05:52:19.086361+0000","last_undegraded":"2023-12-19T05:52:19.086361+0000","last_fullsized":"2023-12-19T05:52:19.086361+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:58:23.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:20.089845+0000","last_change":"2023-12-19T05:52:19.101788+0000","last_active":"2023-12-19T05:52:20.089845+0000","last_peered":"2023-12-19T05:52:20.089845+0000","last_clean":"2023-12-19T05:52:20.089845+0000","last_became_active":"2023-12-19T05:52:19.096632+0000","last_became_peered":"2023-12-19T05:52:19.096632+0000","last_unstale":"2023-12-19T05:52:20.089845+0000","last_undegraded":"2023-12-19T05:52:20.089845+0000","last_fullsized":"2023-12-19T05:52:20.089845+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:49:45.174625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.103995+0000","last_change":"2023-12-19T05:52:18.588640+0000","last_active":"2023-12-19T05:52:19.103995+0000","last_peered":"2023-12-19T05:52:19.103995+0000","last_clean":"2023-12-19T05:52:19.103995+0000","last_became_active":"2023-12-19T05:52:18.588363+0000","last_became_peered":"2023-12-19T05:52:18.588363+0000","last_unstale":"2023-12-19T05:52:19.103995+0000","last_undegraded":"2023-12-19T05:52:19.103995+0000","last_fullsized":"2023-12-19T05:52:19.103995+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:05:19.962413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702151+0000","last_change":"2023-12-19T05:52:19.096025+0000","last_active":"2023-12-19T05:52:21.702151+0000","last_peered":"2023-12-19T05:52:21.702151+0000","last_clean":"2023-12-19T05:52:21.702151+0000","last_became_active":"2023-12-19T05:52:19.095819+0000","last_became_peered":"2023-12-19T05:52:19.095819+0000","last_unstale":"2023-12-19T05:52:21.702151+0000","last_undegraded":"2023-12-19T05:52:21.702151+0000","last_fullsized":"2023-12-19T05:52:21.702151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091459+0000","last_change":"2023-12-19T05:52:18.594016+0000","last_active":"2023-12-19T05:52:19.091459+0000","last_peered":"2023-12-19T05:52:19.091459+0000","last_clean":"2023-12-19T05:52:19.091459+0000","last_became_active":"2023-12-19T05:52:18.590614+0000","last_became_peered":"2023-12-19T05:52:18.590614+0000","last_unstale":"2023-12-19T05:52:19.091459+0000","last_undegraded":"2023-12-19T05:52:19.091459+0000","last_fullsized":"2023-12-19T05:52:19.091459+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:44:16.892374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702050+0000","last_change":"2023-12-19T05:52:19.102810+0000","last_active":"2023-12-19T05:52:21.702050+0000","last_peered":"2023-12-19T05:52:21.702050+0000","last_clean":"2023-12-19T05:52:21.702050+0000","last_became_active":"2023-12-19T05:52:19.102561+0000","last_became_peered":"2023-12-19T05:52:19.102561+0000","last_unstale":"2023-12-19T05:52:21.702050+0000","last_undegraded":"2023-12-19T05:52:21.702050+0000","last_fullsized":"2023-12-19T05:52:21.702050+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:34.455691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.097581+0000","last_change":"2023-12-19T05:52:18.594780+0000","last_active":"2023-12-19T05:52:19.097581+0000","last_peered":"2023-12-19T05:52:19.097581+0000","last_clean":"2023-12-19T05:52:19.097581+0000","last_became_active":"2023-12-19T05:52:18.593894+0000","last_became_peered":"2023-12-19T05:52:18.593894+0000","last_unstale":"2023-12-19T05:52:19.097581+0000","last_undegraded":"2023-12-19T05:52:19.097581+0000","last_fullsized":"2023-12-19T05:52:19.097581+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:31:14.472551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702933+0000","last_change":"2023-12-19T05:52:19.108085+0000","last_active":"2023-12-19T05:52:21.702933+0000","last_peered":"2023-12-19T05:52:21.702933+0000","last_clean":"2023-12-19T05:52:21.702933+0000","last_became_active":"2023-12-19T05:52:19.106553+0000","last_became_peered":"2023-12-19T05:52:19.106553+0000","last_unstale":"2023-12-19T05:52:21.702933+0000","last_undegraded":"2023-12-19T05:52:21.702933+0000","last_fullsized":"2023-12-19T05:52:21.702933+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:07:33.046014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.092579+0000","last_change":"2023-12-19T05:52:18.597203+0000","last_active":"2023-12-19T05:52:19.092579+0000","last_peered":"2023-12-19T05:52:19.092579+0000","last_clean":"2023-12-19T05:52:19.092579+0000","last_became_active":"2023-12-19T05:52:18.596410+0000","last_became_peered":"2023-12-19T05:52:18.596410+0000","last_unstale":"2023-12-19T05:52:19.092579+0000","last_undegraded":"2023-12-19T05:52:19.092579+0000","last_fullsized":"2023-12-19T05:52:19.092579+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:18:43.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-19T05:52:21.702072+0000","last_change":"2023-12-19T05:52:19.095383+0000","last_active":"2023-12-19T05:52:21.702072+0000","last_peered":"2023-12-19T05:52:21.702072+0000","last_clean":"2023-12-19T05:52:21.702072+0000","last_became_active":"2023-12-19T05:52:19.095133+0000","last_became_peered":"2023-12-19T05:52:19.095133+0000","last_unstale":"2023-12-19T05:52:21.702072+0000","last_undegraded":"2023-12-19T05:52:21.702072+0000","last_fullsized":"2023-12-19T05:52:21.702072+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:18.557301+0000","last_clean_scrub_stamp":"2023-12-19T05:52:18.557301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:10:46.263398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.091409+0000","last_change":"2023-12-19T05:52:18.598616+0000","last_active":"2023-12-19T05:52:19.091409+0000","last_peered":"2023-12-19T05:52:19.091409+0000","last_clean":"2023-12-19T05:52:19.091409+0000","last_became_active":"2023-12-19T05:52:18.597992+0000","last_became_peered":"2023-12-19T05:52:18.597992+0000","last_unstale":"2023-12-19T05:52:19.091409+0000","last_undegraded":"2023-12-19T05:52:19.091409+0000","last_fullsized":"2023-12-19T05:52:19.091409+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:52:17.542590+0000","last_clean_scrub_stamp":"2023-12-19T05:52:17.542590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:00:20.517433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":323,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-19T05:52:19.090875+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:52:19.090875+0000","last_peered":"2023-12-19T05:52:19.090875+0000","last_clean":"2023-12-19T05:52:19.090875+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:52:19.090875+0000","last_undegraded":"2023-12-19T05:52:19.090875+0000","last_fullsized":"2023-12-19T05:52:19.090875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910169,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.105,"15min":1.0920000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.56699999999999995},"max":{"1min":1.4830000000000001,"5min":1.635,"15min":6.4429999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.77400000000000002,"5min":0.77000000000000002,"15min":0.63300000000000001},"max":{"1min":1.444,"5min":1.768,"15min":3.976},"last":1.2290000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1799999999999999,"15min":1.157},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":6.399},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1699999999999999,"15min":1.1759999999999999},"min":{"1min":0.70199999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.577,"5min":1.74,"15min":4.25},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.222},"min":{"1min":0.96299999999999997,"5min":0.69799999999999995,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.042},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1519999999999999,"15min":1.1220000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.64500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":1.361}]},{"osd":3,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3080000000000001,"15min":1.272},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.622},"max":{"1min":1.595,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.3680000000000001},"min":{"1min":1.091,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.804,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":0.92000000000000004}]},{"osd":4,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":1.756,"5min":1.756,"15min":2.9980000000000002},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.2789999999999999,"15min":1.2969999999999999},"min":{"1min":0.96299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":6.4850000000000003},"last":1.2769999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.335,"15min":1.343},"min":{"1min":0.97499999999999998,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.774,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.331,"15min":1.3},"min":{"1min":0.94299999999999995,"5min":0.72599999999999998,"15min":0.55600000000000005},"max":{"1min":1.734,"5min":1.9970000000000001,"15min":3.1909999999999998},"last":1.6990000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.476,"15min":1.4359999999999999},"min":{"1min":1.2809999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.863,"5min":1.883,"15min":3.0920000000000001},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.4670000000000001,"15min":1.4770000000000001},"min":{"1min":1.0740000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":7.7519999999999998},"last":1.4630000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.4330000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.387},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":1.22}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":1.2809999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":1.304},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":1.462}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":1.504},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.542}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":1.617}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193671,"statfs":{"total":200000000,"available":198319129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":1.2869999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.724}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.421},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":1.1659999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":1.627}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":1.3520000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":1.778},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":1.659}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":1.829},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":1.923}]}]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.1120000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.026},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.165}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.393}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":1.256},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.3129999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.7829999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.3460000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.524}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.476}]}]},{"osd":3,"up_from":13,"seq":55834575013,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194246,"statfs":{"total":200000000,"available":198908583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.878},"min":{"1min":0.47499999999999998,"5min":0.42899999999999999,"15min":0.314},"max":{"1min":1.8129999999999999,"5min":1.8220000000000001,"15min":1.99},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.095,"5min":0.995,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.499,"15min":0.34999999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.72},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.93100000000000005},"min":{"1min":0.623,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.702},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1399999999999999,"15min":1.048},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.39100000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.3650000000000002},"last":0.85799999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.0760000000000001},"min":{"1min":0.69699999999999995,"5min":0.49399999999999999,"15min":0.45200000000000001},"max":{"1min":1.6519999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.196},{"interface":"front","average":{"1min":1.401,"5min":1.3109999999999999,"15min":1.2030000000000001},"min":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.45600000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.931},"last":0.94399999999999995}]},{"osd":4,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":1.0069999999999999,"5min":0.70199999999999996,"15min":0.51400000000000001},"max":{"1min":1.4710000000000001,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.171},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.351,"15min":1.3120000000000001},"min":{"1min":0.77200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":1.9359999999999999,"15min":2.5859999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.452,"15min":1.3779999999999999},"min":{"1min":0.82899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.052,"5min":2.052,"15min":4.8440000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.4510000000000001,"15min":1.3939999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.306}]},{"osd":6,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4970000000000001,"15min":1.4259999999999999},"min":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.71499999999999997},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3879999999999999,"15min":1.3480000000000001},"min":{"1min":0.84699999999999998,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.877,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.4399999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.458,"15min":1.417},"min":{"1min":0.89300000000000002,"5min":0.82599999999999996,"15min":0.55800000000000005},"max":{"1min":1.7350000000000001,"5min":2.093,"15min":2.1509999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.532,"15min":1.462},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.70099999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.8900000000000001},"last":1.595}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194247,"statfs":{"total":200000000,"available":198909587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.83699999999999997},"min":{"1min":0.65900000000000003,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":1.304,"5min":3.407,"15min":3.407},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.95199999999999996},"min":{"1min":0.69199999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6519999999999999,"5min":1.764,"15min":1.9450000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.147,"15min":1.107},"min":{"1min":0.90600000000000003,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.631,"5min":3.476,"15min":3.476},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.2509999999999999,"15min":1.2050000000000001},"min":{"1min":0.97599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.736,"5min":1.927,"15min":1.927},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.67400000000000004,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.3879999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.753},{"interface":"front","average":{"1min":1.29,"5min":1.246,"15min":1.179},"min":{"1min":0.95499999999999996,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.6080000000000001,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":1.1080000000000001,"5min":0.872,"15min":0.52700000000000002},"max":{"1min":1.8540000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":0.998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.306,"15min":1.2889999999999999},"min":{"1min":0.97699999999999998,"5min":0.76300000000000001,"15min":0.65100000000000002},"max":{"1min":1.6930000000000001,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.018}]},{"osd":5,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3919999999999999,"15min":1.349},"min":{"1min":1.216,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.77,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.3779999999999999,"15min":1.331},"min":{"1min":0.92300000000000004,"5min":0.82999999999999996,"15min":0.72699999999999998},"max":{"1min":1.9910000000000001,"5min":2.028,"15min":2.5960000000000001},"last":1.554}]},{"osd":6,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.373,"15min":1.327},"min":{"1min":1.0089999999999999,"5min":0.77400000000000002,"15min":0.67700000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.526,"15min":1.4430000000000001},"min":{"1min":1.181,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.921,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.075}]},{"osd":7,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5029999999999999,"15min":1.4750000000000001},"min":{"1min":1.153,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.8460000000000001,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.139},{"interface":"front","average":{"1min":1.494,"5min":1.5029999999999999,"15min":1.474},"min":{"1min":1.1399999999999999,"5min":0.81299999999999994,"15min":0.71499999999999997},"max":{"1min":1.9810000000000001,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.3859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1642,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193669,"statfs":{"total":200000000,"available":198318055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":1.052}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.141}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.8360000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.29}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.742},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.48}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.9319999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.615},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.5620000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.5209999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1064,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194248,"statfs":{"total":200000000,"available":198910099,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":14.063000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":1.7789999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":14.003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":3.8940000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":8.6560000000000006},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":14.725}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.8819999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":3.6989999999999998},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":8.5830000000000002}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":13.949999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":2.0190000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":2.2570000000000001},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":8.2260000000000009}]}]}],"pool_statfs":[]}} 2023-12-19T05:52:24.652 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:52:24.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:52:24.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.940+0000 7f525f59e640 1 Processor -- start 2023-12-19T05:52:24.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.940+0000 7f525f59e640 1 -- start start 2023-12-19T05:52:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f525f59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52600ce690 0x7f52600b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f525f59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600b0c20 con 0x7f52600b24c0 2023-12-19T05:52:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f525f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5260161e40 con 0x7f52600b2e50 2023-12-19T05:52:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f525f59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600cb8c0 con 0x7f52600ce690 2023-12-19T05:52:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f5257fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f52600b24c0 0x7f52600cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49526/0 (socket says 172.21.15.49:49526) 2023-12-19T05:52:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f5257fff640 1 -- 172.21.15.49:0/865431676 learned_addr learned my addr 172.21.15.49:0/865431676 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.942+0000 7f525ed9d640 1 --2- 172.21.15.49:0/865431676 >> v2:172.21.15.115:3300/0 conn(0x7f52600ce690 0x7f52600b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346497768 0 0) 0x7f52600b0c20 con 0x7f52600b24c0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c003520 con 0x7f52600b24c0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342154959 0 0) 0x7f524c003520 con 0x7f52600b24c0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 >> v2:172.21.15.115:3300/0 conn(0x7f52600ce690 msgr2=0x7f52600b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 --2- 172.21.15.49:0/865431676 >> v2:172.21.15.115:3300/0 conn(0x7f52600ce690 0x7f52600b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 >> v1:172.21.15.115:6789/0 conn(0x7f52600b2e50 legacy=0x7f52600b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600cbba0 con 0x7f52600b24c0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5248001670 con 0x7f52600b24c0 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 >> v1:172.21.15.49:6789/0 conn(0x7f52600b24c0 legacy=0x7f52600cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c0039c0 0x7f524c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f524c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c005180 0x7f524c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600cb8c0 con 0x7f524c0047c0 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00c080 con 0x7f524c005180 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00c240 con 0x7f524c0039c0 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.943+0000 7f5257fff640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f524c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f525ed9d640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c005180 0x7f524c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f5257fff640 1 -- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c0039c0 msgr2=0x7f524c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f5257fff640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f524c0039c0 0x7f524c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f5257fff640 1 -- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c005180 msgr2=0x7f524c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f5257fff640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c005180 0x7f524c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f5257fff640 1 -- 172.21.15.49:0/865431676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c003520 con 0x7f524c0047c0 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f525ed9d640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c005180 0x7f524c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.944+0000 7f525ed9d640 1 -- 172.21.15.49:0/865431676 reap_dead start 2023-12-19T05:52:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.945+0000 7f5257fff640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f524c004c40 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f524800c0e0 tx=0x7f524c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70f671fec3c8bed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.945+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248005ad0 con 0x7f524c0047c0 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.945+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248005c30 con 0x7f524c0047c0 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525dd9b640 1 -- 172.21.15.49:0/865431676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524802ca50 con 0x7f524c0047c0 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 -- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 msgr2=0x7f524c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f524c004c40 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f524800c0e0 tx=0x7f524c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 -- 172.21.15.49:0/865431676 shutdown_connections 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 --2- 172.21.15.49:0/865431676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f524c004c40 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 -- 172.21.15.49:0/865431676 >> 172.21.15.49:0/865431676 conn(0x7f52600659d0 msgr2=0x7f5260065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 -- 172.21.15.49:0/865431676 shutdown_connections 2023-12-19T05:52:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.946+0000 7f525f59e640 1 -- 172.21.15.49:0/865431676 wait complete. 2023-12-19T05:52:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.948+0000 7f525f59e640 1 Processor -- start 2023-12-19T05:52:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.948+0000 7f525f59e640 1 -- start start 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5260160350 0x7f52600bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52600be680 0x7f52600beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c1ae0 con 0x7f524c0047c0 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600bf040 con 0x7f52600be680 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.949+0000 7f525f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52601601b0 con 0x7f5260160350 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38718/0 (socket says 172.21.15.49:38718) 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 -- 172.21.15.49:0/1869506838 learned_addr learned my addr 172.21.15.49:0/1869506838 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525ed9d640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52600be680 0x7f52600beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f5257fff640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5260160350 0x7f52600bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 -- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5260160350 msgr2=0x7f52600bdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5260160350 0x7f52600bdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 -- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52600be680 msgr2=0x7f52600beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52600be680 0x7f52600beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.950+0000 7f525e59c640 1 -- 172.21.15.49:0/1869506838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600be090 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f525e59c640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f525000c460 tx=0x7f525000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500052d0 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250005450 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52600ca5d0 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250012870 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.951+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52600cab90 con 0x7f524c0047c0 2023-12-19T05:52:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.952+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260061910 con 0x7f524c0047c0 2023-12-19T05:52:24.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.953+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52500129d0 con 0x7f524c0047c0 2023-12-19T05:52:24.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.955+0000 7f5256ffd640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 0x7f524006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:24.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.955+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5250088320 con 0x7f524c0047c0 2023-12-19T05:52:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.956+0000 7f5257fff640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 0x7f524006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:24.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.957+0000 7f5257fff640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 0x7f524006c920 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5248034000 tx=0x7f5248009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:24.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:24.959+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5250057430 con 0x7f524c0047c0 2023-12-19T05:52:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.232+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f52600afff0 con 0x7f524c0047c0 2023-12-19T05:52:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.240+0000 7f5256ffd640 1 -- 172.21.15.49:0/1869506838 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5250056fc0 con 0x7f524c0047c0 2023-12-19T05:52:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-12-19T05:52:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 msgr2=0x7f524006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 0x7f524006c920 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5248034000 tx=0x7f5248009030 comp rx=0 tx=0).stop 2023-12-19T05:52:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 msgr2=0x7f526015fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f525000c460 tx=0x7f525000c920 comp rx=0 tx=0).stop 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 shutdown_connections 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f524006a460 0x7f524006c920 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5260160350 0x7f52600bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52600be680 0x7f52600beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 --2- 172.21.15.49:0/1869506838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f524c0047c0 0x7f526015fc70 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.243+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 >> 172.21.15.49:0/1869506838 conn(0x7f52600659d0 msgr2=0x7f5260161250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.244+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 shutdown_connections 2023-12-19T05:52:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.244+0000 7f525f59e640 1 -- 172.21.15.49:0/1869506838 wait complete. 2023-12-19T05:52:25.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.487+0000 7fa210b8b640 1 Processor -- start 2023-12-19T05:52:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.487+0000 7fa210b8b640 1 -- start start 2023-12-19T05:52:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.488+0000 7fa210b8b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa20c0d2b00 0x7fa20c0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.488+0000 7fa210b8b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa20c0ce110 0x7fa20c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.488+0000 7fa210b8b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c0cd840 con 0x7fa20c146e10 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa210b8b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0d2430 con 0x7fa20c0d2b00 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa210b8b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0ceac0 con 0x7fa20c0ce110 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa20a59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa20c146e10 0x7fa20c0b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49540/0 (socket says 172.21.15.49:49540) 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa20a59c640 1 -- 172.21.15.49:0/2546815205 learned_addr learned my addr 172.21.15.49:0/2546815205 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa209d9b640 1 --2- 172.21.15.49:0/2546815205 >> v2:172.21.15.49:3300/0 conn(0x7fa20c0d2b00 0x7fa20c0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa20ad9d640 1 --2- 172.21.15.49:0/2546815205 >> v2:172.21.15.115:3300/0 conn(0x7fa20c0ce110 0x7fa20c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa20959a640 1 -- 172.21.15.49:0/2546815205 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196177782 0 0) 0x7fa20c0cd840 con 0x7fa20c146e10 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.489+0000 7fa20959a640 1 -- 172.21.15.49:0/2546815205 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f8003520 con 0x7fa20c146e10 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.490+0000 7fa209d9b640 1 -- 172.21.15.49:0/2546815205 >> v2:172.21.15.115:3300/0 conn(0x7fa20c0ce110 msgr2=0x7fa20c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.490+0000 7fa209d9b640 1 --2- 172.21.15.49:0/2546815205 >> v2:172.21.15.115:3300/0 conn(0x7fa20c0ce110 0x7fa20c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.490+0000 7fa209d9b640 1 -- 172.21.15.49:0/2546815205 >> v1:172.21.15.49:6789/0 conn(0x7fa20c146e10 legacy=0x7fa20c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.490+0000 7fa209d9b640 1 -- 172.21.15.49:0/2546815205 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0b6e90 con 0x7fa20c0d2b00 2023-12-19T05:52:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.491+0000 7fa209d9b640 1 --2- 172.21.15.49:0/2546815205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c0d1ef0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0cedb0 tx=0x7fa1f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2793d79018363d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.491+0000 7fa20959a640 1 -- 172.21.15.49:0/2546815205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402e070 con 0x7fa20c0d2b00 2023-12-19T05:52:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.491+0000 7fa20959a640 1 -- 172.21.15.49:0/2546815205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40315a0 con 0x7fa20c0d2b00 2023-12-19T05:52:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.491+0000 7fa20959a640 1 -- 172.21.15.49:0/2546815205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4031910 con 0x7fa20c0d2b00 2023-12-19T05:52:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 -- 172.21.15.49:0/2546815205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 msgr2=0x7fa20c0d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 --2- 172.21.15.49:0/2546815205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c0d1ef0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0cedb0 tx=0x7fa1f402b840 comp rx=0 tx=0).stop 2023-12-19T05:52:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 -- 172.21.15.49:0/2546815205 shutdown_connections 2023-12-19T05:52:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 --2- 172.21.15.49:0/2546815205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c0d1ef0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 --2- 172.21.15.49:0/2546815205 >> v2:172.21.15.115:3300/0 conn(0x7fa20c0ce110 0x7fa20c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 -- 172.21.15.49:0/2546815205 >> 172.21.15.49:0/2546815205 conn(0x7fa20c0b29c0 msgr2=0x7fa20c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 -- 172.21.15.49:0/2546815205 shutdown_connections 2023-12-19T05:52:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.492+0000 7fa210b8b640 1 -- 172.21.15.49:0/2546815205 wait complete. 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.494+0000 7fa210b8b640 1 Processor -- start 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.494+0000 7fa210b8b640 1 -- start start 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 0x7fa20c160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa20c146e10 0x7fa20c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c13d540 con 0x7fa20c0d2b00 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c15f990 con 0x7fa20c0ce110 2023-12-19T05:52:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa210b8b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c15fc70 con 0x7fa20c146e10 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.495+0000 7fa209d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38732/0 (socket says 172.21.15.49:38732) 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 -- 172.21.15.49:0/24916548 learned_addr learned my addr 172.21.15.49:0/24916548 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa20a59c640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 0x7fa20c160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa20ad9d640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa20c146e10 0x7fa20c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 -- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa20c146e10 msgr2=0x7fa20c15ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa20c146e10 0x7fa20c15ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 -- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 msgr2=0x7fa20c160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 0x7fa20c160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 -- 172.21.15.49:0/24916548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009400 con 0x7fa20c0d2b00 2023-12-19T05:52:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa20a59c640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 0x7fa20c160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.496+0000 7fa209d9b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4034040 tx=0x7fa1f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.497+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4032840 con 0x7fa20c0d2b00 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.497+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4031f00 con 0x7fa20c0d2b00 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.497+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c15ff50 con 0x7fa20c0d2b00 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.497+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4032be0 con 0x7fa20c0d2b00 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.497+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c160510 con 0x7fa20c0d2b00 2023-12-19T05:52:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.498+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c061910 con 0x7fa20c0d2b00 2023-12-19T05:52:25.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.499+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1f4032d40 con 0x7fa20c0d2b00 2023-12-19T05:52:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.500+0000 7fa202ffd640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 0x7fa1ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.500+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1f40aa8a0 con 0x7fa20c0d2b00 2023-12-19T05:52:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.501+0000 7fa20a59c640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 0x7fa1ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.502+0000 7fa20a59c640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 0x7fa1ec06c920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc001560 tx=0x7fa1fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.505+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1f4075df0 con 0x7fa20c0d2b00 2023-12-19T05:52:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.736+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa20c1606d0 con 0x7fa20c0d2b00 2023-12-19T05:52:25.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.737+0000 7fa202ffd640 1 -- 172.21.15.49:0/24916548 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fa1f4079410 con 0x7fa20c0d2b00 2023-12-19T05:52:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:25.739 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:52:25.739 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 msgr2=0x7fa1ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 0x7fa1ec06c920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc001560 tx=0x7fa1fc009040 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 msgr2=0x7fa20c13d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4034040 tx=0x7fa1f40046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 shutdown_connections 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa1ec06a460 0x7fa1ec06c920 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa20c146e10 0x7fa20c15ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa20c0d2b00 0x7fa20c13d000 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 --2- 172.21.15.49:0/24916548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c0ce110 0x7fa20c160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 >> 172.21.15.49:0/24916548 conn(0x7fa20c0b29c0 msgr2=0x7fa20c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 shutdown_connections 2023-12-19T05:52:25.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:25.740+0000 7fa210b8b640 1 -- 172.21.15.49:0/24916548 wait complete. 2023-12-19T05:52:26.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:52:19.076252+0000', 'modified': '2023-12-19T05:52:22.603778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8886}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8886': {'gid': 8886, 'name': 'd', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/1808935012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 1808935012}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1808935012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:52:26.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:52:26.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T05:52:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.407+0000 7f5f5a670640 1 Processor -- start 2023-12-19T05:52:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.407+0000 7f5f5a670640 1 -- start start 2023-12-19T05:52:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f5a670640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f540d2290 0x7f5f541611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f5a670640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540d2920 con 0x7f5f54157b60 2023-12-19T05:52:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f5a670640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540d2c00 con 0x7f5f541616f0 2023-12-19T05:52:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f5a670640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540d31c0 con 0x7f5f540d2290 2023-12-19T05:52:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f53fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f54157b60 0x7f5f540ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49542/0 (socket says 172.21.15.49:49542) 2023-12-19T05:52:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f53fff640 1 -- 172.21.15.49:0/4233209198 learned_addr learned my addr 172.21.15.49:0/4233209198 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f537fe640 1 --2- 172.21.15.49:0/4233209198 >> v2:172.21.15.49:3300/0 conn(0x7f5f540d2290 0x7f5f541611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.409+0000 7f5f52ffd640 1 -- 172.21.15.49:0/4233209198 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054852625 0 0) 0x7f5f540d2920 con 0x7f5f54157b60 2023-12-19T05:52:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.410+0000 7f5f52ffd640 1 -- 172.21.15.49:0/4233209198 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f3c003520 con 0x7f5f54157b60 2023-12-19T05:52:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.410+0000 7f5f537fe640 1 -- 172.21.15.49:0/4233209198 >> v1:172.21.15.115:6789/0 conn(0x7f5f541616f0 legacy=0x7f5f540b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.410+0000 7f5f537fe640 1 -- 172.21.15.49:0/4233209198 >> v1:172.21.15.49:6789/0 conn(0x7f5f54157b60 legacy=0x7f5f540ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.410+0000 7f5f537fe640 1 -- 172.21.15.49:0/4233209198 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540d2ee0 con 0x7f5f540d2290 2023-12-19T05:52:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.411+0000 7f5f537fe640 1 --2- 172.21.15.49:0/4233209198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f541611b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5f480097d0 tx=0x7f5f4802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27fd31481fa4c4e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.411+0000 7f5f52ffd640 1 -- 172.21.15.49:0/4233209198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48030800 con 0x7f5f540d2290 2023-12-19T05:52:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.411+0000 7f5f52ffd640 1 -- 172.21.15.49:0/4233209198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48030960 con 0x7f5f540d2290 2023-12-19T05:52:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.411+0000 7f5f52ffd640 1 -- 172.21.15.49:0/4233209198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48030cf0 con 0x7f5f540d2290 2023-12-19T05:52:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 -- 172.21.15.49:0/4233209198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 msgr2=0x7f5f541611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 --2- 172.21.15.49:0/4233209198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f541611b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5f480097d0 tx=0x7f5f4802b940 comp rx=0 tx=0).stop 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 -- 172.21.15.49:0/4233209198 shutdown_connections 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 --2- 172.21.15.49:0/4233209198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f541611b0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 -- 172.21.15.49:0/4233209198 >> 172.21.15.49:0/4233209198 conn(0x7f5f540b29c0 msgr2=0x7f5f540b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 -- 172.21.15.49:0/4233209198 shutdown_connections 2023-12-19T05:52:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.412+0000 7f5f5a670640 1 -- 172.21.15.49:0/4233209198 wait complete. 2023-12-19T05:52:26.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.414+0000 7f5f5a670640 1 Processor -- start 2023-12-19T05:52:26.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.414+0000 7f5f5a670640 1 -- start start 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f54157b60 0x7f5f54158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 0x7f5f54070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540d2740 con 0x7f5f540d2290 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54147380 con 0x7f5f541616f0 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f5a670640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541590d0 con 0x7f5f54157b60 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38748/0 (socket says 172.21.15.49:38748) 2023-12-19T05:52:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f53fff640 1 -- 172.21.15.49:0/1946703262 learned_addr learned my addr 172.21.15.49:0/1946703262 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.415+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f54157b60 0x7f5f54158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 0x7f5f54070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 -- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f54157b60 msgr2=0x7f5f54158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f54157b60 0x7f5f54158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 -- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 msgr2=0x7f5f54070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 0x7f5f54070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 -- 172.21.15.49:0/1946703262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009400 con 0x7f5f540d2290 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 0x7f5f54070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400cbf0 tx=0x7f5f4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f50ff9640 1 -- 172.21.15.49:0/1946703262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400ad50 con 0x7f5f540d2290 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f50ff9640 1 -- 172.21.15.49:0/1946703262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44012400 con 0x7f5f540d2290 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f54153e90 con 0x7f5f540d2290 2023-12-19T05:52:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.416+0000 7f5f50ff9640 1 -- 172.21.15.49:0/1946703262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44012790 con 0x7f5f540d2290 2023-12-19T05:52:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.417+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54153840 con 0x7f5f540d2290 2023-12-19T05:52:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.419+0000 7f5f50ff9640 1 -- 172.21.15.49:0/1946703262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f44007070 con 0x7f5f540d2290 2023-12-19T05:52:26.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.420+0000 7f5f50ff9640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 0x7f5f4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.420+0000 7f5f50ff9640 1 -- 172.21.15.49:0/1946703262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f44088a90 con 0x7f5f540d2290 2023-12-19T05:52:26.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.420+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 0x7f5f4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.421+0000 7f5f5d1de740 1 Processor -- start 2023-12-19T05:52:26.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.421+0000 7f5f5d1de740 1 -- start start 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c56110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49b95f80 con 0x55ff49c25cb0 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49b93710 con 0x55ff49c55d30 2023-12-19T05:52:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff49b8f000 con 0x55ff49c298b0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 0x7f5f4006c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f4803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38760/0 (socket says 172.21.15.49:38760) 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f537fe640 1 -- 172.21.15.49:0/2795522296 learned_addr learned my addr 172.21.15.49:0/2795522296 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f53fff640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c56110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.422+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 -- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 msgr2=0x55ff49c534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 -- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 msgr2=0x55ff49c56110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c56110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 -- 172.21.15.49:0/2795522296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff49b56690 con 0x55ff49c25cb0 2023-12-19T05:52:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f53fff640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c56110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f537fe640 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f5f4802bf50 tx=0x7f5f48030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10212b4022b892b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f39ffb640 1 -- 172.21.15.49:0/2795522296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4803e040 con 0x55ff49c25cb0 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f39ffb640 1 -- 172.21.15.49:0/2795522296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4804b040 con 0x55ff49c25cb0 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.423+0000 7f5f39ffb640 1 -- 172.21.15.49:0/2795522296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48039450 con 0x55ff49c25cb0 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 -- 172.21.15.49:0/2795522296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 msgr2=0x55ff49c52fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f5f4802bf50 tx=0x7f5f48030000 comp rx=0 tx=0).stop 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 -- 172.21.15.49:0/2795522296 shutdown_connections 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c25cb0 0x55ff49c52fa0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/2795522296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c56110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 -- 172.21.15.49:0/2795522296 >> 172.21.15.49:0/2795522296 conn(0x55ff49c27fc0 msgr2=0x55ff49c70b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 -- 172.21.15.49:0/2795522296 shutdown_connections 2023-12-19T05:52:26.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.424+0000 7f5f5d1de740 1 -- 172.21.15.49:0/2795522296 wait complete. 2023-12-19T05:52:26.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.425+0000 7f5f5d1de740 1 -- start start 2023-12-19T05:52:26.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.425+0000 7f5f5d1de740 1 Processor -- start 2023-12-19T05:52:26.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c4b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49b307d0 con 0x55ff49c4d570 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49b30470 con 0x55ff49c55d30 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.426+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff498f6f20 con 0x55ff49c298b0 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f5d1de740 10 client.0 _ll_register_callbacks cb 0x55ff49b7f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38762/0 (socket says 172.21.15.49:38762) 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1848597964 learned_addr learned my addr 172.21.15.49:0/1848597964 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c4b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 msgr2=0x55ff49c4b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c4b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 msgr2=0x55ff49c4d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c4d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1848597964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f540d2ee0 con 0x55ff49c4d570 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.427+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c4d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:26.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c001e60 tx=0x7f5f4c00f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bfa8111269ac09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0050d0 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff49bb9550 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f4c005230 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f4c0053f0 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f5d1de740 10 client.9012 fetch_fsmap learned FSMap version 88 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55ff49b8d680 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff49bb9550 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.428+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 88) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5f4c012070 con 0x55ff49c4d570 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 10 client.9012 fetch_fsmap finished waiting for FSMap version 88 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 10 client.9012 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 20 client.9012 populate_metadata read hostname 'smithi049' 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c835f0 0x55ff49c839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 4 client.9012 mds_command: new command op to 8886 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:52:26.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 --> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff49b81b50 con 0x55ff49c835f0 2023-12-19T05:52:26.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.429+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c835f0 0x55ff49c839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.430+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c835f0 0x55ff49c839d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e08c9e5cde99b server_cookie=751f697f6e127dbd in_seq=0 out_seq=0 2023-12-19T05:52:26.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.430+0000 7f5f32ffd640 10 client.9012 ms_handle_connect on v2:172.21.15.115:6835/1808935012 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.432+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1848597964 <== mds.0 v2:172.21.15.115:6835/1808935012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ff49b81b50 con 0x55ff49c835f0 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.432+0000 7f5f32ffd640 10 client.9012 handle_command_reply: tid=0 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.432+0000 7f5f5d1de740 1 client.9012 shutdown 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.432+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 msgr2=0x55ff49c4e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.432+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c001e60 tx=0x7f5f4c00f660 comp rx=0 tx=0).stop 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 shutdown_connections 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c835f0 0x55ff49c839d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c4d570 0x55ff49c4e3b0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c4d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1848597964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c298b0 0x55ff49c4b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f32ffd640 0 client.9012 ms_handle_reset on v2:172.21.15.115:6835/1808935012 2023-12-19T05:52:26.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 >> 172.21.15.49:0/1848597964 conn(0x55ff49c25cb0 msgr2=0x55ff49c74050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 shutdown_connections 2023-12-19T05:52:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1848597964 wait complete. 2023-12-19T05:52:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.433+0000 7f5f5d1de740 20 client.9012 trim_cache size 0 max 16384 2023-12-19T05:52:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.449+0000 7f5f5d1de740 1 Processor -- start 2023-12-19T05:52:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 -- start start 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c2a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c52c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c273d0 con 0x55ff49c298b0 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c27090 con 0x55ff49c55d30 2023-12-19T05:52:26.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.450+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c89a00 con 0x55ff49c4d570 2023-12-19T05:52:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38774/0 (socket says 172.21.15.49:38774) 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 -- 172.21.15.49:0/4049389422 learned_addr learned my addr 172.21.15.49:0/4049389422 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c52c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f537fe640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c2a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 -- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 msgr2=0x55ff49c2a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c2a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 -- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 msgr2=0x55ff49c52c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c52c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f53fff640 1 -- 172.21.15.49:0/4049389422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff49c27610 con 0x55ff49c298b0 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c52c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.451+0000 7f5f537fe640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.452+0000 7f5f53fff640 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5f44057c30 tx=0x7f5f44086df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7103e5adab4851 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.452+0000 7f5f3a7fc640 1 -- 172.21.15.49:0/4049389422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4406f200 con 0x55ff49c298b0 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.452+0000 7f5f3a7fc640 1 -- 172.21.15.49:0/4049389422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44087030 con 0x55ff49c298b0 2023-12-19T05:52:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.452+0000 7f5f3a7fc640 1 -- 172.21.15.49:0/4049389422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440862f0 con 0x55ff49c298b0 2023-12-19T05:52:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 -- 172.21.15.49:0/4049389422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 msgr2=0x55ff49c2bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5f44057c30 tx=0x7f5f44086df0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 -- 172.21.15.49:0/4049389422 shutdown_connections 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c55d30 0x55ff49c52c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/4049389422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c298b0 0x55ff49c2bf50 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 -- 172.21.15.49:0/4049389422 >> 172.21.15.49:0/4049389422 conn(0x55ff49c25cb0 msgr2=0x55ff49c4a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 -- 172.21.15.49:0/4049389422 shutdown_connections 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.453+0000 7f5f5d1de740 1 -- 172.21.15.49:0/4049389422 wait complete. 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.454+0000 7f5f5d1de740 1 -- start start 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.454+0000 7f5f5d1de740 1 Processor -- start 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c298b0 0x55ff49cd5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c24e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c218d0 con 0x55ff49c55d30 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c574a0 con 0x55ff49c298b0 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff49c73030 con 0x55ff49c4d570 2023-12-19T05:52:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f5d1de740 10 client.0 _ll_register_callbacks cb 0x7f5f3c0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f58c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f58c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38780/0 (socket says 172.21.15.49:38780) 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.455+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1367202790 learned_addr learned my addr 172.21.15.49:0/1367202790 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c298b0 0x55ff49cd5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f537fe640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c24e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 msgr2=0x55ff49c24e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c24e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c298b0 msgr2=0x55ff49cd5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c298b0 0x55ff49cd5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 -- 172.21.15.49:0/1367202790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54153840 con 0x55ff49c55d30 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f58c0d640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c007a30 tx=0x7f5f4c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b562ec3f8d7f901a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00fb60 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f4c007e40 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.456+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f4804b040 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f4c003c90 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 10 client.9018 fetch_fsmap learned FSMap version 88 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55ff49b2f9e0 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4804b040 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 88) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5f4c007020 con 0x55ff49c55d30 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 10 client.9018 fetch_fsmap finished waiting for FSMap version 88 2023-12-19T05:52:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 10 client.9018 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 20 client.9018 populate_metadata read hostname 'smithi049' 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c72240 0x55ff49c72620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 4 client.9018 mds_command: new command op to 8886 tid=0[{"prefix": "status"}] 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.457+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 --> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff49b88080 con 0x55ff49c72240 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.458+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c72240 0x55ff49c72620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.459+0000 7f5f53fff640 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c72240 0x55ff49c72620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37348e985a29fd82 server_cookie=26f16764c9b0fbcb in_seq=0 out_seq=0 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.459+0000 7f5f32ffd640 10 client.9018 ms_handle_connect on v2:172.21.15.115:6835/1808935012 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.459+0000 7f5f32ffd640 1 -- 172.21.15.49:0/1367202790 <== mds.0 v2:172.21.15.115:6835/1808935012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55ff49b88080 con 0x55ff49c72240 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.459+0000 7f5f32ffd640 10 client.9018 handle_command_reply: tid=0 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.459+0000 7f5f5d1de740 1 client.9018 shutdown 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 msgr2=0x55ff49c25370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c007a30 tx=0x7f5f4c001120 comp rx=0 tx=0).stop 2023-12-19T05:52:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 shutdown_connections 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:6835/1808935012,v1:172.21.15.115:6837/1808935012] conn(0x55ff49c72240 0x55ff49c72620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ff49c4d570 0x55ff49c24e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff49c55d30 0x55ff49c25370 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 --2- 172.21.15.49:0/1367202790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ff49c298b0 0x55ff49cd5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 >> 172.21.15.49:0/1367202790 conn(0x55ff49c25cb0 msgr2=0x55ff49c2a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f32ffd640 0 client.9018 ms_handle_reset on v2:172.21.15.115:6835/1808935012 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 shutdown_connections 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 1 -- 172.21.15.49:0/1367202790 wait complete. 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.460+0000 7f5f5d1de740 20 client.9018 trim_cache size 0 max 16384 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8886, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.3783371720000002, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 88, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 193, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 193, 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.154743843 2023-12-19T05:52:26.466 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 msgr2=0x7f5f4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 0x7f5f4006c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f4803b040 comp rx=0 tx=0).stop 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 msgr2=0x7f5f54158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400cbf0 tx=0x7f5f4400a430 comp rx=0 tx=0).stop 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 shutdown_connections 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5f4006a430 0x7f5f4006c8f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f54157b60 0x7f5f54158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f541616f0 0x7f5f54070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 --2- 172.21.15.49:0/1946703262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f540d2290 0x7f5f54158410 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 >> 172.21.15.49:0/1946703262 conn(0x7f5f540b29c0 msgr2=0x7f5f540b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 shutdown_connections 2023-12-19T05:52:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.461+0000 7f5f5a670640 1 -- 172.21.15.49:0/1946703262 wait complete. 2023-12-19T05:52:26.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:52:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.714+0000 7f15f47e0640 1 Processor -- start 2023-12-19T05:52:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.714+0000 7f15f47e0640 1 -- start start 2023-12-19T05:52:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.716+0000 7f15f47e0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.716+0000 7f15f47e0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15ec06c6b0 0x7f15ec0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.716+0000 7f15f47e0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ec0afb10 con 0x7f15ec0b0b50 2023-12-19T05:52:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.716+0000 7f15f47e0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec06bb30 con 0x7f15ec06c6b0 2023-12-19T05:52:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.716+0000 7f15f47e0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0b0070 con 0x7f15ec1449e0 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.717+0000 7f15f257c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.717+0000 7f15f2d7d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15ec06c6b0 0x7f15ec0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.717+0000 7f15f257c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36976/0 (socket says 172.21.15.49:36976) 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.717+0000 7f15f257c640 1 -- 172.21.15.49:0/3654238232 learned_addr learned my addr 172.21.15.49:0/3654238232 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.717+0000 7f15f1d7b640 1 --1- 172.21.15.49:0/3654238232 >> v1:172.21.15.115:6789/0 conn(0x7f15ec0b0b50 0x7f15ec06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50010/0 (socket says 172.21.15.49:50010) 2023-12-19T05:52:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.718+0000 7f15f257c640 1 -- 172.21.15.49:0/3654238232 >> v2:172.21.15.115:3300/0 conn(0x7f15ec06c6b0 msgr2=0x7f15ec0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:26.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.718+0000 7f15f257c640 1 --2- 172.21.15.49:0/3654238232 >> v2:172.21.15.115:3300/0 conn(0x7f15ec06c6b0 0x7f15ec0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.718+0000 7f15f257c640 1 -- 172.21.15.49:0/3654238232 >> v1:172.21.15.115:6789/0 conn(0x7f15ec0b0b50 legacy=0x7f15ec06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.718+0000 7f15f257c640 1 -- 172.21.15.49:0/3654238232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0b0350 con 0x7f15ec1449e0 2023-12-19T05:52:26.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.719+0000 7f15f257c640 1 --2- 172.21.15.49:0/3654238232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e50 tx=0x7f15e802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e07122aac70f4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f157a640 1 -- 172.21.15.49:0/3654238232 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e802cb00 con 0x7f15ec1449e0 2023-12-19T05:52:26.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f157a640 1 -- 172.21.15.49:0/3654238232 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e802cc60 con 0x7f15ec1449e0 2023-12-19T05:52:26.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f157a640 1 -- 172.21.15.49:0/3654238232 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80343f0 con 0x7f15ec1449e0 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 -- 172.21.15.49:0/3654238232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 msgr2=0x7f15ec0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3654238232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e50 tx=0x7f15e802bf60 comp rx=0 tx=0).stop 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 -- 172.21.15.49:0/3654238232 shutdown_connections 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3654238232 >> v2:172.21.15.115:3300/0 conn(0x7f15ec06c6b0 0x7f15ec0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3654238232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0af5d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 -- 172.21.15.49:0/3654238232 >> 172.21.15.49:0/3654238232 conn(0x7f15ec0cbb70 msgr2=0x7f15ec0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.720+0000 7f15f47e0640 1 -- 172.21.15.49:0/3654238232 shutdown_connections 2023-12-19T05:52:26.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.721+0000 7f15f47e0640 1 -- 172.21.15.49:0/3654238232 wait complete. 2023-12-19T05:52:26.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.722+0000 7f15f47e0640 1 Processor -- start 2023-12-19T05:52:26.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.722+0000 7f15f47e0640 1 -- start start 2023-12-19T05:52:26.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 0x7f15ec0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ae420 con 0x7f15ec06c6b0 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0adb80 con 0x7f15ec0b0b50 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.723+0000 7f15f47e0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ade60 con 0x7f15ec1449e0 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38782/0 (socket says 172.21.15.49:38782) 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 -- 172.21.15.49:0/3485207065 learned_addr learned my addr 172.21.15.49:0/3485207065 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f1d7b640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 0x7f15ec0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f2d7d640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 -- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 msgr2=0x7f15ec0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 -- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 msgr2=0x7f15ec0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 0x7f15ec0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f257c640 1 -- 172.21.15.49:0/3485207065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009b30 con 0x7f15ec06c6b0 2023-12-19T05:52:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.724+0000 7f15f1d7b640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 0x7f15ec0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15f257c640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000f80 tx=0x7f15e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8040670 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80407d0 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8040b80 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0ae140 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.725+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec1f1660 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.726+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec1f17f0 con 0x7f15ec06c6b0 2023-12-19T05:52:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.727+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f15e8040ce0 con 0x7f15ec06c6b0 2023-12-19T05:52:26.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.728+0000 7f15e2ffd640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 0x7f15d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:26.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.728+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15e80aba00 con 0x7f15ec06c6b0 2023-12-19T05:52:26.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.729+0000 7f15f1d7b640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 0x7f15d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.730+0000 7f15f1d7b640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 0x7f15d006c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0676c0 tx=0x7f15dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.733+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f15e8076f60 con 0x7f15ec06c6b0 2023-12-19T05:52:26.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.965+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15ec0a8700 con 0x7f15ec06c6b0 2023-12-19T05:52:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.966+0000 7f15e2ffd640 1 -- 172.21.15.49:0/3485207065 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f15ec0a8700 con 0x7f15ec06c6b0 2023-12-19T05:52:26.967 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.968+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 msgr2=0x7f15d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.968+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 0x7f15d006c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0676c0 tx=0x7f15dc009040 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 msgr2=0x7f15ec1f1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000f80 tx=0x7f15e8004a40 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 shutdown_connections 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f15d006a430 0x7f15d006c8f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15ec1449e0 0x7f15ec0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15ec0b0b50 0x7f15ec0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 --2- 172.21.15.49:0/3485207065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15ec06c6b0 0x7f15ec1f1120 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 >> 172.21.15.49:0/3485207065 conn(0x7f15ec0cbb70 msgr2=0x7f15ec0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 shutdown_connections 2023-12-19T05:52:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:26.969+0000 7f15f47e0640 1 -- 172.21.15.49:0/3485207065 wait complete. 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:52:26.991 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:52:26.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:26.992 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-19T05:52:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41546sec preferred_lft 41546sec 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1850:faff:fe3f:4984/64 scope link 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether e2:a7:21:1d:79:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0a7:21ff:fe1d:7931/64 scope link 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether b2:93:ca:f5:40:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:52:27.052 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b093:caff:fef5:402c/64 scope link 2023-12-19T05:52:27.053 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:27.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.054 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:52:27.158 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-19T05:52:27.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.162 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-19T05:52:27.219 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-19T05:52:27.219 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:52:27.220 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-19T05:52:27.220 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-19T05:52:27.220 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:52:27.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.220 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-19T05:52:27.221 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-19T05:52:27.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T05:52:27.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T05:52:27.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T05:52:27.221 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-19T05:52:27.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.431 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:52:27.490 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:52:27.490 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:52:27.490 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:52:27.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-19T05:52:27.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:52:27.602 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:52:27.661 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:52:27.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:52:27.661 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:52:27.720 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T05:52:27.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:27.872 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:27.872 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:52:27.907 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:27.907 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:52:27.907 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:52:27.907 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:52:27.907 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:52:27.910 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:52:27.910 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:52:27.910 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:52:27.910 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:52:27.910 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:52:27.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:52:27.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:27.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:52:28.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:28.008 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:52:28.088 INFO:teuthology.orchestra.run.smithi049.stdout:client6491 2023-12-19T05:52:28.088 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:28.088 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:28.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:52:28.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.381+0000 7f19f70ec640 1 Processor -- start 2023-12-19T05:52:28.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.382+0000 7f19f70ec640 1 -- start start 2023-12-19T05:52:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.383+0000 7f19f70ec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19f015d660 0x7f19f00afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.383+0000 7f19f70ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.383+0000 7f19f70ec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f006e7f0 con 0x7f19f015d280 2023-12-19T05:52:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.384+0000 7f19f70ec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f00d02c0 con 0x7f19f015d660 2023-12-19T05:52:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.384+0000 7f19f70ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f006e510 con 0x7f19f00b2970 2023-12-19T05:52:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.384+0000 7f19f68eb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.384+0000 7f19f68eb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:37002/0 (socket says 172.21.15.49:37002) 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.384+0000 7f19f68eb640 1 -- 172.21.15.49:0/3569235947 learned_addr learned my addr 172.21.15.49:0/3569235947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.385+0000 7f19f58e9640 1 --2- 172.21.15.49:0/3569235947 >> v2:172.21.15.115:3300/0 conn(0x7f19f015d660 0x7f19f00afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.385+0000 7f19f68eb640 1 -- 172.21.15.49:0/3569235947 >> v2:172.21.15.115:3300/0 conn(0x7f19f015d660 msgr2=0x7f19f00afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.385+0000 7f19f68eb640 1 --2- 172.21.15.49:0/3569235947 >> v2:172.21.15.115:3300/0 conn(0x7f19f015d660 0x7f19f00afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.385+0000 7f19f68eb640 1 -- 172.21.15.49:0/3569235947 >> v1:172.21.15.115:6789/0 conn(0x7f19f015d280 legacy=0x7f19f00b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.385+0000 7f19f68eb640 1 -- 172.21.15.49:0/3569235947 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00d0560 con 0x7f19f00b2970 2023-12-19T05:52:28.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.387+0000 7f19f68eb640 1 --2- 172.21.15.49:0/3569235947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba95bf49902eb453 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:28.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.387+0000 7f19f50e8640 1 -- 172.21.15.49:0/3569235947 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e80317c0 con 0x7f19f00b2970 2023-12-19T05:52:28.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.387+0000 7f19f50e8640 1 -- 172.21.15.49:0/3569235947 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8031920 con 0x7f19f00b2970 2023-12-19T05:52:28.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.387+0000 7f19f50e8640 1 -- 172.21.15.49:0/3569235947 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8031cb0 con 0x7f19f00b2970 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 -- 172.21.15.49:0/3569235947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 msgr2=0x7f19f0160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3569235947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e802b860 comp rx=0 tx=0).stop 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 -- 172.21.15.49:0/3569235947 shutdown_connections 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3569235947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f0160fc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3569235947 >> v2:172.21.15.115:3300/0 conn(0x7f19f015d660 0x7f19f00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 -- 172.21.15.49:0/3569235947 >> 172.21.15.49:0/3569235947 conn(0x7f19f006b8f0 msgr2=0x7f19f006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 -- 172.21.15.49:0/3569235947 shutdown_connections 2023-12-19T05:52:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.388+0000 7f19f70ec640 1 -- 172.21.15.49:0/3569235947 wait complete. 2023-12-19T05:52:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.390+0000 7f19f70ec640 1 Processor -- start 2023-12-19T05:52:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.390+0000 7f19f70ec640 1 -- start start 2023-12-19T05:52:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f015d280 0x7f19f01f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f013e040 con 0x7f19f015d660 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f014f400 con 0x7f19f015d280 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.391+0000 7f19f70ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015aa10 con 0x7f19f00b2970 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38784/0 (socket says 172.21.15.49:38784) 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 -- 172.21.15.49:0/3062369624 learned_addr learned my addr 172.21.15.49:0/3062369624 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f60ea640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f58e9640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f015d280 0x7f19f01f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 -- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 msgr2=0x7f19f013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f013b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 -- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f015d280 msgr2=0x7f19f01f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f015d280 0x7f19f01f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.392+0000 7f19f68eb640 1 -- 172.21.15.49:0/3062369624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80094d0 con 0x7f19f015d660 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19f68eb640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8032860 con 0x7f19f015d660 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e80329c0 con 0x7f19f015d660 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8032d70 con 0x7f19f015d660 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f015acf0 con 0x7f19f015d660 2023-12-19T05:52:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.393+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f01f2870 con 0x7f19f015d660 2023-12-19T05:52:28.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.394+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f00700e0 con 0x7f19f015d660 2023-12-19T05:52:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.395+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f19e804e450 con 0x7f19f015d660 2023-12-19T05:52:28.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.397+0000 7f19eeffd640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 0x7f19dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:28.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.397+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e80aab30 con 0x7f19f015d660 2023-12-19T05:52:28.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.398+0000 7f19f60ea640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 0x7f19dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:28.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.399+0000 7f19f60ea640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 0x7f19dc06c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f19e00012e0 tx=0x7f19e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:28.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.401+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f19e8076080 con 0x7f19f015d660 2023-12-19T05:52:28.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.638+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19f015a870 con 0x7f19f015d660 2023-12-19T05:52:28.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.639+0000 7f19eeffd640 1 -- 172.21.15.49:0/3062369624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19f015a870 con 0x7f19f015d660 2023-12-19T05:52:28.641 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 msgr2=0x7f19dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 0x7f19dc06c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f19e00012e0 tx=0x7f19e0009040 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 msgr2=0x7f19f014e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e80046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 shutdown_connections 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f19dc06a430 0x7f19dc06c8f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f015d660 0x7f19f014e7e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f015d280 0x7f19f01f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 --2- 172.21.15.49:0/3062369624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19f00b2970 0x7f19f013b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 >> 172.21.15.49:0/3062369624 conn(0x7f19f006b8f0 msgr2=0x7f19f00b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 shutdown_connections 2023-12-19T05:52:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:28.642+0000 7f19f70ec640 1 -- 172.21.15.49:0/3062369624 wait complete. 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:52:28.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:52:28.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:52:28.666 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:52:28.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:28.666 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-12-19T05:52:28.725 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:52:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:52:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:52:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41561sec preferred_lft 41561sec 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.726 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ac22:b5ff:fe07:445c/64 scope link 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:45:bb:35:2a:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d845:bbff:fe35:2a8e/64 scope link 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether da:9e:5e:f1:f6:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d89e:5eff:fef1:f6b4/64 scope link 2023-12-19T05:52:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:52:28.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:28.728 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:52:28.825 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-12-19T05:52:28.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:28.830 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-12-19T05:52:28.881 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-12-19T05:52:28.881 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:52:28.881 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:52:28.881 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:52:28.881 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:52:28.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:52:28.882 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-12-19T05:52:29.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:29.069 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:52:29.121 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:52:29.121 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:52:29.122 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:52:29.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:29.122 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-12-19T05:52:29.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:52:29.218 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T05:52:29.276 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T05:52:29.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:52:29.277 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:52:29.330 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T05:52:29.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:29.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:29.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:29.375 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:29.461 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:29.461 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:52:29.489 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T05:52:29.490 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T05:52:29.490 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-12-19T05:52:29.490 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@e805799f-455a-49b9-9f36-8f2074fd7be4.cephfs=/ 2023-12-19T05:52:29.490 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.49:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-12-19T05:52:29.493 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-19T05:52:29.493 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:52:29.493 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:52:29.493 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:52:29.493 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:52:29.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:52:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:29.495 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T05:52:29.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:29.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:52:29.674 INFO:teuthology.orchestra.run.smithi115.stdout:client7270 2023-12-19T05:52:29.674 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:29.674 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:29.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:29.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.971+0000 7f1a336b6640 1 Processor -- start 2023-12-19T05:52:29.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.971+0000 7f1a336b6640 1 -- start start 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a336b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 0x7f1a2c144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a336b6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a2c0d1d20 0x7f1a2c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a336b6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0cf280 con 0x7f1a2c144f60 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a336b6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c0d21b0 con 0x7f1a2c0d1d20 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a336b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c15f9e0 con 0x7f1a2c1444b0 2023-12-19T05:52:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a31c53640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1a2c144f60 0x7f1a2c0ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49552/0 (socket says 172.21.15.49:49552) 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a31c53640 1 -- 172.21.15.49:0/721041865 learned_addr learned my addr 172.21.15.49:0/721041865 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.973+0000 7f1a30c51640 1 --2- 172.21.15.49:0/721041865 >> v2:172.21.15.49:3300/0 conn(0x7f1a2c0d1d20 0x7f1a2c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a31452640 1 --2- 172.21.15.49:0/721041865 >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 0x7f1a2c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a23fff640 1 -- 172.21.15.49:0/721041865 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918915112 0 0) 0x7f1a2c0cf280 con 0x7f1a2c144f60 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a23fff640 1 -- 172.21.15.49:0/721041865 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a18003520 con 0x7f1a2c144f60 2023-12-19T05:52:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a30c51640 1 -- 172.21.15.49:0/721041865 >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 msgr2=0x7f1a2c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:29.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a30c51640 1 --2- 172.21.15.49:0/721041865 >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 0x7f1a2c144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:29.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a30c51640 1 -- 172.21.15.49:0/721041865 >> v1:172.21.15.49:6789/0 conn(0x7f1a2c144f60 legacy=0x7f1a2c0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:29.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a30c51640 1 -- 172.21.15.49:0/721041865 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c06e870 con 0x7f1a2c0d1d20 2023-12-19T05:52:29.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.974+0000 7f1a31452640 1 --2- 172.21.15.49:0/721041865 >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 0x7f1a2c144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.975+0000 7f1a30c51640 1 --2- 172.21.15.49:0/721041865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c0d1d20 0x7f1a2c0cdd90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0cdd60 tx=0x7f1a1c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2357d21e28155d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a23fff640 1 -- 172.21.15.49:0/721041865 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c02e070 con 0x7f1a2c0d1d20 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a23fff640 1 -- 172.21.15.49:0/721041865 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0315a0 con 0x7f1a2c0d1d20 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a23fff640 1 -- 172.21.15.49:0/721041865 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c031930 con 0x7f1a2c0d1d20 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 -- 172.21.15.49:0/721041865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c0d1d20 msgr2=0x7f1a2c0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 --2- 172.21.15.49:0/721041865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c0d1d20 0x7f1a2c0cdd90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0cdd60 tx=0x7f1a1c02b840 comp rx=0 tx=0).stop 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 -- 172.21.15.49:0/721041865 shutdown_connections 2023-12-19T05:52:29.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 --2- 172.21.15.49:0/721041865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c0d1d20 0x7f1a2c0cdd90 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 --2- 172.21.15.49:0/721041865 >> v2:172.21.15.115:3300/0 conn(0x7f1a2c1444b0 0x7f1a2c144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.976+0000 7f1a336b6640 1 -- 172.21.15.49:0/721041865 >> 172.21.15.49:0/721041865 conn(0x7f1a2c06a2e0 msgr2=0x7f1a2c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.977+0000 7f1a336b6640 1 -- 172.21.15.49:0/721041865 shutdown_connections 2023-12-19T05:52:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.977+0000 7f1a336b6640 1 -- 172.21.15.49:0/721041865 wait complete. 2023-12-19T05:52:29.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.978+0000 7f1a336b6640 1 Processor -- start 2023-12-19T05:52:29.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.979+0000 7f1a336b6640 1 -- start start 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.979+0000 7f1a336b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a2c1444b0 0x7f1a2c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.979+0000 7f1a336b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a336b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a2c0b6550 0x7f1a2c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a336b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c15b9e0 con 0x7f1a2c144f60 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a336b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c15e3d0 con 0x7f1a2c1444b0 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a336b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c15d210 con 0x7f1a2c0b6550 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38812/0 (socket says 172.21.15.49:38812) 2023-12-19T05:52:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 -- 172.21.15.49:0/923837593 learned_addr learned my addr 172.21.15.49:0/923837593 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 -- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a2c0b6550 msgr2=0x7f1a2c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a2c0b6550 0x7f1a2c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 -- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a2c1444b0 msgr2=0x7f1a2c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a31452640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a2c1444b0 0x7f1a2c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a2c1444b0 0x7f1a2c15de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.980+0000 7f1a30c51640 1 -- 172.21.15.49:0/923837593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009400 con 0x7f1a2c144f60 2023-12-19T05:52:29.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a30c51640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009890 tx=0x7f1a1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c032840 con 0x7f1a2c144f60 2023-12-19T05:52:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c031f00 con 0x7f1a2c144f60 2023-12-19T05:52:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c15bc30 con 0x7f1a2c144f60 2023-12-19T05:52:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c032be0 con 0x7f1a2c144f60 2023-12-19T05:52:29.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.981+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c15c1f0 con 0x7f1a2c144f60 2023-12-19T05:52:29.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.982+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c061910 con 0x7f1a2c144f60 2023-12-19T05:52:29.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.983+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1a1c032d40 con 0x7f1a2c144f60 2023-12-19T05:52:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.984+0000 7f1a21ffb640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 0x7f1a1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.984+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a1c0aa850 con 0x7f1a2c144f60 2023-12-19T05:52:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.985+0000 7f1a31452640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 0x7f1a1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.986+0000 7f1a31452640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 0x7f1a1006c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009f70 tx=0x7f1a2800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:29.988+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1a1c075e40 con 0x7f1a2c144f60 2023-12-19T05:52:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.218+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a2c0cccb0 con 0x7f1a2c144f60 2023-12-19T05:52:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.219+0000 7f1a21ffb640 1 -- 172.21.15.49:0/923837593 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f1a1c079460 con 0x7f1a2c144f60 2023-12-19T05:52:30.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:30.221 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:52:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 msgr2=0x7f1a1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 0x7f1a1006c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009f70 tx=0x7f1a2800b040 comp rx=0 tx=0).stop 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 msgr2=0x7f1a2c15ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009890 tx=0x7f1a1c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 shutdown_connections 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1a1006a460 0x7f1a1006c920 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a2c0b6550 0x7f1a2c06d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2c144f60 0x7f1a2c15ccd0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 --2- 172.21.15.49:0/923837593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a2c1444b0 0x7f1a2c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 >> 172.21.15.49:0/923837593 conn(0x7f1a2c06a2e0 msgr2=0x7f1a2c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 shutdown_connections 2023-12-19T05:52:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.222+0000 7f1a336b6640 1 -- 172.21.15.49:0/923837593 wait complete. 2023-12-19T05:52:30.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:52:30.486 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":8886,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.387317976,"mdsmap_epoch":88,"osdmap_epoch":193,"osdmap_epoch_barrier":193,"uptime":17.163720117} 2023-12-19T05:52:30.486 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 8886, "mdsmap_epoch": 88, "osdmap_epoch": 193, "osdmap_epoch_barrier": 193, "rank_uptime": 11.387317976, "state": "up:active", "uptime": 17.163720117, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:52:30.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-19T05:52:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.736+0000 7f5a01c0e640 1 Processor -- start 2023-12-19T05:52:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.736+0000 7f5a01c0e640 1 -- start start 2023-12-19T05:52:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.737+0000 7f5a01c0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59fc0b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.737+0000 7f5a01c0e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0d07c0 con 0x7f59fc0b1d90 2023-12-19T05:52:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.737+0000 7f5a01c0e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc15d8c0 con 0x7f59fc0d3820 2023-12-19T05:52:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.737+0000 7f5a01c0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0ce7b0 con 0x7f59fc15d4e0 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.738+0000 7f59fbfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f59fc0b1d90 0x7f59fc0d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49556/0 (socket says 172.21.15.49:49556) 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.738+0000 7f59fbfff640 1 -- 172.21.15.49:0/1466886694 learned_addr learned my addr 172.21.15.49:0/1466886694 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.738+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59fc0b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.738+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155033753 0 0) 0x7f59fc0d07c0 con 0x7f59fc0b1d90 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.738+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e4003520 con 0x7f59fc0b1d90 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2452361391 0 0) 0x7f59e4003520 con 0x7f59fc0b1d90 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 msgr2=0x7f59fc0b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59fc0b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 >> v1:172.21.15.115:6789/0 conn(0x7f59fc0d3820 legacy=0x7f59fc0d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0cfbb0 con 0x7f59fc0b1d90 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f59f0001670 con 0x7f59fc0b1d90 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 >> v1:172.21.15.49:6789/0 conn(0x7f59fc0b1d90 legacy=0x7f59fc0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59e40039a0 0x7f59e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4004d00 0x7f59e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0ce7b0 con 0x7f59e40039a0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e400ba30 con 0x7f59e4004d00 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e400bbf0 con 0x7f59fc15d4e0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59e40039a0 0x7f59e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f5a00c0c640 1 -- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 msgr2=0x7f59e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f59fbfff640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.739+0000 7f5a0140d640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4004d00 0x7f59e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f5a00c0c640 1 -- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4004d00 msgr2=0x7f59e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4004d00 0x7f59e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f5a00c0c640 1 -- 172.21.15.49:0/1466886694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4003520 con 0x7f59e40039a0 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f59fbfff640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc15d4e0 0x7f59e40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.740+0000 7f5a0140d640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4004d00 0x7f59e4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.741+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59e40039a0 0x7f59e4003dc0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009f90 tx=0x7f59e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600de61d60c70627 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.741+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec02cbd0 con 0x7f59e40039a0 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.741+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00f040 con 0x7f59e40039a0 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.741+0000 7f59fb7fe640 1 -- 172.21.15.49:0/1466886694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec034440 con 0x7f59e40039a0 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1466886694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59e40039a0 msgr2=0x7f59e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1466886694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59e40039a0 0x7f59e4003dc0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009f90 tx=0x7f59e40057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a0140d640 1 -- 172.21.15.49:0/1466886694 reap_dead start 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1466886694 shutdown_connections 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1466886694 >> 172.21.15.49:0/1466886694 conn(0x7f59fc072f40 msgr2=0x7f59fc073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1466886694 shutdown_connections 2023-12-19T05:52:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.742+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1466886694 wait complete. 2023-12-19T05:52:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.744+0000 7f5a01c0e640 1 Processor -- start 2023-12-19T05:52:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.744+0000 7f5a01c0e640 1 -- start start 2023-12-19T05:52:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 0x7f59fc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc0d1e40 0x7f59fc1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0d22f0 con 0x7f59fc0cadc0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0cc2c0 con 0x7f59e40039a0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a01c0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0cc5a0 con 0x7f59fc0d1e40 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f59fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f59fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38838/0 (socket says 172.21.15.49:38838) 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f59fbfff640 1 -- 172.21.15.49:0/1059816571 learned_addr learned my addr 172.21.15.49:0/1059816571 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.745+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 0x7f59fc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f5a0140d640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc0d1e40 0x7f59fc1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 -- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc0d1e40 msgr2=0x7f59fc1f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc0d1e40 0x7f59fc1f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 -- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 msgr2=0x7f59fc0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 0x7f59fc0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 -- 172.21.15.49:0/1059816571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0cc880 con 0x7f59fc0cadc0 2023-12-19T05:52:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 0x7f59fc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59fbfff640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d8e0 tx=0x7f59f000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00074e0 con 0x7f59fc0cadc0 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f0007640 con 0x7f59fc0cadc0 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00049e0 con 0x7f59fc0cadc0 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc0ccb60 con 0x7f59fc0cadc0 2023-12-19T05:52:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.746+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc154670 con 0x7f59fc0cadc0 2023-12-19T05:52:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.748+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc0d0150 con 0x7f59fc0cadc0 2023-12-19T05:52:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.749+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f59f0004b40 con 0x7f59fc0cadc0 2023-12-19T05:52:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.750+0000 7f59f97fa640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 0x7f59e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.750+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59f0088450 con 0x7f59fc0cadc0 2023-12-19T05:52:30.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.750+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 0x7f59e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:30.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.751+0000 7f5a00c0c640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 0x7f59e806c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f59ec036000 tx=0x7f59ec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:30.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.754+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f59fc0d0150 con 0x7f59fc0cadc0 2023-12-19T05:52:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:30.950+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f59fc0d0150 con 0x7f59fc0cadc0 2023-12-19T05:52:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.677+0000 7f59f97fa640 1 -- 172.21.15.49:0/1059816571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v194) v1 ==== 181+0+0 (secure 0 0 0) 0x7f59fc0d0150 con 0x7f59fc0cadc0 2023-12-19T05:52:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 msgr2=0x7f59e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 0x7f59e806c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f59ec036000 tx=0x7f59ec02e000 comp rx=0 tx=0).stop 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 msgr2=0x7f59fc0d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d8e0 tx=0x7f59f000dda0 comp rx=0 tx=0).stop 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 shutdown_connections 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f59e806a460 0x7f59e806c920 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59fc0d1e40 0x7f59fc1f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59fc0cadc0 0x7f59fc0d1900 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 --2- 172.21.15.49:0/1059816571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e40039a0 0x7f59fc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 >> 172.21.15.49:0/1059816571 conn(0x7f59fc072f40 msgr2=0x7f59fc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 shutdown_connections 2023-12-19T05:52:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:31.681+0000 7f5a01c0e640 1 -- 172.21.15.49:0/1059816571 wait complete. 2023-12-19T05:52:31.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-19T05:52:31.956 INFO:teuthology.orchestra.run.smithi049.stdout:{"osd_mon_report_interval":"5"} 2023-12-19T05:52:31.956 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-19T05:52:31.957 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-19T05:52:31.957 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:31.957 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:32.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:32.012 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-19T05:52:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:16+0 records in 2023-12-19T05:52:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:16+0 records out 2023-12-19T05:52:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.20553 s, 81.6 MB/s 2023-12-19T05:52:32.282 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:32.282 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:32.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:32.338 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-19T05:52:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:17+0 records in 2023-12-19T05:52:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:17+0 records out 2023-12-19T05:52:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.165263 s, 108 MB/s 2023-12-19T05:52:32.562 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-19T05:52:32.562 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.786+0000 7fdb48896640 1 Processor -- start 2023-12-19T05:52:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.786+0000 7fdb48896640 1 -- start start 2023-12-19T05:52:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb48896640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb441449e0 0x7fdb440af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb48896640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440afb10 con 0x7fdb4406c6b0 2023-12-19T05:52:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb48896640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4406bb30 con 0x7fdb440b0b50 2023-12-19T05:52:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb48896640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440b0070 con 0x7fdb441449e0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb4259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb441449e0 0x7fdb440af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb42d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb4406c6b0 0x7fdb440b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49570/0 (socket says 172.21.15.49:49570) 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.788+0000 7fdb42d9d640 1 -- 172.21.15.49:0/893803138 learned_addr learned my addr 172.21.15.49:0/893803138 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.789+0000 7fdb4259c640 1 -- 172.21.15.49:0/893803138 >> v1:172.21.15.115:6789/0 conn(0x7fdb440b0b50 legacy=0x7fdb4406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.789+0000 7fdb4259c640 1 -- 172.21.15.49:0/893803138 >> v1:172.21.15.49:6789/0 conn(0x7fdb4406c6b0 legacy=0x7fdb440b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.789+0000 7fdb41d9b640 1 -- 172.21.15.49:0/893803138 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978553320 0 0) 0x7fdb440afb10 con 0x7fdb4406c6b0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.789+0000 7fdb4259c640 1 -- 172.21.15.49:0/893803138 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440b0350 con 0x7fdb441449e0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.790+0000 7fdb4259c640 1 --2- 172.21.15.49:0/893803138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb441449e0 0x7fdb440af5d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097a0 tx=0x7fdb3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7b35aa7e1420a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.790+0000 7fdb41d9b640 1 -- 172.21.15.49:0/893803138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34031830 con 0x7fdb441449e0 2023-12-19T05:52:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.790+0000 7fdb41d9b640 1 -- 172.21.15.49:0/893803138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34031990 con 0x7fdb441449e0 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.791+0000 7fdb41d9b640 1 -- 172.21.15.49:0/893803138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34031d20 con 0x7fdb441449e0 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.791+0000 7fdb48896640 1 -- 172.21.15.49:0/893803138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb441449e0 msgr2=0x7fdb440af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.791+0000 7fdb48896640 1 --2- 172.21.15.49:0/893803138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb441449e0 0x7fdb440af5d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097a0 tx=0x7fdb3402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.791+0000 7fdb48896640 1 -- 172.21.15.49:0/893803138 shutdown_connections 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.792+0000 7fdb48896640 1 --2- 172.21.15.49:0/893803138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb441449e0 0x7fdb440af5d0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.792+0000 7fdb48896640 1 -- 172.21.15.49:0/893803138 >> 172.21.15.49:0/893803138 conn(0x7fdb440cbb70 msgr2=0x7fdb440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.792+0000 7fdb48896640 1 -- 172.21.15.49:0/893803138 shutdown_connections 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.792+0000 7fdb48896640 1 -- 172.21.15.49:0/893803138 wait complete. 2023-12-19T05:52:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.793+0000 7fdb48896640 1 Processor -- start 2023-12-19T05:52:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.794+0000 7fdb48896640 1 -- start start 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.794+0000 7fdb48896640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb48896640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb440b0b50 0x7fdb4414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb48896640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb441449e0 0x7fdb4414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb48896640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4414b290 con 0x7fdb4406c6b0 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb48896640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4414b570 con 0x7fdb440b0b50 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb48896640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4414b850 con 0x7fdb441449e0 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38858/0 (socket says 172.21.15.49:38858) 2023-12-19T05:52:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 -- 172.21.15.49:0/3197489852 learned_addr learned my addr 172.21.15.49:0/3197489852 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 -- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb441449e0 msgr2=0x7fdb4414c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb441449e0 0x7fdb4414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 -- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb440b0b50 msgr2=0x7fdb4414a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb3bfff640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb440b0b50 0x7fdb4414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb440b0b50 0x7fdb4414a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.795+0000 7fdb4259c640 1 -- 172.21.15.49:0/3197489852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34009400 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb4259c640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097a0 tx=0x7fdb340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3403aa60 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3403abc0 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340443f0 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4414bb30 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.796+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4413cec0 con 0x7fdb4406c6b0 2023-12-19T05:52:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.798+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4414c050 con 0x7fdb4406c6b0 2023-12-19T05:52:32.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.799+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb3404d450 con 0x7fdb4406c6b0 2023-12-19T05:52:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.800+0000 7fdb3affd640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 0x7fdb2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.800+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb340aabe0 con 0x7fdb4406c6b0 2023-12-19T05:52:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.801+0000 7fdb3bfff640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 0x7fdb2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.802+0000 7fdb3bfff640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 0x7fdb2406c8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdb441f3c60 tx=0x7fdb2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:32.805+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb4414c050 con 0x7fdb4406c6b0 2023-12-19T05:52:33.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.003+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdb4414c050 con 0x7fdb4406c6b0 2023-12-19T05:52:33.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.005+0000 7fdb3affd640 1 -- 172.21.15.49:0/3197489852 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+33554 (secure 0 0 0) 0x7fdb4414c050 con 0x7fdb4406c6b0 2023-12-19T05:52:33.007 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:33.007 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:33.007 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 194, 2023-12-19T05:52:33.007 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:31.661288+0000", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:33.008 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:33.009 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:33.010 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:33.011 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:33.012 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:33.013 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:33.014 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:33.015 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.016 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:33.017 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:33.018 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:33.019 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:33.020 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:33.021 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "194", 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:33.022 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:33.023 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:33.024 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.025 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.027 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:33.030 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.031 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.032 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.034 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.037 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.041 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.042 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:33.044 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:33.054 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:33.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.056 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.057 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:33.062 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.063 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:33.065 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:33.066 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.068 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.070 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:33.071 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:33.072 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:33.073 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:33.074 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 msgr2=0x7fdb2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 0x7fdb2406c8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdb441f3c60 tx=0x7fdb2c009040 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 msgr2=0x7fdb4413c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097a0 tx=0x7fdb340046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 shutdown_connections 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fdb2406a430 0x7fdb2406c8f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb441449e0 0x7fdb4414c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb440b0b50 0x7fdb4414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 --2- 172.21.15.49:0/3197489852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4406c6b0 0x7fdb4413c980 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 >> 172.21.15.49:0/3197489852 conn(0x7fdb440cbb70 msgr2=0x7fdb440cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.008+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 shutdown_connections 2023-12-19T05:52:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:33.009+0000 7fdb48896640 1 -- 172.21.15.49:0/3197489852 wait complete. 2023-12-19T05:52:33.077 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:52:38.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:38.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.323+0000 7efc052f3640 1 Processor -- start 2023-12-19T05:52:38.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.323+0000 7efc052f3640 1 -- start start 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.325+0000 7efc052f3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc0015e5a0 0x7efc000b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.325+0000 7efc052f3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc0015f680 0x7efc000b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.325+0000 7efc052f3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0015ec30 con 0x7efc000cdbf0 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.325+0000 7efc052f3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000b2cc0 con 0x7efc0015e5a0 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.325+0000 7efc052f3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0015e980 con 0x7efc0015f680 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc0015e5a0 0x7efc000b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc0015e5a0 0x7efc000b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33852/0 (socket says 172.21.15.49:33852) 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 -- 172.21.15.49:0/3446027081 learned_addr learned my addr 172.21.15.49:0/3446027081 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbf7fff640 1 --2- 172.21.15.49:0/3446027081 >> v2:172.21.15.115:3300/0 conn(0x7efc0015f680 0x7efc000b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 -- 172.21.15.49:0/3446027081 >> v2:172.21.15.115:3300/0 conn(0x7efc0015f680 msgr2=0x7efc000b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 --2- 172.21.15.49:0/3446027081 >> v2:172.21.15.115:3300/0 conn(0x7efc0015f680 0x7efc000b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 -- 172.21.15.49:0/3446027081 >> v1:172.21.15.115:6789/0 conn(0x7efc000cdbf0 legacy=0x7efc0006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.326+0000 7efbfffff640 1 -- 172.21.15.49:0/3446027081 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000b2f90 con 0x7efc0015e5a0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.327+0000 7efbfffff640 1 --2- 172.21.15.49:0/3446027081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0015e5a0 0x7efc000b2030 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2276a23aaf4636 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.328+0000 7efbff7fe640 1 -- 172.21.15.49:0/3446027081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0031870 con 0x7efc0015e5a0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.328+0000 7efbff7fe640 1 -- 172.21.15.49:0/3446027081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00319d0 con 0x7efc0015e5a0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.328+0000 7efbff7fe640 1 -- 172.21.15.49:0/3446027081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0031d60 con 0x7efc0015e5a0 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.328+0000 7efc052f3640 1 -- 172.21.15.49:0/3446027081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0015e5a0 msgr2=0x7efc000b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.328+0000 7efc052f3640 1 --2- 172.21.15.49:0/3446027081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0015e5a0 0x7efc000b2030 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002b910 comp rx=0 tx=0).stop 2023-12-19T05:52:38.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 -- 172.21.15.49:0/3446027081 shutdown_connections 2023-12-19T05:52:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 --2- 172.21.15.49:0/3446027081 >> v2:172.21.15.115:3300/0 conn(0x7efc0015f680 0x7efc000b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 --2- 172.21.15.49:0/3446027081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0015e5a0 0x7efc000b2030 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 -- 172.21.15.49:0/3446027081 >> 172.21.15.49:0/3446027081 conn(0x7efc000b0100 msgr2=0x7efc000b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 -- 172.21.15.49:0/3446027081 shutdown_connections 2023-12-19T05:52:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.329+0000 7efc052f3640 1 -- 172.21.15.49:0/3446027081 wait complete. 2023-12-19T05:52:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.331+0000 7efc052f3640 1 Processor -- start 2023-12-19T05:52:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.331+0000 7efc052f3640 1 -- start start 2023-12-19T05:52:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0015e5a0 0x7efc001539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0015f680 0x7efc0015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc001544c0 con 0x7efc000cdbf0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc00150310 con 0x7efc0015f680 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc052f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc00153f10 con 0x7efc0015e5a0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efbfffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efbfffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33860/0 (socket says 172.21.15.49:33860) 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efbfffff640 1 -- 172.21.15.49:0/3837493775 learned_addr learned my addr 172.21.15.49:0/3837493775 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efc04af2640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0015f680 0x7efc0015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.332+0000 7efbf7fff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0015e5a0 0x7efc001539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 -- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0015e5a0 msgr2=0x7efc001539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0015e5a0 0x7efc001539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 -- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0015f680 msgr2=0x7efc0015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0015f680 0x7efc0015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00094d0 con 0x7efc000cdbf0 2023-12-19T05:52:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfffff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf003ac60 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf003adc0 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.333+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0044610 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.334+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc001541e0 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.334+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0014ff30 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.335+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0014fab0 con 0x7efc000cdbf0 2023-12-19T05:52:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.336+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efbf004d450 con 0x7efc000cdbf0 2023-12-19T05:52:38.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.337+0000 7efbfd7fa640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 0x7efbe006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:38.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.337+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbf002d040 con 0x7efc000cdbf0 2023-12-19T05:52:38.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.337+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7efbe0071f90 con 0x7efc000cdbf0 2023-12-19T05:52:38.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.337+0000 7efbf7fff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 0x7efbe006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.338+0000 7efbf7fff640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 0x7efbe006c920 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efbe8006fd0 tx=0x7efbe8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:38.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.341+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efbf0035020 con 0x7efc000cdbf0 2023-12-19T05:52:38.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.536+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efc00150450 con 0x7efc000cdbf0 2023-12-19T05:52:38.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.538+0000 7efbfd7fa640 1 -- 172.21.15.49:0/3837493775 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+33573 (secure 0 0 0) 0x7efc00150450 con 0x7efc000cdbf0 2023-12-19T05:52:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:38.540 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 195, 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:35.478967+0000", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:38.544 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:38.545 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:38.546 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:38.547 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:38.548 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:38.549 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:38.550 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:38.551 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:38.552 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:38.554 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:38.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "195", 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:38.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:38.557 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:38.558 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.560 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.561 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:38.563 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.564 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.566 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.569 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.570 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.571 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.574 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:38.575 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.576 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.577 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:38.578 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:38.579 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:38.580 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.581 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:38.582 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.584 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.587 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.591 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.592 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.594 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:38.596 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:38.597 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.599 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.600 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:38.601 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.602 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.603 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.604 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:38.605 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:38.606 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:38.607 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:38.609 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.540+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 msgr2=0x7efbe006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.540+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 0x7efbe006c920 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efbe8006fd0 tx=0x7efbe8008040 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.540+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 msgr2=0x7efc00150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.540+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf00046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 shutdown_connections 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efbe006a460 0x7efbe006c920 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0015e5a0 0x7efc001539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0015f680 0x7efc0015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 --2- 172.21.15.49:0/3837493775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc000cdbf0 0x7efc00150730 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 >> 172.21.15.49:0/3837493775 conn(0x7efc000b0100 msgr2=0x7efc000b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 shutdown_connections 2023-12-19T05:52:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:38.541+0000 7efc052f3640 1 -- 172.21.15.49:0/3837493775 wait complete. 2023-12-19T05:52:38.612 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T05:52:38.612 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:38.612 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:38.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:38.673 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-19T05:52:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-19T05:52:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:52:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:52:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.374134 s, 140 MB/s 2023-12-19T05:52:39.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:52:39.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.340+0000 7fb64b59e640 1 Processor -- start 2023-12-19T05:52:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.340+0000 7fb64b59e640 1 -- start start 2023-12-19T05:52:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.342+0000 7fb64b59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb64c15e5a0 0x7fb64c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.342+0000 7fb64b59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb64c15f680 0x7fb64c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.342+0000 7fb64b59e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c15ec30 con 0x7fb64c0cdbf0 2023-12-19T05:52:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.342+0000 7fb64b59e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c0b2cc0 con 0x7fb64c15e5a0 2023-12-19T05:52:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.342+0000 7fb64b59e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c15e980 con 0x7fb64c15f680 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64a59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb64c15e5a0 0x7fb64c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64ad9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb64c0cdbf0 0x7fb64c06c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49048/0 (socket says 172.21.15.49:49048) 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64ad9d640 1 -- 172.21.15.49:0/1394906003 learned_addr learned my addr 172.21.15.49:0/1394906003 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb643fff640 1 --2- 172.21.15.49:0/1394906003 >> v2:172.21.15.115:3300/0 conn(0x7fb64c15f680 0x7fb64c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64a59c640 1 -- 172.21.15.49:0/1394906003 >> v2:172.21.15.115:3300/0 conn(0x7fb64c15f680 msgr2=0x7fb64c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64a59c640 1 --2- 172.21.15.49:0/1394906003 >> v2:172.21.15.115:3300/0 conn(0x7fb64c15f680 0x7fb64c0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64a59c640 1 -- 172.21.15.49:0/1394906003 >> v1:172.21.15.49:6789/0 conn(0x7fb64c0cdbf0 legacy=0x7fb64c06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.343+0000 7fb64a59c640 1 -- 172.21.15.49:0/1394906003 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0b2f90 con 0x7fb64c15e5a0 2023-12-19T05:52:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.344+0000 7fb64a59c640 1 --2- 172.21.15.49:0/1394906003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c0b2030 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8d195ffec73ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb649d9b640 1 -- 172.21.15.49:0/1394906003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c031830 con 0x7fb64c15e5a0 2023-12-19T05:52:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb649d9b640 1 -- 172.21.15.49:0/1394906003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c031990 con 0x7fb64c15e5a0 2023-12-19T05:52:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb649d9b640 1 -- 172.21.15.49:0/1394906003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c031d20 con 0x7fb64c15e5a0 2023-12-19T05:52:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 -- 172.21.15.49:0/1394906003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 msgr2=0x7fb64c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 --2- 172.21.15.49:0/1394906003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c0b2030 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 -- 172.21.15.49:0/1394906003 shutdown_connections 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 --2- 172.21.15.49:0/1394906003 >> v2:172.21.15.115:3300/0 conn(0x7fb64c15f680 0x7fb64c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 --2- 172.21.15.49:0/1394906003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c0b2030 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.345+0000 7fb64b59e640 1 -- 172.21.15.49:0/1394906003 >> 172.21.15.49:0/1394906003 conn(0x7fb64c0b0100 msgr2=0x7fb64c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.346+0000 7fb64b59e640 1 -- 172.21.15.49:0/1394906003 shutdown_connections 2023-12-19T05:52:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.346+0000 7fb64b59e640 1 -- 172.21.15.49:0/1394906003 wait complete. 2023-12-19T05:52:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.347+0000 7fb64b59e640 1 Processor -- start 2023-12-19T05:52:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.347+0000 7fb64b59e640 1 -- start start 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 0x7fb64c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 0x7fb64c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1545e0 con 0x7fb64c15e5a0 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1539d0 con 0x7fb64c15f680 2023-12-19T05:52:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.348+0000 7fb64b59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c153cb0 con 0x7fb64c0cdbf0 2023-12-19T05:52:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33870/0 (socket says 172.21.15.49:33870) 2023-12-19T05:52:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 -- 172.21.15.49:0/2829074224 learned_addr learned my addr 172.21.15.49:0/2829074224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb64a59c640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 0x7fb64c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb64ad9d640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 0x7fb64c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 -- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 msgr2=0x7fb64c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 0x7fb64c152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 -- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 msgr2=0x7fb64c152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 0x7fb64c152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb643fff640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009400 con 0x7fb64c15e5a0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb64a59c640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 0x7fb64c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.349+0000 7fb64ad9d640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 0x7fb64c152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb643fff640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d5f0 tx=0x7fb63400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340125f0 con 0x7fb64c15e5a0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634012750 con 0x7fb64c15e5a0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634012b00 con 0x7fb64c15e5a0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c153f90 con 0x7fb64c15e5a0 2023-12-19T05:52:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.350+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c15dc10 con 0x7fb64c15e5a0 2023-12-19T05:52:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.351+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c061910 con 0x7fb64c15e5a0 2023-12-19T05:52:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.352+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb634012c60 con 0x7fb64c15e5a0 2023-12-19T05:52:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.353+0000 7fb642ffd640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 0x7fb62c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.353+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb634088de0 con 0x7fb64c15e5a0 2023-12-19T05:52:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.353+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fb62c071f90 con 0x7fb64c15e5a0 2023-12-19T05:52:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.354+0000 7fb64a59c640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 0x7fb62c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.355+0000 7fb64a59c640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 0x7fb62c06c920 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb63c036000 tx=0x7fb63c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.358+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb634054330 con 0x7fb64c15e5a0 2023-12-19T05:52:39.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.554+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb64c0ce980 con 0x7fb64c15e5a0 2023-12-19T05:52:39.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.556+0000 7fb642ffd640 1 -- 172.21.15.49:0/2829074224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+33573 (secure 0 0 0) 0x7fb634057950 con 0x7fb64c15e5a0 2023-12-19T05:52:39.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:39.561 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:39.561 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 195, 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:35.478967+0000", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:39.562 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:39.564 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:39.565 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:39.566 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:39.567 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.568 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:39.569 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:39.570 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:39.571 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:39.572 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:39.573 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:39.574 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:39.576 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "195", 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:39.577 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:39.578 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:39.579 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:39.580 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.581 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.582 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:39.586 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.587 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.588 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.589 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.592 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.596 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:39.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.603 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.604 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.605 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:39.607 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.609 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.610 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.611 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.612 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.613 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.617 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.618 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.619 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.620 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.621 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:39.622 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:39.623 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.624 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.625 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.627 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:39.628 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:39.629 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:39.630 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:39.631 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 msgr2=0x7fb62c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 0x7fb62c06c920 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb63c036000 tx=0x7fb63c008030 comp rx=0 tx=0).stop 2023-12-19T05:52:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 msgr2=0x7fb64c154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d5f0 tx=0x7fb63400dab0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 shutdown_connections 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb62c06a460 0x7fb62c06c920 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64c15f680 0x7fb64c152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64c15e5a0 0x7fb64c154a70 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 --2- 172.21.15.49:0/2829074224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb64c0cdbf0 0x7fb64c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 >> 172.21.15.49:0/2829074224 conn(0x7fb64c0b0100 msgr2=0x7fb64c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.559+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 shutdown_connections 2023-12-19T05:52:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.560+0000 7fb64b59e640 1 -- 172.21.15.49:0/2829074224 wait complete. 2023-12-19T05:52:39.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.869+0000 7f58b8aaf640 1 Processor -- start 2023-12-19T05:52:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.869+0000 7f58b8aaf640 1 -- start start 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.871+0000 7f58b8aaf640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f58b4157bf0 0x7f58b415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.871+0000 7f58b8aaf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40b0810 0x7f58b406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.871+0000 7f58b8aaf640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b415b740 con 0x7f58b40ae110 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.871+0000 7f58b8aaf640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b406b8c0 con 0x7f58b4157bf0 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.871+0000 7f58b8aaf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40ae640 con 0x7f58b40b0810 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.872+0000 7f58b1d9b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58b40ae110 0x7f58b40b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49052/0 (socket says 172.21.15.49:49052) 2023-12-19T05:52:39.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.872+0000 7f58b1d9b640 1 -- 172.21.15.49:0/1717669383 learned_addr learned my addr 172.21.15.49:0/1717669383 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.872+0000 7f58b259c640 1 --2- 172.21.15.49:0/1717669383 >> v2:172.21.15.115:3300/0 conn(0x7f58b4157bf0 0x7f58b415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.872+0000 7f58b2d9d640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40b0810 0x7f58b406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.873+0000 7f58b259c640 1 -- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40b0810 msgr2=0x7f58b406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.873+0000 7f58b259c640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40b0810 0x7f58b406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.873+0000 7f58b259c640 1 -- 172.21.15.49:0/1717669383 >> v1:172.21.15.49:6789/0 conn(0x7f58b40ae110 legacy=0x7f58b40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.873+0000 7f58b259c640 1 -- 172.21.15.49:0/1717669383 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40ae920 con 0x7f58b4157bf0 2023-12-19T05:52:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.874+0000 7f58b259c640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b4157bf0 0x7f58b415b200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e7b76c5dd9ce6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.879+0000 7f58b159a640 1 -- 172.21.15.49:0/1717669383 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a402d040 con 0x7f58b4157bf0 2023-12-19T05:52:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b159a640 1 -- 172.21.15.49:0/1717669383 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4031810 con 0x7f58b4157bf0 2023-12-19T05:52:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b159a640 1 -- 172.21.15.49:0/1717669383 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4031ba0 con 0x7f58b4157bf0 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 -- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b4157bf0 msgr2=0x7f58b415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b4157bf0 0x7f58b415b200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 -- 172.21.15.49:0/1717669383 shutdown_connections 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40b0810 0x7f58b406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/1717669383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b4157bf0 0x7f58b415b200 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.880+0000 7f58b8aaf640 1 -- 172.21.15.49:0/1717669383 >> 172.21.15.49:0/1717669383 conn(0x7f58b40cbb70 msgr2=0x7f58b40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:39.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.881+0000 7f58b8aaf640 1 -- 172.21.15.49:0/1717669383 shutdown_connections 2023-12-19T05:52:39.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.881+0000 7f58b8aaf640 1 -- 172.21.15.49:0/1717669383 wait complete. 2023-12-19T05:52:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.882+0000 7f58b8aaf640 1 Processor -- start 2023-12-19T05:52:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.883+0000 7f58b8aaf640 1 -- start start 2023-12-19T05:52:39.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40ae110 0x7f58b40c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b40b0810 0x7f58b4147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40c3640 con 0x7f58b4157bf0 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41f2cf0 con 0x7f58b40b0810 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b8aaf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41f2fd0 con 0x7f58b40ae110 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33884/0 (socket says 172.21.15.49:33884) 2023-12-19T05:52:39.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 -- 172.21.15.49:0/21916590 learned_addr learned my addr 172.21.15.49:0/21916590 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 -- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40ae110 msgr2=0x7f58b40c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b259c640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40ae110 0x7f58b40c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b1d9b640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b40b0810 0x7f58b4147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40ae110 0x7f58b40c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 -- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b40b0810 msgr2=0x7f58b4147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.884+0000 7f58b2d9d640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b40b0810 0x7f58b4147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58b2d9d640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009400 con 0x7f58b4157bf0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58b2d9d640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00efc0 tx=0x7f58ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac009ca0 con 0x7f58b4157bf0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac00f040 con 0x7f58b4157bf0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0146c0 con 0x7f58b4157bf0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b41f32b0 con 0x7f58b4157bf0 2023-12-19T05:52:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.885+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b4147b70 con 0x7f58b4157bf0 2023-12-19T05:52:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.887+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b4149750 con 0x7f58b4157bf0 2023-12-19T05:52:39.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.887+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58ac014820 con 0x7f58b4157bf0 2023-12-19T05:52:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.888+0000 7f58a2ffd640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 0x7f589406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.888+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58ac089790 con 0x7f58b4157bf0 2023-12-19T05:52:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.889+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f5894071f90 con 0x7f58b4157bf0 2023-12-19T05:52:39.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.889+0000 7f58b259c640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 0x7f589406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:39.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.890+0000 7f58b259c640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 0x7f589406c920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:39.892+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f58ac018060 con 0x7f58b4157bf0 2023-12-19T05:52:40.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.124+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b4061910 con 0x7f58b4157bf0 2023-12-19T05:52:40.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.125+0000 7f58a2ffd640 1 -- 172.21.15.49:0/21916590 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f58b4149750 con 0x7f58b4157bf0 2023-12-19T05:52:40.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:40.128 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:52:40.128 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 msgr2=0x7f589406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 0x7f589406c920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a403c040 comp rx=0 tx=0).stop 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 msgr2=0x7f58b4146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00efc0 tx=0x7f58ac00c490 comp rx=0 tx=0).stop 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 shutdown_connections 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f589406a460 0x7f589406c920 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b4157bf0 0x7f58b4146d70 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b40b0810 0x7f58b4147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 --2- 172.21.15.49:0/21916590 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58b40ae110 0x7f58b40c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 >> 172.21.15.49:0/21916590 conn(0x7f58b40cbb70 msgr2=0x7f58b40ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.128+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 shutdown_connections 2023-12-19T05:52:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.129+0000 7f58b8aaf640 1 -- 172.21.15.49:0/21916590 wait complete. 2023-12-19T05:52:40.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:52:40.388 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":8886,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.290225891999999,"mdsmap_epoch":88,"osdmap_epoch":195,"osdmap_epoch_barrier":195,"uptime":27.066629070000001} 2023-12-19T05:52:40.388 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 8886, "mdsmap_epoch": 88, "osdmap_epoch": 195, "osdmap_epoch_barrier": 195, "rank_uptime": 21.290225892, "state": "up:active", "uptime": 27.06662907, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:52:40.389 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:52:40.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:40.389 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-19T05:52:40.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:40.459 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-19T05:52:40.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.784+0000 7f868d504640 1 Processor -- start 2023-12-19T05:52:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.785+0000 7f868d504640 1 -- start start 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f868d504640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86880d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f868d504640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880d12d0 con 0x7f8688146e30 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f868d504640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880d15b0 con 0x7f86880d0a90 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f868d504640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8688147210 con 0x7f86880b8070 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f8687fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8688146e30 0x7f86880b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49062/0 (socket says 172.21.15.49:49062) 2023-12-19T05:52:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.786+0000 7f8687fff640 1 -- 172.21.15.49:0/2635327998 learned_addr learned my addr 172.21.15.49:0/2635327998 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013175330 0 0) 0x7f86880d12d0 con 0x7f8688146e30 2023-12-19T05:52:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8670003520 con 0x7f8688146e30 2023-12-19T05:52:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f86877fe640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86880d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671268069 0 0) 0x7f8670003520 con 0x7f8688146e30 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 msgr2=0x7f86880d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86880d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 >> v1:172.21.15.115:6789/0 conn(0x7f86880d0a90 legacy=0x7f868815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880d1890 con 0x7f8688146e30 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f8678001670 con 0x7f8688146e30 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 >> v1:172.21.15.49:6789/0 conn(0x7f8688146e30 legacy=0x7f86880b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86700039a0 0x7f8670003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8670004d00 0x7f8670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688147210 con 0x7f8670004d00 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867000bc30 con 0x7f86700039a0 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.787+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867000bdf0 con 0x7f86880b8070 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8670004d00 0x7f8670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f8687fff640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86700039a0 0x7f8670003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f86877fe640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 -- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 msgr2=0x7f86700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86880b8070 0x7f86700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 -- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86700039a0 msgr2=0x7f8670003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86700039a0 0x7f8670003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.788+0000 7f868cd03640 1 -- 172.21.15.49:0/2635327998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670003520 con 0x7f8670004d00 2023-12-19T05:52:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.789+0000 7f868cd03640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8670004d00 0x7f8670005180 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8680001e50 tx=0x7f86700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a7b4137ba1cd2b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680003b70 con 0x7f8670004d00 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8680003cd0 con 0x7f8670004d00 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f8686ffd640 1 -- 172.21.15.49:0/2635327998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680005310 con 0x7f8670004d00 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 -- 172.21.15.49:0/2635327998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8670004d00 msgr2=0x7f8670005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 --2- 172.21.15.49:0/2635327998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8670004d00 0x7f8670005180 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8680001e50 tx=0x7f86700057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868cd03640 1 -- 172.21.15.49:0/2635327998 reap_dead start 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 -- 172.21.15.49:0/2635327998 shutdown_connections 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 -- 172.21.15.49:0/2635327998 >> 172.21.15.49:0/2635327998 conn(0x7f86880b2990 msgr2=0x7f86880b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 -- 172.21.15.49:0/2635327998 shutdown_connections 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.790+0000 7f868d504640 1 -- 172.21.15.49:0/2635327998 wait complete. 2023-12-19T05:52:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.792+0000 7f868d504640 1 Processor -- start 2023-12-19T05:52:40.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.792+0000 7f868d504640 1 -- start start 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86881dd940 0x7f86881dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8688142d40 0x7f86881431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881428b0 con 0x7f86881dc790 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688141ca0 con 0x7f86881dd940 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.793+0000 7f868d504640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8688141f80 con 0x7f8688142d40 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33904/0 (socket says 172.21.15.49:33904) 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 -- 172.21.15.49:0/3450094475 learned_addr learned my addr 172.21.15.49:0/3450094475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f86877fe640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86881dd940 0x7f86881dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f868cd03640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8688142d40 0x7f86881431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 -- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8688142d40 msgr2=0x7f86881431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8688142d40 0x7f86881431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 -- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86881dd940 msgr2=0x7f86881dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86881dd940 0x7f86881dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.794+0000 7f8687fff640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688142260 con 0x7f86881dc790 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f8687fff640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f8678007290 tx=0x7f8678007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800f940 con 0x7f86881dc790 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800fae0 con 0x7f86881dc790 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800fe90 con 0x7f86881dc790 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8688142540 con 0x7f86881dc790 2023-12-19T05:52:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.795+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868813f9d0 con 0x7f86881dc790 2023-12-19T05:52:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.796+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688142700 con 0x7f86881dc790 2023-12-19T05:52:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.797+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f867801d460 con 0x7f86881dc790 2023-12-19T05:52:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.798+0000 7f8684ff9640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 0x7f867406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.799+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8678088c60 con 0x7f86881dc790 2023-12-19T05:52:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.799+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f8674071f90 con 0x7f86881dc790 2023-12-19T05:52:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.799+0000 7f86877fe640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 0x7f867406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.800+0000 7f86877fe640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 0x7f867406c920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f86881f5dd0 tx=0x7f867c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:40.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:40.807+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8678054120 con 0x7f86881dc790 2023-12-19T05:52:41.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.008+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f868813fbc0 con 0x7f86881dc790 2023-12-19T05:52:41.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.012+0000 7f8684ff9640 1 -- 172.21.15.49:0/3450094475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+33573 (secure 0 0 0) 0x7f8678057740 con 0x7f86881dc790 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 195, 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:41.014 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:35.478967+0000", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:41.015 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:41.017 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:41.018 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.021 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:41.022 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:41.023 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:41.024 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:41.025 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:41.026 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:41.027 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:41.028 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:41.029 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "195", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:41.031 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:41.032 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:41.033 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:41.034 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:41.035 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.036 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.037 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.038 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.040 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.041 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.047 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.051 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.051 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.051 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:41.052 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.054 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.055 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.056 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:41.059 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.060 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.061 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.063 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:41.064 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:41.065 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.067 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:41.068 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:41.069 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.070 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.071 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.072 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.073 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:41.075 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:41.076 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.078 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.079 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:41.080 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.081 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.083 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:41.084 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.085 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:41.086 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:41.088 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 msgr2=0x7f867406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 0x7f867406c920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f86881f5dd0 tx=0x7f867c008040 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 msgr2=0x7f868813f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f8678007290 tx=0x7f8678007690 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 shutdown_connections 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f867406a460 0x7f867406c920 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8688142d40 0x7f86881431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86881dd940 0x7f86881dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 --2- 172.21.15.49:0/3450094475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86881dc790 0x7f868813f490 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 >> 172.21.15.49:0/3450094475 conn(0x7f86880b2990 msgr2=0x7f86880b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.014+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 shutdown_connections 2023-12-19T05:52:41.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:41.015+0000 7f868d504640 1 -- 172.21.15.49:0/3450094475 wait complete. 2023-12-19T05:52:41.091 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:52:46.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.333+0000 7f9ef20cc640 1 Processor -- start 2023-12-19T05:52:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.333+0000 7f9ef20cc640 1 -- start start 2023-12-19T05:52:46.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef20cc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9eec0b2030 0x7f9eec15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef20cc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9eec0cdbf0 0x7f9eec0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef20cc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec15ec30 con 0x7f9eec15e5a0 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef20cc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec15fbc0 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef20cc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0ce560 con 0x7f9eec0b2030 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef10ca640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9eec15e5a0 0x7f9eec0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60366/0 (socket says 172.21.15.49:60366) 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef10ca640 1 -- 172.21.15.49:0/1740439568 learned_addr learned my addr 172.21.15.49:0/1740439568 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef18cb640 1 --2- 172.21.15.49:0/1740439568 >> v2:172.21.15.49:3300/0 conn(0x7f9eec0cdbf0 0x7f9eec0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.335+0000 7f9ef08c9640 1 --2- 172.21.15.49:0/1740439568 >> v2:172.21.15.115:3300/0 conn(0x7f9eec0b2030 0x7f9eec15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.336+0000 7f9ef18cb640 1 -- 172.21.15.49:0/1740439568 >> v2:172.21.15.115:3300/0 conn(0x7f9eec0b2030 msgr2=0x7f9eec15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.336+0000 7f9ef18cb640 1 --2- 172.21.15.49:0/1740439568 >> v2:172.21.15.115:3300/0 conn(0x7f9eec0b2030 0x7f9eec15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.336+0000 7f9ef18cb640 1 -- 172.21.15.49:0/1740439568 >> v1:172.21.15.49:6789/0 conn(0x7f9eec15e5a0 legacy=0x7f9eec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.336+0000 7f9ef18cb640 1 -- 172.21.15.49:0/1740439568 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec15e980 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.336+0000 7f9ee3fff640 1 -- 172.21.15.49:0/1740439568 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877959676 0 0) 0x7f9eec15ec30 con 0x7f9eec15e5a0 2023-12-19T05:52:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.337+0000 7f9ef18cb640 1 --2- 172.21.15.49:0/1740439568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0cdbf0 0x7f9eec0ce020 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009d90 tx=0x7f9ee402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598521400080beec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.338+0000 7f9ee3fff640 1 -- 172.21.15.49:0/1740439568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee402cc60 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.338+0000 7f9ee3fff640 1 -- 172.21.15.49:0/1740439568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee402cdc0 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.338+0000 7f9ee3fff640 1 -- 172.21.15.49:0/1740439568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4034660 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.338+0000 7f9ef20cc640 1 -- 172.21.15.49:0/1740439568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0cdbf0 msgr2=0x7f9eec0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/1740439568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0cdbf0 0x7f9eec0ce020 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009d90 tx=0x7f9ee402beb0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 -- 172.21.15.49:0/1740439568 shutdown_connections 2023-12-19T05:52:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/1740439568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0cdbf0 0x7f9eec0ce020 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/1740439568 >> v2:172.21.15.115:3300/0 conn(0x7f9eec0b2030 0x7f9eec15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 -- 172.21.15.49:0/1740439568 >> 172.21.15.49:0/1740439568 conn(0x7f9eec0b0100 msgr2=0x7f9eec0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 -- 172.21.15.49:0/1740439568 shutdown_connections 2023-12-19T05:52:46.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.339+0000 7f9ef20cc640 1 -- 172.21.15.49:0/1740439568 wait complete. 2023-12-19T05:52:46.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.341+0000 7f9ef20cc640 1 Processor -- start 2023-12-19T05:52:46.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.341+0000 7f9ef20cc640 1 -- start start 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 0x7f9eec0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 0x7f9eec06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0b0d80 con 0x7f9eec0b2030 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0cb350 con 0x7f9eec15e5a0 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef20cc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0cb020 con 0x7f9eec0cdbf0 2023-12-19T05:52:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef10ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef10ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43572/0 (socket says 172.21.15.49:43572) 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef10ca640 1 -- 172.21.15.49:0/2685186042 learned_addr learned my addr 172.21.15.49:0/2685186042 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef18cb640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 0x7f9eec06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.343+0000 7f9ef08c9640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 0x7f9eec0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 -- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 msgr2=0x7f9eec0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 0x7f9eec0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 -- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 msgr2=0x7f9eec06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 0x7f9eec06f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4009a70 con 0x7f9eec0b2030 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef08c9640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 0x7f9eec0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef18cb640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 0x7f9eec06f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef10ca640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c4d0 tx=0x7f9ee800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80074e0 con 0x7f9eec0b2030 2023-12-19T05:52:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee8007660 con 0x7f9eec0b2030 2023-12-19T05:52:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004a20 con 0x7f9eec0b2030 2023-12-19T05:52:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0b04e0 con 0x7f9eec0b2030 2023-12-19T05:52:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.344+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec0b0aa0 con 0x7f9eec0b2030 2023-12-19T05:52:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.346+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec061910 con 0x7f9eec0b2030 2023-12-19T05:52:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.347+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ee8004b80 con 0x7f9eec0b2030 2023-12-19T05:52:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.348+0000 7f9ee1ffb640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 0x7f9ed006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.348+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee8087b70 con 0x7f9eec0b2030 2023-12-19T05:52:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.348+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f9ed0071f90 con 0x7f9eec0b2030 2023-12-19T05:52:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.349+0000 7f9ef08c9640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 0x7f9ed006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.350+0000 7f9ef08c9640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 0x7f9ed006c920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b2710 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:46.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.352+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ee8018020 con 0x7f9eec0b2030 2023-12-19T05:52:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.548+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9eec15f9a0 con 0x7f9eec0b2030 2023-12-19T05:52:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.550+0000 7f9ee1ffb640 1 -- 172.21.15.49:0/2685186042 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+33573 (secure 0 0 0) 0x7f9ee80530c0 con 0x7f9eec0b2030 2023-12-19T05:52:46.552 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:46.552 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 195, 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:35.478967+0000", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:46.553 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:46.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:46.555 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:46.556 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:46.557 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:46.558 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:46.559 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:46.560 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:46.562 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:46.563 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:46.564 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:46.565 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:46.566 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1027, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:46.567 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:46.568 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "195", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:46.569 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:46.570 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:46.571 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:46.572 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.573 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.574 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.576 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.578 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.579 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.582 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:46.583 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.585 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.586 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.587 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:46.589 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.591 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.593 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:46.594 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.595 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.596 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.597 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.599 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:46.600 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.601 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.602 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.603 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.605 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:46.606 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.607 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.608 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:46.609 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:46.612 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:46.613 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.614 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:46.616 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:46.617 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.618 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.619 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.620 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.622 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:46.623 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:46.624 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.552+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 msgr2=0x7f9ed006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.552+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 0x7f9ed006c920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b2710 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.552+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 msgr2=0x7f9eec156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.552+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c4d0 tx=0x7f9ee800c990 comp rx=0 tx=0).stop 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 shutdown_connections 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9ed006a460 0x7f9ed006c920 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9eec0cdbf0 0x7f9eec0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9eec15e5a0 0x7f9eec06f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 --2- 172.21.15.49:0/2685186042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eec0b2030 0x7f9eec156100 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 >> 172.21.15.49:0/2685186042 conn(0x7f9eec0b0100 msgr2=0x7f9eec157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 shutdown_connections 2023-12-19T05:52:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:46.553+0000 7f9ef20cc640 1 -- 172.21.15.49:0/2685186042 wait complete. 2023-12-19T05:52:46.628 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-19T05:52:51.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:51.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.871+0000 7fb55559e640 1 Processor -- start 2023-12-19T05:52:51.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.871+0000 7fb55559e640 1 -- start start 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 0x7fb5500b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 0x7fb5500d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5500d0a90 0x7fb55006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb550147210 con 0x7fb5500d0a90 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500d2370 con 0x7fb550146e30 2023-12-19T05:52:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.872+0000 7fb55559e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500b8300 con 0x7fb5500b7ea0 2023-12-19T05:52:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5500d0a90 0x7fb55006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5500d0a90 0x7fb55006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43586/0 (socket says 172.21.15.49:43586) 2023-12-19T05:52:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 -- 172.21.15.49:0/2139803432 learned_addr learned my addr 172.21.15.49:0/2139803432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2139803432 >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 0x7fb5500b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb54f7fe640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 0x7fb5500d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 -- 172.21.15.49:0/2139803432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 msgr2=0x7fb5500d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 0x7fb5500d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 -- 172.21.15.49:0/2139803432 >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 msgr2=0x7fb5500b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 --2- 172.21.15.49:0/2139803432 >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 0x7fb5500b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb554d9d640 1 -- 172.21.15.49:0/2139803432 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5500d12d0 con 0x7fb5500d0a90 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2139803432 >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 0x7fb5500b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.873+0000 7fb54f7fe640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 0x7fb5500d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.874+0000 7fb554d9d640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5500d0a90 0x7fb55006f160 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb5500b85a0 tx=0x7fb54802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaad8e552604666d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb54effd640 1 -- 172.21.15.49:0/2139803432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480317c0 con 0x7fb5500d0a90 2023-12-19T05:52:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb54effd640 1 -- 172.21.15.49:0/2139803432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548031920 con 0x7fb5500d0a90 2023-12-19T05:52:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb54effd640 1 -- 172.21.15.49:0/2139803432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548031cb0 con 0x7fb5500d0a90 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 -- 172.21.15.49:0/2139803432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5500d0a90 msgr2=0x7fb55006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5500d0a90 0x7fb55006f160 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb5500b85a0 tx=0x7fb54802b860 comp rx=0 tx=0).stop 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 -- 172.21.15.49:0/2139803432 shutdown_connections 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5500d0a90 0x7fb55006f160 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 --2- 172.21.15.49:0/2139803432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500b7ea0 0x7fb5500d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 --2- 172.21.15.49:0/2139803432 >> v2:172.21.15.115:3300/0 conn(0x7fb550146e30 0x7fb5500b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.875+0000 7fb55559e640 1 -- 172.21.15.49:0/2139803432 >> 172.21.15.49:0/2139803432 conn(0x7fb5500b2990 msgr2=0x7fb5500b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.876+0000 7fb55559e640 1 -- 172.21.15.49:0/2139803432 shutdown_connections 2023-12-19T05:52:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.876+0000 7fb55559e640 1 -- 172.21.15.49:0/2139803432 wait complete. 2023-12-19T05:52:51.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.877+0000 7fb55559e640 1 Processor -- start 2023-12-19T05:52:51.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.878+0000 7fb55559e640 1 -- start start 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.878+0000 7fb55559e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5500b7ea0 0x7fb5501e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb55559e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500d0a90 0x7fb550131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb55559e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb55559e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501314b0 con 0x7fb550146e30 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb55559e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501e7380 con 0x7fb5500b7ea0 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb55559e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550131940 con 0x7fb5500d0a90 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43590/0 (socket says 172.21.15.49:43590) 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 -- 172.21.15.49:0/1597826887 learned_addr learned my addr 172.21.15.49:0/1597826887 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 -- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500d0a90 msgr2=0x7fb550131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500d0a90 0x7fb550131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 -- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5500b7ea0 msgr2=0x7fb5501e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5500b7ea0 0x7fb5501e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.879+0000 7fb554d9d640 1 -- 172.21.15.49:0/1597826887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480094d0 con 0x7fb550146e30 2023-12-19T05:52:51.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb554d9d640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548032860 con 0x7fb550146e30 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480329e0 con 0x7fb550146e30 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501308a0 con 0x7fb550146e30 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548032d90 con 0x7fb550146e30 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.880+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550130e60 con 0x7fb550146e30 2023-12-19T05:52:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.881+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550061910 con 0x7fb550146e30 2023-12-19T05:52:51.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.882+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb54804e450 con 0x7fb550146e30 2023-12-19T05:52:51.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.883+0000 7fb54cff9640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 0x7fb53c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:51.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.883+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5480aace0 con 0x7fb550146e30 2023-12-19T05:52:51.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.884+0000 7fb54ffff640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 0x7fb53c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:51.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.885+0000 7fb54ffff640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 0x7fb53c06c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb540008ea0 tx=0x7fb5400083d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:51.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:51.888+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb548076350 con 0x7fb550146e30 2023-12-19T05:52:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.089+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5501315f0 con 0x7fb550146e30 2023-12-19T05:52:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.092+0000 7fb54cff9640 1 -- 172.21.15.49:0/1597826887 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v196) v1 ==== 81+0+33554 (secure 0 0 0) 0x7fb548079970 con 0x7fb550146e30 2023-12-19T05:52:52.094 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:52.094 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:52.094 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 196, 2023-12-19T05:52:52.094 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:52.094 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:50.485345+0000", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.096 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:52.097 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.098 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.099 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.100 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.101 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.102 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.103 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.105 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.108 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.109 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "196", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.110 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.111 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.112 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.113 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.114 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:52.116 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.120 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.121 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:52.123 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.124 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:52.125 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.126 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:52.128 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.129 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.131 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.132 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:52.133 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.134 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.136 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.137 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:52.138 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.139 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.140 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.142 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:52.143 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.144 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:52.145 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:52.148 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.149 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:52.150 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.151 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:52.153 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.154 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.156 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.158 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.161 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.094+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 msgr2=0x7fb53c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.094+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 0x7fb53c06c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb540008ea0 tx=0x7fb5400083d0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.094+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 msgr2=0x7fb5501320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.094+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb5480046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 shutdown_connections 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb53c06a430 0x7fb53c06c8f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500d0a90 0x7fb550131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550146e30 0x7fb5501320e0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 --2- 172.21.15.49:0/1597826887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5500b7ea0 0x7fb5501e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 >> 172.21.15.49:0/1597826887 conn(0x7fb5500b2990 msgr2=0x7fb5501e3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 shutdown_connections 2023-12-19T05:52:52.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.095+0000 7fb55559e640 1 -- 172.21.15.49:0/1597826887 wait complete. 2023-12-19T05:52:52.164 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-19T05:52:52.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-19T05:52:52.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.405+0000 7f3e28973640 1 Processor -- start 2023-12-19T05:52:52.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.406+0000 7f3e28973640 1 -- start start 2023-12-19T05:52:52.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.407+0000 7f3e28973640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e24146e10 0x7f3e240d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.407+0000 7f3e28973640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3e240d2b00 0x7f3e240b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.407+0000 7f3e28973640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240cd840 con 0x7f3e240ce110 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e28973640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240d2430 con 0x7f3e24146e10 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e28973640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240d2620 con 0x7f3e240d2b00 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e2259c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e24146e10 0x7f3e240d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e22d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3e240ce110 0x7f3e240b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60382/0 (socket says 172.21.15.49:60382) 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e22d9d640 1 -- 172.21.15.49:0/3110704811 learned_addr learned my addr 172.21.15.49:0/3110704811 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e21d9b640 1 --2- 172.21.15.49:0/3110704811 >> v2:172.21.15.115:3300/0 conn(0x7f3e240d2b00 0x7f3e240b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e2259c640 1 -- 172.21.15.49:0/3110704811 >> v2:172.21.15.115:3300/0 conn(0x7f3e240d2b00 msgr2=0x7f3e240b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e2259c640 1 --2- 172.21.15.49:0/3110704811 >> v2:172.21.15.115:3300/0 conn(0x7f3e240d2b00 0x7f3e240b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e2259c640 1 -- 172.21.15.49:0/3110704811 >> v1:172.21.15.49:6789/0 conn(0x7f3e240ce110 legacy=0x7f3e240b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.408+0000 7f3e2259c640 1 -- 172.21.15.49:0/3110704811 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240b41c0 con 0x7f3e24146e10 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.409+0000 7f3e2259c640 1 --2- 172.21.15.49:0/3110704811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e24146e10 0x7f3e240d1ef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f3e240d3360 tx=0x7f3e0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9320a023b96318de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.410+0000 7f3e2159a640 1 -- 172.21.15.49:0/3110704811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c02e070 con 0x7f3e24146e10 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.410+0000 7f3e2159a640 1 -- 172.21.15.49:0/3110704811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0315a0 con 0x7f3e24146e10 2023-12-19T05:52:52.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.410+0000 7f3e2159a640 1 -- 172.21.15.49:0/3110704811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c031930 con 0x7f3e24146e10 2023-12-19T05:52:52.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.410+0000 7f3e28973640 1 -- 172.21.15.49:0/3110704811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e24146e10 msgr2=0x7f3e240d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.410+0000 7f3e28973640 1 --2- 172.21.15.49:0/3110704811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e24146e10 0x7f3e240d1ef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f3e240d3360 tx=0x7f3e0c02b840 comp rx=0 tx=0).stop 2023-12-19T05:52:52.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 -- 172.21.15.49:0/3110704811 shutdown_connections 2023-12-19T05:52:52.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 --2- 172.21.15.49:0/3110704811 >> v2:172.21.15.115:3300/0 conn(0x7f3e240d2b00 0x7f3e240b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 --2- 172.21.15.49:0/3110704811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e24146e10 0x7f3e240d1ef0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 -- 172.21.15.49:0/3110704811 >> 172.21.15.49:0/3110704811 conn(0x7f3e240b29c0 msgr2=0x7f3e240b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 -- 172.21.15.49:0/3110704811 shutdown_connections 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.411+0000 7f3e28973640 1 -- 172.21.15.49:0/3110704811 wait complete. 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.412+0000 7f3e28973640 1 Processor -- start 2023-12-19T05:52:52.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.413+0000 7f3e28973640 1 -- start start 2023-12-19T05:52:52.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.413+0000 7f3e28973640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.413+0000 7f3e28973640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e240d2b00 0x7f3e24142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.413+0000 7f3e28973640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e24146e10 0x7f3e240b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e28973640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2413d0a0 con 0x7f3e240ce110 2023-12-19T05:52:52.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e28973640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24145f40 con 0x7f3e240d2b00 2023-12-19T05:52:52.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e28973640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2415ee90 con 0x7f3e24146e10 2023-12-19T05:52:52.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43602/0 (socket says 172.21.15.49:43602) 2023-12-19T05:52:52.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 -- 172.21.15.49:0/3559747060 learned_addr learned my addr 172.21.15.49:0/3559747060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 -- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e24146e10 msgr2=0x7f3e240b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e24146e10 0x7f3e240b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e21d9b640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e240d2b00 0x7f3e24142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 -- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e240d2b00 msgr2=0x7f3e24142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e240d2b00 0x7f3e24142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.414+0000 7f3e2259c640 1 -- 172.21.15.49:0/3559747060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009400 con 0x7f3e240ce110 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e2259c640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02be50 tx=0x7f3e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c032900 con 0x7f3e240ce110 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c032a60 con 0x7f3e240ce110 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2415fa10 con 0x7f3e240ce110 2023-12-19T05:52:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c032e10 con 0x7f3e240ce110 2023-12-19T05:52:52.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.415+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2415f3c0 con 0x7f3e240ce110 2023-12-19T05:52:52.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.416+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24061910 con 0x7f3e240ce110 2023-12-19T05:52:52.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.417+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e0c0453f0 con 0x7f3e240ce110 2023-12-19T05:52:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.418+0000 7f3e1affd640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 0x7f3e0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.418+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0c0aab60 con 0x7f3e240ce110 2023-12-19T05:52:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.419+0000 7f3e21d9b640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 0x7f3e0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.420+0000 7f3e21d9b640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 0x7f3e0406c8f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3e2415b660 tx=0x7f3e14008440 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.423+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e0c076270 con 0x7f3e240ce110 2023-12-19T05:52:52.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.621+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3e240d3dd0 con 0x7f3e240ce110 2023-12-19T05:52:52.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.623+0000 7f3e1affd640 1 -- 172.21.15.49:0/3559747060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v196) v1 ==== 81+0+33554 (secure 0 0 0) 0x7f3e0c079890 con 0x7f3e240ce110 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 196, 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2023-12-19T05:38:45.391423+0000", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2023-12-19T05:52:50.485345+0000", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2023-12-19T05:38:51.926430+0000", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2023-12-19T05:38:48.903493+0000", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5799936, 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2023-12-19T05:52:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.69999998807907104, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 23, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 8, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2023-12-19T05:52:52.627 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:38:52.584713+0000", 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.628 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.629 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "116", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.630 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.631 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.632 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 8, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 8, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.25, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 22, 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:17.038396+0000", 2023-12-19T05:52:52.633 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2023-12-19T05:52:52.634 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "192", 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.635 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.636 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.637 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.638 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:52.639 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 23, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2023-12-19T05:52:18.108157+0000", 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2023-12-19T05:52:52.640 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2023-12-19T05:52:52.641 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2023-12-19T05:52:52.643 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "196", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2023-12-19T05:52:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 33554432, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2023-12-19T05:52:52.645 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2023-12-19T05:52:52.646 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2023-12-19T05:52:52.647 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.3799999952316284, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.3799999952316284, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2023-12-19T05:52:52.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.649 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6802", 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6803", 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6806", 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6807", 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.652 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6804", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6805", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84033 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6801/84033", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6803/84033", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6807/84033", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6805/84033", 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.654 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6822", 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6824", 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6826", 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6827", 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.656 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.657 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.657 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.657 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.657 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6830", 2023-12-19T05:52:52.657 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6831", 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6828", 2023-12-19T05:52:52.658 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6829", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84036 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6824/84036", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6827/84036", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6831/84036", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6829/84036", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.659 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.660 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6808", 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6811", 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.661 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6813", 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6816", 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.662 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6823", 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6825", 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.663 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6818", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6820", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84037 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6811/84037", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6816/84037", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6825/84037", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6820/84037", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.664 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.665 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6809", 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6810", 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.666 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6812", 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6814", 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6819", 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6821", 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.668 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6815", 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6817", 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84034 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.49:6810/84034", 2023-12-19T05:52:52.669 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.49:6814/84034", 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.49:6821/84034", 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.49:6817/84034", 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.670 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6800", 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6801", 2023-12-19T05:52:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6802", 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6803", 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.672 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6808", 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6810", 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.673 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6804", 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6806", 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84440 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6801/84440", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6803/84440", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6810/84440", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6806/84440", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.675 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6805", 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6807", 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6809", 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6811", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6816", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6819", 2023-12-19T05:52:52.678 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6812", 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6813", 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84439 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.679 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6807/84439", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6811/84439", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6819/84439", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6813/84439", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.680 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6814", 2023-12-19T05:52:52.681 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6815", 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6817", 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.682 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6818", 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6822", 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6823", 2023-12-19T05:52:52.683 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6820", 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6821", 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84441 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6815/84441", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6818/84441", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6823/84441", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6821/84441", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2023-12-19T05:52:52.685 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 13, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 191, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6824", 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.686 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6825", 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6826", 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6827", 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.687 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6830", 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6831", 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6828", 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.115:6829", 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 84475 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.115:6825/84475", 2023-12-19T05:52:52.689 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.115:6827/84475", 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.115:6831/84475", 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.115:6829/84475", 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.212130+0000", 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.235118+0000", 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.691 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.213636+0000", 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 3, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.183769+0000", 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.692 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 4, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122385+0000", 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 5, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.693 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.139288+0000", 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 6, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.122243+0000", 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 7, 2023-12-19T05:52:52.694 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2023-12-19T05:38:50.272209+0000", 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2023-12-19T05:52:52.695 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2023-12-19T05:52:52.696 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2023-12-19T05:52:52.697 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2023-12-19T05:52:52.697 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-19T05:52:52.697 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:52:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 msgr2=0x7f3e0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 0x7f3e0406c8f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3e2415b660 tx=0x7f3e14008440 comp rx=0 tx=0).stop 2023-12-19T05:52:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 msgr2=0x7f3e2413c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02be50 tx=0x7f3e0c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 shutdown_connections 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e0406a430 0x7f3e0406c8f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e24146e10 0x7f3e240b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e240d2b00 0x7f3e24142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 --2- 172.21.15.49:0/3559747060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e240ce110 0x7f3e2413c780 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 >> 172.21.15.49:0/3559747060 conn(0x7f3e240b29c0 msgr2=0x7f3e240b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 shutdown_connections 2023-12-19T05:52:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.626+0000 7f3e28973640 1 -- 172.21.15.49:0/3559747060 wait complete. 2023-12-19T05:52:52.700 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:52:52.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.939+0000 7fae50dc4640 1 Processor -- start 2023-12-19T05:52:52.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.940+0000 7fae50dc4640 1 -- start start 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.941+0000 7fae50dc4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4c0ac8b0 0x7fae4c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.941+0000 7fae50dc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c06fa90 0x7fae4c06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.941+0000 7fae50dc4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0b2fa0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae50dc4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0ad280 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae50dc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06f600 con 0x7fae4c06fa90 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4c0ac8b0 0x7fae4c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4c0ac8b0 0x7fae4c0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43614/0 (socket says 172.21.15.49:43614) 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 -- 172.21.15.49:0/606527676 learned_addr learned my addr 172.21.15.49:0/606527676 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae4bfff640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c06fa90 0x7fae4c06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 -- 172.21.15.49:0/606527676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c06fa90 msgr2=0x7fae4c06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c06fa90 0x7fae4c06ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 -- 172.21.15.49:0/606527676 >> v1:172.21.15.115:6789/0 conn(0x7fae4c15e3f0 legacy=0x7fae4c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.942+0000 7fae43fff640 1 -- 172.21.15.49:0/606527676 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c15e7d0 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.943+0000 7fae43fff640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c0ac8b0 0x7fae4c0acd40 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fae34009870 tx=0x7fae3402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4990a1654666a840 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.944+0000 7fae4affd640 1 -- 172.21.15.49:0/606527676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340317c0 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.944+0000 7fae4affd640 1 -- 172.21.15.49:0/606527676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34031920 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.944+0000 7fae4affd640 1 -- 172.21.15.49:0/606527676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34031cb0 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.944+0000 7fae50dc4640 1 -- 172.21.15.49:0/606527676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c0ac8b0 msgr2=0x7fae4c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.944+0000 7fae50dc4640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c0ac8b0 0x7fae4c0acd40 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fae34009870 tx=0x7fae3402b860 comp rx=0 tx=0).stop 2023-12-19T05:52:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 -- 172.21.15.49:0/606527676 shutdown_connections 2023-12-19T05:52:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c06fa90 0x7fae4c06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 --2- 172.21.15.49:0/606527676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c0ac8b0 0x7fae4c0acd40 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 -- 172.21.15.49:0/606527676 >> 172.21.15.49:0/606527676 conn(0x7fae4c0b0100 msgr2=0x7fae4c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 -- 172.21.15.49:0/606527676 shutdown_connections 2023-12-19T05:52:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.945+0000 7fae50dc4640 1 -- 172.21.15.49:0/606527676 wait complete. 2023-12-19T05:52:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.946+0000 7fae50dc4640 1 Processor -- start 2023-12-19T05:52:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.947+0000 7fae50dc4640 1 -- start start 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 0x7fae4c06d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c0ac8b0 0x7fae4c1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c1f3980 con 0x7fae4c15e3f0 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06c760 con 0x7fae4c06fa90 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae50dc4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06ca40 con 0x7fae4c0ac8b0 2023-12-19T05:52:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43628/0 (socket says 172.21.15.49:43628) 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 -- 172.21.15.49:0/3147588713 learned_addr learned my addr 172.21.15.49:0/3147588713 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae43fff640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c0ac8b0 0x7fae4c1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4b7fe640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 0x7fae4c06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 -- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c0ac8b0 msgr2=0x7fae4c1f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c0ac8b0 0x7fae4c1f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 -- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 msgr2=0x7fae4c06d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 0x7fae4c06d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4bfff640 1 -- 172.21.15.49:0/3147588713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340094d0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.948+0000 7fae4b7fe640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 0x7fae4c06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae4bfff640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fae44007e60 tx=0x7fae4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44014420 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae440145a0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44014950 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c06cd20 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.949+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c06d2e0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.951+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c061910 con 0x7fae4c15e3f0 2023-12-19T05:52:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.952+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae44014ab0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.952+0000 7fae48ff9640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.953+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae440892d0 con 0x7fae4c15e3f0 2023-12-19T05:52:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.953+0000 7fae4b7fe640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.954+0000 7fae4b7fe640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a830 tx=0x7fae3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:52.957+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae44054820 con 0x7fae4c15e3f0 2023-12-19T05:52:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.190+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae4c15edd0 con 0x7fae4c15e3f0 2023-12-19T05:52:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.191+0000 7fae48ff9640 1 -- 172.21.15.49:0/3147588713 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fae44057e40 con 0x7fae4c15e3f0 2023-12-19T05:52:53.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:53.194 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:52:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.194+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 msgr2=0x7fae2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.194+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a830 tx=0x7fae3c008040 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.194+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 msgr2=0x7fae4c14bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.194+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fae44007e60 tx=0x7fae4400e4b0 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 shutdown_connections 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae4c0ac8b0 0x7fae4c1f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4c15e3f0 0x7fae4c14bb10 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 --2- 172.21.15.49:0/3147588713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4c06fa90 0x7fae4c06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 >> 172.21.15.49:0/3147588713 conn(0x7fae4c0b0100 msgr2=0x7fae4c0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:53.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 shutdown_connections 2023-12-19T05:52:53.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:53.195+0000 7fae50dc4640 1 -- 172.21.15.49:0/3147588713 wait complete. 2023-12-19T05:52:53.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-19T05:52:53.455 INFO:teuthology.orchestra.run.smithi115.stdout:{"cluster_fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","whoami":0,"id":8886,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.356450203999998,"mdsmap_epoch":88,"osdmap_epoch":196,"osdmap_epoch_barrier":195,"uptime":40.132888952000002} 2023-12-19T05:52:53.455 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e805799f-455a-49b9-9f36-8f2074fd7be4", "fs_name": "cephfs", "id": 8886, "mdsmap_epoch": 88, "osdmap_epoch": 196, "osdmap_epoch_barrier": 195, "rank_uptime": 34.356450204, "state": "up:active", "uptime": 40.132888952, "want_state": "up:active", "whoami": 0 } 2023-12-19T05:52:53.456 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T05:52:53.456 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:53.456 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:53.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:53.523 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-19T05:52:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records in 2023-12-19T05:52:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:50+0 records out 2023-12-19T05:52:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.418824 s, 125 MB/s 2023-12-19T05:52:54.003 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:52:54.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:52:54.105 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:52:54.233 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:52:54.233 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:54.233 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:54.299 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:54.299 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:54.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:54.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.590+0000 7f061b42d640 1 Processor -- start 2023-12-19T05:52:54.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.590+0000 7f061b42d640 1 -- start start 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061b42d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06140b2030 0x7f061415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061b42d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f06140ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061b42d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061415ec30 con 0x7f061415e5a0 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061b42d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140ce5a0 con 0x7f06140b2030 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061b42d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061415fbc0 con 0x7f06140cdbf0 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.592+0000 7f061a42b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f061415e5a0 0x7f06140b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37936/0 (socket says 172.21.15.49:37936) 2023-12-19T05:52:54.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f061a42b640 1 -- 172.21.15.49:0/2108855807 learned_addr learned my addr 172.21.15.49:0/2108855807 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234447440 0 0) 0x7f061415ec30 con 0x7f061415e5a0 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0600003520 con 0x7f061415e5a0 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2108855807 >> v2:172.21.15.115:3300/0 conn(0x7f06140b2030 0x7f061415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f061ac2c640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f06140ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057021452 0 0) 0x7f0600003520 con 0x7f061415e5a0 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 msgr2=0x7f06140ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f06140ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 >> v2:172.21.15.115:3300/0 conn(0x7f06140b2030 msgr2=0x7f061415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 --2- 172.21.15.49:0/2108855807 >> v2:172.21.15.115:3300/0 conn(0x7f06140b2030 0x7f061415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061415e980 con 0x7f061415e5a0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f0610001670 con 0x7f061415e5a0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.593+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 >> v1:172.21.15.49:6789/0 conn(0x7f061415e5a0 legacy=0x7f06140b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f0600003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f06000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0600004d00 0x7f0600005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140ce5a0 con 0x7f0600003fa0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061415fbc0 con 0x7f0600004d00 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060000ba80 con 0x7f06140cdbf0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f06000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f061a42b640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f0600003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f061ac2c640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0600004d00 0x7f0600005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 -- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 msgr2=0x7f0600003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:54.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f0600003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 -- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0600004d00 msgr2=0x7f0600005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:54.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0600004d00 0x7f0600005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f0619c2a640 1 -- 172.21.15.49:0/2108855807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600003520 con 0x7f0600003fa0 2023-12-19T05:52:54.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.594+0000 7f061a42b640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06140cdbf0 0x7f0600003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f06000047c0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f060400ba30 tx=0x7f06000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5145048bcf75709 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604032680 con 0x7f0600003fa0 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040327e0 con 0x7f0600003fa0 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f0619429640 1 -- 172.21.15.49:0/2108855807 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604032b70 con 0x7f0600003fa0 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f061b42d640 1 -- 172.21.15.49:0/2108855807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 msgr2=0x7f06000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f061b42d640 1 --2- 172.21.15.49:0/2108855807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f06000047c0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f060400ba30 tx=0x7f06000057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.596+0000 7f061ac2c640 1 -- 172.21.15.49:0/2108855807 reap_dead start 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.597+0000 7f061b42d640 1 -- 172.21.15.49:0/2108855807 shutdown_connections 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.597+0000 7f061b42d640 1 -- 172.21.15.49:0/2108855807 >> 172.21.15.49:0/2108855807 conn(0x7f06140b0100 msgr2=0x7f06140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.597+0000 7f061b42d640 1 -- 172.21.15.49:0/2108855807 shutdown_connections 2023-12-19T05:52:54.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.597+0000 7f061b42d640 1 -- 172.21.15.49:0/2108855807 wait complete. 2023-12-19T05:52:54.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.599+0000 7f061b42d640 1 Processor -- start 2023-12-19T05:52:54.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.599+0000 7f061b42d640 1 -- start start 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0614152d80 0x7f06140c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061415a710 0x7f06140c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140cc290 con 0x7f0600003fa0 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140cb6c0 con 0x7f061415a710 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061b42d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140c9500 con 0x7f0614152d80 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061a42b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061a42b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44946/0 (socket says 172.21.15.49:44946) 2023-12-19T05:52:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061a42b640 1 -- 172.21.15.49:0/2527635458 learned_addr learned my addr 172.21.15.49:0/2527635458 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:54.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.600+0000 7f061a42b640 1 -- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0614152d80 msgr2=0x7f06140c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061a42b640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0614152d80 0x7f06140c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061a42b640 1 -- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061415a710 msgr2=0x7f06140c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061a42b640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061415a710 0x7f06140c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061a42b640 1 -- 172.21.15.49:0/2527635458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140c9230 con 0x7f0600003fa0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061a42b640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f061000d860 tx=0x7f061000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100074e0 con 0x7f0600003fa0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610007640 con 0x7f0600003fa0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610004a00 con 0x7f0600003fa0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06140cb8f0 con 0x7f0600003fa0 2023-12-19T05:52:54.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.601+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06140cbeb0 con 0x7f0600003fa0 2023-12-19T05:52:54.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.602+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614061910 con 0x7f0600003fa0 2023-12-19T05:52:54.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.603+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0610004b60 con 0x7f0600003fa0 2023-12-19T05:52:54.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.604+0000 7f060affd640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 0x7f05f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:54.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.604+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06100882e0 con 0x7f0600003fa0 2023-12-19T05:52:54.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.605+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 0x7f05f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:54.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.606+0000 7f0619c2a640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 0x7f05f806c920 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f060400ba00 tx=0x7f0604032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.609+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06100538c0 con 0x7f0600003fa0 2023-12-19T05:52:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.802+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06140b0b60 con 0x7f0600003fa0 2023-12-19T05:52:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.805+0000 7f060affd640 1 -- 172.21.15.49:0/2527635458 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16119 (secure 0 0 0) 0x7f0610056ee0 con 0x7f0600003fa0 2023-12-19T05:52:54.807 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:54.807 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":196,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:50.485345+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 msgr2=0x7f05f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 0x7f05f806c920 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f060400ba00 tx=0x7f0604032000 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 msgr2=0x7f061415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f061000d860 tx=0x7f061000dd20 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 shutdown_connections 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f05f806a460 0x7f05f806c920 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0614152d80 0x7f06140c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061415a710 0x7f06140c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 --2- 172.21.15.49:0/2527635458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600003fa0 0x7f061415c9b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 >> 172.21.15.49:0/2527635458 conn(0x7f06140b0100 msgr2=0x7f06141586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 shutdown_connections 2023-12-19T05:52:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:54.808+0000 7f061b42d640 1 -- 172.21.15.49:0/2527635458 wait complete. 2023-12-19T05:52:54.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:52:17.038396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:52:18.108157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:52:54.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:52:55.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.065+0000 7f17ba3a4640 1 Processor -- start 2023-12-19T05:52:55.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.065+0000 7f17ba3a4640 1 -- start start 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17ba3a4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17b40b2760 0x7f17b40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17ba3a4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b415fde0 con 0x7f17b415b1d0 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17ba3a4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b40b2bc0 con 0x7f17b40ceea0 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17ba3a4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40b2400 con 0x7f17b40b2760 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17b3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17b415b1d0 0x7f17b415f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37948/0 (socket says 172.21.15.49:37948) 2023-12-19T05:52:55.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.067+0000 7f17b3fff640 1 -- 172.21.15.49:0/1688658845 learned_addr learned my addr 172.21.15.49:0/1688658845 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:55.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/1688658845 >> v2:172.21.15.115:3300/0 conn(0x7f17b40b2760 0x7f17b40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927721997 0 0) 0x7f17b415fde0 con 0x7f17b415b1d0 2023-12-19T05:52:55.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a0003520 con 0x7f17b415b1d0 2023-12-19T05:52:55.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672415911 0 0) 0x7f17a0003520 con 0x7f17b415b1d0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 >> v2:172.21.15.115:3300/0 conn(0x7f17b40b2760 msgr2=0x7f17b40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 --2- 172.21.15.49:0/1688658845 >> v2:172.21.15.115:3300/0 conn(0x7f17b40b2760 0x7f17b40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 >> v1:172.21.15.115:6789/0 conn(0x7f17b40ceea0 legacy=0x7f17b406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b415ef10 con 0x7f17b415b1d0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f17a4001670 con 0x7f17b415b1d0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 >> v1:172.21.15.49:6789/0 conn(0x7f17b415b1d0 legacy=0x7f17b415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17a00039e0 0x7f17a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.068+0000 7f17b37fe640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b37fe640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000c080 con 0x7f17a0005180 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000c1f0 con 0x7f17a00047c0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000c3b0 con 0x7f17a00039e0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b3fff640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17a00039e0 0x7f17a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 -- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17a00039e0 msgr2=0x7f17a0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17a00039e0 0x7f17a0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 -- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a00047c0 msgr2=0x7f17a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b8941640 1 -- 172.21.15.49:0/1688658845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0003520 con 0x7f17a0005180 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:55.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.069+0000 7f17b3fff640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17a00039e0 0x7f17a0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:55.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.070+0000 7f17b8941640 1 -- 172.21.15.49:0/1688658845 reap_dead start 2023-12-19T05:52:55.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17b8941640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17a000b980 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f17ac001e50 tx=0x7f17a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adfa1fd348b72f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac003b70 con 0x7f17a0005180 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac003d10 con 0x7f17a0005180 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17b37fe640 1 -- 172.21.15.49:0/1688658845 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac005310 con 0x7f17a0005180 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17ba3a4640 1 -- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 msgr2=0x7f17a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.071+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17a000b980 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f17ac001e50 tx=0x7f17a00057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.072+0000 7f17ba3a4640 1 -- 172.21.15.49:0/1688658845 shutdown_connections 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.072+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/1688658845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17a000b980 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.072+0000 7f17ba3a4640 1 -- 172.21.15.49:0/1688658845 >> 172.21.15.49:0/1688658845 conn(0x7f17b4073150 msgr2=0x7f17b40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.072+0000 7f17ba3a4640 1 -- 172.21.15.49:0/1688658845 shutdown_connections 2023-12-19T05:52:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.072+0000 7f17ba3a4640 1 -- 172.21.15.49:0/1688658845 wait complete. 2023-12-19T05:52:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.074+0000 7f17ba3a4640 1 Processor -- start 2023-12-19T05:52:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.074+0000 7f17ba3a4640 1 -- start start 2023-12-19T05:52:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17b415d930 0x7f17b41f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 0x7f17b4158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4159210 con 0x7f17a0005180 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b415e110 con 0x7f17b4158850 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ba3a4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40cbb50 con 0x7f17b415d930 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44966/0 (socket says 172.21.15.49:44966) 2023-12-19T05:52:55.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b3fff640 1 -- 172.21.15.49:0/3931717198 learned_addr learned my addr 172.21.15.49:0/3931717198 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17b415d930 0x7f17b41f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b8941640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 0x7f17b4158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b3fff640 1 -- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17b415d930 msgr2=0x7f17b41f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.075+0000 7f17b3fff640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17b415d930 0x7f17b41f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b3fff640 1 -- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 msgr2=0x7f17b4158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b3fff640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 0x7f17b4158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b3fff640 1 -- 172.21.15.49:0/3931717198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40cbe30 con 0x7f17a0005180 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b8941640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 0x7f17b4158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b3fff640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000f60 tx=0x7f17a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40074e0 con 0x7f17a0005180 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4007640 con 0x7f17a0005180 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40049e0 con 0x7f17a0005180 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b40cc110 con 0x7f17a0005180 2023-12-19T05:52:55.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.076+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b415ddb0 con 0x7f17a0005180 2023-12-19T05:52:55.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.078+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b40cbc90 con 0x7f17a0005180 2023-12-19T05:52:55.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.079+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17a4004b40 con 0x7f17a0005180 2023-12-19T05:52:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.079+0000 7f17b17fa640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.080+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17a4088190 con 0x7f17a0005180 2023-12-19T05:52:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.080+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.081+0000 7f17ab7fe640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 0x7f179406c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f17b40cd0e0 tx=0x7f179c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.084+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17b40cbc90 con 0x7f17a0005180 2023-12-19T05:52:55.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.275+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17b40cbc90 con 0x7f17a0005180 2023-12-19T05:52:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.276+0000 7f17b17fa640 1 -- 172.21.15.49:0/3931717198 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17b40cbc90 con 0x7f17a0005180 2023-12-19T05:52:55.278 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 msgr2=0x7f179406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 0x7f179406c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f17b40cd0e0 tx=0x7f179c008040 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 msgr2=0x7f17b40cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000f60 tx=0x7f17a400dc90 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 shutdown_connections 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17b415d930 0x7f17b41f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17b4158850 0x7f17b4158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 --2- 172.21.15.49:0/3931717198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17a0005180 0x7f17b40cd5a0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 >> 172.21.15.49:0/3931717198 conn(0x7f17b4073150 msgr2=0x7f17b40ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 shutdown_connections 2023-12-19T05:52:55.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.279+0000 7f17ba3a4640 1 -- 172.21.15.49:0/3931717198 wait complete. 2023-12-19T05:52:55.300 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:52:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.539+0000 7f67cb34e640 1 Processor -- start 2023-12-19T05:52:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.539+0000 7f67cb34e640 1 -- start start 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67cb34e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67c40b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67cb34e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f67c40b6e50 0x7f67c406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67cb34e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c4142bf0 con 0x7f67c40b8d60 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67cb34e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c4142e40 con 0x7f67c40b6e50 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67cb34e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4143120 con 0x7f67c40d2d00 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67c88e9640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f67c40b8d60 0x7f67c40b6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37956/0 (socket says 172.21.15.49:37956) 2023-12-19T05:52:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.542+0000 7f67c88e9640 1 -- 172.21.15.49:0/3846223999 learned_addr learned my addr 172.21.15.49:0/3846223999 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778388464 0 0) 0x7f67c4142bf0 con 0x7f67c40b8d60 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b0003520 con 0x7f67c40b8d60 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67c90ea640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67c40b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790576459 0 0) 0x7f67b0003520 con 0x7f67c40b8d60 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 msgr2=0x7f67c40b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67c40b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 >> v2:172.21.15.115:3300/0 conn(0x7f67c40b6e50 msgr2=0x7f67c406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 --2- 172.21.15.49:0/3846223999 >> v2:172.21.15.115:3300/0 conn(0x7f67c40b6e50 0x7f67c406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4143400 con 0x7f67c40b8d60 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f67b4001670 con 0x7f67c40b8d60 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67c90ea640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67c40b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 >> v1:172.21.15.49:6789/0 conn(0x7f67c40b8d60 legacy=0x7f67c40b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.543+0000 7f67bbfff640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67b00039e0 0x7f67b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67bbfff640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67bbfff640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4142e40 con 0x7f67b00047c0 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4143120 con 0x7f67b00039e0 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0005520 con 0x7f67c40d2d00 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 -- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 msgr2=0x7f67b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c40d2d00 0x7f67b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 -- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67b00039e0 msgr2=0x7f67b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67b00039e0 0x7f67b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.544+0000 7f67c88e9640 1 -- 172.21.15.49:0/3846223999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0003520 con 0x7f67b00047c0 2023-12-19T05:52:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.546+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67b0004c40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c240 tx=0x7f67b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f623984cdd3d3bdf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.546+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b402cb00 con 0x7f67b00047c0 2023-12-19T05:52:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.546+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b402cc60 con 0x7f67b00047c0 2023-12-19T05:52:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.546+0000 7f67bbfff640 1 -- 172.21.15.49:0/3846223999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4005af0 con 0x7f67b00047c0 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 -- 172.21.15.49:0/3846223999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 msgr2=0x7f67b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3846223999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67b0004c40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c240 tx=0x7f67b00057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67c98eb640 1 -- 172.21.15.49:0/3846223999 reap_dead start 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 -- 172.21.15.49:0/3846223999 shutdown_connections 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 -- 172.21.15.49:0/3846223999 >> 172.21.15.49:0/3846223999 conn(0x7f67c40cfe10 msgr2=0x7f67c40d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 -- 172.21.15.49:0/3846223999 shutdown_connections 2023-12-19T05:52:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.547+0000 7f67cb34e640 1 -- 172.21.15.49:0/3846223999 wait complete. 2023-12-19T05:52:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.550+0000 7f67cb34e640 1 Processor -- start 2023-12-19T05:52:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.550+0000 7f67cb34e640 1 -- start start 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c4158a30 0x7f67c41f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 0x7f67c41f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c415a100 con 0x7f67b00047c0 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c41f2bf0 con 0x7f67c4158eb0 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67cb34e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4159480 con 0x7f67c4158a30 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67c90ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67c90ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44982/0 (socket says 172.21.15.49:44982) 2023-12-19T05:52:55.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.551+0000 7f67c90ea640 1 -- 172.21.15.49:0/3719115671 learned_addr learned my addr 172.21.15.49:0/3719115671 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:55.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 -- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c4158a30 msgr2=0x7f67c41f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c4158a30 0x7f67c41f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c98eb640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 0x7f67c41f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c4158a30 0x7f67c41f2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 -- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 msgr2=0x7f67c41f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 0x7f67c41f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 -- 172.21.15.49:0/3719115671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4159760 con 0x7f67b00047c0 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c98eb640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 0x7f67c41f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.552+0000 7f67c90ea640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c7c0 tx=0x7f67c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.554+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0007820 con 0x7f67b00047c0 2023-12-19T05:52:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.554+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0007980 con 0x7f67b00047c0 2023-12-19T05:52:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.554+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0007d30 con 0x7f67b00047c0 2023-12-19T05:52:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.554+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4159a40 con 0x7f67b00047c0 2023-12-19T05:52:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.554+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c4145ed0 con 0x7f67b00047c0 2023-12-19T05:52:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.556+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c415a240 con 0x7f67b00047c0 2023-12-19T05:52:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.556+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67c00113f0 con 0x7f67b00047c0 2023-12-19T05:52:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.557+0000 7f67b9ffb640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 0x7f67a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.557+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f67c0088a70 con 0x7f67b00047c0 2023-12-19T05:52:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.558+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 0x7f67a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:55.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.559+0000 7f67c88e9640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 0x7f67a806c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.562+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67c0054040 con 0x7f67b00047c0 2023-12-19T05:52:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.755+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67c4061910 con 0x7f67b00047c0 2023-12-19T05:52:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.755+0000 7f67b9ffb640 1 -- 172.21.15.49:0/3719115671 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67c0057660 con 0x7f67b00047c0 2023-12-19T05:52:55.757 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 msgr2=0x7f67a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 0x7f67a806c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4007000 comp rx=0 tx=0).stop 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 msgr2=0x7f67c4142170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c7c0 tx=0x7f67c000cc80 comp rx=0 tx=0).stop 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 shutdown_connections 2023-12-19T05:52:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f67a806a430 0x7f67a806c8f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67c4158a30 0x7f67c41f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67c4158eb0 0x7f67c41f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 --2- 172.21.15.49:0/3719115671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b00047c0 0x7f67c4142170 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.758+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 >> 172.21.15.49:0/3719115671 conn(0x7f67c40cfe10 msgr2=0x7f67c415b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.759+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 shutdown_connections 2023-12-19T05:52:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:55.759+0000 7f67cb34e640 1 -- 172.21.15.49:0/3719115671 wait complete. 2023-12-19T05:52:55.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:52:56.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.017+0000 7f70e48c3640 1 Processor -- start 2023-12-19T05:52:56.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.017+0000 7f70e48c3640 1 -- start start 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70e48c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 0x7f70e006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70e48c3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70e00d1670 0x7f70e00d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70e48c3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e006fe30 con 0x7f70e0146cd0 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70e48c3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e01470b0 con 0x7f70e00d1670 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70e48c3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0070260 con 0x7f70e006f490 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70df59e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70e00d1670 0x7f70e00d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70ded9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f70e0146cd0 0x7f70e00b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37968/0 (socket says 172.21.15.49:37968) 2023-12-19T05:52:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.019+0000 7f70ded9d640 1 -- 172.21.15.49:0/39162976 learned_addr learned my addr 172.21.15.49:0/39162976 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70df59e640 1 -- 172.21.15.49:0/39162976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 msgr2=0x7f70e006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70de59c640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 0x7f70e006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70df59e640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 0x7f70e006f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70df59e640 1 -- 172.21.15.49:0/39162976 >> v1:172.21.15.49:6789/0 conn(0x7f70e0146cd0 legacy=0x7f70e00b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70df59e640 1 -- 172.21.15.49:0/39162976 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00b6ea0 con 0x7f70e00d1670 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70ddd9b640 1 -- 172.21.15.49:0/39162976 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832129549 0 0) 0x7f70e006fe30 con 0x7f70e0146cd0 2023-12-19T05:52:56.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.020+0000 7f70de59c640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 0x7f70e006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:56.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.021+0000 7f70df59e640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00d1670 0x7f70e00d1ad0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097a0 tx=0x7f70d802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7e885746588fb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.021+0000 7f70ddd9b640 1 -- 172.21.15.49:0/39162976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8031780 con 0x7f70e00d1670 2023-12-19T05:52:56.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.021+0000 7f70ddd9b640 1 -- 172.21.15.49:0/39162976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d80318e0 con 0x7f70e00d1670 2023-12-19T05:52:56.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.021+0000 7f70ddd9b640 1 -- 172.21.15.49:0/39162976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8031c70 con 0x7f70e00d1670 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 -- 172.21.15.49:0/39162976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00d1670 msgr2=0x7f70e00d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00d1670 0x7f70e00d1ad0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097a0 tx=0x7f70d802b820 comp rx=0 tx=0).stop 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 -- 172.21.15.49:0/39162976 shutdown_connections 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e00d1670 0x7f70e00d1ad0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 --2- 172.21.15.49:0/39162976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e006f490 0x7f70e006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 -- 172.21.15.49:0/39162976 >> 172.21.15.49:0/39162976 conn(0x7f70e00d3200 msgr2=0x7f70e00d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 -- 172.21.15.49:0/39162976 shutdown_connections 2023-12-19T05:52:56.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.022+0000 7f70e48c3640 1 -- 172.21.15.49:0/39162976 wait complete. 2023-12-19T05:52:56.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.024+0000 7f70e48c3640 1 Processor -- start 2023-12-19T05:52:56.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.024+0000 7f70e48c3640 1 -- start start 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 0x7f70e013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 0x7f70e01e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e013d290 con 0x7f70e0146cd0 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e015eb50 con 0x7f70e006f490 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70e48c3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e015daf0 con 0x7f70e00d1670 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70df59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70df59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44998/0 (socket says 172.21.15.49:44998) 2023-12-19T05:52:56.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.025+0000 7f70df59e640 1 -- 172.21.15.49:0/3408884862 learned_addr learned my addr 172.21.15.49:0/3408884862 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70de59c640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 0x7f70e01e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70ded9d640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 0x7f70e013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 -- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 msgr2=0x7f70e01e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 0x7f70e01e8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 -- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 msgr2=0x7f70e013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 0x7f70e013cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 -- 172.21.15.49:0/3408884862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009400 con 0x7f70e0146cd0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70de59c640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 0x7f70e01e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70ded9d640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 0x7f70e013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70df59e640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f70d80096f0 tx=0x7f70d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80328e0 con 0x7f70e0146cd0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8032a40 con 0x7f70e0146cd0 2023-12-19T05:52:56.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8032dd0 con 0x7f70e0146cd0 2023-12-19T05:52:56.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.026+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e015dd90 con 0x7f70e0146cd0 2023-12-19T05:52:56.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.027+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e015e350 con 0x7f70e0146cd0 2023-12-19T05:52:56.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.028+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e0061910 con 0x7f70e0146cd0 2023-12-19T05:52:56.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.029+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70d804e440 con 0x7f70e0146cd0 2023-12-19T05:52:56.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.030+0000 7f70d77fe640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 0x7f70c006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.030+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f70d80aaa70 con 0x7f70e0146cd0 2023-12-19T05:52:56.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.031+0000 7f70ded9d640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 0x7f70c006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.032+0000 7f70ded9d640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 0x7f70c006c940 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f70d0007fd0 tx=0x7f70d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.034+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70d8076120 con 0x7f70e0146cd0 2023-12-19T05:52:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.228+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70e00d2620 con 0x7f70e0146cd0 2023-12-19T05:52:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.229+0000 7f70d77fe640 1 -- 172.21.15.49:0/3408884862 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70d80aa070 con 0x7f70e0146cd0 2023-12-19T05:52:56.230 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:52:56.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 msgr2=0x7f70c006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 0x7f70c006c940 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f70d0007fd0 tx=0x7f70d0009040 comp rx=0 tx=0).stop 2023-12-19T05:52:56.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 msgr2=0x7f70e01e8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f70d80096f0 tx=0x7f70d80046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 shutdown_connections 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f70c006a480 0x7f70c006c940 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e00d1670 0x7f70e01e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70e0146cd0 0x7f70e01e8560 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 --2- 172.21.15.49:0/3408884862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e006f490 0x7f70e013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.231+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 >> 172.21.15.49:0/3408884862 conn(0x7f70e00d3200 msgr2=0x7f70e0143100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.232+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 shutdown_connections 2023-12-19T05:52:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.232+0000 7f70e48c3640 1 -- 172.21.15.49:0/3408884862 wait complete. 2023-12-19T05:52:56.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:52:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.492+0000 7f102a899640 1 Processor -- start 2023-12-19T05:52:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.492+0000 7f102a899640 1 -- start start 2023-12-19T05:52:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.494+0000 7f102a899640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.494+0000 7f102a899640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f102406cc50 0x7f10240cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.494+0000 7f102a899640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102415c9c0 con 0x7f10240b0830 2023-12-19T05:52:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.494+0000 7f102a899640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240b0cb0 con 0x7f102406cc50 2023-12-19T05:52:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.494+0000 7f102a899640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102406d270 con 0x7f1024155460 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f102406cc50 0x7f10240cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f102406cc50 0x7f10240cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45000/0 (socket says 172.21.15.49:45000) 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 -- 172.21.15.49:0/4217770935 learned_addr learned my addr 172.21.15.49:0/4217770935 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f1029897640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 -- 172.21.15.49:0/4217770935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 msgr2=0x7f10240b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 -- 172.21.15.49:0/4217770935 >> v1:172.21.15.115:6789/0 conn(0x7f10240b0830 legacy=0x7f102406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.495+0000 7f102a098640 1 -- 172.21.15.49:0/4217770935 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102406d550 con 0x7f102406cc50 2023-12-19T05:52:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.496+0000 7f102a098640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102406cc50 0x7f10240cdcf0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f101c009870 tx=0x7f101c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2b441f3c60f1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.497+0000 7f1028895640 1 -- 172.21.15.49:0/4217770935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c031640 con 0x7f102406cc50 2023-12-19T05:52:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.497+0000 7f1028895640 1 -- 172.21.15.49:0/4217770935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0317a0 con 0x7f102406cc50 2023-12-19T05:52:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.497+0000 7f1028895640 1 -- 172.21.15.49:0/4217770935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c031b30 con 0x7f102406cc50 2023-12-19T05:52:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.497+0000 7f102a899640 1 -- 172.21.15.49:0/4217770935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102406cc50 msgr2=0x7f10240cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.497+0000 7f102a899640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102406cc50 0x7f10240cdcf0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f101c009870 tx=0x7f101c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 -- 172.21.15.49:0/4217770935 shutdown_connections 2023-12-19T05:52:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102406cc50 0x7f10240cdcf0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 --2- 172.21.15.49:0/4217770935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 -- 172.21.15.49:0/4217770935 >> 172.21.15.49:0/4217770935 conn(0x7f10240659a0 msgr2=0x7f1024065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 -- 172.21.15.49:0/4217770935 shutdown_connections 2023-12-19T05:52:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.498+0000 7f102a899640 1 -- 172.21.15.49:0/4217770935 wait complete. 2023-12-19T05:52:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.500+0000 7f102a899640 1 Processor -- start 2023-12-19T05:52:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.500+0000 7f102a899640 1 -- start start 2023-12-19T05:52:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102406cc50 0x7f102414c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240b1860 con 0x7f10240b0830 2023-12-19T05:52:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102414cce0 con 0x7f102406cc50 2023-12-19T05:52:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.501+0000 7f102a899640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240b1ab0 con 0x7f1024155460 2023-12-19T05:52:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45004/0 (socket says 172.21.15.49:45004) 2023-12-19T05:52:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 -- 172.21.15.49:0/354282083 learned_addr learned my addr 172.21.15.49:0/354282083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029897640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102406cc50 0x7f102414c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f102a098640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 -- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 msgr2=0x7f10240cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 -- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102406cc50 msgr2=0x7f102414c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102406cc50 0x7f102414c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.502+0000 7f1029096640 1 -- 172.21.15.49:0/354282083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0094d0 con 0x7f10240b0830 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f1029096640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f101400c430 tx=0x7f101400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014011790 con 0x7f10240b0830 2023-12-19T05:52:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10140118f0 con 0x7f10240b0830 2023-12-19T05:52:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014011ce0 con 0x7f10240b0830 2023-12-19T05:52:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10240b1d90 con 0x7f10240b0830 2023-12-19T05:52:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.503+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10240b2350 con 0x7f10240b0830 2023-12-19T05:52:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.504+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024061910 con 0x7f10240b0830 2023-12-19T05:52:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.506+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f101401c460 con 0x7f10240b0830 2023-12-19T05:52:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.507+0000 7f101a7fc640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 0x7f100806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.507+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f10140888b0 con 0x7f10240b0830 2023-12-19T05:52:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.508+0000 7f1029897640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 0x7f100806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.509+0000 7f1029897640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 0x7f100806c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f10200099c0 tx=0x7f1020003990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.512+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1014053e70 con 0x7f10240b0830 2023-12-19T05:52:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.738+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10240afaf0 con 0x7f10240b0830 2023-12-19T05:52:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.739+0000 7f101a7fc640 1 -- 172.21.15.49:0/354282083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v198) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1014057490 con 0x7f10240b0830 2023-12-19T05:52:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 msgr2=0x7f100806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 0x7f100806c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f10200099c0 tx=0x7f1020003990 comp rx=0 tx=0).stop 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 msgr2=0x7f102414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f101400c430 tx=0x7f101400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 shutdown_connections 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f100806a430 0x7f100806c8f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1024155460 0x7f10240cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10240b0830 0x7f102414e4b0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 --2- 172.21.15.49:0/354282083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f102406cc50 0x7f102414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 >> 172.21.15.49:0/354282083 conn(0x7f10240659a0 msgr2=0x7f1024151440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 shutdown_connections 2023-12-19T05:52:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:56.742+0000 7f102a899640 1 -- 172.21.15.49:0/354282083 wait complete. 2023-12-19T05:52:56.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:52:56.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:56.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T05:52:56.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:52:56.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:56.934 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:52:56.979 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:56.979 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:57.020 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:57.020 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:57.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:52:57.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.341+0000 7ff87b99f640 1 Processor -- start 2023-12-19T05:52:57.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.342+0000 7ff87b99f640 1 -- start start 2023-12-19T05:52:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.343+0000 7ff87b99f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff874157bf0 0x7ff87415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.343+0000 7ff87b99f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87415b740 con 0x7ff8740ae110 2023-12-19T05:52:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.343+0000 7ff87b99f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740ae640 con 0x7ff8740b0810 2023-12-19T05:52:57.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.343+0000 7ff87b99f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87406b8c0 con 0x7ff874157bf0 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff878f3a640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff8740ae110 0x7ff8740b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37980/0 (socket says 172.21.15.49:37980) 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff87973b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff874157bf0 0x7ff87415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff878f3a640 1 -- 172.21.15.49:0/2062881885 learned_addr learned my addr 172.21.15.49:0/2062881885 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff86bfff640 1 -- 172.21.15.49:0/2062881885 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690287459 0 0) 0x7ff87415b740 con 0x7ff8740ae110 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff86bfff640 1 -- 172.21.15.49:0/2062881885 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860003520 con 0x7ff8740ae110 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff87973b640 1 -- 172.21.15.49:0/2062881885 >> v1:172.21.15.115:6789/0 conn(0x7ff8740b0810 legacy=0x7ff87406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff87973b640 1 -- 172.21.15.49:0/2062881885 >> v1:172.21.15.49:6789/0 conn(0x7ff8740ae110 legacy=0x7ff8740b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.344+0000 7ff87973b640 1 -- 172.21.15.49:0/2062881885 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740ae920 con 0x7ff874157bf0 2023-12-19T05:52:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff87973b640 1 --2- 172.21.15.49:0/2062881885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff874157bf0 0x7ff87415b200 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff8700097a0 tx=0x7ff87002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74c805061c9b61a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff86bfff640 1 -- 172.21.15.49:0/2062881885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870031830 con 0x7ff874157bf0 2023-12-19T05:52:57.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff86bfff640 1 -- 172.21.15.49:0/2062881885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870031990 con 0x7ff874157bf0 2023-12-19T05:52:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff86bfff640 1 -- 172.21.15.49:0/2062881885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870031d20 con 0x7ff874157bf0 2023-12-19T05:52:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff87b99f640 1 -- 172.21.15.49:0/2062881885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff874157bf0 msgr2=0x7ff87415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.346+0000 7ff87b99f640 1 --2- 172.21.15.49:0/2062881885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff874157bf0 0x7ff87415b200 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff8700097a0 tx=0x7ff87002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.347+0000 7ff87b99f640 1 -- 172.21.15.49:0/2062881885 shutdown_connections 2023-12-19T05:52:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.347+0000 7ff87b99f640 1 --2- 172.21.15.49:0/2062881885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff874157bf0 0x7ff87415b200 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.347+0000 7ff87b99f640 1 -- 172.21.15.49:0/2062881885 >> 172.21.15.49:0/2062881885 conn(0x7ff8740cbb70 msgr2=0x7ff8740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.347+0000 7ff87b99f640 1 -- 172.21.15.49:0/2062881885 shutdown_connections 2023-12-19T05:52:57.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.347+0000 7ff87b99f640 1 -- 172.21.15.49:0/2062881885 wait complete. 2023-12-19T05:52:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.348+0000 7ff87b99f640 1 Processor -- start 2023-12-19T05:52:57.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.349+0000 7ff87b99f640 1 -- start start 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.349+0000 7ff87b99f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.349+0000 7ff87b99f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8740b0810 0x7ff87414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87b99f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff874157bf0 0x7ff87414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87b99f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87415c790 con 0x7ff8740ae110 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87b99f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87414bf80 con 0x7ff8740b0810 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87b99f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87415c460 con 0x7ff874157bf0 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45018/0 (socket says 172.21.15.49:45018) 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 -- 172.21.15.49:0/1835050207 learned_addr learned my addr 172.21.15.49:0/1835050207 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 -- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff874157bf0 msgr2=0x7ff87414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff874157bf0 0x7ff87414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff878f3a640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8740b0810 0x7ff87414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 -- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8740b0810 msgr2=0x7ff87414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8740b0810 0x7ff87414da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.350+0000 7ff87973b640 1 -- 172.21.15.49:0/1835050207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff870009400 con 0x7ff8740ae110 2023-12-19T05:52:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff87973b640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ff870000c00 tx=0x7ff8700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87003a8f0 con 0x7ff8740ae110 2023-12-19T05:52:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87003aa50 con 0x7ff8740ae110 2023-12-19T05:52:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87003ae00 con 0x7ff8740ae110 2023-12-19T05:52:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87414c220 con 0x7ff8740ae110 2023-12-19T05:52:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.351+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87415d160 con 0x7ff8740ae110 2023-12-19T05:52:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.352+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874061910 con 0x7ff8740ae110 2023-12-19T05:52:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.353+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff87004d450 con 0x7ff8740ae110 2023-12-19T05:52:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.354+0000 7ff869ffb640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 0x7ff85806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.354+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff8700aa860 con 0x7ff8740ae110 2023-12-19T05:52:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.355+0000 7ff878f3a640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 0x7ff85806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.356+0000 7ff878f3a640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 0x7ff85806c940 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff87416a0e0 tx=0x7ff864009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.358+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff8700760c0 con 0x7ff8740ae110 2023-12-19T05:52:57.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.553+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8740b29e0 con 0x7ff8740ae110 2023-12-19T05:52:57.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.555+0000 7ff869ffb640 1 -- 172.21.15.49:0/1835050207 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+16169 (secure 0 0 0) 0x7ff870035090 con 0x7ff8740ae110 2023-12-19T05:52:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:52:57.557 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":198,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:52:56.553037+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.1f","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 msgr2=0x7ff85806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 0x7ff85806c940 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff87416a0e0 tx=0x7ff864009040 comp rx=0 tx=0).stop 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 msgr2=0x7ff87415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ff870000c00 tx=0x7ff8700046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 shutdown_connections 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff85806a480 0x7ff85806c940 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff874157bf0 0x7ff87414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8740b0810 0x7ff87414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 --2- 172.21.15.49:0/1835050207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8740ae110 0x7ff87415cc20 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 >> 172.21.15.49:0/1835050207 conn(0x7ff8740cbb70 msgr2=0x7ff87406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:57.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.558+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 shutdown_connections 2023-12-19T05:52:57.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.559+0000 7ff87b99f640 1 -- 172.21.15.49:0/1835050207 wait complete. 2023-12-19T05:52:57.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:52:17.038396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:52:18.108157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:52:57.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:52:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.813+0000 7f71c19b9640 1 Processor -- start 2023-12-19T05:52:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.813+0000 7f71c19b9640 1 -- start start 2023-12-19T05:52:57.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71c19b9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71bc0ad300 0x7f71bc0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71c19b9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc15da00 con 0x7f71bc157c30 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71c19b9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc15dcc0 con 0x7f71bc0cce30 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71c19b9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc15e940 con 0x7f71bc0ad300 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71baffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71bc157c30 0x7f71bc0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37982/0 (socket says 172.21.15.49:37982) 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71baffd640 1 -- 172.21.15.49:0/222091518 learned_addr learned my addr 172.21.15.49:0/222091518 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.816+0000 7f71b3fff640 1 --2- 172.21.15.49:0/222091518 >> v2:172.21.15.49:3300/0 conn(0x7f71bc0ad300 0x7f71bc0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.817+0000 7f71b3fff640 1 -- 172.21.15.49:0/222091518 >> v1:172.21.15.115:6789/0 conn(0x7f71bc0cce30 legacy=0x7f71bc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.817+0000 7f71b3fff640 1 -- 172.21.15.49:0/222091518 >> v1:172.21.15.49:6789/0 conn(0x7f71bc157c30 legacy=0x7f71bc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.817+0000 7f71ba7fc640 1 -- 172.21.15.49:0/222091518 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041447484 0 0) 0x7f71bc15da00 con 0x7f71bc157c30 2023-12-19T05:52:57.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.817+0000 7f71b3fff640 1 -- 172.21.15.49:0/222091518 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc15dfa0 con 0x7f71bc0ad300 2023-12-19T05:52:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.818+0000 7f71b3fff640 1 --2- 172.21.15.49:0/222091518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc0ad780 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f71bc15dbf0 tx=0x7f71a402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbd7b15a4c2ea07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.818+0000 7f71ba7fc640 1 -- 172.21.15.49:0/222091518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a402d040 con 0x7f71bc0ad300 2023-12-19T05:52:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.818+0000 7f71ba7fc640 1 -- 172.21.15.49:0/222091518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4031810 con 0x7f71bc0ad300 2023-12-19T05:52:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.818+0000 7f71ba7fc640 1 -- 172.21.15.49:0/222091518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4031ba0 con 0x7f71bc0ad300 2023-12-19T05:52:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 -- 172.21.15.49:0/222091518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 msgr2=0x7f71bc0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 --2- 172.21.15.49:0/222091518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc0ad780 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f71bc15dbf0 tx=0x7f71a402b8b0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 -- 172.21.15.49:0/222091518 shutdown_connections 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 --2- 172.21.15.49:0/222091518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc0ad780 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 -- 172.21.15.49:0/222091518 >> 172.21.15.49:0/222091518 conn(0x7f71bc073150 msgr2=0x7f71bc0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 -- 172.21.15.49:0/222091518 shutdown_connections 2023-12-19T05:52:57.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.819+0000 7f71c19b9640 1 -- 172.21.15.49:0/222091518 wait complete. 2023-12-19T05:52:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.821+0000 7f71c19b9640 1 Processor -- start 2023-12-19T05:52:57.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.821+0000 7f71c19b9640 1 -- start start 2023-12-19T05:52:57.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71bc0cce30 0x7f71bc1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 0x7f71bc150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc15f9b0 con 0x7f71bc0ad300 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc151ca0 con 0x7f71bc0cce30 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71c19b9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1f2a90 con 0x7f71bc157c30 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71baffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71baffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45038/0 (socket says 172.21.15.49:45038) 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71baffd640 1 -- 172.21.15.49:0/3229736762 learned_addr learned my addr 172.21.15.49:0/3229736762 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.822+0000 7f71b3fff640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71bc0cce30 0x7f71bc1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71bb7fe640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 0x7f71bc150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 -- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 msgr2=0x7f71bc150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 0x7f71bc150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 -- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71bc0cce30 msgr2=0x7f71bc1544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71bc0cce30 0x7f71bc1544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 -- 172.21.15.49:0/3229736762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009400 con 0x7f71bc0ad300 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71bb7fe640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 0x7f71bc150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:52:57.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71baffd640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c430 tx=0x7f71ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0074e0 con 0x7f71bc0ad300 2023-12-19T05:52:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac007660 con 0x7f71bc0ad300 2023-12-19T05:52:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc14f610 con 0x7f71bc0ad300 2023-12-19T05:52:57.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac004a20 con 0x7f71bc0ad300 2023-12-19T05:52:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.823+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc151ef0 con 0x7f71bc0ad300 2023-12-19T05:52:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.825+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc061910 con 0x7f71bc0ad300 2023-12-19T05:52:57.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.826+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71ac004b80 con 0x7f71bc0ad300 2023-12-19T05:52:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.826+0000 7f71b8ff9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 0x7f719c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.827+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f71ac0887e0 con 0x7f71bc0ad300 2023-12-19T05:52:57.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.827+0000 7f71b3fff640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 0x7f719c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:57.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.828+0000 7f71b3fff640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 0x7f719c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:57.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:57.830+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71ac053db0 con 0x7f71bc0ad300 2023-12-19T05:52:58.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.025+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71bc15e250 con 0x7f71bc0ad300 2023-12-19T05:52:58.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.026+0000 7f71b8ff9640 1 -- 172.21.15.49:0/3229736762 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v198) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71ac0573d0 con 0x7f71bc0ad300 2023-12-19T05:52:58.028 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 msgr2=0x7f719c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 0x7f719c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a403c040 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 msgr2=0x7f71bc148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c430 tx=0x7f71ac00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 shutdown_connections 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f719c06a430 0x7f719c06c8f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71bc157c30 0x7f71bc150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71bc0cce30 0x7f71bc1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 --2- 172.21.15.49:0/3229736762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71bc0ad300 0x7f71bc148350 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 >> 172.21.15.49:0/3229736762 conn(0x7f71bc073150 msgr2=0x7f71bc0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:58.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 shutdown_connections 2023-12-19T05:52:58.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.029+0000 7f71c19b9640 1 -- 172.21.15.49:0/3229736762 wait complete. 2023-12-19T05:52:58.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:52:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.289+0000 7fc7f2829640 1 Processor -- start 2023-12-19T05:52:58.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.289+0000 7fc7f2829640 1 -- start start 2023-12-19T05:52:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f2829640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7ec155460 0x7fc7ec0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f2829640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec15c9c0 con 0x7fc7ec0b0830 2023-12-19T05:52:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f2829640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec06d270 con 0x7fc7ec06cc50 2023-12-19T05:52:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f2829640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0b0ce0 con 0x7fc7ec155460 2023-12-19T05:52:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f1827640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7ec155460 0x7fc7ec0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f1026640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7ec0b0830 0x7fc7ec06c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37990/0 (socket says 172.21.15.49:37990) 2023-12-19T05:52:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.291+0000 7fc7f1026640 1 -- 172.21.15.49:0/2479729503 learned_addr learned my addr 172.21.15.49:0/2479729503 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.292+0000 7fc7f1827640 1 -- 172.21.15.49:0/2479729503 >> v1:172.21.15.115:6789/0 conn(0x7fc7ec06cc50 legacy=0x7fc7ec0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.292+0000 7fc7f1827640 1 -- 172.21.15.49:0/2479729503 >> v1:172.21.15.49:6789/0 conn(0x7fc7ec0b0830 legacy=0x7fc7ec06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.292+0000 7fc7f1827640 1 -- 172.21.15.49:0/2479729503 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec06d550 con 0x7fc7ec155460 2023-12-19T05:52:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.293+0000 7fc7f1827640 1 --2- 172.21.15.49:0/2479729503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec155460 0x7fc7ec0b02f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b427c05e6af0bccd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.293+0000 7fc7f0825640 1 -- 172.21.15.49:0/2479729503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e802cc60 con 0x7fc7ec155460 2023-12-19T05:52:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.293+0000 7fc7f0825640 1 -- 172.21.15.49:0/2479729503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e802cdc0 con 0x7fc7ec155460 2023-12-19T05:52:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.293+0000 7fc7f0825640 1 -- 172.21.15.49:0/2479729503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8034660 con 0x7fc7ec155460 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 -- 172.21.15.49:0/2479729503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec155460 msgr2=0x7fc7ec0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2479729503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec155460 0x7fc7ec0b02f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e802beb0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 -- 172.21.15.49:0/2479729503 shutdown_connections 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2479729503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec155460 0x7fc7ec0b02f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 -- 172.21.15.49:0/2479729503 >> 172.21.15.49:0/2479729503 conn(0x7fc7ec0659a0 msgr2=0x7fc7ec065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 -- 172.21.15.49:0/2479729503 shutdown_connections 2023-12-19T05:52:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.294+0000 7fc7f2829640 1 -- 172.21.15.49:0/2479729503 wait complete. 2023-12-19T05:52:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.296+0000 7fc7f2829640 1 Processor -- start 2023-12-19T05:52:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.296+0000 7fc7f2829640 1 -- start start 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7ec06cc50 0x7fc7ec14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7ec155460 0x7fc7ec0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ce970 con 0x7fc7ec0b0830 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec1f7100 con 0x7fc7ec06cc50 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.297+0000 7fc7f2829640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ceba0 con 0x7fc7ec155460 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45052/0 (socket says 172.21.15.49:45052) 2023-12-19T05:52:58.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 -- 172.21.15.49:0/2107023902 learned_addr learned my addr 172.21.15.49:0/2107023902 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1827640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7ec06cc50 0x7fc7ec14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 -- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7ec155460 msgr2=0x7fc7ec0b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7ec155460 0x7fc7ec0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 -- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7ec06cc50 msgr2=0x7fc7ec14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7ec06cc50 0x7fc7ec14a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.298+0000 7fc7f1026640 1 -- 172.21.15.49:0/2107023902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009a70 con 0x7fc7ec0b0830 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7f1026640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c4a0 tx=0x7fc7dc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc005ce0 con 0x7fc7ec0b0830 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc005e40 con 0x7fc7ec0b0830 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec0cee80 con 0x7fc7ec0b0830 2023-12-19T05:52:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc007270 con 0x7fc7ec0b0830 2023-12-19T05:52:58.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.299+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec0cf440 con 0x7fc7ec0b0830 2023-12-19T05:52:58.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.300+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec0cf630 con 0x7fc7ec0b0830 2023-12-19T05:52:58.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.302+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7dc007490 con 0x7fc7ec0b0830 2023-12-19T05:52:58.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.303+0000 7fc7e27fc640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 0x7fc7d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.303+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc7dc087e90 con 0x7fc7ec0b0830 2023-12-19T05:52:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.303+0000 7fc7f1827640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 0x7fc7d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.304+0000 7fc7f1827640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 0x7fc7d006c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8036000 tx=0x7fc7e8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.307+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc7dc053470 con 0x7fc7ec0b0830 2023-12-19T05:52:58.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.501+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7ec061910 con 0x7fc7ec0b0830 2023-12-19T05:52:58.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.502+0000 7fc7e27fc640 1 -- 172.21.15.49:0/2107023902 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v198) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7dc017020 con 0x7fc7ec0b0830 2023-12-19T05:52:58.504 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 msgr2=0x7fc7d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 0x7fc7d006c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8036000 tx=0x7fc7e8030000 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 msgr2=0x7fc7ec0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c4a0 tx=0x7fc7dc00c960 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 shutdown_connections 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7d006a430 0x7fc7d006c8f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7ec155460 0x7fc7ec0b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7ec0b0830 0x7fc7ec0b1d90 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 --2- 172.21.15.49:0/2107023902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7ec06cc50 0x7fc7ec14a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 >> 172.21.15.49:0/2107023902 conn(0x7fc7ec0659a0 msgr2=0x7fc7ec0adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 shutdown_connections 2023-12-19T05:52:58.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.505+0000 7fc7f2829640 1 -- 172.21.15.49:0/2107023902 wait complete. 2023-12-19T05:52:58.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:52:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.760+0000 7f7090fd6640 1 Processor -- start 2023-12-19T05:52:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.761+0000 7f7090fd6640 1 -- start start 2023-12-19T05:52:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.762+0000 7f7090fd6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f708c06f8f0 0x7f708c0d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.762+0000 7f7090fd6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c070260 con 0x7f708c06f490 2023-12-19T05:52:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f7090fd6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c0b6ea0 con 0x7f708c146cd0 2023-12-19T05:52:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f7090fd6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c1470b0 con 0x7f708c06f8f0 2023-12-19T05:52:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f708affd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f708c06f490 0x7f708c0d1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37998/0 (socket says 172.21.15.49:37998) 2023-12-19T05:52:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f708affd640 1 -- 172.21.15.49:0/1649309741 learned_addr learned my addr 172.21.15.49:0/1649309741 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314462452 0 0) 0x7f708c070260 con 0x7f708c06f490 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f708bfff640 1 --2- 172.21.15.49:0/1649309741 >> v2:172.21.15.115:3300/0 conn(0x7f708c06f8f0 0x7f708c0d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.763+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7078003520 con 0x7f708c06f490 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493698225 0 0) 0x7f7078003520 con 0x7f708c06f490 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 >> v2:172.21.15.115:3300/0 conn(0x7f708c06f8f0 msgr2=0x7f708c0d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 --2- 172.21.15.49:0/1649309741 >> v2:172.21.15.115:3300/0 conn(0x7f708c06f8f0 0x7f708c0d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 >> v1:172.21.15.115:6789/0 conn(0x7f708c146cd0 legacy=0x7f708c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0b7180 con 0x7f708c06f490 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f7074001670 con 0x7f708c06f490 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 >> v1:172.21.15.49:6789/0 conn(0x7f708c06f490 legacy=0x7f708c0d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70780039c0 0x7f7078003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70780052a0 0x7f707800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1470b0 con 0x7f70780047c0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c1c0 con 0x7f70780039c0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.764+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c380 con 0x7f70780052a0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708b7fe640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70780039c0 0x7f7078003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708bfff640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70780052a0 0x7f707800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 -- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70780052a0 msgr2=0x7f707800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70780052a0 0x7f707800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 -- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70780039c0 msgr2=0x7f7078003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70780039c0 0x7f7078003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708affd640 1 -- 172.21.15.49:0/1649309741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078003520 con 0x7f70780047c0 2023-12-19T05:52:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.765+0000 7f708bfff640 1 -- 172.21.15.49:0/1649309741 reap_dead start 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.766+0000 7f708affd640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f7078004c40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f707400c0e0 tx=0x7f70780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e355971d031540b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074005ad0 con 0x7f70780047c0 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7074005c30 con 0x7f70780047c0 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f708a7fc640 1 -- 172.21.15.49:0/1649309741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70740072b0 con 0x7f70780047c0 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f7090fd6640 1 -- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 msgr2=0x7f7078004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f7090fd6640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f7078004c40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f707400c0e0 tx=0x7f70780057f0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f7090fd6640 1 -- 172.21.15.49:0/1649309741 shutdown_connections 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f7090fd6640 1 --2- 172.21.15.49:0/1649309741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.767+0000 7f7090fd6640 1 -- 172.21.15.49:0/1649309741 >> 172.21.15.49:0/1649309741 conn(0x7f708c0d3200 msgr2=0x7f708c0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.768+0000 7f7090fd6640 1 -- 172.21.15.49:0/1649309741 shutdown_connections 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.768+0000 7f7090fd6640 1 -- 172.21.15.49:0/1649309741 wait complete. 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.769+0000 7f7090fd6640 1 Processor -- start 2023-12-19T05:52:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.770+0000 7f7090fd6640 1 -- start start 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f708c154b10 0x7f708c145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f708c1f1d50 0x7f708c1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1f26f0 con 0x7f70780047c0 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c155080 con 0x7f708c154b10 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f7090fd6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c155360 con 0x7f708c1f1d50 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45058/0 (socket says 172.21.15.49:45058) 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 -- 172.21.15.49:0/4205792073 learned_addr learned my addr 172.21.15.49:0/4205792073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 -- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f708c1f1d50 msgr2=0x7f708c1f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f708c1f1d50 0x7f708c1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 -- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f708c154b10 msgr2=0x7f708c145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f708c154b10 0x7f708c145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.771+0000 7f708b7fe640 1 -- 172.21.15.49:0/4205792073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c155640 con 0x7f70780047c0 2023-12-19T05:52:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f708b7fe640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f707c00f960 tx=0x7f707c00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c006d60 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c003970 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c003d20 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c155920 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.772+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c1459a0 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.773+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c061910 con 0x7f70780047c0 2023-12-19T05:52:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.774+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f707c00d7f0 con 0x7f70780047c0 2023-12-19T05:52:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.775+0000 7f7083fff640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 0x7f706c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.775+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f707c088300 con 0x7f70780047c0 2023-12-19T05:52:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.776+0000 7f708affd640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 0x7f706c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.777+0000 7f708affd640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 0x7f706c06c920 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7074034000 tx=0x7f7074039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.779+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f707c0538d0 con 0x7f70780047c0 2023-12-19T05:52:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.975+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f708c12f5c0 con 0x7f70780047c0 2023-12-19T05:52:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.976+0000 7f7083fff640 1 -- 172.21.15.49:0/4205792073 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v198) v1 ==== 100+0+11 (secure 0 0 0) 0x7f707c056ef0 con 0x7f70780047c0 2023-12-19T05:52:58.977 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:52:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 msgr2=0x7f706c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 0x7f706c06c920 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7074034000 tx=0x7f7074039040 comp rx=0 tx=0).stop 2023-12-19T05:52:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 msgr2=0x7f708c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f707c00f960 tx=0x7f707c00fe20 comp rx=0 tx=0).stop 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 shutdown_connections 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f706c06a460 0x7f706c06c920 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f708c1f1d50 0x7f708c1f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f708c154b10 0x7f708c145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 --2- 172.21.15.49:0/4205792073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70780047c0 0x7f708c1531c0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.978+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 >> 172.21.15.49:0/4205792073 conn(0x7f708c0d3200 msgr2=0x7f708c15bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.979+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 shutdown_connections 2023-12-19T05:52:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:58.979+0000 7f7090fd6640 1 -- 172.21.15.49:0/4205792073 wait complete. 2023-12-19T05:52:58.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:52:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.238+0000 7fb7148f6640 1 Processor -- start 2023-12-19T05:52:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.238+0000 7fb7148f6640 1 -- start start 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb7148f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb710140360 0x7fb7100b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb7148f6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7100b5cd0 0x7fb7100b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb7148f6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7100b6670 con 0x7fb710160f30 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb7148f6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb710140740 con 0x7fb7100b5cd0 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb7148f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710143990 con 0x7fb710140360 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb70659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7100b5cd0 0x7fb7100b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb70659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7100b5cd0 0x7fb7100b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45072/0 (socket says 172.21.15.49:45072) 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb70659c640 1 -- 172.21.15.49:0/153772853 learned_addr learned my addr 172.21.15.49:0/153772853 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.240+0000 7fb70ed9d640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb710140360 0x7fb7100b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.241+0000 7fb70659c640 1 -- 172.21.15.49:0/153772853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb710140360 msgr2=0x7fb7100b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.241+0000 7fb70659c640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb710140360 0x7fb7100b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.241+0000 7fb70659c640 1 -- 172.21.15.49:0/153772853 >> v1:172.21.15.115:6789/0 conn(0x7fb710160f30 legacy=0x7fb7101613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.241+0000 7fb70659c640 1 -- 172.21.15.49:0/153772853 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100b8610 con 0x7fb7100b5cd0 2023-12-19T05:52:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.242+0000 7fb70659c640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7100b5cd0 0x7fb7100b6130 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009870 tx=0x7fb6f802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c15a1568ff7b27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.242+0000 7fb70e59c640 1 -- 172.21.15.49:0/153772853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80317c0 con 0x7fb7100b5cd0 2023-12-19T05:52:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.242+0000 7fb70e59c640 1 -- 172.21.15.49:0/153772853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8031920 con 0x7fb7100b5cd0 2023-12-19T05:52:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.242+0000 7fb70e59c640 1 -- 172.21.15.49:0/153772853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8031cb0 con 0x7fb7100b5cd0 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 -- 172.21.15.49:0/153772853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7100b5cd0 msgr2=0x7fb7100b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7100b5cd0 0x7fb7100b6130 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009870 tx=0x7fb6f802b860 comp rx=0 tx=0).stop 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 -- 172.21.15.49:0/153772853 shutdown_connections 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7100b5cd0 0x7fb7100b6130 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 --2- 172.21.15.49:0/153772853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb710140360 0x7fb7100b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 -- 172.21.15.49:0/153772853 >> 172.21.15.49:0/153772853 conn(0x7fb710065dc0 msgr2=0x7fb7100b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 -- 172.21.15.49:0/153772853 shutdown_connections 2023-12-19T05:52:59.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.243+0000 7fb7148f6640 1 -- 172.21.15.49:0/153772853 wait complete. 2023-12-19T05:52:59.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.245+0000 7fb7148f6640 1 Processor -- start 2023-12-19T05:52:59.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.245+0000 7fb7148f6640 1 -- start start 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7100b5cd0 0x7fb710142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb710160f30 0x7fb71013b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101f39a0 con 0x7fb710140360 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101f2d50 con 0x7fb710160f30 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb7148f6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101f3030 con 0x7fb7100b5cd0 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.246+0000 7fb70659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45078/0 (socket says 172.21.15.49:45078) 2023-12-19T05:52:59.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 -- 172.21.15.49:0/3344576877 learned_addr learned my addr 172.21.15.49:0/3344576877 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70ed9d640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7100b5cd0 0x7fb710142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70f59e640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb710160f30 0x7fb71013b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 -- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7100b5cd0 msgr2=0x7fb710142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7100b5cd0 0x7fb710142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 -- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb710160f30 msgr2=0x7fb71013b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb710160f30 0x7fb71013b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 -- 172.21.15.49:0/3344576877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80094d0 con 0x7fb710140360 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.247+0000 7fb70659c640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009870 tx=0x7fb6f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.248+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8032860 con 0x7fb710140360 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.248+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80329c0 con 0x7fb710140360 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.248+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8032d70 con 0x7fb710140360 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.248+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7101f3310 con 0x7fb710140360 2023-12-19T05:52:59.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.248+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb710142580 con 0x7fb710140360 2023-12-19T05:52:59.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.249+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7101f3b10 con 0x7fb710140360 2023-12-19T05:52:59.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.250+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6f804d3f0 con 0x7fb710140360 2023-12-19T05:52:59.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.252+0000 7fb707fff640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 0x7fb6f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:52:59.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.252+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb6f80aa870 con 0x7fb710140360 2023-12-19T05:52:59.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.252+0000 7fb70ed9d640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 0x7fb6f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:52:59.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.253+0000 7fb70ed9d640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 0x7fb6f006c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb700006fd0 tx=0x7fb700008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:52:59.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.256+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb7101f3b10 con 0x7fb710140360 2023-12-19T05:52:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.463+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb7101f3ae0 con 0x7fb710140360 2023-12-19T05:52:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.464+0000 7fb707fff640 1 -- 172.21.15.49:0/3344576877 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v198) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb6f8075e30 con 0x7fb710140360 2023-12-19T05:52:59.466 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-12-19T05:52:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.466+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 msgr2=0x7fb6f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.466+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 0x7fb6f006c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb700006fd0 tx=0x7fb700008040 comp rx=0 tx=0).stop 2023-12-19T05:52:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.466+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 msgr2=0x7fb71013ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.466+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009870 tx=0x7fb6f80046c0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 shutdown_connections 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fb6f006a430 0x7fb6f006c8f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb710160f30 0x7fb71013b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb710140360 0x7fb71013ab30 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 --2- 172.21.15.49:0/3344576877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7100b5cd0 0x7fb710142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 >> 172.21.15.49:0/3344576877 conn(0x7fb710065dc0 msgr2=0x7fb7100d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 shutdown_connections 2023-12-19T05:52:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:52:59.467+0000 7fb7148f6640 1 -- 172.21.15.49:0/3344576877 wait complete. 2023-12-19T05:52:59.488 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T05:52:59.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:59.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T05:52:59.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:59.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:59.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:52:59.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:52:59.592 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T05:52:59.634 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:52:59.634 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:59.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:52:59.692 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:52:59.692 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:52:59.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:52:59.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:53:00.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.012+0000 7f548482d640 1 Processor -- start 2023-12-19T05:53:00.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.012+0000 7f548482d640 1 -- start start 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f548482d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5480161810 0x7f54800cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f548482d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54800cc8a0 0x7f54800cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f548482d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54800b22b0 con 0x7f54800ce490 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f548482d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5480161bf0 con 0x7f54800cc8a0 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f548482d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800b2830 con 0x7f5480161810 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f5476ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54800cc8a0 0x7f54800cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f547ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f54800ce490 0x7f5480165260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38006/0 (socket says 172.21.15.49:38006) 2023-12-19T05:53:00.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f547ffff640 1 -- 172.21.15.49:0/2454695750 learned_addr learned my addr 172.21.15.49:0/2454695750 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.014+0000 7f547f7fe640 1 --2- 172.21.15.49:0/2454695750 >> v2:172.21.15.115:3300/0 conn(0x7f5480161810 0x7f54800cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.015+0000 7f5476ffd640 1 -- 172.21.15.49:0/2454695750 >> v2:172.21.15.115:3300/0 conn(0x7f5480161810 msgr2=0x7f54800cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.015+0000 7f5476ffd640 1 --2- 172.21.15.49:0/2454695750 >> v2:172.21.15.115:3300/0 conn(0x7f5480161810 0x7f54800cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.015+0000 7f5476ffd640 1 -- 172.21.15.49:0/2454695750 >> v1:172.21.15.49:6789/0 conn(0x7f54800ce490 legacy=0x7f5480165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.015+0000 7f5476ffd640 1 -- 172.21.15.49:0/2454695750 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800b2550 con 0x7f54800cc8a0 2023-12-19T05:53:00.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.015+0000 7f547effd640 1 -- 172.21.15.49:0/2454695750 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937679310 0 0) 0x7f54800b22b0 con 0x7f54800ce490 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.016+0000 7f5476ffd640 1 --2- 172.21.15.49:0/2454695750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f54800cdf50 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5480070e30 tx=0x7f546802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d02e4e61dff494 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.016+0000 7f547effd640 1 -- 172.21.15.49:0/2454695750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546802e070 con 0x7f54800cc8a0 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.016+0000 7f547effd640 1 -- 172.21.15.49:0/2454695750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54680315a0 con 0x7f54800cc8a0 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.016+0000 7f547effd640 1 -- 172.21.15.49:0/2454695750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468031930 con 0x7f54800cc8a0 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 -- 172.21.15.49:0/2454695750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 msgr2=0x7f54800cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 --2- 172.21.15.49:0/2454695750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f54800cdf50 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5480070e30 tx=0x7f546802b840 comp rx=0 tx=0).stop 2023-12-19T05:53:00.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 -- 172.21.15.49:0/2454695750 shutdown_connections 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 --2- 172.21.15.49:0/2454695750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f54800cdf50 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 --2- 172.21.15.49:0/2454695750 >> v2:172.21.15.115:3300/0 conn(0x7f5480161810 0x7f54800cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 -- 172.21.15.49:0/2454695750 >> 172.21.15.49:0/2454695750 conn(0x7f54800b0100 msgr2=0x7f54800b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 -- 172.21.15.49:0/2454695750 shutdown_connections 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.017+0000 7f548482d640 1 -- 172.21.15.49:0/2454695750 wait complete. 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.019+0000 7f548482d640 1 Processor -- start 2023-12-19T05:53:00.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.019+0000 7f548482d640 1 -- start start 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 0x7f5480164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 0x7f54801fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5480151ca0 con 0x7f54800cc8a0 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54801607a0 con 0x7f54800ce490 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f548482d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548015f1c0 con 0x7f5480161810 2023-12-19T05:53:00.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45104/0 (socket says 172.21.15.49:45104) 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.020+0000 7f547f7fe640 1 -- 172.21.15.49:0/3774997489 learned_addr learned my addr 172.21.15.49:0/3774997489 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547ffff640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 0x7f54801fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f5476ffd640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 0x7f5480164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 -- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 msgr2=0x7f54801fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 0x7f54801fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 -- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 msgr2=0x7f5480164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 0x7f5480164460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 -- 172.21.15.49:0/3774997489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468009400 con 0x7f54800cc8a0 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547ffff640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 0x7f54801fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f5476ffd640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 0x7f5480164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:00.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547f7fe640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f547000d5f0 tx=0x7f547000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700125f0 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470012750 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470012b00 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.021+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548015f4a0 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.022+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548015fa60 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.023+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5480061910 con 0x7f54800cc8a0 2023-12-19T05:53:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.024+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5470012c60 con 0x7f54800cc8a0 2023-12-19T05:53:00.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.025+0000 7f547cff9640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 0x7f546006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.025+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5470088dd0 con 0x7f54800cc8a0 2023-12-19T05:53:00.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.025+0000 7f5476ffd640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 0x7f546006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.027+0000 7f5476ffd640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 0x7f546006c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5468036000 tx=0x7f5468008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.029+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5470054390 con 0x7f54800cc8a0 2023-12-19T05:53:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.264+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f548015ebc0 con 0x7f54800cc8a0 2023-12-19T05:53:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.265+0000 7f547cff9640 1 -- 172.21.15.49:0/3774997489 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f54700579b0 con 0x7f54800cc8a0 2023-12-19T05:53:00.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:00.269 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:53:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:53:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 msgr2=0x7f546006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 0x7f546006c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5468036000 tx=0x7f5468008030 comp rx=0 tx=0).stop 2023-12-19T05:53:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 msgr2=0x7f5480160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f547000d5f0 tx=0x7f547000dab0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 shutdown_connections 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f546006a430 0x7f546006c8f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480161810 0x7f54801fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54800ce490 0x7f5480164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 --2- 172.21.15.49:0/3774997489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54800cc8a0 0x7f5480160260 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 >> 172.21.15.49:0/3774997489 conn(0x7f54800b0100 msgr2=0x7f54800cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 shutdown_connections 2023-12-19T05:53:00.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.268+0000 7f548482d640 1 -- 172.21.15.49:0/3774997489 wait complete. 2023-12-19T05:53:00.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:53:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.521+0000 7fc22ecec640 1 Processor -- start 2023-12-19T05:53:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.521+0000 7fc22ecec640 1 -- start start 2023-12-19T05:53:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.522+0000 7fc22ecec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc228157bf0 0x7fc22815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.522+0000 7fc22ecec640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2280b0810 0x7fc22806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.522+0000 7fc22ecec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22815b740 con 0x7fc2280ae110 2023-12-19T05:53:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.522+0000 7fc22ecec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22806b8c0 con 0x7fc228157bf0 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.522+0000 7fc22ecec640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280ae640 con 0x7fc2280b0810 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc228157bf0 0x7fc22815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc228157bf0 0x7fc22815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45108/0 (socket says 172.21.15.49:45108) 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 -- 172.21.15.49:0/927349943 learned_addr learned my addr 172.21.15.49:0/927349943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 -- 172.21.15.49:0/927349943 >> v2:172.21.15.115:3300/0 conn(0x7fc2280b0810 msgr2=0x7fc22806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 --2- 172.21.15.49:0/927349943 >> v2:172.21.15.115:3300/0 conn(0x7fc2280b0810 0x7fc22806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 -- 172.21.15.49:0/927349943 >> v1:172.21.15.115:6789/0 conn(0x7fc2280ae110 legacy=0x7fc2280b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.523+0000 7fc22ca88640 1 -- 172.21.15.49:0/927349943 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280ae920 con 0x7fc228157bf0 2023-12-19T05:53:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.524+0000 7fc22ca88640 1 --2- 172.21.15.49:0/927349943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc22815b200 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc2280b1210 tx=0x7fc21802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c47a962d8670b77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc2277fe640 1 -- 172.21.15.49:0/927349943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218031870 con 0x7fc228157bf0 2023-12-19T05:53:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc2277fe640 1 -- 172.21.15.49:0/927349943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180319d0 con 0x7fc228157bf0 2023-12-19T05:53:00.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc2277fe640 1 -- 172.21.15.49:0/927349943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218031d60 con 0x7fc228157bf0 2023-12-19T05:53:00.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 -- 172.21.15.49:0/927349943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 msgr2=0x7fc22815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 --2- 172.21.15.49:0/927349943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc22815b200 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc2280b1210 tx=0x7fc21802b910 comp rx=0 tx=0).stop 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 -- 172.21.15.49:0/927349943 shutdown_connections 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 --2- 172.21.15.49:0/927349943 >> v2:172.21.15.115:3300/0 conn(0x7fc2280b0810 0x7fc22806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 --2- 172.21.15.49:0/927349943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc22815b200 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 -- 172.21.15.49:0/927349943 >> 172.21.15.49:0/927349943 conn(0x7fc2280cbb70 msgr2=0x7fc2280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.525+0000 7fc22ecec640 1 -- 172.21.15.49:0/927349943 shutdown_connections 2023-12-19T05:53:00.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.526+0000 7fc22ecec640 1 -- 172.21.15.49:0/927349943 wait complete. 2023-12-19T05:53:00.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.527+0000 7fc22ecec640 1 Processor -- start 2023-12-19T05:53:00.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.527+0000 7fc22ecec640 1 -- start start 2023-12-19T05:53:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280ae110 0x7fc22815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2280b0810 0x7fc2281487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22815bcc0 con 0x7fc228157bf0 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22815bfa0 con 0x7fc2280ae110 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.528+0000 7fc22ecec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22815c280 con 0x7fc2280b0810 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45120/0 (socket says 172.21.15.49:45120) 2023-12-19T05:53:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 -- 172.21.15.49:0/1433687581 learned_addr learned my addr 172.21.15.49:0/1433687581 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc227fff640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2280b0810 0x7fc2281487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22ca88640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280ae110 0x7fc22815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 -- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2280b0810 msgr2=0x7fc2281487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2280b0810 0x7fc2281487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 -- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280ae110 msgr2=0x7fc22815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280ae110 0x7fc22815cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.529+0000 7fc22d289640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094d0 con 0x7fc228157bf0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc22d289640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc220009fd0 tx=0x7fc22000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011830 con 0x7fc228157bf0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220011990 con 0x7fc228157bf0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22815c560 con 0x7fc228157bf0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011d20 con 0x7fc228157bf0 2023-12-19T05:53:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.530+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22814b890 con 0x7fc228157bf0 2023-12-19T05:53:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.531+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22815ca80 con 0x7fc228157bf0 2023-12-19T05:53:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.532+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc22001b460 con 0x7fc228157bf0 2023-12-19T05:53:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.533+0000 7fc2257fa640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 0x7fc21406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.533+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc220088730 con 0x7fc228157bf0 2023-12-19T05:53:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.534+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fc214071fc0 con 0x7fc228157bf0 2023-12-19T05:53:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.534+0000 7fc22ca88640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 0x7fc21406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:00.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.536+0000 7fc22ca88640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 0x7fc21406c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc218036000 tx=0x7fc21803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:00.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.538+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc22815ca80 con 0x7fc228157bf0 2023-12-19T05:53:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.732+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc22815ca80 con 0x7fc228157bf0 2023-12-19T05:53:00.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.735+0000 7fc2257fa640 1 -- 172.21.15.49:0/1433687581 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16188 (secure 0 0 0) 0x7fc22815ca80 con 0x7fc228157bf0 2023-12-19T05:53:00.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:00.738 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":199,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:53:00.490415+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.1f","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:53:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 msgr2=0x7fc21406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 0x7fc21406c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc218036000 tx=0x7fc21803c040 comp rx=0 tx=0).stop 2023-12-19T05:53:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 msgr2=0x7fc228151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc220009fd0 tx=0x7fc22000b8e0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 shutdown_connections 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc21406a430 0x7fc21406c8f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2280b0810 0x7fc2281487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc228157bf0 0x7fc228151e10 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 --2- 172.21.15.49:0/1433687581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280ae110 0x7fc22815cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 >> 172.21.15.49:0/1433687581 conn(0x7fc2280cbb70 msgr2=0x7fc22814fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.738+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 shutdown_connections 2023-12-19T05:53:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:00.739+0000 7fc22ecec640 1 -- 172.21.15.49:0/1433687581 wait complete. 2023-12-19T05:53:00.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:52.584713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:52:17.038396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:52:18.108157+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:53:00.760 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:53:01.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.000+0000 7f5089679640 1 Processor -- start 2023-12-19T05:53:01.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.001+0000 7f5089679640 1 -- start start 2023-12-19T05:53:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.002+0000 7f5089679640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5084144820 0x7f508415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.002+0000 7f5089679640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 0x7f5084065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.002+0000 7f5089679640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5084071740 con 0x7f5084070820 2023-12-19T05:53:01.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.002+0000 7f5089679640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840663c0 con 0x7f5084144820 2023-12-19T05:53:01.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.002+0000 7f5089679640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840b4120 con 0x7f50840659d0 2023-12-19T05:53:01.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.003+0000 7f507bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5084070820 0x7f50840cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38016/0 (socket says 172.21.15.49:38016) 2023-12-19T05:53:01.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.003+0000 7f507bfff640 1 -- 172.21.15.49:0/125301960 learned_addr learned my addr 172.21.15.49:0/125301960 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.003+0000 7f5088e78640 1 --2- 172.21.15.49:0/125301960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 0x7f5084065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.003+0000 7f5083fff640 1 --2- 172.21.15.49:0/125301960 >> v2:172.21.15.115:3300/0 conn(0x7f5084144820 0x7f508415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f50837fe640 1 -- 172.21.15.49:0/125301960 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351440947 0 0) 0x7f5084071740 con 0x7f5084070820 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f50837fe640 1 -- 172.21.15.49:0/125301960 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5070003520 con 0x7f5084070820 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f5088e78640 1 -- 172.21.15.49:0/125301960 >> v2:172.21.15.115:3300/0 conn(0x7f5084144820 msgr2=0x7f508415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f5088e78640 1 --2- 172.21.15.49:0/125301960 >> v2:172.21.15.115:3300/0 conn(0x7f5084144820 0x7f508415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f5088e78640 1 -- 172.21.15.49:0/125301960 >> v1:172.21.15.49:6789/0 conn(0x7f5084070820 legacy=0x7f50840cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.004+0000 7f5088e78640 1 -- 172.21.15.49:0/125301960 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508415bb00 con 0x7f50840659d0 2023-12-19T05:53:01.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.005+0000 7f5088e78640 1 --2- 172.21.15.49:0/125301960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 0x7f5084065e80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b979d180f370ee4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.006+0000 7f50837fe640 1 -- 172.21.15.49:0/125301960 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c02cc60 con 0x7f50840659d0 2023-12-19T05:53:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.006+0000 7f50837fe640 1 -- 172.21.15.49:0/125301960 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c02cdc0 con 0x7f50840659d0 2023-12-19T05:53:01.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.006+0000 7f50837fe640 1 -- 172.21.15.49:0/125301960 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c034660 con 0x7f50840659d0 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 -- 172.21.15.49:0/125301960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 msgr2=0x7f5084065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 --2- 172.21.15.49:0/125301960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 0x7f5084065e80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c02beb0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 -- 172.21.15.49:0/125301960 shutdown_connections 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 --2- 172.21.15.49:0/125301960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50840659d0 0x7f5084065e80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 --2- 172.21.15.49:0/125301960 >> v2:172.21.15.115:3300/0 conn(0x7f5084144820 0x7f508415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 -- 172.21.15.49:0/125301960 >> 172.21.15.49:0/125301960 conn(0x7f50840735a0 msgr2=0x7f50840b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 -- 172.21.15.49:0/125301960 shutdown_connections 2023-12-19T05:53:01.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.007+0000 7f5089679640 1 -- 172.21.15.49:0/125301960 wait complete. 2023-12-19T05:53:01.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.010+0000 7f5089679640 1 Processor -- start 2023-12-19T05:53:01.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.010+0000 7f5089679640 1 -- start start 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5084070820 0x7f50840ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5084144820 0x7f50840ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841f3890 con 0x7f50840659d0 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841f6e60 con 0x7f5084070820 2023-12-19T05:53:01.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.011+0000 7f5089679640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50841f2820 con 0x7f5084144820 2023-12-19T05:53:01.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.012+0000 7f5083fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.012+0000 7f5083fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45128/0 (socket says 172.21.15.49:45128) 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.012+0000 7f5083fff640 1 -- 172.21.15.49:0/599136470 learned_addr learned my addr 172.21.15.49:0/599136470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.012+0000 7f5088e78640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5084144820 0x7f50840ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.012+0000 7f507bfff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5084070820 0x7f50840ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 -- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5084144820 msgr2=0x7f50840ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5084144820 0x7f50840ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 -- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5084070820 msgr2=0x7f50840ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5084070820 0x7f50840ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c009a70 con 0x7f50840659d0 2023-12-19T05:53:01.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5083fff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f507400e8a0 tx=0x7f507400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50740094f0 con 0x7f50840659d0 2023-12-19T05:53:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400c940 con 0x7f50840659d0 2023-12-19T05:53:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400ccf0 con 0x7f50840659d0 2023-12-19T05:53:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.013+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50841f60a0 con 0x7f50840659d0 2023-12-19T05:53:01.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.014+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50841f6660 con 0x7f50840659d0 2023-12-19T05:53:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.015+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084061910 con 0x7f50840659d0 2023-12-19T05:53:01.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.016+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5074013470 con 0x7f50840659d0 2023-12-19T05:53:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.017+0000 7f50817fa640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 0x7f506406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.017+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f50740888f0 con 0x7f50840659d0 2023-12-19T05:53:01.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.017+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f5064071fc0 con 0x7f50840659d0 2023-12-19T05:53:01.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.018+0000 7f507bfff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 0x7f506406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.019+0000 7f507bfff640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 0x7f506406c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f50840b2ba0 tx=0x7f506c007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.021+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5074021060 con 0x7f50840659d0 2023-12-19T05:53:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.219+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f508415b180 con 0x7f50840659d0 2023-12-19T05:53:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.219+0000 7f50817fa640 1 -- 172.21.15.49:0/599136470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v199) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5074053f60 con 0x7f50840659d0 2023-12-19T05:53:01.222 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-19T05:53:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 msgr2=0x7f506406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 0x7f506406c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f50840b2ba0 tx=0x7f506c007d30 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 msgr2=0x7f50841f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f507400e8a0 tx=0x7f507400ed60 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 shutdown_connections 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f506406a430 0x7f506406c8f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5084144820 0x7f50840ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5084070820 0x7f50840ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 --2- 172.21.15.49:0/599136470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50840659d0 0x7f50841f22e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.222+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 >> 172.21.15.49:0/599136470 conn(0x7f50840735a0 msgr2=0x7f508406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.223+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 shutdown_connections 2023-12-19T05:53:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.223+0000 7f5089679640 1 -- 172.21.15.49:0/599136470 wait complete. 2023-12-19T05:53:01.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:53:01.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.484+0000 7fae46338640 1 Processor -- start 2023-12-19T05:53:01.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.484+0000 7fae46338640 1 -- start start 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.486+0000 7fae46338640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4013e1c0 0x7fae400d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.486+0000 7fae46338640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae4015f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.486+0000 7fae46338640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400cf770 con 0x7fae4006d7f0 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.486+0000 7fae46338640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae400cf560 con 0x7fae4013e1c0 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.486+0000 7fae46338640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400cfa50 con 0x7fae400d0df0 2023-12-19T05:53:01.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4013e1c0 0x7fae400d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae4013e1c0 0x7fae400d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45140/0 (socket says 172.21.15.49:45140) 2023-12-19T05:53:01.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 -- 172.21.15.49:0/4027013071 learned_addr learned my addr 172.21.15.49:0/4027013071 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:01.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 -- 172.21.15.49:0/4027013071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 msgr2=0x7fae4015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3f7fe640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae4015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae4015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 -- 172.21.15.49:0/4027013071 >> v1:172.21.15.115:6789/0 conn(0x7fae4006d7f0 legacy=0x7fae400a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3ffff640 1 -- 172.21.15.49:0/4027013071 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400cfd30 con 0x7fae4013e1c0 2023-12-19T05:53:01.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.487+0000 7fae3f7fe640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae4015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.488+0000 7fae3ffff640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae400d0530 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fae30009e50 tx=0x7fae3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cc15d59e2b479e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae3effd640 1 -- 172.21.15.49:0/4027013071 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3002ca70 con 0x7fae4013e1c0 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae3effd640 1 -- 172.21.15.49:0/4027013071 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3002cbd0 con 0x7fae4013e1c0 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae3effd640 1 -- 172.21.15.49:0/4027013071 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300343f0 con 0x7fae4013e1c0 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 -- 172.21.15.49:0/4027013071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 msgr2=0x7fae400d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae400d0530 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fae30009e50 tx=0x7fae3002bed0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 -- 172.21.15.49:0/4027013071 shutdown_connections 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae4015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 --2- 172.21.15.49:0/4027013071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae400d0530 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.489+0000 7fae46338640 1 -- 172.21.15.49:0/4027013071 >> 172.21.15.49:0/4027013071 conn(0x7fae4006a2e0 msgr2=0x7fae4006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.490+0000 7fae46338640 1 -- 172.21.15.49:0/4027013071 shutdown_connections 2023-12-19T05:53:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.490+0000 7fae46338640 1 -- 172.21.15.49:0/4027013071 wait complete. 2023-12-19T05:53:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.491+0000 7fae46338640 1 Processor -- start 2023-12-19T05:53:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.492+0000 7fae46338640 1 -- start start 2023-12-19T05:53:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.492+0000 7fae46338640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4006d7f0 0x7fae4013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.492+0000 7fae46338640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae401f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae46338640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae46338640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4013cc30 con 0x7fae4013e1c0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae46338640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae401581f0 con 0x7fae4006d7f0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae46338640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae40156a30 con 0x7fae400d0df0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45156/0 (socket says 172.21.15.49:45156) 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 -- 172.21.15.49:0/3618309534 learned_addr learned my addr 172.21.15.49:0/3618309534 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae3f7fe640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae401f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae3ffff640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4006d7f0 0x7fae4013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 -- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 msgr2=0x7fae401f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae401f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 -- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4006d7f0 msgr2=0x7fae4013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4006d7f0 0x7fae4013c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.493+0000 7fae448d5640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30009b30 con 0x7fae4013e1c0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae448d5640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c440 tx=0x7fae3800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38011790 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae380118f0 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38011ca0 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae40158420 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.494+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae401589e0 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.495+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40158ba0 con 0x7fae4013e1c0 2023-12-19T05:53:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.496+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae3801c460 con 0x7fae4013e1c0 2023-12-19T05:53:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.498+0000 7fae3cff9640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.498+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fae38088840 con 0x7fae4013e1c0 2023-12-19T05:53:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.498+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fae2c071fc0 con 0x7fae4013e1c0 2023-12-19T05:53:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.499+0000 7fae3ffff640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.500+0000 7fae3ffff640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fae30035000 tx=0x7fae30030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.503+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae38053e00 con 0x7fae4013e1c0 2023-12-19T05:53:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.696+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae40061910 con 0x7fae4013e1c0 2023-12-19T05:53:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.697+0000 7fae3cff9640 1 -- 172.21.15.49:0/3618309534 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v199) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae38057420 con 0x7fae4013e1c0 2023-12-19T05:53:01.699 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-19T05:53:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 msgr2=0x7fae2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fae30035000 tx=0x7fae30030000 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 msgr2=0x7fae40156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c440 tx=0x7fae3800c900 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 shutdown_connections 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fae2c06a430 0x7fae2c06c8f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae400d0df0 0x7fae401f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae4013e1c0 0x7fae40156200 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 --2- 172.21.15.49:0/3618309534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae4006d7f0 0x7fae4013c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 >> 172.21.15.49:0/3618309534 conn(0x7fae4006a2e0 msgr2=0x7fae400a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 shutdown_connections 2023-12-19T05:53:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.700+0000 7fae46338640 1 -- 172.21.15.49:0/3618309534 wait complete. 2023-12-19T05:53:01.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:53:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.957+0000 7f3eb1641640 1 Processor -- start 2023-12-19T05:53:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.957+0000 7f3eb1641640 1 -- start start 2023-12-19T05:53:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.958+0000 7f3eb1641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3eac166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eb1641640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac15c260 con 0x7f3eac0b2c20 2023-12-19T05:53:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eb1641640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0ced20 con 0x7f3eac0d0c30 2023-12-19T05:53:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eb1641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac15fae0 con 0x7f3eac15f6b0 2023-12-19T05:53:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eaa7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3eac0b2c20 0x7f3eac15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38026/0 (socket says 172.21.15.49:38026) 2023-12-19T05:53:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eaa7fc640 1 -- 172.21.15.49:0/632979055 learned_addr learned my addr 172.21.15.49:0/632979055 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3eac166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.959+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512121084 0 0) 0x7f3eac15c260 con 0x7f3eac0b2c20 2023-12-19T05:53:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94003520 con 0x7f3eac0b2c20 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3324298388 0 0) 0x7f3e94003520 con 0x7f3eac0b2c20 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 msgr2=0x7f3eac166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3eac166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 >> v1:172.21.15.115:6789/0 conn(0x7f3eac0d0c30 legacy=0x7f3eac0b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac15b9a0 con 0x7f3eac0b2c20 2023-12-19T05:53:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f3ea0001670 con 0x7f3eac0b2c20 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 >> v1:172.21.15.49:6789/0 conn(0x7f3eac0b2c20 legacy=0x7f3eac15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94003a10 0x7f3e94003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3e940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94004d00 0x7f3e94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac15fae0 con 0x7f3e94004d00 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400bb10 con 0x7f3e94003a10 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400bcd0 con 0x7f3eac15f6b0 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.960+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94004d00 0x7f3e94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eaaffd640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94003a10 0x7f3e94003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eaa7fc640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3e940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eab7fe640 1 -- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 msgr2=0x7f3e940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eac15f6b0 0x7f3e940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eab7fe640 1 -- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94003a10 msgr2=0x7f3e94003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94003a10 0x7f3e94003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eab7fe640 1 -- 172.21.15.49:0/632979055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94003520 con 0x7f3e94004d00 2023-12-19T05:53:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.961+0000 7f3eaaffd640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e94003a10 0x7f3e94003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.962+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94004d00 0x7f3e94005180 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009a90 tx=0x7f3e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf406251daefc6c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.962+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea402c680 con 0x7f3e94004d00 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.962+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea402c7e0 con 0x7f3e94004d00 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.962+0000 7f3ea9ffb640 1 -- 172.21.15.49:0/632979055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea402cb70 con 0x7f3e94004d00 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 -- 172.21.15.49:0/632979055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94004d00 msgr2=0x7f3e94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 --2- 172.21.15.49:0/632979055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e94004d00 0x7f3e94005180 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009a90 tx=0x7f3e940057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eab7fe640 1 -- 172.21.15.49:0/632979055 reap_dead start 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 -- 172.21.15.49:0/632979055 shutdown_connections 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 -- 172.21.15.49:0/632979055 >> 172.21.15.49:0/632979055 conn(0x7f3eac06ba40 msgr2=0x7f3eac06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 -- 172.21.15.49:0/632979055 shutdown_connections 2023-12-19T05:53:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.963+0000 7f3eb1641640 1 -- 172.21.15.49:0/632979055 wait complete. 2023-12-19T05:53:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.965+0000 7f3eb1641640 1 Processor -- start 2023-12-19T05:53:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.965+0000 7f3eb1641640 1 -- start start 2023-12-19T05:53:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e94004d00 0x7f3eac14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac1529b0 0x7f3eac155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac14c5a0 con 0x7f3eac1556d0 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac154d00 con 0x7f3eac1529b0 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eb1641640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac154430 con 0x7f3e94004d00 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45170/0 (socket says 172.21.15.49:45170) 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.966+0000 7f3eab7fe640 1 -- 172.21.15.49:0/2710877548 learned_addr learned my addr 172.21.15.49:0/2710877548 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eaaffd640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e94004d00 0x7f3eac14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eaa7fc640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac1529b0 0x7f3eac155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 -- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e94004d00 msgr2=0x7f3eac14bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e94004d00 0x7f3eac14bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 -- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac1529b0 msgr2=0x7f3eac155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac1529b0 0x7f3eac155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac14c2c0 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.967+0000 7f3eab7fe640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4037040 tx=0x7f3ea4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.968+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003810 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.968+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4003970 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.968+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003d00 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.968+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac1546b0 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.968+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac152df0 con 0x7f3eac1556d0 2023-12-19T05:53:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.969+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac154eb0 con 0x7f3eac1556d0 2023-12-19T05:53:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.970+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ea403b070 con 0x7f3eac1556d0 2023-12-19T05:53:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.971+0000 7f3e937fe640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 0x7f3e9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.972+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3ea40a9c10 con 0x7f3eac1556d0 2023-12-19T05:53:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.972+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f3e98071fc0 con 0x7f3eac1556d0 2023-12-19T05:53:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.972+0000 7f3eaaffd640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 0x7f3e9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.973+0000 7f3eaaffd640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 0x7f3e9806c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c007fd0 tx=0x7f3e9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:01.976+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ea4039060 con 0x7f3eac1556d0 2023-12-19T05:53:02.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.169+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3eac152fb0 con 0x7f3eac1556d0 2023-12-19T05:53:02.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.170+0000 7f3e937fe640 1 -- 172.21.15.49:0/2710877548 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v199) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3eac154eb0 con 0x7f3eac1556d0 2023-12-19T05:53:02.172 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.172+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 msgr2=0x7f3e9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.172+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 0x7f3e9806c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c007fd0 tx=0x7f3e9c009040 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.172+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 msgr2=0x7f3eac0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4037040 tx=0x7f3ea4004730 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 shutdown_connections 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3e9806a430 0x7f3e9806c8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac1556d0 0x7f3eac0b50e0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac1529b0 0x7f3eac155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 --2- 172.21.15.49:0/2710877548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e94004d00 0x7f3eac14bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 >> 172.21.15.49:0/2710877548 conn(0x7f3eac06ba40 msgr2=0x7f3eac0b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:02.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 shutdown_connections 2023-12-19T05:53:02.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.173+0000 7f3eb1641640 1 -- 172.21.15.49:0/2710877548 wait complete. 2023-12-19T05:53:02.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:53:02.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.417+0000 7f07c4d00640 1 Processor -- start 2023-12-19T05:53:02.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.417+0000 7f07c4d00640 1 -- start start 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07c4d00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07c01449e0 0x7f07c00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07c4d00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 0x7f07c006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07c4d00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00afb10 con 0x7f07c006b590 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07c4d00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c006bb30 con 0x7f07c01449e0 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07c4d00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b0070 con 0x7f07c00b0b50 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07bed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07c006b590 0x7f07c015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38028/0 (socket says 172.21.15.49:38028) 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07bed9d640 1 -- 172.21.15.49:0/3502541735 learned_addr learned my addr 172.21.15.49:0/3502541735 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07be59c640 1 --2- 172.21.15.49:0/3502541735 >> v2:172.21.15.49:3300/0 conn(0x7f07c01449e0 0x7f07c00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.419+0000 7f07b7fff640 1 --2- 172.21.15.49:0/3502541735 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 0x7f07c006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07bdd9b640 1 -- 172.21.15.49:0/3502541735 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149942699 0 0) 0x7f07c00afb10 con 0x7f07c006b590 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07bdd9b640 1 -- 172.21.15.49:0/3502541735 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ac003520 con 0x7f07c006b590 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07be59c640 1 -- 172.21.15.49:0/3502541735 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 msgr2=0x7f07c006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07be59c640 1 --2- 172.21.15.49:0/3502541735 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 0x7f07c006bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07be59c640 1 -- 172.21.15.49:0/3502541735 >> v1:172.21.15.49:6789/0 conn(0x7f07c006b590 legacy=0x7f07c015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07be59c640 1 -- 172.21.15.49:0/3502541735 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b0350 con 0x7f07c01449e0 2023-12-19T05:53:02.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.420+0000 7f07b7fff640 1 --2- 172.21.15.49:0/3502541735 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 0x7f07c006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.421+0000 7f07be59c640 1 --2- 172.21.15.49:0/3502541735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00af5d0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f07c0071c80 tx=0x7f07b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26858273f459bc58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.421+0000 7f07bdd9b640 1 -- 172.21.15.49:0/3502541735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0031830 con 0x7f07c01449e0 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.421+0000 7f07bdd9b640 1 -- 172.21.15.49:0/3502541735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0031990 con 0x7f07c01449e0 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.421+0000 7f07bdd9b640 1 -- 172.21.15.49:0/3502541735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0031d00 con 0x7f07c01449e0 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 -- 172.21.15.49:0/3502541735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 msgr2=0x7f07c00af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 --2- 172.21.15.49:0/3502541735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00af5d0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f07c0071c80 tx=0x7f07b002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 -- 172.21.15.49:0/3502541735 shutdown_connections 2023-12-19T05:53:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 --2- 172.21.15.49:0/3502541735 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b0b50 0x7f07c006bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 --2- 172.21.15.49:0/3502541735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00af5d0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 -- 172.21.15.49:0/3502541735 >> 172.21.15.49:0/3502541735 conn(0x7f07c00cbb70 msgr2=0x7f07c00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 -- 172.21.15.49:0/3502541735 shutdown_connections 2023-12-19T05:53:02.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.422+0000 7f07c4d00640 1 -- 172.21.15.49:0/3502541735 wait complete. 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.424+0000 7f07c4d00640 1 Processor -- start 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.424+0000 7f07c4d00640 1 -- start start 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 0x7f07c0143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b0b50 0x7f07c0143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0141e30 con 0x7f07c01449e0 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0142c90 con 0x7f07c00b0b50 2023-12-19T05:53:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07c4d00640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0144250 con 0x7f07c006b590 2023-12-19T05:53:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45182/0 (socket says 172.21.15.49:45182) 2023-12-19T05:53:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.425+0000 7f07bed9d640 1 -- 172.21.15.49:0/2333328032 learned_addr learned my addr 172.21.15.49:0/2333328032 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07be59c640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 0x7f07c0143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07b7fff640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b0b50 0x7f07c0143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 -- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 msgr2=0x7f07c0143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 0x7f07c0143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 -- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b0b50 msgr2=0x7f07c0143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b0b50 0x7f07c0143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009400 con 0x7f07c01449e0 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07be59c640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 0x7f07c0143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:53:02.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07bed9d640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f07b800cba0 tx=0x7f07b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800ad40 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.426+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8012400 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.427+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800aea0 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.427+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c0142080 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.427+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c0142640 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.428+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c0070fa0 con 0x7f07c01449e0 2023-12-19T05:53:02.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.429+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07b8007070 con 0x7f07c01449e0 2023-12-19T05:53:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.430+0000 7f07b6ffd640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 0x7f07a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.430+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f07b8088990 con 0x7f07c01449e0 2023-12-19T05:53:02.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.430+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f07a0071fc0 con 0x7f07c01449e0 2023-12-19T05:53:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.430+0000 7f07be59c640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 0x7f07a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.432+0000 7f07be59c640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 0x7f07a006c8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f07b0036000 tx=0x7f07b003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.434+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07b8017020 con 0x7f07c01449e0 2023-12-19T05:53:02.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.658+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07c0061910 con 0x7f07c01449e0 2023-12-19T05:53:02.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.658+0000 7f07b6ffd640 1 -- 172.21.15.49:0/2333328032 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f07b8053f50 con 0x7f07c01449e0 2023-12-19T05:53:02.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:02.661 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:53:02.661 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:53:02.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 msgr2=0x7f07a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 0x7f07a006c8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f07b0036000 tx=0x7f07b003c040 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 msgr2=0x7f07c00a8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f07b800cba0 tx=0x7f07b800a430 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 shutdown_connections 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f07a006a430 0x7f07a006c8f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07c01449e0 0x7f07c00a8c60 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b0b50 0x7f07c0143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 --2- 172.21.15.49:0/2333328032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c006b590 0x7f07c0143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.661+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 >> 172.21.15.49:0/2333328032 conn(0x7f07c00cbb70 msgr2=0x7f07c00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.662+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 shutdown_connections 2023-12-19T05:53:02.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.662+0000 7f07c4d00640 1 -- 172.21.15.49:0/2333328032 wait complete. 2023-12-19T05:53:02.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:53:02.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.913+0000 7f6418850640 1 Processor -- start 2023-12-19T05:53:02.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.913+0000 7f6418850640 1 -- start start 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6418850640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64140ac8b0 0x7f64140acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6418850640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 0x7f641406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6418850640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64140b2fa0 con 0x7f641415e3f0 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6418850640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64140ad280 con 0x7f64140ac8b0 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6418850640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641406f600 con 0x7f641406fa90 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6412d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f641415e3f0 0x7f64140b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38040/0 (socket says 172.21.15.49:38040) 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f640a59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64140ac8b0 0x7f64140acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.915+0000 7f6412d9d640 1 -- 172.21.15.49:0/3845497062 learned_addr learned my addr 172.21.15.49:0/3845497062 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f641359e640 1 --2- 172.21.15.49:0/3845497062 >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 0x7f641406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f640a59c640 1 -- 172.21.15.49:0/3845497062 >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 msgr2=0x7f641406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f640a59c640 1 --2- 172.21.15.49:0/3845497062 >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 0x7f641406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f640a59c640 1 -- 172.21.15.49:0/3845497062 >> v1:172.21.15.49:6789/0 conn(0x7f641415e3f0 legacy=0x7f64140b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f640a59c640 1 -- 172.21.15.49:0/3845497062 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641415e7d0 con 0x7f64140ac8b0 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f641259c640 1 -- 172.21.15.49:0/3845497062 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144874988 0 0) 0x7f64140b2fa0 con 0x7f641415e3f0 2023-12-19T05:53:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.916+0000 7f641359e640 1 --2- 172.21.15.49:0/3845497062 >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 0x7f641406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:02.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.917+0000 7f640a59c640 1 --2- 172.21.15.49:0/3845497062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64140ac8b0 0x7f64140acd40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f64140b11a0 tx=0x7f63fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22347ab8be23dfd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f641259c640 1 -- 172.21.15.49:0/3845497062 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc02e070 con 0x7f64140ac8b0 2023-12-19T05:53:02.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f641259c640 1 -- 172.21.15.49:0/3845497062 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc0315a0 con 0x7f64140ac8b0 2023-12-19T05:53:02.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f641259c640 1 -- 172.21.15.49:0/3845497062 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc031930 con 0x7f64140ac8b0 2023-12-19T05:53:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 -- 172.21.15.49:0/3845497062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64140ac8b0 msgr2=0x7f64140acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 --2- 172.21.15.49:0/3845497062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64140ac8b0 0x7f64140acd40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f64140b11a0 tx=0x7f63fc02b840 comp rx=0 tx=0).stop 2023-12-19T05:53:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 -- 172.21.15.49:0/3845497062 shutdown_connections 2023-12-19T05:53:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 --2- 172.21.15.49:0/3845497062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64140ac8b0 0x7f64140acd40 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 --2- 172.21.15.49:0/3845497062 >> v2:172.21.15.115:3300/0 conn(0x7f641406fa90 0x7f641406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 -- 172.21.15.49:0/3845497062 >> 172.21.15.49:0/3845497062 conn(0x7f64140b0100 msgr2=0x7f64140b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 -- 172.21.15.49:0/3845497062 shutdown_connections 2023-12-19T05:53:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.918+0000 7f6418850640 1 -- 172.21.15.49:0/3845497062 wait complete. 2023-12-19T05:53:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.920+0000 7f6418850640 1 Processor -- start 2023-12-19T05:53:02.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.920+0000 7f6418850640 1 -- start start 2023-12-19T05:53:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 0x7f641406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64140ac8b0 0x7f641406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641406ca60 con 0x7f641415e3f0 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641406e520 con 0x7f64140ac8b0 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.921+0000 7f6418850640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641406c410 con 0x7f641406fa90 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45188/0 (socket says 172.21.15.49:45188) 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 -- 172.21.15.49:0/522539494 learned_addr learned my addr 172.21.15.49:0/522539494 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f640a59c640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64140ac8b0 0x7f641406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f6412d9d640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 0x7f641406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 -- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 msgr2=0x7f641406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 0x7f641406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 -- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64140ac8b0 msgr2=0x7f641406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64140ac8b0 0x7f641406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f641359e640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009400 con 0x7f641415e3f0 2023-12-19T05:53:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.922+0000 7f6412d9d640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 0x7f641406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f641359e640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f640c00cd50 tx=0x7f640c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00f680 con 0x7f641415e3f0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c00f800 con 0x7f641415e3f0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641406c6f0 con 0x7f641415e3f0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00fbb0 con 0x7f641415e3f0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.923+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6414148f90 con 0x7f641415e3f0 2023-12-19T05:53:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.924+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641406cbd0 con 0x7f641415e3f0 2023-12-19T05:53:02.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.925+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f640c00b040 con 0x7f641415e3f0 2023-12-19T05:53:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.927+0000 7f640bfff640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 0x7f63f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.927+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f640c089460 con 0x7f641415e3f0 2023-12-19T05:53:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.927+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f63f8071fc0 con 0x7f641415e3f0 2023-12-19T05:53:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.927+0000 7f6412d9d640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 0x7f63f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.928+0000 7f6412d9d640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 0x7f63f806c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6404000f60 tx=0x7f6404009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:02.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:02.931+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f640c01d020 con 0x7f641415e3f0 2023-12-19T05:53:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.118+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641406f260 con 0x7f641415e3f0 2023-12-19T05:53:03.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.121+0000 7f640bfff640 1 -- 172.21.15.49:0/522539494 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16188 (secure 0 0 0) 0x7f640c0549a0 con 0x7f641415e3f0 2023-12-19T05:53:03.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:03.123 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":199,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:53:00.490415+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.1f","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:53:03.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 msgr2=0x7f63f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 0x7f63f806c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6404000f60 tx=0x7f6404009040 comp rx=0 tx=0).stop 2023-12-19T05:53:03.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 msgr2=0x7f6414148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f640c00cd50 tx=0x7f640c00a650 comp rx=0 tx=0).stop 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 shutdown_connections 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f63f806a430 0x7f63f806c8f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641415e3f0 0x7f6414148a50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64140ac8b0 0x7f641406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 --2- 172.21.15.49:0/522539494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f641406fa90 0x7f641406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.125+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 >> 172.21.15.49:0/522539494 conn(0x7f64140b0100 msgr2=0x7f6414070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.126+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 shutdown_connections 2023-12-19T05:53:03.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.126+0000 7f6418850640 1 -- 172.21.15.49:0/522539494 wait complete. 2023-12-19T05:53:03.146 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:53:03.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:53:03.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.376+0000 7f8d2630a640 1 Processor -- start 2023-12-19T05:53:03.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.376+0000 7f8d2630a640 1 -- start start 2023-12-19T05:53:03.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.377+0000 7f8d2630a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8d20157bf0 0x7f8d2015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d2630a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d200b0810 0x7f8d2006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d2630a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2015b740 con 0x7f8d200ae110 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d2630a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2006b8c0 con 0x7f8d20157bf0 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d2630a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d200ae640 con 0x7f8d200b0810 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8d20157bf0 0x7f8d2015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8d20157bf0 0x7f8d2015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45202/0 (socket says 172.21.15.49:45202) 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 -- 172.21.15.49:0/1668828745 learned_addr learned my addr 172.21.15.49:0/1668828745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:03.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 -- 172.21.15.49:0/1668828745 >> v2:172.21.15.115:3300/0 conn(0x7f8d200b0810 msgr2=0x7f8d2006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 --2- 172.21.15.49:0/1668828745 >> v2:172.21.15.115:3300/0 conn(0x7f8d200b0810 0x7f8d2006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 -- 172.21.15.49:0/1668828745 >> v1:172.21.15.115:6789/0 conn(0x7f8d200ae110 legacy=0x7f8d200b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.378+0000 7f8d1ffff640 1 -- 172.21.15.49:0/1668828745 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200ae920 con 0x7f8d20157bf0 2023-12-19T05:53:03.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.379+0000 7f8d1ffff640 1 --2- 172.21.15.49:0/1668828745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d2015b200 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f8d200b1210 tx=0x7f8d1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7197714354be04c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d1f7fe640 1 -- 172.21.15.49:0/1668828745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10031870 con 0x7f8d20157bf0 2023-12-19T05:53:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d1f7fe640 1 -- 172.21.15.49:0/1668828745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d100319d0 con 0x7f8d20157bf0 2023-12-19T05:53:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d1f7fe640 1 -- 172.21.15.49:0/1668828745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10031d60 con 0x7f8d20157bf0 2023-12-19T05:53:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 -- 172.21.15.49:0/1668828745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 msgr2=0x7f8d2015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 --2- 172.21.15.49:0/1668828745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d2015b200 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f8d200b1210 tx=0x7f8d1002b910 comp rx=0 tx=0).stop 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 -- 172.21.15.49:0/1668828745 shutdown_connections 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 --2- 172.21.15.49:0/1668828745 >> v2:172.21.15.115:3300/0 conn(0x7f8d200b0810 0x7f8d2006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 --2- 172.21.15.49:0/1668828745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d2015b200 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.380+0000 7f8d2630a640 1 -- 172.21.15.49:0/1668828745 >> 172.21.15.49:0/1668828745 conn(0x7f8d200cbb70 msgr2=0x7f8d200cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.381+0000 7f8d2630a640 1 -- 172.21.15.49:0/1668828745 shutdown_connections 2023-12-19T05:53:03.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.381+0000 7f8d2630a640 1 -- 172.21.15.49:0/1668828745 wait complete. 2023-12-19T05:53:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.382+0000 7f8d2630a640 1 Processor -- start 2023-12-19T05:53:03.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.382+0000 7f8d2630a640 1 -- start start 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d200ae110 0x7f8d2015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d200b0810 0x7f8d2015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2015ce10 con 0x7f8d20157bf0 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2015d7e0 con 0x7f8d200b0810 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.383+0000 7f8d2630a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2015c200 con 0x7f8d200ae110 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45206/0 (socket says 172.21.15.49:45206) 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 -- 172.21.15.49:0/4290682483 learned_addr learned my addr 172.21.15.49:0/4290682483 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 -- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d200ae110 msgr2=0x7f8d2015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d200ae110 0x7f8d2015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 -- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d200b0810 msgr2=0x7f8d2015b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d200b0810 0x7f8d2015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100094d0 con 0x7f8d20157bf0 2023-12-19T05:53:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.384+0000 7f8d248a7640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b970 tx=0x7f8d1800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.385+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800cb40 con 0x7f8d20157bf0 2023-12-19T05:53:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.385+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800ccc0 con 0x7f8d20157bf0 2023-12-19T05:53:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.385+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2015c4e0 con 0x7f8d20157bf0 2023-12-19T05:53:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.385+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18014680 con 0x7f8d20157bf0 2023-12-19T05:53:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.385+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2015caa0 con 0x7f8d20157bf0 2023-12-19T05:53:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.386+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d20157430 con 0x7f8d20157bf0 2023-12-19T05:53:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.387+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d1801d3b0 con 0x7f8d20157bf0 2023-12-19T05:53:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.388+0000 7f8d1d7fa640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 0x7f8d0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.388+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8d18088880 con 0x7f8d20157bf0 2023-12-19T05:53:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.389+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f8d00071ff0 con 0x7f8d20157bf0 2023-12-19T05:53:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.389+0000 7f8d1ffff640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 0x7f8d0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.390+0000 7f8d1ffff640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 0x7f8d0006c920 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8d10036000 tx=0x7f8d10030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.393+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d18019020 con 0x7f8d20157bf0 2023-12-19T05:53:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.625+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d20061910 con 0x7f8d20157bf0 2023-12-19T05:53:03.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.626+0000 7f8d1d7fa640 1 -- 172.21.15.49:0/4290682483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f8d180578c0 con 0x7f8d20157bf0 2023-12-19T05:53:03.628 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:03.628 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:53:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:53:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.629+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 msgr2=0x7f8d0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.629+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 0x7f8d0006c920 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8d10036000 tx=0x7f8d10030000 comp rx=0 tx=0).stop 2023-12-19T05:53:03.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.629+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 msgr2=0x7f8d20151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.629+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b970 tx=0x7f8d1800be30 comp rx=0 tx=0).stop 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 shutdown_connections 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f8d0006a460 0x7f8d0006c920 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d20157bf0 0x7f8d20151fb0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d200b0810 0x7f8d2015b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 --2- 172.21.15.49:0/4290682483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d200ae110 0x7f8d2015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 >> 172.21.15.49:0/4290682483 conn(0x7f8d200cbb70 msgr2=0x7f8d2015dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 shutdown_connections 2023-12-19T05:53:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.630+0000 7f8d2630a640 1 -- 172.21.15.49:0/4290682483 wait complete. 2023-12-19T05:53:03.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:53:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.885+0000 7f8437fff640 1 Processor -- start 2023-12-19T05:53:03.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.886+0000 7f8437fff640 1 -- start start 2023-12-19T05:53:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.887+0000 7f8437fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84380d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.887+0000 7f8437fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f84380d0a90 0x7f843815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.887+0000 7f8437fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84380d12d0 con 0x7f8438146e30 2023-12-19T05:53:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.887+0000 7f8437fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8438147210 con 0x7f84380d0a90 2023-12-19T05:53:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.887+0000 7f8437fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380d2370 con 0x7f84380b8070 2023-12-19T05:53:03.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f8436ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8438146e30 0x7f84380b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38054/0 (socket says 172.21.15.49:38054) 2023-12-19T05:53:03.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f8436ffd640 1 -- 172.21.15.49:0/2335897046 learned_addr learned my addr 172.21.15.49:0/2335897046 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:03.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f84377fe640 1 --2- 172.21.15.49:0/2335897046 >> v2:172.21.15.49:3300/0 conn(0x7f84380d0a90 0x7f843815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f84367fc640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84380d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f8435ffb640 1 -- 172.21.15.49:0/2335897046 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300635830 0 0) 0x7f84380d12d0 con 0x7f8438146e30 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.888+0000 7f8435ffb640 1 -- 172.21.15.49:0/2335897046 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8424003520 con 0x7f8438146e30 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.889+0000 7f84377fe640 1 -- 172.21.15.49:0/2335897046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 msgr2=0x7f84380d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.889+0000 7f84377fe640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84380d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.889+0000 7f84377fe640 1 -- 172.21.15.49:0/2335897046 >> v1:172.21.15.49:6789/0 conn(0x7f8438146e30 legacy=0x7f84380b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.889+0000 7f84377fe640 1 -- 172.21.15.49:0/2335897046 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380d15b0 con 0x7f84380d0a90 2023-12-19T05:53:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.890+0000 7f84377fe640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f843815d870 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f84300097d0 tx=0x7f843002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3a4f8f9d958790 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.890+0000 7f8435ffb640 1 -- 172.21.15.49:0/2335897046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430031770 con 0x7f84380d0a90 2023-12-19T05:53:03.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.890+0000 7f8435ffb640 1 -- 172.21.15.49:0/2335897046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300318d0 con 0x7f84380d0a90 2023-12-19T05:53:03.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.890+0000 7f8435ffb640 1 -- 172.21.15.49:0/2335897046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430031c40 con 0x7f84380d0a90 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 -- 172.21.15.49:0/2335897046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 msgr2=0x7f843815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f843815d870 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f84300097d0 tx=0x7f843002b810 comp rx=0 tx=0).stop 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 -- 172.21.15.49:0/2335897046 shutdown_connections 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f843815d870 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 --2- 172.21.15.49:0/2335897046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84380d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 -- 172.21.15.49:0/2335897046 >> 172.21.15.49:0/2335897046 conn(0x7f84380b2990 msgr2=0x7f84380b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 -- 172.21.15.49:0/2335897046 shutdown_connections 2023-12-19T05:53:03.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.891+0000 7f8437fff640 1 -- 172.21.15.49:0/2335897046 wait complete. 2023-12-19T05:53:03.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.893+0000 7f8437fff640 1 Processor -- start 2023-12-19T05:53:03.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.893+0000 7f8437fff640 1 -- start start 2023-12-19T05:53:03.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84381e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438146e30 0x7f84380cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c9a00 con 0x7f84380d0a90 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c8d80 con 0x7f8438146e30 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.894+0000 7f8437fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c9060 con 0x7f84380b8070 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45226/0 (socket says 172.21.15.49:45226) 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 -- 172.21.15.49:0/745812717 learned_addr learned my addr 172.21.15.49:0/745812717 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:03.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f8436ffd640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84381e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84377fe640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438146e30 0x7f84380cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 -- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 msgr2=0x7f84381e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84381e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 -- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438146e30 msgr2=0x7f84380cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438146e30 0x7f84380cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.895+0000 7f84367fc640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009400 con 0x7f84380d0a90 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f84367fc640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f842800efc0 tx=0x7f842800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428009b80 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842800f040 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280146a0 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84380c9340 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.896+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438141630 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.897+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84380c9c70 con 0x7f84380d0a90 2023-12-19T05:53:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.898+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8428014800 con 0x7f84380d0a90 2023-12-19T05:53:03.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.899+0000 7f842f7fe640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 0x7f841806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:03.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.899+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f84280894a0 con 0x7f84380d0a90 2023-12-19T05:53:03.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.899+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f8418071fc0 con 0x7f84380d0a90 2023-12-19T05:53:03.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.900+0000 7f8436ffd640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 0x7f841806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.901+0000 7f8436ffd640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 0x7f841806c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8420007fd0 tx=0x7f8420009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:03.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:03.903+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8428054a60 con 0x7f84380d0a90 2023-12-19T05:53:04.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.135+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8438061910 con 0x7f84380d0a90 2023-12-19T05:53:04.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.136+0000 7f842f7fe640 1 -- 172.21.15.49:0/745812717 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f8428058080 con 0x7f84380d0a90 2023-12-19T05:53:04.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:52:19.076252+0000","modified":"2023-12-19T05:52:22.603778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8886":{"gid":8886,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/1808935012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1808935012},{"type":"v1","addr":"172.21.15.115:6837","nonce":1808935012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-19T05:53:04.139 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 88 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 msgr2=0x7f841806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 0x7f841806c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8420007fd0 tx=0x7f8420009040 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 msgr2=0x7f84381410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f842800efc0 tx=0x7f842800c490 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 shutdown_connections 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f841806a430 0x7f841806c8f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8438146e30 0x7f84380cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84380d0a90 0x7f84381410f0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 --2- 172.21.15.49:0/745812717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84380b8070 0x7f84381e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 >> 172.21.15.49:0/745812717 conn(0x7f84380b2990 msgr2=0x7f84380cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 shutdown_connections 2023-12-19T05:53:04.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.139+0000 7f8437fff640 1 -- 172.21.15.49:0/745812717 wait complete. 2023-12-19T05:53:04.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:53:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.392+0000 7f1cd278f640 1 Processor -- start 2023-12-19T05:53:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.392+0000 7f1cd278f640 1 -- start start 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd278f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc15e3f0 0x7f1ccc0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd278f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ccc0b2460 0x7f1ccc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd278f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc0b2fa0 con 0x7f1ccc0acdf0 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd278f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0ad280 con 0x7f1ccc0b2460 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd278f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc06f600 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd1f8e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1ccc0acdf0 0x7f1ccc160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50098/0 (socket says 172.21.15.49:50098) 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd1f8e640 1 -- 172.21.15.49:0/2659270239 learned_addr learned my addr 172.21.15.49:0/2659270239 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.394+0000 7f1cd0f8c640 1 --2- 172.21.15.49:0/2659270239 >> v2:172.21.15.49:3300/0 conn(0x7f1ccc0b2460 0x7f1ccc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cd178d640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc15e3f0 0x7f1ccc0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cc3fff640 1 -- 172.21.15.49:0/2659270239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174733105 0 0) 0x7f1ccc0b2fa0 con 0x7f1ccc0acdf0 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cc3fff640 1 -- 172.21.15.49:0/2659270239 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb8003520 con 0x7f1ccc0acdf0 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cd0f8c640 1 -- 172.21.15.49:0/2659270239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc15e3f0 msgr2=0x7f1ccc0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cd0f8c640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc15e3f0 0x7f1ccc0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cd0f8c640 1 -- 172.21.15.49:0/2659270239 >> v1:172.21.15.49:6789/0 conn(0x7f1ccc0acdf0 legacy=0x7f1ccc160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.395+0000 7f1cd0f8c640 1 -- 172.21.15.49:0/2659270239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc15e7d0 con 0x7f1ccc0b2460 2023-12-19T05:53:04.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.396+0000 7f1cd0f8c640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc0ac8b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097a0 tx=0x7f1cbc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8576fcb3f7b77c7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cc3fff640 1 -- 172.21.15.49:0/2659270239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc031780 con 0x7f1ccc0b2460 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cc3fff640 1 -- 172.21.15.49:0/2659270239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0318e0 con 0x7f1ccc0b2460 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cc3fff640 1 -- 172.21.15.49:0/2659270239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc031c70 con 0x7f1ccc0b2460 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 -- 172.21.15.49:0/2659270239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc0b2460 msgr2=0x7f1ccc0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc0ac8b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097a0 tx=0x7f1cbc02b820 comp rx=0 tx=0).stop 2023-12-19T05:53:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 -- 172.21.15.49:0/2659270239 shutdown_connections 2023-12-19T05:53:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc0ac8b0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2659270239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc15e3f0 0x7f1ccc0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.397+0000 7f1cd278f640 1 -- 172.21.15.49:0/2659270239 >> 172.21.15.49:0/2659270239 conn(0x7f1ccc0b0100 msgr2=0x7f1ccc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.398+0000 7f1cd278f640 1 -- 172.21.15.49:0/2659270239 shutdown_connections 2023-12-19T05:53:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.398+0000 7f1cd278f640 1 -- 172.21.15.49:0/2659270239 wait complete. 2023-12-19T05:53:04.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.399+0000 7f1cd278f640 1 Processor -- start 2023-12-19T05:53:04.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.399+0000 7f1cd278f640 1 -- start start 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0acdf0 0x7f1ccc06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc154320 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc06e100 con 0x7f1ccc0b2460 2023-12-19T05:53:04.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.400+0000 7f1cd278f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc06d4f0 con 0x7f1ccc0acdf0 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33410/0 (socket says 172.21.15.49:33410) 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 -- 172.21.15.49:0/2645801582 learned_addr learned my addr 172.21.15.49:0/2645801582 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd178d640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0acdf0 0x7f1ccc06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd0f8c640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 -- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0acdf0 msgr2=0x7f1ccc06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0acdf0 0x7f1ccc06ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 -- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc0b2460 msgr2=0x7f1ccc153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.401+0000 7f1cd1f8e640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cd1f8e640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009400 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cd1f8e640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400caa0 tx=0x7f1cc400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400ac00 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400ad60 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc06d7d0 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012620 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.402+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc06dd90 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.403+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc15d6b0 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.405+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cc4007070 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.405+0000 7f1cc1ffb640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 0x7f1cb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.406+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1cc4088890 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.406+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f1cb0071fc0 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.406+0000 7f1cd178d640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 0x7f1cb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.407+0000 7f1cd178d640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 0x7f1cb006c8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.410+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cc4017020 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.604+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ccc06e270 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.606+0000 7f1cc1ffb640 1 -- 172.21.15.49:0/2645801582 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16188 (secure 0 0 0) 0x7f1cc4053f00 con 0x7f1ccc15e3f0 2023-12-19T05:53:04.608 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:04.608 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":199,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:53:00.490415+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:52:17.038396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-19T05:52:18.108157+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.1f","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:53:04.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 msgr2=0x7f1cb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 0x7f1cb006c8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2023-12-19T05:53:04.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 msgr2=0x7f1ccc155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400caa0 tx=0x7f1cc400cf60 comp rx=0 tx=0).stop 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 shutdown_connections 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1cb006a430 0x7f1cb006c8f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ccc15e3f0 0x7f1ccc155520 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc0b2460 0x7f1ccc153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 --2- 172.21.15.49:0/2645801582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0acdf0 0x7f1ccc06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.609+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 >> 172.21.15.49:0/2645801582 conn(0x7f1ccc0b0100 msgr2=0x7f1ccc157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.610+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 shutdown_connections 2023-12-19T05:53:04.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.610+0000 7f1cd278f640 1 -- 172.21.15.49:0/2645801582 wait complete. 2023-12-19T05:53:04.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:53:04.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.866+0000 7fa31d92c640 1 Processor -- start 2023-12-19T05:53:04.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.866+0000 7fa31d92c640 1 -- start start 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.867+0000 7fa31d92c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa31806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.867+0000 7fa31d92c640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31815c9c0 con 0x7fa318155460 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.867+0000 7fa31d92c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31806d270 con 0x7fa3180b0a00 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.867+0000 7fa31d92c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31806d550 con 0x7fa31815de60 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa31c92a640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa318155460 0x7fa3180b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50100/0 (socket says 172.21.15.49:50100) 2023-12-19T05:53:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa31c92a640 1 -- 172.21.15.49:0/987119675 learned_addr learned my addr 172.21.15.49:0/987119675 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:04.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751266642 0 0) 0x7fa31815c9c0 con 0x7fa318155460 2023-12-19T05:53:04.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa31d12b640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa31806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa300003520 con 0x7fa318155460 2023-12-19T05:53:04.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1467515356 0 0) 0x7fa300003520 con 0x7fa318155460 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 msgr2=0x7fa31806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.868+0000 7fa30f7fe640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa31806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 >> v1:172.21.15.115:6789/0 conn(0x7fa3180b0a00 legacy=0x7fa31806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31806d830 con 0x7fa318155460 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fa3140019f0 con 0x7fa318155460 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 >> v1:172.21.15.49:6789/0 conn(0x7fa318155460 legacy=0x7fa3180b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa300003a10 0x7fa300003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa3000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa300004d00 0x7fa300005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31806d550 con 0x7fa300003a10 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30000bb10 con 0x7fa300004d00 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30000bca0 con 0x7fa31815de60 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa300003a10 0x7fa300003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30ffff640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa3000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31d12b640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa300004d00 0x7fa300005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 -- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 msgr2=0x7fa3000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa3000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 -- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa300004d00 msgr2=0x7fa300005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa300004d00 0x7fa300005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31c92a640 1 -- 172.21.15.49:0/987119675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300003520 con 0x7fa300003a10 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa30ffff640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa31815de60 0x7fa3000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.869+0000 7fa31d12b640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa300004d00 0x7fa300005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa31c92a640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa300003a10 0x7fa300003e30 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fa31400a760 tx=0x7fa3000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8965545c917810b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314034630 con 0x7fa300003a10 2023-12-19T05:53:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31402f070 con 0x7fa300003a10 2023-12-19T05:53:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa30f7fe640 1 -- 172.21.15.49:0/987119675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314034a10 con 0x7fa300003a10 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa31d92c640 1 -- 172.21.15.49:0/987119675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa300003a10 msgr2=0x7fa300003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa31d92c640 1 --2- 172.21.15.49:0/987119675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa300003a10 0x7fa300003e30 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fa31400a760 tx=0x7fa3000057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.871+0000 7fa31d12b640 1 -- 172.21.15.49:0/987119675 reap_dead start 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.872+0000 7fa31d92c640 1 -- 172.21.15.49:0/987119675 shutdown_connections 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.872+0000 7fa31d92c640 1 -- 172.21.15.49:0/987119675 >> 172.21.15.49:0/987119675 conn(0x7fa3180659a0 msgr2=0x7fa318065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.872+0000 7fa31d92c640 1 -- 172.21.15.49:0/987119675 shutdown_connections 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.872+0000 7fa31d92c640 1 -- 172.21.15.49:0/987119675 wait complete. 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.874+0000 7fa31d92c640 1 Processor -- start 2023-12-19T05:53:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.874+0000 7fa31d92c640 1 -- start start 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa300003a10 0x7fa31806df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3180b1330 0x7fa3180ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f2d00 con 0x7fa3180ae9f0 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f2fe0 con 0x7fa3180b1330 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d92c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f32c0 con 0x7fa300003a10 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d12b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d12b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33438/0 (socket says 172.21.15.49:33438) 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31d12b640 1 -- 172.21.15.49:0/1587745595 learned_addr learned my addr 172.21.15.49:0/1587745595 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa31c92a640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa300003a10 0x7fa31806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.875+0000 7fa30ffff640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3180b1330 0x7fa3180ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 -- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa300003a10 msgr2=0x7fa31806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa300003a10 0x7fa31806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 -- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3180b1330 msgr2=0x7fa3180ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3180b1330 0x7fa3180ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3181f35a0 con 0x7fa3180ae9f0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d12b640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b3630 tx=0x7fa310010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31000e8a0 con 0x7fa3180ae9f0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31000ea20 con 0x7fa3180ae9f0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31000edd0 con 0x7fa3180ae9f0 2023-12-19T05:53:04.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.876+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3181f3880 con 0x7fa3180ae9f0 2023-12-19T05:53:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.877+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31806e440 con 0x7fa3180ae9f0 2023-12-19T05:53:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.878+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318156b90 con 0x7fa3180ae9f0 2023-12-19T05:53:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.879+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa310020410 con 0x7fa3180ae9f0 2023-12-19T05:53:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.880+0000 7fa30d7fa640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 0x7fa30406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.880+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa3100880d0 con 0x7fa3180ae9f0 2023-12-19T05:53:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.880+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fa304071fc0 con 0x7fa3180ae9f0 2023-12-19T05:53:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.880+0000 7fa31c92a640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 0x7fa30406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:04.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.882+0000 7fa31c92a640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 0x7fa30406c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa314034000 tx=0x7fa31402f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:04.884+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa310053750 con 0x7fa3180ae9f0 2023-12-19T05:53:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.116+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa318061910 con 0x7fa3180ae9f0 2023-12-19T05:53:05.120 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-12-19T05:53:05.118+0000 7f9984d43640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:53:05.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.122+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(200..200 src has 1..200) v4 ==== 374+0+0 (secure 0 0 0) 0x7fa310010020 con 0x7fa3180ae9f0 2023-12-19T05:53:05.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.122+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=201}) v3 -- 0x7fa304072870 con 0x7fa3180ae9f0 2023-12-19T05:53:05.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.137+0000 7fa30d7fa640 1 -- 172.21.15.49:0/1587745595 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa310056d70 con 0x7fa3180ae9f0 2023-12-19T05:53:05.139 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 msgr2=0x7fa30406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 0x7fa30406c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa314034000 tx=0x7fa31402f000 comp rx=0 tx=0).stop 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 msgr2=0x7fa318144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b3630 tx=0x7fa310010c20 comp rx=0 tx=0).stop 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 shutdown_connections 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fa30406a430 0x7fa30406c8f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3180ae9f0 0x7fa318144370 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3180b1330 0x7fa3180ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 --2- 172.21.15.49:0/1587745595 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa300003a10 0x7fa31806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 >> 172.21.15.49:0/1587745595 conn(0x7fa3180659a0 msgr2=0x7fa3181592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:05.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 shutdown_connections 2023-12-19T05:53:05.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.140+0000 7fa31d92c640 1 -- 172.21.15.49:0/1587745595 wait complete. 2023-12-19T05:53:05.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:53:05.173 INFO:tasks.ceph.mds.d.smithi115.stderr: -9150> 2023-12-19T05:52:23.529+0000 7fe1fab9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:53:05.246 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-12-19T05:53:05.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.396+0000 7f1355bbf640 1 Processor -- start 2023-12-19T05:53:05.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.396+0000 7f1355bbf640 1 -- start start 2023-12-19T05:53:05.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1355bbf640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1350155460 0x7f13500b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1355bbf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 0x7f135006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1355bbf640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135015c9c0 con 0x7f135006ca80 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1355bbf640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500b0cb0 con 0x7f1350155460 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1355bbf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135006d270 con 0x7f13500b0830 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f13553be640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f135006ca80 0x7f13500cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50108/0 (socket says 172.21.15.49:50108) 2023-12-19T05:53:05.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f13553be640 1 -- 172.21.15.49:0/2984442098 learned_addr learned my addr 172.21.15.49:0/2984442098 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.398+0000 7f1354bbd640 1 --2- 172.21.15.49:0/2984442098 >> v2:172.21.15.115:3300/0 conn(0x7f1350155460 0x7f13500b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134ffff640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 0x7f135006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974958680 0 0) 0x7f135015c9c0 con 0x7f135006ca80 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1338003520 con 0x7f135006ca80 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934572311 0 0) 0x7f1338003520 con 0x7f135006ca80 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 msgr2=0x7f135006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 0x7f135006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 >> v2:172.21.15.115:3300/0 conn(0x7f1350155460 msgr2=0x7f13500b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 --2- 172.21.15.49:0/2984442098 >> v2:172.21.15.115:3300/0 conn(0x7f1350155460 0x7f13500b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135006d550 con 0x7f135006ca80 2023-12-19T05:53:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1348001670 con 0x7f135006ca80 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 >> v1:172.21.15.49:6789/0 conn(0x7f135006ca80 legacy=0x7f13500cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 0x7f13380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1338003f60 0x7f13380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f1338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500b0cb0 con 0x7f1338004d00 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135006d270 con 0x7f1338003f60 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.399+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133800b9b0 con 0x7f13500b0830 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f1338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f134ffff640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1338003f60 0x7f13380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 -- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 msgr2=0x7f13380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13500b0830 0x7f13380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 -- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1338003f60 msgr2=0x7f13380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1338003f60 0x7f13380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.400+0000 7f13553be640 1 -- 172.21.15.49:0/2984442098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338003520 con 0x7f1338004d00 2023-12-19T05:53:05.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.401+0000 7f13553be640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f1338005180 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f134800c210 tx=0x7f13380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2855e8699ef8ecf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134802cae0 con 0x7f1338004d00 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134802cc40 con 0x7f1338004d00 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f134f7fe640 1 -- 172.21.15.49:0/2984442098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348005af0 con 0x7f1338004d00 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f1355bbf640 1 -- 172.21.15.49:0/2984442098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 msgr2=0x7f1338005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f1355bbf640 1 --2- 172.21.15.49:0/2984442098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f1338005180 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f134800c210 tx=0x7f13380057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f13553be640 1 -- 172.21.15.49:0/2984442098 reap_dead start 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f1355bbf640 1 -- 172.21.15.49:0/2984442098 shutdown_connections 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.402+0000 7f1355bbf640 1 -- 172.21.15.49:0/2984442098 >> 172.21.15.49:0/2984442098 conn(0x7f13500659a0 msgr2=0x7f1350065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.403+0000 7f1355bbf640 1 -- 172.21.15.49:0/2984442098 shutdown_connections 2023-12-19T05:53:05.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.403+0000 7f1355bbf640 1 -- 172.21.15.49:0/2984442098 wait complete. 2023-12-19T05:53:05.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.404+0000 7f1355bbf640 1 Processor -- start 2023-12-19T05:53:05.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.405+0000 7f1355bbf640 1 -- start start 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13501597b0 0x7f135015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1350153f40 0x7f13501543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015a2c0 con 0x7f1338004d00 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500a85b0 con 0x7f1350153f40 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1355bbf640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13501548e0 con 0x7f13501597b0 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1354bbd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1354bbd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33460/0 (socket says 172.21.15.49:33460) 2023-12-19T05:53:05.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.406+0000 7f1354bbd640 1 -- 172.21.15.49:0/1069616513 learned_addr learned my addr 172.21.15.49:0/1069616513 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:05.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 -- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13501597b0 msgr2=0x7f135015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13501597b0 0x7f135015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 -- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1350153f40 msgr2=0x7f13501543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f13553be640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1350153f40 0x7f13501543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1350153f40 0x7f13501543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350159d00 con 0x7f1338004d00 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1354bbd640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f1340009d20 tx=0x7f134000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003990 con 0x7f1338004d00 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134000f040 con 0x7f1338004d00 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003d50 con 0x7f1338004d00 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.407+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350159fe0 con 0x7f1338004d00 2023-12-19T05:53:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.408+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350155cc0 con 0x7f1338004d00 2023-12-19T05:53:05.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.409+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350155e80 con 0x7f1338004d00 2023-12-19T05:53:05.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.410+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1340004030 con 0x7f1338004d00 2023-12-19T05:53:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.411+0000 7f134d7fa640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 0x7f133c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.411+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1340089500 con 0x7f1338004d00 2023-12-19T05:53:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.411+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=201}) v3 -- 0x7f133c0720d0 con 0x7f1338004d00 2023-12-19T05:53:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.411+0000 7f134ffff640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 0x7f133c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.413+0000 7f134ffff640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 0x7f133c06c8f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f13500ac3a0 tx=0x7f1344008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:05.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.415+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1340054a00 con 0x7f1338004d00 2023-12-19T05:53:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:05.653+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1350155840 con 0x7f1338004d00 2023-12-19T05:53:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.140+0000 7f134d7fa640 1 -- 172.21.15.49:0/1069616513 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1350155840 con 0x7f1338004d00 2023-12-19T05:53:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 msgr2=0x7f133c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 0x7f133c06c8f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f13500ac3a0 tx=0x7f1344008040 comp rx=0 tx=0).stop 2023-12-19T05:53:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 msgr2=0x7f135015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f1340009d20 tx=0x7f134000c490 comp rx=0 tx=0).stop 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 shutdown_connections 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f133c06a430 0x7f133c06c8f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13501597b0 0x7f135015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1350153f40 0x7f13501543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.144+0000 7f1355bbf640 1 --2- 172.21.15.49:0/1069616513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1338004d00 0x7f135015a9c0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.145+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 >> 172.21.15.49:0/1069616513 conn(0x7f13500659a0 msgr2=0x7f13500ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.145+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 shutdown_connections 2023-12-19T05:53:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.145+0000 7f1355bbf640 1 -- 172.21.15.49:0/1069616513 wait complete. 2023-12-19T05:53:06.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:53:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.412+0000 7f785ec9e640 1 Processor -- start 2023-12-19T05:53:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.412+0000 7f785ec9e640 1 -- start start 2023-12-19T05:53:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.414+0000 7f785ec9e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f785815df30 0x7f78580acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.414+0000 7f785ec9e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78580ad460 con 0x7f78580acac0 2023-12-19T05:53:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.414+0000 7f785ec9e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785815e810 con 0x7f785815aed0 2023-12-19T05:53:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.414+0000 7f785ec9e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785815e340 con 0x7f785815df30 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785d49b640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f78580acac0 0x7f785815d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50116/0 (socket says 172.21.15.49:50116) 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785d49b640 1 -- 172.21.15.49:0/201438902 learned_addr learned my addr 172.21.15.49:0/201438902 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785e49d640 1 --2- 172.21.15.49:0/201438902 >> v2:172.21.15.49:3300/0 conn(0x7f785815df30 0x7f78580acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785cc9a640 1 -- 172.21.15.49:0/201438902 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139642857 0 0) 0x7f78580ad460 con 0x7f78580acac0 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785cc9a640 1 -- 172.21.15.49:0/201438902 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7844003520 con 0x7f78580acac0 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785e49d640 1 -- 172.21.15.49:0/201438902 >> v1:172.21.15.115:6789/0 conn(0x7f785815aed0 legacy=0x7f78580cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785e49d640 1 -- 172.21.15.49:0/201438902 >> v1:172.21.15.49:6789/0 conn(0x7f78580acac0 legacy=0x7f785815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.415+0000 7f785e49d640 1 -- 172.21.15.49:0/201438902 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785815b2b0 con 0x7f785815df30 2023-12-19T05:53:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785e49d640 1 --2- 172.21.15.49:0/201438902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815df30 0x7f78580acf20 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dbb07d1ad36378 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785cc9a640 1 -- 172.21.15.49:0/201438902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785002cc60 con 0x7f785815df30 2023-12-19T05:53:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785cc9a640 1 -- 172.21.15.49:0/201438902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785002cdc0 con 0x7f785815df30 2023-12-19T05:53:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785cc9a640 1 -- 172.21.15.49:0/201438902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850034660 con 0x7f785815df30 2023-12-19T05:53:06.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785ec9e640 1 -- 172.21.15.49:0/201438902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815df30 msgr2=0x7f78580acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.417+0000 7f785ec9e640 1 --2- 172.21.15.49:0/201438902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815df30 0x7f78580acf20 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785002beb0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.418+0000 7f785ec9e640 1 -- 172.21.15.49:0/201438902 shutdown_connections 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.418+0000 7f785ec9e640 1 --2- 172.21.15.49:0/201438902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815df30 0x7f78580acf20 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.418+0000 7f785ec9e640 1 -- 172.21.15.49:0/201438902 >> 172.21.15.49:0/201438902 conn(0x7f78580b4750 msgr2=0x7f78580659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.418+0000 7f785ec9e640 1 -- 172.21.15.49:0/201438902 shutdown_connections 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.418+0000 7f785ec9e640 1 -- 172.21.15.49:0/201438902 wait complete. 2023-12-19T05:53:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.420+0000 7f785ec9e640 1 Processor -- start 2023-12-19T05:53:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.420+0000 7f785ec9e640 1 -- start start 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78580acac0 0x7f78580cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785815df30 0x7f785815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580ae5d0 con 0x7f785815aed0 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785815fc50 con 0x7f785815df30 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785ec9e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785815fef0 con 0x7f78580acac0 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.421+0000 7f785d49b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33474/0 (socket says 172.21.15.49:33474) 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 -- 172.21.15.49:0/4111769311 learned_addr learned my addr 172.21.15.49:0/4111769311 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785dc9c640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78580acac0 0x7f78580cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785e49d640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785815df30 0x7f785815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 -- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78580acac0 msgr2=0x7f78580cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78580acac0 0x7f78580cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 -- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785815df30 msgr2=0x7f785815f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785815df30 0x7f785815f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850009a70 con 0x7f785815aed0 2023-12-19T05:53:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.422+0000 7f785d49b640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c500 tx=0x7f784c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.423+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c005ce0 con 0x7f785815aed0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.423+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c005e40 con 0x7f785815aed0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.423+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c007330 con 0x7f785815aed0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.423+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78580adf80 con 0x7f785815aed0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.423+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78581601d0 con 0x7f785815aed0 2023-12-19T05:53:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.424+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78580ae780 con 0x7f785815aed0 2023-12-19T05:53:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.425+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f784c007490 con 0x7f785815aed0 2023-12-19T05:53:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.426+0000 7f784a7fc640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 0x7f783c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.426+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f784c087fc0 con 0x7f785815aed0 2023-12-19T05:53:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.426+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=201}) v3 -- 0x7f783c072100 con 0x7f785815aed0 2023-12-19T05:53:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.427+0000 7f785dc9c640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 0x7f783c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.428+0000 7f785dc9c640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 0x7f783c06c920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7854000f60 tx=0x7f7854009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.431+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f784c017060 con 0x7f785815aed0 2023-12-19T05:53:06.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:06.629+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7858061910 con 0x7f785815aed0 2023-12-19T05:53:07.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.642+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(201..201 src has 1..201) v4 ==== 296+0+0 (secure 0 0 0) 0x7f784c05be40 con 0x7f785815aed0 2023-12-19T05:53:07.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.642+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f783c070530 con 0x7f785815aed0 2023-12-19T05:53:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.650+0000 7f784a7fc640 1 -- 172.21.15.49:0/4111769311 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v201) v1 ==== 181+0+0 (secure 0 0 0) 0x7f78580ae780 con 0x7f785815aed0 2023-12-19T05:53:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.659+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 msgr2=0x7f783c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.659+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 0x7f783c06c920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7854000f60 tx=0x7f7854009040 comp rx=0 tx=0).stop 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.659+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 msgr2=0x7f785814ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.659+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c500 tx=0x7f784c00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 shutdown_connections 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f783c06a460 0x7f783c06c920 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785815df30 0x7f785815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f785815aed0 0x7f785814ffb0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 --2- 172.21.15.49:0/4111769311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78580acac0 0x7f78580cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.660+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 >> 172.21.15.49:0/4111769311 conn(0x7f78580b4750 msgr2=0x7f785815d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:07.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.661+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 shutdown_connections 2023-12-19T05:53:07.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.662+0000 7f785ec9e640 1 -- 172.21.15.49:0/4111769311 wait complete. 2023-12-19T05:53:07.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:53:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.911+0000 7f5d8488a640 1 Processor -- start 2023-12-19T05:53:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.911+0000 7f5d8488a640 1 -- start start 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d8488a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d800cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d8488a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8015b460 con 0x7f5d800b0360 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d8488a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800cc700 con 0x7f5d80157970 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d8488a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800cdab0 con 0x7f5d8015b000 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d7ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5d800b0360 0x7f5d800b12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50128/0 (socket says 172.21.15.49:50128) 2023-12-19T05:53:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.913+0000 7f5d7ffff640 1 -- 172.21.15.49:0/794457914 learned_addr learned my addr 172.21.15.49:0/794457914 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7effd640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d800cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686866159 0 0) 0x7f5d78001490 con 0x7f5d800b0360 2023-12-19T05:53:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d68003520 con 0x7f5d800b0360 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865210357 0 0) 0x7f5d68003520 con 0x7f5d800b0360 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 msgr2=0x7f5d800cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d800cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 >> v1:172.21.15.115:6789/0 conn(0x7f5d80157970 legacy=0x7f5d800ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800cbd30 con 0x7f5d800b0360 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f5d78001b80 con 0x7f5d800b0360 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 >> v1:172.21.15.49:6789/0 conn(0x7f5d800b0360 legacy=0x7f5d800b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d680039a0 0x7f5d68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.914+0000 7f5d7e7fc640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d68004d00 0x7f5d68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800cdab0 con 0x7f5d68004d00 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6800ba30 con 0x7f5d680039a0 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6800bbf0 con 0x7f5d8015b000 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d68004d00 0x7f5d68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7effd640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7f7fe640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d680039a0 0x7f5d68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 -- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 msgr2=0x7f5d680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d8015b000 0x7f5d680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 -- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d680039a0 msgr2=0x7f5d68003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d680039a0 0x7f5d68003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7ffff640 1 -- 172.21.15.49:0/794457914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68003520 con 0x7f5d68004d00 2023-12-19T05:53:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.915+0000 7f5d7f7fe640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d680039a0 0x7f5d68003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.916+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d68004d00 0x7f5d68005180 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800a7d0 tx=0x7f5d680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4623dc8ea2f437 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78034630 con 0x7f5d68004d00 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7802f070 con 0x7f5d68004d00 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d7e7fc640 1 -- 172.21.15.49:0/794457914 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d780349f0 con 0x7f5d68004d00 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d8488a640 1 -- 172.21.15.49:0/794457914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d68004d00 msgr2=0x7f5d68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d8488a640 1 --2- 172.21.15.49:0/794457914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d68004d00 0x7f5d68005180 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800a7d0 tx=0x7f5d680057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d7ffff640 1 -- 172.21.15.49:0/794457914 reap_dead start 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d8488a640 1 -- 172.21.15.49:0/794457914 shutdown_connections 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.917+0000 7f5d8488a640 1 -- 172.21.15.49:0/794457914 >> 172.21.15.49:0/794457914 conn(0x7f5d800659a0 msgr2=0x7f5d80065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.918+0000 7f5d8488a640 1 -- 172.21.15.49:0/794457914 shutdown_connections 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.918+0000 7f5d8488a640 1 -- 172.21.15.49:0/794457914 wait complete. 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.919+0000 7f5d8488a640 1 Processor -- start 2023-12-19T05:53:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.920+0000 7f5d8488a640 1 -- start start 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d68004d00 0x7f5d80141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d801438e0 0x7f5d80143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801e50e0 con 0x7f5d801e4720 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800aed80 con 0x7f5d801438e0 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d8488a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80144450 con 0x7f5d68004d00 2023-12-19T05:53:07.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33498/0 (socket says 172.21.15.49:33498) 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 -- 172.21.15.49:0/3220988155 learned_addr learned my addr 172.21.15.49:0/3220988155 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7f7fe640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d68004d00 0x7f5d80141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7effd640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d801438e0 0x7f5d80143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 -- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d68004d00 msgr2=0x7f5d80141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d68004d00 0x7f5d80141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 -- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d801438e0 msgr2=0x7f5d80143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.921+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d801438e0 0x7f5d80143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d7ffff640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80144730 con 0x7f5d801e4720 2023-12-19T05:53:07.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d7ffff640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001e40 tx=0x7f5d8015a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78034840 con 0x7f5d801e4720 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d780349a0 con 0x7f5d801e4720 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78034d10 con 0x7f5d801e4720 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d80141850 con 0x7f5d801e4720 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.922+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d80141e10 con 0x7f5d801e4720 2023-12-19T05:53:07.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.924+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d80061910 con 0x7f5d801e4720 2023-12-19T05:53:07.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.925+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d78031030 con 0x7f5d801e4720 2023-12-19T05:53:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.925+0000 7f5d67fff640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 0x7f5d6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.926+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f5d780aa720 con 0x7f5d801e4720 2023-12-19T05:53:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.926+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f5d6c071260 con 0x7f5d801e4720 2023-12-19T05:53:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.926+0000 7f5d7f7fe640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 0x7f5d6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.927+0000 7f5d7f7fe640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 0x7f5d6c06c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5d801f5c80 tx=0x7f5d70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:07.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:07.930+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d78075e50 con 0x7f5d801e4720 2023-12-19T05:53:08.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.124+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d8015b460 con 0x7f5d801e4720 2023-12-19T05:53:08.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.654+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 7 ==== osd_map(202..202 src has 1..202) v4 ==== 313+0+0 (secure 0 0 0) 0x7f5d7807a210 con 0x7f5d801e4720 2023-12-19T05:53:08.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.654+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7f5d6c06fff0 con 0x7f5d801e4720 2023-12-19T05:53:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.664+0000 7f5d67fff640 1 -- 172.21.15.49:0/3220988155 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v202) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5d78079470 con 0x7f5d801e4720 2023-12-19T05:53:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-12-19T05:53:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.671+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 msgr2=0x7f5d6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.671+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 0x7f5d6c06c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5d801f5c80 tx=0x7f5d70009040 comp rx=0 tx=0).stop 2023-12-19T05:53:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.671+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 msgr2=0x7f5d801e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.671+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001e40 tx=0x7f5d8015a4d0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 shutdown_connections 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f5d6c06a430 0x7f5d6c06c8f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d801e4720 0x7f5d801e4ba0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d801438e0 0x7f5d80143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 --2- 172.21.15.49:0/3220988155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d68004d00 0x7f5d80141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.673+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 >> 172.21.15.49:0/3220988155 conn(0x7f5d800659a0 msgr2=0x7f5d80157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.674+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 shutdown_connections 2023-12-19T05:53:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.675+0000 7f5d8488a640 1 -- 172.21.15.49:0/3220988155 wait complete. 2023-12-19T05:53:08.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T05:53:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.916+0000 7f9347fff640 1 Processor -- start 2023-12-19T05:53:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.916+0000 7f9347fff640 1 -- start start 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9347fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93480b0a00 0x7f93480b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9347fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93480cd430 0x7f934806b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9347fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934806b3a0 con 0x7f9348159e40 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9347fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480b23e0 con 0x7f93480cd430 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9347fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480b1860 con 0x7f93480b0a00 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9346ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9348159e40 0x7f93480b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50130/0 (socket says 172.21.15.49:50130) 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f9346ffd640 1 -- 172.21.15.49:0/1340229917 learned_addr learned my addr 172.21.15.49:0/1340229917 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:08.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.918+0000 7f93477fe640 1 --2- 172.21.15.49:0/1340229917 >> v2:172.21.15.49:3300/0 conn(0x7f93480cd430 0x7f934806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f93467fc640 1 --2- 172.21.15.49:0/1340229917 >> v2:172.21.15.115:3300/0 conn(0x7f93480b0a00 0x7f93480b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f9345ffb640 1 -- 172.21.15.49:0/1340229917 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62601722 0 0) 0x7f934806b3a0 con 0x7f9348159e40 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f9345ffb640 1 -- 172.21.15.49:0/1340229917 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9330003520 con 0x7f9348159e40 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f93477fe640 1 -- 172.21.15.49:0/1340229917 >> v2:172.21.15.115:3300/0 conn(0x7f93480b0a00 msgr2=0x7f93480b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f93477fe640 1 --2- 172.21.15.49:0/1340229917 >> v2:172.21.15.115:3300/0 conn(0x7f93480b0a00 0x7f93480b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f93477fe640 1 -- 172.21.15.49:0/1340229917 >> v1:172.21.15.49:6789/0 conn(0x7f9348159e40 legacy=0x7f93480b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.919+0000 7f93477fe640 1 -- 172.21.15.49:0/1340229917 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480b1b40 con 0x7f93480cd430 2023-12-19T05:53:08.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.920+0000 7f93477fe640 1 --2- 172.21.15.49:0/1340229917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480cd430 0x7f934806b810 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f93480b2b90 tx=0x7f934002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb01558e3d2d73b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:08.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.920+0000 7f9345ffb640 1 -- 172.21.15.49:0/1340229917 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340030610 con 0x7f93480cd430 2023-12-19T05:53:08.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.920+0000 7f9345ffb640 1 -- 172.21.15.49:0/1340229917 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340030770 con 0x7f93480cd430 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.920+0000 7f9345ffb640 1 -- 172.21.15.49:0/1340229917 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340030ae0 con 0x7f93480cd430 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 -- 172.21.15.49:0/1340229917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480cd430 msgr2=0x7f934806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 --2- 172.21.15.49:0/1340229917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480cd430 0x7f934806b810 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f93480b2b90 tx=0x7f934002b960 comp rx=0 tx=0).stop 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 -- 172.21.15.49:0/1340229917 shutdown_connections 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 --2- 172.21.15.49:0/1340229917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480cd430 0x7f934806b810 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 --2- 172.21.15.49:0/1340229917 >> v2:172.21.15.115:3300/0 conn(0x7f93480b0a00 0x7f93480b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 -- 172.21.15.49:0/1340229917 >> 172.21.15.49:0/1340229917 conn(0x7f93480659a0 msgr2=0x7f9348065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 -- 172.21.15.49:0/1340229917 shutdown_connections 2023-12-19T05:53:08.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.921+0000 7f9347fff640 1 -- 172.21.15.49:0/1340229917 wait complete. 2023-12-19T05:53:08.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.923+0000 7f9347fff640 1 Processor -- start 2023-12-19T05:53:08.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.923+0000 7f9347fff640 1 -- start start 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93480cd430 0x7f934814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9348159e40 0x7f934806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481514a0 con 0x7f93480b0a00 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348151780 con 0x7f9348159e40 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9347fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9348151a60 con 0x7f93480cd430 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.924+0000 7f9346ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33520/0 (socket says 172.21.15.49:33520) 2023-12-19T05:53:08.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 -- 172.21.15.49:0/1586983966 learned_addr learned my addr 172.21.15.49:0/1586983966 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f93467fc640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93480cd430 0x7f934814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f93477fe640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9348159e40 0x7f934806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 -- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93480cd430 msgr2=0x7f934814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93480cd430 0x7f934814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 -- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9348159e40 msgr2=0x7f934806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9348159e40 0x7f934806f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 -- 172.21.15.49:0/1586983966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009400 con 0x7f93480b0a00 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.925+0000 7f9346ffd640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f933800c390 tx=0x7f933800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:08.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.926+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338005ce0 con 0x7f93480b0a00 2023-12-19T05:53:08.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.926+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338005e40 con 0x7f93480b0a00 2023-12-19T05:53:08.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.926+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93380072f0 con 0x7f93480b0a00 2023-12-19T05:53:08.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.926+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9348151d40 con 0x7f93480b0a00 2023-12-19T05:53:08.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.926+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9348152c90 con 0x7f93480b0a00 2023-12-19T05:53:08.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.927+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348061910 con 0x7f93480b0a00 2023-12-19T05:53:08.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.929+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9338007450 con 0x7f93480b0a00 2023-12-19T05:53:08.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.929+0000 7f932f7fe640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 0x7f933406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:08.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.930+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9338087c60 con 0x7f93480b0a00 2023-12-19T05:53:08.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.930+0000 7f93467fc640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 0x7f933406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:08.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.931+0000 7f93467fc640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 0x7f933406c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f934806cc00 tx=0x7f933c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:08.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:08.934+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9338053540 con 0x7f93480b0a00 2023-12-19T05:53:09.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.131+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f93480cda50 con 0x7f93480b0a00 2023-12-19T05:53:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.140+0000 7f932f7fe640 1 -- 172.21.15.49:0/1586983966 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9338056b60 con 0x7f93480b0a00 2023-12-19T05:53:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 msgr2=0x7f933406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 0x7f933406c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f934806cc00 tx=0x7f933c00b040 comp rx=0 tx=0).stop 2023-12-19T05:53:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 msgr2=0x7f9348150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f933800c390 tx=0x7f933800c850 comp rx=0 tx=0).stop 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 shutdown_connections 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f933406a430 0x7f933406c8f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93480cd430 0x7f934814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9348159e40 0x7f934806f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 --2- 172.21.15.49:0/1586983966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93480b0a00 0x7f9348150dc0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 >> 172.21.15.49:0/1586983966 conn(0x7f93480659a0 msgr2=0x7f93480ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.143+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 shutdown_connections 2023-12-19T05:53:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.144+0000 7f9347fff640 1 -- 172.21.15.49:0/1586983966 wait complete. 2023-12-19T05:53:09.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-19T05:53:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.389+0000 7f9fc60ec640 1 Processor -- start 2023-12-19T05:53:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.390+0000 7f9fc60ec640 1 -- start start 2023-12-19T05:53:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.391+0000 7f9fc60ec640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9fc00ce300 0x7f9fc015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.391+0000 7f9fc60ec640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc015ec30 con 0x7f9fc015e5a0 2023-12-19T05:53:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.391+0000 7f9fc60ec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc015fbc0 con 0x7f9fc00b2030 2023-12-19T05:53:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.391+0000 7f9fc60ec640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc015e980 con 0x7f9fc00ce300 2023-12-19T05:53:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fc50ea640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9fc015e5a0 0x7f9fc00b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50142/0 (socket says 172.21.15.49:50142) 2023-12-19T05:53:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fc50ea640 1 -- 172.21.15.49:0/1176284334 learned_addr learned my addr 172.21.15.49:0/1176284334 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fc58eb640 1 --2- 172.21.15.49:0/1176284334 >> v2:172.21.15.49:3300/0 conn(0x7f9fc00ce300 0x7f9fc015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fb7fff640 1 -- 172.21.15.49:0/1176284334 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257837788 0 0) 0x7f9fc015ec30 con 0x7f9fc015e5a0 2023-12-19T05:53:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fb7fff640 1 -- 172.21.15.49:0/1176284334 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fac003520 con 0x7f9fc015e5a0 2023-12-19T05:53:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fc58eb640 1 -- 172.21.15.49:0/1176284334 >> v1:172.21.15.115:6789/0 conn(0x7f9fc00b2030 legacy=0x7f9fc00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.392+0000 7f9fc58eb640 1 -- 172.21.15.49:0/1176284334 >> v1:172.21.15.49:6789/0 conn(0x7f9fc015e5a0 legacy=0x7f9fc00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.393+0000 7f9fc58eb640 1 -- 172.21.15.49:0/1176284334 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00b2f90 con 0x7f9fc00ce300 2023-12-19T05:53:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fc58eb640 1 --2- 172.21.15.49:0/1176284334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00ce300 0x7f9fc015f680 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009dc0 tx=0x7f9fb802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199fcb2cad291df2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fb7fff640 1 -- 172.21.15.49:0/1176284334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb802ccd0 con 0x7f9fc00ce300 2023-12-19T05:53:09.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fb7fff640 1 -- 172.21.15.49:0/1176284334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb802ce30 con 0x7f9fc00ce300 2023-12-19T05:53:09.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fb7fff640 1 -- 172.21.15.49:0/1176284334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8034660 con 0x7f9fc00ce300 2023-12-19T05:53:09.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1176284334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00ce300 msgr2=0x7f9fc015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.394+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1176284334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00ce300 0x7f9fc015f680 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009dc0 tx=0x7f9fb802bf20 comp rx=0 tx=0).stop 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.395+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1176284334 shutdown_connections 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.395+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1176284334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00ce300 0x7f9fc015f680 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.395+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1176284334 >> 172.21.15.49:0/1176284334 conn(0x7f9fc00b0100 msgr2=0x7f9fc00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.395+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1176284334 shutdown_connections 2023-12-19T05:53:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.395+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1176284334 wait complete. 2023-12-19T05:53:09.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.396+0000 7f9fc60ec640 1 Processor -- start 2023-12-19T05:53:09.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.397+0000 7f9fc60ec640 1 -- start start 2023-12-19T05:53:09.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.397+0000 7f9fc60ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.397+0000 7f9fc60ec640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 0x7f9fc00b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc60ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc015e5a0 0x7f9fc00b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc60ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f3b10 con 0x7f9fc00b2030 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc60ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f3db0 con 0x7f9fc015e5a0 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc60ec640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f31a0 con 0x7f9fc00ce300 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33534/0 (socket says 172.21.15.49:33534) 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 -- 172.21.15.49:0/1398888353 learned_addr learned my addr 172.21.15.49:0/1398888353 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc48e9640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 0x7f9fc00b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 -- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 msgr2=0x7f9fc00b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc58eb640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc015e5a0 0x7f9fc00b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:09.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 0x7f9fc00b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 -- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc015e5a0 msgr2=0x7f9fc00b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc015e5a0 0x7f9fc00b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc50ea640 1 -- 172.21.15.49:0/1398888353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8009a70 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.398+0000 7f9fc48e9640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 0x7f9fc00b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fc50ea640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00c440 tx=0x7f9fbc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc005ce0 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc005e40 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0072b0 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01f3480 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.399+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01f2e40 con 0x7f9fc00b2030 2023-12-19T05:53:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.400+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc006c660 con 0x7f9fc00b2030 2023-12-19T05:53:09.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.401+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fbc007410 con 0x7f9fc00b2030 2023-12-19T05:53:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.402+0000 7f9fb5ffb640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 0x7f9fa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.402+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9fbc087bd0 con 0x7f9fc00b2030 2023-12-19T05:53:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.403+0000 7f9fc48e9640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 0x7f9fa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:09.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.404+0000 7f9fc48e9640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 0x7f9fa406c920 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9fc014eba0 tx=0x7f9fb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.407+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fbc0534e0 con 0x7f9fc00b2030 2023-12-19T05:53:09.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:09.670+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f9fc0061910 con 0x7f9fc00b2030 2023-12-19T05:53:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.666+0000 7f9fb5ffb640 1 -- 172.21.15.49:0/1398888353 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v672) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9fbc0170c0 con 0x7f9fc00b2030 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 msgr2=0x7f9fa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 0x7f9fa406c920 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9fc014eba0 tx=0x7f9fb0009040 comp rx=0 tx=0).stop 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 msgr2=0x7f9fc01f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00c440 tx=0x7f9fbc00c900 comp rx=0 tx=0).stop 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 shutdown_connections 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9fa406a460 0x7f9fa406c920 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc00ce300 0x7f9fc00b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc015e5a0 0x7f9fc00b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 --2- 172.21.15.49:0/1398888353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc00b2030 0x7f9fc01f2900 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.670+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 >> 172.21.15.49:0/1398888353 conn(0x7f9fc00b0100 msgr2=0x7f9fc006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.671+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 shutdown_connections 2023-12-19T05:53:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:10.671+0000 7f9fc60ec640 1 -- 172.21.15.49:0/1398888353 wait complete. 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner: 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner:Ran 10 tests in 803.373s 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner: 2023-12-19T05:53:10.693 INFO:tasks.cephfs_test_runner:OK 2023-12-19T05:53:10.694 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T05:53:10.703 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T05:53:10.720 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T05:53:10.721 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:53:10.721 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:53:10.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:53:10.787 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-19T05:53:10.787 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:53:10.843 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T05:53:10.844 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:53:10.844 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:53:10.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:53:10.905 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-12-19T05:53:10.905 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:53:10.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T05:53:10.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:10.958 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:53:11.024 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:53:11.024 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T05:53:11.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:53:11.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T05:53:11.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-19T05:53:11.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.405 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-19T05:53:11.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-19T05:53:11.543 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-12-19T05:53:11.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:53:11.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.551 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:53:11.611 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T05:53:11.611 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T05:53:11.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T05:53:11.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T05:53:11.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-12-19T05:53:11.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.935 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-12-19T05:53:11.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:53:11.981 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-12-19T05:53:12.111 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-12-19T05:53:12.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:53:12.114 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T05:53:12.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T05:53:12.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:53:12.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.361+0000 7fe50a8a1640 1 Processor -- start 2023-12-19T05:53:12.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.362+0000 7fe50a8a1640 1 -- start start 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.363+0000 7fe50a8a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 0x7fe5040af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.363+0000 7fe50a8a1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5040b0b50 0x7fe50406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.363+0000 7fe50a8a1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5040afb10 con 0x7fe50406b590 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe50a8a1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50406bb30 con 0x7fe5040b0b50 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe50a8a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040b0070 con 0x7fe5041449e0 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5040b0b50 0x7fe50406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5040b0b50 0x7fe50406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33542/0 (socket says 172.21.15.49:33542) 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 -- 172.21.15.49:0/545210058 learned_addr learned my addr 172.21.15.49:0/545210058 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe503fff640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 0x7fe5040af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 -- 172.21.15.49:0/545210058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 msgr2=0x7fe5040af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 0x7fe5040af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 -- 172.21.15.49:0/545210058 >> v1:172.21.15.115:6789/0 conn(0x7fe50406b590 legacy=0x7fe50415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe5037fe640 1 -- 172.21.15.49:0/545210058 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040b0350 con 0x7fe5040b0b50 2023-12-19T05:53:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.364+0000 7fe503fff640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 0x7fe5040af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.366+0000 7fe5037fe640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5040b0b50 0x7fe50406bfa0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009870 tx=0x7fe4ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f169b4a1e000e698 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.366+0000 7fe502ffd640 1 -- 172.21.15.49:0/545210058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec031640 con 0x7fe5040b0b50 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.366+0000 7fe502ffd640 1 -- 172.21.15.49:0/545210058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0317a0 con 0x7fe5040b0b50 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.366+0000 7fe502ffd640 1 -- 172.21.15.49:0/545210058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec031b30 con 0x7fe5040b0b50 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 -- 172.21.15.49:0/545210058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5040b0b50 msgr2=0x7fe50406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5040b0b50 0x7fe50406bfa0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009870 tx=0x7fe4ec02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 -- 172.21.15.49:0/545210058 shutdown_connections 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5040b0b50 0x7fe50406bfa0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/545210058 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5041449e0 0x7fe5040af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 -- 172.21.15.49:0/545210058 >> 172.21.15.49:0/545210058 conn(0x7fe5040cbb70 msgr2=0x7fe5040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 -- 172.21.15.49:0/545210058 shutdown_connections 2023-12-19T05:53:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.367+0000 7fe50a8a1640 1 -- 172.21.15.49:0/545210058 wait complete. 2023-12-19T05:53:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.369+0000 7fe50a8a1640 1 Processor -- start 2023-12-19T05:53:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.369+0000 7fe50a8a1640 1 -- start start 2023-12-19T05:53:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50406b590 0x7fe50413edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5040b0b50 0x7fe5041f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50413f9b0 con 0x7fe5041449e0 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50413bee0 con 0x7fe5040b0b50 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe50a8a1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50413c780 con 0x7fe50406b590 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe508e3e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe508e3e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33558/0 (socket says 172.21.15.49:33558) 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe508e3e640 1 -- 172.21.15.49:0/1586163333 learned_addr learned my addr 172.21.15.49:0/1586163333 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.370+0000 7fe5037fe640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5040b0b50 0x7fe5041f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 -- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50406b590 msgr2=0x7fe50413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50406b590 0x7fe50413edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 -- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5040b0b50 msgr2=0x7fe5041f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5040b0b50 0x7fe5041f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 -- 172.21.15.49:0/1586163333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0094d0 con 0x7fe5041449e0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe508e3e640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c410 tx=0x7fe4fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011790 con 0x7fe5041449e0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0118f0 con 0x7fe5041449e0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011ce0 con 0x7fe5041449e0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50413f6d0 con 0x7fe5041449e0 2023-12-19T05:53:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.371+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50413f310 con 0x7fe5041449e0 2023-12-19T05:53:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.373+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50413f4a0 con 0x7fe5041449e0 2023-12-19T05:53:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.374+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4fc01c460 con 0x7fe5041449e0 2023-12-19T05:53:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.375+0000 7fe500ff9640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 0x7fe4e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.375+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4fc088280 con 0x7fe5041449e0 2023-12-19T05:53:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.375+0000 7fe503fff640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 0x7fe4e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.376+0000 7fe503fff640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 0x7fe4e406c920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4008e00 tx=0x7fe4f4008330 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.379+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe4fc053b60 con 0x7fe5041449e0 2023-12-19T05:53:12.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.579+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5040b0630 con 0x7fe4e406a460 2023-12-19T05:53:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.586+0000 7fe500ff9640 1 -- 172.21.15.49:0/1586163333 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47667 (secure 0 0 0) 0x7fe4f40089f0 con 0x7fe4e406a460 2023-12-19T05:53:12.588 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:12.589 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:53:12.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 msgr2=0x7fe4e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 0x7fe4e406c920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4008e00 tx=0x7fe4f4008330 comp rx=0 tx=0).stop 2023-12-19T05:53:12.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 msgr2=0x7fe504140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c410 tx=0x7fe4fc00c8d0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 shutdown_connections 2023-12-19T05:53:12.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe4e406a460 0x7fe4e406c920 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5041449e0 0x7fe504140dc0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5040b0b50 0x7fe5041f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 --2- 172.21.15.49:0/1586163333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50406b590 0x7fe50413edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.588+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 >> 172.21.15.49:0/1586163333 conn(0x7fe5040cbb70 msgr2=0x7fe50406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.589+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 shutdown_connections 2023-12-19T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.589+0000 7fe50a8a1640 1 -- 172.21.15.49:0/1586163333 wait complete. 2023-12-19T05:53:12.610 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":623,"stamp":"2023-12-19T05:53:10.807342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1449972,"statfs":{"total":1600000000,"available":1484771354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491623,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-4194304,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001899"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":331,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-12-19T05:53:00.499771+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:53:00.499771+0000","last_peered":"2023-12-19T05:53:00.499771+0000","last_clean":"2023-12-19T05:53:00.499771+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:53:00.499771+0000","last_undegraded":"2023-12-19T05:53:00.499771+0000","last_fullsized":"2023-12-19T05:53:00.499771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5202,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190109,"statfs":{"total":200000000,"available":194672613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.105,"15min":1.0920000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.56699999999999995},"max":{"1min":1.4830000000000001,"5min":1.635,"15min":6.4429999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.77400000000000002,"5min":0.77000000000000002,"15min":0.63300000000000001},"max":{"1min":1.444,"5min":1.768,"15min":3.976},"last":0.84999999999999998}]},{"osd":1,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1799999999999999,"15min":1.157},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":6.399},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1699999999999999,"15min":1.1759999999999999},"min":{"1min":0.70199999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.577,"5min":1.74,"15min":4.25},"last":1.105}]},{"osd":2,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.222},"min":{"1min":0.96299999999999997,"5min":0.69799999999999995,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":0.749},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1519999999999999,"15min":1.1220000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.64500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":0.89600000000000002}]},{"osd":3,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3080000000000001,"15min":1.272},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.622},"max":{"1min":1.595,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.3680000000000001},"min":{"1min":1.091,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.804,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":1.756,"5min":1.756,"15min":2.9980000000000002},"last":1.2},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.2789999999999999,"15min":1.2969999999999999},"min":{"1min":0.96299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":6.4850000000000003},"last":1.51}]},{"osd":5,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.335,"15min":1.343},"min":{"1min":0.97499999999999998,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.774,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.331,"15min":1.3},"min":{"1min":0.94299999999999995,"5min":0.72599999999999998,"15min":0.55600000000000005},"max":{"1min":1.734,"5min":1.9970000000000001,"15min":3.1909999999999998},"last":1.617}]},{"osd":6,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.476,"15min":1.4359999999999999},"min":{"1min":1.2809999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.863,"5min":1.883,"15min":3.0920000000000001},"last":1.8779999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.4670000000000001,"15min":1.4770000000000001},"min":{"1min":1.0740000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":7.7519999999999998},"last":2.032}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177821,"statfs":{"total":200000000,"available":182089465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":1.276},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.022}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.1379999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":1.415}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":1.103},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":1.4570000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":1.2310000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":1.522},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.48}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":1.571}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":18067,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177244,"statfs":{"total":200000000,"available":181498661,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":1.016},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":1.5700000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":1.401},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.4330000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":1.248}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":1.3149999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":1.139}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":1.845},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":1.476}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":1.9370000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575021,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186013,"statfs":{"total":200000000,"available":190478275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.173}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.351},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.0249999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.871}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.089}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.54}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.248},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.302}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4670000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179809,"statfs":{"total":200000000,"available":184125008,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.878},"min":{"1min":0.47499999999999998,"5min":0.42899999999999999,"15min":0.314},"max":{"1min":1.8129999999999999,"5min":1.8220000000000001,"15min":1.99},"last":0.36099999999999999},{"interface":"front","average":{"1min":1.095,"5min":0.995,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.499,"15min":0.34999999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.72},"last":0.38300000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.93100000000000005},"min":{"1min":0.623,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.702},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.175,"5min":1.1399999999999999,"15min":1.048},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.39100000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.3650000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.0760000000000001},"min":{"1min":0.69699999999999995,"5min":0.49399999999999999,"15min":0.45200000000000001},"max":{"1min":1.6519999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.497},{"interface":"front","average":{"1min":1.401,"5min":1.3109999999999999,"15min":1.2030000000000001},"min":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.45600000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.931},"last":0.56000000000000005}]},{"osd":4,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":1.0069999999999999,"5min":0.70199999999999996,"15min":0.51400000000000001},"max":{"1min":1.4710000000000001,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.351,"15min":1.3120000000000001},"min":{"1min":0.77200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":1.9359999999999999,"15min":2.5859999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.452,"15min":1.3779999999999999},"min":{"1min":0.82899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.052,"5min":2.052,"15min":4.8440000000000003},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.462,"5min":1.4510000000000001,"15min":1.3939999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.0640000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4970000000000001,"15min":1.4259999999999999},"min":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.71499999999999997},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.3879999999999999,"15min":1.3480000000000001},"min":{"1min":0.84699999999999998,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.877,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.458,"15min":1.417},"min":{"1min":0.89300000000000002,"5min":0.82599999999999996,"15min":0.55800000000000005},"max":{"1min":1.7350000000000001,"5min":2.093,"15min":2.1509999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.532,"15min":1.462},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.70099999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.8900000000000001},"last":0.84399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190109,"statfs":{"total":200000000,"available":194671829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.83699999999999997},"min":{"1min":0.65900000000000003,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":1.304,"5min":3.407,"15min":3.407},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.95199999999999996},"min":{"1min":0.69199999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6519999999999999,"5min":1.764,"15min":1.9450000000000001},"last":1.581}]},{"osd":1,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.147,"15min":1.107},"min":{"1min":0.90600000000000003,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.631,"5min":3.476,"15min":3.476},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.2509999999999999,"15min":1.2050000000000001},"min":{"1min":0.97599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.736,"5min":1.927,"15min":1.927},"last":1.1739999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.67400000000000004,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.3879999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.27},{"interface":"front","average":{"1min":1.29,"5min":1.246,"15min":1.179},"min":{"1min":0.95499999999999996,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.6080000000000001,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.232}]},{"osd":4,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":1.1080000000000001,"5min":0.872,"15min":0.52700000000000002},"max":{"1min":1.8540000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.306,"15min":1.2889999999999999},"min":{"1min":0.97699999999999998,"5min":0.76300000000000001,"15min":0.65100000000000002},"max":{"1min":1.6930000000000001,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.3069999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.3919999999999999,"15min":1.349},"min":{"1min":1.216,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.77,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.3779999999999999,"15min":1.331},"min":{"1min":0.92300000000000004,"5min":0.82999999999999996,"15min":0.72699999999999998},"max":{"1min":1.9910000000000001,"5min":2.028,"15min":2.5960000000000001},"last":1.429}]},{"osd":6,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.373,"15min":1.327},"min":{"1min":1.0089999999999999,"5min":0.77400000000000002,"15min":0.67700000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.526,"15min":1.4430000000000001},"min":{"1min":1.181,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.921,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.48}]},{"osd":7,"last update":"Tue Dec 19 05:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5029999999999999,"15min":1.4750000000000001},"min":{"1min":1.153,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.8460000000000001,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.7889999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.5029999999999999,"15min":1.474},"min":{"1min":1.1399999999999999,"5min":0.81299999999999994,"15min":0.71499999999999997},"max":{"1min":1.9810000000000001,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.6180000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22223,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173088,"statfs":{"total":200000000,"available":177243024,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.87},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.2}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.276},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.3500000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.153},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.3280000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.2290000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.7490000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19538,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175773,"statfs":{"total":200000000,"available":179992479,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":0.754},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":0.73399999999999999},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":0.98699999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.446}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":1.528}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":1.27}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":1.464},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.484}]}]}],"pool_statfs":[]}} 2023-12-19T05:53:12.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:53:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.841+0000 7fc7ce167640 1 Processor -- start 2023-12-19T05:53:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.841+0000 7fc7ce167640 1 -- start start 2023-12-19T05:53:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7ce167640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7c815e5a0 0x7fc7c80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7ce167640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7ce167640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c815ec30 con 0x7fc7c815f680 2023-12-19T05:53:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7ce167640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c80ce5a0 con 0x7fc7c815e5a0 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7ce167640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c815e980 con 0x7fc7c80cdbf0 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7cd165640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7c815e5a0 0x7fc7c80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7cd165640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7c815e5a0 0x7fc7c80b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33566/0 (socket says 172.21.15.49:33566) 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.843+0000 7fc7cd165640 1 -- 172.21.15.49:0/703392822 learned_addr learned my addr 172.21.15.49:0/703392822 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7cd966640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7cd165640 1 -- 172.21.15.49:0/703392822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 msgr2=0x7fc7c80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7cd165640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7cd165640 1 -- 172.21.15.49:0/703392822 >> v1:172.21.15.49:6789/0 conn(0x7fc7c815f680 legacy=0x7fc7c80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7cd165640 1 -- 172.21.15.49:0/703392822 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80b2f90 con 0x7fc7c815e5a0 2023-12-19T05:53:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.844+0000 7fc7bbfff640 1 -- 172.21.15.49:0/703392822 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463430561 0 0) 0x7fc7c815ec30 con 0x7fc7c815f680 2023-12-19T05:53:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.845+0000 7fc7cd165640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815e5a0 0x7fc7c80b2030 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098a0 tx=0x7fc7bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c7e0ba41c9dc78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.845+0000 7fc7bbfff640 1 -- 172.21.15.49:0/703392822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc030840 con 0x7fc7c815e5a0 2023-12-19T05:53:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.845+0000 7fc7bbfff640 1 -- 172.21.15.49:0/703392822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0309a0 con 0x7fc7c815e5a0 2023-12-19T05:53:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.845+0000 7fc7bbfff640 1 -- 172.21.15.49:0/703392822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc030d30 con 0x7fc7c815e5a0 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 -- 172.21.15.49:0/703392822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815e5a0 msgr2=0x7fc7c80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815e5a0 0x7fc7c80b2030 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098a0 tx=0x7fc7bc02b980 comp rx=0 tx=0).stop 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 -- 172.21.15.49:0/703392822 shutdown_connections 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 --2- 172.21.15.49:0/703392822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815e5a0 0x7fc7c80b2030 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 -- 172.21.15.49:0/703392822 >> 172.21.15.49:0/703392822 conn(0x7fc7c80b0100 msgr2=0x7fc7c80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 -- 172.21.15.49:0/703392822 shutdown_connections 2023-12-19T05:53:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.846+0000 7fc7ce167640 1 -- 172.21.15.49:0/703392822 wait complete. 2023-12-19T05:53:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.848+0000 7fc7ce167640 1 Processor -- start 2023-12-19T05:53:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.848+0000 7fc7ce167640 1 -- start start 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c815e5a0 0x7fc7c8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8150550 con 0x7fc7c815f680 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81507a0 con 0x7fc7c815e5a0 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.849+0000 7fc7ce167640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8150a80 con 0x7fc7c80cdbf0 2023-12-19T05:53:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33574/0 (socket says 172.21.15.49:33574) 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 -- 172.21.15.49:0/3404459769 learned_addr learned my addr 172.21.15.49:0/3404459769 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd165640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cc964640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c815e5a0 0x7fc7c8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 -- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 msgr2=0x7fc7c80aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 -- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c815e5a0 msgr2=0x7fc7c8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c815e5a0 0x7fc7c8146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd966640 1 -- 172.21.15.49:0/3404459769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0094d0 con 0x7fc7c815f680 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.850+0000 7fc7cd165640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7cd966640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000d5d0 tx=0x7fc7c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00125f0 con 0x7fc7c815f680 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0012770 con 0x7fc7c815f680 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8150d60 con 0x7fc7c815f680 2023-12-19T05:53:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0012b20 con 0x7fc7c815f680 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.851+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c8151560 con 0x7fc7c815f680 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.852+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c8151280 con 0x7fc7c815f680 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.853+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7c0012c80 con 0x7fc7c815f680 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.854+0000 7fc7b9ffb640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 0x7fc7ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.854+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc7c0088ab0 con 0x7fc7c815f680 2023-12-19T05:53:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.855+0000 7fc7cd165640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 0x7fc7ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:12.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.856+0000 7fc7cd165640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 0x7fc7ac06c920 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc036000 tx=0x7fc7bc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:12.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:12.859+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc7c0054310 con 0x7fc7c815f680 2023-12-19T05:53:13.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.051+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7c815ee80 con 0x7fc7ac06a460 2023-12-19T05:53:13.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.057+0000 7fc7b9ffb640 1 -- 172.21.15.49:0/3404459769 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47691 (secure 0 0 0) 0x7fc7bc044470 con 0x7fc7ac06a460 2023-12-19T05:53:13.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:13.060 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 msgr2=0x7fc7ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 0x7fc7ac06c920 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc036000 tx=0x7fc7bc008030 comp rx=0 tx=0).stop 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 msgr2=0x7fc7c80ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000d5d0 tx=0x7fc7c000da90 comp rx=0 tx=0).stop 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 shutdown_connections 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc7ac06a460 0x7fc7ac06c920 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c815f680 0x7fc7c80ae2b0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c815e5a0 0x7fc7c8146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 --2- 172.21.15.49:0/3404459769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c80cdbf0 0x7fc7c80aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.060+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 >> 172.21.15.49:0/3404459769 conn(0x7fc7c80b0100 msgr2=0x7fc7c80b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.061+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 shutdown_connections 2023-12-19T05:53:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.061+0000 7fc7ce167640 1 -- 172.21.15.49:0/3404459769 wait complete. 2023-12-19T05:53:13.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":624,"stamp":"2023-12-19T05:53:12.807913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10096,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552403,"statfs":{"total":1600000000,"available":1589661688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491623,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-4194304,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.683307"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":333,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-12-19T05:53:07.659837+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:53:07.659837+0000","last_peered":"2023-12-19T05:53:07.659837+0000","last_clean":"2023-12-19T05:53:07.659837+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:53:07.659837+0000","last_undegraded":"2023-12-19T05:53:07.659837+0000","last_fullsized":"2023-12-19T05:53:07.659837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.105,"15min":1.0920000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.56699999999999995},"max":{"1min":1.4830000000000001,"5min":1.635,"15min":6.4429999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.77400000000000002,"5min":0.77000000000000002,"15min":0.63300000000000001},"max":{"1min":1.444,"5min":1.768,"15min":3.976},"last":1.278}]},{"osd":1,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1799999999999999,"15min":1.157},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":6.399},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1699999999999999,"15min":1.1759999999999999},"min":{"1min":0.70199999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.577,"5min":1.74,"15min":4.25},"last":1.3759999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.222},"min":{"1min":0.96299999999999997,"5min":0.69799999999999995,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1519999999999999,"15min":1.1220000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.64500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":0.99299999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3080000000000001,"15min":1.272},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.622},"max":{"1min":1.595,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":1.359},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.3680000000000001},"min":{"1min":1.091,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.804,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":1.5369999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":1.756,"5min":1.756,"15min":2.9980000000000002},"last":1.113},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.2789999999999999,"15min":1.2969999999999999},"min":{"1min":0.96299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":6.4850000000000003},"last":1.145}]},{"osd":5,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.335,"15min":1.343},"min":{"1min":0.97499999999999998,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.774,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.331,"15min":1.3},"min":{"1min":0.94299999999999995,"5min":0.72599999999999998,"15min":0.55600000000000005},"max":{"1min":1.734,"5min":1.9970000000000001,"15min":3.1909999999999998},"last":1.23}]},{"osd":6,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.476,"15min":1.4359999999999999},"min":{"1min":1.2809999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.863,"5min":1.883,"15min":3.0920000000000001},"last":1.327},{"interface":"front","average":{"1min":1.516,"5min":1.4670000000000001,"15min":1.4770000000000001},"min":{"1min":1.0740000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":7.7519999999999998},"last":1.26}]}]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.173}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":1.052}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.0029999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.028}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.044},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.3500000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.83399999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.006}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":1.474},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.042}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.113},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.538}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.4219999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.314},"max":{"1min":1.23,"5min":1.8220000000000001,"15min":1.99},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.98799999999999999,"15min":0.91900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":1.5600000000000001,"5min":1.6060000000000001,"15min":1.72},"last":0.98299999999999998}]},{"osd":1,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.995,"15min":0.93300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.34599999999999997},"max":{"1min":1.4550000000000001,"5min":2.2519999999999998,"15min":2.702},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1399999999999999,"15min":1.0620000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.39100000000000001},"max":{"1min":1.665,"5min":2.004,"15min":2.3650000000000002},"last":1.25}]},{"osd":2,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.212,"15min":1.093},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.716,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.218},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45600000000000002},"max":{"1min":1.857,"5min":2.2469999999999999,"15min":2.931},"last":1.04}]},{"osd":4,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.27,"15min":1.202},"min":{"1min":0.81499999999999995,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.8939999999999999,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.387,"15min":1.321},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.59499999999999997},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.5859999999999999},"last":1.23}]},{"osd":5,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.476,"15min":1.3899999999999999},"min":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.67300000000000004},"max":{"1min":2.415,"5min":2.415,"15min":4.8440000000000003},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.46,"15min":1.4039999999999999},"min":{"1min":0.98899999999999999,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":1.9259999999999999,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.325}]},{"osd":6,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5049999999999999,"15min":1.4399999999999999},"min":{"1min":0.93600000000000005,"5min":0.79600000000000004,"15min":0.71499999999999997},"max":{"1min":1.9970000000000001,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3939999999999999,"15min":1.355},"min":{"1min":0.86099999999999999,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.909,"5min":1.909,"15min":2.1859999999999999},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.002,"5min":0.89300000000000002,"15min":0.55800000000000005},"max":{"1min":1.98,"5min":2.0339999999999998,"15min":2.1509999999999998},"last":1.542},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5509999999999999,"15min":1.47},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.70099999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.8900000000000001},"last":1.3500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.84199999999999997},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.27800000000000002},"max":{"1min":1.256,"5min":3.407,"15min":3.407},"last":1.256},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":0.95499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.581,"5min":1.764,"15min":1.9450000000000001},"last":1.208}]},{"osd":1,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.153,"15min":1.1100000000000001},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.544,"5min":3.476,"15min":3.476},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.26,"15min":1.206},"min":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6359999999999999,"5min":1.8580000000000001,"15min":1.927},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.5760000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.252,"15min":1.1879999999999999},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.7829999999999999,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.004}]},{"osd":4,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.423,"15min":1.355},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.52700000000000002},"max":{"1min":1.6870000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.542},{"interface":"front","average":{"1min":1.329,"5min":1.323,"15min":1.298},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65100000000000002},"max":{"1min":1.9279999999999999,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.6519999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4019999999999999,"15min":1.3560000000000001},"min":{"1min":0.83199999999999996,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.7090000000000001,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.482},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.72699999999999998},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.5960000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.385,"15min":1.3340000000000001},"min":{"1min":0.92100000000000004,"5min":0.80500000000000005,"15min":0.67700000000000005},"max":{"1min":1.831,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.304},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.528,"15min":1.452},"min":{"1min":0.97599999999999998,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.877,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.6930000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.506,"15min":1.4770000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4890000000000001,"15min":1.474},"min":{"1min":0.96699999999999997,"5min":0.84599999999999997,"15min":0.71499999999999997},"max":{"1min":1.964,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.3799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":1.3839999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.343},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.1799999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.151},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.288},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.597}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.6950000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.52},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.633}]}]},{"osd":0,"up_from":13,"seq":55834575022,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":1.244}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":1.5580000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":1.008},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":1.587}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.498}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.9179999999999999},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":1.173}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":1.379},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":2.0489999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":1.992},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.4510000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:53:13.084 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T05:53:13.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:53:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.314+0000 7ff4df2c7640 1 Processor -- start 2023-12-19T05:53:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.314+0000 7ff4df2c7640 1 -- start start 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.316+0000 7ff4df2c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4d8166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.316+0000 7ff4df2c7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d8165bc0 con 0x7ff4d8161660 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.316+0000 7ff4df2c7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d806e520 con 0x7ff4d8161a40 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.316+0000 7ff4df2c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80afef0 con 0x7ff4d80afa50 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.317+0000 7ff4dd063640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff4d8161660 0x7ff4d80b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50156/0 (socket says 172.21.15.49:50156) 2023-12-19T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.317+0000 7ff4dd063640 1 -- 172.21.15.49:0/2108112686 learned_addr learned my addr 172.21.15.49:0/2108112686 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.317+0000 7ff4dc862640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4d8166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.317+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220764900 0 0) 0x7ff4d8165bc0 con 0x7ff4d8161660 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.317+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c4003520 con 0x7ff4d8161660 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158644650 0 0) 0x7ff4c4003520 con 0x7ff4d8161660 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 msgr2=0x7ff4d8166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4d8166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 >> v1:172.21.15.115:6789/0 conn(0x7ff4d8161a40 legacy=0x7ff4d80ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8165570 con 0x7ff4d8161660 2023-12-19T05:53:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7ff4d4001670 con 0x7ff4d8161660 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 >> v1:172.21.15.49:6789/0 conn(0x7ff4d8161660 legacy=0x7ff4d80b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4c40047c0 0x7ff4c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4c40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80afef0 con 0x7ff4c4003a10 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c400bb40 con 0x7ff4c40047c0 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c400bd00 con 0x7ff4d80afa50 2023-12-19T05:53:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.318+0000 7ff4dd063640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd864640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4c40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dc862640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4c40047c0 0x7ff4c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd063640 1 -- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 msgr2=0x7ff4c40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd063640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d80afa50 0x7ff4c40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd063640 1 -- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4c40047c0 msgr2=0x7ff4c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd063640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4c40047c0 0x7ff4c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.319+0000 7ff4dd063640 1 -- 172.21.15.49:0/2108112686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4003520 con 0x7ff4c4003a10 2023-12-19T05:53:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.321+0000 7ff4dd063640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4c4003e30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400c0e0 tx=0x7ff4c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51236e8d95d1b73a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.321+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4005ad0 con 0x7ff4c4003a10 2023-12-19T05:53:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.321+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4005c30 con 0x7ff4c4003a10 2023-12-19T05:53:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.321+0000 7ff4cffff640 1 -- 172.21.15.49:0/2108112686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d402c810 con 0x7ff4c4003a10 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 -- 172.21.15.49:0/2108112686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 msgr2=0x7ff4c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/2108112686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4c4003e30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400c0e0 tx=0x7ff4c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4dd864640 1 -- 172.21.15.49:0/2108112686 reap_dead start 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 -- 172.21.15.49:0/2108112686 shutdown_connections 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 -- 172.21.15.49:0/2108112686 >> 172.21.15.49:0/2108112686 conn(0x7ff4d80cbb70 msgr2=0x7ff4d80cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 -- 172.21.15.49:0/2108112686 shutdown_connections 2023-12-19T05:53:13.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.322+0000 7ff4df2c7640 1 -- 172.21.15.49:0/2108112686 wait complete. 2023-12-19T05:53:13.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.324+0000 7ff4df2c7640 1 Processor -- start 2023-12-19T05:53:13.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.324+0000 7ff4df2c7640 1 -- start start 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d806bb90 0x7ff4d806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4d814b6c0 0x7ff4d814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d806c550 con 0x7ff4c4003a10 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d815a540 con 0x7ff4d814b6c0 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.325+0000 7ff4df2c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d815b2e0 con 0x7ff4d806bb90 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33600/0 (socket says 172.21.15.49:33600) 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 -- 172.21.15.49:0/1610596427 learned_addr learned my addr 172.21.15.49:0/1610596427 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dc862640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d806bb90 0x7ff4d806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 -- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d806bb90 msgr2=0x7ff4d806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d806bb90 0x7ff4d806c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 -- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4d814b6c0 msgr2=0x7ff4d814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4d814b6c0 0x7ff4d814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.326+0000 7ff4dd063640 1 -- 172.21.15.49:0/1610596427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d815a800 con 0x7ff4c4003a10 2023-12-19T05:53:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4dd063640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7ff4d402c3b0 tx=0x7ff4d4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d403c040 con 0x7ff4c4003a10 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d402cc20 con 0x7ff4c4003a10 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4007070 con 0x7ff4c4003a10 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d815aae0 con 0x7ff4c4003a10 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.327+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d814c080 con 0x7ff4c4003a10 2023-12-19T05:53:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.328+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8061910 con 0x7ff4c4003a10 2023-12-19T05:53:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.329+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4d4032070 con 0x7ff4c4003a10 2023-12-19T05:53:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.330+0000 7ff4cdffb640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 0x7ff4bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.330+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4d40a9840 con 0x7ff4c4003a10 2023-12-19T05:53:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.331+0000 7ff4dc862640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 0x7ff4bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.332+0000 7ff4dc862640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 0x7ff4bc06c920 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff4d814faa0 tx=0x7ff4c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.334+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4d4075090 con 0x7ff4c4003a10 2023-12-19T05:53:13.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.526+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4d8165850 con 0x7ff4bc06a460 2023-12-19T05:53:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.532+0000 7ff4cdffb640 1 -- 172.21.15.49:0/1610596427 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47691 (secure 0 0 0) 0x7ff4c8012950 con 0x7ff4bc06a460 2023-12-19T05:53:13.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:53:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 msgr2=0x7ff4bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 0x7ff4bc06c920 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff4d814faa0 tx=0x7ff4c8008040 comp rx=0 tx=0).stop 2023-12-19T05:53:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 msgr2=0x7ff4d81f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7ff4d402c3b0 tx=0x7ff4d4001930 comp rx=0 tx=0).stop 2023-12-19T05:53:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 shutdown_connections 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7ff4bc06a460 0x7ff4bc06c920 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4d806bb90 0x7ff4d806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4d814b6c0 0x7ff4d814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 --2- 172.21.15.49:0/1610596427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c4003a10 0x7ff4d81f6980 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 >> 172.21.15.49:0/1610596427 conn(0x7ff4d80cbb70 msgr2=0x7ff4d815cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.535+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 shutdown_connections 2023-12-19T05:53:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.536+0000 7ff4df2c7640 1 -- 172.21.15.49:0/1610596427 wait complete. 2023-12-19T05:53:13.557 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":624,"stamp":"2023-12-19T05:53:12.807913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10096,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552403,"statfs":{"total":1600000000,"available":1589661688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491623,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-4194304,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.683307"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":333,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-12-19T05:53:07.659837+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:53:07.659837+0000","last_peered":"2023-12-19T05:53:07.659837+0000","last_clean":"2023-12-19T05:53:07.659837+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:53:07.659837+0000","last_undegraded":"2023-12-19T05:53:07.659837+0000","last_fullsized":"2023-12-19T05:53:07.659837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:31:13.090119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.105,"15min":1.0920000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.56699999999999995},"max":{"1min":1.4830000000000001,"5min":1.635,"15min":6.4429999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.77400000000000002,"5min":0.77000000000000002,"15min":0.63300000000000001},"max":{"1min":1.444,"5min":1.768,"15min":3.976},"last":1.278}]},{"osd":1,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1799999999999999,"15min":1.157},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":6.399},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1699999999999999,"15min":1.1759999999999999},"min":{"1min":0.70199999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.577,"5min":1.74,"15min":4.25},"last":1.3759999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.222},"min":{"1min":0.96299999999999997,"5min":0.69799999999999995,"15min":0.63800000000000001},"max":{"1min":1.5580000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1519999999999999,"15min":1.1220000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.64500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":0.99299999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3080000000000001,"15min":1.272},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.622},"max":{"1min":1.595,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":1.359},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.3680000000000001},"min":{"1min":1.091,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.804,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":1.5369999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":1.756,"5min":1.756,"15min":2.9980000000000002},"last":1.113},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.2789999999999999,"15min":1.2969999999999999},"min":{"1min":0.96299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":6.4850000000000003},"last":1.145}]},{"osd":5,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.335,"15min":1.343},"min":{"1min":0.97499999999999998,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.774,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.331,"15min":1.3},"min":{"1min":0.94299999999999995,"5min":0.72599999999999998,"15min":0.55600000000000005},"max":{"1min":1.734,"5min":1.9970000000000001,"15min":3.1909999999999998},"last":1.23}]},{"osd":6,"last update":"Tue Dec 19 05:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.476,"15min":1.4359999999999999},"min":{"1min":1.2809999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.863,"5min":1.883,"15min":3.0920000000000001},"last":1.327},{"interface":"front","average":{"1min":1.516,"5min":1.4670000000000001,"15min":1.4770000000000001},"min":{"1min":1.0740000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":7.7519999999999998},"last":1.26}]}]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.173}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":1.052}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.0029999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.028}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.044},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.3500000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.83399999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.006}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":1.474},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.042}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.113},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.538}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.4219999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.314},"max":{"1min":1.23,"5min":1.8220000000000001,"15min":1.99},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.98799999999999999,"15min":0.91900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":1.5600000000000001,"5min":1.6060000000000001,"15min":1.72},"last":0.98299999999999998}]},{"osd":1,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.995,"15min":0.93300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.34599999999999997},"max":{"1min":1.4550000000000001,"5min":2.2519999999999998,"15min":2.702},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1399999999999999,"15min":1.0620000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.39100000000000001},"max":{"1min":1.665,"5min":2.004,"15min":2.3650000000000002},"last":1.25}]},{"osd":2,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.212,"15min":1.093},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.716,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.218},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45600000000000002},"max":{"1min":1.857,"5min":2.2469999999999999,"15min":2.931},"last":1.04}]},{"osd":4,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.27,"15min":1.202},"min":{"1min":0.81499999999999995,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.8939999999999999,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.387,"15min":1.321},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.59499999999999997},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.5859999999999999},"last":1.23}]},{"osd":5,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.476,"15min":1.3899999999999999},"min":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.67300000000000004},"max":{"1min":2.415,"5min":2.415,"15min":4.8440000000000003},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.46,"15min":1.4039999999999999},"min":{"1min":0.98899999999999999,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":1.9259999999999999,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.325}]},{"osd":6,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5049999999999999,"15min":1.4399999999999999},"min":{"1min":0.93600000000000005,"5min":0.79600000000000004,"15min":0.71499999999999997},"max":{"1min":1.9970000000000001,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3939999999999999,"15min":1.355},"min":{"1min":0.86099999999999999,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.909,"5min":1.909,"15min":2.1859999999999999},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.002,"5min":0.89300000000000002,"15min":0.55800000000000005},"max":{"1min":1.98,"5min":2.0339999999999998,"15min":2.1509999999999998},"last":1.542},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5509999999999999,"15min":1.47},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.70099999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.8900000000000001},"last":1.3500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.84199999999999997},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.27800000000000002},"max":{"1min":1.256,"5min":3.407,"15min":3.407},"last":1.256},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":0.95499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.581,"5min":1.764,"15min":1.9450000000000001},"last":1.208}]},{"osd":1,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.153,"15min":1.1100000000000001},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.544,"5min":3.476,"15min":3.476},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.26,"15min":1.206},"min":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6359999999999999,"5min":1.8580000000000001,"15min":1.927},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.5760000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.252,"15min":1.1879999999999999},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.7829999999999999,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.004}]},{"osd":4,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.423,"15min":1.355},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.52700000000000002},"max":{"1min":1.6870000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.542},{"interface":"front","average":{"1min":1.329,"5min":1.323,"15min":1.298},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65100000000000002},"max":{"1min":1.9279999999999999,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.6519999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4019999999999999,"15min":1.3560000000000001},"min":{"1min":0.83199999999999996,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.7090000000000001,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.482},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.72699999999999998},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.5960000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.385,"15min":1.3340000000000001},"min":{"1min":0.92100000000000004,"5min":0.80500000000000005,"15min":0.67700000000000005},"max":{"1min":1.831,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.304},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.528,"15min":1.452},"min":{"1min":0.97599999999999998,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.877,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.6930000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.506,"15min":1.4770000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4890000000000001,"15min":1.474},"min":{"1min":0.96699999999999997,"5min":0.84599999999999997,"15min":0.71499999999999997},"max":{"1min":1.964,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.3799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":1.3839999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.343},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.1799999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.151},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.288},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.597}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.6950000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.52},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.633}]}]},{"osd":0,"up_from":13,"seq":55834575022,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":1.244}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":1.5580000000000001}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":1.008},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":1.587}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.498}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.9179999999999999},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":1.173}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":1.379},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":2.0489999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":1.992},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.4510000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:53:13.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:53:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.790+0000 7f5318e7a640 1 Processor -- start 2023-12-19T05:53:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.790+0000 7f5318e7a640 1 -- start start 2023-12-19T05:53:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5314157bf0 0x7f531415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f53140ae110 0x7f53140b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53140b0640 0x7f531415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531406b8c0 con 0x7f53140b0640 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140b0a90 con 0x7f53140ae110 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5318e7a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531415b740 con 0x7f5314157bf0 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5312d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53140b0640 0x7f531415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5312d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53140b0640 0x7f531415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33606/0 (socket says 172.21.15.49:33606) 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.792+0000 7f5312d9d640 1 -- 172.21.15.49:0/510254760 learned_addr learned my addr 172.21.15.49:0/510254760 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f531259c640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5314157bf0 0x7f531415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5311d9b640 1 --2- 172.21.15.49:0/510254760 >> v2:172.21.15.115:3300/0 conn(0x7f53140ae110 0x7f53140b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5312d9d640 1 -- 172.21.15.49:0/510254760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5314157bf0 msgr2=0x7f531415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5312d9d640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5314157bf0 0x7f531415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5312d9d640 1 -- 172.21.15.49:0/510254760 >> v2:172.21.15.115:3300/0 conn(0x7f53140ae110 msgr2=0x7f53140b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5312d9d640 1 --2- 172.21.15.49:0/510254760 >> v2:172.21.15.115:3300/0 conn(0x7f53140ae110 0x7f53140b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.793+0000 7f5312d9d640 1 -- 172.21.15.49:0/510254760 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140ae640 con 0x7f53140b0640 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.794+0000 7f5312d9d640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140b0640 0x7f531415dd70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f53140cc8a0 tx=0x7f530c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d624fb26d3412f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.795+0000 7f531159a640 1 -- 172.21.15.49:0/510254760 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c02ca70 con 0x7f53140b0640 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.795+0000 7f531159a640 1 -- 172.21.15.49:0/510254760 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c02cbd0 con 0x7f53140b0640 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.795+0000 7f531159a640 1 -- 172.21.15.49:0/510254760 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0343f0 con 0x7f53140b0640 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.795+0000 7f5318e7a640 1 -- 172.21.15.49:0/510254760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140b0640 msgr2=0x7f531415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.795+0000 7f5318e7a640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140b0640 0x7f531415dd70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f53140cc8a0 tx=0x7f530c02bed0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 -- 172.21.15.49:0/510254760 shutdown_connections 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140b0640 0x7f531415dd70 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 --2- 172.21.15.49:0/510254760 >> v2:172.21.15.115:3300/0 conn(0x7f53140ae110 0x7f53140b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 --2- 172.21.15.49:0/510254760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5314157bf0 0x7f531415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 -- 172.21.15.49:0/510254760 >> 172.21.15.49:0/510254760 conn(0x7f53140cbb70 msgr2=0x7f53140cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 -- 172.21.15.49:0/510254760 shutdown_connections 2023-12-19T05:53:13.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.796+0000 7f5318e7a640 1 -- 172.21.15.49:0/510254760 wait complete. 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.798+0000 7f5318e7a640 1 Processor -- start 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.798+0000 7f5318e7a640 1 -- start start 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53140b0640 0x7f531414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5314157bf0 0x7f531414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314159b70 con 0x7f53140ae110 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314159260 con 0x7f5314157bf0 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f5318e7a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5314150ec0 con 0x7f53140b0640 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f531259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f531259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33610/0 (socket says 172.21.15.49:33610) 2023-12-19T05:53:13.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.799+0000 7f531259c640 1 -- 172.21.15.49:0/3012636321 learned_addr learned my addr 172.21.15.49:0/3012636321 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 -- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53140b0640 msgr2=0x7f531414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53140b0640 0x7f531414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 -- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5314157bf0 msgr2=0x7f531414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5312d9d640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5314157bf0 0x7f531414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5314157bf0 0x7f531414aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 -- 172.21.15.49:0/3012636321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c009b30 con 0x7f53140ae110 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f531259c640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f530400d800 tx=0x7f530400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400b6c0 con 0x7f53140ae110 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400b820 con 0x7f53140ae110 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400bbb0 con 0x7f53140ae110 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53141594b0 con 0x7f53140ae110 2023-12-19T05:53:13.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.800+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531414b860 con 0x7f53140ae110 2023-12-19T05:53:13.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.801+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314061910 con 0x7f53140ae110 2023-12-19T05:53:13.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.803+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f530400bd10 con 0x7f53140ae110 2023-12-19T05:53:13.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.803+0000 7f5302ffd640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 0x7f52f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:13.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.804+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5304088b90 con 0x7f53140ae110 2023-12-19T05:53:13.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.804+0000 7f5311d9b640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 0x7f52f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:13.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.805+0000 7f5311d9b640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 0x7f52f406c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5308006fd0 tx=0x7f5308008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:13.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:13.808+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f53040543e0 con 0x7f53140ae110 2023-12-19T05:53:14.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.003+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5314073220 con 0x7f53140ae110 2023-12-19T05:53:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.004+0000 7f5302ffd640 1 -- 172.21.15.49:0/3012636321 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+12531 (secure 0 0 0) 0x7f5304057a00 con 0x7f53140ae110 2023-12-19T05:53:14.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:14.006 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":202,"fsid":"e805799f-455a-49b9-9f36-8f2074fd7be4","created":"2023-12-19T05:38:45.391423+0000","modified":"2023-12-19T05:53:08.642896+0000","last_up_change":"2023-12-19T05:38:51.926430+0000","last_in_change":"2023-12-19T05:38:48.903493+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:52.584713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":84033},{"type":"v1","addr":"172.21.15.49:6801","nonce":84033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":84033},{"type":"v1","addr":"172.21.15.49:6803","nonce":84033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":84033},{"type":"v1","addr":"172.21.15.49:6807","nonce":84033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":84033},{"type":"v1","addr":"172.21.15.49:6805","nonce":84033}]},"public_addr":"172.21.15.49:6801/84033","cluster_addr":"172.21.15.49:6803/84033","heartbeat_back_addr":"172.21.15.49:6807/84033","heartbeat_front_addr":"172.21.15.49:6805/84033","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":84036},{"type":"v1","addr":"172.21.15.49:6824","nonce":84036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":84036},{"type":"v1","addr":"172.21.15.49:6827","nonce":84036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":84036},{"type":"v1","addr":"172.21.15.49:6831","nonce":84036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":84036},{"type":"v1","addr":"172.21.15.49:6829","nonce":84036}]},"public_addr":"172.21.15.49:6824/84036","cluster_addr":"172.21.15.49:6827/84036","heartbeat_back_addr":"172.21.15.49:6831/84036","heartbeat_front_addr":"172.21.15.49:6829/84036","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":84037},{"type":"v1","addr":"172.21.15.49:6811","nonce":84037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":84037},{"type":"v1","addr":"172.21.15.49:6816","nonce":84037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6823","nonce":84037},{"type":"v1","addr":"172.21.15.49:6825","nonce":84037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":84037},{"type":"v1","addr":"172.21.15.49:6820","nonce":84037}]},"public_addr":"172.21.15.49:6811/84037","cluster_addr":"172.21.15.49:6816/84037","heartbeat_back_addr":"172.21.15.49:6825/84037","heartbeat_front_addr":"172.21.15.49:6820/84037","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":84034},{"type":"v1","addr":"172.21.15.49:6810","nonce":84034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":84034},{"type":"v1","addr":"172.21.15.49:6814","nonce":84034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6819","nonce":84034},{"type":"v1","addr":"172.21.15.49:6821","nonce":84034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6815","nonce":84034},{"type":"v1","addr":"172.21.15.49:6817","nonce":84034}]},"public_addr":"172.21.15.49:6810/84034","cluster_addr":"172.21.15.49:6814/84034","heartbeat_back_addr":"172.21.15.49:6821/84034","heartbeat_front_addr":"172.21.15.49:6817/84034","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":84440},{"type":"v1","addr":"172.21.15.115:6801","nonce":84440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":84440},{"type":"v1","addr":"172.21.15.115:6803","nonce":84440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":84440},{"type":"v1","addr":"172.21.15.115:6810","nonce":84440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":84440},{"type":"v1","addr":"172.21.15.115:6806","nonce":84440}]},"public_addr":"172.21.15.115:6801/84440","cluster_addr":"172.21.15.115:6803/84440","heartbeat_back_addr":"172.21.15.115:6810/84440","heartbeat_front_addr":"172.21.15.115:6806/84440","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":84439},{"type":"v1","addr":"172.21.15.115:6807","nonce":84439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":84439},{"type":"v1","addr":"172.21.15.115:6811","nonce":84439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":84439},{"type":"v1","addr":"172.21.15.115:6819","nonce":84439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":84439},{"type":"v1","addr":"172.21.15.115:6813","nonce":84439}]},"public_addr":"172.21.15.115:6807/84439","cluster_addr":"172.21.15.115:6811/84439","heartbeat_back_addr":"172.21.15.115:6819/84439","heartbeat_front_addr":"172.21.15.115:6813/84439","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":84441},{"type":"v1","addr":"172.21.15.115:6815","nonce":84441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":84441},{"type":"v1","addr":"172.21.15.115:6818","nonce":84441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":84441},{"type":"v1","addr":"172.21.15.115:6823","nonce":84441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":84441},{"type":"v1","addr":"172.21.15.115:6821","nonce":84441}]},"public_addr":"172.21.15.115:6815/84441","cluster_addr":"172.21.15.115:6818/84441","heartbeat_back_addr":"172.21.15.115:6823/84441","heartbeat_front_addr":"172.21.15.115:6821/84441","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":84475},{"type":"v1","addr":"172.21.15.115:6825","nonce":84475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":84475},{"type":"v1","addr":"172.21.15.115:6827","nonce":84475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":84475},{"type":"v1","addr":"172.21.15.115:6831","nonce":84475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":84475},{"type":"v1","addr":"172.21.15.115:6829","nonce":84475}]},"public_addr":"172.21.15.115:6825/84475","cluster_addr":"172.21.15.115:6827/84475","heartbeat_back_addr":"172.21.15.115:6831/84475","heartbeat_front_addr":"172.21.15.115:6829/84475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.212130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.235118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.213636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.183769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.139288+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.122243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:50.272209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6837/1808935012":"2023-12-20T05:53:05.118395+0000","172.21.15.115:6835/1808935012":"2023-12-20T05:53:05.118395+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 msgr2=0x7f52f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 0x7f52f406c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5308006fd0 tx=0x7f5308008040 comp rx=0 tx=0).stop 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 msgr2=0x7f5314152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f530400d800 tx=0x7f530400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 shutdown_connections 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f52f406a430 0x7f52f406c8f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53140b0640 0x7f531414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5314157bf0 0x7f531414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:14.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 --2- 172.21.15.49:0/3012636321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53140ae110 0x7f5314152530 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:14.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 >> 172.21.15.49:0/3012636321 conn(0x7f53140cbb70 msgr2=0x7f531415dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:14.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 shutdown_connections 2023-12-19T05:53:14.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:14.007+0000 7f5318e7a640 1 -- 172.21.15.49:0/3012636321 wait complete. 2023-12-19T05:53:15.029 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T05:53:15.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.278+0000 7fc88e462640 1 Processor -- start 2023-12-19T05:53:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.279+0000 7fc88e462640 1 -- start start 2023-12-19T05:53:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.280+0000 7fc88e462640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc88815afd0 0x7fc8880ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.280+0000 7fc88e462640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88815f920 con 0x7fc8880b04c0 2023-12-19T05:53:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.280+0000 7fc88e462640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88815ed10 con 0x7fc88806d070 2023-12-19T05:53:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88e462640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880adc40 con 0x7fc88815afd0 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88d460640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc88815afd0 0x7fc8880ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88d460640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc88815afd0 0x7fc8880ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35732/0 (socket says 172.21.15.49:35732) 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88d460640 1 -- 172.21.15.49:0/3859500007 learned_addr learned my addr 172.21.15.49:0/3859500007 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88dc61640 1 --1- 172.21.15.49:0/3859500007 >> v1:172.21.15.49:6789/0 conn(0x7fc8880b04c0 0x7fc88806b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52518/0 (socket says 172.21.15.49:52518) 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88d460640 1 -- 172.21.15.49:0/3859500007 >> v1:172.21.15.115:6789/0 conn(0x7fc88806d070 legacy=0x7fc8880afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.281+0000 7fc88d460640 1 -- 172.21.15.49:0/3859500007 >> v1:172.21.15.49:6789/0 conn(0x7fc8880b04c0 legacy=0x7fc88806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.282+0000 7fc88d460640 1 -- 172.21.15.49:0/3859500007 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88815eff0 con 0x7fc88815afd0 2023-12-19T05:53:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.282+0000 7fc87ffff640 1 -- 172.21.15.49:0/3859500007 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213110881 0 0) 0x7fc88815f920 con 0x7fc8880b04c0 2023-12-19T05:53:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.283+0000 7fc88d460640 1 --2- 172.21.15.49:0/3859500007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc8880ad700 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fc884009870 tx=0x7fc88402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0904ad160397ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.283+0000 7fc87ffff640 1 -- 172.21.15.49:0/3859500007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884030860 con 0x7fc88815afd0 2023-12-19T05:53:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.283+0000 7fc87ffff640 1 -- 172.21.15.49:0/3859500007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840309c0 con 0x7fc88815afd0 2023-12-19T05:53:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.283+0000 7fc87ffff640 1 -- 172.21.15.49:0/3859500007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884030d50 con 0x7fc88815afd0 2023-12-19T05:53:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 -- 172.21.15.49:0/3859500007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 msgr2=0x7fc8880ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 --2- 172.21.15.49:0/3859500007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc8880ad700 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fc884009870 tx=0x7fc88402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 -- 172.21.15.49:0/3859500007 shutdown_connections 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 --2- 172.21.15.49:0/3859500007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc8880ad700 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 -- 172.21.15.49:0/3859500007 >> 172.21.15.49:0/3859500007 conn(0x7fc8880b4750 msgr2=0x7fc8880659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 -- 172.21.15.49:0/3859500007 shutdown_connections 2023-12-19T05:53:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.284+0000 7fc88e462640 1 -- 172.21.15.49:0/3859500007 wait complete. 2023-12-19T05:53:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.286+0000 7fc88e462640 1 Processor -- start 2023-12-19T05:53:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.286+0000 7fc88e462640 1 -- start start 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc88806d070 0x7fc88814d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8880b04c0 0x7fc88814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc888158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814e9e0 con 0x7fc88815afd0 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814ddd0 con 0x7fc88806d070 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88e462640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814e0b0 con 0x7fc8880b04c0 2023-12-19T05:53:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88dc61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc888158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88dc61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc888158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35740/0 (socket says 172.21.15.49:35740) 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.287+0000 7fc88dc61640 1 -- 172.21.15.49:0/2423286949 learned_addr learned my addr 172.21.15.49:0/2423286949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88d460640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc88806d070 0x7fc88814d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 -- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8880b04c0 msgr2=0x7fc88814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8880b04c0 0x7fc88814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 -- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc88806d070 msgr2=0x7fc88814d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc88806d070 0x7fc88814d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8840094d0 con 0x7fc88815afd0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88d460640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc88806d070 0x7fc88814d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88dc61640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc888158880 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fc880001560 tx=0x7fc88000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000ce30 con 0x7fc88815afd0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000a610 con 0x7fc88815afd0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000a9a0 con 0x7fc88815afd0 2023-12-19T05:53:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.288+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88814e390 con 0x7fc88815afd0 2023-12-19T05:53:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.289+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88814bdd0 con 0x7fc88815afd0 2023-12-19T05:53:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.289+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc88815f5b0 con 0x7fc88815afd0 2023-12-19T05:53:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.290+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc88000ab00 con 0x7fc88815afd0 2023-12-19T05:53:15.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.291+0000 7fc87dffb640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc86c06a460 0x7fc86c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8800879d0 con 0x7fc88815afd0 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc87dffb640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7fc86c0702c0 0x7fc86c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc86c072d90 con 0x7fc86c0702c0 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc88008c2a0 con 0x7fc88815afd0 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc88cc5f640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7fc86c0702c0 0x7fc86c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.292+0000 7fc88d460640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc86c06a460 0x7fc86c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.293+0000 7fc88cc5f640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7fc86c0702c0 0x7fc86c0726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.293+0000 7fc88d460640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc86c06a460 0x7fc86c06c920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc884036000 tx=0x7fc88403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.293+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== osd.0 v2:172.21.15.49:6800/84033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc86c072d90 con 0x7fc86c0702c0 2023-12-19T05:53:15.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.306+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 --> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc88804e0d0 con 0x7fc86c0702c0 2023-12-19T05:53:15.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc87dffb640 1 -- 172.21.15.49:0/2423286949 <== osd.0 v2:172.21.15.49:6800/84033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fc88804e0d0 con 0x7fc86c0702c0 2023-12-19T05:53:15.309 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:15.309 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:15.309 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:15.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7fc86c0702c0 msgr2=0x7fc86c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:6800/84033,v1:172.21.15.49:6801/84033] conn(0x7fc86c0702c0 0x7fc86c0726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc86c06a460 msgr2=0x7fc86c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc86c06a460 0x7fc86c06c920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc884036000 tx=0x7fc88403b040 comp rx=0 tx=0).stop 2023-12-19T05:53:15.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 msgr2=0x7fc888158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88e462640 1 --2- 172.21.15.49:0/2423286949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc88815afd0 0x7fc888158880 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fc880001560 tx=0x7fc88000cbe0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.307+0000 7fc88dc61640 1 -- 172.21.15.49:0/2423286949 reap_dead start 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.308+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 shutdown_connections 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.308+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 >> 172.21.15.49:0/2423286949 conn(0x7fc8880b4750 msgr2=0x7fc8880b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.308+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 shutdown_connections 2023-12-19T05:53:15.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.308+0000 7fc88e462640 1 -- 172.21.15.49:0/2423286949 wait complete. 2023-12-19T05:53:15.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T05:53:15.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.555+0000 7f3b1b17e640 1 Processor -- start 2023-12-19T05:53:15.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.555+0000 7f3b1b17e640 1 -- start start 2023-12-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.556+0000 7f3b1b17e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 0x7f3b140b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.556+0000 7f3b1b17e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140b8300 con 0x7f3b140d0c60 2023-12-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.556+0000 7f3b1b17e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140d12d0 con 0x7f3b140b7ea0 2023-12-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.556+0000 7f3b1b17e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14147210 con 0x7f3b14146e30 2023-12-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.557+0000 7f3b1a97d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b140d0c60 0x7f3b1415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52532/0 (socket says 172.21.15.49:52532) 2023-12-19T05:53:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.557+0000 7f3b1a97d640 1 -- 172.21.15.49:0/2133088070 learned_addr learned my addr 172.21.15.49:0/2133088070 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.557+0000 7f3b1a17c640 1 --2- 172.21.15.49:0/2133088070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 0x7f3b140b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.557+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924969635 0 0) 0x7f3b140b8300 con 0x7f3b140d0c60 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.557+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003520 con 0x7f3b140d0c60 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638994065 0 0) 0x7f3b140d12d0 con 0x7f3b140b7ea0 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b140b8300 con 0x7f3b140b7ea0 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1a17c640 1 -- 172.21.15.49:0/2133088070 >> v1:172.21.15.115:6789/0 conn(0x7f3b140b7ea0 legacy=0x7f3b140d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153482542 0 0) 0x7f3b00003520 con 0x7f3b140d0c60 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1a17c640 1 -- 172.21.15.49:0/2133088070 >> v1:172.21.15.49:6789/0 conn(0x7f3b140d0c60 legacy=0x7f3b1415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.558+0000 7f3b1a17c640 1 -- 172.21.15.49:0/2133088070 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140d15b0 con 0x7f3b14146e30 2023-12-19T05:53:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.559+0000 7f3b1a17c640 1 --2- 172.21.15.49:0/2133088070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 0x7f3b140b7960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097d0 tx=0x7f3b1002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a99522e455ffa4a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0019f0 con 0x7f3b14146e30 2023-12-19T05:53:15.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1002e050 con 0x7f3b14146e30 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1917a640 1 -- 172.21.15.49:0/2133088070 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10030730 con 0x7f3b14146e30 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2133088070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 msgr2=0x7f3b140b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2133088070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 0x7f3b140b7960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097d0 tx=0x7f3b1002b770 comp rx=0 tx=0).stop 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2133088070 shutdown_connections 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2133088070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b14146e30 0x7f3b140b7960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2133088070 >> 172.21.15.49:0/2133088070 conn(0x7f3b140b2990 msgr2=0x7f3b140b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.560+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2133088070 shutdown_connections 2023-12-19T05:53:15.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.561+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2133088070 wait complete. 2023-12-19T05:53:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.562+0000 7f3b1b17e640 1 Processor -- start 2023-12-19T05:53:15.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.562+0000 7f3b1b17e640 1 -- start start 2023-12-19T05:53:15.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b140b7ea0 0x7f3b1413db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b140d0c60 0x7f3b141deef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1413f910 con 0x7f3b14146e30 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14144c80 con 0x7f3b140b7ea0 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.563+0000 7f3b1b17e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14144f60 con 0x7f3b140d0c60 2023-12-19T05:53:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35748/0 (socket says 172.21.15.49:35748) 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 -- 172.21.15.49:0/2739194007 learned_addr learned my addr 172.21.15.49:0/2739194007 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 -- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b140d0c60 msgr2=0x7f3b141deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b140d0c60 0x7f3b141deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a17c640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b140b7ea0 0x7f3b1413db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 -- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b140b7ea0 msgr2=0x7f3b1413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b140b7ea0 0x7f3b1413db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 -- 172.21.15.49:0/2739194007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009400 con 0x7f3b14146e30 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.564+0000 7f3b1a97d640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c001f60 tx=0x7f3b0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.565+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c012400 con 0x7f3b14146e30 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.565+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c012560 con 0x7f3b14146e30 2023-12-19T05:53:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.565+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14145240 con 0x7f3b14146e30 2023-12-19T05:53:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.565+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c012930 con 0x7f3b14146e30 2023-12-19T05:53:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.565+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1413e070 con 0x7f3b14146e30 2023-12-19T05:53:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.566+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14061910 con 0x7f3b14146e30 2023-12-19T05:53:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.567+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b0c012a90 con 0x7f3b14146e30 2023-12-19T05:53:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.568+0000 7f3b0affd640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.569+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b0c088e40 con 0x7f3b14146e30 2023-12-19T05:53:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.569+0000 7f3b1a17c640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:15.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.570+0000 7f3b1a17c640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 0x7f3af806c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3b10034000 tx=0x7f3b10008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.573+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3b0c054730 con 0x7f3b14146e30 2023-12-19T05:53:15.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.771+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b140d1890 con 0x7f3af806a430 2023-12-19T05:53:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.772+0000 7f3b0affd640 1 -- 172.21.15.49:0/2739194007 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b10043090 con 0x7f3af806a430 2023-12-19T05:53:15.774 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T05:53:15.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.774+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 msgr2=0x7f3af806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.774+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 0x7f3af806c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3b10034000 tx=0x7f3b10008030 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.774+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 msgr2=0x7f3b141df430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.774+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c001f60 tx=0x7f3b0c00a430 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 shutdown_connections 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b140d0c60 0x7f3b141deef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b14146e30 0x7f3b141df430 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 --2- 172.21.15.49:0/2739194007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b140b7ea0 0x7f3b1413db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 >> 172.21.15.49:0/2739194007 conn(0x7f3b140b2990 msgr2=0x7f3b141e1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 shutdown_connections 2023-12-19T05:53:15.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:15.775+0000 7f3b1b17e640 1 -- 172.21.15.49:0/2739194007 wait complete. 2023-12-19T05:53:15.796 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T05:53:15.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.031+0000 7fc531f55640 1 Processor -- start 2023-12-19T05:53:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.031+0000 7fc531f55640 1 -- start start 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc52c13e200 0x7fc52c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc52c141660 0x7fc52c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c140f70 0x7fc52c15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c1413c0 con 0x7fc52c13e200 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0b1880 con 0x7fc52c141660 2023-12-19T05:53:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.033+0000 7fc531f55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0b26e0 con 0x7fc52c140f70 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc52c13e200 0x7fc52c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc52c13e200 0x7fc52c0ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35760/0 (socket says 172.21.15.49:35760) 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 -- 172.21.15.49:0/3615269421 learned_addr learned my addr 172.21.15.49:0/3615269421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc523fff640 1 --2- 172.21.15.49:0/3615269421 >> v2:172.21.15.115:3300/0 conn(0x7fc52c141660 0x7fc52c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52bfff640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c140f70 0x7fc52c15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 -- 172.21.15.49:0/3615269421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c140f70 msgr2=0x7fc52c15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c140f70 0x7fc52c15ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 -- 172.21.15.49:0/3615269421 >> v2:172.21.15.115:3300/0 conn(0x7fc52c141660 msgr2=0x7fc52c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3615269421 >> v2:172.21.15.115:3300/0 conn(0x7fc52c141660 0x7fc52c140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.034+0000 7fc52b7fe640 1 -- 172.21.15.49:0/3615269421 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0cf020 con 0x7fc52c13e200 2023-12-19T05:53:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.036+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c13e200 0x7fc52c0ceae0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06dc10 tx=0x7fc51c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c14c6e9e006246 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.036+0000 7fc52affd640 1 -- 172.21.15.49:0/3615269421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c031870 con 0x7fc52c13e200 2023-12-19T05:53:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.036+0000 7fc52affd640 1 -- 172.21.15.49:0/3615269421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c0319d0 con 0x7fc52c13e200 2023-12-19T05:53:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.036+0000 7fc52affd640 1 -- 172.21.15.49:0/3615269421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c031d60 con 0x7fc52c13e200 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 -- 172.21.15.49:0/3615269421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c13e200 msgr2=0x7fc52c0ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c13e200 0x7fc52c0ceae0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06dc10 tx=0x7fc51c02b910 comp rx=0 tx=0).stop 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 -- 172.21.15.49:0/3615269421 shutdown_connections 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c140f70 0x7fc52c15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 --2- 172.21.15.49:0/3615269421 >> v2:172.21.15.115:3300/0 conn(0x7fc52c141660 0x7fc52c140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 --2- 172.21.15.49:0/3615269421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c13e200 0x7fc52c0ceae0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 -- 172.21.15.49:0/3615269421 >> 172.21.15.49:0/3615269421 conn(0x7fc52c0cf230 msgr2=0x7fc52c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 -- 172.21.15.49:0/3615269421 shutdown_connections 2023-12-19T05:53:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.037+0000 7fc531f55640 1 -- 172.21.15.49:0/3615269421 wait complete. 2023-12-19T05:53:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.040+0000 7fc531f55640 1 Processor -- start 2023-12-19T05:53:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.040+0000 7fc531f55640 1 -- start start 2023-12-19T05:53:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.041+0000 7fc531f55640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c13e200 0x7fc52c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.041+0000 7fc531f55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 0x7fc52c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.041+0000 7fc531f55640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc52c141660 0x7fc52c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.041+0000 7fc531f55640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1407b0 con 0x7fc52c140f70 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc531f55640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0aec80 con 0x7fc52c141660 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc531f55640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0afac0 con 0x7fc52c13e200 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 0x7fc52c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 0x7fc52c15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35770/0 (socket says 172.21.15.49:35770) 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 -- 172.21.15.49:0/3552227736 learned_addr learned my addr 172.21.15.49:0/3552227736 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc52bfff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc52c141660 0x7fc52c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c13e200 0x7fc52c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 -- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c13e200 msgr2=0x7fc52c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc52c13e200 0x7fc52c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 -- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc52c141660 msgr2=0x7fc52c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc52c141660 0x7fc52c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.042+0000 7fc523fff640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0094d0 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc523fff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 0x7fc52c15c0d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc51400e9b0 tx=0x7fc51400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514009670 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400c9a0 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400cd30 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c0aeeb0 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.043+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c0af470 con 0x7fc52c140f70 2023-12-19T05:53:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.044+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc52c0b1db0 con 0x7fc52c140f70 2023-12-19T05:53:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.045+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc514013470 con 0x7fc52c140f70 2023-12-19T05:53:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.046+0000 7fc528ff9640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc50c06a430 0x7fc50c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5140887f0 con 0x7fc52c140f70 2023-12-19T05:53:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc528ff9640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fc50c070290 0x7fc50c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc50c072d60 con 0x7fc50c070290 2023-12-19T05:53:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc51408ad70 con 0x7fc52c140f70 2023-12-19T05:53:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc52bfff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fc50c070290 0x7fc50c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.047+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc50c06a430 0x7fc50c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.048+0000 7fc52bfff640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fc50c070290 0x7fc50c0726b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.048+0000 7fc52b7fe640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc50c06a430 0x7fc50c06c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc51c036000 tx=0x7fc51c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.049+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== osd.1 v2:172.21.15.49:6822/84036 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc50c072d60 con 0x7fc50c070290 2023-12-19T05:53:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.062+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 --> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc52c0b1ad0 con 0x7fc50c070290 2023-12-19T05:53:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.062+0000 7fc528ff9640 1 -- 172.21.15.49:0/3552227736 <== osd.1 v2:172.21.15.49:6822/84036 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fc524009a50 con 0x7fc50c070290 2023-12-19T05:53:16.065 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:16.065 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.062+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fc50c070290 msgr2=0x7fc50c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.062+0000 7fc531f55640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:6822/84036,v1:172.21.15.49:6824/84036] conn(0x7fc50c070290 0x7fc50c0726b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc50c06a430 msgr2=0x7fc50c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fc50c06a430 0x7fc50c06c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc51c036000 tx=0x7fc51c03c040 comp rx=0 tx=0).stop 2023-12-19T05:53:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 msgr2=0x7fc52c15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 --2- 172.21.15.49:0/3552227736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc52c140f70 0x7fc52c15c0d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc51400e9b0 tx=0x7fc51400ee70 comp rx=0 tx=0).stop 2023-12-19T05:53:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc52bfff640 1 -- 172.21.15.49:0/3552227736 reap_dead start 2023-12-19T05:53:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 shutdown_connections 2023-12-19T05:53:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 >> 172.21.15.49:0/3552227736 conn(0x7fc52c0cf230 msgr2=0x7fc52c13bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 shutdown_connections 2023-12-19T05:53:16.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.063+0000 7fc531f55640 1 -- 172.21.15.49:0/3552227736 wait complete. 2023-12-19T05:53:16.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T05:53:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.314+0000 7f1ec7468640 1 Processor -- start 2023-12-19T05:53:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.314+0000 7f1ec7468640 1 -- start start 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec7468640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1ec0159f80 0x7f1ec006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec7468640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1ec015b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec7468640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec006b520 con 0x7f1ec015b1e0 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec7468640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00b2b20 con 0x7f1ec0159f80 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec7468640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b2fb0 con 0x7f1ec015aa70 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec5c65640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1ec015b1e0 0x7f1ec015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52546/0 (socket says 172.21.15.49:52546) 2023-12-19T05:53:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.316+0000 7f1ec5c65640 1 -- 172.21.15.49:0/790455934 learned_addr learned my addr 172.21.15.49:0/790455934 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec6466640 1 --2- 172.21.15.49:0/790455934 >> v2:172.21.15.115:3300/0 conn(0x7f1ec0159f80 0x7f1ec006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec6c67640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1ec015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466041778 0 0) 0x7f1ec006b520 con 0x7f1ec015b1e0 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eac003520 con 0x7f1ec015b1e0 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449251991 0 0) 0x7f1eac003520 con 0x7f1ec015b1e0 2023-12-19T05:53:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 msgr2=0x7f1ec015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1ec015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 >> v2:172.21.15.115:3300/0 conn(0x7f1ec0159f80 msgr2=0x7f1ec006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 --2- 172.21.15.49:0/790455934 >> v2:172.21.15.115:3300/0 conn(0x7f1ec0159f80 0x7f1ec006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00b1f10 con 0x7f1ec015b1e0 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f1eb0001670 con 0x7f1ec015b1e0 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.317+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 >> v1:172.21.15.49:6789/0 conn(0x7f1ec015b1e0 legacy=0x7f1ec015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1eac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1eac003f40 0x7f1eac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1eac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b2b20 con 0x7f1eac004d00 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b2fb0 con 0x7f1eac003f40 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac00dc10 con 0x7f1ec015aa70 2023-12-19T05:53:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1eac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6466640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1eac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5c65640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1eac003f40 0x7f1eac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 -- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 msgr2=0x7f1eac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec015aa70 0x7f1eac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 -- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1eac003f40 msgr2=0x7f1eac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1eac003f40 0x7f1eac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec6c67640 1 -- 172.21.15.49:0/790455934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac003520 con 0x7f1eac004d00 2023-12-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.318+0000 7f1ec5c65640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1eac003f40 0x7f1eac0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec6c67640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1eac005180 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009ac0 tx=0x7f1eac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d632f6ceff0ab10a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb802c6b0 con 0x7f1eac004d00 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb802c810 con 0x7f1eac004d00 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec5464640 1 -- 172.21.15.49:0/790455934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb802cba0 con 0x7f1eac004d00 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec7468640 1 -- 172.21.15.49:0/790455934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 msgr2=0x7f1eac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec7468640 1 --2- 172.21.15.49:0/790455934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1eac005180 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009ac0 tx=0x7f1eac0057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.320+0000 7f1ec6c67640 1 -- 172.21.15.49:0/790455934 reap_dead start 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.321+0000 7f1ec7468640 1 -- 172.21.15.49:0/790455934 shutdown_connections 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.321+0000 7f1ec7468640 1 -- 172.21.15.49:0/790455934 >> 172.21.15.49:0/790455934 conn(0x7f1ec00b0100 msgr2=0x7f1ec00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.321+0000 7f1ec7468640 1 -- 172.21.15.49:0/790455934 shutdown_connections 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.321+0000 7f1ec7468640 1 -- 172.21.15.49:0/790455934 wait complete. 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.323+0000 7f1ec7468640 1 Processor -- start 2023-12-19T05:53:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.323+0000 7f1ec7468640 1 -- start start 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec01539b0 0x7f1ec01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec00a9c40 0x7f1ec015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0159820 con 0x7f1eac004d00 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00a97b0 con 0x7f1ec01539b0 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec7468640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0153e10 con 0x7f1ec00a9c40 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35786/0 (socket says 172.21.15.49:35786) 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 -- 172.21.15.49:0/4156327041 learned_addr learned my addr 172.21.15.49:0/4156327041 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:16.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec5c65640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec01539b0 0x7f1ec01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 -- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec00a9c40 msgr2=0x7f1ec015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec00a9c40 0x7f1ec015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 -- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec01539b0 msgr2=0x7f1ec01592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec01539b0 0x7f1ec01592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.324+0000 7f1ec6466640 1 -- 172.21.15.49:0/4156327041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00a8ba0 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1ec6466640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc007f30 tx=0x7f1ebc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00e030 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc016470 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00a8e80 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc016820 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.325+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00a9440 con 0x7f1eac004d00 2023-12-19T05:53:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.327+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0061910 con 0x7f1eac004d00 2023-12-19T05:53:16.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.328+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1ebc016980 con 0x7f1eac004d00 2023-12-19T05:53:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.328+0000 7f1eb6ffd640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 0x7f1ea406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.329+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1ebc00f070 con 0x7f1eac004d00 2023-12-19T05:53:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.329+0000 7f1ec5c65640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 0x7f1ea406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.330+0000 7f1ec5c65640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 0x7f1ea406c920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ec006de80 tx=0x7f1eb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.333+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1ebc054ed0 con 0x7f1eac004d00 2023-12-19T05:53:16.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.525+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec00b24d0 con 0x7f1ea406a460 2023-12-19T05:53:16.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.526+0000 7f1eb6ffd640 1 -- 172.21.15.49:0/4156327041 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1eb000d050 con 0x7f1ea406a460 2023-12-19T05:53:16.528 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T05:53:16.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 msgr2=0x7f1ea406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 0x7f1ea406c920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ec006de80 tx=0x7f1eb0009040 comp rx=0 tx=0).stop 2023-12-19T05:53:16.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 msgr2=0x7f1ec00a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc007f30 tx=0x7f1ebc011660 comp rx=0 tx=0).stop 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 shutdown_connections 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1ea406a460 0x7f1ea406c920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ec00a9c40 0x7f1ec015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec01539b0 0x7f1ec01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 --2- 172.21.15.49:0/4156327041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac004d00 0x7f1ec00a84a0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.529+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 >> 172.21.15.49:0/4156327041 conn(0x7f1ec00b0100 msgr2=0x7f1ec0154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.530+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 shutdown_connections 2023-12-19T05:53:16.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.530+0000 7f1ec7468640 1 -- 172.21.15.49:0/4156327041 wait complete. 2023-12-19T05:53:16.549 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T05:53:16.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:16.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.782+0000 7f055759e640 1 Processor -- start 2023-12-19T05:53:16.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.782+0000 7f055759e640 1 -- start start 2023-12-19T05:53:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055759e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f055815afd0 0x7f05580ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f055806d070 0x7f05580afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055759e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055815f920 con 0x7f05580b02f0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055759e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05580adc40 con 0x7f055815afd0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05580b0780 con 0x7f055806d070 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f055659c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f055815afd0 0x7f05580ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f0556d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05580b02f0 0x7f05580ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52550/0 (socket says 172.21.15.49:52550) 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.784+0000 7f0556d9d640 1 -- 172.21.15.49:0/2724198557 learned_addr learned my addr 172.21.15.49:0/2724198557 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f054ffff640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f055806d070 0x7f05580afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f055659c640 1 -- 172.21.15.49:0/2724198557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f055806d070 msgr2=0x7f05580afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f055659c640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f055806d070 0x7f05580afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f055659c640 1 -- 172.21.15.49:0/2724198557 >> v1:172.21.15.49:6789/0 conn(0x7f05580b02f0 legacy=0x7f05580ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f0555d9b640 1 -- 172.21.15.49:0/2724198557 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721309409 0 0) 0x7f055815f920 con 0x7f05580b02f0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.785+0000 7f055659c640 1 -- 172.21.15.49:0/2724198557 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055815ed10 con 0x7f055815afd0 2023-12-19T05:53:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.786+0000 7f055659c640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f05580ad700 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f05480097a0 tx=0x7f054802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b883fc7ae10a95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.786+0000 7f0555d9b640 1 -- 172.21.15.49:0/2724198557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054802d040 con 0x7f055815afd0 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.786+0000 7f0555d9b640 1 -- 172.21.15.49:0/2724198557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548031810 con 0x7f055815afd0 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.786+0000 7f0555d9b640 1 -- 172.21.15.49:0/2724198557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548031ba0 con 0x7f055815afd0 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 -- 172.21.15.49:0/2724198557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 msgr2=0x7f05580ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f05580ad700 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f05480097a0 tx=0x7f054802b8b0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 -- 172.21.15.49:0/2724198557 shutdown_connections 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f055806d070 0x7f05580afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 --2- 172.21.15.49:0/2724198557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f05580ad700 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 -- 172.21.15.49:0/2724198557 >> 172.21.15.49:0/2724198557 conn(0x7f05580b4750 msgr2=0x7f05580659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 -- 172.21.15.49:0/2724198557 shutdown_connections 2023-12-19T05:53:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.787+0000 7f055759e640 1 -- 172.21.15.49:0/2724198557 wait complete. 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.789+0000 7f055759e640 1 Processor -- start 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.789+0000 7f055759e640 1 -- start start 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055806d070 0x7f05580b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05580b02f0 0x7f0558142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f055814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055815b550 con 0x7f055815afd0 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580b2a30 con 0x7f055806d070 2023-12-19T05:53:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f055759e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05580b1980 con 0x7f05580b02f0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.790+0000 7f0556d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f055814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f055814ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35806/0 (socket says 172.21.15.49:35806) 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 -- 172.21.15.49:0/823773118 learned_addr learned my addr 172.21.15.49:0/823773118 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f054ffff640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05580b02f0 0x7f0558142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f055659c640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055806d070 0x7f05580b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 -- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05580b02f0 msgr2=0x7f0558142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05580b02f0 0x7f0558142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 -- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055806d070 msgr2=0x7f05580b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055806d070 0x7f05580b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009400 con 0x7f055815afd0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.791+0000 7f0556d9d640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f055814ce00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f0550002230 tx=0x7f055000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.792+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000ce30 con 0x7f055815afd0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.792+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000a640 con 0x7f055815afd0 2023-12-19T05:53:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.792+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000a9f0 con 0x7f055815afd0 2023-12-19T05:53:16.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.792+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05580b1c60 con 0x7f055815afd0 2023-12-19T05:53:16.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.792+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05580b2220 con 0x7f055815afd0 2023-12-19T05:53:16.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.793+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f055815f2d0 con 0x7f055815afd0 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.794+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f055000ab50 con 0x7f055815afd0 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.795+0000 7f054effd640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f053806a430 0x7f053806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.795+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0550088220 con 0x7f055815afd0 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.795+0000 7f054effd640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7f0538070290 0x7f05380726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.795+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0538072d60 con 0x7f0538070290 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.796+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0550088590 con 0x7f055815afd0 2023-12-19T05:53:16.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.796+0000 7f055659c640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f053806a430 0x7f053806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.796+0000 7f054ffff640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7f0538070290 0x7f05380726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.796+0000 7f054ffff640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7f0538070290 0x7f05380726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.797+0000 7f055659c640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f053806a430 0x7f053806c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0548036000 tx=0x7f054803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.797+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== osd.2 v2:172.21.15.49:6808/84037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0538072d60 con 0x7f0538070290 2023-12-19T05:53:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.809+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 --> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f055815eff0 con 0x7f0538070290 2023-12-19T05:53:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.810+0000 7f054effd640 1 -- 172.21.15.49:0/823773118 <== osd.2 v2:172.21.15.49:6808/84037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f05400076f0 con 0x7f0538070290 2023-12-19T05:53:16.812 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:16.812 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:16.812 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.810+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7f0538070290 msgr2=0x7f05380726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.810+0000 7f055759e640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:6808/84037,v1:172.21.15.49:6811/84037] conn(0x7f0538070290 0x7f05380726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.810+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f053806a430 msgr2=0x7f053806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.810+0000 7f055759e640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f053806a430 0x7f053806c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0548036000 tx=0x7f054803c040 comp rx=0 tx=0).stop 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 msgr2=0x7f055814ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 --2- 172.21.15.49:0/823773118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055815afd0 0x7f055814ce00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f0550002230 tx=0x7f055000cbe0 comp rx=0 tx=0).stop 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f0556d9d640 1 -- 172.21.15.49:0/823773118 reap_dead start 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 shutdown_connections 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 >> 172.21.15.49:0/823773118 conn(0x7f05580b4750 msgr2=0x7f05580cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 shutdown_connections 2023-12-19T05:53:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:16.811+0000 7f055759e640 1 -- 172.21.15.49:0/823773118 wait complete. 2023-12-19T05:53:16.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T05:53:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.056+0000 7f9f30d9f640 1 Processor -- start 2023-12-19T05:53:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.056+0000 7f9f30d9f640 1 -- start start 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f30d9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f30d9f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f2c06e410 0x7f9f2c161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f30d9f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c06e890 con 0x7f9f2c161540 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f30d9f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b2600 con 0x7f9f2c06e410 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f30d9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b1d60 con 0x7f9f2c157aa0 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f23fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f2c06e410 0x7f9f2c161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f23fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f2c06e410 0x7f9f2c161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35822/0 (socket says 172.21.15.49:35822) 2023-12-19T05:53:17.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f23fff640 1 -- 172.21.15.49:0/2549695084 learned_addr learned my addr 172.21.15.49:0/2549695084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.058+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.059+0000 7f9f23fff640 1 -- 172.21.15.49:0/2549695084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 msgr2=0x7f9f2c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.059+0000 7f9f23fff640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.059+0000 7f9f23fff640 1 -- 172.21.15.49:0/2549695084 >> v1:172.21.15.115:6789/0 conn(0x7f9f2c161540 legacy=0x7f9f2c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.059+0000 7f9f23fff640 1 -- 172.21.15.49:0/2549695084 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0b2040 con 0x7f9f2c06e410 2023-12-19T05:53:17.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.060+0000 7f9f23fff640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c06e410 0x7f9f2c161000 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009870 tx=0x7f9f1402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0170dcf92bee47a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f29d9b640 1 -- 172.21.15.49:0/2549695084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14030840 con 0x7f9f2c06e410 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f29d9b640 1 -- 172.21.15.49:0/2549695084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f140309a0 con 0x7f9f2c06e410 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f29d9b640 1 -- 172.21.15.49:0/2549695084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14030d30 con 0x7f9f2c06e410 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2549695084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c06e410 msgr2=0x7f9f2c161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c06e410 0x7f9f2c161000 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009870 tx=0x7f9f1402b980 comp rx=0 tx=0).stop 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2549695084 shutdown_connections 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c06e410 0x7f9f2c161000 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2549695084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2549695084 >> 172.21.15.49:0/2549695084 conn(0x7f9f2c0cbb70 msgr2=0x7f9f2c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2549695084 shutdown_connections 2023-12-19T05:53:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.061+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2549695084 wait complete. 2023-12-19T05:53:17.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.063+0000 7f9f30d9f640 1 Processor -- start 2023-12-19T05:53:17.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.063+0000 7f9f30d9f640 1 -- start start 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 0x7f9f2c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c1e7430 con 0x7f9f2c161540 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c070af0 con 0x7f9f2c06e410 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.064+0000 7f9f30d9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c158130 con 0x7f9f2c157aa0 2023-12-19T05:53:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35832/0 (socket says 172.21.15.49:35832) 2023-12-19T05:53:17.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 -- 172.21.15.49:0/2760867540 learned_addr learned my addr 172.21.15.49:0/2760867540 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f23fff640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 0x7f9f2c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 -- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 msgr2=0x7f9f2c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 -- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 msgr2=0x7f9f2c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 0x7f9f2c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 -- 172.21.15.49:0/2760867540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140094d0 con 0x7f9f2c161540 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 0x7f9f2c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.065+0000 7f9f2ad9d640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c760 tx=0x7f9f2400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.066+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24006d50 con 0x7f9f2c161540 2023-12-19T05:53:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.066+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400ce10 con 0x7f9f2c161540 2023-12-19T05:53:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.066+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c158410 con 0x7f9f2c161540 2023-12-19T05:53:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.066+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24003bb0 con 0x7f9f2c161540 2023-12-19T05:53:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.066+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c1587a0 con 0x7f9f2c161540 2023-12-19T05:53:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.067+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c061910 con 0x7f9f2c161540 2023-12-19T05:53:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.068+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f24003d10 con 0x7f9f2c161540 2023-12-19T05:53:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.069+0000 7f9f22ffd640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 0x7f9f0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.070+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f240880a0 con 0x7f9f2c161540 2023-12-19T05:53:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.070+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 0x7f9f0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.071+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 0x7f9f0c06c8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.074+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f24053a20 con 0x7f9f2c161540 2023-12-19T05:53:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.266+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f2c15db20 con 0x7f9f0c06a430 2023-12-19T05:53:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.267+0000 7f9f22ffd640 1 -- 172.21.15.49:0/2760867540 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f1c009e10 con 0x7f9f0c06a430 2023-12-19T05:53:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T05:53:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 msgr2=0x7f9f0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 0x7f9f0c06c8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c008040 comp rx=0 tx=0).stop 2023-12-19T05:53:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 msgr2=0x7f9f2c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c760 tx=0x7f9f2400cc20 comp rx=0 tx=0).stop 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 shutdown_connections 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9f0c06a430 0x7f9f0c06c8f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f2c157aa0 0x7f9f2c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c161540 0x7f9f2c0705b0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 --2- 172.21.15.49:0/2760867540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f2c06e410 0x7f9f2c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.269+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 >> 172.21.15.49:0/2760867540 conn(0x7f9f2c0cbb70 msgr2=0x7f9f2c15c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.270+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 shutdown_connections 2023-12-19T05:53:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.270+0000 7f9f30d9f640 1 -- 172.21.15.49:0/2760867540 wait complete. 2023-12-19T05:53:17.291 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T05:53:17.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.530+0000 7f1c51bc9640 1 Processor -- start 2023-12-19T05:53:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.531+0000 7f1c51bc9640 1 -- start start 2023-12-19T05:53:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.532+0000 7f1c51bc9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 0x7f1c4c0cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.532+0000 7f1c51bc9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c4c0d03c0 0x7f1c4c160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.532+0000 7f1c51bc9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c147280 con 0x7f1c4c146ea0 2023-12-19T05:53:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.532+0000 7f1c51bc9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c15eb70 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.532+0000 7f1c51bc9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c15f4d0 con 0x7f1c4c15e730 2023-12-19T05:53:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.533+0000 7f1c4affd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 0x7f1c4c0cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.533+0000 7f1c4bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c4c0d03c0 0x7f1c4c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.533+0000 7f1c4b7fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1c4c146ea0 0x7f1c4c15ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44762/0 (socket says 172.21.15.49:44762) 2023-12-19T05:53:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.533+0000 7f1c4affd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 0x7f1c4c0cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:37286/0 (socket says 172.21.15.49:37286) 2023-12-19T05:53:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.533+0000 7f1c4b7fe640 1 -- 172.21.15.49:0/2688706093 learned_addr learned my addr 172.21.15.49:0/2688706093 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.534+0000 7f1c4bfff640 1 -- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 msgr2=0x7f1c4c0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.534+0000 7f1c4bfff640 1 --2- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 0x7f1c4c0cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.534+0000 7f1c4a7fc640 1 -- 172.21.15.49:0/2688706093 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999794708 0 0) 0x7f1c4c147280 con 0x7f1c4c146ea0 2023-12-19T05:53:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.534+0000 7f1c4bfff640 1 -- 172.21.15.49:0/2688706093 >> v1:172.21.15.115:6789/0 conn(0x7f1c4c146ea0 legacy=0x7f1c4c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.534+0000 7f1c4bfff640 1 -- 172.21.15.49:0/2688706093 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c15f7b0 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.536+0000 7f1c4bfff640 1 --2- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c160570 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097a0 tx=0x7f1c4402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b1f40a7f5339a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.536+0000 7f1c4a7fc640 1 -- 172.21.15.49:0/2688706093 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44031830 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.536+0000 7f1c4a7fc640 1 -- 172.21.15.49:0/2688706093 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44031990 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.536+0000 7f1c4a7fc640 1 -- 172.21.15.49:0/2688706093 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44031d20 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 -- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 msgr2=0x7f1c4c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c160570 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097a0 tx=0x7f1c4402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 -- 172.21.15.49:0/2688706093 shutdown_connections 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c160570 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/2688706093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c15e730 0x7f1c4c0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 -- 172.21.15.49:0/2688706093 >> 172.21.15.49:0/2688706093 conn(0x7f1c4c0b29f0 msgr2=0x7f1c4c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 -- 172.21.15.49:0/2688706093 shutdown_connections 2023-12-19T05:53:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.537+0000 7f1c51bc9640 1 -- 172.21.15.49:0/2688706093 wait complete. 2023-12-19T05:53:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.539+0000 7f1c51bc9640 1 Processor -- start 2023-12-19T05:53:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.539+0000 7f1c51bc9640 1 -- start start 2023-12-19T05:53:17.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c13e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c146ea0 0x7f1c4c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 0x7f1c4c1e6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c13e690 con 0x7f1c4c15e730 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c13d420 con 0x7f1c4c0d03c0 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c51bc9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c13dcc0 con 0x7f1c4c146ea0 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 0x7f1c4c1e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 0x7f1c4c1e6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35834/0 (socket says 172.21.15.49:35834) 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c4bfff640 1 -- 172.21.15.49:0/1117630657 learned_addr learned my addr 172.21.15.49:0/1117630657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c4affd640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c146ea0 0x7f1c4c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.540+0000 7f1c4b7fe640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c13e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 -- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c146ea0 msgr2=0x7f1c4c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c4c146ea0 0x7f1c4c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 -- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 msgr2=0x7f1c4c13e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c4c0d03c0 0x7f1c4c13e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009400 con 0x7f1c4c15e730 2023-12-19T05:53:17.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c4bfff640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 0x7f1c4c1e6350 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098c0 tx=0x7f1c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4403a630 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4403a790 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c1e6cf0 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.541+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4403ab40 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.542+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c13d950 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.543+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c4c15fd70 con 0x7f1c4c15e730 2023-12-19T05:53:17.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.544+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c4403aca0 con 0x7f1c4c15e730 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c43fff640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c440aa350 con 0x7f1c4c15e730 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c43fff640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7f1c2c070290 0x7f1c2c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c2c072d60 con 0x7f1c2c070290 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c440aca10 con 0x7f1c4c15e730 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c4affd640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7f1c2c070290 0x7f1c2c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.545+0000 7f1c4b7fe640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.546+0000 7f1c4affd640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7f1c2c070290 0x7f1c2c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.546+0000 7f1c4b7fe640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c000f60 tx=0x7f1c3c007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.547+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== osd.3 v2:172.21.15.49:6809/84034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1c2c072d60 con 0x7f1c2c070290 2023-12-19T05:53:17.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.560+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 --> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c4c15fa90 con 0x7f1c2c070290 2023-12-19T05:53:17.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.561+0000 7f1c43fff640 1 -- 172.21.15.49:0/1117630657 <== osd.3 v2:172.21.15.49:6809/84034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f1c3400f040 con 0x7f1c2c070290 2023-12-19T05:53:17.562 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:17.563 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.561+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7f1c2c070290 msgr2=0x7f1c2c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.561+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:6809/84034,v1:172.21.15.49:6810/84034] conn(0x7f1c2c070290 0x7f1c2c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c2c06a430 msgr2=0x7f1c2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f1c2c06a430 0x7f1c2c06c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c000f60 tx=0x7f1c3c007b70 comp rx=0 tx=0).stop 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 msgr2=0x7f1c4c1e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 --2- 172.21.15.49:0/1117630657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c4c15e730 0x7f1c4c1e6350 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098c0 tx=0x7f1c440046c0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c4bfff640 1 -- 172.21.15.49:0/1117630657 reap_dead start 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 shutdown_connections 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 >> 172.21.15.49:0/1117630657 conn(0x7f1c4c0b29f0 msgr2=0x7f1c4c0b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 shutdown_connections 2023-12-19T05:53:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.562+0000 7f1c51bc9640 1 -- 172.21.15.49:0/1117630657 wait complete. 2023-12-19T05:53:17.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T05:53:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.817+0000 7f27ea16e640 1 Processor -- start 2023-12-19T05:53:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.817+0000 7f27ea16e640 1 -- start start 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27ea16e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f27e41449e0 0x7f27e40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27ea16e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27e406c6b0 0x7f27e40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27ea16e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40afb10 con 0x7f27e40b0b50 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27ea16e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e406bb30 con 0x7f27e406c6b0 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27ea16e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40b0070 con 0x7f27e41449e0 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.819+0000 7f27daffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f27e40b0b50 0x7f27e406bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52552/0 (socket says 172.21.15.49:52552) 2023-12-19T05:53:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27daffd640 1 -- 172.21.15.49:0/2564320096 learned_addr learned my addr 172.21.15.49:0/2564320096 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2564320096 >> v2:172.21.15.49:3300/0 conn(0x7f27e406c6b0 0x7f27e40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e37fe640 1 --2- 172.21.15.49:0/2564320096 >> v2:172.21.15.115:3300/0 conn(0x7f27e41449e0 0x7f27e40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e2ffd640 1 -- 172.21.15.49:0/2564320096 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494691943 0 0) 0x7f27e40afb10 con 0x7f27e40b0b50 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e2ffd640 1 -- 172.21.15.49:0/2564320096 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d0003520 con 0x7f27e40b0b50 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e3fff640 1 -- 172.21.15.49:0/2564320096 >> v2:172.21.15.115:3300/0 conn(0x7f27e41449e0 msgr2=0x7f27e40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2564320096 >> v2:172.21.15.115:3300/0 conn(0x7f27e41449e0 0x7f27e40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e3fff640 1 -- 172.21.15.49:0/2564320096 >> v1:172.21.15.49:6789/0 conn(0x7f27e40b0b50 legacy=0x7f27e406bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.820+0000 7f27e3fff640 1 -- 172.21.15.49:0/2564320096 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40b0350 con 0x7f27e406c6b0 2023-12-19T05:53:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2564320096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e406c6b0 0x7f27e40b1710 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f27e4071cd0 tx=0x7f27dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b95e4048d038aee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27e2ffd640 1 -- 172.21.15.49:0/2564320096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc031830 con 0x7f27e406c6b0 2023-12-19T05:53:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27e2ffd640 1 -- 172.21.15.49:0/2564320096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc031990 con 0x7f27e406c6b0 2023-12-19T05:53:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27e2ffd640 1 -- 172.21.15.49:0/2564320096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc031d00 con 0x7f27e406c6b0 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27ea16e640 1 -- 172.21.15.49:0/2564320096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e406c6b0 msgr2=0x7f27e40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.822+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2564320096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e406c6b0 0x7f27e40b1710 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f27e4071cd0 tx=0x7f27dc02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 -- 172.21.15.49:0/2564320096 shutdown_connections 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2564320096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e406c6b0 0x7f27e40b1710 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2564320096 >> v2:172.21.15.115:3300/0 conn(0x7f27e41449e0 0x7f27e40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 -- 172.21.15.49:0/2564320096 >> 172.21.15.49:0/2564320096 conn(0x7f27e40cbb70 msgr2=0x7f27e40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 -- 172.21.15.49:0/2564320096 shutdown_connections 2023-12-19T05:53:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.823+0000 7f27ea16e640 1 -- 172.21.15.49:0/2564320096 wait complete. 2023-12-19T05:53:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.825+0000 7f27ea16e640 1 Processor -- start 2023-12-19T05:53:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.825+0000 7f27ea16e640 1 -- start start 2023-12-19T05:53:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e406c6b0 0x7f27e40ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27e40b0b50 0x7f27e40aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415e4b0 con 0x7f27e41449e0 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ad000 con 0x7f27e406c6b0 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27ea16e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ad2e0 con 0x7f27e40b0b50 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35848/0 (socket says 172.21.15.49:35848) 2023-12-19T05:53:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27e3fff640 1 -- 172.21.15.49:0/2324570668 learned_addr learned my addr 172.21.15.49:0/2324570668 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.826+0000 7f27e37fe640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e406c6b0 0x7f27e40ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 -- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27e40b0b50 msgr2=0x7f27e40aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27e40b0b50 0x7f27e40aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 -- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e406c6b0 msgr2=0x7f27e40ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e406c6b0 0x7f27e40ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 -- 172.21.15.49:0/2324570668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009400 con 0x7f27e41449e0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e3fff640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009890 tx=0x7f27dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc03a630 con 0x7f27e41449e0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc03a7b0 con 0x7f27e41449e0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc03ab60 con 0x7f27e41449e0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40ad5c0 con 0x7f27e41449e0 2023-12-19T05:53:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.827+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40adb80 con 0x7f27e41449e0 2023-12-19T05:53:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.829+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40add70 con 0x7f27e41449e0 2023-12-19T05:53:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.830+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27dc03acc0 con 0x7f27e41449e0 2023-12-19T05:53:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.831+0000 7f27e0ff9640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 0x7f27c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.831+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f27dc0aa130 con 0x7f27e41449e0 2023-12-19T05:53:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.831+0000 7f27e37fe640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 0x7f27c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.832+0000 7f27e37fe640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 0x7f27c406c8f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f27d40073f0 tx=0x7f27d400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:17.835+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27dc075a20 con 0x7f27e41449e0 2023-12-19T05:53:18.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.030+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e40b0630 con 0x7f27c406a430 2023-12-19T05:53:18.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.032+0000 7f27e0ff9640 1 -- 172.21.15.49:0/2324570668 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27d400f050 con 0x7f27c406a430 2023-12-19T05:53:18.033 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.034+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 msgr2=0x7f27c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.034+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 0x7f27c406c8f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f27d40073f0 tx=0x7f27d400b040 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.034+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 msgr2=0x7f27e415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.034+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009890 tx=0x7f27dc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 shutdown_connections 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f27c406a430 0x7f27c406c8f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f27e40b0b50 0x7f27e40aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e41449e0 0x7f27e415a3a0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 --2- 172.21.15.49:0/2324570668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e406c6b0 0x7f27e40ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 >> 172.21.15.49:0/2324570668 conn(0x7f27e40cbb70 msgr2=0x7f27e413e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:18.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 shutdown_connections 2023-12-19T05:53:18.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.035+0000 7f27ea16e640 1 -- 172.21.15.49:0/2324570668 wait complete. 2023-12-19T05:53:18.057 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T05:53:18.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.286+0000 7f9c65f39640 1 Processor -- start 2023-12-19T05:53:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.286+0000 7f9c65f39640 1 -- start start 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c65f39640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 0x7f9c60140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c65f39640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c60140f70 0x7f9c600cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c65f39640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c600b1880 con 0x7f9c6013e200 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c65f39640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c60141400 con 0x7f9c60140f70 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c65f39640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b26e0 con 0x7f9c60141660 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c5f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9c6013e200 0x7f9c600ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52554/0 (socket says 172.21.15.49:52554) 2023-12-19T05:53:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c5f7fe640 1 -- 172.21.15.49:0/1430593249 learned_addr learned my addr 172.21.15.49:0/1430593249 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c5ffff640 1 --2- 172.21.15.49:0/1430593249 >> v2:172.21.15.115:3300/0 conn(0x7f9c60140f70 0x7f9c600cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.288+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 0x7f9c60140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552383912 0 0) 0x7f9c600b1880 con 0x7f9c6013e200 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c4c003520 con 0x7f9c6013e200 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048407782 0 0) 0x7f9c4c003520 con 0x7f9c6013e200 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 msgr2=0x7f9c60140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 0x7f9c60140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 >> v2:172.21.15.115:3300/0 conn(0x7f9c60140f70 msgr2=0x7f9c600cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 --2- 172.21.15.49:0/1430593249 >> v2:172.21.15.115:3300/0 conn(0x7f9c60140f70 0x7f9c600cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600b1ad0 con 0x7f9c6013e200 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7f9c50001670 con 0x7f9c6013e200 2023-12-19T05:53:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 >> v1:172.21.15.49:6789/0 conn(0x7f9c6013e200 legacy=0x7f9c600ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c4c0039e0 0x7f9c4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c4c0047c0 0x7f9c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 0x7f9c4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60141400 con 0x7f9c4c0047c0 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b26e0 con 0x7f9c4c0039e0 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.289+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c00b9b0 con 0x7f9c60141660 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c4c0047c0 0x7f9c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c5f7fe640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c4c0039e0 0x7f9c4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 -- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 msgr2=0x7f9c4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c60141660 0x7f9c4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 -- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c4c0039e0 msgr2=0x7f9c4c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c4c0039e0 0x7f9c4c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c57fff640 1 -- 172.21.15.49:0/1430593249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c003520 con 0x7f9c4c0047c0 2023-12-19T05:53:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.290+0000 7f9c5f7fe640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c4c0039e0 0x7f9c4c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c4c0047c0 0x7f9c4c004c40 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009a90 tx=0x7f9c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c51e9e71a617f4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4802c6b0 con 0x7f9c4c0047c0 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4802c810 con 0x7f9c4c0047c0 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c5effd640 1 -- 172.21.15.49:0/1430593249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4802cba0 con 0x7f9c4c0047c0 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c65f39640 1 -- 172.21.15.49:0/1430593249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c4c0047c0 msgr2=0x7f9c4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c65f39640 1 --2- 172.21.15.49:0/1430593249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c4c0047c0 0x7f9c4c004c40 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009a90 tx=0x7f9c4c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.292+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1430593249 reap_dead start 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.293+0000 7f9c65f39640 1 -- 172.21.15.49:0/1430593249 shutdown_connections 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.293+0000 7f9c65f39640 1 -- 172.21.15.49:0/1430593249 >> 172.21.15.49:0/1430593249 conn(0x7f9c600cf230 msgr2=0x7f9c600cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.293+0000 7f9c65f39640 1 -- 172.21.15.49:0/1430593249 shutdown_connections 2023-12-19T05:53:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.293+0000 7f9c65f39640 1 -- 172.21.15.49:0/1430593249 wait complete. 2023-12-19T05:53:18.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.295+0000 7f9c65f39640 1 Processor -- start 2023-12-19T05:53:18.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.295+0000 7f9c65f39640 1 -- start start 2023-12-19T05:53:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c4c0047c0 0x7f9c6006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c60154e40 0x7f9c6015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 0x7f9c6013b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6013b600 con 0x7f9c6013ac30 2023-12-19T05:53:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60155ec0 con 0x7f9c60154e40 2023-12-19T05:53:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c65f39640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60155340 con 0x7f9c4c0047c0 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 0x7f9c6013b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 0x7f9c6013b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35860/0 (socket says 172.21.15.49:35860) 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.296+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1184223728 learned_addr learned my addr 172.21.15.49:0/1184223728 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c60154e40 0x7f9c6015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5f7fe640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c4c0047c0 0x7f9c6006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c4c0047c0 msgr2=0x7f9c6006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c4c0047c0 0x7f9c6006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c60154e40 msgr2=0x7f9c6015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c60154e40 0x7f9c6015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60155620 con 0x7f9c6013ac30 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.297+0000 7f9c5ffff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 0x7f9c6013b0c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9c6006e710 tx=0x7f9c5800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.298+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58010040 con 0x7f9c6013ac30 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.298+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800bae0 con 0x7f9c6013ac30 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.298+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800be70 con 0x7f9c6013ac30 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.298+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60155900 con 0x7f9c6013ac30 2023-12-19T05:53:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.298+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6006ced0 con 0x7f9c6013ac30 2023-12-19T05:53:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.299+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c600b2090 con 0x7f9c6013ac30 2023-12-19T05:53:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.300+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c5801e410 con 0x7f9c6013ac30 2023-12-19T05:53:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.301+0000 7f9c5cff9640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9c4006a430 0x7f9c4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.301+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c580889b0 con 0x7f9c6013ac30 2023-12-19T05:53:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.301+0000 7f9c5cff9640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f9c40070290 0x7f9c400726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.301+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c40072d60 con 0x7f9c40070290 2023-12-19T05:53:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.301+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c5808d2a0 con 0x7f9c6013ac30 2023-12-19T05:53:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.302+0000 7f9c5f7fe640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9c4006a430 0x7f9c4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.302+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f9c40070290 0x7f9c400726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.303+0000 7f9c57fff640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f9c40070290 0x7f9c400726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.303+0000 7f9c5f7fe640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9c4006a430 0x7f9c4006c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c6015b240 tx=0x7f9c50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.305+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== osd.4 v2:172.21.15.115:6800/84440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9c40072d60 con 0x7f9c40070290 2023-12-19T05:53:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.318+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 --> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c600b1db0 con 0x7f9c40070290 2023-12-19T05:53:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c5cff9640 1 -- 172.21.15.49:0/1184223728 <== osd.4 v2:172.21.15.115:6800/84440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f9c48004040 con 0x7f9c40070290 2023-12-19T05:53:18.320 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:18.320 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:18.321 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f9c40070290 msgr2=0x7f9c400726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6800/84440,v1:172.21.15.115:6801/84440] conn(0x7f9c40070290 0x7f9c400726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9c4006a430 msgr2=0x7f9c4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9c4006a430 0x7f9c4006c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c6015b240 tx=0x7f9c50009040 comp rx=0 tx=0).stop 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 msgr2=0x7f9c6013b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.319+0000 7f9c65f39640 1 --2- 172.21.15.49:0/1184223728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c6013ac30 0x7f9c6013b0c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9c6006e710 tx=0x7f9c5800b480 comp rx=0 tx=0).stop 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.320+0000 7f9c5ffff640 1 -- 172.21.15.49:0/1184223728 reap_dead start 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.320+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 shutdown_connections 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.320+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 >> 172.21.15.49:0/1184223728 conn(0x7f9c600cf230 msgr2=0x7f9c601576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.320+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 shutdown_connections 2023-12-19T05:53:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.320+0000 7f9c65f39640 1 -- 172.21.15.49:0/1184223728 wait complete. 2023-12-19T05:53:18.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T05:53:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.578+0000 7f3b9edfd640 1 Processor -- start 2023-12-19T05:53:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.578+0000 7f3b9edfd640 1 -- start start 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b9815e5a0 0x7f3b980b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 0x7f3b980b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b980cdbf0 0x7f3b980ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980ce5a0 con 0x7f3b9815e5a0 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9815ec30 con 0x7f3b9815f680 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9edfd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980b2cc0 con 0x7f3b980cdbf0 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9ddfb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b9815e5a0 0x7f3b980b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9ddfb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b9815e5a0 0x7f3b980b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35864/0 (socket says 172.21.15.49:35864) 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.580+0000 7f3b9ddfb640 1 -- 172.21.15.49:0/1374954446 learned_addr learned my addr 172.21.15.49:0/1374954446 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9e5fc640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b980cdbf0 0x7f3b980ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9d5fa640 1 --2- 172.21.15.49:0/1374954446 >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 0x7f3b980b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9ddfb640 1 -- 172.21.15.49:0/1374954446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b980cdbf0 msgr2=0x7f3b980ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b980cdbf0 0x7f3b980ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9ddfb640 1 -- 172.21.15.49:0/1374954446 >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 msgr2=0x7f3b980b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:18.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1374954446 >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 0x7f3b980b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9ddfb640 1 -- 172.21.15.49:0/1374954446 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9815e980 con 0x7f3b9815e5a0 2023-12-19T05:53:18.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.581+0000 7f3b9d5fa640 1 --2- 172.21.15.49:0/1374954446 >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 0x7f3b980b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:18.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.582+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815e5a0 0x7f3b980b2030 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009870 tx=0x7f3b9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d8e81c877d0511 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.582+0000 7f3b9cdf9640 1 -- 172.21.15.49:0/1374954446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94031640 con 0x7f3b9815e5a0 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.582+0000 7f3b9cdf9640 1 -- 172.21.15.49:0/1374954446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b940317a0 con 0x7f3b9815e5a0 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.582+0000 7f3b9cdf9640 1 -- 172.21.15.49:0/1374954446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94031b30 con 0x7f3b9815e5a0 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1374954446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815e5a0 msgr2=0x7f3b980b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815e5a0 0x7f3b980b2030 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009870 tx=0x7f3b9402b8f0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1374954446 shutdown_connections 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b980cdbf0 0x7f3b980ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1374954446 >> v2:172.21.15.115:3300/0 conn(0x7f3b9815f680 0x7f3b980b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1374954446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815e5a0 0x7f3b980b2030 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1374954446 >> 172.21.15.49:0/1374954446 conn(0x7f3b980b0100 msgr2=0x7f3b980b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1374954446 shutdown_connections 2023-12-19T05:53:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.583+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1374954446 wait complete. 2023-12-19T05:53:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.585+0000 7f3b9edfd640 1 Processor -- start 2023-12-19T05:53:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.585+0000 7f3b9edfd640 1 -- start start 2023-12-19T05:53:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b980cdbf0 0x7f3b980cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b9815e5a0 0x7f3b981f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c9320 con 0x7f3b9815f680 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c9600 con 0x7f3b980cdbf0 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9edfd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c98e0 con 0x7f3b9815e5a0 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9e5fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9e5fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35866/0 (socket says 172.21.15.49:35866) 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.586+0000 7f3b9e5fc640 1 -- 172.21.15.49:0/1277428309 learned_addr learned my addr 172.21.15.49:0/1277428309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b980cdbf0 0x7f3b980cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9d5fa640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b9815e5a0 0x7f3b981f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 -- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b9815e5a0 msgr2=0x7f3b981f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b9815e5a0 0x7f3b981f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 -- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b980cdbf0 msgr2=0x7f3b980cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b980cdbf0 0x7f3b980cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 -- 172.21.15.49:0/1277428309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940094d0 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b9e5fc640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000cd70 tx=0x7f3b9000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90003b90 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.587+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90003cf0 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.588+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980c9bc0 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.588+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90004240 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.588+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980cc030 con 0x7f3b9815f680 2023-12-19T05:53:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.589+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b980ca0e0 con 0x7f3b9815f680 2023-12-19T05:53:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.590+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b900043a0 con 0x7f3b9815f680 2023-12-19T05:53:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.591+0000 7f3b8e7fc640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 0x7f3b7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.591+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b90012070 con 0x7f3b9815f680 2023-12-19T05:53:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.592+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 0x7f3b7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:18.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.593+0000 7f3b9ddfb640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 0x7f3b7c06c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3b94036000 tx=0x7f3b9403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:18.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.595+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3b980ca0e0 con 0x7f3b9815f680 2023-12-19T05:53:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.792+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b980b3270 con 0x7f3b7c06a460 2023-12-19T05:53:18.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.793+0000 7f3b8e7fc640 1 -- 172.21.15.49:0/1277428309 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b94031ae0 con 0x7f3b7c06a460 2023-12-19T05:53:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 msgr2=0x7f3b7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 0x7f3b7c06c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3b94036000 tx=0x7f3b9403c040 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 msgr2=0x7f3b980ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000cd70 tx=0x7f3b9000a660 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 shutdown_connections 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f3b7c06a460 0x7f3b7c06c920 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b9815e5a0 0x7f3b981f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9815f680 0x7f3b980ca3c0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 --2- 172.21.15.49:0/1277428309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b980cdbf0 0x7f3b980cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 >> 172.21.15.49:0/1277428309 conn(0x7f3b980b0100 msgr2=0x7f3b980b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 shutdown_connections 2023-12-19T05:53:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:18.796+0000 7f3b9edfd640 1 -- 172.21.15.49:0/1277428309 wait complete. 2023-12-19T05:53:18.816 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T05:53:18.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:19.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.048+0000 7f0f2132e640 1 Processor -- start 2023-12-19T05:53:19.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.048+0000 7f0f2132e640 1 -- start start 2023-12-19T05:53:19.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.049+0000 7f0f2132e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c13e200 0x7f0f1c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.049+0000 7f0f2132e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f1c141660 0x7f0f1c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f2132e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f1c140f70 0x7f0f1c15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f2132e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c1413e0 con 0x7f0f1c140f70 2023-12-19T05:53:19.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f2132e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b1880 con 0x7f0f1c141660 2023-12-19T05:53:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f2132e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b26e0 con 0x7f0f1c13e200 2023-12-19T05:53:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f1b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f1c140f70 0x7f0f1c15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f1b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f1c140f70 0x7f0f1c15ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35878/0 (socket says 172.21.15.49:35878) 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f1b7fe640 1 -- 172.21.15.49:0/3863106966 learned_addr learned my addr 172.21.15.49:0/3863106966 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f1affd640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c13e200 0x7f0f1c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.050+0000 7f0f1a7fc640 1 --2- 172.21.15.49:0/3863106966 >> v2:172.21.15.115:3300/0 conn(0x7f0f1c141660 0x7f0f1c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.051+0000 7f0f1b7fe640 1 -- 172.21.15.49:0/3863106966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c13e200 msgr2=0x7f0f1c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.051+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c13e200 0x7f0f1c0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.051+0000 7f0f1b7fe640 1 -- 172.21.15.49:0/3863106966 >> v2:172.21.15.115:3300/0 conn(0x7f0f1c141660 msgr2=0x7f0f1c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.051+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/3863106966 >> v2:172.21.15.115:3300/0 conn(0x7f0f1c141660 0x7f0f1c140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.051+0000 7f0f1b7fe640 1 -- 172.21.15.49:0/3863106966 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0cf020 con 0x7f0f1c140f70 2023-12-19T05:53:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.052+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c15ee40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c06dc40 tx=0x7f0f1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac0171d675c1a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.052+0000 7f0f19ffb640 1 -- 172.21.15.49:0/3863106966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1402ca70 con 0x7f0f1c140f70 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.052+0000 7f0f19ffb640 1 -- 172.21.15.49:0/3863106966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1402cbd0 con 0x7f0f1c140f70 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.052+0000 7f0f19ffb640 1 -- 172.21.15.49:0/3863106966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140343f0 con 0x7f0f1c140f70 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 -- 172.21.15.49:0/3863106966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 msgr2=0x7f0f1c15ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c15ee40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c06dc40 tx=0x7f0f1402bed0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 -- 172.21.15.49:0/3863106966 shutdown_connections 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c15ee40 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 --2- 172.21.15.49:0/3863106966 >> v2:172.21.15.115:3300/0 conn(0x7f0f1c141660 0x7f0f1c140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 --2- 172.21.15.49:0/3863106966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c13e200 0x7f0f1c0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 -- 172.21.15.49:0/3863106966 >> 172.21.15.49:0/3863106966 conn(0x7f0f1c0cf230 msgr2=0x7f0f1c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 -- 172.21.15.49:0/3863106966 shutdown_connections 2023-12-19T05:53:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.053+0000 7f0f2132e640 1 -- 172.21.15.49:0/3863106966 wait complete. 2023-12-19T05:53:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.055+0000 7f0f2132e640 1 Processor -- start 2023-12-19T05:53:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.055+0000 7f0f2132e640 1 -- start start 2023-12-19T05:53:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c13e200 0x7f0f1c139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c141660 0x7f0f1c070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c13f0a0 con 0x7f0f1c140f70 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c155570 con 0x7f0f1c13e200 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f2132e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0ae8c0 con 0x7f0f1c141660 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f1a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f1a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c0b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35894/0 (socket says 172.21.15.49:35894) 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.056+0000 7f0f1a7fc640 1 -- 172.21.15.49:0/2950977694 learned_addr learned my addr 172.21.15.49:0/2950977694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c141660 0x7f0f1c070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 -- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c141660 msgr2=0x7f0f1c070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c141660 0x7f0f1c070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 -- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c13e200 msgr2=0x7f0f1c139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c13e200 0x7f0f1c139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009b30 con 0x7f0f1c140f70 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f1c141660 0x7f0f1c070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f1a7fc640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c0b0810 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000d800 tx=0x7f0f1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000b6c0 con 0x7f0f1c140f70 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000b820 con 0x7f0f1c140f70 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c139f70 con 0x7f0f1c140f70 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000bbb0 con 0x7f0f1c140f70 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.057+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c13e9e0 con 0x7f0f1c140f70 2023-12-19T05:53:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.059+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f1c13e870 con 0x7f0f1c140f70 2023-12-19T05:53:19.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.060+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f1000bd10 con 0x7f0f1c140f70 2023-12-19T05:53:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.060+0000 7f0f037fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0f0806a430 0x7f0f0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f10088b50 con 0x7f0f1c140f70 2023-12-19T05:53:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f037fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f0f08070290 0x7f0f080726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f08072d60 con 0x7f0f08070290 2023-12-19T05:53:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f1008d2a0 con 0x7f0f1c140f70 2023-12-19T05:53:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f1affd640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0f0806a430 0x7f0f0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.061+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f0f08070290 0x7f0f080726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.063+0000 7f0f1b7fe640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f0f08070290 0x7f0f080726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.063+0000 7f0f1affd640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0f0806a430 0x7f0f0806c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b7f0 tx=0x7f0f0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.064+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== osd.5 v2:172.21.15.115:6805/84439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0f08072d60 con 0x7f0f08070290 2023-12-19T05:53:19.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.078+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 --> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f1c0b1db0 con 0x7f0f08070290 2023-12-19T05:53:19.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f037fe640 1 -- 172.21.15.49:0/2950977694 <== osd.5 v2:172.21.15.115:6805/84439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0f14040410 con 0x7f0f08070290 2023-12-19T05:53:19.081 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:19.081 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:19.081 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f0f08070290 msgr2=0x7f0f080726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6805/84439,v1:172.21.15.115:6807/84439] conn(0x7f0f08070290 0x7f0f080726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0f0806a430 msgr2=0x7f0f0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f0f0806a430 0x7f0f0806c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b7f0 tx=0x7f0f0c008040 comp rx=0 tx=0).stop 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 msgr2=0x7f0f1c0b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 --2- 172.21.15.49:0/2950977694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f1c140f70 0x7f0f1c0b0810 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000d800 tx=0x7f0f1000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f1b7fe640 1 -- 172.21.15.49:0/2950977694 reap_dead start 2023-12-19T05:53:19.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 shutdown_connections 2023-12-19T05:53:19.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 >> 172.21.15.49:0/2950977694 conn(0x7f0f1c0cf230 msgr2=0x7f0f1c15ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 shutdown_connections 2023-12-19T05:53:19.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.080+0000 7f0f2132e640 1 -- 172.21.15.49:0/2950977694 wait complete. 2023-12-19T05:53:19.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T05:53:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.321+0000 7fe7a89ea640 1 Processor -- start 2023-12-19T05:53:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.322+0000 7fe7a89ea640 1 -- start start 2023-12-19T05:53:19.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.323+0000 7fe7a89ea640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7a40cf670 0x7fe7a40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a89ea640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a40b4120 con 0x7fe7a415da00 2023-12-19T05:53:19.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a89ea640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a40b5b80 con 0x7fe7a415d620 2023-12-19T05:53:19.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a89ea640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40b6ee0 con 0x7fe7a40cf670 2023-12-19T05:53:19.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a3fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe7a415da00 0x7fe7a40b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52570/0 (socket says 172.21.15.49:52570) 2023-12-19T05:53:19.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a3fff640 1 -- 172.21.15.49:0/1531847256 learned_addr learned my addr 172.21.15.49:0/1531847256 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a2ffd640 1 --2- 172.21.15.49:0/1531847256 >> v2:172.21.15.115:3300/0 conn(0x7fe7a40cf670 0x7fe7a40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.324+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22258165 0 0) 0x7fe7a40b4120 con 0x7fe7a415da00 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe790003520 con 0x7fe7a415da00 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286395570 0 0) 0x7fe790003520 con 0x7fe7a415da00 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 >> v2:172.21.15.115:3300/0 conn(0x7fe7a40cf670 msgr2=0x7fe7a40b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 --2- 172.21.15.49:0/1531847256 >> v2:172.21.15.115:3300/0 conn(0x7fe7a40cf670 0x7fe7a40b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 >> v1:172.21.15.115:6789/0 conn(0x7fe7a415d620 legacy=0x7fe7a40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40b71c0 con 0x7fe7a415da00 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48136508 0 0) 0x7fe79c001670 con 0x7fe7a415da00 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 >> v1:172.21.15.49:6789/0 conn(0x7fe7a415da00 legacy=0x7fe7a40b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe790003970 0x7fe790003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7900047c0 0x7fe790004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe79000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40b6ee0 con 0x7fe790005180 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79000c020 con 0x7fe7900047c0 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79000c1e0 con 0x7fe790003970 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.325+0000 7fe7a3fff640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe79000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a37fe640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe790003970 0x7fe790003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a2ffd640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7900047c0 0x7fe790004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a3fff640 1 -- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe790003970 msgr2=0x7fe790003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a3fff640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe790003970 0x7fe790003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a3fff640 1 -- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7900047c0 msgr2=0x7fe790004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a3fff640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7900047c0 0x7fe790004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a3fff640 1 -- 172.21.15.49:0/1531847256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790003520 con 0x7fe790005180 2023-12-19T05:53:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.326+0000 7fe7a2ffd640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7900047c0 0x7fe790004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.327+0000 7fe7a3fff640 1 -- 172.21.15.49:0/1531847256 reap_dead start 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.327+0000 7fe7a3fff640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe79000b980 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007fd0 tx=0x7fe7900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae83b0e05596c298 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.327+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005ad0 con 0x7fe790005180 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.327+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c005c30 con 0x7fe790005180 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.327+0000 7fe7a27fc640 1 -- 172.21.15.49:0/1531847256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c02c870 con 0x7fe790005180 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 -- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 msgr2=0x7fe79000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe79000b980 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007fd0 tx=0x7fe7900057f0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 -- 172.21.15.49:0/1531847256 shutdown_connections 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/1531847256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe79000b980 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 -- 172.21.15.49:0/1531847256 >> 172.21.15.49:0/1531847256 conn(0x7fe7a40cfb90 msgr2=0x7fe7a40cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 -- 172.21.15.49:0/1531847256 shutdown_connections 2023-12-19T05:53:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.328+0000 7fe7a89ea640 1 -- 172.21.15.49:0/1531847256 wait complete. 2023-12-19T05:53:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.330+0000 7fe7a89ea640 1 Processor -- start 2023-12-19T05:53:19.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.330+0000 7fe7a89ea640 1 -- start start 2023-12-19T05:53:19.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7a41e3db0 0x7fe7a41e4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7a41f6650 0x7fe7a41f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a415b700 con 0x7fe790005180 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41e4770 con 0x7fe7a41e3db0 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a89ea640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a415a6f0 con 0x7fe7a41f6650 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.331+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35912/0 (socket says 172.21.15.49:35912) 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 -- 172.21.15.49:0/2339420838 learned_addr learned my addr 172.21.15.49:0/2339420838 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 -- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7a41f6650 msgr2=0x7fe7a41f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7a41f6650 0x7fe7a41f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 -- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7a41e3db0 msgr2=0x7fe7a41e4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7a41e3db0 0x7fe7a41e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 -- 172.21.15.49:0/2339420838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a415b270 con 0x7fe790005180 2023-12-19T05:53:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe7a37fe640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e920 tx=0x7fe79400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794003b80 con 0x7fe790005180 2023-12-19T05:53:19.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.332+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794003ce0 con 0x7fe790005180 2023-12-19T05:53:19.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.333+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940052f0 con 0x7fe790005180 2023-12-19T05:53:19.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.333+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a415a940 con 0x7fe790005180 2023-12-19T05:53:19.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.333+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a415af00 con 0x7fe790005180 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.334+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4061910 con 0x7fe790005180 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.335+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe794005450 con 0x7fe790005180 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.336+0000 7fe79bfff640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 0x7fe78406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.336+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe794088610 con 0x7fe790005180 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.336+0000 7fe7a2ffd640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 0x7fe78406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.338+0000 7fe7a2ffd640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 0x7fe78406c920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe7a415bef0 tx=0x7fe78c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.340+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe794053f00 con 0x7fe790005180 2023-12-19T05:53:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.535+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a40b4650 con 0x7fe78406a460 2023-12-19T05:53:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.536+0000 7fe79bfff640 1 -- 172.21.15.49:0/2339420838 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe78c0107f0 con 0x7fe78406a460 2023-12-19T05:53:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T05:53:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 msgr2=0x7fe78406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 0x7fe78406c920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe7a415bef0 tx=0x7fe78c008040 comp rx=0 tx=0).stop 2023-12-19T05:53:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 msgr2=0x7fe7a4143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e920 tx=0x7fe79400ede0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 shutdown_connections 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe78406a460 0x7fe78406c920 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7a41f6650 0x7fe7a41f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7a41e3db0 0x7fe7a41e4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 --2- 172.21.15.49:0/2339420838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe790005180 0x7fe7a4143a90 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 >> 172.21.15.49:0/2339420838 conn(0x7fe7a40cfb90 msgr2=0x7fe7a40cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 shutdown_connections 2023-12-19T05:53:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.539+0000 7fe7a89ea640 1 -- 172.21.15.49:0/2339420838 wait complete. 2023-12-19T05:53:19.561 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T05:53:19.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.797+0000 7f4f1e794640 1 Processor -- start 2023-12-19T05:53:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.797+0000 7f4f1e794640 1 -- start start 2023-12-19T05:53:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.799+0000 7f4f1e794640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f180b1d90 0x7f4f180d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.799+0000 7f4f1e794640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f180d3650 0x7f4f180d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.799+0000 7f4f1e794640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180d07c0 con 0x7f4f1815d4e0 2023-12-19T05:53:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.799+0000 7f4f1e794640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180ce7b0 con 0x7f4f180d3650 2023-12-19T05:53:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.799+0000 7f4f1e794640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180d3ae0 con 0x7f4f180b1d90 2023-12-19T05:53:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f180d3650 0x7f4f180d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f180d3650 0x7f4f180d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35914/0 (socket says 172.21.15.49:35914) 2023-12-19T05:53:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 -- 172.21.15.49:0/188904148 learned_addr learned my addr 172.21.15.49:0/188904148 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1cf91640 1 --2- 172.21.15.49:0/188904148 >> v2:172.21.15.115:3300/0 conn(0x7f4f180b1d90 0x7f4f180d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 -- 172.21.15.49:0/188904148 >> v2:172.21.15.115:3300/0 conn(0x7f4f180b1d90 msgr2=0x7f4f180d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 --2- 172.21.15.49:0/188904148 >> v2:172.21.15.115:3300/0 conn(0x7f4f180b1d90 0x7f4f180d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 -- 172.21.15.49:0/188904148 >> v1:172.21.15.115:6789/0 conn(0x7f4f1815d4e0 legacy=0x7f4f180b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.800+0000 7f4f1df93640 1 -- 172.21.15.49:0/188904148 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815d8c0 con 0x7f4f180d3650 2023-12-19T05:53:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.802+0000 7f4f1df93640 1 --2- 172.21.15.49:0/188904148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180d3650 0x7f4f180d15b0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f4f180b9310 tx=0x7f4f1002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3819f15381e83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.802+0000 7f4f0ffff640 1 -- 172.21.15.49:0/188904148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1002cb20 con 0x7f4f180d3650 2023-12-19T05:53:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.802+0000 7f4f0ffff640 1 -- 172.21.15.49:0/188904148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1002cc80 con 0x7f4f180d3650 2023-12-19T05:53:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.802+0000 7f4f0ffff640 1 -- 172.21.15.49:0/188904148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100343f0 con 0x7f4f180d3650 2023-12-19T05:53:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 -- 172.21.15.49:0/188904148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180d3650 msgr2=0x7f4f180d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 --2- 172.21.15.49:0/188904148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180d3650 0x7f4f180d15b0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f4f180b9310 tx=0x7f4f1002bf80 comp rx=0 tx=0).stop 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 -- 172.21.15.49:0/188904148 shutdown_connections 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 --2- 172.21.15.49:0/188904148 >> v2:172.21.15.115:3300/0 conn(0x7f4f180b1d90 0x7f4f180d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 --2- 172.21.15.49:0/188904148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180d3650 0x7f4f180d15b0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 -- 172.21.15.49:0/188904148 >> 172.21.15.49:0/188904148 conn(0x7f4f18072f40 msgr2=0x7f4f18073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 -- 172.21.15.49:0/188904148 shutdown_connections 2023-12-19T05:53:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.803+0000 7f4f1e794640 1 -- 172.21.15.49:0/188904148 wait complete. 2023-12-19T05:53:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.805+0000 7f4f1e794640 1 Processor -- start 2023-12-19T05:53:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.805+0000 7f4f1e794640 1 -- start start 2023-12-19T05:53:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 0x7f4f180abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180d3650 0x7f4f181f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1815d4e0 0x7f4f181f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1814c510 con 0x7f4f180b1d90 2023-12-19T05:53:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180ac0c0 con 0x7f4f180d3650 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1e794640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b7b10 con 0x7f4f1815d4e0 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1d792640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 0x7f4f180abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1d792640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 0x7f4f180abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35930/0 (socket says 172.21.15.49:35930) 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.806+0000 7f4f1d792640 1 -- 172.21.15.49:0/171554542 learned_addr learned my addr 172.21.15.49:0/171554542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 -- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1815d4e0 msgr2=0x7f4f181f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1815d4e0 0x7f4f181f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 -- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180d3650 msgr2=0x7f4f181f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180d3650 0x7f4f181f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009b30 con 0x7f4f180b1d90 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1d792640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 0x7f4f180abb80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400c400 tx=0x7f4f1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140052d0 con 0x7f4f180b1d90 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f14005430 con 0x7f4f180b1d90 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14003830 con 0x7f4f180b1d90 2023-12-19T05:53:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.807+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1814c7d0 con 0x7f4f180b1d90 2023-12-19T05:53:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.808+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1814cd90 con 0x7f4f180b1d90 2023-12-19T05:53:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.809+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f180cfe90 con 0x7f4f180b1d90 2023-12-19T05:53:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.810+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f14003990 con 0x7f4f180b1d90 2023-12-19T05:53:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.811+0000 7f4f0dffb640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4efc06a430 0x7f4efc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.811+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f14087bc0 con 0x7f4f180b1d90 2023-12-19T05:53:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.811+0000 7f4f0dffb640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f4efc070290 0x7f4efc0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.811+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4efc072d60 con 0x7f4efc070290 2023-12-19T05:53:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.811+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f1408c2a0 con 0x7f4f180b1d90 2023-12-19T05:53:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.812+0000 7f4f1cf91640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4efc06a430 0x7f4efc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.812+0000 7f4f1df93640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f4efc070290 0x7f4efc0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:19.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.813+0000 7f4f1cf91640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4efc06a430 0x7f4efc06c8f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4f1814f660 tx=0x7f4f08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.813+0000 7f4f1df93640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f4efc070290 0x7f4efc0726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.815+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== osd.6 v2:172.21.15.115:6814/84441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f4efc072d60 con 0x7f4efc070290 2023-12-19T05:53:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.828+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 --> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f180cfbb0 con 0x7f4efc070290 2023-12-19T05:53:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f0dffb640 1 -- 172.21.15.49:0/171554542 <== osd.6 v2:172.21.15.115:6814/84441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f4f1002c9a0 con 0x7f4efc070290 2023-12-19T05:53:19.831 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:19.831 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:19.831 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f4efc070290 msgr2=0x7f4efc0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6814/84441,v1:172.21.15.115:6815/84441] conn(0x7f4efc070290 0x7f4efc0726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4efc06a430 msgr2=0x7f4efc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f4efc06a430 0x7f4efc06c8f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4f1814f660 tx=0x7f4f08008040 comp rx=0 tx=0).stop 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 msgr2=0x7f4f180abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 --2- 172.21.15.49:0/171554542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f180b1d90 0x7f4f180abb80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400c400 tx=0x7f4f1400c8c0 comp rx=0 tx=0).stop 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1df93640 1 -- 172.21.15.49:0/171554542 reap_dead start 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 shutdown_connections 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 >> 172.21.15.49:0/171554542 conn(0x7f4f18072f40 msgr2=0x7f4f180ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 shutdown_connections 2023-12-19T05:53:19.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:19.830+0000 7f4f1e794640 1 -- 172.21.15.49:0/171554542 wait complete. 2023-12-19T05:53:19.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T05:53:20.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.085+0000 7f914d5b5640 1 Processor -- start 2023-12-19T05:53:20.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.085+0000 7f914d5b5640 1 -- start start 2023-12-19T05:53:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914d5b5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914815e3f0 0x7f91480b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914d5b5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91480acfc0 0x7f914806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914d5b5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480b2fa0 con 0x7f91480b2460 2023-12-19T05:53:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914d5b5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914806f600 con 0x7f914815e3f0 2023-12-19T05:53:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914d5b5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914815e7d0 con 0x7f91480acfc0 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f9147fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914815e3f0 0x7f91480b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f9147fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f914815e3f0 0x7f91480b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35934/0 (socket says 172.21.15.49:35934) 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f9147fff640 1 -- 172.21.15.49:0/1961879889 learned_addr learned my addr 172.21.15.49:0/1961879889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.087+0000 7f914cdb4640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91480acfc0 0x7f914806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.088+0000 7f9147fff640 1 -- 172.21.15.49:0/1961879889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91480acfc0 msgr2=0x7f914806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.088+0000 7f9147fff640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91480acfc0 0x7f914806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.088+0000 7f9147fff640 1 -- 172.21.15.49:0/1961879889 >> v1:172.21.15.115:6789/0 conn(0x7f91480b2460 legacy=0x7f91480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.088+0000 7f9147fff640 1 -- 172.21.15.49:0/1961879889 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480b29e0 con 0x7f914815e3f0 2023-12-19T05:53:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.089+0000 7f9147fff640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914815e3f0 0x7f91480b1f20 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9138009870 tx=0x7f913802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88935afe622ae0b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.089+0000 7f91477fe640 1 -- 172.21.15.49:0/1961879889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138031640 con 0x7f914815e3f0 2023-12-19T05:53:20.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.089+0000 7f91477fe640 1 -- 172.21.15.49:0/1961879889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91380317a0 con 0x7f914815e3f0 2023-12-19T05:53:20.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.089+0000 7f91477fe640 1 -- 172.21.15.49:0/1961879889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138031b30 con 0x7f914815e3f0 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 -- 172.21.15.49:0/1961879889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914815e3f0 msgr2=0x7f91480b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914815e3f0 0x7f91480b1f20 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9138009870 tx=0x7f913802b8f0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 -- 172.21.15.49:0/1961879889 shutdown_connections 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91480acfc0 0x7f914806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 --2- 172.21.15.49:0/1961879889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914815e3f0 0x7f91480b1f20 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 -- 172.21.15.49:0/1961879889 >> 172.21.15.49:0/1961879889 conn(0x7f91480b0100 msgr2=0x7f91480b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:20.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 -- 172.21.15.49:0/1961879889 shutdown_connections 2023-12-19T05:53:20.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.090+0000 7f914d5b5640 1 -- 172.21.15.49:0/1961879889 wait complete. 2023-12-19T05:53:20.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.092+0000 7f914d5b5640 1 Processor -- start 2023-12-19T05:53:20.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.092+0000 7f914d5b5640 1 -- start start 2023-12-19T05:53:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 0x7f9148153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 0x7f9148155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148152c00 con 0x7f91480acfc0 2023-12-19T05:53:20.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148152e50 con 0x7f91480b2460 2023-12-19T05:53:20.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.093+0000 7f914d5b5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148153130 con 0x7f914815e3f0 2023-12-19T05:53:20.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35944/0 (socket says 172.21.15.49:35944) 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 -- 172.21.15.49:0/696090685 learned_addr learned my addr 172.21.15.49:0/696090685 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f913ffff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 0x7f9148153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 -- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 msgr2=0x7f9148155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f914cdb4640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 0x7f9148155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 0x7f9148155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 -- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 msgr2=0x7f9148153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 0x7f9148153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f9147fff640 1 -- 172.21.15.49:0/696090685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380094d0 con 0x7f91480acfc0 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f913ffff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 0x7f9148153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.094+0000 7f914cdb4640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 0x7f9148155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f9147fff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f91380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913803a930 con 0x7f91480acfc0 2023-12-19T05:53:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913803aa90 con 0x7f91480acfc0 2023-12-19T05:53:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913803ae40 con 0x7f91480acfc0 2023-12-19T05:53:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9148153410 con 0x7f91480acfc0 2023-12-19T05:53:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.095+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91481539d0 con 0x7f91480acfc0 2023-12-19T05:53:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.096+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9148153bc0 con 0x7f91480acfc0 2023-12-19T05:53:20.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.097+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f913802f050 con 0x7f91480acfc0 2023-12-19T05:53:20.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.098+0000 7f91457fa640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.098+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91380aa340 con 0x7f91480acfc0 2023-12-19T05:53:20.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.099+0000 7f913ffff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.100+0000 7f913ffff640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 0x7f912806c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f914806e900 tx=0x7f9130009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.103+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9138075cc0 con 0x7f91480acfc0 2023-12-19T05:53:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.300+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f914806f290 con 0x7f912806a430 2023-12-19T05:53:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.302+0000 7f91457fa640 1 -- 172.21.15.49:0/696090685 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9130001c90 con 0x7f912806a430 2023-12-19T05:53:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T05:53:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 msgr2=0x7f912806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 0x7f912806c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f914806e900 tx=0x7f9130009040 comp rx=0 tx=0).stop 2023-12-19T05:53:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 msgr2=0x7f9148150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f91380046c0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 shutdown_connections 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f912806a430 0x7f912806c8f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f914815e3f0 0x7f9148155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91480b2460 0x7f9148153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 --2- 172.21.15.49:0/696090685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91480acfc0 0x7f9148150bd0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.304+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 >> 172.21.15.49:0/696090685 conn(0x7f91480b0100 msgr2=0x7f91480b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.305+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 shutdown_connections 2023-12-19T05:53:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.305+0000 7f914d5b5640 1 -- 172.21.15.49:0/696090685 wait complete. 2023-12-19T05:53:20.327 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T05:53:20.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.561+0000 7f495353e640 1 Processor -- start 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.561+0000 7f495353e640 1 -- start start 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f495353e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f494c0b1f90 0x7f494c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f495353e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c161a20 con 0x7f494c143570 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f495353e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c161d00 con 0x7f494c1402b0 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f495353e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c143150 con 0x7f494c0b1f90 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f4951adb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f494c0b1f90 0x7f494c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f4951adb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f494c0b1f90 0x7f494c070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35958/0 (socket says 172.21.15.49:35958) 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.563+0000 7f4951adb640 1 -- 172.21.15.49:0/3020542710 learned_addr learned my addr 172.21.15.49:0/3020542710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.564+0000 7f4951adb640 1 -- 172.21.15.49:0/3020542710 >> v1:172.21.15.115:6789/0 conn(0x7f494c1402b0 legacy=0x7f494c160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.564+0000 7f4951adb640 1 -- 172.21.15.49:0/3020542710 >> v1:172.21.15.49:6789/0 conn(0x7f494c143570 legacy=0x7f494c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.564+0000 7f4951adb640 1 -- 172.21.15.49:0/3020542710 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c142d70 con 0x7f494c0b1f90 2023-12-19T05:53:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.565+0000 7f4951adb640 1 --2- 172.21.15.49:0/3020542710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c0b1f90 0x7f494c070c90 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4944009e50 tx=0x7f494402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bede113bcf058051 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.565+0000 7f493ffff640 1 -- 172.21.15.49:0/3020542710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494402cb10 con 0x7f494c0b1f90 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f493ffff640 1 -- 172.21.15.49:0/3020542710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494402cc70 con 0x7f494c0b1f90 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f493ffff640 1 -- 172.21.15.49:0/3020542710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49440343f0 con 0x7f494c0b1f90 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 -- 172.21.15.49:0/3020542710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c0b1f90 msgr2=0x7f494c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 --2- 172.21.15.49:0/3020542710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c0b1f90 0x7f494c070c90 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4944009e50 tx=0x7f494402bf70 comp rx=0 tx=0).stop 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 -- 172.21.15.49:0/3020542710 shutdown_connections 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 --2- 172.21.15.49:0/3020542710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c0b1f90 0x7f494c070c90 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 -- 172.21.15.49:0/3020542710 >> 172.21.15.49:0/3020542710 conn(0x7f494c0cf230 msgr2=0x7f494c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 -- 172.21.15.49:0/3020542710 shutdown_connections 2023-12-19T05:53:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.566+0000 7f495353e640 1 -- 172.21.15.49:0/3020542710 wait complete. 2023-12-19T05:53:20.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.568+0000 7f495353e640 1 Processor -- start 2023-12-19T05:53:20.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.568+0000 7f495353e640 1 -- start start 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f494c0b1f90 0x7f494c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 0x7f494c13c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f494c143570 0x7f494c0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0af010 con 0x7f494c1402b0 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0cbd40 con 0x7f494c143570 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.569+0000 7f495353e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0cc020 con 0x7f494c0b1f90 2023-12-19T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 0x7f494c13c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 0x7f494c13c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35960/0 (socket says 172.21.15.49:35960) 2023-12-19T05:53:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 -- 172.21.15.49:0/3373670028 learned_addr learned my addr 172.21.15.49:0/3373670028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4951adb640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f494c143570 0x7f494c0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 -- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f494c0b1f90 msgr2=0x7f494c1f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f494c0b1f90 0x7f494c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 -- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f494c143570 msgr2=0x7f494c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f494c143570 0x7f494c0ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009b30 con 0x7f494c1402b0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.570+0000 7f4950ad9640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 0x7f494c13c8e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f494800c400 tx=0x7f494800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.571+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480052d0 con 0x7f494c1402b0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.571+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948005430 con 0x7f494c1402b0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.571+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0cc300 con 0x7f494c1402b0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.571+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948003830 con 0x7f494c1402b0 2023-12-19T05:53:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.571+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c1f3460 con 0x7f494c1402b0 2023-12-19T05:53:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.572+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f494c0cbeb0 con 0x7f494c1402b0 2023-12-19T05:53:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.573+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4948003990 con 0x7f494c1402b0 2023-12-19T05:53:20.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.574+0000 7f493dffb640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493006a460 0x7f493006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.574+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4948087c50 con 0x7f494c1402b0 2023-12-19T05:53:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.574+0000 7f493dffb640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7f49300702c0 0x7f49300726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.574+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4930072d90 con 0x7f49300702c0 2023-12-19T05:53:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.574+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x7f494808c2a0 con 0x7f494c1402b0 2023-12-19T05:53:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.575+0000 7f49512da640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493006a460 0x7f493006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.575+0000 7f4951adb640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7f49300702c0 0x7f49300726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.576+0000 7f49512da640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493006a460 0x7f493006c920 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4940000f60 tx=0x7f49400079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.576+0000 7f4951adb640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7f49300702c0 0x7f49300726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.578+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== osd.7 v2:172.21.15.115:6824/84475 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f4930072d90 con 0x7f49300702c0 2023-12-19T05:53:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.591+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 --> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f494c1616e0 con 0x7f49300702c0 2023-12-19T05:53:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.592+0000 7f493dffb640 1 -- 172.21.15.49:0/3373670028 <== osd.7 v2:172.21.15.115:6824/84475 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f494402cb00 con 0x7f49300702c0 2023-12-19T05:53:20.594 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-19T05:53:20.594 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-19T05:53:20.594 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7f49300702c0 msgr2=0x7f49300726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6824/84475,v1:172.21.15.115:6825/84475] conn(0x7f49300702c0 0x7f49300726e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493006a460 msgr2=0x7f493006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f493006a460 0x7f493006c920 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4940000f60 tx=0x7f49400079b0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 msgr2=0x7f494c13c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 --2- 172.21.15.49:0/3373670028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f494c1402b0 0x7f494c13c8e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f494800c400 tx=0x7f494800c8c0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f4951adb640 1 -- 172.21.15.49:0/3373670028 reap_dead start 2023-12-19T05:53:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 shutdown_connections 2023-12-19T05:53:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 >> 172.21.15.49:0/3373670028 conn(0x7f494c0cf230 msgr2=0x7f494c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 shutdown_connections 2023-12-19T05:53:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.593+0000 7f495353e640 1 -- 172.21.15.49:0/3373670028 wait complete. 2023-12-19T05:53:20.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T05:53:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.833+0000 7f9e15dce640 1 Processor -- start 2023-12-19T05:53:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.833+0000 7f9e15dce640 1 -- start start 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e15dce640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e1006e4d0 0x7f9e10070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e15dce640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9e100b2270 0x7f9e1015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e15dce640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e100ce6e0 con 0x7f9e1015a720 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e15dce640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1006e8b0 con 0x7f9e100b2270 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e15dce640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e10070c60 con 0x7f9e1006e4d0 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e155cd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9e100b2270 0x7f9e1015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e155cd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9e100b2270 0x7f9e1015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35976/0 (socket says 172.21.15.49:35976) 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e155cd640 1 -- 172.21.15.49:0/3211384479 learned_addr learned my addr 172.21.15.49:0/3211384479 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.836+0000 7f9e14dcc640 1 --2- 172.21.15.49:0/3211384479 >> v2:172.21.15.115:3300/0 conn(0x7f9e1006e4d0 0x7f9e10070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.837+0000 7f9e155cd640 1 -- 172.21.15.49:0/3211384479 >> v2:172.21.15.115:3300/0 conn(0x7f9e1006e4d0 msgr2=0x7f9e10070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.837+0000 7f9e155cd640 1 --2- 172.21.15.49:0/3211384479 >> v2:172.21.15.115:3300/0 conn(0x7f9e1006e4d0 0x7f9e10070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.837+0000 7f9e155cd640 1 -- 172.21.15.49:0/3211384479 >> v1:172.21.15.115:6789/0 conn(0x7f9e1015a720 legacy=0x7f9e100b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.837+0000 7f9e155cd640 1 -- 172.21.15.49:0/3211384479 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10070f40 con 0x7f9e100b2270 2023-12-19T05:53:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.838+0000 7f9e155cd640 1 --2- 172.21.15.49:0/3211384479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e100b2270 0x7f9e1015ae70 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9e100b2870 tx=0x7f9e0802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47060aac9f68ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.838+0000 7f9e0f7fe640 1 -- 172.21.15.49:0/3211384479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0802cb20 con 0x7f9e100b2270 2023-12-19T05:53:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.838+0000 7f9e0f7fe640 1 -- 172.21.15.49:0/3211384479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0802cc80 con 0x7f9e100b2270 2023-12-19T05:53:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.838+0000 7f9e0f7fe640 1 -- 172.21.15.49:0/3211384479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080343f0 con 0x7f9e100b2270 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 -- 172.21.15.49:0/3211384479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e100b2270 msgr2=0x7f9e1015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 --2- 172.21.15.49:0/3211384479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e100b2270 0x7f9e1015ae70 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9e100b2870 tx=0x7f9e0802bf80 comp rx=0 tx=0).stop 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 -- 172.21.15.49:0/3211384479 shutdown_connections 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 --2- 172.21.15.49:0/3211384479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e100b2270 0x7f9e1015ae70 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 --2- 172.21.15.49:0/3211384479 >> v2:172.21.15.115:3300/0 conn(0x7f9e1006e4d0 0x7f9e10070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 -- 172.21.15.49:0/3211384479 >> 172.21.15.49:0/3211384479 conn(0x7f9e100cfd80 msgr2=0x7f9e100cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.839+0000 7f9e15dce640 1 -- 172.21.15.49:0/3211384479 shutdown_connections 2023-12-19T05:53:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.840+0000 7f9e15dce640 1 -- 172.21.15.49:0/3211384479 wait complete. 2023-12-19T05:53:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.841+0000 7f9e15dce640 1 Processor -- start 2023-12-19T05:53:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.842+0000 7f9e15dce640 1 -- start start 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.842+0000 7f9e15dce640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 0x7f9e100cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e15dce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 0x7f9e10146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e15dce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e15dce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10151120 con 0x7f9e1015a720 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e15dce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10150510 con 0x7f9e100b2270 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e15dce640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101507f0 con 0x7f9e1006e4d0 2023-12-19T05:53:20.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35980/0 (socket says 172.21.15.49:35980) 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 -- 172.21.15.49:0/4132837937 learned_addr learned my addr 172.21.15.49:0/4132837937 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e14dcc640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 0x7f9e100cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e0ffff640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 0x7f9e10146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 -- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 msgr2=0x7f9e100cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 0x7f9e100cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 -- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 msgr2=0x7f9e10146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 0x7f9e10146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e155cd640 1 -- 172.21.15.49:0/4132837937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08009b30 con 0x7f9e1015a720 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.843+0000 7f9e14dcc640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 0x7f9e100cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:20.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e0ffff640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 0x7f9e10146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e155cd640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f9e08036040 tx=0x7f9e08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08009510 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0802c920 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0803e690 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e10150ad0 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.844+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e100cba50 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.846+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e101512d0 con 0x7f9e1015a720 2023-12-19T05:53:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.847+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e0803e7f0 con 0x7f9e1015a720 2023-12-19T05:53:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.847+0000 7f9e0d7fa640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 0x7f9df406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:20.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.848+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9e080ab0d0 con 0x7f9e1015a720 2023-12-19T05:53:20.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.848+0000 7f9e14dcc640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 0x7f9df406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:20.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.849+0000 7f9e14dcc640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 0x7f9df406c920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009ac0 tx=0x7f9e04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:20.852+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e101512d0 con 0x7f9e1015a720 2023-12-19T05:53:21.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.045+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e10150960 con 0x7f9df406a460 2023-12-19T05:53:21.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.047+0000 7f9e0d7fa640 1 -- 172.21.15.49:0/4132837937 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9e10150960 con 0x7f9df406a460 2023-12-19T05:53:21.049 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.049+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 msgr2=0x7f9df406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.049+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 0x7f9df406c920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009ac0 tx=0x7f9e04008040 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.049+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 msgr2=0x7f9e1014ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.049+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f9e08036040 tx=0x7f9e08004a40 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.049+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 shutdown_connections 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f9df406a460 0x7f9df406c920 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e1015a720 0x7f9e1014ee40 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e100b2270 0x7f9e10146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 --2- 172.21.15.49:0/4132837937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e1006e4d0 0x7f9e100cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 >> 172.21.15.49:0/4132837937 conn(0x7f9e100cfd80 msgr2=0x7f9e100b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 shutdown_connections 2023-12-19T05:53:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.050+0000 7f9e15dce640 1 -- 172.21.15.49:0/4132837937 wait complete. 2023-12-19T05:53:21.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:53:21.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.305+0000 7efc759c4640 1 Processor -- start 2023-12-19T05:53:21.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.305+0000 7efc759c4640 1 -- start start 2023-12-19T05:53:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.307+0000 7efc759c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc70146e30 0x7efc700b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.307+0000 7efc759c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700d0c60 0x7efc7015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc759c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700d12d0 con 0x7efc700b7ea0 2023-12-19T05:53:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc759c4640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc70147210 con 0x7efc70146e30 2023-12-19T05:53:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc759c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700b8330 con 0x7efc700d0c60 2023-12-19T05:53:21.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc67fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc700b7ea0 0x7efc700d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52578/0 (socket says 172.21.15.49:52578) 2023-12-19T05:53:21.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc67fff640 1 -- 172.21.15.49:0/2866340562 learned_addr learned my addr 172.21.15.49:0/2866340562 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc749c2640 1 --2- 172.21.15.49:0/2866340562 >> v2:172.21.15.115:3300/0 conn(0x7efc70146e30 0x7efc700b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.308+0000 7efc751c3640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700d0c60 0x7efc7015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc677fe640 1 -- 172.21.15.49:0/2866340562 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579771009 0 0) 0x7efc700d12d0 con 0x7efc700b7ea0 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc677fe640 1 -- 172.21.15.49:0/2866340562 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc58003520 con 0x7efc700b7ea0 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc749c2640 1 -- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700d0c60 msgr2=0x7efc7015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc749c2640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700d0c60 0x7efc7015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc749c2640 1 -- 172.21.15.49:0/2866340562 >> v1:172.21.15.49:6789/0 conn(0x7efc700b7ea0 legacy=0x7efc700d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.309+0000 7efc749c2640 1 -- 172.21.15.49:0/2866340562 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700d15b0 con 0x7efc70146e30 2023-12-19T05:53:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.310+0000 7efc749c2640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc700b7960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0097a0 tx=0x7efc6c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c85ce45773bf1f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.311+0000 7efc677fe640 1 -- 172.21.15.49:0/2866340562 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c031780 con 0x7efc70146e30 2023-12-19T05:53:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.311+0000 7efc677fe640 1 -- 172.21.15.49:0/2866340562 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0318e0 con 0x7efc70146e30 2023-12-19T05:53:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.311+0000 7efc677fe640 1 -- 172.21.15.49:0/2866340562 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c031c70 con 0x7efc70146e30 2023-12-19T05:53:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.311+0000 7efc759c4640 1 -- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 msgr2=0x7efc700b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.311+0000 7efc759c4640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc700b7960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0097a0 tx=0x7efc6c02b820 comp rx=0 tx=0).stop 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 -- 172.21.15.49:0/2866340562 shutdown_connections 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700d0c60 0x7efc7015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 --2- 172.21.15.49:0/2866340562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc700b7960 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 -- 172.21.15.49:0/2866340562 >> 172.21.15.49:0/2866340562 conn(0x7efc700b2990 msgr2=0x7efc700b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 -- 172.21.15.49:0/2866340562 shutdown_connections 2023-12-19T05:53:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.312+0000 7efc759c4640 1 -- 172.21.15.49:0/2866340562 wait complete. 2023-12-19T05:53:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.314+0000 7efc759c4640 1 Processor -- start 2023-12-19T05:53:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.314+0000 7efc759c4640 1 -- start start 2023-12-19T05:53:21.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700b7ea0 0x7efc7013db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc701d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7013e0c0 con 0x7efc700d0c60 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70141a50 con 0x7efc70146e30 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc759c4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc70141d30 con 0x7efc700b7ea0 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc67fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc67fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35984/0 (socket says 172.21.15.49:35984) 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc67fff640 1 -- 172.21.15.49:0/2823188086 learned_addr learned my addr 172.21.15.49:0/2823188086 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc749c2640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700b7ea0 0x7efc7013db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc751c3640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc701d54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.315+0000 7efc67fff640 1 -- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700b7ea0 msgr2=0x7efc7013db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc67fff640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700b7ea0 0x7efc7013db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc67fff640 1 -- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 msgr2=0x7efc701d54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc67fff640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc701d54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc67fff640 1 -- 172.21.15.49:0/2823188086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009400 con 0x7efc700d0c60 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc751c3640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc701d54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc67fff640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7efc6000c410 tx=0x7efc6000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:21.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60005ce0 con 0x7efc700d0c60 2023-12-19T05:53:21.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc60005e40 con 0x7efc700d0c60 2023-12-19T05:53:21.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600072f0 con 0x7efc700d0c60 2023-12-19T05:53:21.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70142010 con 0x7efc700d0c60 2023-12-19T05:53:21.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.316+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc701425d0 con 0x7efc700d0c60 2023-12-19T05:53:21.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.318+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc701427c0 con 0x7efc700d0c60 2023-12-19T05:53:21.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.319+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc60007510 con 0x7efc700d0c60 2023-12-19T05:53:21.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.319+0000 7efc657fa640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 0x7efc5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:21.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.320+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc60087db0 con 0x7efc700d0c60 2023-12-19T05:53:21.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.320+0000 7efc749c2640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 0x7efc5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:21.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.321+0000 7efc749c2640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 0x7efc5c06c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.324+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc6008c070 con 0x7efc700d0c60 2023-12-19T05:53:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.515+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc700d10b0 con 0x7efc5c06a430 2023-12-19T05:53:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.522+0000 7efc657fa640 1 -- 172.21.15.49:0/2823188086 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47664 (secure 0 0 0) 0x7efc6c031a50 con 0x7efc5c06a430 2023-12-19T05:53:21.524 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:21.525 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 msgr2=0x7efc5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 0x7efc5c06c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c03d040 comp rx=0 tx=0).stop 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 msgr2=0x7efc700c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7efc6000c410 tx=0x7efc6000c8d0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 shutdown_connections 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7efc5c06a430 0x7efc5c06c8f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc70146e30 0x7efc701d54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc700d0c60 0x7efc700c8980 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 --2- 172.21.15.49:0/2823188086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc700b7ea0 0x7efc7013db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.524+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 >> 172.21.15.49:0/2823188086 conn(0x7efc700b2990 msgr2=0x7efc70145ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.525+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 shutdown_connections 2023-12-19T05:53:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:21.525+0000 7efc759c4640 1 -- 172.21.15.49:0/2823188086 wait complete. 2023-12-19T05:53:21.547 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":628,"stamp":"2023-12-19T05:53:20.810110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10096,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552403,"statfs":{"total":1600000000,"available":1589661688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003311"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-12-19T05:53:08.673372+0000","last_change":"2023-12-19T05:38:54.205138+0000","last_active":"2023-12-19T05:53:08.673372+0000","last_peered":"2023-12-19T05:53:08.673372+0000","last_clean":"2023-12-19T05:53:08.673372+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:53:08.673372+0000","last_undegraded":"2023-12-19T05:53:08.673372+0000","last_fullsized":"2023-12-19T05:53:08.673372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:52.954345+0000","last_clean_scrub_stamp":"2023-12-19T05:38:52.954345+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.083,"15min":1.0920000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5329999999999999,"5min":1.635,"15min":6.4429999999999996},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.63300000000000001},"max":{"1min":1.7669999999999999,"5min":1.768,"15min":3.976},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.175,"15min":1.163},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":6.399},"last":1.23},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1759999999999999},"min":{"1min":0.754,"5min":0.70199999999999996,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.74,"15min":4.25},"last":1.0620000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2190000000000001,"15min":1.216},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"max":{"1min":1.4890000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.129},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.64500000000000002},"max":{"1min":1.5860000000000001,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":1.093}]},{"osd":3,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3149999999999999,"15min":1.284},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.622},"max":{"1min":1.6719999999999999,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":1.581},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.82399999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":1.486}]},{"osd":4,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.157,"15min":1.1459999999999999},"min":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":2.081,"5min":2.081,"15min":2.9980000000000002},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2869999999999999,"15min":1.3009999999999999},"min":{"1min":0.59299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.907,"5min":1.907,"15min":6.4850000000000003},"last":1.641}]},{"osd":5,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.319,"15min":1.3420000000000001},"min":{"1min":0.68600000000000005,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.722,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3200000000000001,"15min":1.3080000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55600000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":3.1909999999999998},"last":1.29}]},{"osd":6,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.464,"15min":1.4470000000000001},"min":{"1min":0.79200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8779999999999999,"5min":1.883,"15min":3.0920000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.458,"15min":1.48},"min":{"1min":0.69599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.032,"5min":2.032,"15min":7.7519999999999998},"last":1.7450000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1060000000000001,"15min":1.0640000000000001},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2989999999999999,"15min":1.2170000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":5.8250000000000002,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3440000000000001,"15min":1.2869999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.2}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.1950000000000001,"15min":1.1739999999999999},"min":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2390000000000001,"15min":1.242},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.71,"5min":1.879,"15min":3.5859999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.72899999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.089,"5min":2.089,"15min":4.5220000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.2769999999999999,"15min":1.2989999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.59399999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":4.452},"last":0.96199999999999997}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2170000000000001,"15min":1.248},"min":{"1min":0.73299999999999998,"5min":0.65900000000000003,"15min":0.48899999999999999},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.21,"15min":1.282},"min":{"1min":0.83899999999999997,"5min":0.748,"15min":0.46100000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3069999999999999,"15min":1.4039999999999999},"min":{"1min":0.96699999999999997,"5min":0.60699999999999998,"15min":0.53900000000000003},"max":{"1min":3.5859999999999999,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.48,"15min":1.534},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.63400000000000001},"max":{"1min":1.7490000000000001,"5min":2.2069999999999999,"15min":3.681},"last":1.2869999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.419,"15min":1.4399999999999999},"min":{"1min":0.93899999999999995,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":1.361},{"interface":"front","average":{"1min":1.595,"5min":1.528,"15min":1.556},"min":{"1min":0.92200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.117,"5min":3.117,"15min":4.7480000000000002},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0920000000000001,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.59499999999999997,"15min":0.44800000000000001},"max":{"1min":1.677,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1240000000000001,"15min":1.1140000000000001},"min":{"1min":0.80800000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.625,"5min":1.625,"15min":2.641},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.218},"min":{"1min":0.86099999999999999,"5min":0.622,"15min":0.56299999999999994},"max":{"1min":1.5089999999999999,"5min":1.635,"15min":3.9540000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.83399999999999996,"5min":0.68100000000000005,"15min":0.65600000000000003},"max":{"1min":1.738,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.028}]},{"osd":2,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.85799999999999998,"5min":0.65500000000000003,"15min":0.61199999999999999},"max":{"1min":1.4850000000000001,"5min":1.752,"15min":2.5550000000000002},"last":1.044},{"interface":"front","average":{"1min":1.284,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.86299999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2549999999999999,"15min":1.3340000000000001},"min":{"1min":0.91900000000000004,"5min":0.71299999999999997,"15min":0.61899999999999999},"max":{"1min":1.946,"5min":1.946,"15min":6.9969999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.345},"min":{"1min":0.96899999999999997,"5min":0.78700000000000003,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.9950000000000001,"15min":2.992},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2350000000000001,"15min":1.3200000000000001},"min":{"1min":0.92600000000000005,"5min":0.65300000000000002,"15min":0.55600000000000005},"max":{"1min":1.5409999999999999,"5min":1.819,"15min":6.3559999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.319,"15min":1.4099999999999999},"min":{"1min":0.84999999999999998,"5min":0.73699999999999999,"15min":0.52700000000000002},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.306,"15min":1.3919999999999999},"min":{"1min":0.91700000000000004,"5min":0.629,"15min":0.53000000000000003},"max":{"1min":1.621,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.47},"min":{"1min":0.999,"5min":0.755,"15min":0.67100000000000004},"max":{"1min":1.649,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Dec 19 05:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4710000000000001,"15min":1.5620000000000001},"min":{"1min":1.149,"5min":0.80300000000000005,"15min":0.68200000000000005},"max":{"1min":1.984,"5min":2.2549999999999999,"15min":7.0949999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5049999999999999,"15min":1.5569999999999999},"min":{"1min":1.252,"5min":0.85899999999999999,"15min":0.53200000000000003},"max":{"1min":1.804,"5min":2.3639999999999999,"15min":3.1739999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.081,"15min":1.0509999999999999},"min":{"1min":0.748,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.694,"5min":1.694,"15min":3.5760000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.131,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.61899999999999999},"max":{"1min":1.4970000000000001,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.94599999999999995}]},{"osd":1,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.147,"15min":1.1020000000000001},"min":{"1min":0.80300000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.1779999999999999},"min":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.61599999999999999},"max":{"1min":2.206,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.86299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.21},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.331,"15min":1.268},"min":{"1min":1.02,"5min":0.79900000000000004,"15min":0.45600000000000002},"max":{"1min":2.1110000000000002,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":1.288}]},{"osd":3,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.1839999999999999},"min":{"1min":0.82299999999999995,"5min":0.74199999999999999,"15min":0.57599999999999996},"max":{"1min":1.722,"5min":1.722,"15min":4.1079999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.276,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":1.7709999999999999,"15min":1.8819999999999999},"last":1.3009999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.363,"15min":1.359},"min":{"1min":1.2490000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.179},{"interface":"front","average":{"1min":1.427,"5min":1.401,"15min":1.373},"min":{"1min":1.2350000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.147}]},{"osd":6,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.3740000000000001},"min":{"1min":1.01,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8169999999999999,"5min":2.0529999999999999,"15min":2.161},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":1.0920000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.4259999999999999,"15min":1.423},"min":{"1min":1.085,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.875,"5min":1.964,"15min":5.484},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4970000000000001,"15min":1.4870000000000001},"min":{"1min":1.194,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0489999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.49}]}]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.314},"max":{"1min":1.23,"5min":1.8220000000000001,"15min":1.99},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.98799999999999999,"15min":0.91900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":1.5600000000000001,"5min":1.6060000000000001,"15min":1.72},"last":1.1899999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.995,"15min":0.93300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.34599999999999997},"max":{"1min":1.4550000000000001,"5min":2.2519999999999998,"15min":2.702},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1399999999999999,"15min":1.0620000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.39100000000000001},"max":{"1min":1.665,"5min":2.004,"15min":2.3650000000000002},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.212,"15min":1.093},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.716,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.218},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45600000000000002},"max":{"1min":1.857,"5min":2.2469999999999999,"15min":2.931},"last":0.754}]},{"osd":4,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.27,"15min":1.202},"min":{"1min":0.81499999999999995,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.8939999999999999,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.141},{"interface":"front","average":{"1min":1.425,"5min":1.387,"15min":1.321},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.59499999999999997},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.5859999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.476,"15min":1.3899999999999999},"min":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.67300000000000004},"max":{"1min":2.415,"5min":2.415,"15min":4.8440000000000003},"last":1.103},{"interface":"front","average":{"1min":1.496,"5min":1.46,"15min":1.4039999999999999},"min":{"1min":0.98899999999999999,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":1.9259999999999999,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":0.98799999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5049999999999999,"15min":1.4399999999999999},"min":{"1min":0.93600000000000005,"5min":0.79600000000000004,"15min":0.71499999999999997},"max":{"1min":1.9970000000000001,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3939999999999999,"15min":1.355},"min":{"1min":0.86099999999999999,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.909,"5min":1.909,"15min":2.1859999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.002,"5min":0.89300000000000002,"15min":0.55800000000000005},"max":{"1min":1.98,"5min":2.0339999999999998,"15min":2.1509999999999998},"last":1.083},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5509999999999999,"15min":1.47},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.70099999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.8900000000000001},"last":1.2669999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.84199999999999997},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.27800000000000002},"max":{"1min":1.256,"5min":3.407,"15min":3.407},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":0.95499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.581,"5min":1.764,"15min":1.9450000000000001},"last":0.65700000000000003}]},{"osd":1,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.153,"15min":1.1100000000000001},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.544,"5min":3.476,"15min":3.476},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.26,"15min":1.206},"min":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6359999999999999,"5min":1.8580000000000001,"15min":1.927},"last":1.226}]},{"osd":3,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.5760000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.252,"15min":1.1879999999999999},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.7829999999999999,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":0.95999999999999996}]},{"osd":4,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.423,"15min":1.355},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.52700000000000002},"max":{"1min":1.6870000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.47},{"interface":"front","average":{"1min":1.329,"5min":1.323,"15min":1.298},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65100000000000002},"max":{"1min":1.9279999999999999,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.641}]},{"osd":5,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4019999999999999,"15min":1.3560000000000001},"min":{"1min":0.83199999999999996,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.7090000000000001,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.72699999999999998},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.5960000000000001},"last":1.276}]},{"osd":6,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.385,"15min":1.3340000000000001},"min":{"1min":0.92100000000000004,"5min":0.80500000000000005,"15min":0.67700000000000005},"max":{"1min":1.831,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.353},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.528,"15min":1.452},"min":{"1min":0.97599999999999998,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.877,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.5}]},{"osd":7,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.506,"15min":1.4770000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4890000000000001,"15min":1.474},"min":{"1min":0.96699999999999997,"5min":0.84599999999999997,"15min":0.71499999999999997},"max":{"1min":1.964,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.5169999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2669999999999999,"5min":1.4059999999999999,"15min":2.992},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.94799999999999995},"min":{"1min":0.59499999999999997,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.421,"5min":1.665,"15min":2.2789999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1339999999999999,"15min":1.3500000000000001},"min":{"1min":0.60099999999999998,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.304}]},{"osd":3,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3839999999999999,"15min":1.339},"min":{"1min":0.65700000000000003,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.964,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.143},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.224,"15min":1.2290000000000001},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.708,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":0.81699999999999995}]},{"osd":4,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.278,"15min":1.2729999999999999},"min":{"1min":0.85299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.893,"15min":5.3860000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7629999999999999,"5min":1.974,"15min":4.306},"last":1.377}]},{"osd":5,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3200000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6819999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.234},{"interface":"front","average":{"1min":1.456,"5min":1.383,"15min":1.3879999999999999},"min":{"1min":1.079,"5min":0.73399999999999999,"15min":0.67900000000000005},"max":{"1min":1.9390000000000001,"5min":2.0369999999999999,"15min":5.4569999999999999},"last":1.095}]},{"osd":6,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4179999999999999,"15min":1.452},"min":{"1min":0.80100000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7549999999999999,"5min":1.968,"15min":5.1429999999999998},"last":1.327},{"interface":"front","average":{"1min":1.476,"5min":1.4830000000000001,"15min":1.4630000000000001},"min":{"1min":1.036,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":2.081,"5min":2.1880000000000002,"15min":3.75},"last":1.2749999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5369999999999999,"15min":1.5600000000000001},"min":{"1min":1.093,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.982,"5min":2.089,"15min":8.4039999999999999},"last":1.427},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5669999999999999,"15min":1.599},"min":{"1min":0.83599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.397}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.99099999999999999,"15min":0.877},"min":{"1min":0.63,"5min":0.34300000000000003,"15min":0.33100000000000002},"max":{"1min":14.063000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":1.7789999999999999,"5min":1.806,"15min":2.0459999999999998},"last":0.68799999999999994}]},{"osd":2,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.294,"15min":1.143},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":14.003,"5min":14.003,"15min":14.003},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3149999999999999,"15min":1.196},"min":{"1min":0.71999999999999997,"5min":0.52100000000000002,"15min":0.42699999999999999},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":1.196}]},{"osd":3,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.089,"15min":0.96399999999999997},"min":{"1min":0.68899999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.3740000000000001,"15min":1.1819999999999999},"min":{"1min":0.71699999999999997,"5min":0.499,"15min":0.40899999999999997},"max":{"1min":14.725,"5min":14.725,"15min":14.725},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.353,"15min":1.244},"min":{"1min":0.84099999999999997,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3280000000000001},"min":{"1min":1.0940000000000001,"5min":0.79600000000000004,"15min":0.65100000000000002},"max":{"1min":1.8819999999999999,"5min":2.0209999999999999,"15min":2.149},"last":1.6559999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4319999999999999,"15min":1.3720000000000001},"min":{"1min":0.93500000000000005,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.8759999999999999,"5min":1.4910000000000001,"15min":1.373},"min":{"1min":0.99199999999999999,"5min":0.96699999999999997,"15min":0.67500000000000004},"max":{"1min":8.5830000000000002,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":1.6240000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.6539999999999999,"15min":1.4850000000000001},"min":{"1min":1.1559999999999999,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":13.949999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4419999999999999,"15min":1.359},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.72699999999999998},"max":{"1min":2.0190000000000001,"5min":2.395,"15min":2.395},"last":1.585}]},{"osd":7,"last update":"Tue Dec 19 05:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6140000000000001,"15min":1.5},"min":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.71899999999999997},"max":{"1min":2.2570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":1.915},{"interface":"front","average":{"1min":1.8500000000000001,"5min":1.5549999999999999,"15min":1.446},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.845}]}]}],"pool_statfs":[]}} 2023-12-19T05:53:21.550 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T05:38:52.954345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=5, tm_min=38, tm_sec=52, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=5, tm_min=53, tm_sec=14, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T05:53:21.551 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T05:53:29.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:29.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:41.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:53:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.798+0000 7fe24585b640 1 Processor -- start 2023-12-19T05:53:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.799+0000 7fe24585b640 1 -- start start 2023-12-19T05:53:41.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.800+0000 7fe24585b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2400b8070 0x7fe2400d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe24585b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400d12d0 con 0x7fe2400d0a90 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe24585b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400d15b0 con 0x7fe240146e30 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe24585b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe240147210 con 0x7fe2400b8070 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2400b8070 0x7fe2400d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2400b8070 0x7fe2400d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60012/0 (socket says 172.21.15.49:60012) 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 -- 172.21.15.49:0/2188530527 learned_addr learned my addr 172.21.15.49:0/2188530527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe24505a640 1 --1- 172.21.15.49:0/2188530527 >> v1:172.21.15.49:6789/0 conn(0x7fe2400d0a90 0x7fe24015d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48268/0 (socket says 172.21.15.49:48268) 2023-12-19T05:53:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 -- 172.21.15.49:0/2188530527 >> v1:172.21.15.115:6789/0 conn(0x7fe240146e30 legacy=0x7fe2400b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 -- 172.21.15.49:0/2188530527 >> v1:172.21.15.49:6789/0 conn(0x7fe2400d0a90 legacy=0x7fe24015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.801+0000 7fe237fff640 1 -- 172.21.15.49:0/2188530527 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400d1890 con 0x7fe2400b8070 2023-12-19T05:53:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe237fff640 1 --2- 172.21.15.49:0/2188530527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe2400d0550 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fe230009870 tx=0x7fe23002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf57d3e0a10b111 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe2377fe640 1 -- 172.21.15.49:0/2188530527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230031870 con 0x7fe2400b8070 2023-12-19T05:53:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe2377fe640 1 -- 172.21.15.49:0/2188530527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2300319d0 con 0x7fe2400b8070 2023-12-19T05:53:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe2377fe640 1 -- 172.21.15.49:0/2188530527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230031d60 con 0x7fe2400b8070 2023-12-19T05:53:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe24585b640 1 -- 172.21.15.49:0/2188530527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 msgr2=0x7fe2400d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.803+0000 7fe24585b640 1 --2- 172.21.15.49:0/2188530527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe2400d0550 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fe230009870 tx=0x7fe23002b910 comp rx=0 tx=0).stop 2023-12-19T05:53:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.804+0000 7fe24585b640 1 -- 172.21.15.49:0/2188530527 shutdown_connections 2023-12-19T05:53:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.804+0000 7fe24585b640 1 --2- 172.21.15.49:0/2188530527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe2400d0550 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.804+0000 7fe24585b640 1 -- 172.21.15.49:0/2188530527 >> 172.21.15.49:0/2188530527 conn(0x7fe2400b2990 msgr2=0x7fe2400b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.804+0000 7fe24585b640 1 -- 172.21.15.49:0/2188530527 shutdown_connections 2023-12-19T05:53:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.804+0000 7fe24585b640 1 -- 172.21.15.49:0/2188530527 wait complete. 2023-12-19T05:53:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.806+0000 7fe24585b640 1 Processor -- start 2023-12-19T05:53:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.806+0000 7fe24585b640 1 -- start start 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2400d0a90 0x7fe240141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 0x7fe24006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24013efc0 con 0x7fe2400b8070 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24013f2a0 con 0x7fe240146e30 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24585b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24013f580 con 0x7fe2400d0a90 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe244859640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe244859640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60018/0 (socket says 172.21.15.49:60018) 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe244859640 1 -- 172.21.15.49:0/878377421 learned_addr learned my addr 172.21.15.49:0/878377421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.807+0000 7fe24505a640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 0x7fe24006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 -- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2400d0a90 msgr2=0x7fe240141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2400d0a90 0x7fe240141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 -- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 msgr2=0x7fe24006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 0x7fe24006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 -- 172.21.15.49:0/878377421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2300094d0 con 0x7fe2400b8070 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe24505a640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 0x7fe24006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe244859640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ba50 tx=0x7fe23c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00cbe0 con 0x7fe2400b8070 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00cd80 con 0x7fe2400b8070 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24013f860 con 0x7fe2400b8070 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c014680 con 0x7fe2400b8070 2023-12-19T05:53:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.808+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2401de290 con 0x7fe2400b8070 2023-12-19T05:53:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.809+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24013fd80 con 0x7fe2400b8070 2023-12-19T05:53:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.811+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe23c0147e0 con 0x7fe2400b8070 2023-12-19T05:53:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.811+0000 7fe2357fa640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 0x7fe22c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.812+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe23c088460 con 0x7fe2400b8070 2023-12-19T05:53:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.812+0000 7fe237fff640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 0x7fe22c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:41.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.813+0000 7fe237fff640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 0x7fe22c06c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe230036000 tx=0x7fe230030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:41.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:41.816+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe24013fd80 con 0x7fe2400b8070 2023-12-19T05:53:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.008+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 --> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2400d1b70 con 0x7fe22c06a430 2023-12-19T05:53:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.014+0000 7fe2357fa640 1 -- 172.21.15.49:0/878377421 <== mgr.4106 v2:172.21.15.115:6832/83870 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47544 (secure 0 0 0) 0x7fe230031c40 con 0x7fe22c06a430 2023-12-19T05:53:42.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 msgr2=0x7fe22c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 0x7fe22c06c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe230036000 tx=0x7fe230030000 comp rx=0 tx=0).stop 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 msgr2=0x7fe24013e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ba50 tx=0x7fe23c00bf10 comp rx=0 tx=0).stop 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 shutdown_connections 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7fe22c06a430 0x7fe22c06c8f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2400d0a90 0x7fe240141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe240146e30 0x7fe24006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 --2- 172.21.15.49:0/878377421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400b8070 0x7fe24013e930 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 >> 172.21.15.49:0/878377421 conn(0x7fe2400b2990 msgr2=0x7fe2401e8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 shutdown_connections 2023-12-19T05:53:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.017+0000 7fe24585b640 1 -- 172.21.15.49:0/878377421 wait complete. 2023-12-19T05:53:42.040 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":638,"stamp":"2023-12-19T05:53:40.816059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10096,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552403,"statfs":{"total":1600000000,"available":1589661688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003773"},"pg_stats":[{"pgid":"1.0","version":"202'119","reported_seq":347,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-12-19T05:53:18.206353+0000","last_change":"2023-12-19T05:53:18.206510+0000","last_active":"2023-12-19T05:53:18.206353+0000","last_peered":"2023-12-19T05:53:18.206353+0000","last_clean":"2023-12-19T05:53:18.206353+0000","last_became_active":"2023-12-19T05:38:54.204650+0000","last_became_peered":"2023-12-19T05:38:54.204650+0000","last_unstale":"2023-12-19T05:53:18.206353+0000","last_undegraded":"2023-12-19T05:53:18.206353+0000","last_fullsized":"2023-12-19T05:53:18.206353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"202'119","last_scrub_stamp":"2023-12-19T05:53:18.206299+0000","last_deep_scrub":"202'119","last_deep_scrub_stamp":"2023-12-19T05:53:18.206299+0000","last_clean_scrub_stamp":"2023-12-19T05:53:18.206299+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:23.978094+0000","scrub_duration":0.0063409299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.083,"15min":1.0920000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5329999999999999,"5min":1.635,"15min":6.4429999999999996},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.63300000000000001},"max":{"1min":1.7669999999999999,"5min":1.768,"15min":3.976},"last":1.1160000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.175,"15min":1.163},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":6.399},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.169,"15min":1.1759999999999999},"min":{"1min":0.754,"5min":0.70199999999999996,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.74,"15min":4.25},"last":1.002}]},{"osd":2,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2190000000000001,"15min":1.216},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"max":{"1min":1.4890000000000001,"5min":1.6779999999999999,"15min":3.0249999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.129},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.64500000000000002},"max":{"1min":1.5860000000000001,"5min":1.6899999999999999,"15min":2.8250000000000002},"last":1.1499999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3149999999999999,"15min":1.284},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.622},"max":{"1min":1.6719999999999999,"5min":1.7949999999999999,"15min":6.5259999999999998},"last":1.254},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.82399999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":4.1529999999999996},"last":1.3300000000000001}]},{"osd":4,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.157,"15min":1.1459999999999999},"min":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.50800000000000001},"max":{"1min":2.081,"5min":2.081,"15min":2.9980000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2869999999999999,"15min":1.3009999999999999},"min":{"1min":0.59299999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.907,"5min":1.907,"15min":6.4850000000000003},"last":1.0629999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.319,"15min":1.3420000000000001},"min":{"1min":0.68600000000000005,"5min":0.52900000000000003,"15min":0.51400000000000001},"max":{"1min":1.722,"5min":2.0379999999999998,"15min":6.3099999999999996},"last":1.2},{"interface":"front","average":{"1min":1.335,"5min":1.3200000000000001,"15min":1.3080000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55600000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":3.1909999999999998},"last":1.2290000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.464,"15min":1.4470000000000001},"min":{"1min":0.79200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8779999999999999,"5min":1.883,"15min":3.0920000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.458,"15min":1.48},"min":{"1min":0.69599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.032,"5min":2.032,"15min":7.7519999999999998},"last":1.1830000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0660000000000001,"15min":1.075},"min":{"1min":0.72799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.528,"5min":1.5880000000000001,"15min":4.7000000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.095,"15min":1.0629999999999999},"min":{"1min":0.70799999999999996,"5min":0.56799999999999995,"15min":0.46500000000000002},"max":{"1min":1.458,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.123}]},{"osd":1,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.294,"15min":1.222},"min":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.64900000000000002},"max":{"1min":1.655,"5min":5.8250000000000002,"15min":5.8250000000000002},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.341,"15min":1.2809999999999999},"min":{"1min":0.82899999999999996,"5min":0.68799999999999994,"15min":0.61699999999999999},"max":{"1min":1.6359999999999999,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":1.4810000000000001}]},{"osd":2,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.214,"15min":1.175},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6799999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.095},{"interface":"front","average":{"1min":1.202,"5min":1.2430000000000001,"15min":1.232},"min":{"1min":0.89100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.421,"5min":1.879,"15min":3.5859999999999999},"last":1.373}]},{"osd":3,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.212,"15min":1.214},"min":{"1min":0.86699999999999999,"5min":0.72899999999999998,"15min":0.63100000000000001},"max":{"1min":1.6970000000000001,"5min":2.089,"15min":4.5220000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2749999999999999,"15min":1.2869999999999999},"min":{"1min":0.96199999999999997,"5min":0.86399999999999999,"15min":0.59399999999999997},"max":{"1min":1.5189999999999999,"5min":3.0630000000000002,"15min":4.452},"last":1.5089999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.226,"15min":1.238},"min":{"1min":0.73799999999999999,"5min":0.69899999999999995,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":1.036},{"interface":"front","average":{"1min":1.302,"5min":1.2430000000000001,"15min":1.2669999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.46100000000000002},"max":{"1min":1.7769999999999999,"5min":1.9670000000000001,"15min":4.6689999999999996},"last":1.2509999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.331,"15min":1.3879999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.53900000000000003},"max":{"1min":2.0179999999999998,"5min":3.5859999999999999,"15min":4.5670000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.4850000000000001,"15min":1.51},"min":{"1min":1.0029999999999999,"5min":0.89200000000000002,"15min":0.63400000000000001},"max":{"1min":1.7330000000000001,"5min":1.9370000000000001,"15min":3.681},"last":1.5720000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4419999999999999,"15min":1.4319999999999999},"min":{"1min":0.91600000000000004,"5min":0.63200000000000001,"15min":0.57599999999999996},"max":{"1min":1.78,"5min":2.0409999999999999,"15min":3.2719999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.544,"15min":1.55},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.55400000000000005},"max":{"1min":1.9319999999999999,"5min":3.117,"15min":4.7480000000000002},"last":1.6220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.079,"15min":1.105},"min":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.44800000000000001},"max":{"1min":1.5189999999999999,"5min":1.8759999999999999,"15min":6.9420000000000002},"last":1.448},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.129,"15min":1.111},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.436},"max":{"1min":1.5700000000000001,"5min":1.625,"15min":2.641},"last":0.95599999999999996}]},{"osd":1,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.242,"15min":1.2150000000000001},"min":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.56299999999999994},"max":{"1min":1.657,"5min":1.657,"15min":3.9540000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.286,"15min":1.3080000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.65600000000000003},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":6.8700000000000001},"last":1.5}]},{"osd":2,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1779999999999999,"15min":1.1819999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61199999999999999},"max":{"1min":1.421,"5min":1.752,"15min":2.5550000000000002},"last":1.123},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2490000000000001,"15min":1.2110000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.6759999999999999,"15min":2.8250000000000002},"last":1.353}]},{"osd":3,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2430000000000001,"15min":1.3129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.61899999999999999},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":6.9969999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.3049999999999999,"15min":1.329},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.56299999999999994},"max":{"1min":1.627,"5min":1.9950000000000001,"15min":2.992},"last":1.2709999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2589999999999999,"15min":1.2989999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":1.819,"15min":6.3559999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.28,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.52700000000000002},"max":{"1min":1.6419999999999999,"5min":1.9930000000000001,"15min":7.0469999999999997},"last":1.294}]},{"osd":6,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3200000000000001,"15min":1.3759999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.845,"5min":2.1179999999999999,"15min":3.1120000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3799999999999999,"15min":1.4399999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6819999999999999,"5min":1.7410000000000001,"15min":6.3579999999999997},"last":1.1679999999999999}]},{"osd":7,"last update":"Tue Dec 19 05:53:18 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.452,"15min":1.5349999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.829,"5min":1.986,"15min":7.0949999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.502,"15min":1.544},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.53200000000000003},"max":{"1min":1.9370000000000001,"5min":2.056,"15min":3.1739999999999999},"last":1.2130000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.087,"15min":1.0569999999999999},"min":{"1min":0.66600000000000004,"5min":0.65500000000000003,"15min":0.40400000000000003},"max":{"1min":1.5740000000000001,"5min":1.694,"15min":3.5760000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.143,"15min":1.121},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.61899999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":4.3630000000000004},"last":1.1850000000000001}]},{"osd":1,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.139,"15min":1.1020000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.63100000000000001},"max":{"1min":1.5880000000000001,"5min":1.6870000000000001,"15min":1.7410000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1950000000000001,"15min":1.1830000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.61599999999999999},"max":{"1min":1.698,"5min":2.206,"15min":4.3499999999999996},"last":1.0149999999999999}]},{"osd":2,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.228,"15min":1.206},"min":{"1min":0.86799999999999999,"5min":0.82299999999999995,"15min":0.66100000000000003},"max":{"1min":1.514,"5min":1.95,"15min":1.95},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.28,"15min":1.2689999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.45600000000000002},"max":{"1min":1.6080000000000001,"5min":2.1110000000000002,"15min":4.3200000000000003},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.238,"15min":1.1950000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.722,"15min":4.1079999999999997},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.323,"15min":1.3069999999999999},"min":{"1min":0.95599999999999996,"5min":0.93500000000000005,"15min":0.76500000000000001},"max":{"1min":1.508,"5min":1.7450000000000001,"15min":1.8819999999999999},"last":1.593}]},{"osd":5,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3680000000000001,"15min":1.3600000000000001},"min":{"1min":0.67000000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7529999999999999,"5min":1.7829999999999999,"15min":2.081},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.421,"15min":1.385},"min":{"1min":0.81999999999999995,"5min":0.67100000000000004,"15min":0.45100000000000001},"max":{"1min":1.79,"5min":2.0720000000000001,"15min":4.2160000000000002},"last":1.48}]},{"osd":6,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3740000000000001,"15min":1.3700000000000001},"min":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.47699999999999998},"max":{"1min":1.6200000000000001,"5min":1.8169999999999999,"15min":2.161},"last":1.524},{"interface":"front","average":{"1min":1.379,"5min":1.4390000000000001,"15min":1.4330000000000001},"min":{"1min":0.877,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7430000000000001,"5min":1.9970000000000001,"15min":3.7200000000000002},"last":1.115}]},{"osd":7,"last update":"Tue Dec 19 05:53:22 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4339999999999999,"15min":1.4299999999999999},"min":{"1min":0.93600000000000005,"5min":0.89500000000000002,"15min":0.49199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":5.484},"last":1.556},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4950000000000001,"15min":1.488},"min":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.53000000000000003},"max":{"1min":1.8859999999999999,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.6739999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.314},"max":{"1min":1.23,"5min":1.8220000000000001,"15min":1.99},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.98799999999999999,"15min":0.91900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":1.5600000000000001,"5min":1.6060000000000001,"15min":1.72},"last":1.5669999999999999}]},{"osd":1,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.995,"15min":0.93300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.34599999999999997},"max":{"1min":1.4550000000000001,"5min":2.2519999999999998,"15min":2.702},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.1399999999999999,"15min":1.0620000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.39100000000000001},"max":{"1min":1.665,"5min":2.004,"15min":2.3650000000000002},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.212,"15min":1.093},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.716,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.218},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45600000000000002},"max":{"1min":1.857,"5min":2.2469999999999999,"15min":2.931},"last":1.595}]},{"osd":4,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.27,"15min":1.202},"min":{"1min":0.81499999999999995,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.8939999999999999,"5min":1.8999999999999999,"15min":1.9430000000000001},"last":1.272},{"interface":"front","average":{"1min":1.425,"5min":1.387,"15min":1.321},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.59499999999999997},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.5859999999999999},"last":1.2390000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.476,"15min":1.3899999999999999},"min":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.67300000000000004},"max":{"1min":2.415,"5min":2.415,"15min":4.8440000000000003},"last":1.52},{"interface":"front","average":{"1min":1.496,"5min":1.46,"15min":1.4039999999999999},"min":{"1min":0.98899999999999999,"5min":0.86399999999999999,"15min":0.46500000000000002},"max":{"1min":1.9259999999999999,"5min":2.4860000000000002,"15min":4.4509999999999996},"last":1.462}]},{"osd":6,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5049999999999999,"15min":1.4399999999999999},"min":{"1min":0.93600000000000005,"5min":0.79600000000000004,"15min":0.71499999999999997},"max":{"1min":1.9970000000000001,"5min":2.3929999999999998,"15min":3.4300000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3939999999999999,"15min":1.355},"min":{"1min":0.86099999999999999,"5min":0.75900000000000001,"15min":0.69199999999999995},"max":{"1min":1.909,"5min":1.909,"15min":2.1859999999999999},"last":1.653}]},{"osd":7,"last update":"Tue Dec 19 05:53:12 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4630000000000001,"15min":1.423},"min":{"1min":1.002,"5min":0.89300000000000002,"15min":0.55800000000000005},"max":{"1min":1.98,"5min":2.0339999999999998,"15min":2.1509999999999998},"last":1.706},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5509999999999999,"15min":1.47},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.70099999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.8900000000000001},"last":1.677}]}]},{"osd":2,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.84199999999999997},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.27800000000000002},"max":{"1min":1.256,"5min":3.407,"15min":3.407},"last":1.4279999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":0.95499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.581,"5min":1.764,"15min":1.9450000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.153,"15min":1.1100000000000001},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.46000000000000002},"max":{"1min":1.544,"5min":3.476,"15min":3.476},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.26,"15min":1.206},"min":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6359999999999999,"5min":1.8580000000000001,"15min":1.927},"last":1.512}]},{"osd":3,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.34599999999999997},"max":{"1min":1.5760000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.252,"15min":1.1879999999999999},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.48199999999999998},"max":{"1min":1.7829999999999999,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.1339999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.423,"15min":1.355},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.52700000000000002},"max":{"1min":1.6870000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.323,"15min":1.298},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.65100000000000002},"max":{"1min":1.9279999999999999,"5min":2.0800000000000001,"15min":2.3370000000000002},"last":1.2330000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4019999999999999,"15min":1.3560000000000001},"min":{"1min":0.83199999999999996,"5min":0.82399999999999995,"15min":0.70299999999999996},"max":{"1min":1.7090000000000001,"5min":1.9430000000000001,"15min":1.9970000000000001},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3839999999999999,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.72699999999999998},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.5960000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.385,"15min":1.3340000000000001},"min":{"1min":0.92100000000000004,"5min":0.80500000000000005,"15min":0.67700000000000005},"max":{"1min":1.831,"5min":2.0539999999999998,"15min":2.0950000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.528,"15min":1.452},"min":{"1min":0.97599999999999998,"5min":0.88400000000000001,"15min":0.58599999999999997},"max":{"1min":1.877,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.661}]},{"osd":7,"last update":"Tue Dec 19 05:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.506,"15min":1.4770000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":2.1509999999999998,"15min":2.4350000000000001},"last":1.393},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4890000000000001,"15min":1.474},"min":{"1min":0.96699999999999997,"5min":0.84599999999999997,"15min":0.71499999999999997},"max":{"1min":1.964,"5min":2.2549999999999999,"15min":9.5359999999999996},"last":1.474}]}]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193618,"statfs":{"total":200000000,"available":198264935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57099999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":2.992},"last":0.753},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99199999999999999,"15min":0.997},"min":{"1min":0.57699999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.593,"5min":1.6830000000000001,"15min":3.5169999999999999},"last":0.92200000000000004}]},{"osd":2,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.95599999999999996,"15min":0.94099999999999995},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":1.444,"5min":1.665,"15min":2.2789999999999999},"last":1.252},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1399999999999999,"15min":1.3520000000000001},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.40999999999999998},"max":{"1min":1.556,"5min":1.8959999999999999,"15min":70.206000000000003},"last":1.175}]},{"osd":3,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3999999999999999,"15min":1.337},"min":{"1min":0.96499999999999997,"5min":0.53900000000000003,"15min":0.46100000000000002},"max":{"1min":1.76,"5min":2.1200000000000001,"15min":3.5670000000000002},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.246,"15min":1.222},"min":{"1min":0.64100000000000001,"5min":0.501,"15min":0.39400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7909999999999999,"15min":3.1920000000000002},"last":1.323}]},{"osd":4,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2649999999999999,"15min":1.2729999999999999},"min":{"1min":0.80900000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6180000000000001,"5min":1.893,"15min":5.3860000000000001},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.355,"15min":1.3799999999999999},"min":{"1min":0.92000000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.891,"5min":1.974,"15min":4.306},"last":1.4019999999999999}]},{"osd":5,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.339,"15min":1.363},"min":{"1min":1.0589999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"max":{"1min":1.5609999999999999,"5min":1.917,"15min":4.9880000000000004},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.367,"15min":1.387},"min":{"1min":0.84299999999999997,"5min":0.746,"15min":0.67900000000000005},"max":{"1min":1.609,"5min":1.9390000000000001,"15min":5.4569999999999999},"last":1.8100000000000001}]},{"osd":6,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.4330000000000001,"15min":1.4530000000000001},"min":{"1min":0.94199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6830000000000001,"5min":1.968,"15min":5.1429999999999998},"last":1.891},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.462,"15min":1.462},"min":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.70199999999999996},"max":{"1min":1.6950000000000001,"5min":2.081,"15min":3.75},"last":1.48}]},{"osd":7,"last update":"Tue Dec 19 05:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.026,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0350000000000001,"5min":2.089,"15min":8.4039999999999999},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.5760000000000001,"15min":1.5940000000000001},"min":{"1min":1.131,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.8979999999999999,"5min":2.1400000000000001,"15min":8.2390000000000008},"last":1.6970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198855303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.99399999999999999,"15min":0.879},"min":{"1min":0.60699999999999998,"5min":0.377,"15min":0.33100000000000002},"max":{"1min":1.1830000000000001,"5min":14.063000000000001,"15min":14.063000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.071,"15min":0.96299999999999997},"min":{"1min":0.68799999999999994,"5min":0.46600000000000003,"15min":0.373},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.97499999999999998}]},{"osd":2,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.298,"15min":1.145},"min":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.45300000000000001},"max":{"1min":1.8380000000000001,"5min":14.003,"15min":14.003},"last":1.014},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.341,"15min":1.206},"min":{"1min":0.72499999999999998,"5min":0.59499999999999997,"15min":0.42699999999999999},"max":{"1min":1.819,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":1.3879999999999999}]},{"osd":3,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.1080000000000001,"15min":0.97199999999999998},"min":{"1min":0.70699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3280000000000001,"5min":8.6560000000000006,"15min":8.6560000000000006},"last":1.133},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.419,"15min":1.198},"min":{"1min":0.90800000000000003,"5min":0.55700000000000005,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":14.725,"15min":14.725},"last":1.4319999999999999}]},{"osd":4,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3660000000000001,"15min":1.254},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.59499999999999997},"max":{"1min":1.8979999999999999,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.397,"15min":1.3380000000000001},"min":{"1min":1.099,"5min":0.82799999999999996,"15min":0.65100000000000002},"max":{"1min":1.669,"5min":1.8819999999999999,"15min":2.149},"last":1.3140000000000001}]},{"osd":5,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.3819999999999999},"min":{"1min":1.012,"5min":0.85899999999999999,"15min":0.63300000000000001},"max":{"1min":2.149,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.52,"15min":1.385},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.67500000000000004},"max":{"1min":1.804,"5min":8.5830000000000002,"15min":8.5830000000000002},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.6839999999999999,"15min":1.494},"min":{"1min":1.1890000000000001,"5min":0.77500000000000002,"15min":0.69299999999999995},"max":{"1min":1.9019999999999999,"5min":13.949999999999999,"15min":13.949999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.4730000000000001,"15min":1.377},"min":{"1min":1.264,"5min":0.78500000000000003,"15min":0.72699999999999998},"max":{"1min":2.2440000000000002,"5min":2.395,"15min":2.395},"last":1.7270000000000001}]},{"osd":7,"last update":"Tue Dec 19 05:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.6419999999999999,"15min":1.514},"min":{"1min":1.327,"5min":0.96799999999999997,"15min":0.71899999999999997},"max":{"1min":2.1989999999999998,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.601,"15min":1.458},"min":{"1min":1.1279999999999999,"5min":0.76600000000000001,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.4830000000000001}]}]}],"pool_statfs":[]}} 2023-12-19T05:53:42.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T05:53:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.265+0000 7f5996b62640 1 Processor -- start 2023-12-19T05:53:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.265+0000 7f5996b62640 1 -- start start 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f5996b62640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59900cc1a0 0x7f59900cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f5996b62640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900b2bc0 con 0x7f59900b2f70 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f5996b62640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900ceb50 con 0x7f5990157250 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f5996b62640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5990157630 con 0x7f59900cc1a0 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f599535f640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f59900b2f70 0x7f59900b24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48282/0 (socket says 172.21.15.49:48282) 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f599535f640 1 -- 172.21.15.49:0/1400671682 learned_addr learned my addr 172.21.15.49:0/1400671682 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-12-19T05:53:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.267+0000 7f5996361640 1 --2- 172.21.15.49:0/1400671682 >> v2:172.21.15.49:3300/0 conn(0x7f59900cc1a0 0x7f59900cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.268+0000 7f5994b5e640 1 -- 172.21.15.49:0/1400671682 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961728700 0 0) 0x7f598c001110 con 0x7f59900b2f70 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.268+0000 7f5994b5e640 1 -- 172.21.15.49:0/1400671682 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c003440 con 0x7f59900b2f70 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.268+0000 7f5996361640 1 -- 172.21.15.49:0/1400671682 >> v1:172.21.15.115:6789/0 conn(0x7f5990157250 legacy=0x7f599015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.268+0000 7f5996361640 1 -- 172.21.15.49:0/1400671682 >> v1:172.21.15.49:6789/0 conn(0x7f59900b2f70 legacy=0x7f59900b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.268+0000 7f5996361640 1 -- 172.21.15.49:0/1400671682 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900ccac0 con 0x7f59900cc1a0 2023-12-19T05:53:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.269+0000 7f5996361640 1 --2- 172.21.15.49:0/1400671682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59900cc1a0 0x7f59900cc580 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f598802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786c90625d45e7be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.269+0000 7f5994b5e640 1 -- 172.21.15.49:0/1400671682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598802cc60 con 0x7f59900cc1a0 2023-12-19T05:53:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5994b5e640 1 -- 172.21.15.49:0/1400671682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598802cdc0 con 0x7f59900cc1a0 2023-12-19T05:53:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5994b5e640 1 -- 172.21.15.49:0/1400671682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988034660 con 0x7f59900cc1a0 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 -- 172.21.15.49:0/1400671682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59900cc1a0 msgr2=0x7f59900cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 --2- 172.21.15.49:0/1400671682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59900cc1a0 0x7f59900cc580 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f598802beb0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 -- 172.21.15.49:0/1400671682 shutdown_connections 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 --2- 172.21.15.49:0/1400671682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59900cc1a0 0x7f59900cc580 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 -- 172.21.15.49:0/1400671682 >> 172.21.15.49:0/1400671682 conn(0x7f59900659a0 msgr2=0x7f5990065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 -- 172.21.15.49:0/1400671682 shutdown_connections 2023-12-19T05:53:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.270+0000 7f5996b62640 1 -- 172.21.15.49:0/1400671682 wait complete. 2023-12-19T05:53:42.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.272+0000 7f5996b62640 1 Processor -- start 2023-12-19T05:53:42.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.272+0000 7f5996b62640 1 -- start start 2023-12-19T05:53:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59900b2f70 0x7f599015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59900cc1a0 0x7f59900ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599014fe30 con 0x7f5990157250 2023-12-19T05:53:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990155b60 con 0x7f59900cc1a0 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.273+0000 7f5996b62640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599015cfd0 con 0x7f59900b2f70 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60046/0 (socket says 172.21.15.49:60046) 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 -- 172.21.15.49:0/596639405 learned_addr learned my addr 172.21.15.49:0/596639405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f599535f640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59900cc1a0 0x7f59900ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5995b60640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59900b2f70 0x7f599015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 -- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59900b2f70 msgr2=0x7f599015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59900b2f70 0x7f599015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 -- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59900cc1a0 msgr2=0x7f59900ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59900cc1a0 0x7f59900ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 -- 172.21.15.49:0/596639405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009a70 con 0x7f5990157250 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.274+0000 7f5996361640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f5988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.275+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988040650 con 0x7f5990157250 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.275+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59880407b0 con 0x7f5990157250 2023-12-19T05:53:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.275+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988040b60 con 0x7f5990157250 2023-12-19T05:53:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.275+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5990155880 con 0x7f5990157250 2023-12-19T05:53:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.275+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59900ae100 con 0x7f5990157250 2023-12-19T05:53:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.276+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990061910 con 0x7f5990157250 2023-12-19T05:53:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.277+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5988040cc0 con 0x7f5990157250 2023-12-19T05:53:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.278+0000 7f59827fc640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 0x7f597406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.278+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f59880ab370 con 0x7f5990157250 2023-12-19T05:53:42.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.279+0000 7f5995b60640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 0x7f597406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.280+0000 7f5995b60640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 0x7f597406c8f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5984000f60 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.282+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5988076d70 con 0x7f5990157250 2023-12-19T05:53:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.477+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f59900b1980 con 0x7f5990157250 2023-12-19T05:53:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.484+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5988076d70 con 0x7f5990157250 2023-12-19T05:53:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.484+0000 7f59827fc640 1 -- 172.21.15.49:0/596639405 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5988009450 con 0x7f5990157250 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 msgr2=0x7f597406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 0x7f597406c8f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5984000f60 tx=0x7f5984009040 comp rx=0 tx=0).stop 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 msgr2=0x7f599015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f5988004a40 comp rx=0 tx=0).stop 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 shutdown_connections 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f597406a430 0x7f597406c8f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5990157250 0x7f599015b8c0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59900cc1a0 0x7f59900ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 --2- 172.21.15.49:0/596639405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59900b2f70 0x7f599015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.487+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 >> 172.21.15.49:0/596639405 conn(0x7f59900659a0 msgr2=0x7f599006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.488+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 shutdown_connections 2023-12-19T05:53:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.488+0000 7f5996b62640 1 -- 172.21.15.49:0/596639405 wait complete. 2023-12-19T05:53:42.510 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:53:42.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:53:42.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.746+0000 7f0478c9f640 1 Processor -- start 2023-12-19T05:53:42.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.747+0000 7f0478c9f640 1 -- start start 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.748+0000 7f0478c9f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0474159f80 0x7f047406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.748+0000 7f0478c9f640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f047415b1e0 0x7f047415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.748+0000 7f0478c9f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047406b520 con 0x7f047415a8a0 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.748+0000 7f0478c9f640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04740b2b20 con 0x7f047415b1e0 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.748+0000 7f0478c9f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04740b2fb0 con 0x7f0474159f80 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f047415b1e0 0x7f047415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f047415b1e0 0x7f047415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60054/0 (socket says 172.21.15.49:60054) 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 -- 172.21.15.49:0/837914100 learned_addr learned my addr 172.21.15.49:0/837914100 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f04737fe640 1 --2- 172.21.15.49:0/837914100 >> v2:172.21.15.115:3300/0 conn(0x7f0474159f80 0x7f047406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 -- 172.21.15.49:0/837914100 >> v2:172.21.15.115:3300/0 conn(0x7f0474159f80 msgr2=0x7f047406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 --2- 172.21.15.49:0/837914100 >> v2:172.21.15.115:3300/0 conn(0x7f0474159f80 0x7f047406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 -- 172.21.15.49:0/837914100 >> v1:172.21.15.115:6789/0 conn(0x7f047415a8a0 legacy=0x7f047415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.749+0000 7f046bfff640 1 -- 172.21.15.49:0/837914100 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740b1f10 con 0x7f047415b1e0 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.750+0000 7f046bfff640 1 --2- 172.21.15.49:0/837914100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415b1e0 0x7f047415a360 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f04740b3230 tx=0x7f045c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b385ab8dcb700662 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.751+0000 7f0472ffd640 1 -- 172.21.15.49:0/837914100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c036440 con 0x7f047415b1e0 2023-12-19T05:53:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.751+0000 7f0472ffd640 1 -- 172.21.15.49:0/837914100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f045c0365a0 con 0x7f047415b1e0 2023-12-19T05:53:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.751+0000 7f0472ffd640 1 -- 172.21.15.49:0/837914100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c036950 con 0x7f047415b1e0 2023-12-19T05:53:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.751+0000 7f0478c9f640 1 -- 172.21.15.49:0/837914100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415b1e0 msgr2=0x7f047415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.751+0000 7f0478c9f640 1 --2- 172.21.15.49:0/837914100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415b1e0 0x7f047415a360 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f04740b3230 tx=0x7f045c02e170 comp rx=0 tx=0).stop 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 -- 172.21.15.49:0/837914100 shutdown_connections 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 --2- 172.21.15.49:0/837914100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415b1e0 0x7f047415a360 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 --2- 172.21.15.49:0/837914100 >> v2:172.21.15.115:3300/0 conn(0x7f0474159f80 0x7f047406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 -- 172.21.15.49:0/837914100 >> 172.21.15.49:0/837914100 conn(0x7f04740b0100 msgr2=0x7f04740b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 -- 172.21.15.49:0/837914100 shutdown_connections 2023-12-19T05:53:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.752+0000 7f0478c9f640 1 -- 172.21.15.49:0/837914100 wait complete. 2023-12-19T05:53:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.754+0000 7f0478c9f640 1 Processor -- start 2023-12-19T05:53:42.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.754+0000 7f0478c9f640 1 -- start start 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 0x7f0474156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f047415b1e0 0x7f04740ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04741f3840 con 0x7f047415a8a0 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04741f3560 con 0x7f047415b1e0 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.755+0000 7f0478c9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047406b850 con 0x7f0474159f80 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60062/0 (socket says 172.21.15.49:60062) 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 -- 172.21.15.49:0/3654616431 learned_addr learned my addr 172.21.15.49:0/3654616431 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f04737fe640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 0x7f0474156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 -- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 msgr2=0x7f0474156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 0x7f0474156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f0473fff640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f047415b1e0 0x7f04740ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 -- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f047415b1e0 msgr2=0x7f04740ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:42.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f047415b1e0 0x7f04740ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:42.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f046bfff640 1 -- 172.21.15.49:0/3654616431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c00b770 con 0x7f047415a8a0 2023-12-19T05:53:42.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.756+0000 7f04737fe640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 0x7f0474156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f046bfff640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f045c02e1b0 tx=0x7f045c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c034b80 con 0x7f047415a8a0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f045c034d00 con 0x7f047415a8a0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c0416a0 con 0x7f047415a8a0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047406bb30 con 0x7f047415a8a0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.757+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0474157520 con 0x7f047415a8a0 2023-12-19T05:53:42.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.758+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047406b6b0 con 0x7f047415a8a0 2023-12-19T05:53:42.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.759+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f045c0403e0 con 0x7f047415a8a0 2023-12-19T05:53:42.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.760+0000 7f0470ff9640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 0x7f045406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:53:42.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.760+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f045c0aac90 con 0x7f047415a8a0 2023-12-19T05:53:42.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.761+0000 7f04737fe640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 0x7f045406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:53:42.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.762+0000 7f04737fe640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 0x7f045406c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f04740ce420 tx=0x7f0464008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:53:42.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.765+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f047406b6b0 con 0x7f047415a8a0 2023-12-19T05:53:42.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.997+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f047406c050 con 0x7f047415a8a0 2023-12-19T05:53:43.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:42.998+0000 7f0470ff9640 1 -- 172.21.15.49:0/3654616431 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f047406c050 con 0x7f047415a8a0 2023-12-19T05:53:43.000 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-19T05:53:43.000 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1641556346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1641556346},{"type":"v1","addr":"172.21.15.49:6834","nonce":1641556346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3841930976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3841930976},{"type":"v1","addr":"172.21.15.49:6835","nonce":3841930976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2267559805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2267559805},{"type":"v1","addr":"172.21.15.115:6837","nonce":2267559805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8883,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1262946583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1262946583},{"type":"v1","addr":"172.21.15.115:6836","nonce":1262946583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[]} 2023-12-19T05:53:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2023-12-19T05:53:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.001+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 msgr2=0x7f045406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.001+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 0x7f045406c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f04740ce420 tx=0x7f0464008040 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.001+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 msgr2=0x7f04740cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.001+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f045c02e1b0 tx=0x7f045c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 shutdown_connections 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:6832/83870,v1:172.21.15.115:6833/83870] conn(0x7f045406a430 0x7f045406c8f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f047415b1e0 0x7f04740ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f047415a8a0 0x7f04740cc6f0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 --2- 172.21.15.49:0/3654616431 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0474159f80 0x7f0474156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 >> 172.21.15.49:0/3654616431 conn(0x7f04740b0100 msgr2=0x7f04740b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 shutdown_connections 2023-12-19T05:53:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-19T05:53:43.002+0000 7f0478c9f640 1 -- 172.21.15.49:0/3654616431 wait complete. 2023-12-19T05:53:43.022 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T05:53:43.022 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T05:53:43.022 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:53:43.023 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.050 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:53:43.050 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:53:43.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.114 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:53:43.115 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:53:43.115 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.145 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:53:43.145 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T05:53:43.146 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.214 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T05:53:43.214 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T05:53:43.215 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T05:53:43.215 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.277 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T05:53:43.278 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T05:53:43.278 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.326 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T05:53:43.327 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T05:53:43.327 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.426 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T05:53:43.427 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T05:53:43.427 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.477 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T05:53:43.477 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T05:53:43.477 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.575 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T05:53:43.575 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T05:53:43.575 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.638 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T05:53:43.638 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T05:53:43.638 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:43.717 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T05:53:43.718 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T05:53:43.718 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:46.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-19T05:53:49.819 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T05:53:49.820 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T05:53:49.820 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T05:53:49.820 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:52.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-12-19T05:53:52.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-19T05:53:55.563 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-12-19T05:53:55.561+0000 7f156fff7640 -1 calc_pg_upmaps abort due to max <= 0 2023-12-19T05:53:55.922 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T05:53:55.922 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T05:53:55.922 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:56.002 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T05:53:56.002 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T05:53:56.002 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T05:53:56.002 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:56.043 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T05:53:56.044 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T05:53:56.044 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:56.076 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T05:53:56.076 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T05:53:56.076 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:53:56.154 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T05:53:56.155 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T05:53:56.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T05:53:56.281 INFO:teuthology.orchestra.run.smithi049.stdout:2023-12-19T05:38:50.953442+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench result of 115752.610742 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.5. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-19T05:53:56.282 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-19T05:53:56.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T05:53:56.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T05:53:56.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-19T05:53:56.580 INFO:teuthology.orchestra.run.smithi049.stdout:2023-12-19T05:38:50.953442+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench result of 115752.610742 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.5. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-19T05:53:56.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:53:56.582 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T05:53:56.830 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:53:56.830 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T05:53:57.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:53:57.052 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T05:53:57.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-12-19T05:53:57.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:53:57.258 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T05:53:57.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:53:57.403 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T05:53:57.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:53:57.671 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T05:53:57.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:53:57.826 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T05:53:57.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:53:57.974 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T05:53:58.142 INFO:tasks.ceph:Archiving mon data... 2023-12-19T05:53:58.143 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/data/mon.a.tgz 2023-12-19T05:53:58.144 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-12-19T05:53:58.208 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.d1qhZVdqm2 2023-12-19T05:53:58.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.d1qhZVdqm2 2023-12-19T05:53:58.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.d1qhZVdqm2 2023-12-19T05:53:58.619 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.d1qhZVdqm2 is 495KB 2023-12-19T05:53:58.738 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.d1qhZVdqm2 2023-12-19T05:53:58.804 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/data/mon.b.tgz 2023-12-19T05:53:58.804 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-12-19T05:53:58.864 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.o8EAwv0A7B 2023-12-19T05:53:58.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.o8EAwv0A7B 2023-12-19T05:53:59.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.o8EAwv0A7B 2023-12-19T05:53:59.258 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.o8EAwv0A7B is 530KB 2023-12-19T05:53:59.376 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.o8EAwv0A7B 2023-12-19T05:53:59.436 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/data/mon.c.tgz 2023-12-19T05:53:59.437 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-12-19T05:53:59.489 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.dmfbXI2pNi 2023-12-19T05:53:59.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dmfbXI2pNi 2023-12-19T05:53:59.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.dmfbXI2pNi 2023-12-19T05:53:59.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:59.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:59.858 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.dmfbXI2pNi is 530KB 2023-12-19T05:53:59.992 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.dmfbXI2pNi 2023-12-19T05:54:00.051 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T05:54:00.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T05:54:00.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T05:54:00.168 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T05:54:00.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T05:54:00.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T05:54:00.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T05:54:00.285 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T05:54:00.299 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T05:54:00.300 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi049/crash 2023-12-19T05:54:00.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T05:54:00.392 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi115/crash 2023-12-19T05:54:00.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T05:54:00.490 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T05:54:00.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:00.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:00.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:00.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:00.893 INFO:tasks.ceph:Compressing logs... 2023-12-19T05:54:00.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T05:54:00.903 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T05:54:06.568 INFO:tasks.ceph:Archiving logs... 2023-12-19T05:54:06.568 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi049/log 2023-12-19T05:54:06.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T05:54:07.896 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi115/log 2023-12-19T05:54:07.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T05:54:08.600 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T05:54:08.610 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T05:54:08.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T05:54:08.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T05:54:08.778 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T05:54:08.788 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T05:54:08.788 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:54:08.798 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:54:08.850 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:54:08.857 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:54:08.861 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:54:08.861 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-12-19T05:54:08.861 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +162us[ +162us] +/- 78ms 2023-12-19T05:54:08.861 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 7 377 34 +453us[ +477us] +/- 61ms 2023-12-19T05:54:08.861 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -966us[ -966us] +/- 62ms 2023-12-19T05:54:08.862 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:54:08.867 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:54:08.867 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-12-19T05:54:08.867 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +177us[ +177us] +/- 78ms 2023-12-19T05:54:08.867 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 +482us[ +484us] +/- 61ms 2023-12-19T05:54:08.867 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -935us[ -935us] +/- 62ms 2023-12-19T05:54:08.868 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:54:08.869 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T05:54:08.880 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T05:54:08.881 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T05:54:08.889 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T05:54:09.207 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T05:54:09.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:54:09.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:54:09.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:54:09.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:54:09.705 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T05:54:09.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T05:54:09.725 INFO:teuthology.task.internal:Duration was 1721.167115 seconds 2023-12-19T05:54:09.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T05:54:09.741 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T05:54:09.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T05:54:09.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T05:54:09.917 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:54:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:54:10.302 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T05:54:10.303 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2023-12-19T05:54:10.303 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T05:54:10.374 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2023-12-19T05:54:10.374 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T05:54:10.453 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T05:54:10.454 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T05:54:10.463 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T05:54:10.566 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T05:54:10.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T05:54:10.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T05:54:10.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T05:54:10.810 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T05:54:10.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T05:54:10.924 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T05:54:11.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T05:54:11.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T05:54:11.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T05:54:11.163 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2023-12-19T05:54:11.167 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2023-12-19T05:54:11.233 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T05:54:11.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:54:11.288 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T05:54:11.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:54:11.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T05:54:11.358 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T05:54:11.358 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi049 2023-12-19T05:54:11.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T05:54:11.487 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704/remote/smithi115 2023-12-19T05:54:11.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T05:54:11.602 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T05:54:11.602 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T05:54:11.612 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T05:54:11.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T05:54:11.684 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T05:54:11.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T05:54:11.695 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T05:54:11.695 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T05:54:11.704 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T05:54:11.760 INFO:teuthology.orchestra.run.smithi049.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 05:54 /home/ubuntu/cephtest 2023-12-19T05:54:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: 393944 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 05:54 /home/ubuntu/cephtest 2023-12-19T05:54:11.767 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T05:54:11.779 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T05:54:11.802 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T05:54:11.829 DEBUG:teuthology.nuke:shortname: smithi049 2023-12-19T05:54:11.829 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:54:11.852 DEBUG:teuthology.nuke:shortname: smithi115 2023-12-19T05:54:11.852 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:54:11.856 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:55.929794', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPeBqvvW8DTtvuXDBawxojEQ1cjh39iwoN4/skmgEMNEhYsClN7uQ+aEFE12uBDbzeOBF7/A1uPCAr5qmo8E/Q='} 2023-12-19T05:54:11.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:55.928413', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ujCLYD6AB0r79A9zyId+NHg2bt9W8ezhnZOxvepu4+42zEsUWq3f7MJNDOyHONjJ4S2nsf3GBamP79sjGqAY='} 2023-12-19T05:54:11.910 INFO:teuthology.orchestra.console.smithi049:Power off 2023-12-19T05:54:11.910 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:54:11.937 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-12-19T05:54:11.938 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:11.952 INFO:teuthology.orchestra.console.smithi115:Power off 2023-12-19T05:54:11.952 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:54:11.961 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-19T05:54:11.977 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-12-19T05:54:11.978 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:12.000 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-12-19T05:54:15.961 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:16.001 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:16.071 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-19T05:54:16.110 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-12-19T05:54:20.076 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:20.111 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:20.188 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-19T05:54:20.220 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-12-19T05:54:20.290 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-12-19T05:54:24.224 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:54:24.334 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-19T05:54:24.435 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-12-19T05:54:24.541 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1721.1671147346497 failure_reason: '"2023-12-19T05:38:50.953442+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench result of 115752.610742 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.5. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-12-19T05:54:24.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:54:24.642 INFO:teuthology.run:FAIL